Data & Platform Engineer Azure/Fabric
Function
We're looking for a skilled professional to join our client's team focused on data management and platform engineering. This position involves ensuring the seamless operation and enhancement of data solutions, and while remote work is possible, a presence on-site in Gosselies for at least two days a week is required. Given the site's transport accessibility, having a valid driver's license and a vehicle is preferred.
Responsibilities
The successful candidate will undertake a variety of tasks that primarily focus on data engineering and platform management.
- Develop ingestion flows using Fabric Data Factory and comprehend Azure Data Factory.
- Create data transformation flows using Fabric Factory Notebook.
- Optimize transformation queries considering Azure costs.
- Contribute to the modeling of the Lake House.
- Establish technical designs and implement a medallion architecture within Microsoft Fabric.
- Develop and execute automated unit test plans.
- Document technical aspects and contribute to ongoing improvements.
- Manage and monitor the Microsoft Fabric platform, ensuring its optimal configuration and performance.
- Collaborate with teams to support platform issues, incident analysis, and service reliability enhancements.
Profile of the Ideal Candidate
Candidates should possess a strong technical background with a proven ability to document and standardize practices while working across different technical teams. The following skills and qualifications are essential:
- Fluency in English and French.
- Experience in SaaS infrastructure roles (builder, administrator, etc.) and data engineering roles.
- Proven proficiency with Spark framework (PySpark) and Python programming.
- Experience with SQL and/or T-SQL.
- Familiarity with Azure ecosystem and Microsoft Fabric.
- Strong understanding of data platform security principles and quality coding practices.
- Experience with Infrastructure as Code (IaC) and Git & CI/CD workflows.
Prior certifications such as Azure Administrator Associate and Fabric Data Engineer Associate are preferred. The role requires a high level of integrity and the ability to handle confidential data, necessitating a reference check as per ISO27001 standards for shortlisted candidates. We look forward to welcoming a proactive team member who thrives in a collaborative environment and is keen to make a meaningful impact within our client’s organization.