BI / Data Engineer
Function
We're looking for a skilled data engineering consultant to join our client's dynamic team. The successful candidate will play a pivotal role in supporting various projects and maintaining essential data management operations. If you possess a strong technical background and an analytical mindset, we want to hear from you.
Responsibilities
As part of your mission, you will be expected to:
- Build, maintain, and optimize comprehensive data pipelines that support both batch and streaming processes.
- Design data models and schemas, and manage data lakes and warehouses effectively.
- Conduct troubleshooting and root-cause analysis for incidents related to data processing.
- Collaborate closely with stakeholders to understand and clarify data requirements and support new data onboarding.
- Operate and enhance the underlying data infrastructure crucial for analytics and reporting.
Role and Profile
The ideal candidate will have:
- Advanced proficiency in SQL, Python, and AWS components such as Glue, S3, and Redshift.
- Extensive experience in constructing and maintaining large-scale data pipelines, as well as optimizing complex SQL queries across substantial datasets.
- A proactive and positive mindset, with the ability to work independently while managing priorities effectively.
- Strong communication skills and the ability to foster collaboration within a team environment.
- A minimum of 10 years of relevant experience in data engineering.
Languages
Fluency in both English and Dutch is required. Additional proficiency in French is considered an asset.
Key Skills
Applicants must demonstrate expertise in the following areas:
- Proficient in AWS (Glue, S3, Redshift).
- Expert in Python development.
- Advanced SQL skills.
In your application, please include responses to the following questions:
- Describe a production data pipeline you built that failed. What caused the failure, and what steps did you take to prevent it from recurring?
- How do you design a data model when business requirements are unclear or subject to change?
- How do you identify a poorly designed SQL query or pipeline, and what is your approach to optimizing it?
Interested candidates are encouraged to apply without direct contact with our client or the hiring manager. Thank you for respecting the application process.