Senior Data Engineer

General Description

We're looking for a consultant to join our client's team as they embark on an ambitious project to enhance the quality of collected data through a robust validation engine. This engine, built using Python and Databricks, is pivotal in ensuring the consistency and integrity of information exchanged among various stakeholders. The success of this initiative relies heavily on a solid technical design and collaborative efforts among multiple organizations.

In this context, the individual will assume the role of technical and architectural owner for the validation engine, guaranteeing consistency and alignment while supervising a dedicated developer. As part of a multidisciplinary agile team, you will participate in a collaborative environment that includes data engineers, functional analysts, AI professionals, and more to deliver impactful data solutions. Knowledge in a variety of technologies like MS SQL Server, SSIS, SAS, Azure, and Power BI will be beneficial in this role.

The responsibilities for this position include:

• Defining the technical architecture of the validation engine.
• Collaborating closely with the Data Governance team and stakeholders to establish functional design and business requirements.
• Overseeing the development process and ensuring the quality of integrations into cloud environments.
• Documenting architecture decisions and best practices and acting as a technical reference for the team.
• Supervising a dedicated developer while engaging in testing and challenging technical choices.

The ideal candidate will possess:

• A Master's degree in Computer Science or a related field.
• Over 10 years of experience in software engineering, with an emphasis on backend architecture and design.
• Expertise in Python and Databricks with experience in ETL/ELT processes and data validation.
• Strong background in cloud environments, especially Azure.
• Excellent communication skills for effective stakeholder management and the ability to translate business requirements into technical specifications.
• Fluency in English and Dutch.

The ideal candidate will combine technical leadership with diplomacy skills, ensuring the quality of technical outputs without direct involvement in development tasks. They will need to demonstrate excellent interpersonal skills and a strategic mindset focused on data quality and effective validation processes.

With a long-term vision for supporting data initiatives, this role offers the chance to make a meaningful impact in the realm of data services while enjoying numerous benefits, such as flexible working hours, opportunities for self-development, and a supportive work environment. If you are passionate about data and excited about leading technical initiatives, we encourage you to apply!