AI & Data Engineer
Function
Our client is looking for an experienced data professional to help build reusable AI and analytics building blocks that enable faster, easier access to valuable insights from data. The assignment focuses on exploring and validating new data and AI technologies through short feasibility tracks, working in temporary multidisciplinary teams and applying a fail-fast approach to quickly test hypotheses and demonstrate potential.
Responsibilities
- Develop standardized data and AI building blocks as part of a new AI and analytics platform.
- Contribute to feasibility assessments for emerging data and AI technologies.
- Work in short iterative cycles with multidisciplinary teams to validate ideas quickly.
- Focus on proving technical and functional potential through rapid experimentation.
- Support the creation of efficient, high-quality, and data-driven services.
Technical Skills
- Strong experience as a Data Engineer.
- Solid experience with databases.
- Hands-on experience with programming languages such as Python, Java, or Scala for building data flows and ETL processes.
- Proven experience designing and implementing Extract, Transform, Load (ETL) processes.
- Experience with Databricks.
- Experience with data lake solutions, such as Azure Data Lake or Delta Lake.
- Experience with DBT.
- Experience with ETL tools within the Databricks ecosystem to build reliable and scalable pipelines.
- Experience connecting data sources such as databases and APIs to an AI and analytics platform, using standardized building blocks.
- Experience with Infrastructure as Code using Terraform and/or Pulumi.
- Experience with REST APIs.
- Experience with Spark or PySpark for processing large datasets.
Profile
- Ability to work in a structured and hypothesis-driven environment.
- Comfortable collaborating with temporary multidisciplinary teams.
- Capable of validating new ideas quickly and working with an iterative mindset.
- Experience with reliable and scalable data pipeline development is an asset.
- Documented NDA must be signed and uploaded.
Practical Information
Languages required:
- Fluent Dutch at CEFR level C2
The external consultant works from their own laptop with virtual access to the organization’s environments. Interviews are expected to take place within two weeks after the submission deadline. Indexation during the course of the assignment may be possible after at least one year, in line with the organization’s guidelines and subject to prior agreement.
Contactperson & Reference
- Reference #: INW27744
- Geert Roete
- geert.roete@i4m.be