Senior Python Data Engineer (I09995)

Function

We're looking for a Senior Python Data Engineer to join our client's team and play a key role in the modernization of a large-scale data platform. You will contribute to the migration of legacy ETL workloads to a modern Python-based ecosystem using technologies such as Parquet and Spark, while helping to enhance an AI-assisted migration framework. Working alongside architects, data engineers, and domain experts, you will combine hands-on development with the continuous improvement of intelligent, agent-driven workflows that automate and accelerate the migration process.

Key Responsibilities

• Design, develop, and validate Python-based data transformation solutions.
• Review, optimize, and enhance AI-generated Python code to ensure quality, maintainability, and performance.
• Support complex migration scenarios that require manual refinement beyond automated code generation.
• Contribute to data quality initiatives, schema management, and Parquet optimization.
• Develop and optimize PySpark-based data processing solutions where appropriate.
• Improve AI-assisted development workflows by enhancing agent orchestration, workflow reliability, traceability, and automation.
• Contribute to the evolution of multi-agent systems responsible for source analysis, functional and technical documentation, Python code generation, validation, and testing.
• Strengthen human-in-the-loop validation processes and identify opportunities to further industrialize the migration factory while maintaining high quality standards.

Your Profile

You are a senior Python Data Engineer with at least five years of hands-on Python development experience and a strong background in data engineering. You have extensive knowledge of Python data processing libraries, including Pandas, Polars, PyArrow, and Parquet, as well as testing frameworks, ETL/ELT processes, schema management, and data quality practices. Experience with PySpark is considered a strong advantage. You are comfortable working with AI-assisted development tools such as GitHub Copilot and have practical experience with agentic workflows, multi-agent systems, workflow orchestration, agent harness engineering, and human-in-the-loop validation.

Nice to Have

Experience with legacy SAS environments is a valuable asset. Familiarity with SAS DATA steps, PROC SQL, SAS macros, and traditional ETL processing patterns will enable you to collaborate effectively with domain experts during migration and validation activities. You enjoy solving complex technical challenges, thrive in collaborative environments, and are passionate about combining software engineering excellence with emerging AI technologies to deliver scalable, high-quality migration solutions.

Contactperson & Reference

• Reference #: INW26985
• Pieter Messely
• pieter.messely@i4m.be