Data Platform Engineer
Function
Our client is a leading organization that recently celebrated a significant milestone, demonstrating strong financial growth and commitment to their community. They strongly emphasize sustainable and responsible practices, engaging with the public through innovative projects and initiatives aimed at social, cultural, and sports support. With a burgeoning digital presence, their app has become increasingly popular, reinforcing their connection with users.
Your Mission
As a pivotal member of the Data Platform team, your primary responsibility will be the development and management of a comprehensive data platform hosted in the Microsoft Azure cloud. You will act as an IT Custodian, ensuring design, implementation, and advanced optimization of the big data processing pipeline.
Specifically, your responsibilities will include:
- Processing and transforming the platform's generic data by overseeing data collection, integration, storage, and logic from various sources.
- Conducting data analyses and collaborating with Data Scientists to enhance machine learning models and algorithms.
- Optimizing performance and maintaining the platform to guarantee optimal operation.
The Ideal Candidate
You are a qualified professional with a Bachelor’s or Master’s degree in Data Science or a related field, bringing at least 5 years of experience in data pipelines and cloud technologies. Your expertise includes strong data modeling and data warehousing capabilities, along with familiarity with:
- Apache Spark, Python, and notebooks
- Azure DevOps CI/CD pipelines
- Microsoft SQL or DBT
- Azure Data Platform Stack, including Synapse Analytics, Lakehouse, Fabric, Semantic Model, and Power BI
- Cloud computing, data engineering, big data processing, and performance tuning
- Azure Data Platform architecture
Why This Position is Right for You
This role is perfect for you if:
- You are an expert in Azure data platforms and have experience with Azure & Fabric technology, particularly in data pipeline performance and optimization.
- You are well-versed in DevOps methodologies, applying them in your daily tasks.
- You possess a natural analytical mindset, thriving on solving complex problems.
