We are looking for an experienced Data Engineer to join the Data & AI team delivering core data platform capabilities. This is a hands-on engineering role focused on designing and building robust Python-based data pipelines, ETL processes, and data models across a modern data platform. The ideal candidate is a strong Python developer with solid SQL skills and a good understanding of data lake architecture. Exposure to data quality tooling/techniques is a valuable plus.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Location: Abu Dhabi Emirate, United Arab Emirates
Work Conditions: On-site, Contract (3 months extendable)
Key Responsibilities:
- Design, build, and maintain end-to-end data pipelines using Python, ensuring reliable data ingestion, transformation, and delivery across the platform.
- Develop and optimise ETL/ELT processes following the Medallion architecture pattern.
- Write clean, modular, production-grade Python code for data processing, orchestration, and automation tasks.
- Support the design and implementation of data models, schemas, and storage strategies to support downstream analytics and reporting.
- Build and maintain SQL-based transformations, stored procedures, and views for data validation and reconciliation.
- Develop and manage data ingestion frameworks, handling various source formats (flat files, APIs, databases, streaming).
- Implement data quality checks and validations within pipelines, applying rules across multiple dimensions.
- Monitor pipeline health, build alerting mechanisms, and troubleshoot data issues in production environments.
- Contribute to CI/CD pipelines, including automated testing, deployment, and version control.
- Produce clear technical documentation for pipelines, data models, and operational runbooks.
Required Skills & Experience:
- Strong Python development skills with hands-on experience building production data pipelines (e.g., pandas, PySpark).
- Solid SQL skills for complex queries, data transformations, and performance tuning.
- Experience designing and implementing ETL/ELT processes at scale.
- Good understanding of the Medallion architecture and modern data lake/lakehouse design patterns.
- Experience with data orchestration tools.
- Working knowledge of cloud data platforms (Azure, AWS, or GCP).
- Familiarity with relational and non-relational databases.
- Strong problem-solving skills with the ability to debug complex data pipeline issues.
Desirable Skills:
- Exposure to data quality tooling (e.g., Informatica IDQ, Microsoft Purview).
- Experience with data cataloguing and lineage tools (e.g., Informatica EDC).
- Familiarity with data governance platforms for policy management and stewardship workflows.
- Knowledge of BI tools for data visualisation and reporting.
Application Contact: Interested candidates can share their CVs at shaloo.rani@the company.
