Position

Cognizant is seeking a highly skilled Senior Engineer with extensive experience in data engineering to join our team. The ideal candidate will have a strong foundation in Databricks, PySpark, Azure Data Factory (ADF), and query optimization techniques, focusing on building metadata-driven ETL pipelines. This role will be instrumental in designing, developing, and maintaining robust data pipelines that can adapt to evolving data landscapes.

Location: Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates
Work Conditions: Hybrid, Full-time

Key Responsibilities:

Design, develop, and maintain scalable, metadata-driven ETL pipelines using Databricks, PySpark, and ADF.
Create and manage data catalogs and metadata repositories.
Implement automated data lineage and impact analysis to ensure data quality and traceability.
Optimize query performance and data processing efficiency to meet stringent SLAs.
Collaborate with data analysts and scientists to understand data requirements and translate them into technical solutions.
Troubleshoot and resolve data-related issues promptly.
Mentor and guide junior team members in data engineering best practices.

Job Requirements: