Data Engineer DataOps

We are looking for a hands-on DataOps Engineer with 7-10 years of experience who can operate across both data engineering and platform operations. This role requires deep expertise in Databricks along with strong DataOps practices to ensure scalable, reliable, and automated data pipelines. The ideal candidate is comfortable building complex workloads and managing the underlying platform components.

Key Responsibilities:

• Develop, optimize, and maintain data pipelines using Databricks (PySpark, SQL, Delta Lake).
• Implement DataOps best practices including CI/CD, automated testing, version control, and environment management.
• Manage Databricks platform operations: clusters, jobs, permissions, workspace configuration, and performance tuning.
• Build monitoring and observability for pipelines, data quality, and platform health.
• Troubleshoot production issues across both pipeline logic and platform infrastructure.
• Collaborate with data engineers, platform teams, and DevOps to streamline deployments and improve reliability.
• Contribute to metadata-driven frameworks, governance standards, and operational automation.

Required Skills:

• Strong hands-on experience with Databricks (notebooks, jobs, clusters, Delta Lake).
• Solid understanding of DataOps concepts: automation, CI/CD, testing, governance.
• Proficiency in PySpark, SQL, and distributed data processing.
• Experience with DevOps features.

Location: Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates
Work Conditions: On-site, Full-time
Language Requirements: Not specified.