We are looking for a Databricks Developer with strong expertise in SQL, Python, Apache Spark, data pipelines, analytics, reporting, and AI workloads. The role focuses on building scalable data solutions on the Databricks platform to support enterprise analytics, reporting, and AI/ML initiatives.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
About Us:
The company is an IT services, consulting, and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 50 years. The company offers a consulting-led, cognitive powered, integrated portfolio of business, technology, and engineering services and solutions delivered through its unique Location Independent Agile™ delivery model. The company has over 616,171 trained consultants from 157 nationalities in 53 countries.
Key Responsibilities:
-
Databricks & Spark Development:
- Design, develop, and optimize data engineering solutions on Databricks.
- Build high-performance Apache Spark jobs using PySpark and Spark SQL.
- Develop and manage Databricks notebooks, jobs, and workflows.
- Optimize Spark performance, cluster configuration, and cost efficiency.
-
Data Pipelines & Processing:
- Build and maintain robust ETL/ELT pipelines using Python, Spark, and Databricks.
- Process large-scale structured and semi-structured datasets.
- Ensure data quality, reliability, and scalability of pipelines.
- Implement reusable and modular pipeline frameworks.
-
Analytics & Reporting Enablement:
- Create analytics-ready datasets using strong SQL modeling.
- Support BI and reporting platforms by delivering accurate and timely data.
- Collaborate with analytics teams to understand business requirements.
- Improve query performance for dashboards and reports.
-
AI & Advanced Workloads:
- Prepare and curate data for AI/ML workloads on Databricks.
- Support feature engineering, model training, and batch/real-time scoring pipelines.
- Work closely with Data Scientists to operationalize AI solutions.
- Enable end-to-end data workflows for AI-driven use cases.
-
Collaboration & Governance:
- Partner with Data Science, Analytics, and Platform teams.
- Ensure adherence to data governance, security, and compliance standards.
- Document pipelines, data models, and operational processes.
- Participate in code reviews and best practice definition.
Required Skills:
- Strong experience in SQL (complex queries, performance tuning).
- Proficiency in Python for data engineering and analytics.
- Hands-on experience with Apache Spark (PySpark / Spark SQL).
- Proven experience as a Databricks Developer.
- Expertise in data pipelines and ETL/ELT frameworks.
- Experience supporting analytics and reporting use cases.
- Exposure to AI/ML data workloads and large-scale analytics platforms.
Core Competencies:
- Strong analytical and problem-solving abilities.
- Experience handling large and complex datasets.
- Ability to translate business requirements into technical solutions.
- Good communication and stakeholder engagement skills.
Good to Have:
- Experience with Databricks Delta Lake, Unity Catalog, or MLflow.
- BFSI / enterprise analytics experience.
- Familiarity with cloud platforms (Azure, AWS, or GCP).
- Knowledge of data quality checks and monitoring frameworks.
Location:
Dubai, United Arab Emirates
Job Type:
Full-time
Application Deadline:
12-June-2026
Language Requirements:
Fluency in English is likely required, though specific language requirements are not explicitly stated.
