Data Engineer

We are seeking a Data Engineer with 5–8 years of experience to design and build data pipelines using Apache Spark, Databricks, or equivalent big data frameworks. The ideal candidate will possess hands-on expertise with streaming and messaging systems, such as Apache Kafka, Confluent Cloud, RabbitMQ, or Azure Event Hub. Responsibilities include:

• Creating producers, consumers, and topics, and integrating them into downstream processing.
• Deep understanding of relational databases and Change Data Capture (CDC).
• Proficiency in SQL Server, Oracle, or other RDBMSs; experience with tools such as Debezium for capturing change events and transforming data for downstream consumption.
• Proficiency in programming languages such as Python, Scala, or Java, along with solid knowledge of SQL for data manipulation and transformation.
• Expertise in cloud platforms, specifically with Azure or AWS services for data storage, compute, and orchestration (e.g., ADLS, S3, Azure Data Factory, AWS Glue, Airflow, DBX, DLT).
• Knowledge of data modeling and warehousing, including data lakehouse architectures, Delta Lake, partitioning strategies, and performance optimization.
• Familiarity with version control and DevOps practices, including Git and CI/CD pipelines, with the ability to automate deployment and manage infrastructure as code.
• Strong problem-solving and communication skills, with the ability to work with cross-functional teams and articulate complex technical concepts to non-technical stakeholders.

Preferred/Bonus Skills:

• Experience with event-driven architectures and microservices integration.
• Exposure to NiFi, Flume, or other ingestion frameworks for connecting heterogeneous sources.
• Knowledge of graph processing or machine learning pipelines on Spark.

Location: Dubai, Dubai, United Arab Emirates

Work Conditions: Hybrid, Full-time