As a Senior Data Engineer, you will play a crucial role in building and maintaining the infrastructure for data collection, processing, and storage. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data systems are reliable, scalable, and secure. Your responsibilities will include developing and optimizing the data infrastructure, designing and implementing data pipelines, ensuring data quality, and collaborating with cross-functional teams to support various data initiatives.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Responsibilities:
- Design, construct, install, test, and maintain scalable data pipelines focused on machine learning models and analytics.
- Collaborate with data scientists and stakeholders to ensure data accessibility and reliability.
- Develop and maintain APIs for data access and integrate with external data services.
- Manage and optimize solutions for structured and unstructured data, including relational databases and NoSQL databases.
- Implement processes to monitor and ensure data quality is accurate and available for stakeholders.
- Ensure compliance with data security and privacy policies.
- Maintain documentation, including data dictionaries and architectural diagrams.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field, or equivalent work experience.
- 7+ years of experience in a Data Engineering role.
- Proficiency in programming languages such as Python and SQL.
- Hands-on experience with big data technologies like Spark (PySpark/Scala) and Flink.
- Familiarity with machine learning frameworks such as TensorFlow or PyTorch.
- Strong understanding of data warehousing, ETL processes, and data modeling.
- Experience with API development and cloud platforms like Azure.
- Knowledge of DevOps, CI/CD methods, and containerization technologies like Docker or Kubernetes.
- Experience with real-time/streaming data processing.
Technical Skills:
- Programming Languages: Python, SQL
- Query Engine: Trino
- Big Data Technologies: Spark, Flink
- Databases: Clickhouse, MySQL, PostgreSQL, MongoDB, Cassandra, HBase, Redis
- Cloud Platforms: Azure
- API Development: RESTful APIs, GraphQL
- Data Services: Kafka, RabbitMQ
- Containers: Docker, Kubernetes
Work Conditions: Full-time, On-site in Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates.
About the Company:
The company is an ADX-listed public company, majority-owned by Abu Dhabi-based G42, and is a leading company in big data analytics powered by GenAI. The company integrates big data, analytics, and AI expertise to create positive business and societal impact across various sectors. The company offers a range of GenAI-driven products and solutions designed to help both public and private sectors achieve their AI strategies efficiently.
