The Data Engineer plays a crucial role in developing and optimizing our data architecture to support data-driven initiatives and enhance overall business intelligence.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Key Accountabilities:
- Design, implement, and maintain scalable and robust data architecture to support business needs.
- Collaborate with stakeholders to understand data requirements and ensure alignment with organizational goals.
- Develop and implement efficient Extract, Transform, Load (ETL) processes to integrate data from various sources.
- Ensure data integrity and quality throughout the ETL pipeline.
- Develop and implement event streaming frameworks and services (e.g., Kafka).
- Design and manage relational and non-relational databases, ensuring optimal performance and scalability.
- Implement database optimization strategies and conduct performance tuning.
- Utilize big data technologies (Hadoop, Spark, Kafka) to process and analyze large volumes of data.
- Implement solutions for real-time data streaming and processing.
- Develop and maintain data models for efficient storage and retrieval of information.
- Collaborate with data scientists and analysts on data requirements for analytical purposes.
- Create and maintain metadata repositories, documenting data lineage, definitions, and relationships.
- Implement and enforce metadata management best practices.
- Implement data quality checks and validation processes to ensure accuracy and reliability.
- Collaborate with cross-functional teams to address and resolve data-related issues.
Stakeholder Management:
- Manage all external entities with development scope under core functionality of Data and BI Engineering.
Qualification & Education:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Data Engineer or in a similar role.
Overall Experience:
- 8–9 years of experience from a leading stock exchange industry (e.g., Dubai, London, etc.).
- Candidate must be currently working for and available in the UAE.
Technical Skills:
- Strong proficiency in SQL and database management systems (e.g., MySQL, PostgreSQL, MongoDB).
- Experience with big data technologies (Hadoop, Spark) and data processing frameworks.
- Knowledge of ETL tools and techniques.
- Knowledge of DevOps practices.
- Knowledge of event streaming frameworks (Kafka, Event Hub, Apache Storm, Stream Analytics, etc.).
Non-Technical Skills:
- Excellent problem-solving and analytical skills.
Location: Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates
Contract Duration: 12 months (renewable to long term or made permanent)
Work Conditions: On-site
