Senior Data Engineer

As a Senior Data Engineer at Dautom, you will design, implement, and maintain scalable and robust data architecture to support business needs. Key responsibilities include:

• Collaborating with stakeholders to understand data requirements and ensure alignment with organizational goals.
• Developing and implementing efficient Extract, Transform, Load (ETL) processes to integrate data from various sources into a unified format.
• Ensuring data integrity and quality throughout the ETL pipeline.
• Developing and implementing an event streaming framework and services.
• Designing and managing relational and non-relational databases, ensuring optimal performance and scalability.
• Implementing database optimization strategies and conducting performance tuning.
• Utilizing big data technologies such as Hadoop, Spark, and Kafka to process and analyze large volumes of data.
• Implementing solutions for real-time data streaming and processing.
• Developing and maintaining data models for efficient storage and retrieval of information.
• Collaborating with data scientists and analysts to understand data requirements for analytical purposes.
• Creating and maintaining metadata repositories, documenting data lineage, definitions, and relationships.
• Implementing and enforcing metadata management best practices.
• Implementing data quality checks and validation processes to ensure accuracy and reliability of data.
• Collaborating with cross-functional teams to address and resolve data-related issues.

Qualifications:

• Bachelor’s degree in computer science, Information Technology or a related field.
• Proven experience as a Data Engineer or in a similar role, with 8 - 9 years of overall experience.

Technical Skills:

• Strong proficiency in SQL and database management systems (e.g., MySQL, PostgreSQL, MongoDB).
• Experience with big data technologies (Hadoop, Spark) and data processing frameworks.
• Knowledge of ETL tools and techniques.
• Familiarity with DevOps practices.
• Understanding of event streaming frameworks (Kafka, Event Hub, Apache Storm, Stream Analytics, etc.).

Non-Technical Skills:

• Excellent problem-solving and analytical skills.

Work Conditions:
On-site, Contract
Location:
Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates.