Data Engineer - PySpark

We are looking for an experienced Data Engineer with expertise in Data Architecture, Data Strategy, and Roadmap for large and complex organizations and systems. The candidate will be responsible for implementing large-scale end-to-end Data Management and Analytics solutions.

Key Responsibilities:

• Transform traditional Data Warehousing approaches to Big Data-based approaches.
• Manage risks and ensure data security.
• Utilize DW dimensional modeling techniques, including Star and Snowflake schemas, modeling slowly changing dimensions and role-playing dimensions, as well as dimensional hierarchies and data classification.
• Apply cloud-native principles, designs, and deployments.
• Enhance Continuous Integration (CI) and Continuous Development (CD) environments.
• Ensure Data Quality, Data Profiling, Data Governance, Data Security, Metadata Management, and Data Archival.
• Define workload migration strategies using appropriate tools.
• Drive delivery in a matrixed environment with various internal IT partners.
• Work independently in a fast-paced environment, managing multiple tasks/projects with short deadlines.

Skills and Experience:

• Strong problem-solving, influencing, communication, and presentation skills.
• Hands-on experience with data processing frameworks and platforms such as Hadoop, Presto, Tez, Hive, and Spark.
• Proficiency in programming languages related to big data platforms, particularly Linux, Python, PySpark, GIT, and Jenkins.

Location: Dubai, Dubai, United Arab Emirates
Work Conditions: Hybrid, Full-time