Pyspark Data Engineer

We are seeking an experienced Pyspark Data Engineer with expertise in Data Architecture, Data Strategy, and the implementation of large-scale end-to-end Data Management and Analytics solutions. The ideal candidate will have a strong background in transforming traditional Data Warehousing approaches to Big Data-based frameworks and a proven track record in managing risks and data security.

Key Responsibilities:

• Design and implement Data Management strategies for large and complex organizations.
• Utilize dimensional modeling techniques, including Star and Snowflake schemas.
• Apply cloud-native principles in systems design and deployment.
• Enhance Continuous Integration (CI) and Continuous Development (CD) environments.
• Maintain high standards of Data Quality, Governance, Security, Metadata Management, and Archival strategies.
• Define workload migration strategies using appropriate technologies.
• Collaborate with various internal IT partners in a matrixed delivery environment.

Required Skills:

• Proficient in data processing frameworks and platforms such as Hadoop, Presto, Tez, Hive, and Spark.
• Hands-on experience with programming languages including Linux, Python, and PySpark.
• Strong problem-solving, influencing, communication, and presentation abilities.
• Capable of working independently while managing multiple tasks/projects in a fast-paced environment.

Location: Dubai, Dubai, United Arab Emirates
Work Conditions: Hybrid, Full-time Language Requirements: None specified.