Pyspark Data Engineer

We are seeking a Pyspark Data Engineer with expertise in Data Architecture, Data Strategy, and Roadmap for large and complex organizations and systems. The successful candidate will implement large scale end-to-end Data Management & Analytics solutions and transform traditional Data Warehousing approaches to Big Data-based methods.

Key Responsibilities:

• Manage risks and data security while implementing data solutions.
• Utilize DW Dimensional modeling techniques, including Star & Snowflake schemas, and manage slowly changing dimensions, dimensional hierarchies, and data classification.
• Work with cloud native principles, designs, and deployments.
• Enhance Continuous Integration (CI) and Continuous Development (CD) environments.
• Oversee Data Quality, Data Profiling, Data Governance, Data Security, Metadata Management, and Data Archival.
• Define workload migration strategies using appropriate tools.
• Drive delivery in a matrixed environment by collaborating with various internal IT partners.
• Thrive in a fast-paced, rapidly changing environment with short deadlines and multiple concurrent tasks/projects.

Qualifications:

• Strong skills in planning, strategy, estimation, and scheduling.
• Excellent problem-solving, influencing, communication, and presentation skills.
• Ability to work independently as a self-starter.
• Hands-on experience with data processing frameworks and platforms (Hadoop, Presto, Tez, Hive, Spark, etc.).
• Proficiency in big data platforms and related programming languages (e.g., Linux, Python, PySpark, GIT, Jenkins).

Location: Dubai, Dubai, United Arab Emirates
Work Conditions: Hybrid, Full-time

Language Requirements: None specified.