Pyspark Data Engineer

We are seeking a skilled Pyspark Data Engineer to join our team at the company. The ideal candidate will have expertise in Data Architecture, Data Strategy, and the implementation of large-scale end-to-end Data Management and Analytics solutions for large and complex organizations.

Location: Dubai, Dubai, United Arab Emirates
Work Conditions: Hybrid, Full-time

Key Responsibilities:

• Transform traditional Data Warehousing approaches to Big Data-based methodologies.
• Manage risks and ensure data security throughout the data lifecycle.
• Utilize DW Dimensional modeling techniques including Star & Snowflake schemas, modeling slowly changing dimensions, and dimensional hierarchies.
• Define workload migration strategies using appropriate tools.
• Collaborate effectively in a matrixed environment with various internal IT partners.
• Work independently and manage multiple tasks/projects simultaneously in a fast-paced environment.

Required Skills and Experience:

• Extensive experience with Continuous Integration (CI) and Continuous Development (CD) environments.
• Proficiency in Data Quality, Data Profiling, Data Governance, Data Security, Metadata Management, and Data Archival.
• Hands-on experience with big data platforms and related programming languages (e.g., Linux, Python, PySpark, GIT, Jenkins).
• Familiarity with data processing frameworks and platforms such as Hadoop, Presto, Tez, Hive, and Spark.
• Strong problem-solving, influencing, communication, and presentation skills.