We are seeking a skilled Pyspark Data Engineer to join our team at the company. The ideal candidate will have expertise in Data Architecture, Data Strategy, and the implementation of large-scale end-to-end Data Management and Analytics solutions for large and complex organizations.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Location: Dubai, Dubai, United Arab Emirates
Work Conditions: Hybrid, Full-time
Key Responsibilities:
- Transform traditional Data Warehousing approaches to Big Data-based methodologies.
- Manage risks and ensure data security throughout the data lifecycle.
- Utilize DW Dimensional modeling techniques including Star & Snowflake schemas, modeling slowly changing dimensions, and dimensional hierarchies.
- Define workload migration strategies using appropriate tools.
- Collaborate effectively in a matrixed environment with various internal IT partners.
- Work independently and manage multiple tasks/projects simultaneously in a fast-paced environment.
Required Skills and Experience:
- Extensive experience with Continuous Integration (CI) and Continuous Development (CD) environments.
- Proficiency in Data Quality, Data Profiling, Data Governance, Data Security, Metadata Management, and Data Archival.
- Hands-on experience with big data platforms and related programming languages (e.g., Linux, Python, PySpark, GIT, Jenkins).
- Familiarity with data processing frameworks and platforms such as Hadoop, Presto, Tez, Hive, and Spark.
- Strong problem-solving, influencing, communication, and presentation skills.
