We are seeking a Pyspark Data Engineer with expertise in Data Architecture, Data Strategy, and Roadmap for large and complex organizations and systems. The successful candidate will implement large scale end-to-end Data Management & Analytics solutions and transform traditional Data Warehousing approaches to Big Data-based methods.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Key Responsibilities:
- Manage risks and data security while implementing data solutions.
- Utilize DW Dimensional modeling techniques, including Star & Snowflake schemas, and manage slowly changing dimensions, dimensional hierarchies, and data classification.
- Work with cloud native principles, designs, and deployments.
- Enhance Continuous Integration (CI) and Continuous Development (CD) environments.
- Oversee Data Quality, Data Profiling, Data Governance, Data Security, Metadata Management, and Data Archival.
- Define workload migration strategies using appropriate tools.
- Drive delivery in a matrixed environment by collaborating with various internal IT partners.
- Thrive in a fast-paced, rapidly changing environment with short deadlines and multiple concurrent tasks/projects.
Qualifications:
- Strong skills in planning, strategy, estimation, and scheduling.
- Excellent problem-solving, influencing, communication, and presentation skills.
- Ability to work independently as a self-starter.
- Hands-on experience with data processing frameworks and platforms (Hadoop, Presto, Tez, Hive, Spark, etc.).
- Proficiency in big data platforms and related programming languages (e.g., Linux, Python, PySpark, GIT, Jenkins).
Location: Dubai, Dubai, United Arab Emirates
Work Conditions: Hybrid, Full-time
Language Requirements: None specified.
