Big Data Engineer – PySpark

The company is seeking a Big Data Engineer specializing in PySpark. The role focuses on utilizing a range of big data technologies, including Hadoop, HDFS, Hive, and the Apache ecosystem, with an emphasis on optimization techniques.

Key Requirements:

• Big Data Technologies: Proficiency in Hadoop, HDFS, Hive, and PySpark (including optimization techniques).
• Data Warehousing & Storage: Understanding of ODS (Operational Data Store), RDB (Relational Database concepts), and general data warehousing concepts.
• Processing & Execution Modes: Experience with cluster and client mode processing.
• Performance & Optimization: Skills in performance tuning and specific PySpark optimization techniques.
• Data & Database Skills: Proficiency in writing and optimizing SQL queries, along with knowledge of data modeling.
• Architecture & Concepts: Basic understanding of data architecture and data warehousing concepts.

Location: Dubai, United Arab Emirates
Work Conditions: On-site, Full-time

If interested, please share your CV at: [email protected].