Senior Data Engineer

Dautom is seeking a Senior Data Engineer with extensive experience in the Big Data space, particularly with Hadoop Stack technologies such as MapReduce, HDFS, Pig, Hive, HBase, Flume, and Sqoop, as well as NoSQL stores like Cassandra. The ideal candidate will possess strong leadership skills, managing both a Backend/Distributed Data Systems team and a Business Intelligence team, while remaining hands-on in technical duties.

Key Responsibilities:

• Write and tune complex Java, MapReduce, and Hive jobs.
• Manage the business intelligence team and vendor partners, prioritizing projects based on customer and internal needs.
• Develop top-quality dashboards following industry best practices.
• Analyze and confirm the integrity of source data and lead deployment and auditing of models for accuracy.
• Experience with stream-processing systems such as Spark-Streaming and Storm.
• Implement object-oriented and functional scripting using languages like Python and Scala.
• Design and build dimensional data models to enhance data accessibility, efficiency, and quality.
• Proficiency in writing advanced SQLs and performance tuning of SQLs.
• Familiarity with data science and machine learning tools is a plus.
• Knowledge of relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with Azure cloud services and financial services knowledge are advantageous.

Requirements:

• Minimum 10 years of experience as a Big Data Engineer.
• In-depth knowledge of Hadoop (Cloudera), Spark, and similar frameworks.
• Proficient in Big Data querying tools such as Pig, Hive, and Impala.
• Strong knowledge of scripting languages including Java, C++, Ruby, PHP, Python, and R.
• Ability to solve complex networking, data, and software issues.
• Strong organizational skills and effective work planning.
• Excellent interpersonal communication skills for collaborative team dynamics.

Location: Dubai, United Arab Emirates
Work Conditions: On-site, Full-time

Language Requirements: Not specified.