About the Job
The company is looking for an astute, proficient, and qualified Senior Data Engineer to assess, analyze, and work with data concepts, use-cases & complex new data sources to provide business insights to customers and support the implementation & integration of the data sources into the company AI platform.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Location
Abu Dhabi, Abu Dhabi, United Arab Emirates
Contract
12 months
About the company
The company is the region’s leading big data analytics company powered by Artificial Intelligence (AI). It combines big data, analytics, and AI expertise to create business and positive societal impact.
Responsibilities
- Solve challenging problems using Python coding skills.
- Design, build, and launch new data extraction, transformation & loading processes in production.
- Perform web crawling, data cleaning, data annotation, data ingestion, and data processing.
- Read and collate complex data sets.
- Create and maintain data pipelines.
- Focus on process improvement to drive efficiency and productivity within the team.
- Utilize Python, SQL, ES, Shell, etc., to build the infrastructure required for optimal extraction, transformation, and loading of data.
- Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 3+ years of programming experience with solid coding skills in Python, Shell, and Java.
- Good corporate capacity and communication skills.
- Experience with web crawling and data cleaning.
- Familiarity with solution architecture, data ingestion, query optimization, data segregation, ETL, ELT, AWS, EC2, S3, SQS, Lambda, Elastic Search, Redshift, and CI/CD frameworks.
- Working knowledge of data platform concepts like data lake, data warehouse, ETL, big data processing, and real-time processing architecture.
- Proficiency in SQL and NoSQL databases and understanding data and entity relationships.
- Knowledge of best practices in optimizing columnar and distributed data processing systems.
- Experience in designing and implementing dimensional modeling.
- Knowledge of machine learning and data mining techniques in areas such as statistical modeling, text mining, and information retrieval.
Ideally, you’ll also need
- In-depth market and domain knowledge.
- A passion for constant improvement.
- An innovative and creative approach to problem-solving.
- Excellent communication skills.
What we look for
A performance-driven, inquisitive mind with the agility to adapt to ambiguity. You should be eager to explore opportunities to build meaningful collaborations with stakeholders and aspire to create unique customer-centric solutions. A bias for action and a passion for conquering new frontiers in the AI space is at the heart of the company community.
