As a Senior Data Engineer at the company, you will play a crucial role in designing and implementing data solutions that drive business insights. The position requires a bachelor's degree in Computer Engineering, Computer Science, or Electrical Engineering, along with a minimum of 6 years of programming experience, particularly in Python, SQL, and Java.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Responsibilities
- Solve challenging problems using Python coding skills.
- Design, build, and launch new data extraction, transformation, and loading processes in production.
- Perform web crawling, data cleaning, data annotation, data ingestion, and data processing.
- Read and collate complex data sets, creating and maintaining data pipelines.
- Maintain a continual focus on process improvement to drive efficiency and productivity within the team.
- Utilize Python, SQL, Shell, etc., to build the infrastructure required for optimal extraction, transformation, and loading of data.
- Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline.
- Support the wider business with their data needs on an ad hoc basis.
- Comply with QHSE (Quality Health Safety and Environment), Business Continuity, Information Security, Privacy, Risk, Compliance Management, and Governance of Organizations policies, procedures, plans, and related risk assessments.
Qualifications
- Bachelor's degree in Computer Engineering, Computer Science, or Electrical Engineering.
- 6+ years of programming experience with solid coding skills in Python, Shell, and Java.
- Good communication skills and corporate capacity.
- Experience with web crawling and data cleaning.
- Familiarity with solution architecture, data ingestion, query optimization, data segregation, ETL, ELT, AWS, EC2, S3, SQS, Lambda, Elastic Search, Redshift, and CI/CD frameworks and workflows.
- Working knowledge of data platform concepts (data lake, data warehouse, ETL, big data processing, and real-time processing architecture).
- Proficient in PostgreSQL and programming (preferably Java, Python); strong understanding of data, entity relationships, and both structured & unstructured data.
- Knowledge of the best practices in optimizing columnar and distributed data processing systems and infrastructure.
- Experience in designing and implementing dimensional modeling.
- Knowledge of machine learning and data mining techniques in areas such as statistical modeling, text mining, and information retrieval.
