As a Data Engineer, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are reliable, scalable, and secure. Your work will be crucial in enabling data-driven decision-making across the organization.
The Data Engineer is a key technical role focused on developing and optimizing the company's data infrastructure. This role involves designing and implementing data pipelines, ensuring data quality, and collaborating with cross-functional teams to support various data initiatives. The ideal candidate will have strong technical skills in data engineering, experience with data architectures, and a passion for working with data.
Inception is the UAE’s national-scale enabler in AI Research and Development, partnering with Microsoft to offer domain-specific AI platforms. We focus on AI incubation, applied AI R&D, and investment products, ensuring superior accuracy and efficiency through tailored models.
Key Responsibilities:
- Design and maintain highly scalable data pipelines with a focus on machine learning models and analytics.
- Work closely with data scientists and ML engineers to ensure data accessibility and reliability.
- Develop and maintain APIs for data access and integrate with external data services.
- Manage and optimize storage solutions for structured and unstructured data.
- Implement processes to monitor data quality and ensure accurate production data.
- Collaborate with ML engineers on data-related technical issues and provide architectural guidance.
- Ensure compliance with data security and privacy policies.
- Maintain clear and up-to-date documentation, including data dictionaries and architectural diagrams.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.
- 3+ years of experience in a Data Engineering role.
- Proficient in programming languages such as Python, Java, and Scala.
- Hands-on experience with big data technologies (e.g., Hadoop, Spark, Flink).
- Familiarity with machine learning frameworks (e.g., TensorFlow, PyTorch).
- Strong understanding of data warehousing, ETL processes, and data modeling.
- Experience with API development and cloud platforms (e.g., Azure).
- Knowledge of DevOps, CI/CD methods, and containerization technologies (e.g., Docker, Kubernetes).
- Experience with real-time/streaming data processing.
Languages:
No specific language requirements mentioned.
Culture and Benefits:
- An open, diverse, and inclusive environment that encourages personal growth.
- Outstanding learning, development, and growth opportunities through structured training programs.
- Hybrid work policy to balance office and home work.
- Competitive remuneration package with perks including healthcare, education support, and leave benefits.
If you meet the criteria above, please apply as soon as possible.
