Technology Innovation Institute (TII) is a publicly funded research institute based in Abu Dhabi, United Arab Emirates. TII is home to a diverse community of leading scientists, engineers, mathematicians, and researchers who work together to transform problems into pioneering research and technology prototypes. The Artificial Intelligence Cross-Center Unit at TII focuses on machine learning, collaborating closely with other research centers to integrate AI benefits across various sectors such as technology, healthcare, and cybersecurity. The unit works on advanced AI methodologies and technologies to address challenging issues, incorporating elements of intelligence in the ideation and prototyping of next-generation systems with human-like capabilities.
Responsibilities:
- Design, develop, and maintain scalable data pipelines to support LLM training and inference.
- Implement ETL processes to ingest, transform, and store data from various sources, including text corpora and user-generated content.
- Develop well-structured, maintainable code and create comprehensive unit tests.
- Monitor and troubleshoot data pipeline performance to implement improvements.
- Collaborate with data scientists and ML engineers to meet data requirements and ensure data quality and availability.
- Manage data infrastructure ensuring reliability and scalability.
- Lead a team of data professionals to deliver data solutions effectively.
- Design and implement CI/CD pipelines to automate testing and deployment processes.
- Stay updated on industry trends in data engineering and LLMs.
Qualifications:
- MSc degree in Software Engineering, Analytics, Data Science, Machine Learning, or a related field with 5+ years of relevant experience.
- Proven experience as a Data Engineer with a focus on large-scale data processing and analytics.
- Proficiency in languages such as Python, C++, Scala, or Java.
- Experience with version control systems (e.g., Git).
- Comfortable with Linux administration.
- Knowledge of data pipeline frameworks and ETL tools (e.g., Apache Spark, SQL DB).
- Familiarity with cloud computing platforms such as AWS, GCP, and Azure.
- Experience with various data types (text, images, audio, and video).
- Skills in web scraping, web crawling, and optimizing large-scale data processing.
- Familiarity with high-performance computing tools (e.g., SLURM, SageMaker).
Soft Skills:
- Strong problem-solving skills and attention to detail.
- Eagerness to learn and adapt to new technologies.
- Excellent communication skills for sharing insights effectively.
- Ability to work collaboratively in a multicultural environment.
Language Requirements:
Not specifically mentioned, but proficiency in English may be inferred as necessary for communication in a multicultural environment.
