The AI Infrastructure Engineer is a platform specialist responsible for architecting, building, and operating high-performance AI infrastructure to support advanced AI workloads, including large language models (LLMs), Generative AI, Computer Vision, and MLOps. This role will focus on managing GPU clusters (NVIDIA A100/H100), deploying and maintaining Red Hat OpenShift AI (RHODS), and ensuring secure, scalable, and cost-efficient AI platforms across the Sovereign Cloud and hybrid/multi-cloud environments. The engineer will enable enterprise-grade AI adoption for over 200 government entities.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Key Responsibilities:
- GPU & AI Platform Architecture: Design and implement GPU-based compute clusters, ensuring operational uptime and performance utilization.
- GPU Cluster Operations: Install, configure, and optimize core components such as CUDA, cuDNN, and NVIDIA Drivers while managing performance tuning for high-end GPUs.
- OpenShift AI (RHODS) Management: Deploy and maintain the Red Hat OpenShift AI platform for multi-tenant use.
- LLM & Model Serving: Build infrastructure for hosting and serving open-source LLM frameworks and Vector Databases, ensuring a multi-model serving environment.
- MLOps & Automation: Implement Infrastructure as Code (IaC) and GitOps for automated lifecycle management of the AI platform.
Required Qualifications & Experience:
- 7–12 years of experience in Cloud Infrastructure, DevOps, ML Infrastructure, or Platform Engineering.
- Deep expertise in GPU Systems (NVIDIA A100/H100), Linux, Containers, Kubernetes, and OpenShift AI or equivalent.
- Strong experience with TensorFlow, PyTorch, and ML Ops Stacks (MLflow, Kubeflow).
Skills & Competencies:
- Technical Skills: In-depth understanding of GPU compute, HPC architectures, and ML performance profiling. Proficiency in IaC, CI/CD, and OpenShift/Kubernetes operators.
- Soft Skills: Strong troubleshooting, optimization, performance engineering mindset, and excellent collaboration skills.
Preferred Certifications:
- NVIDIA Deep Learning / AI Infrastructure Certification
- Red Hat OpenShift AI specialization
- Kubernetes certifications (CKA/CKAD)
- Azure AI or Oracle Cloud AI certifications
- Terraform & Ansible certifications
This position offers an excellent opportunity to contribute to the advancement of AI infrastructure within a dynamic and impactful environment.
Work Conditions: On-site, Full-time
Location: Sharjah, Sharjah Emirate, United Arab Emirates
