The AI Infrastructure Engineer is a platform specialist responsible for architecting, building, and operating high-performance AI infrastructure to support advanced AI workloads, including LLMs, GenAI, Computer Vision, and MLOps. This role will focus on managing GPU clusters (NVIDIA A100/H100), deploying and maintaining Red Hat OpenShift AI (RHODS), and ensuring secure, scalable, and cost-efficient AI platforms across Sovereign Cloud and hybrid/multi-cloud environments. The engineer will enable enterprise-grade AI adoption for over 200 government entities.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Key Responsibilities & Deliverables:
- GPU & AI Platform Architecture: Design and implement GPU-based compute clusters. Define reference architectures for LLM hosting, Vector Databases, MLOps, and high-performance storage/networking.
- GPU Cluster Operations: Install, configure, and optimize core components: CUDA, cuDNN, NCCL, NVIDIA Drivers, and GPU Operators. Implement GPU partitioning, scheduling, and performance tuning for high-end GPUs.
- OpenShift AI (RHODS) Management: Deploy, configure, and maintain the Red Hat OpenShift AI (RHODS) platform for multi-tenant use.
- LLM & Model Serving: Build and manage infrastructure for hosting and serving open-source LLM frameworks (Llama, Falcon, Mistral).
- MLOps & Automation: Implement IaC (Terraform, Ansible) and GitOps for automated lifecycle management of the AI platform.
Required Qualifications & Experience:
- 7–12 years in Cloud Infrastructure, DevOps, ML Infrastructure, or Platform Engineering.
- Deep Hands-On Expertise in GPU Systems (NVIDIA A100/H100), Linux, Containers, and Kubernetes.
- Strong experience in TensorFlow, PyTorch, Hugging Face, and distributed ML training.
Essential Skills & Competencies:
- Technical: Understanding of GPU compute, HPC architectures, and ML performance profiling. IaC (Terraform/Ansible), CI/CD, and OpenShift/Kubernetes operators.
- Soft Skills: Strong troubleshooting, optimization, and performance engineering mindset. Excellent collaboration and documentation skills.
Preferred Certifications:
- NVIDIA Deep Learning / AI Infrastructure Certification
- Red Hat OpenShift AI specialization
- Kubernetes CKA/CKAD
- Azure AI or Oracle Cloud AI certifications
- Terraform & Ansible certifications
Location: Sharjah, Sharjah Emirate, United Arab Emirates
Work Conditions: On-site, Full-time
This role offers a unique opportunity to contribute to cutting-edge AI technology and support a significant transformation in government services.
