We are seeking a highly skilled LLM Ops Engineer to lead the deployment, scaling, monitoring, and optimization of large language models (LLMs) across diverse environments. This role is critical to ensuring our machine learning systems are production-ready, high-performing, and resilient. The ideal candidate will have deep expertise in Python programming, a comprehensive understanding of LLM internals, and hands-on experience with various agentic frameworks, inference engines, and deployment strategies. This position offers the opportunity to work on cutting-edge AI technologies in a dynamic and collaborative environment.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Responsibilities
- Design, deploy, and scale LLM infrastructure across cloud and on-premises environments, ensuring high performance, reliability, and fault tolerance.
- Build and optimize inference pipelines for low-latency, high-throughput model serving.
- Manage CI/CD pipelines, AI microservices, embeddings storage, and maintenance of agentic AI frameworks and LLM gateways.
- Monitor performance, cost, and resource usage; implement optimization strategies for efficiency while maintaining scalability and reliability.
- Collaborate with data scientists and engineers to operationalize models and workflows into production-grade systems.
Qualifications
- Bachelor’s or Master’s degree in computer science, machine learning, or related field, with 2+ years of experience in ML Ops, DevOps, or ML infrastructure.
- Strong Python and scripting skills, with experience in containerization and orchestration.
- Expertise in GPU cluster management, distributed inference, and scalable architectures.
- Proficiency with cloud/hybrid environments and knowledge of security and compliance requirements.
Preferred Qualifications
- Experience deploying and maintaining agentic AI frameworks for LLM-tool integration.
- Familiarity with LLM orchestration, API integrations, and distributed inference frameworks.
- Hands-on experience with LLM optimization techniques and infrastructure-as-code tools for large-scale ML deployments.
- Understanding of compliance and governance standards for operational AI systems.
What We Look For
If you are a performance-driven, inquisitive mind with the agility to adapt to ambiguity, you will fit right in. You should be eager to explore opportunities to build meaningful collaborations with stakeholders and aspire to create unique customer-centric solutions. Bias for action and a passion to conquer new frontiers is at the heart of the Presight community.
