Quality Assurance Engineer

About the Job:

The Quality Assurance Engineer plays a critical role in executing and automating functional and non-functional testing for Generative AI-driven applications. This role ensures that AI models, APIs, and user interfaces are reliable, scalable, and secure by implementing robust test cases and automation frameworks.

Key Responsibilities:

• Functional Testing:

  • Execute end-to-end (E2E) and integration testing to validate AI-driven actions.
  • Validate workflows, user journeys, API interactions, and AI model outputs against business logic.
  • Conduct UI/UX testing to ensure accessibility, responsiveness, and usability across devices and browsers.
  • Support user acceptance testing activities.

• Data and AI Model Validation:

  • Validate input datasets for training, testing, and tuning AI models.
  • Ensure data integrity, preprocessing workflows, and real-world alignment of synthetic data.
  • Validate data pipelines and test models against predefined scenarios, including edge cases.

• Non-Functional Testing:

  • Support performance, load, and stress testing using tools such as JMeter.
  • Simulate heavy traffic to test scalability and identify vulnerabilities in data handling and API endpoints.
  • Ensure secure handling of sensitive data used in AI processes.

• Deployment and Post-Deployment Testing:

  • Automate test cases for regression testing.
  • Validate new builds, releases, and updates continuously.
  • Track defects and monitor production model performance for quality improvements.

• Automation & API Testing:

  • Implement test automation for functional and regression testing using Selenium, Cypress, and Robot Framework.
  • Conduct API testing using Postman and SoapUI.
  • Assist in security and compliance validation to ensure data protection and regulatory adherence.

Skills and Experience:

• Experience in quality assurance with a focus on functional and integration testing.
• Proficiency in test automation tools (e.g., Selenium, Cypress) and API testing (e.g., Postman, SoapUI).
• Working experience in Python is required; familiarity with LLM evaluation is a plus.
• Strong knowledge of AI model validation techniques and data integrity testing.
• Familiarity with performance testing tools (e.g., JMeter) and security best practices.
• Experience working in agile environments with CI/CD pipeline integration.
• Strong analytical skills with attention to detail in test execution and reporting.

Location: Al Khobar, Eastern, Saudi Arabia (On-site)

Job Type: Full-time

Language Requirements: (If applicable, please specify any language requirements here.)