Principal QA QC Engineer (AI, Manual & Auto)

Job Description

We are looking for a Senior QA/QC Engineer to ensure the quality and reliability of our AI-driven platform and applications. The ideal candidate has strong analytical skills, practical experience with both manual and automated testing, and thrives in cross-functional teams. You’ll collaborate closely with backend, frontend, and AI engineers to build products that serve millions of users with confidence and consistency.

Responsibilities

• Support evaluation and validation of AI-generated outputs (e.g., LLMs), including prompt testing, edge case exploration, and consistency checking
• Work with AI and product teams to define metrics for subjective quality (e.g., helpfulness, accuracy, coherence) and build repeatable QA processes for them
• Analyze product requirements, clarify ambiguities, and provide test impact assessments
• Design comprehensive test cases based on deep understanding of business logic and technical architecture
• Execute test activities across the development lifecycle, including exploratory, functional, regression, and integration testing
• Create and maintain automated test scripts for web and API testing
• Collaborate with developers and product owners as part of an agile team to ensure high product quality
• Identify, track, and report defects clearly and systematically
• Continuously improve test coverage, testing practices, and QA processes
• Mentor junior QA engineers and contribute to knowledge sharing across teams

Your Skills and Experience

Technical

Must have

• 8+ years of experience in software testing for web and/or mobile applications
• Solid understanding of QA methodologies, testing types, and best practices

• Hands-on experience with:

  (1) Programming or scripting languages (Python is priority, however open for other programming languages, e.g.JavaScript, Shell…)

  (2) Writing and executing test cases

  (3) Automation testing using tools or frameworks (e.g., Selenium, Playwright, Cypress, etc.)

  (4) API testing using Postman or similar tools

  (5) Issue and test case management tools (e.g., Jira, TestRail, Zephyr)

• Familiarity with CI/CD pipelines and how QA fits into the release process
• Ability to read and analyze logs, API responses, and basic frontend/backend code for debugging

Nice to have

• Experience in evaluating or testing AI/ML-based systems, including LLM outputs, hallucination detection, or user feedback loops
• Familiarity with prompt engineering, output evaluation techniques (e.g., rubric-based scoring), or A/B testing for AI features
• Experience working in cross-functional teams with developers, designers, and product managers
• Exposure to performance, security, or accessibility testing
• Familiarity with cloud-based environments (e.g., AWS)
• ISTQB or equivalent software testing certification

Communication

• Proactive communicator with strong collaboration skills
• Experience mentoring junior team members or leading testing initiatives
• Strong ownership and commitment to quality
• Business-level English (speaking, listening, reading and writing)