🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
Position: AI Tester Experience: 2 - 8 Years Location: Kolkata (Onsite) Employment Type: Full-Time About the Role We are looking for a skilled and detail-oriented AI Tester to join our Quality Engineering team. The ideal candidate should have hands-on experience in testing AI/ML and Generative AI (GenAI) applications, with expertise in validating model behavior, prompt engineering, API testing, automation, and performance testing. You will play a key role in ensuring the quality, reliability, fairness, and performance of AI-powered solutions. Key Responsibilities Design, develop, and execute test strategies for AI/ML and Generative AI applications. Perform functional and non-functional testing to ensure application quality and reliability. Validate Large Language Model (LLM) responses through prompt testing and prompt validation. Conduct AI model evaluation by assessing accuracy, consistency, robustness, and reliability. Perform bias, hallucination, toxicity, and fairness testing to ensure responsible AI practices. Validate AI quality metrics such as precision, recall, accuracy, latency, and response relevance. Develop and maintain automation test frameworks for AI-driven applications. Perform API testing using tools such as Postman, REST Assured, or similar frameworks. Execute performance, load, and scalability testing for AI services and APIs. Identify, document, track, and verify defects throughout the software development lifecycle. Collaborate closely with AI Engineers, Data Scientists, Developers, and Product Teams to ensure high-quality AI solutions. Contribute to continuous improvement of AI testing methodologies, processes, and automation. Required Skills 2-8 years of experience in Software Testing, including experience testing AI/ML or Generative AI applications. Hands-on experience in functional and non-functional testing. Experience with prompt testing, prompt validation, and LLM response evaluation. Strong understanding of AI model evaluation techniques and quality assessment. Knowledge of AI quality metrics, bias detection, hallucination testing, fairness, and responsible AI validation. Experience in API testing using REST APIs and related tools. Experience with automation testing frameworks (Selenium, Playwright, Cypress, or similar). Experience in performance testing using tools such as JMeter, LoadRunner, or equivalent. Good understanding of software testing methodologies, defect lifecycle, and Agile practices. Strong analytical, troubleshooting, and communication skills. Preferred Qualifications Exposure to AI/ML frameworks and LLM-based applications. Familiarity with Python or Java for automation scripting. Experience working with cloud-based AI platforms (Azure AI, AWS AI, or Google Cloud AI) is an added advantage. ISTQB certification or equivalent testing certification is preferred. Education Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field. .