🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
Role Name GenAI / Agent Testing Engineer Position - Senior Associate Location- (Bangalore) Job Description Summary Job Summary: We are looking for a GenAI / LLM Agent Test Engineer to assure quality, reliability, and responsible behavior of LLMbased and RAGbased agents, including singleagent and multiagent workflows. The role focuses on prompt engineering, hallucination detection, agent reasoning validation, and automated evaluation of GenAI outputs using modern LLM testing frameworks. Perform functional, regression, integration, and system testing for AI-driven workflows. Test edge cases, hallucination scenarios, and adversarial prompts. Key Responsibilities: - Perform data validation and reconciliation across source-to-target pipelines using SQL and automated checks - Design and execute test strategies for data quality pipelines, including test data preparation, labeling verification, and schema validation - Validate predictive quality metrics (trend forecasts, risk scoring, defect leakage signals) for correctness and stability - Execute defect trend analysis and riskbased testing using telemetry and historical patterns - Implement automated data validation in CI/CD pipelines and ensure continuous quality gates - Conduct prompt testing and A/B comparisons for AIassisted analytics interactions (where applicable) - Leverage LLMs for: - Intelligent test data generation - Automated data labeling validation - AIassisted anomaly detection in data quality pipelines - Produce actionable insights via statistical thinking and analytical reasoning; communicate quality risks clearly to stakeholders Qualifications and Skills: - Bachelors or masters degree in computer science, Engineering, Data Science, or equivalent experience. - 6+ years of experience in QA automation or software engineering. - 3+ years of experience working with AIdriven automation or intelligent testing frameworks. - Minimum 2 years of handson experience in building or testing AIbased tools or platforms. Must Have Tools - SQL (Postgres / Snowflake) - Pandas / NumPy - Python (data validation) - Promptfoo (A/B prompt tests) - Test data profiling tools - OpenAI / Azure OpenAI APIs - Cursor AI / GitHub Copilot / Claude CLI - PydanticAI Good To Have Tools - Power BI / Tableau - Great Expectations - Evidently AI - MLflow - CI data checks (dbt tests) - Apache Airflow - dbt (Data Build Tool) Nice To Have Tools - AI bias detection tools - WhyLabs - Fairlearn - Data drift simulators - Feature store exposure Communication: - Strong verbal and written communication skills, with the ability to clearly articulate defects, risks, and quality insights. - AI & GenAI Testing Skills: - Handson experience in testing AI/LLMbased systems, including promptdriven workflows, RAG pipelines, and agentbased solutions. - Robust exposure to prompt engineering, prompt validation, and response evaluation techniques. Additional Information: - Travel Requirements: Travel to client locations may be required as per project requirements. - Shift Requirements: Required to work on shift as per project requirements. - Line of Service: Advisory - Industry: Enterprise Testing Managed Services - Designation: Senior Associate - Location: Bangalore, India (ONLY) Position - Senior Associate Location- (Bangalore) .
Here's how to pick the right one and stand out in your application.
144.883Jobs
31.687IN
81%EN
That number is real. WorkMundi's database shows 144,883 open engineer roles across the world. India has the most with 31,687 jobs, followed by the United States with 30,084. If you just finished reading one job ad and felt paralyzed by choice, you're not alone—but this scale is actually an advantage. It means you can afford to be selective.
Start by geography and language. The majority of engineer ads—117,837 of them—have the job posting text written in English. Use that as one filter, but remember: the ad text language tells you nothing about whether the role actually requires you to speak English day-to-day. Read the job description carefully. Then check which countries have the volume you're targeting. Singapore, Poland, and Australia round out the top five after India and the US.
Next, learn who's hiring. Accenture has posted 2,801 engineer roles. andurilindustries, speechify, and jobgether are also actively recruiting. If you're applying to one of these names, research their hiring patterns and interview style before you apply. That homework pays off.
When you interview, expect the question every engineer hears: 'Tell me about a time you had to debug a problem that wasn't in your job description.' Have a specific story ready—not a general one. Name the tools, the deadline pressure, and what you learned. Hiring managers listen for whether you see problem-solving as part of the role itself, not a favour.