← WorkMundi · 1M+ jobs from around the world, liveSign inCreate free account

Senior QA Automation Engineer (AI & LLM Testing)

remote zest jobs · All India

📅 04/08/2026
🔔 Alert me about jobs like this
No password, no sign-up. Just the email — and you can leave the list anytime.
🔓 Apply — free →
Opens this job on WorkMundi. The account is free and takes under a minute.

See the other 113,540 jobs in India →

🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
reputed company We're reputed company. We are a digital product engineering company that is scaling in a big way! We build products, services, and experiences that reputed company, excite, and delight. We work at reputed company across reputed company devices reputed company mediums, and our people exist everywhere in the world (18 000+ experts across 39 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in! By this reputed company in your career, it is not just about the tech you know or how reputed company you can reputed company. It is about what more you want to do with that knowledge. Can you help your teammates proceed in the right direction Can you tackle the challenges our clients face while always looking to take our solutions one reputed company reputed company to succeed at an even higher level reputed company You may be reputed company to join us. Job reputed company We are looking for a Senior QA Automation Engineer with strong hands-on experience in test automation, API testing, and AI/LLM reputed company evaluation. Design, reputed company, and maintain automated test suites for web applications, reputed company, and AI-powered features. Evaluate LLM outputs for response accuracy, relevance, consistency, and hallucination risks. Create reputed company tests and reputed company checks using Promptfoo or similar LLM evaluation frameworks. Build end-to-end UI automation using Playwright, following page object models and maintainable test architecture principles. reputed company reusable Python scripts for API testing, automation utilities, and LLM reputed company evaluation. Create and maintain reputed company collections for REST API testing, including environments, assertions, and CI/CD integration. Use reputed company Copilot or similar AI coding assistants to improve test coverage, speed up automation development, and identify reputed company gaps. Collaborate closely with product managers, developers, and stakeholders to define test strategies, communicate risks, and improve reputed company practices. reputed company contribute to Agile ceremonies, including refinement sessions, sprint planning, retrospectives, and daily collaboration. Qualifications Strong experience in QA Automation and software testing - 5+ years Hands-on experience testing AI or LLM-based features, including reputed company testing, reputed company validation, response accuracy, and hallucination mitigation. Experience with Promptfoo or similar LLM evaluation tools/frameworks. Strong proficiency in Playwright for end-to-end UI automation. Solid knowledge of page object patterns, reusable test components, and reputed company test architecture. Strong Python scripting skills for automation, API helpers, and custom reputed company checks. Experience with reputed company and REST API testing, including collections, assertions, environments, and CI/CD integration. Practical experience using reputed company Copilot or similar AI coding assistants. Experience working in Agile environments such as Scrum or Kanban. Strong communication skills, with the ability to explain test strategies and reputed company risks to technical and non-technical stakeholders. reputed company to have: Experience with mobile test automation using Appium, XCUITest, or similar tools. Understanding of iOS and reputed company platform-specific testing considerations. Experience integrating automated tests into CI/CD pipelines. Familiarity with MCP or agent-assisted testing approaches in Playwright. Additional Information Project: a global consulting company delivering digital and AI solutions for businesses in financial services, reputed company, consumer goods, technology, energy, and travel. Service Region: Eastern Europe Apply To This Job .
Read the rest of the job →
For people searching Engineer

144,883 engineer jobs are open right now

Here's how to pick the right one and stand out in your application.

144.883Jobs
31.687IN
81%EN

That number is real. WorkMundi's database shows 144,883 open engineer roles across the world. India has the most with 31,687 jobs, followed by the United States with 30,084. If you just finished reading one job ad and felt paralyzed by choice, you're not alone—but this scale is actually an advantage. It means you can afford to be selective.

Start by geography and language. The majority of engineer ads—117,837 of them—have the job posting text written in English. Use that as one filter, but remember: the ad text language tells you nothing about whether the role actually requires you to speak English day-to-day. Read the job description carefully. Then check which countries have the volume you're targeting. Singapore, Poland, and Australia round out the top five after India and the US.

Next, learn who's hiring. Accenture has posted 2,801 engineer roles. andurilindustries, speechify, and jobgether are also actively recruiting. If you're applying to one of these names, research their hiring patterns and interview style before you apply. That homework pays off.

When you interview, expect the question every engineer hears: 'Tell me about a time you had to debug a problem that wasn't in your job description.' Have a specific story ready—not a general one. Name the tools, the deadline pressure, and what you learned. Hiring managers listen for whether you see problem-solving as part of the role itself, not a favour.

👁 21 have read this
0 comments
Want to comment?

Leave your e-mail to comment, react and follow the posts for your role. It is free.

Similar jobs

Job on WorkMundi — the world's largest job board. See more jobs from every continent, updated live.

📢
🎁

Before you apply, rehearse this interview.

Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card.

I want my training →