🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
Description This role is for one of Weekdays clients Salary range: Rs 5000000 - Rs 9000000 (ie INR 50 - 90 LPA) Min Experience: 1+ years Location: Bengaluru JobType: full-time We are looking for a highly motivated Senior Research Engineer with 18 years of experience to join our research and engineering team. The ideal candidate will work at the intersection of LLM research, model evaluation, and large-scale experimentation, helping develop rigorous methods to understand, measure, and improve the capabilities of modern language models. You will design and implement evaluation frameworks, build high-quality datasets and test suites, analyze model behavior, and translate research findings into practical improvements. This role is ideal for someone who enjoys solving open-ended research problems while also being comfortable building production-quality systems. Requirements Key ResponsibilitiesDesign, develop, and maintain comprehensive LLM evaluation (evals) frameworks to measure model capabilities, reliability, reasoning, instruction following, safety, and task performance.Conduct research on large language models, including model behavior, capabilities, limitations, prompting, fine-tuning, and evaluation methodologies.Develop novel evaluation methodologies and experiments for emerging LLM capabilities and use cases.Create high-quality evaluation datasets, test cases, rubrics, and automated evaluation pipelines.Analyze model outputs using quantitative and qualitative methods to identify performance gaps and behavioral patterns.Design controlled experiments to compare models, prompts, training approaches, and inference strategies.Build scalable tooling for running evaluations across large numbers of prompts, models, and datasets.Collaborate with researchers, ML engineers, and product teams to convert research insights into measurable model improvements.Investigate failures and edge cases and develop targeted evaluations to capture previously undetected model weaknesses.Contribute to technical documentation, research reports, internal benchmarks, and presentations of findings.Stay current with developments in LLM research, evaluation techniques, reasoning systems, and AI benchmarks.Required Skills & Qualifications18 years of experience in machine learning, AI research, software engineering, data science, or a related technical field.Strong hands-on experience designing and implementing LLM evals or model evaluation systems.Solid understanding of LLM research, including model capabilities, prompting, fine-tuning, inference, and evaluation methodologies.Strong Python programming and experience working with ML/AI frameworks and data-processing pipelines.Ability to formulate research questions, design experiments, interpret results, and communicate technical findings clearly.Strong analytical and problem-solving skills with attention to experimental rigor and reproducibility.Experience working with large datasets, automated testing, and evaluation pipelines.Good-to-Have SkillsExperience developing or working with LLM benchmarks and standardized evaluation suites.Familiarity with benchmark design, dataset curation, scoring methodologies, and statistical analysis.Experience with open-source LLMs, model APIs, Hugging Face, PyTorch, or similar frameworks.Exposure to reinforcement learning, RLHF/RLAIF, fine-tuning, synthetic data generation, or agentic systems.Research publications, technical blogs, open-source contributions, or demonstrated independent AI research work. .
Here's how to pick the right one and stand out in your application.
144.883Jobs
31.687IN
81%EN
That number is real. WorkMundi's database shows 144,883 open engineer roles across the world. India has the most with 31,687 jobs, followed by the United States with 30,084. If you just finished reading one job ad and felt paralyzed by choice, you're not alone—but this scale is actually an advantage. It means you can afford to be selective.
Start by geography and language. The majority of engineer ads—117,837 of them—have the job posting text written in English. Use that as one filter, but remember: the ad text language tells you nothing about whether the role actually requires you to speak English day-to-day. Read the job description carefully. Then check which countries have the volume you're targeting. Singapore, Poland, and Australia round out the top five after India and the US.
Next, learn who's hiring. Accenture has posted 2,801 engineer roles. andurilindustries, speechify, and jobgether are also actively recruiting. If you're applying to one of these names, research their hiring patterns and interview style before you apply. That homework pays off.
When you interview, expect the question every engineer hears: 'Tell me about a time you had to debug a problem that wasn't in your job description.' Have a specific story ready—not a general one. Name the tools, the deadline pressure, and what you learned. Hiring managers listen for whether you see problem-solving as part of the role itself, not a favour.