🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
LLM Operations Engineer Project Role : LLM Operations Engineer Project Role Description : Utilize cloud-native services and tools for scalable and efficient deployment. Monitor LLM performance, address operational challenges, and ensure compliance and security standards in AI operations. Must have skills : Generative AI, Large Language Models (LLMs), Machine Learning Operations, Agentic AI Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary: We are looking for a highly skilled AI Engineer specializing in Generative AI and Multi-Agent Systems to design and deploy intelligent, autonomous solutions. This role focuses on building LLM-powered, agent-driven architectures that can reason, collaborate, and execute complex workflows across enterprise systems. You will work on cutting-edge Agentic AI frameworks, enabling systems that go beyond prediction to decision-making, orchestration, and autonomous execution. Roles & Responsibilities: - Design and build multi-agent AI systems capable of planning, reasoning, and task execution - Develop applications using LLMs (GPT, Claude, Llama, etc.) with advanced prompt engineering and orchestration - Implement Agentic workflows (planner - executor - critic - memory loops) - Build RAG (Retrieval-Augmented Generation) pipelines with vector databases for enterprise knowledge grounding - Develop tool-using agents that integrate with APIs, databases, and enterprise systems - Architect and deploy AI copilots and autonomous assistants for business workflows - Optimize LLM performance using fine-tuning, prompt chaining, and caching strategies - Implement short-term and long-term memory mechanisms (vector stores, knowledge graphs) - Design multi-agent collaboration protocols (hierarchical, swarm, role-based agents) - Deploy scalable solutions using MLOps & LLMOps practices (monitoring, evaluation, guardrails) - Ensure AI safety, governance, and responsible AI practices Professional & Technical Skills: - Experience building multi-agent orchestration systems with role-based coordination - Exposure to agent planning algorithms (ReAct, Plan-and-Execute, Tree of Thought) - Experience with LLM evaluation frameworks (RAGAS, TruLens, Promptfoo) - Knowledge of graph-based reasoning, knowledge graphs - Building autonomous systems or copilots in enterprise environments - Domain experience in industrial, energy, or IoT environments - Systems thinking for designing autonomous AI architectures - Strong problem decomposition for agent task design - Ability to balance latency, cost, and accuracy in LLM systems - Communication with business stakeholders to translate workflows into agent pipelines - Innovation mindset with focus on applying agentic AI in production - 38 years' experience in AI/ML with strong focus on Generative AI - Strong Python development skills - Hands-on experience with: - LLMs & GenAI frameworks - OpenAI, Hugging Face Transformers - Agent frameworks: LangChain, AutoGen, CrewAI, Semantic Kernel - RAG pipelines & vector DBs- FAISS, Pinecone, Weaviate - Experience building API-driven, tool-integrated AI agents - Strong understanding of - - Prompt engineering & prompt optimization - Chain-of-thought reasoning and tool augmentation - Context management and token optimization - Experience with cloud platforms (Azure OpenAI preferred, AWS/GCP acceptable) - Knowledge of Docker, Kubernetes, CI/CD pipelines Additional Information: - The candidate should have minimum 3 years of experience in Generative AI. - This position is based at our Pune office. - A 15 years full time education is required. .
Here's how to pick the right one and stand out in your application.
144.883Jobs
31.687IN
81%EN
That number is real. WorkMundi's database shows 144,883 open engineer roles across the world. India has the most with 31,687 jobs, followed by the United States with 30,084. If you just finished reading one job ad and felt paralyzed by choice, you're not alone—but this scale is actually an advantage. It means you can afford to be selective.
Start by geography and language. The majority of engineer ads—117,837 of them—have the job posting text written in English. Use that as one filter, but remember: the ad text language tells you nothing about whether the role actually requires you to speak English day-to-day. Read the job description carefully. Then check which countries have the volume you're targeting. Singapore, Poland, and Australia round out the top five after India and the US.
Next, learn who's hiring. Accenture has posted 2,801 engineer roles. andurilindustries, speechify, and jobgether are also actively recruiting. If you're applying to one of these names, research their hiring patterns and interview style before you apply. That homework pays off.
When you interview, expect the question every engineer hears: 'Tell me about a time you had to debug a problem that wasn't in your job description.' Have a specific story ready—not a general one. Name the tools, the deadline pressure, and what you learned. Hiring managers listen for whether you see problem-solving as part of the role itself, not a favour.