🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
Gen AI / LLM Backend DeveloperExperience : 5 8 YearsLocation : Ahmedabad, Gujarat, IndiaMode of Engagement : Full-timeOpen Positions : 2 4Educational Qualification : B. E / B. Tech / M. Tech / MCA / Computer Science or related fieldIndustry Preference: AI / Saa S / Software Product / IT Services / Data Engineering CompaniesNotice Period : Immediate Joiners PreferredWhat We Are Looking For5 8 years of hands-on experience in backend software development and distributed systems.Strong expertise in Python, Node.Js, or Java for backend application development.Hands-on experience building and deploying Generative AI and LLM-powered working with Open AI, Azure Open AI, Anthropic, Gemini, or open-source LLMs.Strong understanding of Prompt Engineering, Prompt Chaining, Function Calling, and Agentic AI workflows.Experience implementing Retrieval Augmented Generation (RAG) pipelines and contextual AI systems.Hands-on experience with vector databases such as Pinecone, Milvus, FAISS, Chroma DB, or similar experience designing and developing RESTful APIs, Graph QL APIs, and microservices architectures.Experience working with SQL and No SQL databases such as Postgre SQL, My SQL, Mongo DB, Dynamo DB, or Redis.Hands-on experience with AWS, Azure, or Google Cloud experience deploying and managing applications using Docker, Kubernetes, and containerized environments.Experience building CI/CD pipelines and implementing Dev Ops best practices.Good understanding of AI/ML workflows, model lifecycle management, monitoring, and observability.Experience implementing authentication, authorization, API security, rate limiting, and compliance controls.Strong debugging, performance optimization, and problem-solving skills.Ability to work independently and manage multiple development initiatives simultaneously.Candidates should be based in Ahmedabad or willing to relocate to Ahmedabad, Gujarat.Prior experience in AI, Saa S, Software Product, or Data Engineering organizations is highly preferred.ResponsibilitiesDesign, develop, and maintain scalable backend services for Generative AI and LLM-powered and integrate REST APIs, Graph QL APIs, and microservices to support AI-driven and optimize Retrieval Augmented Generation (RAG) pipelines and vector search architectures.Integrate Open AI, Azure Open AI, Anthropic, Gemini, and open-source LLMs into production and manage prompt orchestration, context management, and AI workflow scalable data processing and retrieval systems for AI AI application performance, latency, reliability, and infrastructure costs.Build and maintain integrations with vector databases, SQL databases, and No SQL systems.Deploy, monitor, and scale applications using cloud-native technologies and containerized environments.Implement security, compliance, authentication, authorization, and API governance best practices.Collaborate closely with Data Scientists, ML Engineers, Product Teams, and Frontend Developers.Participate in architecture discussions, code reviews, technical documentation, and engineering best practices.Monitor AI workloads and implement observability frameworks including logging, metrics, and alerting.Continuously evaluate emerging Gen AI technologies and recommend improvements to existing systems.QualificationsBachelors or Masters Degree in Computer Science, Information Technology, Engineering, or related field.Strong foundation in software engineering principles, backend architecture, and distributed systems.Experience working with cloud-native architectures and contemporary Dev Ops practices.Familiarity with AI/ML concepts, model deployment workflows, and LLM ecosystems.Experience with Lang Chain, Llama Index, Semantic Kernel, Crew AI, Auto Gen, or similar frameworks will be an added advantage.Exposure to MLOps, model monitoring, and AI governance practices is preferred.Prior experience working in product engineering teams or AI-focused organizations is preferred. .
Here's where they are and how to stand out in your next interview.
24.795Jobs
9.577IN
74%EN
That number includes positions in India (9,577), Poland (3,429), the United States (1,753), Singapore (787), and Brazil (779). If you're looking to move or work remotely, check which countries match your goals — then filter WorkMundi by location to see what's actually hiring near you.
Most developer ads you'll see are written in English: 18,397 of the 24,795. That doesn't tell you whether the job itself requires you to speak English or work in English daily, so read each posting carefully. Don't assume the language of the ad matches the language of the team.
The employers posting the most developer roles are Link Group (369 jobs), Upvanta (257), jobgether (226), and OfferZen (212). If you're applying to any of these, research their hiring patterns. They move fast and post often, which means they're either scaling hard or replacing people who didn't fit.
In your interview, expect this: 'Walk me through the last time you had to debug something that took you more than an hour. What was it, what did you try first, and what would you do differently?' Hiring managers ask this to see if you think systematically or just try random fixes. Have a real example ready with specifics.