🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
The role You'll own the cost and performance of our inference stack. Your work will determine how efficiently we serve models as workloads, traffic, and hardware change. You'll work closely with the engineers operating the serving fleet while owning the core performance levers: caching, batching, quantization, decoding, and kernel-level optimization. Success means improving throughput and latency without compromising reliability or model quality. Responsibilities Improve throughput, cost, and tail latency through KV-cache management, continuous batching, speculative decoding, and quantization. Optimize long-context prefill and decode workloads based on real production traffic. Tune routing between our infrastructure and external providers based on cost, capacity, and performance. Work within serving engines such as vLLM, SGLang, and TensorRT-LLM, going below the framework when needed. Build profiling and measurement systems that show where time, memory, and compute are being spent. Qualifications 5+ years in ML systems, inference infrastructure, or performance engineering, with measurable improvements in cost or latency. Deep understanding of model serving, including prefill and decode, memory bandwidth, batching, and concurrency. Production experience with serving engines such as vLLM, SGLang, or TensorRT-LLM. Strong Python skills and proficiency in C++, Rust, or another systems language. Experience with GPU performance, including CUDA, NCCL, mixed precision, memory layout, kernels, or quantization. Above all, we're looking for great teammates who make work feel lighter and aren't afraid to go out on a limb with bold ideas. You don't need to be perfect, but you do need to be adaptable. We encourage you to apply, even if you don't check every box. About Us Most AI is frozen in place - it doesn't adapt to the world. We think that's backwards. Our mandate is to build efficient intelligence that evolves in real-time. Our vision is AI systems that are flexible, personalized, and accessible to everyone. We believe efficiency is what makes this possible - it's how we expand access and ensure innovation benefits the many, not the few. We believe in talent density: bringing together the best and most driven individuals to push the boundaries of continual adaptation. We're looking for builders and creative thinkers ready to shape the next era of intelligence. Benefits Flexible work: In-person collaboration in the Bay Area, a distributed global-first team, and team offsites. Adaption Passport: Annual travel stipend to explore a country you've never visited. We're building intelligence that evolves alongside you, so we encourage you to keep expanding your horizons. Lunch Stipend: Weekly meal allowance for take-out or grocery delivery. Well-Being: Comprehensive medical benefits and generous paid time off.
Here's how to pick the right one and stand out in your application.
144.883Jobs
31.687IN
81%EN
That number is real. WorkMundi's database shows 144,883 open engineer roles across the world. India has the most with 31,687 jobs, followed by the United States with 30,084. If you just finished reading one job ad and felt paralyzed by choice, you're not alone—but this scale is actually an advantage. It means you can afford to be selective.
Start by geography and language. The majority of engineer ads—117,837 of them—have the job posting text written in English. Use that as one filter, but remember: the ad text language tells you nothing about whether the role actually requires you to speak English day-to-day. Read the job description carefully. Then check which countries have the volume you're targeting. Singapore, Poland, and Australia round out the top five after India and the US.
Next, learn who's hiring. Accenture has posted 2,801 engineer roles. andurilindustries, speechify, and jobgether are also actively recruiting. If you're applying to one of these names, research their hiring patterns and interview style before you apply. That homework pays off.
When you interview, expect the question every engineer hears: 'Tell me about a time you had to debug a problem that wasn't in your job description.' Have a specific story ready—not a general one. Name the tools, the deadline pressure, and what you learned. Hiring managers listen for whether you see problem-solving as part of the role itself, not a favour.