🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
We are looking for a Lead Software Engineer Data to design, build, and optimize large-scale data solutions while guiding a team through the full lifecycle of Big Data implementation. This role requires deep technical expertise in distributed computing and modern data processing frameworks, along with strong leadership capabilities to drive projects in an Agile environment. Responsibilities Lead the design and implementation of Big Data solutions across the organization Develop and optimize distributed data processing pipelines using Apache Spark Write efficient, scalable code in Python to support data engineering initiatives Build stream-processing systems leveraging technologies such as Apache Storm or Spark-Streaming Integrate data from multiple sources, including RDBMS, ERP systems, and file-based inputs Apply ETL techniques and frameworks to ensure reliable data transformation and delivery Tune and optimize Spark job performance to meet business and technical requirements Guide the team in adopting native cloud data services on Azure or AWS with Databricks Manage and mentor a team of engineers to deliver high-quality data solutions efficiently Drive Agile practices throughout the software development lifecycle Requirements 8-14 years of experience in Big Data and related data technologies Expertise in distributed computing principles and Apache Spark Proficiency in Hadoop v2, MapReduce, HDFS, and Sqoop Experience with messaging systems such as Kafka or RabbitMQ Familiarity with Big Data querying tools such as Hive and Impala Understanding of SQL queries, joins, stored procedures, and relational schemas Experience with NoSQL databases such as HBase, Cassandra, or MongoDB Knowledge of ETL techniques and frameworks Experience with native cloud data services on Azure or AWS with Databricks Capability to lead a team efficiently Background in designing and implementing Big Data solutions Practitioner of AGILE methodology .
Here's how to pick the right one and stand out in your application.
144.883Jobs
31.687IN
81%EN
That number is real. WorkMundi's database shows 144,883 open engineer roles across the world. India has the most with 31,687 jobs, followed by the United States with 30,084. If you just finished reading one job ad and felt paralyzed by choice, you're not alone—but this scale is actually an advantage. It means you can afford to be selective.
Start by geography and language. The majority of engineer ads—117,837 of them—have the job posting text written in English. Use that as one filter, but remember: the ad text language tells you nothing about whether the role actually requires you to speak English day-to-day. Read the job description carefully. Then check which countries have the volume you're targeting. Singapore, Poland, and Australia round out the top five after India and the US.
Next, learn who's hiring. Accenture has posted 2,801 engineer roles. andurilindustries, speechify, and jobgether are also actively recruiting. If you're applying to one of these names, research their hiring patterns and interview style before you apply. That homework pays off.
When you interview, expect the question every engineer hears: 'Tell me about a time you had to debug a problem that wasn't in your job description.' Have a specific story ready—not a general one. Name the tools, the deadline pressure, and what you learned. Hiring managers listen for whether you see problem-solving as part of the role itself, not a favour.