🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
Job Summary We are seeking an experienced Senior Data Engineer with strong expertise in Azure Databricks, PySpark, Azure Data Factory (ADF), and T-SQL to design and deliver enterprise-scale data engineering solutions. The ideal candidate will have extensive experience modernizing legacy SQL-based data transformation logic into scalable Databricks implementations, building high-performance ETL/ELT pipelines, and optimizing large-scale data processing workloads. This role requires strong technical leadership, the ability to mentor engineering teams, and close collaboration with architects, business stakeholders, and global delivery teams to implement enterprise data transformation programs. Key Responsibilities - Design, develop, and maintain enterprise-scale data engineering solutions using Azure Databricks and PySpark. - Analyze, modernize, and migrate complex T-SQL transformation logic into optimized Databricks implementations. - Design and develop scalable data ingestion pipelines using Azure Data Factory (ADF) to ingest data from multiple enterprise source systems into RAW and curated data layers. - Build, maintain, and optimize enterprise ETL/ELT pipelines, ensuring high availability, scalability, and performance. - Monitor pipeline execution, analyze performance metrics, troubleshoot bottlenecks, and implement optimization strategies. - Optimize Databricks workloads using partitioning, caching, Delta Lake optimization, file format tuning, and Spark performance best practices. - Collaborate with Solution Architects, Business Analysts, Product Owners, and cross-functional engineering teams. - Participate in technical solution design, architecture discussions, and engineering best practices. - Lead technical initiatives and provide guidance to junior and mid-level Data Engineers. - Conduct code reviews and ensure adherence to coding standards and data engineering best practices. - Prepare technical documentation and support production deployments. - Work closely with global teams on enterprise-scale cloud data transformation initiatives. Required Skills - Minimum 6 years of hands-on experience with Azure Databricks. - Strong expertise in Core SQL and T-SQL. - Robust hands-on experience with PySpark. - Experience designing enterprise-scale data ingestion pipelines using Azure Data Factory (ADF). - Strong understanding of ETL/ELT architecture and enterprise data engineering principles. - Experience migrating complex SQL transformation logic into Databricks using PySpark. - Expertise in Databricks performance optimization and Spark tuning. - Experience working with enterprise cloud data platforms. - Strong analytical, debugging, troubleshooting, and problem-solving skills. - Excellent communication and stakeholder management skills. - Ability to mentor engineering teams and provide technical leadership. Good to Have - .NET knowledge - Delta Lake - Lakehouse Architecture - Azure DevOps - CI/CD Pipelines - Agile/Scrum methodology Educational Qualification - Bachelor's Degree in Computer Science, Information Technology, Engineering, or a related discipline. .
Here's how to pick the right one and stand out in your application.
144.883Jobs
31.687IN
81%EN
That number is real. WorkMundi's database shows 144,883 open engineer roles across the world. India has the most with 31,687 jobs, followed by the United States with 30,084. If you just finished reading one job ad and felt paralyzed by choice, you're not alone—but this scale is actually an advantage. It means you can afford to be selective.
Start by geography and language. The majority of engineer ads—117,837 of them—have the job posting text written in English. Use that as one filter, but remember: the ad text language tells you nothing about whether the role actually requires you to speak English day-to-day. Read the job description carefully. Then check which countries have the volume you're targeting. Singapore, Poland, and Australia round out the top five after India and the US.
Next, learn who's hiring. Accenture has posted 2,801 engineer roles. andurilindustries, speechify, and jobgether are also actively recruiting. If you're applying to one of these names, research their hiring patterns and interview style before you apply. That homework pays off.
When you interview, expect the question every engineer hears: 'Tell me about a time you had to debug a problem that wasn't in your job description.' Have a specific story ready—not a general one. Name the tools, the deadline pressure, and what you learned. Hiring managers listen for whether you see problem-solving as part of the role itself, not a favour.