← WorkMundi · 1M+ jobs from around the world, liveSign inCreate free account

Data Pipeline Engineer

SE Mentor Solutions · Ernakulam

📅 04/08/2026
🔔 Alert me about jobs like this
No password, no sign-up. Just the email — and you can leave the list anytime.
🔓 Apply — free →
Opens this job on WorkMundi. The account is free and takes under a minute.

See the other 113,540 jobs in India →

🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
Responsibilities Build batch-seed and event-tail ingestion per source system, including seed tail watermark handoff, idempotent upserts, and dedup ledgers Build and operate medallion layers with reprocess-from-Bronze, pipeline orchestration (checkpoints, retry/backoff, DLQ), and full observabilityBuild data-quality gates (quarantine / pass-with-flag), quality scoring, and a reconciliation engine covering count, record, and financial reconciliation financial is zero-toleranceBuild identity matching combining deterministic rules with probabilistic scoring and confidence bands; deliver deduplication, golden-record materialization, and survivorship rules, calibrating match thresholds with labelled dataAuthor and maintain source canonical structural mappings and value crosswalks (e.g., collapsing 1,800+ raw employment-status values to ~20 standard ones) as governed, versioned configurationEnforce data contracts at the boundary: schema registry, fail-fast validation, and semver-compatible schema evolution5+ years building production data pipelines at scaleKafka depth: consumers/producers, replay, DLQ, exactly-once / idempotent processing patternsStrong SQL and solid ETL fundamentalsJava and/or Python in productionMedallion/lakehouse layering, CDC, watermark/checkpoint patterns, and batch-stream hand-offData-quality frameworks: validation rules, quarantine and re-entry, quality scoring, reconciliationEntity resolution / MDM exposure: record matching, dedup, survivorship via commercial tools (Informatica MDM, Reltio) or custom buildsData mapping and crosswalk discipline: profiling messy datasets, authoring governed reference data, config-as-code (YAML/JSON, Git) Bonus PointsProbabilistic record linkage at depth blocking/candidate generation, scoring models, threshold calibration (expected at senior level)Schema registry experience (Avro/Protobuf)Extracting from mainframe or older RDBMS sources with limited CDC supportFinancial reconciliation in finance-adjacent domainsBenefits administration or healthcare domain knowledgeWhat Were Looking For5+ years building production data pipelines at scaleKafka depth: consumers/producers, replay, DLQ, exactly-once / idempotent processing patternsStrong SQL and solid ETL fundamentalsJava and/or Python in productionMedallion/lakehouse layering, CDC, watermark/checkpoint patterns, and batch-stream hand-offData-quality frameworks: validation rules, quarantine and re-entry, quality scoring, reconciliationEntity resolution / MDM exposure: record matching, dedup, survivorship via commercial tools (Informatica MDM, Reltio) or custom buildsData mapping and crosswalk discipline: profiling messy datasets, authoring governed reference data, config-as-code (YAML/JSON, Git) Bonus PointsProbabilistic record linkage at depth blocking/candidate generation, scoring models, threshold calibration (expected at senior level)Schema registry experience (Avro/Protobuf)Extracting from mainframe or older RDBMS sources with limited CDC supportFinancial reconciliation in finance-adjacent domainsBenefits administration or healthcare domain knowledge .
Read the rest of the job →
For people searching Engineer

144,883 engineer jobs are open right now

Here's how to pick the right one and stand out in your application.

144.883Jobs
31.687IN
81%EN

That number is real. WorkMundi's database shows 144,883 open engineer roles across the world. India has the most with 31,687 jobs, followed by the United States with 30,084. If you just finished reading one job ad and felt paralyzed by choice, you're not alone—but this scale is actually an advantage. It means you can afford to be selective.

Start by geography and language. The majority of engineer ads—117,837 of them—have the job posting text written in English. Use that as one filter, but remember: the ad text language tells you nothing about whether the role actually requires you to speak English day-to-day. Read the job description carefully. Then check which countries have the volume you're targeting. Singapore, Poland, and Australia round out the top five after India and the US.

Next, learn who's hiring. Accenture has posted 2,801 engineer roles. andurilindustries, speechify, and jobgether are also actively recruiting. If you're applying to one of these names, research their hiring patterns and interview style before you apply. That homework pays off.

When you interview, expect the question every engineer hears: 'Tell me about a time you had to debug a problem that wasn't in your job description.' Have a specific story ready—not a general one. Name the tools, the deadline pressure, and what you learned. Hiring managers listen for whether you see problem-solving as part of the role itself, not a favour.

👁 21 have read this
0 comments
Want to comment?

Leave your e-mail to comment, react and follow the posts for your role. It is free.

Similar jobs

Job on WorkMundi — the world's largest job board. See more jobs from every continent, updated live.

📢
🎁

Before you apply, rehearse this interview.

Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card.

I want my training →