🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
Note: The job is a remote job and is open to candidates in USA. Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. They are seeking an experienced Senior Data Engineer - Hadoop to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. The role involves ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads.ResponsibilitiesDesign, develop, and operate end-to-end big-data pipelines on Hadoop, ingesting data from a diverse mix of relational, file-based, streaming, and API-driven sourcesBuild robust ETL/ELT workflows using Apache Spark, Hive, Pig, and Sqoop, with strong attention to data quality, idempotency, error handling, and recoverabilityDevelop high-throughput streaming data pipelines using Kafka, Spark Streaming, or Flink, and integrate them with downstream analytical and operational systemsOptimize Spark and MapReduce jobs through careful tuning of partitioning, memory, serialization, and skew handling to meet demanding SLAs at minimal costDesign and maintain data models and storage layouts on HDFS, Hive, HBase, and modern lakehouse formats (Parquet, ORC, Delta, Iceberg, Hudi) to balance flexibility and performanceImplement data governance, lineage, and quality controls in collaboration with data governance and security teamsBuild robust monitoring, alerting, and logging strategies for big-data pipelines, including job-level SLAs and proactive failure detectionPartner with data scientists and analysts to deliver curated, reliable, and well-documented datasets that accelerate their workAutomate pipeline orchestration using Airflow, Oozie, or similar workflow engines, with clean dependency management and clear ownership boundariesContinuously evaluate and adopt new technologies in the big-data and cloud ecosystem (EMR, Databricks, Snowflake, BigQuery) where they offer meaningful improvementsLead performance reviews and architecture audits of existing pipelines, proposing concrete refactoring and optimization initiativesDocument data architectures, schemas, pipeline behaviors, and operational runbooks in a way that makes the platform supportable as the team scalesMentor junior engineers and contribute to the teams engineering standards and best practicesSkillsBachelor's degree in Computer Science, Engineering, or a related technical disciplineFive or more years of professional experience designing and operating big-data pipelines on HadoopStrong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environmentsSolid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystemHands-on experience with streaming data platforms such as Kafka, Spark Streaming, or FlinkStrong SQL skills and experience working with both relational and NoSQL data storesExperience with workflow orchestration tools such as Airflow or OozieSolid understanding of distributed systems concepts, including partitioning, replication, and fault toleranceStrong scripting skills in Python or ShellExcellent troubleshooting, debugging, and documentation skillsExperience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or DatabricksFamiliarity with modern lakehouse formats (Delta, Iceberg, Hudi)Exposure to data governance tooling such as Apache Atlas or CollibraExperience with Kubernetes-based data platforms (Spark-on-K8s, Trino)Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflowsCompany OverviewBrightvision is a lead generation agency for B2B tech companies. It was founded in 2000, and is headquartered in Gteborg, Vastra Gotaland, SWE, with a workforce of 51-200 employees. Its website is https://brightvision.com/. Apply To this Job .
Here's how to pick the right one and stand out in your application.
144.883Jobs
31.687IN
81%EN
That number is real. WorkMundi's database shows 144,883 open engineer roles across the world. India has the most with 31,687 jobs, followed by the United States with 30,084. If you just finished reading one job ad and felt paralyzed by choice, you're not alone—but this scale is actually an advantage. It means you can afford to be selective.
Start by geography and language. The majority of engineer ads—117,837 of them—have the job posting text written in English. Use that as one filter, but remember: the ad text language tells you nothing about whether the role actually requires you to speak English day-to-day. Read the job description carefully. Then check which countries have the volume you're targeting. Singapore, Poland, and Australia round out the top five after India and the US.
Next, learn who's hiring. Accenture has posted 2,801 engineer roles. andurilindustries, speechify, and jobgether are also actively recruiting. If you're applying to one of these names, research their hiring patterns and interview style before you apply. That homework pays off.
When you interview, expect the question every engineer hears: 'Tell me about a time you had to debug a problem that wasn't in your job description.' Have a specific story ready—not a general one. Name the tools, the deadline pressure, and what you learned. Hiring managers listen for whether you see problem-solving as part of the role itself, not a favour.