🎁 Before you apply, rehearse this interview. Create your free WorkMundi account and get an Interview Training on HelpsYouSpeak — no cost, no card. I want my training →
Lead Data Engineer Primary Skills Athena, Step Functions, Spark - Pyspark, ETL Fundamentals, SQL (Basic + Advanced), Glue, Python, Lambda, Data Warehousing, EBS /EFS, AWS EC2, Lake Formation, Aurora, S3, Modern Data Platform Fundamentals, PLSQL, Data Modelling Fundamentals, Cloud front Specialization AWS Data EngineerIng Basic: Senior Data Engineer Job requirements Job Description AWS Senior Data Engineer Company: Brillio Technologies Role: Senior Data Engineer Experience: 510 Years Location: India (Hybrid/Remote) Employment Type: Full-time Role Overview We are looking for a Senior Data Engineer with strong Databricks and Big Data expertise to design, build, and optimize scalable data pipelines and platforms. The ideal candidate will have hands-on experience with Spark, PySpark, AWS ecosystem, and modern data architectures, along with exposure to APIs and real-time data processing. Key Responsibilities Design and build scalable data pipelines using Spark / PySpark on DatabricksDevelop and optimize ETL/ELT workflows for large-scale data processingWork with AWS EMR, S3, and Hadoop ecosystem for distributed data processingBuild and maintain data lake and data warehouse solutionsDevelop and integrate APIs for data ingestion and consumptionImplement data processing workflows using Airflow / AutosysOptimize data performance using partitioning, caching, and query tuningHandle structured and semi-structured data from multiple sourcesEnsure data quality, governance, and reliability of pipelinesCollaborate with cross-functional teams (Analytics, Product, Engineering) Technical Skills (Must-Have) Strong expertise in:Apache Spark / PySparkDatabricks (mandatory)SQL (PostgreSQL or similar)Hands-on experience with:AWS EMR, S3Hadoop, Hive ecosystemProgramming skills:Python (must-have)Scala (good exposure)Strong knowledge of:UNIX / Shell scriptingETL pipelines and data engineering fundamentals Additional Skills Experience with:Elasticsearch (data storage & retrieval)Workflow orchestration tools (Airflow, Autosys)Exposure to:API development & integrationVersion control tools (Git / SVN)Basic knowledge of HTML (for web/data tasks) Experience Required Minimum 5+ years of Data Engineering experienceStrong hands-on experience in Databricks + Big Data stackProven experience working on large-scale distributed systems Education Bachelors or Masters degree in Computer Science, Engineering, or related field Why Join Brillio Work on cloud-native, large-scale data platformsExposure to cutting-edge Databricks & AWS ecosystemsCollaborative and high-performance engineering culture .