Senior Big Data Platform Administrator

Experience Required 58 years of overall IT experience, with at least 35 years of hands-on experience in Big Data platform administration and Linux systems. Job Summary We are seeking an experienced Senior Big Data Platform Administrator to manage and support our enterprise Big Data infrastructure. The ideal candidate will have strong expertise in the Hadoop ecosystem, Linux administration, distributed systems, and platform monitoring tools. This role involves ensuring platform performance, availability, scalability, and security across production and non-production environments. Key Responsibilities Administer and support Hadoop ecosystem components (HDFS, YARN) across Production, Test, and Development environmentsManage and maintain Apache Spark and Airflow infrastructureMonitor cluster health, troubleshoot performance issues, and optimize system performanceImplement and maintain High Availability (HA), Disaster Recovery (DR), backup, and restore strategiesManage logging, monitoring, and alerting systems using Prometheus, Grafana, and ELK StackPerform Linux (Ubuntu) system administration, including patching, upgrades, and security hardeningDevelop and maintain automation scripts using Shell and/or PythonHandle Kerberos authentication setup and maintenanceSupport incident management, root cause analysis (RCA), and ensure SLA adherenceManage capacity planning and system scalabilityFollow CI/CD and DevOps best practices for platform improvements and deployments Skills Required Mandatory Skills: Strong experience with Hadoop ecosystem (HDFS, YARN)Hands-on experience with Apache Spark and AirflowExpertise in Linux (Ubuntu) administrationExperience in implementing High Availability (HA) and Disaster Recovery (DR) Optional Skills Experience with Prometheus, Grafana, and ELK Stack (Elasticsearch, Logstash, Kibana)Knowledge of Shell/Python scripting for automationExperience with Kerberos authenticationStrong understanding of distributed systems, cluster management, and performance tuningFamiliarity with CI/CD pipelines and DevOps practices Preferred Qualifications Experience in managing large-scale on-premises Big Data environmentsCertification in Hadoop, Linux, or Cloud/DevOps technologies will be an added advantage Educational Qualification Bachelors Degree in Engineering (B.E) Computer Science / Information Technology Key Competencies Strong problem-solving and analytical skillsExcellent troubleshooting and debugging abilitiesGood communication and collaboration skillsAbility to work in high-pressure, production-critical environmentsProactive and self-driven mindset .