Big Data Engineer - Hadoop/Spark/Hive

Job Description

Job Title : Big Data Engineer Location : Bangalore / Pune Employment Type : Full Time Experience : 4 to 8 years Notice Period : 15 days About The Role We are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data processing systems. The ideal candidate will have hands-on experience with big data technologies and a strong ability to build scalable and high-performance data pipelines. Key Responsibilities Design and implement big data pipelines and ETL processes using Hadoop, Spark, Hive, and Kafka. Develop and maintain data ingestion, processing, and storage frameworks for high-volume datasets. Optimize and tune big data applications for performance and scalability. Work closely with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions. Ensure data quality, security, and compliance with industry best practices. Monitor, troubleshoot, and resolve issues in production big data environments. Required Skills & Qualifications 4 to 8 years of experience in big data engineering or related roles. Strong expertise in Hadoop ecosystem : HDFS, YARN, MapReduce. Hands-on experience with Apache Spark, Hive, and Kafka. Proficiency in SQL and at least one programming language (Java/Scala/Python). Good understanding of data modeling, distributed computing, and performance tuning. Experience with real-time data streaming and batch processing. Strong problem-solving skills and ability to work in a fast-paced environment. Good To Have Experience with cloud platforms (AWS, Azure, or GCP) and big data services. Knowledge of data lake architectures, NoSQL databases (HBase, Cassandra, etc.). Familiarity with containerization (Docker, Kubernetes). Why Join Us Opportunity to work on cutting-edge big data technologies and large-scale projects. Collaborative work culture and exposure to challenging data engineering problems. Competitive salary and growth opportunities in a rapidly evolving data-driven industry. (ref:hirist.tech)