Principal Apache Hadoop Engineer

Job Description

At BairesDev?, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Principal Apache Hadoop Engineer at BairesDev We are seeking a Principal Apache Hadoop Engineer with deep expertise in big data ecosystem, HDFS architecture, MapReduce paradigm, and YARN resource management. The technology stack includes popular open source big data technologies - Apache Hadoop, and related ecosystem tools. Thus, there is ample scope for collaboration and contribution to open source. The ideal candidate will lead the design and optimization of large-scale distributed data processing systems, drive architectural decisions, and mentor engineering teams while delivering cutting-edge solutions for complex big data challenges. What You'll Do: - Contribute actively to Apache Hadoop and related open source projects as a core contributor, spending 20% of your time on upstream development. - Design and optimize big data ecosystem architectures for large-scale data processing. - Architect advanced HDFS components to ensure highly reliable distributed data storage. - Lead MapReduce paradigm implementation for complex scalable data processing workflows. - Drive YARN resource management optimization for maximum cluster efficiency and performance. - Mentor engineering teams and provide technical leadership across projects. What we are looking for: - 10+ years of experience in software development. - Strong expertise in big data ecosystem and distributed data processing systems. - Deep understanding of advanced HDFS architecture and distributed file system concepts. - Proficiency in MapReduce paradigm and complex parallel processing techniques. - Proven experience with YARN resource management and large-scale cluster orchestration. - Core contributions to Apache open source projects (Hadoop, HDFS, Spark, or similar). - Advanced level of English. How we make your work (and your life) easier: - Excellent compensation in USD or your local currency if preferred. - Paid parental leave, vacation, & national holidays. - Innovative and multicultural work environment. - Collaborate and learn from the global Top 1% of talent in each area. - Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities. Join a global team where your unique talents can truly thrive and make a significant impact! Apply now!