Lead Software Engineer

Job Description

Let?s be unstoppable together! At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We?re a global company dedicated to fostering inclusivity and belonging. We value and celebrate the unique experiences, cultures, and viewpoints that each individual brings. By embracing a wide range of backgrounds, skills, expertise, and beyond, we create a stronger, more innovative environment for our employees, clients, and communities. Circana is proud to be Certified? by Great Place To Work?. This prestigious award is based entirely on what current employees say about their experience working at Circana. Learn more at www.circana.com Role & Responsibilities Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders Design, develop, and maintain highly scalable data processing applications Write efficient, reusable and well documented code Deliver big data projects using Spark, Scala , Python, SQL Maintain and tune existing Spark applications to the fullest. Find opportunities for optimizing existing spark applications. Work closely with QA, Operations and various teams to deliver error free software on time Actively lead / participate daily agile / scrum meetings Take responsibility for Apache Spark development and implementation Translate complex technical and functional requirements into detailed designs Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions Serve as a mentor for junior staff members by conducting technical training sessions and reviewing project outputs Qualifications Engineering graduates in computer science backgrounds preferred with 8+ years of software development experience with Hadoop framework components(HDFS, Spark, Spark, Scala, PySpark) Excellent at verbal, written and presentation skills Ability to present and defend a solution with technical facts & business proficiency Understanding of data-warehousing and data-modeling techniques Strong data engineering skills Knowledge of Core Java, Linux, SQL, and any scripting language At least 6+ years of experience using Python / Scala, Spark, SQL Knowledge of shell scripting is a plus Knowledge of Core and Advance Java is a plus. Experience in developing and tuning spark applications Excellent understanding of spark architecture, data frames and tuning spark Strong knowledge of database concepts, systems architecture, and data structures is a must Process oriented with strong analytical and problem solving skills Experience in writing Python standalone applications dealing with PySpark API Knowledge of DELTA.IO package is a plus. Note:- ?An offer of employment may be conditional upon successful completion of a background check in accordance with local legislation and our candidate privacy notice . Your current employer will not be contacted without your permission?