Data Engineer

Job Description

Zemoso Technologies is a Software Product Market Fit Studio that brings silicon valley style rapid prototyping and rapid application builds to Entrepreneurs and Corporate innovation. We offer Innovation as a service and work on ideas from scratch and take it to the Product Market Fit stage using Design Thinking->Lean Execution->Agile Methodology. We were featured as one of Deloitte Fastest 50 growing tech companies from India thrice (2016, 2018 and 2019). We were also featured in Deloitte Technology Fast 500 Asia Pacific both in 2016 and 2018. We are located in Hyderabad India, Dallas, US & have recently incorporated another office in Waterloo, Canada. Our founders have had past successes - founded a decision management company acquired by SAP AG (now part of Hana Big data stack & NetWeaver BPM), early engineering team of Zoho (leading billion $ SaaS player) & some Private Equity experience. Marquee customers along with some exciting start-ups are part of our clientele. Zemoso is looking for a Senior Software Engineer to work across Engineering, Design and Product teams to align workstreams. Successful candidates will have a solid track record of Technical Leadership along with superior organizational and communication skills in leading teams and programs to deliver successful outcomes. In addition, the right candidate will possess learning agility to understand and adapt to product direction. And technical architecture, so they can make decisions to accelerate initiatives at any level of depth. You should have experience in working with distributed cross-border teams. Key Responsibilities: ? Python Proficiency: Demonstrate a strong command of Python programming language, actively contributing to the development and maintenance of data engineering solutions. ? Data Engineering Expertise: Set up and maintain efficient data pipelines, ensuring smooth data flow and integration across systems. Experience with PySpark and/or Data Bricks platform is required. Contribute to the establishment and maintenance of Data Lakes, implementing industry best practices. Execute data scrubbing techniques and implement data validation processes to ensure data integrity and quality. ? Machine Learning Integration: Experience in setting up and managing classic ML and LLM models. Participate in model updates and validation, contributing to the enhancement of machine learning algorithms. ? Tool and Platform Proficiency: Experience with PySpark and/or Data Bricks platform is required, apart from this expertise in at least one popular tool/platform within the data engineering domain will be nice to have. Stay informed about industry trends, exploring and adopting tools to optimize data engineering processes. ? Collaboration and Communication: Collaborate effectively with cross-functional teams, including data scientists, software engineers, and business analysts. Communicate technical concepts to non-technical stakeholders, fostering collaboration and innovation within the team. ? Documentation and Best Practices: Contribute to maintaining comprehensive documentation for data engineering processes, ensuring knowledge transfer within the team. Adhere to best practices in data engineering, promoting a culture of quality and efficiency. Must-Have Skills: ? Bachelor?s or Master?s degree in Computer Science, Data Science, or a related field. ? Minimum of 2 years of proven experience as a Data Engineer. ? Experience with PySpark ? Strong proficiency in Python programming language. ? Experience in setting up and managing data pipelines, data lakes, and classic Machine Learning models. ? Familiarity with at least one popular tool/platform in the data engineering space. (Kafka, Airflow, Snowflake, etc.) Nice-to-Have Skills (Optional): ? Exposure to cloud-based data platforms. (AWS/Azure/GCP) ? Basic knowledge of big data technologies such as Hadoop or Spark. ? Familiarity with containerization tools like Docker or Kubernetes. ? Interest in data visualization tools. (Tableau, PowerBI, etc.) ? Certifications in relevant data engineering or machine learning technologies