Azure Data Engineer

Job Description

About the job Are you looking for a new career challenge? With LTIMindtree, are you ready to embark on a data-driven career? Working for global leading manufacturing client for providing an engaging product experience through best-in-class PIM implementation and building rich, relevant, and trusted product information across channels and digital touchpoints so their end customers can make an informed purchase decision ? will surely be a fulfilling experience. Location: Coimbatore only E-mail: [email protected] Responsibilities Develop scalable pipelines to efficiently process transform data using Spark Design and develop a scalable and robust framework for generating PDF reports using Python Spark Utilize Snowflake Spark SQL to perform aggregations on high volume of data Develop Stored Procedures Views Indexes Triggers and Functions in Snowflake Database to maintain data and share with downstream applications in form of APIs Should use Snowflake features Streams Tasks Snowpipes etc wherever needed in the development flow Leverage Azure Databricks and Datalake for data processing and storage Develop APIs using Pythons Flask framework to support front end applications Collaborate with Architects and Business stakeholders to understand reporting requirements Maintain and improve existing reporting pipelines and infrastructure Qualifications Proven experience as a Data Engineer with a strong understanding of data pipelines and ETL processes Proficiency in Python with experience in data manipulation libraries such as Pandas and Numpy Experience with SQL Snowflake Spark for data querying and aggregations Familiarity with Azure cloud services such as Data Factory Databricks and Datalake Experience developing APIs using frameworks like Flask is a plus Excellent communication and collaboration skills Ability to work independently and manage multiple tasks effectively Mandatory Skills: Python, SQL, Spark, Azure Data Factory, Azure Datalake, Azure Databricks Azure Service Bus and Azure Event hubs Why join us? Work in industry leading implementations for Tier-1 clients Accelerated career growth and global exposure Collaborative, inclusive work environment rooted in innovation Exposure to best-in-class automation framework Innovation first culture: We embrace automation, AI insights and clean data Know someone who fits this perfectly? Tag them ? let?s connect the right talent with right opportunity