DataBricks - Data Engineering

The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters

We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering on Azure, with hands-on expertise in Databricks for big data processing and analytics.

Responsibilities

• Design, build, and maintain efficient and reliable data pipelines across Azure services and Databricks.
• Collaborate with data scientists and analysts to understand data needs and deliver scalable solutions.
• Develop and maintain ETL/ELT jobs for data ingestion, transformation, and integration.
• Implement best practices for data lake architecture, storage, and security in Azure.
• Integrate data from diverse sources into centralized repositories.
• Optimize and tune data pipelines for performance and scalability.
• Troubleshoot and resolve data-related issues in a timely manner.
• Stay updated on the latest industry trends and emerging technologies in data engineering.

• Proven experience as a Data Engineer in cloud environments.
• Strong proficiency in Azure services such as Azure Data Lake, Azure Synapse, Azure Data Factory, and Azure Databricks.
• Hands-on experience with Databricks IDE, PySpark, and service integrations.
• Proficiency in SQL and scripting languages such as Python, Scala, or Java.
• Familiarity with data modelling, ETL processes, and data warehousing concepts.
• Solid understanding of data management, governance, and security best practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.
• Ability to thrive in a fast-paced and dynamic environment.

Deliver

Experience: 3-5 Years .

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.