Azure Data Engineer

Job Description

Job ID: Clo-ETP-Ind-1099 Location: India,Pune Job Summary: We are seeking a skilled and experienced Cloud Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining data solutions on the Azure/AWS cloud platforms. The candidate should have a strong background in data engineering, including ETL processes, data warehousing, and database management. The role requires expertise in Databricks other relevant technologies. The Data Engineer will collaborate with cross-functional teams to ensure the successful delivery of scalable and efficient data solutions. Minimum 3-5 Years of Experience in Data Integration platform on cloud (Azure preferred) Responsibilities Solution Design and Architecture: Collaborate with stakeholders to understand business requirements and design scalable data solutions on the cloud platforms. Create and maintain data architecture diagrams and documentation. Data Ingestion and ETL: Develop and implement ETL processes using Databricks, and other relevant tools. Design and optimize data pipelines to ensure efficient data processing and transformation. Data Storage and Management: Implement and manage Relational Databases, Snowflake and other data sources. Ensure data integrity, security, and compliance with industry best practices and organizational standards. Data Transformation and Processing: Utilize Databricks and other tools for data transformation and processing. Optimize queries and data processing workflows for performance and efficiency. Monitoring and Optimization: Implement monitoring solutions to track the performance and health of data solutions. Identify and resolve performance bottlenecks and optimize data processing workflows. Collaboration and Communication: Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders. Communicate effectively with technical and non-technical audiences, providing insights and recommendations. Automation and Scripting: Develop scripts and automation processes to streamline data engineering tasks. Qualifications Bachelor?s degree in Computer Science, Information Technology, or a related field. Proven experience as a Data Engineer with Azure/AWS cloud technologies. In-depth knowledge of Databricks, and other relevant Azure services. Strong proficiency in SQL, Python, and/or other scripting languages. Experience with data modeling, schema design, and database performance tuning. Familiarity with data warehousing concepts and best practices. Excellent problem-solving and analytical skills. Effective communication and collaboration skills. If you meet these qualifications and are excited about the opportunity to work with cutting-edge cloud technologies to solve complex data challenges, we encourage you to apply. Join our team and be a key contributor to the success of our data-driven initiatives.