Bestkaam Logo
Creospan Private Limited Logo

Data Engineer

Actively Reviewing the Applications

Creospan Private Limited

4–8 years
Posted 3 days ago Apply by June 11, 2026

Job Description

*****************************Immediate Joiners Only************************************

Creospan is hiring for Azure Databricks Engineer for one of our Banking & Wealth Management projects based in Pune, India.


Experience: 8+ Years

Location: Pune (Hybrid)


About the Role:

We are looking for an experienced Azure Databricks Engineer to join a high-impact data engineering team working on enterprise-scale Azure data platforms. The role involves designing, building, and optimizing scalable data pipelines using Azure Databricks and Apache Spark. You will collaborate with global stakeholders to deliver secure, high-performance analytics and data processing solutions.


Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Azure Databricks
  • Build and optimize batch and streaming ETL/ELT workflows using Apache Spark
  • Develop data processing solutions using PySpark, Spark SQL, and Delta Lake
  • Integrate data from Azure sources such as ADLS Gen2, Azure SQL, APIs
  • Optimize Spark jobs for performance, cost efficiency, and reliability
  • Implement data quality, validation, and reconciliation frameworks
  • Collaborate with data architects, analysts, and business stakeholders
  • Ensure compliance with data security, governance, and regulatory standards
  • Support production deployments and troubleshoot pipeline failures


Required Skills & Qualifications:

  • 8+ years of overall Data Engineering experience
  • Hands-on Azure Databricks experience
  • Strong expertise in Apache Spark, PySpark, Spark SQL
  • Experience with Azure Data Lake (ADLS Gen2)
  • Hands-on experience with Azure Data Factory (ADF) for orchestration
  • Strong SQL skills and experience with relational databases
  • Python proficiency for data processing and automation
  • Experience with CI/CD pipelines (Azure DevOps preferred)
  • Working knowledge of Azure cloud security and access controls


Company Profile:

Creospan is a subsidiary of Creospan Inc., headquartered in Chicago, IL. Since 1999, we have grown into a leading technology consulting and solutions provider, serving global clients across Banking, Telecom, Technology, Manufacturing, Ecommerce, Insurance, Transportation, and Healthcare industries. Our team specializes in emerging technologies, helping clients build next-generation products that drive innovation.

🌐 For more details, visit: www.creospan.com

Check Qualification

Quick Tip

Customize your resume and cover letter to highlight relevant skills for this position to increase your chances of getting hired.