Bestkaam Logo
Back to Jobs
Zorba AI

Azure DE

Actively Reviewing

Zorba AI

Chennai Full-Time 4–8 yrs exp Posted 1 month ago  · Apply by Jul 18, 2026
Data Engineer – Python | SQL | Databricks | Azure Cloud

Experience: 5+ Years

Location: [Insert Location]

Notice Period: Immediate to 30 Days Preferred

Job Description

We are seeking a highly skilled Data Engineer with strong expertise in Python, SQL, Databricks, and Azure Cloud technologies. The ideal candidate should have hands-on experience building scalable data pipelines, optimizing large-scale data processing, and developing cloud-based analytics solutions.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines using Azure cloud services.
  • Develop and optimize data processing workflows using Databricks and PySpark.
  • Write efficient Python scripts and complex SQL queries for data transformation and analysis.
  • Build and manage data solutions using Azure Data Factory (ADF), Azure Databricks, and ADLS.
  • Perform data ingestion from multiple structured and unstructured data sources.
  • Optimize Spark jobs and SQL queries for performance and scalability.
  • Collaborate with data analysts, business teams, and stakeholders for data requirements and reporting needs.
  • Implement data quality checks, monitoring, and troubleshooting mechanisms.
  • Support data warehousing, lakehouse, and cloud migration initiatives.
  • Ensure best practices for data governance, security, and compliance.

Required Skills

  • 5+ years of experience in Data Engineering or related roles.
  • Strong hands-on expertise in Python and SQL.
  • Extensive experience with Azure Databricks and PySpark.
  • Strong working knowledge of Azure Cloud services.
  • Hands-on experience with:
    • Azure Data Factory (ADF)
    • Azure Data Lake Storage (ADLS)
    • Azure Databricks
    • Synapse Analytics
    • Azure SQL Database
    • Key Vault / Logic Apps (preferred)
  • Strong understanding of ETL/ELT concepts and data pipeline development.
  • Experience with Spark performance tuning and optimization techniques.
  • Good understanding of data warehousing and dimensional modeling concepts.
  • Experience handling large-scale batch and streaming data pipelines.
  • Familiarity with Git, CI/CD pipelines, and Agile methodologies.
Preferred Qualifications

  • Experience with Delta Lake and Lakehouse architecture.
  • Exposure to Power BI or other reporting tools.
  • Knowledge of Airflow or workflow orchestration tools.
  • Azure Certification is an added advantage.

Nice to Have

  • Experience working in distributed data environments.
  • Exposure to real-time data processing frameworks like Kafka/Event Hub.
  • Understanding of DevOps and Infrastructure as Code concepts.

Qualifications

[Some qualifications you may want to include are Skills, Education, Experience, or Certifications.]

Example: Excellent verbal and written communication skills

Data Engineer – Python | SQL | Databricks | Azure Cloud

Experience: 5+ Years

Location: [Insert Location]

Notice Period: Immediate to 30 Days Preferred

Preferred Qualifications

  • Experience with Delta Lake and Lakehouse architecture.
  • Exposure to Power BI or other reporting tools.
  • Knowledge of Airflow or workflow orchestration tools.
  • Azure Certification is an added advantage.

Nice to Have

  • Experience working in distributed data environments.
  • Exposure to real-time data processing frameworks like Kafka/Event Hub.
  • Understanding of DevOps and Infrastructure as Code concepts.
  • Data Engineer – Python | SQL | Databricks | Azure Cloud Experience: 5+ Years Location: [Insert Location] Notice Period: Immediate to 30 Days Preferred

Job Description

We are seeking a highly skilled Data Engineer with strong expertise in Python, SQL, Databricks, and Azure Cloud technologies. The ideal candidate should have hands-on experience building scalable data pipelines, optimizing large-scale data processing, and developing cloud-based analytics solutions.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines using Azure cloud services.
  • Develop and optimize data processing workflows using Databricks and PySpark.
  • Write efficient Python scripts and complex SQL queries for data transformation and analysis.
  • Build and manage data solutions using Azure Data Factory (ADF), Azure Databricks, and ADLS.
  • Perform data ingestion from multiple structured and unstructured data sources.
  • Optimize Spark jobs and SQL queries for performance and scalability.
  • Collaborate with data analysts, business teams, and stakeholders for data requirements and reporting needs.
  • Implement data quality checks, monitoring, and troubleshooting mechanisms.
  • Support data warehousing, lakehouse, and cloud migration initiatives.
  • Ensure best practices for data governance, security, and compliance.

Required Skills

  • 5+ years of experience in Data Engineering or related roles.
  • Strong hands-on expertise in Python and SQL.
  • Extensive experience with Azure Databricks and PySpark.
  • Strong working knowledge of Azure Cloud services.
  • Hands-on experience with:
    • Azure Data Factory (ADF)
    • Azure Data Lake Storage (ADLS)
    • Azure Databricks
    • Synapse Analytics
    • Azure SQL Database
    • Key Vault / Logic Apps (preferred)
  • Strong understanding of ETL/ELT concepts and data pipeline development.
  • Experience with Spark performance tuning and optimization techniques.
  • Good understanding of data warehousing and dimensional modeling concepts.
  • Experience handling large-scale batch and streaming data pipelines.
  • Familiarity with Git, CI/CD pipelines, and Agile methodologies.
Preferred Qualifications

  • Experience with Delta Lake and Lakehouse architecture.
  • Exposure to Power BI or other reporting tools.
  • Knowledge of Airflow or workflow orchestration tools.
  • Azure Certification is an added advantage.

Nice to Have

  • Experience working in distributed data environments.
  • Exposure to real-time data processing frameworks like Kafka/Event Hub.
  • Understanding of DevOps and Infrastructure as Code concepts.
  • Data Engineer – Python | SQL | Databricks | Azure Cloud Experience: 5+ Years Location: [Insert Location] Notice Period: Immediate to 30 Days Preferred

Job Description

We are seeking a highly skilled Data Engineer with strong expertise in Python, SQL, Databricks, and Azure Cloud technologies. The ideal candidate should have hands-on experience building scalable data pipelines, optimizing large-scale data processing, and developing cloud-based analytics solutions.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines using Azure cloud services.
  • Develop and optimize data processing workflows using Databricks and PySpark.
  • Write efficient Python scripts and complex SQL queries for data transformation and analysis.
  • Build and manage data solutions using Azure Data Factory (ADF), Azure Databricks, and ADLS.
  • Perform data ingestion from multiple structured and unstructured data sources.
  • Optimize Spark jobs and SQL queries for performance and scalability.
  • Collaborate with data analysts, business teams, and stakeholders for data requirements and reporting needs.
  • Implement data quality checks, monitoring, and troubleshooting mechanisms.
  • Support data warehousing, lakehouse, and cloud migration initiatives.
  • Ensure best practices for data governance, security, and compliance.

Required Skills

  • 5+ years of experience in Data Engineering or related roles.
  • Strong hands-on expertise in Python and SQL.
  • Extensive experience with Azure Databricks and PySpark.
  • Strong working knowledge of Azure Cloud services.
  • Hands-on experience with:
    • Azure Data Factory (ADF)
    • Azure Data Lake Storage (ADLS)
    • Azure Databricks
    • Synapse Analytics
    • Azure SQL Database
    • Key Vault / Logic Apps (preferred)
  • Strong understanding of ETL/ELT concepts and data pipeline development.
  • Experience with Spark performance tuning and optimization techniques.
  • Good understanding of data warehousing and dimensional modeling concepts.
  • Experience handling large-scale batch and streaming data pipelines.
  • Familiarity with Git, CI/CD pipelines, and Agile methodologies.
Preferred Qualifications

  • Experience with Delta Lake and Lakehouse architecture.
  • Exposure to Power BI or other reporting tools.
  • Knowledge of Airflow or workflow orchestration tools.
  • Azure Certification is an added advantage.

Nice to Have

  • Experience working in distributed data environments.
  • Exposure to real-time data processing frameworks like Kafka/Event Hub.
  • Understanding of DevOps and Infrastructure as Code concepts.

Skills: sql,azure databrick,python,azure