Python and Azure Data Engineer

Actively Reviewing

Papigen

Chennai Full-Time 4–8 yrs exp Posted 4 days ago · Apply by Sep 10, 2026

Job Description

Job Summary

We are looking for an experienced Python & Azure Data Engineer to support the Country Risk Dashboard initiative focused on building a centralized Country & Sovereign Risk DataMart and analytics platform on Azure.

The ideal candidate will have strong expertise in Python, SQL, Azure Data Lake, Azure Web Apps, and cloud-based data engineering. The role involves developing Python-based applications, designing scalable Azure data solutions, building data ingestion pipelines, and supporting analytics/reporting initiatives in a fast-paced Agile environment.

Experience in Capital Markets, Risk Management, or Financial Analytics is highly preferred.

Key Responsibilities Python Application & GUI Development

Develop and support Python-based GUI/web applications using Streamlit, Flask, or FastAPI.
Build backend services and integrate applications with APIs, databases, and Azure Data Lake.
Troubleshoot application issues and optimize performance.
Maintain technical documentation and application support artifacts.

SQL Development & Data Engineering

Develop and optimize complex SQL queries for analytics and reporting.
Design and maintain SQL views, datasets, and reusable data models.
Perform data validation, reconciliation, and troubleshooting.
Ensure scalability and performance when handling large datasets.

Azure Data Lake & Cloud Development

Design and implement scalable data structures in Azure Data Lake Storage (ADLS Gen2).
Build and maintain data ingestion and transformation pipelines using Python/PySpark.
Manage curated datasets, topics, and data modules.
Implement RBAC, ACLs, and Azure security best practices.
Deploy and support applications using Azure Web Apps.
Monitor applications and pipelines using Azure Monitor and Application Insights.

Agile Delivery & Collaboration

Participate in Agile/SAFe ceremonies including sprint planning, stand-ups, retrospectives, and PI Planning.
Collaborate with product owners, architects, analysts, and engineering teams.
Contribute to user stories, estimations, testing, and release activities.
Support production deployments, issue resolution, and continuous improvements.

Required Skills