Azure Data Engineer

Job Description

Job Summary: We are seeking a highly skilled Senior Azure Data Engineer to design, develop, and optimize data pipelines and solutions within the Microsoft Azure ecosystem. The ideal candidate will have strong experience with Azure Data Factory (ADF), SQL, JSON data processing, and Python-based ETL pipelines, along with an understanding of Property & Casualty (P&C) insurance data models and business processes. Key Responsibilities: ? Design, build, and maintain data ingestion, transformation, and integration pipelines using Azure Data Factory (ADF), Databricks, and Azure Synapse Analytics. ? Develop scalable ETL/ELT processes to extract and transform structured and semi-structured data (JSON, CSV, Parquet) from diverse data sources. ? Write complex SQL queries, stored procedures, and performance tuning scripts for data validation, cleansing, and reporting. ? Utilize Python to automate data workflows, implement data quality checks, and optimize data processing tasks. ? Collaborate with business analysts, data architects, and insurance domain experts to translate functional requirements into efficient data solutions. ? Implement data governance, lineage, and security best practices across Azure environments. ? Support data migration and modernization initiatives for legacy insurance data systems into Azure. ? Leverage knowledge of P&C Insurance data domains such as policy, claims, underwriting, and reinsurance to design business-ready data models. ? Participate in Agile/Scrum ceremonies, ensuring timely delivery of project milestones. Required Skills & Qualifications: ? 8+ years of hands-on experience in Data Engineering and Analytics. ? 5+ years of experience working with Microsoft Azure Data Services (ADF, Synapse, Data Lake, Databricks). ? Proficiency in SQL development and optimization across large datasets. ? Strong experience with Python scripting for ETL, API integration, and data processing. ? Experience working with JSON and semi-structured data within Azure and cloud environments. ? Proven experience in P&C Insurance domain (policy, claims, premium, underwriting data). ? Strong understanding of data architecture, pipelines, and data warehousing concepts. ? Familiarity with Azure DevOps, Git, and CI/CD pipelines for data deployments. ? Excellent problem-solving, analytical, and communication skills. Preferred Qualifications: ? Bachelor?s or Master?s degree in Computer Science, Information Systems, or related field. ? Experience with Power BI or other BI tools for data visualization. ? Exposure to Azure Purview, DataBricks Delta Lake, or Fabric is a plus. ? Prior experience working in an Agile environment with insurance or financial services clients.