Azure Databricks

Must have minimum 7+ years of experience in Data Migration and Data Transformation projects on Azure cloud Proven expertise in building large-scale batch and real-time data pipelines with data processing frameworks in AWS and Azure cloud platforms Design and develop pipelines, ETL and analytical processes on Azure cloud using data services like Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse including Spark & SQL Pools Hands-on experience in Microsoft Fabric for implementing end-to-end data pipelines, Real-Time Analytics, OneLake integration, and Data Activator features Demonstrated experience with ETL development both on-premises and in the cloud using IoT, Azure Stream Analytics, Azure Event Hubs, Azure Databricks, Azure Synapse, SQL, Azure Data Lake, Azure Logic Apps, Power BI, and other ETL technologies Design and develop highly available, resilient, scalable, and secured data platforms adhering to best practices Proficient in writing automation scripts using Python and Spark (Scala) for data processing and transformation Strong analytical skills to solve complex issues in both existing and new code Solid experience in building cloud data solutions and deep understanding of Cloud Storage, Big Data Platform Services, Serverless Architectures, Hadoop, RDBMS, DW/DM, NoSQL databases, and Cloud Security Extensive hands-on experience with Azure Data Architecture components: Data Ingestion, Data Integration, Data Pipeline, Data Orchestration tools and streaming services like Event Hubs, Databricks, Stream Analytics, Logic Apps, Data Factory, Data Lakes Experience in Data Governance, including Data Security, Data Quality, and Access Controls Skilled in monitoring, debugging, diagnosing, and troubleshooting complex production systems Self-driven and able to work independently in dynamic and fast-paced environments Responsibility Translate business requirements into actionable technical specifications, defining application components, enhancement needs, data models, and integration workflows Mentor and coach application teams on the adoption of modern tools, technologies, design patterns, and Microsoft Fabric capabilities Design optimal cloud-hybrid architectures for Big Data, Data Warehousing, and orchestration pipelines, enabling smooth migration from on-premise to Azure Cloud and Microsoft Fabric Architect.