Spark, Scala, Azure Synapse

Job Description

Key skills: Azure SQL, AZURE Synapse, Spark Experience: 6 to 9 years Location: AIA-Pune Job Description Solution Design and Development: Collaborate with business stakeholders and data architects to understand data requirements and design scalable and efficient solutions using Azure Synapse Analytics. Develop and implement data pipelines, data warehouses, and ETL processes to integrate data from various sources into Azure Synapse Analytics. Query Optimization: Optimize SQL queries and data processing workflows to ensure optimal performance and responsiveness of Azure Synapse Analytics. Integration: Integrate Azure Synapse Analytics with other Azure services, such as Azure Data Factory, Azure Databricks, and Power BI, to create end-to-end data solutions. Monitoring and Troubleshooting: Implement monitoring solutions to track system performance, data quality, and job completion status. Troubleshoot and resolve issues promptly. Security and Compliance: Implement and enforce security measures to protect sensitive data. Ensure compliance with data governance and regulatory requirements. Documentation: Create and maintain comprehensive documentation for all developed solutions, including data models, ETL processes, and system configurations. Collaboration: Collaborate with cross-functional teams, including data scientists, analysts, and business users, to understand their requirements and deliver effective solutions. Continuous Learning: Stay updated on the latest Azure Synapse Analytics features and best practices. Continuously enhance skills and knowledge to drive innovation and improvement.