Technical Lead

Role Purpose

• The Lead Data Engineer is responsible for leading the design, development, and implementation of enterprise-scale data platforms, data pipelines, and analytics solutions. The role provides technical leadership to the data engineering team and works closely with business stakeholders, architects, and delivery teams to enable data-driven decision making across the organisation.

Key Responsibilities

• Lead and mentor a team of Data Engineers in delivering scalable and secure data solutions.
• Design and implement enterprise data lakehouse, data warehouse, and analytics platforms.
• Develop and optimise ETL/ELT pipelines using Azure Data Factory and Databricks.
• Implement data models and analytics platforms using Azure Synapse Analytics.
• Partner with business stakeholders to translate business requirements into technical solutions.
• Support Power BI semantic models, datasets, dashboards, and reporting solutions.
• Establish data engineering standards, coding guidelines, and DevOps/DataOps practices.
• Ensure data quality, governance, security, and compliance requirements are met.
• Perform architecture reviews, code reviews, and technical assessments.
• Drive continuous improvement and adoption of modern data engineering practices.

Mandatory Technical Skills

• Databricks (Mandatory) – Delta Lake, Unity Catalog, Medallion Architecture, Auto Loader, Spark, PySpark, Spark SQL, Workflows.
• Azure Data Factory (Mandatory) – Enterprise ETL/ELT pipeline development and orchestration.
• Azure Synapse Analytics (Mandatory) – Data warehousing, SQL pools, analytics, and performance tuning.
• Power BI (Mandatory) – Data modelling, DAX, semantic models, dashboards, and reporting.
• Advanced SQL and database optimisation.
• Python and PySpark development.
• Dimensional Data Modelling and Data Warehousing.
• Azure Cloud architecture and services.

Qualifications & Experience

• Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science or related discipline.
• Minimum 8 years of experience in Data Engineering, Analytics, or Business Intelligence.
• Minimum 3 years of experience leading technical teams or major data engineering initiatives.
• Proven experience delivering enterprise-scale cloud data platforms.

Preferred Certifications

• Databricks Certified Data Engineer Associate OR
• Databricks Certified Data Engineer Professional (Preferred)
• Microsoft Certified: Azure Data Engineer Associate (DP-203).
• Microsoft Certified: Power BI Data Analyst Associate (PL-300).
• Microsoft Certified: Azure Solutions Architect Expert.
• Microsoft Fabric Analytics Engineer Associate (DP-600).

Leadership Competencies

• Strong stakeholder management and communication skills.
• Ability to lead technical discussions and architecture decisions.
• Strong analytical and problem-solving capabilities.
• Experience mentoring and developing engineering teams.
• Ability to work across multiple projects and stakeholders.