Data Engineer

We are looking for an experienced Data Engineer to design, build, and optimize scalable, secure, and high-performing data solutions that power enterprise reporting and analytics.

Key Responsibilities

Data Engineering & Pipeline Development

• Design, develop, test, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).
• Build data ingestion pipelines from databases, APIs, files, and cloud storage.
• Develop batch and near real-time data processing solutions.
• Create data transformation workflows using Azure Databricks (PySpark/Spark SQL).
• Build reusable, parameter-driven, and metadata-based pipeline frameworks.
• Monitor, troubleshoot, and optimize data pipelines to ensure reliability and performance.

Data Modeling & Architecture

• Design scalable data models for enterprise reporting and analytics.
• Implement dimensional models, star schemas, and normalization techniques where appropriate.
• Develop Lakehouse architectures using Bronze, Silver, and Gold data layers.
• Optimize storage, partitioning, and retrieval for large-scale datasets.
• Utilize Delta Lake capabilities, including ACID transactions, schema evolution, and time travel.
• Contribute to enterprise data architecture and solution design initiatives.

Required Skills & Experience

• 5+ years of experience in Data Engineering or related roles.
• Strong experience designing and developing ETL/ELT pipelines.
• Advanced SQL programming and data transformation expertise.
• Hands-on experience with:
• Azure Data Factory (ADF)
• Azure Databricks
• Apache Spark (PySpark & Spark SQL)
• Azure Data Lake Storage Gen2 (ADLS)
• Strong understanding of dimensional data modeling and data warehousing concepts.
• Experience implementing Lakehouse architecture and Delta Lake.
• Proficiency in Python or similar programming languages.
• Experience with Power BI or other BI reporting platforms.
• Knowledge of Git, CI/CD, and Azure DevOps.
• Strong understanding of cloud security, authentication, and authorization principles.
• Experience optimizing large-scale data processing and cloud-based analytics platforms.

About Us

We specialize in Digital, ERP, and larger IT Services. We offer flexible, efficient and collaborative solutions to any organization that requires IT, experts. Our agile, agnostic, and flexible solutions will help you source the IT Expertise you need. If you are looking for new opportunities, send your profile at [email protected].

Also follow our LinkedIn page for new job opportunities and more.

Zone IT Solutions is an equal opportunity employer and our recruitment process focuses on essential skills and abilities. We encourage applications from a diverse array of backgrounds, including individuals of various ethnicities, cultures, and linguistic backgrounds, as well as those with disabilities.