Back to Jobs
PC - 1469 - Data Engineer (ADF / Dataflow Specialist)
Actively Reviewing
Softobiz
Job Description
Data Engineer – Kochi Data CoE
Role Basics
We are looking for a skilled and driven Data Engineer with 4 to 6 years of experience to join our Architecture & Delivery Team in Kochi on a fully onsite basis. In this role, you will focus heavily on designing, building, and optimizing robust data pipelines using Microsoft Azure Data Factory (ADF) and Dataflows.
Operating under our specialized Agentic Development Lifecycle (AiDLC), you will transition standard data migration and modernization tasks into repeatable, high-margin software products. You will build automated data tools and embed smart, subscription-enabling validation agents into software deployed for our global clients, maintaining strict engineering and security baselines throughout a rapid 90-day deployment lifecycle.
Key Responsibilities
Pipeline & Product Engineering
Domain Skills & Technologies Must / Preferred
Core Cloud Data Microsoft Azure Data Factory (ADF) / Dataflows / Azure Data Engineering / Microsoft Fabric / Dataverse Must-Have Governance & Quality Microsoft Purview, ISO/IEC 25010 Compliance Frameworks Good-to-Have Analytics & BI Power BI, Advanced DAX, Pre-packaged Analytics Frameworks Good-to-Have AI & Lifecycle Agentic Development Lifecycle (AiDLC), Embedded Validation Agents Good-to-Have Target Architecture Dynamics 365 Core Schemas & Migration APIs Preferred
Qualifications & Certifications
Role Basics
We are looking for a skilled and driven Data Engineer with 4 to 6 years of experience to join our Architecture & Delivery Team in Kochi on a fully onsite basis. In this role, you will focus heavily on designing, building, and optimizing robust data pipelines using Microsoft Azure Data Factory (ADF) and Dataflows.
Operating under our specialized Agentic Development Lifecycle (AiDLC), you will transition standard data migration and modernization tasks into repeatable, high-margin software products. You will build automated data tools and embed smart, subscription-enabling validation agents into software deployed for our global clients, maintaining strict engineering and security baselines throughout a rapid 90-day deployment lifecycle.
Key Responsibilities
Pipeline & Product Engineering
- Design & Build Pipelines: Develop, orchestrate, and maintain scalable data ingestion and transformation pipelines using Azure Data Factory (ADF) and Dataflows.
- Accelerate Migrations: Build automated data solutions and core data assets focusing on the Data Migration Accelerator for Dynamics 365, Dataverse, and Microsoft Fabric.
- Embed Agentic Logic: Develop and integrate intelligent, automated agents (including validation, reconciliation, and data-stewardship agents) within pipelines to shift client value from one-time migration builds to ongoing, subscription-based service models.
- Analytics Delivery: Create and pre-package robust Analytics & Insights Accelerators utilizing Microsoft Fabric and Power BI to maximize day-one reporting capabilities for end-users.
- Data Governance: Implement and enforce native data governance, security baselines, and tracking frameworks seamlessly across environments using Microsoft Purview.
- Agile Delivery: Deliver and deploy all assigned data products utilizing the internal Agentic Development Lifecycle (AiDLC), adhering strictly to a 90-day development-to-production cycle (the "3-month rule").
- Quality Assurance: Ensure all data pipelines and products strictly align with ISO/IEC 25010 software quality standards and pass uncompromising security clearance checks before entering active client environments.
Domain Skills & Technologies Must / Preferred
Core Cloud Data Microsoft Azure Data Factory (ADF) / Dataflows / Azure Data Engineering / Microsoft Fabric / Dataverse Must-Have Governance & Quality Microsoft Purview, ISO/IEC 25010 Compliance Frameworks Good-to-Have Analytics & BI Power BI, Advanced DAX, Pre-packaged Analytics Frameworks Good-to-Have AI & Lifecycle Agentic Development Lifecycle (AiDLC), Embedded Validation Agents Good-to-Have Target Architecture Dynamics 365 Core Schemas & Migration APIs Preferred
Qualifications & Certifications
- Education: Bachelor's degree in Computer Science, Information Technology, Software Engineering, or a related technical discipline.
- Experience: 4–6 years of professional data engineering experience, with a heavy emphasis on building cloud data pipelines (ADF/Dataflows), reusable accelerators, or SaaS-based data integrations.
- Mandatory Certification Timeline: Must currently hold, or explicitly commit to achieving, the DP-203 (Azure Data Engineer Associate) or DP-600 (Fabric Analytics Engineer Associate) along with PL-300 (Power BI Data Analyst) certifications by December 2026 to support Softobiz's Solutions Partner for Data & AI designation roadmap.
- Accountability & Drive: High ownership mindset with a proven ability to independently drive complex engineering milestones to completion under 90-day cycles.
- Cross-Border Communication: Strong written and verbal communication skills, with the capability to clearly articulate technical logic, documentation, and product requirements.
- Product-Centric Thinking: Ability to design data flows with modularity and reusability in mind, looking past single-project silos to build scalable platforms.
- Leading-Edge Innovation: Deep, direct engagement with emerging technologies like Agentic AI orchestration, Micro-Agent Architectures, and advanced Microsoft Fabric implementations.
- Global Exposure: Opportunity to contribute directly to data systems deployed for premier enterprise clients across Australia, the US, and India.
- Upskilling & Certification Support: Structured organizational tracking and learning assistance to clear premier Microsoft and Azure technical certifications.
Required Skills
Similar Jobs
View all →
Microsoft Fabric Consultant (Contract Role)
Unknown
India
Solution architecture
Release management
Capacity Planning
+19
Master Data Specialist
RH Aero Systems
Compliance frameworks
Business Intelligence
Data Analysis
+13
DATA & AI LEAD
Case New Holland Const Equip Ind Private Limited
Gurgaon
Data architecture
Machine Learning
Solution architecture
+10
Senior Risk Analyst
Jobgether
India
Compliance frameworks
ISO 27001
Adobe Illustrator
+8
DATA & AI LEAD
凯斯纽荷兰(中国)管理有限公司
Gurgaon
Data architecture
Machine Learning
Solution architecture
+10
Share
Quick Apply
Upload your resume to apply for this position
–