Back to Jobs
Software Engineering Manager, Data Platform
Actively Reviewing
Autodesk
Job Description
Job Requisition ID #
26WD97080
Position Overview
We are looking for an experienced Engineering Manager to lead our Batch Processing platform team — responsible for building and scaling a high-throughput, governed data platform that powers critical business decisions across the organization, including Autodesk's AI products such as Autodesk Assistant. This role sits at the intersection of high-scale platform engineering, data architecture, and organizational leadership. You will lead a team of strong engineers designing and operating large-scale distributed data processing systems on a modern lakehouse architecture, enabling reliable, secure, and cost-efficient data movement at petabyte scale.
Responsibilities
Team leadership & delivery
About Autodesk
Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.
When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!
Salary transparency
Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.
Diversity & Belonging
We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging
Are you an existing contractor or consultant with Autodesk?
Please search for open jobs and apply internally (not on this external site).
26WD97080
Position Overview
We are looking for an experienced Engineering Manager to lead our Batch Processing platform team — responsible for building and scaling a high-throughput, governed data platform that powers critical business decisions across the organization, including Autodesk's AI products such as Autodesk Assistant. This role sits at the intersection of high-scale platform engineering, data architecture, and organizational leadership. You will lead a team of strong engineers designing and operating large-scale distributed data processing systems on a modern lakehouse architecture, enabling reliable, secure, and cost-efficient data movement at petabyte scale.
Responsibilities
Team leadership & delivery
- Lead, mentor, and grow a team of strong engineers working on batch processing and data platform capabilities
- Be an AI-native leader — leverage AI tools to drive rapid iteration, experimentation, and continuous product evolution
- Drive roadmap execution with a focus on reliability, scalability, ease of use, and time-to-data
- Establish a high-ownership culture with strong engineering fundamentals: design reviews, RCA, testing, and observability
- Partner with TPMs and stakeholders to ensure predictable, high-quality delivery
- Design and evolve a scalable, AI-friendly batch processing platform using Apache Spark (PySpark), distributed compute frameworks, workflow orchestration (Airflow / Temporal), Kubernetes controllers, and AI agents
- Build systems capable of processing billions of records at petabyte scale
- Enable self-service and AI-native pipeline capabilities for internal teams through clean, extensible APIs and platform abstractions
- Optimize continuously for performance, cost efficiency, and reliability
- Drive adoption of a modern lakehouse architecture (S3 + Apache Iceberg or equivalent)
- Build self-service batch processing capabilities that enable internal teams to run Spark, Python, Ray, and MLOps jobs with minimal friction and strong platform guardrails
- Enable downstream consumption via SQL engines and warehouse integrations
- Ensure platform adherence to data governance and security standards
- Build self-service controls and abstractions that allow teams to manage access, enforce data policies, and meet compliance requirements without deep platform expertise
- Partner with security and compliance teams to meet enterprise and regulatory requirements
- Build end-to-end observability: metrics, logging, alerting, SLA tracking, and reporting
- Drive incident management, root cause analysis, and continuous improvement
- Improve platform resilience through automation and resilience patterns
- Partner with data engineering, analytics, and platform teams to drive adoption
- Work closely with infra, security, and partner teams for platform integration
- Influence architecture decisions at the org level
- Communicate effectively with senior leadership and business stakeholders
- 8–12+ years in software or data engineering
- 3–5+ years managing engineering teams
- Experience leading platform teams or large-scale data systems
- Strong hands-on experience with distributed data processing (Spark, Flink, etc.), batch pipelines at scale, and AWS (preferred)
- Deep understanding of data lake / lakehouse architectures, data modeling, and workflow orchestration (Airflow, Temporal, etc.)
- Proven ability to hire, mentor, and grow high-performing teams
- Strong communication and cross-functional influence skills; ability to balance technical depth with strategic thinking
- Experience with Apache Iceberg or Delta Lake
- Familiarity with data observability tools
- Experience with metadata and catalog systems (e.g., Atlan or similar)
- Exposure to data governance frameworks and compliance standards
About Autodesk
Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.
When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!
Salary transparency
Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.
Diversity & Belonging
We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging
Are you an existing contractor or consultant with Autodesk?
Please search for open jobs and apply internally (not on this external site).
Required Skills
Similar Jobs
View all →
SAP ABAP Development for HANA
Aryvart Software Pvt Ltd
Coimbatore
₹5–17 LPA
SAP ABAP on HANA
HANA
SAP
+1
Sr. Data Analyst
RSCP
Noida
₹6–9 LPA
Dashboard Development
Data Analysis
ETL Validation
+1
PHP Developer
Cloudnausor Technologies Pvt ltd
Chennai
₹4–10 LPA
PHP
SQL
Senior Software Engineer – Backend & Search
Wingify
India
Data architecture
Machine Learning
RedShift
+26
Senior Data Engineer – Telecom OSS, ETL & Analytics (Python, Airflow)
Infosys
Chennai
Data architecture
Machine Learning
Data Analysis
+17
Similar Jobs
View all →
SAP ABAP Development for HANA
Aryvart Software Pvt Ltd
Coimbatore
Sr. Data Analyst
RSCP
Noida
PHP Developer
Cloudnausor Technologies Pvt ltd
Chennai
Senior Software Engineer – Backend & Search
Wingify
India
Senior Data Engineer – Telecom OSS, ETL & Analytics (Python, Airflow)
Infosys
ChennaiShare
Quick Apply
Upload your resume to apply for this position
–