EY - GDS Consulting - AI and DATA - AWS Databricks - Senior

Job Description

At EY, you?ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we?re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS ? Data and Analytics (D&A) ? AWS Data Engineer with Databricks As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We?re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. Your Key Responsibilities Develop and deploy data lakehouse pipelines in a cloud environment using AWS and Databricks services. Design and implement end-to-end ETL/ELT workflows using Databricks (PySpark, Delta Lake, DLT) and AWS native services such as S3, Glue, Lambda, and Step Functions. Migrate existing on-premises ETL workloads to the AWS + Databricks platform with optimized performance and cost efficiency. Interact with business and technical stakeholders, understand their data goals, and translate them into scalable, governed solutions. Design, optimize, and monitor Spark jobs and SQL models for faster execution and high throughput. Implement and manage Unity Catalog for metadata, lineage, and fine-grained access control across workspaces. Participate in data architecture reviews, DevOps automation, and CI/CD deployments for Databricks workflows. Collaborate closely with data analysts, BI developers, and data scientists to ensure reliable, high-quality data delivery. Skills And Attributes For Success Overall 4+ years of IT experience with 2+ years of relevant experience in Databricks and AWS cloud-based data engineering. Strong hands-on experience in Databricks (PySpark, Delta Lake, Delta Live Tables, Unity Catalog). Practical knowledge of AWS services such as S3, Glue, Lambda, Step Functions, CloudWatch, and Redshift. Experience working with structured and semi-structured data formats (CSV, JSON, Parquet, XML). Good understanding of ETL orchestration using Databricks Workflows, Airflow, or Step Functions. Familiarity with metadata-driven ingestion frameworks and medallion architecture (Bronze, Silver, Gold) design principles. Solid experience in Python, PySpark, and SQL for data transformation and validation. Knowledge of CI/CD practices and version control (GitHub, Azure DevOps, Jenkins). Excellent analytical, troubleshooting, and problem-solving skills. Ability to work independently, interact with stakeholders, and deliver high-quality solutions under minimal supervision. To qualify for the role, you must have A Bachelor?s or Master?s degree in Computer Science, Information Technology, or related field. 4?7 years of industry experience in data engineering or data architecture roles. Proven working experience in AWS Databricks environment with production-grade data pipelines. Working knowledge of Agile/Scrum methodologies and data delivery lifecycle. Strong communication skills (both written and verbal) and ability to present complex solutions clearly. Flexible, proactive, and self-motivated working style with strong ownership of problem resolution. Experience across all phases of data solution delivery lifecycle ? analysis, design, development, testing, deployment, and support. Ideally, you?ll also have Client management skills What We Look For People with technical experience and enthusiasm to learn new things in this fast-moving environment What Working At EY Offers At EY, we?re dedicated to helping our clients, from start?ups to Fortune 500 companies ? and the work we do with them is as varied as they are. You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer: Support, coaching and feedback from some of the most engaging colleagues around Opportunities to develop new skills and progress your career The freedom and flexibility to handle your role in a way that?s right for you EY | Building a better working world EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets. Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate. Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.