AWS Data Engineer

Job Description

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities,?collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow.?Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your Role Design and implement scalable, secure, and high-performance data pipelines on AWS Cloud. Collaborate with data scientists, analysts, and application teams to deliver advanced analytics and ML-ready data solutions. Ensure data quality, governance, and security across all ingestion, transformation, and storage layers. Optimize ETL workflows, SQL queries, and big data processing for efficiency and reliability. Drive automation and CI/CD practices for seamless deployment and maintenance of data solutions. Monitor and troubleshoot data pipeline performance, ensuring accuracy and resilience. Your Profile 8?14 years of experience in AWS-based data engineering and big data ecosystems. Hands-on expertise in AWS services: Kinesis, EMR, Glue, RDS, Athena, RedShift, Lambda, and S3. Strong programming skills in Python and PySpark, with advanced SQL optimization capabilities. Proven experience with big data tools (Hadoop, Spark, Kafka) and data lake/data warehouse architectures. Familiarity with relational (SQL Server, MySQL, PostgreSQL, Oracle) and NoSQL databases (Cassandra, MongoDB). Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.