AWS Glue

Job Description

Job Summary As a Sr. Developer you will play a crucial role in designing developing and implementing cloud-based solutions using AWS technologies. You will leverage your expertise in AWS CloudWatch IAM Amazon Redshift and other AWS services to optimize data workflows and ensure seamless integration. Your contributions will directly impact the efficiency and scalability of our data infrastructure supporting the companys mission to deliver innovative solutions. Responsibilities Develop and implement cloud-based solutions using AWS services to enhance data processing capabilities. Collaborate with cross-functional teams to design scalable and efficient data architectures. Utilize AWS CloudWatch to monitor and optimize system performance ensuring high availability and reliability. Manage access and security protocols using AWS IAM to safeguard data integrity and privacy. Design and maintain data warehouses using Amazon Redshift to support analytical and reporting needs. Implement ETL processes using AWS Glue Studio and AWS Glue ETL to streamline data transformation workflows. Leverage AWS Glue Catalog to organize and manage metadata for efficient data discovery. Utilize Amazon S3 for data storage and retrieval ensuring cost-effective and scalable solutions. Apply Apache Spark for distributed data processing to handle large datasets efficiently. Develop Python scripts to automate data processing tasks and improve operational efficiency. Collaborate with stakeholders to understand business requirements and translate them into technical solutions. Provide technical guidance and support to junior developers fostering a collaborative team environment. Continuously evaluate and integrate new AWS technologies to enhance system capabilities. Qualifications Possess a strong understanding of AWS services including CloudWatch IAM and Redshift to design robust solutions. Demonstrate proficiency in Python programming for developing efficient data processing scripts. Experience with AWS Glue Studio and Glue ETL for implementing seamless data transformation processes. Familiarity with Apache Spark for handling large-scale data processing tasks. Strong analytical and problem-solving skills to address complex technical challenges. Certifications Required AWS Certified Solutions Architect AWS Certified Developer