Senior Data Engineer - GCP

Job Description

Job Title: Senior GCP Data Engineer Job Description We are seeking a highly skilled Senior GCP Data Engineer to design, develop, and optimize data-centric solutions on the Google Cloud Platform (GCP) . The ideal candidate will have strong expertise in building scalable ETL pipelines, developing data processing workflows, and implementing robust data management strategies using GCP-native services. This role requires hands-on experience in cloud-based data engineering, CI/CD, security, and performance optimization. Key Responsibilities Data Engineering & Development Design and implement scalable data-centric solutions on GCP using tools such as BigQuery, Google Cloud Storage, Cloud SQL, MemoryStore, Dataflow, Dataproc, Artifact Registry, Cloud Build, Cloud Run, Pub/Sub, Vertex AI, and GCP APIs . Build robust ETL pipelines to ingest data from heterogeneous sources into the system. Develop data processing workflows using Python and Java for extracting, transforming, and loading (ETL) large datasets. Create and maintain efficient data models , ensuring optimized storage, retrieval, and analytics. Database Management Deploy and manage SQL and NoSQL databases on GCP, including Cloud SQL, Bigtable, and Firestore . Optimize data workflows for performance, reliability, and cost efficiency on GCP infrastructure. DevOps, CI/CD & Monitoring Implement version control and CI/CD pipelines for data engineering workflows. Utilize GCP monitoring & logging tools (Cloud Monitoring, Cloud Logging) to identify performance bottlenecks and system failures. Troubleshoot and resolve issues related to data processing, storage, and retrieval. Security & Quality Assurance Ensure code quality using SonarQube, Checkmarx, Fossa, Cycode throughout the development lifecycle. Implement strong security measures and adhere to data governance policies to ensure data integrity and confidentiality. Collaboration & Documentation Work closely with cross-functional stakeholders to gather and define data requirements aligned with business goals. Develop and maintain comprehensive documentation for data engineering processes and systems. Participate in on-call rotations to address critical production issues. Mentor and guide junior team members, fostering a collaborative, knowledge-sharing culture. Required Skills & Qualifications 10+ years of experience in data engineering , WITH GCP . Strong proficiency in Python and Java for data processing. Expertise in building and maintaining ETL/ELT pipelines . Hands-on experience with major GCP services: BigQuery, Dataflow, Dataproc, GCS, Cloud SQL, Cloud Run, Pub/Sub , etc. Excellent understanding of SQL/NoSQL databases and data modeling concepts. Experience with CI/CD tools, version control (Git), and DevOps practices. Familiarity with code scanning and security tools like SonarQube, Checkmarx, Fossa, Cycode . Strong analytical, troubleshooting, and communication skills.