Senior Data Engineer

Job Description

Senior Data Engineer ? Python & GCP We are seeking an experienced and highly motivated Senior Data Engineer with hands-on expertise in Python programming and Google Cloud Platform (GCP). In this role, you will design, build, and maintain scalable ETL pipelines, work with cloud-native technologies, and ensure the reliability and quality of enterprise data systems. Key Responsibilities Design, develop, test, and maintain scalable ETL pipelines using Python. Build and optimize data workflows leveraging GCP services such as Dataflow, BigQuery, Cloud Functions, Cloud Composer (Airflow), GCS, IAM, and Cloud Run. Implement robust data ingestion, transformation, and quality assurance processes. Collaborate with cross-functional teams including data scientists, analysts, and software engineers to deliver high-quality, reliable data solutions. Manage version control with GitHub and support CI/CD pipeline deployments for data projects. Write and optimize complex SQL queries across databases such as SQL Server, Oracle, and PostgreSQL. Prepare and maintain documentation including pipeline design, architecture diagrams, and support procedures. Technical Skills & Experience 7?10 years of hands-on data engineering experience with Python. Strong proficiency in GCP services: Dataflow, BigQuery, Cloud Functions, Cloud Composer, GCS. Proven experience with Apache Spark, Kafka, Airflow, and Python FastAPI. Knowledge of caching and storage technologies like Redis, MongoDB, or Bigtable. Strong SQL expertise with large-scale relational databases. Experience in CI/CD pipeline integration and Git-based workflows. Exposure to data migration projects from on-premise to cloud environments. Good to Have Experience with Snowflake, GKE, Cloud Run, or Databricks. Familiarity with Azure Data Factory or other Azure data tools. Additional Details Excellent problem-solving and analytical abilities. Effective communication and teamwork skills. Ability to thrive in a dynamic, cloud-driven data environment. If you're passionate about building robust data systems and leveraging GCP to drive data excellence, we?d love to hear from you.