GCP Data Engineer

Job Description

Dear Candidate, Greetings from TATA Consultancy Services!! Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For:- GCP Data Engineer GCP, Big Query, Dataflow, Data Proc, Cloud SQL, Cloud Spanner, Pub/Sub, ETL, Apache airflow, Python, Pandas and Numphy Location: Bangalore / Chennai Experience: 6 to 10yrs Must-Have ? Google Data Engineer (Overall 5+ Years with 3 years relevant hands-on experience) ? Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc. ? Good skills in Python Language, PYSPARK ? Good Skills in Linux ? Exposure to creation of CI-CD pipelines for promoting big data release deployments and designing log monitoring features. ? Excellent written and verbal communication skills in English ? The following skills are good-to-have, but not a requirement: ? Good-to-Have ? Experience in On Premise Hadoop technologies (Hive, Sqoop, SPARK, Kafka) Hadoop, Spark, Apache Beam SN Responsibility of / Expectations from the Role 1 Data modelling/Data warehouse modernization/Cloud based data lakes 2 Create and maintain optimal data pipeline architecture 3 Define technical roadmap for data platform modernization and analysis and assessment of the existing data platforms 4 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. 5 Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Google cloud ?big data? technologies. 6 Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. 7 Define KPIs for successful modernization of data platform and measure the improvement against the KPIs.