Data Engineer - GCP, BiqQuery, Dataflow, Pub/Sub, Stardog, Composer
Chennai, Tamil Nadu, India
1 month ago
Applicants: 0
1 month left to apply
Job Description
Avant de postuler ? un emploi, s?lectionnez votre langue de pr?f?rence parmi les options disponibles en haut ? droite de cette page. D?couvrez votre prochaine opportunit? au sein d'une organisation qui compte parmi les 500 plus importantes entreprises mondiales. Envisagez des opportunit?s innovantes, d?couvrez notre culture enrichissante et travaillez avec des ?quipes talentueuses qui vous poussent ? vous d?velopper chaque jour. Nous savons ce qu?il faut faire pour diriger UPS vers l'avenir : des personnes passionn?es dot?es d?une combinaison unique de comp?tences. Si vous avez les qualit?s, de la motivation, de l'autonomie ou le leadership pour diriger des ?quipes, il existe des postes adapt?s ? vos aspirations et ? vos comp?tences d'aujourd'hui et de demain. Job Description Fiche de poste : We're seeking a talented Data Engineer with hands-on experience in the Google Cloud data ecosystem and a proven track record of working with Vector Database, Knowledge Graphs like Neo4j and StarDog. You'll be instrumental in designing, building, and maintaining our data infrastructure and pipelines, enabling critical insights and supporting data-driven initiatives across the organization. Responsibilities Data Pipeline Development: Design, build, and optimize robust and scalable data pipelines to ingest, transform, and load data from various sources into our data warehouse and knowledge graphs. Cloud Data Stack Expertise: Implement and manage data solutions using Google Cloud Platform (GCP) services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, Spanner and Dataproc and Azure Cloud Services Knowledge Graph Engineering: Develop and maintain data models, ingest data, and create efficient queries within Neo4j and/or Stardog. Leverage your expertise to build and expand our enterprise knowledge graph. Data Quality & Governance: Implement best practices for data quality, data validation, and data governance, ensuring data accuracy, consistency, and reliability. Performance Optimization: Continuously monitor and optimize the performance of data pipelines and database queries, identifying and resolving bottlenecks. Collaboration: Work closely with data scientists, analysts, and other engineering teams to understand data requirements and deliver effective data solutions. Documentation: Create and maintain comprehensive documentation for data pipelines, data models, and knowledge graph schemas. Education Required Qualifications Bachelor?s degree in computer science, Engineering, or a related quantitative field. Experience 3+ years of professional experience as a Data Engineer or in a similar role. Strong hands-on experience with Google Cloud Platform (GCP) data services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer (Apache Airflow). Demonstrable experience working with Knowledge Graph technologies, specifically Neo4j and/or Stardog. This includes data modeling, query language proficiency (Cypher for Neo4j, SPARQL for Stardog), and integration. Proficiency in Python for data manipulation and pipeline orchestration. Experience with SQL and data warehousing concepts. Familiarity with data modeling techniques for both relational and graph databases. Experience with version control systems (e.g., Git). Preferred Qualifications Experience with other GCP services like Data Catalog, Looker, or Vertex AI. Knowledge of streaming data technologies (e.g., Kafka, Google Cloud Dataflow streaming). Experience with other graph databases or semantic web technologies. Familiarity with data governance tools and principles. Certifications in Google Cloud Platform data engineering. Type De Contrat en CDI Chez UPS, ?galit? des chances, traitement ?quitable et environnement de travail inclusif sont des valeurs clefs auxquelles nous sommes attach?s.
Required Skills
Additional Information
- Company Name
- UPS
- Industry
- N/A
- Department
- N/A
- Role Category
- Data Engineer
- Job Role
- Mid-Senior level
- Education
- No Restriction
- Job Types
- On-site
- Gender
- No Restriction
- Notice Period
- Less Than 30 Days
- Year of Experience
- 1 - Any Yrs
- Job Posted On
- 1 month ago
- Application Ends
- 1 month left to apply