Data Engineer

We are looking for energetic, high-performing and highly skilled GCP Data Engineers to help shape our technology and product roadmap.

Job Description:

Responsibilities:

• Develop and maintain large scale data processing pipeline using PySpark Data Proc, Big Query and SQL.
• Use Big Query and Data proc to migrate existing Hadoop/Spark/Hive workloads to Google Cloud.
• Proficient in Big Query to carry out batch and interactive data analysis.
• Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)
• Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality
• Enable the deployment, support, and monitoring of software across test, integration, and production environments

Minimum Qualifications:

This high energy Engineer must have:

• A Bachelor’s degree in computer science, computer engineering, other technical discipline, or equivalent work experience
• 6 – 9 years of software development experience. Hands-on expertise with application design, software development, and automated testing.
• Strong programming knowledge in SQL, PySpark, Data Proc, Big Query
• Hands-on experience in Big Data technologies (Spark, Hive)
• Understanding and experience with UNIX / Shell / Perl / Python scripting
• Database query optimization and indexing
• Web services design and implementation using REST / SOAP and Java is a plus
• Experience collaborating with the business to drive requirements/Agile story analysis.
• Experience with design and coding across one or more platforms and languages as appropriate

Bonus skills:

• Machine learning/data mining
• Object-oriented design and coding
• Adobe Marketing Campaign products