Data Engineer

Job Description

Job Description REQUIREMENTS MANAGEMENT: Identify, document, communicate and design per requirements. DESIGN: Work with Data Product Owners to design data stores. IMPLEMENT DATA STORES: Implement data stores on GCP, using DBT for transformations, BigQuery for data store and Astronomer for overall orchestration. TEST: Participate in testing and adopt test driven development. TUNE: Tune data stores (indexes, SQL queries) to improve performance. L2 SUPPORT: Assist with customer inquiries and incidents/problems. COLLABORATE: Work within/across teams. Responsibilities Critical thinking and decision making DA/DBA - Data Architecture (Data Design, Index Design, Referential Integrity) DA/DBA - DB Create/Modify (DB Create/Modify tables, DDL export/import, Data export/import) DA/DBA - Performance Tuning (DB-side identification of issues, SQL tuning, DB tuning) Data Manipulation ? GCP BigQuery, DBT Data Pipeline Orchestration ? Astronomer, GCP Cloud Scheduler Strong communication ? both verbal and written Qualifications Bachelor?s degree in Data science, computer science, Operational research, Statistics, Applied mathematics, or in any other engineering discipline. 3+ years of hands-on experience in Python programming for data analysis, machine learning, and with libraries such as NumPy, Pandas, Matplotlib, Scikit-learn, TensorFlow, PyTorch, NLTK, spaCy, and Gensim. 2+ years of experience with both supervised and unsupervised machine learning techniques. 2+ years of experience with data analysis and visualization using Python packages such as Pandas, NumPy, Matplotlib, Seaborn, or data visualization tools like Dash or QlikSense. 1+ years' experience in SQL programming language and relational databases.