Data Engineer

Job Description

Job Overview: We are seeking an experienced Snowflake Developer with a minimum of 5 years of hands-on experience in Snowflake development, integration, migration, and deployment. The ideal candidate will be responsible for designing, implementing, and optimizing Snowflake solutions, ensuring efficient data architecture, and supporting our data-driven decision-making processes. Key Responsibilities: ? Snowflake Development: o Design, develop, and optimize complex data models, tables, views, and stored procedures within the Snowflake environment. o Implement data ingestion, transformation, and loading processes using Snowflake features such as Snowpipe, streams, and tasks. o Develop and maintain Snowflake scripts and SQL-based ETL/ELT processes. ? Data Integration & Migration: o Lead and execute data migration projects, including the transition from legacy databases or data warehouses to Snowflake. o Integrate Snowflake with various data sources and third-party tools, ensuring seamless data flow and connectivity. o Collaborate with cross-functional teams to ensure data consistency, quality, and accuracy across systems. ? Performance Optimization: o Monitor and optimize Snowflake performance, including query tuning, workload management, and resource optimization. o Implement and manage data partitioning, clustering, and indexing strategies to improve performance and scalability. o Regularly review and refine Snowflake security models, including access controls and encryption. ? Deployment & Maintenance : o Develop and manage CI/CD pipelines for Snowflake deployments, ensuring smooth and automated release processes. o Perform regular maintenance, upgrades, and troubleshooting within the Snowflake environment. o Ensure data compliance with organizational policies and industry regulations, including GDPR, HIPAA, etc. ? Collaboration & Documentation: o Work closely with data architects, analysts, and other stakeholders to translate business requirements into technical solutions. o Create and maintain detailed documentation of Snowflake environments, data flows, and ETL/ELT processes. o Provide mentorship and guidance to junior developers and team members. Required Skills & Qualifications: ? Technical Expertise : o Minimum of 5 years of hands-on experience with Snowflake development, including data modeling, ETL/ELT, and SQL scripting. o Strong experience in data integration, migration, and deployment within the Snowflake environment. o Proficiency in SQL, Python, or other relevant programming languages. o Experience with data warehousing concepts, including star schema, snowflake schema, and OLAP. o Familiarity with Snowflake?s features such as Snowpipe, Time Travel, Streams, and Tasks. ? Tools & Technologies: o Experience with cloud platforms such as AWS, Azure, or Google Cloud, and their integration with Snowflake. o Proficiency in data integration tools like Matillion, Talend, Informatica, or similar. o Familiarity with CI/CD tools such as Jenkins, GitLab, or Azure DevOps. Preferred Qualifications: ? Certifications: Snowflake Certification or equivalent certifications in cloud data warehousing. ? Experience : Experience with additional data platforms like Redshift, BigQuery, or similar. ? Knowledge: Understanding of data governance, data security, and compliance.