Delta Lakes & Relational Database Engineer (Python, SQL, PySpark)

Job Description

NEW OPPORTUNITY || IMMEDIATE TO 30 DAYS JOINERS REQUIRED|| Position Title:- Data Engineer Grade 5 Location:- Hyderabad, TL Position type:- Contract-to-hire (Initial contract of 12 Months) Experience:- 10+ Years Job Responsibility We are looking for a strong software engineer with experience building solutions against delta lakes and relational databases. You will work on Azure Databricks writing code in Python and SQL, with PySpark. You will perform analysis, design, implementation, and testing. We favour automated testing. You will extend the functionality of the consistency check engine for the sub-ledger data and any other tenants. Given the large data volume (datasets with 10s of billion rows, 200+ columns), you also need to dive deeply into the spark performance optimization. Requirement Bachelor's or master's degree in computer science or electrical engineering ? Expert software engineering skills. Proven experience developing complex software systems as a software engineer ? Strong core Python software engineering experience ? Have a good understanding and significant experience with projects using relational data models and SQL ? Spark experience is a must. ? Good work ethic and self-starter. Not content to be "task driven". You look out for issues, opportunities and address them when you can, raise them when you can't ? Good analytical skills and the ability to understand complexity and break it down into smaller, achievable steps ? Highly proficient in English (written and verbal)