Senior Pyspark Developer

Job Description

Project Description: We need a Senior Python and Pyspark Developer to work for a leading investment bank client. Responsibilities: ? Develop software applications based on business requirements ? Maintain software applications and make enhancements according to project specifications ? Participate in requirement analysis, design, development, testing, and implementation activities ? Propose new techniques and technologies for software development. ? Perform unit testing and user acceptance testing to evaluate application functionality ? Ensure to complete the assigned development tasks within the deadlines ? Work in compliance with coding standards and best practices ? Provide assistance to Junior Developers when needed. ? Perform code reviews and recommend improvements. ? Review business requirements and recommend changes to develop reliable applications. ? Develop coding documentation and other technical specifications for assigned projects. ? Act as primary contact for development queries and concerns. ? Analyze and resolve development issues accurately. Mandatory Skills Description: ? 8+ years of experience in data intensive Pyspark development. ? Experience as a core Python developer. ? Experience developing Classes, OOPS, exception handling, parallel processing . ? Strong knowledge of DB connectivity, data loading , transformation, calculation. ? Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations. ? Lambda Functions, Decorators. ? Vector operations on Pandas dataframes /series. ? Application of applymap, apply, map functions. ? Concurrency and error handling data pipeline batch of size [1-10 gb]. ? Ability to understand business requirements and translate them into technical requirements. ? Ability to design architecture of data pipeline for concurrent data processing. ? Familiar with creating/designing RESTful services and APIs. ? Familiar with application unit tests. ? Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services. ? Debugging application. Nice-to-Have Skills Description: ? Knowledge of web backend technology - Django, Python, PostgreSQL. ? Apache Airflow ? Atlassian Jira ? Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus ? Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus Languages: English: C2 Proficient