Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow

Job Description

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we?re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title And Summary Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all. Overview The Mastercard Account Level Management (ALM) platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend. Role Managing multiple scrum teams of Software developers and testers to develop quality software solutions in a timely and cost-effective manner. Successfully lead definition, development and delivery of major cross-department initiatives with broad scope and long-term business implications. Provide technical leadership and direction to software development teams in the development of services and capabilities, Understand, implement and enforce Software development standards and engineering principles in the Big Data space. Work closely with product and architecture teams on product definition, technical design, and overall execution for the team. Ensure the project or effort is adequately staffed; trained and managed. Ensure personnel have appropriate skills and behaviors; and effectively communicate performance results; as necessary, managing each effort within approved manpower and budget guidelines Technically manage and drive deliveries from scrum teams that will be responsible implementing, documenting, testing, maintaining and supporting applications in adherence with industry best practices specially in Big Data space. Developing high quality, secure, scalable solutions based on technical requirements specifications and design artifacts within expected time and budget. Work across on-premises and cloud environments (AWS, Azure, Databricks). Design & development of high quality data driven applications and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO. Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge. Expertise to guide team in using SDLC tools such Git-based version control systems, CI/CD pipelines using Jenkins, Checkmarx, test automation tools etc Proficient in working within an Agile/Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews Good to have experience in developing enterprise solutions (standalone applications, services & SDK) using J2EE, JDBC (SQL & NoSQL) related technologies like Spring & Spring framework, micro services on Cloud. Integrating content feeds via API, JSON, XML, and RSS from both internal and external sources. supporting internal and external users of the applications/systems, performing production incident management and participating in on-call escalation pager support rotation. Documenting application components for support and training materials for MasterCard Quality Assurance and Quality Control processes. About You Hands-on technical leader who brings considerable experience doing application development and managing teams by using a broad range of technologies and dives deep into everything team does. Demonstrate leadership, ethics and values to generate high trust with team, peers, and management. Must be high-energy, detail-oriented and proactive with the ability to function under pressure in an independent environment. Must provide the necessary skills to have a high degree of initiative and self-motivation with a willingness and ability to learn and take on challenging opportunities. Strong communication skills ? both verbal and written ? with strong relationship building, collaborative skills and organizational skills. Must be obsessed with results, and effectively communicate objectives and how success will be measured to the team and other stakeholders. Have strong decision-making skills, lead retrospection and continually improve as a result. Understands how to guide an engineer?s career including performance evaluation, coaching, and motivation. Corporate Security Responsibility All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must: Abide by Mastercard?s security policies and practices; Ensure the confidentiality and integrity of the information being accessed; Report any suspected information security violation or breach, and Complete all periodic mandatory security trainings in accordance with Mastercard?s guidelines.