Senior enterprise technology engineer

Job Description

You will work with You will join our Digital Trading Analytics department , supporting the Trading Analytics & Insights (TA&I) organisation. This is a high-performing, global team that collaborates closely with traders, trading analysts, business analysts, and engineers to deliver data-driven insights for energy trading. You will lead and mentor a team of data engineers, working in an Agile environment (Kanban/Scrum) and using tools such as Azure DevOps for planning and tracking work. You will also collaborate across borders and time zones to deliver strategic data solutions. Let Me Tell You About The Role As a Senior Enterprise Technology Engineer , you will provide technical leadership and strategic direction for building highly scalable and efficient data pipelines. You will design and implement advanced data solutions, optimise performance, and ensure seamless integration across systems. This role combines hands-on engineering with leadership responsibilities, including mentoring team members and driving best practices in data engineering. You will play a critical role in enabling reliable, high-quality data solutions that support trading operations and business intelligence. What You Will Deliver Design, develop, and implement highly scalable data pipelines using advanced Python (including Pandas, web scraping, and machine learning libraries), SQL, and Apache Airflow. Lead ETL processes for large and complex datasets, including time-series data from APIs, databases, and real-time streams. Leverage AWS cloud services (S3, Redshift, EC2, Lambda) to build and manage secure, cost-effective data solutions. Use Databricks for large-scale data processing and advanced analytics. Create compelling data visualisations using tools such as Tableau and Power BI to communicate insights effectively. Mentor and coach a team of 3?4 data engineers, fostering a culture of knowledge sharing and continuous learning. Drive adoption of Agile methodologies and utilise Azure DevOps for planning and delivery. Champion automation and best practices to improve reliability and efficiency. Maintain clear technical documentation for pipelines and processes to ensure maintainability and knowledge transfer. What you will need to be successful (experience and qualifications) 7+ years of experience in a Data Engineering role, with proven success in leading and mentoring teams. Expertise in Python (Pandas, web scraping libraries like Selenium, Beautiful Soup, Requests, and machine learning libraries such as TensorFlow, PyTorch). Advanced SQL skills, including optimisation techniques, and strong experience with relational databases. Extensive experience designing and building large-scale, efficient data pipelines for complex and time-series data. Proven experience with Apache Airflow for orchestration and scheduling at scale. Strong knowledge of AWS cloud services (S3, Redshift, EC2, Lambda). Experience with Databricks and advanced data visualisation tools (Tableau, Power BI). Comfortable working in Linux environments and proficient with Git version control. Excellent communication skills with the ability to present complex concepts to technical and non-technical audiences. Demonstrated ability to work in a global environment and build strong relationships across teams. Highly responsible, self-motivated, and adaptable in fast-paced environments. Strong organisational skills and a passion for automation and continuous improvement. Bachelor?s or Master?s degree in Computer Science, Engineering, Information Systems, or a numerate discipline. About Bp Our purpose is to deliver energy to the world, today and tomorrow. For over 100 years, bp has focused on discovering, developing, and producing oil and gas in the nations where we operate. We are one of the few companies globally that can provide governments and customers with an integrated energy offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner! We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.