Software Engineer - AI Evals and Benchmarking

Job Description

About Us Our mission is to empower researchers, traders, asset managers and risk managers to make better decisions in financial markets Harmoney has built an agentic solution to deliver data and analytics to the users. This helps them generate insights in seconds vs hours with traditional means. Harmoney is backed by Y Combinator and has raised $5 mn in funding. Solid team - worked at Goldman Sachs, Amazon, Tata Capital, Paysense, and leading schools such as IITs and Purdue We are a product company, and our engineering team is at its heart. Our engineers thrive on innovation and the freedom to try out new things. Responsibilities We?re on a mission to make financial data more actionable. Looking for a Software Engineer who?s excited to build an evaluation framework. The software engineer will own the evaluation framework and will be responsible for ensuring quality control as we scale What will you do? Design and maintain the evaluation framework for agentic workflows Create and own datasets/ground truth (programmatic + human-in-the-loop), and manage drift detection Work closely with business teams to understand real-world cases to build a relevant evaluation framework What will you bring? Strong Python + SQL skills Curiousity to explore the AI tools early and iterate fast Why join Harmoney? Small, fast-moving team ? lots of ownership Real impact at the intersection of finance + tech Space to experiment and grow with us