Product Manager, APEX

Mercor’s AI Productivity Index (APEX) assesses how effectively frontier AI models can perform economically valuable work. We're looking for a Product Manager to own and scale the APEX brand and public leaderboard. In this role, you will define the positioning, strategy, roadmap, and operational excellence of Mercor's evaluation products, benchmarks, and public and private leaderboards. You will work across Research, Engineering, Operations, and Go-To-Market teams to transform evaluation datasets into trusted industry benchmarks that influence model development and purchasing decisions across the AI ecosystem.

Responsibilities

Own the roadmap and portfolio strategy: set and influence priorities across new benchmark development, leaderboard launches, infrastructure investment, and expansion into new evaluation categories; Run the intake for new benchmarks: evaluate and prioritize proposals from research, customers, and GTM against real demand and company strategy; Enforce eval integrity: own contamination policy, holdout strategy, versioning, auditability, and release cadence; Build end-to-end eval pipeline: own the path from eval run to published result, including harness execution, grading, model onboarding, hyperparameter scaffolds, cost and latency reporting, and the leaderboard surface itself; Work directly with labs and customers: understand evaluation needs, present and defend results, and turn feedback into the next benchmark; Close the loop to the business: connect leaderboard demand signals to loss analysis investments and dataset production; Get in the weeds: write specs and PRDs, read trajectories, spot-check failures, and make small PRs to unblock yourself and continuously improve the system

Requirements

5+ years in product management, technical program management, or a customer-facing technical role; Eval literacy: reason fluently about rubric design, inter-rater reliability, agentic harnesses, contamination and overfitting, and what a small sample can and can't support; Public judgment: publish numbers about other people's models, and be neutral, precise, and defensible under scrutiny; Taste for what matters: strong instincts for which capabilities are worth measuring and which results are worth highlighting; Entrepreneurial: track record of building a product, program, or business line from nothing; High Ownership: take full accountability for outcomes, not just outputs; Independence: able to self-direct in ambiguous contexts and create clarity for others; Stakeholder alignment: bring research, engineering, operations, and GTM around a shared methodology

Nice to have

Prior background in SWE, ML, or DS

Benefits

Bi-annual performance bonus structure; Generous equity grant vested over 4 years; Up to $15k Relocation bonus; $10K housing bonus if you live within 0.5 miles of our office; $1.5K monthly stipend for meals; Free Equinox membership; $200 monthly laundry reimbursement; $200 monthly personal wellness reimbursement; Health, Dental, Vision insurance