jobs.pl/Oferty pracy/IT - Rozwój oprogramowania/Senior Product Manager, Observability Tools
Źródło: CrawlJobs

Senior Product Manager, Observability Tools

ASAPP Argentina
Full-time Remote work

Publication date: 03/11/2026

ASAPP's mission is to deliver the best AI-powered customer experience, faster than anyone else. This role owns the tools that let builders and reviewers see, test, and trust how GenerativeAgent (GA) behaves, before it talks to a customer and after. The role focuses on making agent behavior visible, testable, and reviewable at scale. The company has hubs in New York City, Mountain View, Latin America, and India. Candidates should be based in the Buenos Aires Metropolitan Area, Argentina.

Responsibilities

Own scenario creation via the simulation agent and the tools builders use to generate and curate realistic test scenarios; Own evals surfaces, including mistake monitoring and structured data evals, defining how GA mistakes are detected, surfaced, and categorized at scale and how structured data extraction is evaluated for accuracy; Own the Previewer, the tool builders use to see how configurations show up in simulated conversations; Own Conversation Explorer, the primary surface reviewers use to read full production conversations, including agent thoughts and actions; Build the case for simulation-driven quality by partnering with Sales, Customer Success, and Research; Partner with Research and Engineering on agent architecture, including reasoning traces, tool calls, and scenario generation methods; Manage the trust layer of the review experience by identifying and resolving issues that erode confidence, such as desyncs between simulated and real behavior, incomplete traces, and unclear mistake categorization, and designing the UX and guardrails that keep users confident

Requirements

5+ years of product management experience, with meaningful time spent on testing, quality, or review/analytics products in enterprise B2B SaaS; Direct experience building products around LLMs, AI agents, or other applied AI systems, with the ability to reason about agentic behavior, prompt and scenario design, or model output evaluation; Experience shipping tools that simulate, test, or preview system behavior before it reaches production, including judgment on when simulated behavior is a reliable proxy for real behavior; Experience building review or audit tooling for complex, unstructured content and turning ambiguous quality signals into clear, defensible categorizations; Comfort partnering with research and engineering teams on system internals such as reasoning traces, tool-use logs, and evaluation methodology; Track record of running discovery with internal or external users and translating it into structured requirements (evals, quality metrics, or review workflows); Excellent written and verbal communication, including writing a clear PRD and release announcements and presenting directly to customers

Nice to have

Experience in contact centers, conversational AI, or customer experience (CX) analytics; Experience with evaluation frameworks or methodologies for generative AI systems (offline evals, human-in-the-loop review, automated mistake detection); Prior experience in a startup or fast-scaling environment where the role's scope evolved as the company did

Benefits

Competitive compensation; Stock options; Healthcare for the family group; Mac equipment; USD 150 per month in flexible benefits; 3 weeks of vacation; English lessons
Apply with employer

Podobne oferty

Wszystkie →

Dostosuj zgody

Każdy cel jest opcjonalny i domyślnie wyłączony. Zgodę możesz wycofać w dowolnym momencie.

Pokazujemy oferty najbliżej Ciebie