AI Product Engineer - ClickStack

Join ClickHouse in building the AI layer for Observability. ClickStack is the open-source observability platform that unifies logs, metrics, traces, and session replays so engineers can find root causes quickly. The role focuses on building agentic capabilities on top of a petabyte-scale observability platform, with a focus on developer experience.

Responsibilities

Build agents that investigate incidents, surface anomalies, and answer 'why is production broken?' using ClickStack as their substrate; Write a library of reusable skills that captures how the team debugs, finds root causes, writes ClickHouse queries, and runs incident response; Own the agent stack end-to-end, including context engineering, tool design, evals, tracing, and cost; Make ClickStack a great place to run AI workloads by building MCP servers, SDKs, and integrations that let customers' agents read telemetry, take action, and stay observable; Work in the open with OSS contributors and customers, debug their problems alongside them, and feed learnings back into the product; Tackle latency, cost, context window limits, eval coverage, and hallucinations on real telemetry

Requirements

5+ years of software engineering experience, including 1–2 years on LLM-powered systems or agents in production; Strong backend skills in TypeScript/Node.js and/or Python; Hands-on experience building agents: multi-step tool use, planning, memory, error recovery; Experience designing skills (Markdown-based workflow encodings, Anthropic-style or similar) and a view on when a skill, a tool, or both is the right fit; Experience with MCP: building servers, designing tools, and thinking through auth, scoping, and observability for agentic systems; Strong evals practice: golden sets, LLM-as-judge, regression detection; SQL proficiency, including writing ClickHouse queries directly; Comfort with Docker and Kubernetes; Active in open source and the developer community

Nice to have

Built or operated production agents in observability, incident response, or SRE; Strong opinions on agent observability (tracing, cost attribution, eval pipelines, OpenTelemetry for agents) and ideas on how to improve it; Experience with prompt caching, context compaction, or other techniques for running agents on production telemetry volumes; Experience with columnar databases and event ingestion pipelines; Contributed to or maintained an open source AI/agent project; Familiarity with Go, Rust, or other systems languages for integrations and high-throughput infrastructure

Benefits

Flexible work environment, with ClickHouse being globally distributed and remote-friendly across over 25 countries; Healthcare with employer contributions towards healthcare; Equity in the company through stock options for every new team member; Flexible time off in the US and generous entitlement in other countries; USD$500 home office setup for remote employees; Global Gatherings with company-wide offsites