jobs.pl/Job offers/IT - Software Development/Staff Site Reliability Engineer - Dev Platform
Source: CrawlJobs

Staff Site Reliability Engineer - Dev Platform

Kraken Digital Asset Exchange Brazil ; Brazil (whole country)
Full-time Remote work

Publication date: 08/11/2026

Staff role on Developer Platform AI, a small team that builds AI systems used by Kraken's engineers, including agents that write and review code, access to models in existing tools, and infrastructure connecting AI to internal systems. The role owns the reliability of the AI Gateway, the agent runtime and connections to internal tools, and sets the technical direction for how the platform runs.

Responsibilities

Own the reliability of the platform engineers depend on: the AI Gateway, the agent runtime and the connections to internal tools; Set the SLOs, own the error budgets and decide what happens when they're spent; Design resilience across model providers: routing, failover, retries, rate limiting and graceful degradation when a provider is slow, throttling or down; Make LLM traffic legible: build observability that shows latency, errors, token usage and cost by team, model and use case; Treat capacity and cost as one problem, owning the tradeoff between latency and spend; Work with Security, Finance and AI governance to put access controls, budgets, audit logging and data handling into the platform; Lead incident response and blameless post-incident reviews; Automate operations with infrastructure as code, safe deployments and progressive rollouts; Mentor engineers and raise the operating standard across the team; Set the technical direction for how the platform runs

Requirements

Extensive experience in site reliability, infrastructure or platform engineering, with a track record of owning high-traffic, business-critical services in production; Deep hands-on experience with Kubernetes, a major cloud provider and infrastructure as code such as Terraform; Strong command of SLOs, observability and incident management, and the judgment to know which reliability work actually matters; Proficiency in Rust or Python, and comfort reading and changing a production service's code; Experience with API gateways, reverse proxies or traffic management: load balancing, rate limiting, failover and caching; Experience operating multi-tenant internal platforms, including authentication, authorization and per-tenant cost controls; Staff-level influence: you set direction across teams, write clear design documents and bring other engineers with you

Nice to have

Experience operating LLM gateways or integrating LLM provider APIs at scale: streaming, token-based rate limiting, model routing and caching; Experience serving models yourself, including vLLM or Ray: GPU scheduling, batching, autoscaling and cost per token; Experience building Kubernetes controllers or operators with controller-runtime or kubebuilder; Experience with Consul and Vault for service discovery, configuration and secrets; Experience with model evaluation pipelines for catching quality regressions before and after rollout; Familiarity with coding agents and agent harnesses, and running them safely in sandboxed environments; Experience with cost attribution, budgeting or FinOps for usage-based services; Background in security-sensitive or regulated environments such as financial services or crypto; Contributions to open-source gateway, proxy or observability projects
Apply with employer

Similar offers

All →

Cookie settings

Each purpose is optional and off by default. You can withdraw consent at any time.

Showing offers closest to you