AI DevOps Engineer

The AI DevOps Engineer owns the deployment, operations, and reliability of the AI‑SDLC platform as it transitions from local/team execution to a centralised, hosted enterprise service. This person builds and manages the infrastructure, CI/CD, monitoring, and observability that keep the platform available, secure, and scalable across multiple teams and products. They automate deployments, maintain pipelines, and provide operational support, playing a critical role in productionising the AI‑SDLC and ensuring it meets enterprise SLAs, security, and governance requirements.

Responsibilities

Own AI-SDLC deployment, operations, and platform reliability (uptime, performance, incident response); Manage infrastructure, monitoring, observability, and operational/on-call support; Build and maintain CI/CD pipelines and automation for platform releases; Drive the shift to a centralised, hosted AI-SDLC service — scalability, multi-tenancy, cost, and resilience

Requirements

CI/CD — GitLab Pipeline / Jenkins / Harness (highly relevant given your Harness Engineering direction); Infrastructure as Code — Terraform; Cloud platform — AWS (ECS/EKS, Lambda, S3, IAM, networking); container orchestration with Docker + Kubernetes; Observability & monitoring — OpenTelemetry, CloudWatch, logging/tracing for AI workloads; Scripting/automation — Python and/or Bash; Security & compliance operations — secrets management, IAM/least privilege, PCI DSS-aligned controls, auditability; Reliability engineering — SLIs/SLOs, incident management, cost and capacity management (incl. LLM token/credit cost control)

Nice to have

LLMOps / MLOps — model serving, gateway/proxy management, prompt/version management, guardrails at runtime; Experience hosting AI/agentic platforms as a shared internal service (multi-tenant); Bedrock / model-hosting and API gateway management; FinOps for AI (usage-based cost optimisation); LangGraph, LangChain understanding

Benefits

Clearly defined salary ranges aligned with industry benchmarks and internal equity standards; Performance-based incentives for eligible employees (as defined by relevant plan rules), awarded through transparent, objective criteria that recognize both individual and company performance; Inclusive equitable benefits that are accessible to all employees and focused around our 3 main pillars of financial wellbeing, health & wellness; Continuous development opportunities including training, education support, and career progression pathways based on inclusive and transparent criteria; Employee recognition programs that celebrate achievements and milestones for all