DevOps Engineer - Data team

As a DevOps Engineer in the Data Infra group, you’ll lead the design, implementation, and optimization of our cloud infrastructure, ensuring reliability, scalability, and efficiency. You’ll collaborate with cross-functional teams to build and maintain a modern big data platform while driving innovation and operational excellence.

In your day-to-day, you will: .

Responsibilities

Build and maintain enterprise-grade AWS environments and Kubernetes infrastructure using IaC, optimizing data workloads with EMR, EKS, and advanced autoscaling (Karpenter/Keda).; Monitor and optimize cloud performance and cost-efficiency while spearheading the resolution of complex infrastructure challenges.; Collaborate with cross-functional teams to understand business requirements and translate them into effective cloud solutions; Lead research and implementation of innovative solutions to enhance our overall system resilience and support massive-scale data processing.

Requirements

5+ years of experience working in live production systems; 3+ years of experience administering Kubernetes clusters on AWS (EKS), with expert-level skills in Helm-based application orchestration.; Knowledge of provisioning and configuration management systems (e.g., Terraform, Ansible, Chef, etc.); Proficiency in Linux and networking fundamentals; Familiarity with scripting languages like Python and Bash; Strong communication and collaboration skills; Experience operating large scale data infrastructure and distributed systems (e.g., Spark on EKS, Trino, Airflow, and Aerospike) at scale – an advantage