Cloud Platform Engineer

Responsibilities

Design, implement, and test cloud infrastructure using DevOps best practices; Use Terraform and Argo to automate and orchestrate cloud resources; Develop and deploy serverless applications using Lambda and ECS; Manage and monitor cloud services using ECR and CloudWatch; Write clean and efficient code in Python and use Git for version control; Collaborate with other engineers and stakeholders to deliver high-quality products; Build and maintain a scalable and reliable cloud platform; Bi-weekly open office hours for all customers to bring questions and issues; Primary focus on bug resolution in codebase and AWS infrastructure; Enhance Airflow orchestration utility in AWS; Upgrade Airflow to latest version; Increase verbosity of generated logs and errors; Integrate configurable Slack alerting via Apprise; Thoroughly document existing codebase and processes via DP Confluence pages (dbt utility, SageMaker utility, Verify-deps utility, load-Snowflake utility, Run-SQL utility, Extract-bigquery utility, Tableau-refresh utility, API-ingestion utility)

Requirements

Strong experience on AWS architecture/administration in production environments; Solid experience of network and security on cloud-based environments, specifically on AWS services such as VPCs, Security Groups, NACLs and IAM roles; Deep understanding of CI/CD using tools like Jenkins/ /AWS Code Pipeline/AWS Code Commit; Expertise on Terraform for automated provision of infrastructure; Experience writing production quality code in Python and SQL; Experience of building and maintaining distributed platforms to handle high volume of data; Strong platform-level design, architecture, implementation and troubleshooting skills; Good understanding of Enterprise patterns and best practices applied to data engineering and data science use cases at scale; Experience with containers, preferably with AWS ECS and\or Kubernetes; Lambda build, deployment and managing within private VPC; Observability and Monitoring using AWS native CloudWatch, Insights and CloudTrail; Experience with Argo CD for deployment of container applications; Deep understanding of DevOps and tool sets required for a mature DevSecops implementation; Bachelor's degree in computer science, Engineering, or related field; At least 7 years of experience as a platform engineer, cloud engineer, or similar role; Strong knowledge of AWS services and cloud architecture; Proficient in Terraform, Argo, Lambda, ECS, ECR, and CloudWatch; Expert in Python and Git; Excellent communication and problem-solving skills; Passionate about learning new technologies and improving existing ones; Able to lead some team of engineers and plan out user stories; Client interaction and communication to advice client and communicate with non-technical and technical client base

Nice to have

Worked and managed tools, services, products like Snowflake, Airflow, DBT and SageMaker; Experience working with AWS Data Service\Platform; Worked with Jira\Confluence or other SCRUM and document management tools

Benefits

Health, dental, vision, life insurance, and disability plans; Benefits on first day of employment; 401(k) Plan after 30 days of employment; 11 paid holidays; 12 weeks of Parental Leave; Free time PTO policy; Discretionary bonus