Intermediate Data Engineer

We’re seeking an Intermediate Data Engineer to join our Insurance Retail department, supporting development squads with reliable, automated and cloud-ready data solutions. This role is suited to someone who can combine strong SQL, scripting and AWS experience with modern DevOps practices to build, maintain and improve data pipelines, data services and supporting infrastructure. AI is a key part of the role. You will be expected to use AI-assisted engineering tools responsibly to accelerate development, improve documentation, support analysis and identify opportunities to automate repeatable data engineering and operational tasks.

Responsibilities

Building, testing, monitoring and maintaining data pipelines and infrastructure to support the Data Platform using best practices including CI/CD, IaC and DevOps; Applying security best practices across data pipelines, cloud infrastructure and operational processes; Using AWS services and PostgreSQL/AWS RDS knowledge to design, deliver and support scalable, reliable and secure data solutions; Actively embracing AI-assisted engineering practices and demonstrating willingness to learn emerging AI tools such as Kiro, GitHub Copilot or equivalent; Developing and maintaining automated deployment, testing and operational workflows using GitLab pipelines, version control, Terraform/OpenTofu and scripting; Contributing to data quality, lineage, governance and observability practices; Investigating data quality, platform reliability, pipeline performance and operational issues; Working with business stakeholders, analysts and architects to understand requirements and design data models; Contributing to database and data platform activities such as upgrades, data migrations, schema updates and platform modernisation initiatives; Documenting processes and products, sharing knowledge, and supporting development of less experienced engineers; Contributing significantly to small-to-medium feature deliveries and multi-person initiatives

Requirements

Hold, or be willing to obtain, a relevant AWS certification; Proven experience working with AWS services relevant to data engineering and operational support, such as RDS, S3, Lambda, ECS, EC2, VPC, CloudWatch and related services; Strong SQL skills, including PostgreSQL experience, query optimisation awareness and the ability to investigate data or performance issues; Good understanding of security principles including least-privilege access, encryption, secrets management, vulnerability remediation and secure handling of sensitive data; Experience with CI/CD pipelines, automated testing and deployment practices using GitLab or similar tooling; Experience with Infrastructure as Code tools such as Terraform, OpenTofu or CloudFormation; Good understanding of version control workflows, branching strategies and GitLab best practice; Experience of, or a strong willingness to learn, AI-assisted engineering tools such as Kiro, GitHub Copilot or similar technologies; Familiarity with observability and troubleshooting tooling such as Dynatrace, OpenSearch/Elasticsearch or CloudWatch logs; Ability to communicate clearly, analyse problems, work collaboratively and explain technical concepts; Familiarity with Agile methodologies and operational tooling such as Jira and ServiceNow

Nice to have

Experience with MySQL and Oracle databases would be advantageous.

Benefits

Hybrid Working (2 days a week in the office); Flexible working; 25 days holiday to start, increasing by 1 day per year of service up to 30 days; Excellent training and development platform; Opportunities for career progression; Health and Wellbeing Programme; Life and health assurance; Electric Vehicle Scheme; Established Recognition Award System; Great Parental Benefits; Diversity and Inclusion network; Pension scheme; Community projects and volunteer days; Refer a friend bonus; On-site free parking; Open plan modern offices; Quiet Spaces; Shuttle bus to and from the station; Subsidised restaurant; Games room, pool & table-tennis tables and chill out zone; Annual Hackathon & Deep Racer Events; Social activities; On-site car wash, barber, yoga classes, boot camp and massage services; Cycle to work scheme; Shower and dry rooms