Data Engineer

Data Engineer | London (Hybrid) | up to £500/day - Outside IR35 | Initial 6-Month Contract. We're partnering with a leading organisation undergoing a major transformation of its data and AI capabilities. They are looking for an experienced Data Engineer to join a growing engineering team building strategic data solutions that support business-critical functions across trading, analytics and commercial operations. This is a hands on engineering role where you'll design and build scalable data pipelines, solve complex technical challenges, and help evolve an enterprise data platform using modern open-source technologies.

Responsibilities

Designing, building and maintaining data ingestion pipelines and ETL/ELT workflows; Developing robust data engineering solutions using Python and SQL; Building scalable data pipelines that support multiple business functions; Working closely with technical and business stakeholders to deliver strategic solutions; Solving complex engineering challenges and taking ownership from design through to delivery; Contributing to the evolution of a modern on-premise data platform

Requirements

Excellent Python and SQL skills; Experience building ETL/ELT pipelines and data ingestion frameworks; Strong understanding of data architecture and data movement between systems; Experience with modern data engineering tools and frameworks; Extensive experience working closely with business stakeholders

Nice to have

Apache Spark; Databricks; Experience in Financial services, commodities or another fast-paced commercial environment; Exposure to AI technologies such as LangChain, agentic AI or open-source LLMs