Senior Data Engineer (Cloud, Data Integration & Migration)

Come join us and make a difference in the world!

Discover more at www.necsws.com

We are seeking an experienced Senior Data Engineer to join our growing Data Services team. This is a hands-on technical role focused on designing, building, and supporting cloud-based data solutions across AWS and Azure platforms.

The successful candidate will have strong experience in data engineering, data integration, ETL/ELT development, data migration, data quality, and cloud-native analytics platforms. They will work closely with technical and business stakeholders to deliver scalable, secure, and high-quality data solutions.

Strong hands-on experience with

- PostgreSQL
- MySQL
- Microsoft SQL Server
- Oracle
- Amazon Redshift
- Amazon Athena

Excellent SQL development, optimisation, and troubleshooting skills.

Strong practical experience with

- AWS Glue
- Amazon Athena
- Amazon Redshift
- Amazon S3
- AWS Lambda
- AWS Step Functions
- Amazon QuickSight

- Microsoft Fabric
- Azure Data Factory
- Azure Synapse Analytics
- Azure Data Lake Storage
- Azure SQL

Strong knowledge of

- ETL and ELT design patterns
- Data Integration architectures
- Data Warehousing
- Data Lake and Lakehouse architectures
- Data Modelling
- Data Profiling
- Data Quality Management
- Data Validation and Reconciliation

Responsibilities

Design, develop and maintain scalable ETL and ELT pipelines.; Build data integration solutions across cloud, on-premise, and third-party systems.; Design and implement robust data migration solutions, including extraction, transformation, validation, reconciliation, and cutover activities.; Perform data profiling, root cause analysis, and data quality assessments.; Develop and optimise data warehouse, data lake, and lakehouse solutions.; Produce source-to-target mappings, transformation rules, and technical documentation.; Support data governance, security, and compliance requirements.; Work collaboratively with stakeholders to understand requirements and deliver effective solutions.; Troubleshoot complex data issues and implement sustainable solutions.

Requirements

MUST be eligible for UK Security Clearance; Demonstrable experience in Data Engineering.; Proven experience delivering complex Data Migration and Data Integration projects.; Strong experience working with large and complex datasets.; Experience working across both AWS and Microsoft Azure environments.