Senior Data Engineer (Databricks & Cloud Data Platforms)

DVT is one of Africa’s leading software development consultancies, partnering with top organisations across South Africa and globally to deliver innovative, enterprise-grade technology solutions.
At DVT, our engineers work on complex, high-impact projects using modern cloud and data technologies while collaborating with some of the strongest technical talent in the industry. We are passionate about continuous learning, technical excellence, and growing our people through mentorship, technical communities, sponsored events, and ongoing professional development.
We are looking for a Capetown based Senior Data Engineer with deep Databricks expertise to help design and deliver modern, scalable data platforms for enterprise clients.

Requirements

Job Description: Senior Data Engineer (Databricks & Cloud Data Platforms); Position Overview; As a Senior Data Engineer, you will play a critical consulting role in designing, building, and modernising enterprise data platforms, with a strong focus on Databricks lakehouse implementations across cloud environments.; What You’ll Be Doing; · Design and implement scalable Databricks-based data platforms; · Build robust ETL / ELT pipelines for batch and streaming workloads; · Lead data migration and modernisation initiatives from legacy platforms to cloud-based lakehouse architectures; · Develop high-performance data processing solutions using PySpark, Python, and SQL; · Implement Delta Lake, Unity Catalog, and modern governance frameworks including Purview; · Design enterprise-grade lakehouse and medallion architectures; · Optimise Spark workloads for performance, scalability, and cost efficiency; · Build orchestration solutions using Databricks Workflows, ADF, Airflow, or similar tools in Azure/AWS; · Collaborate with technical and business stakeholders to define solution requirements; · Mentor junior engineers and contribute to technical best practices within the Data & AI practice; · Produce technical documentation, architecture artefacts, and reusable delivery assets; Technical Requirements; · Databricks Expertise (Essential); · Cloud Data Platform Experience (Azure Fabric, AWS) (Essential); You are:; · A strong technical leader who can own complex delivery outcomes; · Comfortable engaging directly with clients and stakeholders; · A proactive problem-solver with excellent analytical skills; · Able to clearly communicate technical concepts to both technical and non-technical audiences; · Passionate about mentoring and uplifting engineering teams; · Delivery-focused, quality-driven, and adaptable in consulting environments