Senior Data Engineer (Contract)

Location: Paddington, London (moving to Battersea from June)

Working Model: Hybrid - onsite Wednesday & Thursday

Contract Length: 12 months

Max Rate: £725.96 per day (Umbrella)

Function: AI & Data - Product Engineering

Our client is looking for a Senior Data Engineer to join an AI & Data Product Engineering team on a 12-month contract.

This role supports data monetisation initiatives by migrating and modernising complex, large-scale data processes within a cloud-based analytics environment.

You will play a hands-on role in improving data quality, efficiency, and resilience while enabling analytics and visualisation through modern data platforms.

• Migrate complex existing data processes into a Databricks environment, ensuring continuity and performance

• Design, build, and optimise scalable data pipelines using Python, SQL, and distributed computing frameworks

• Rapidly understand high-complexity data processes to support efficient migration

• Drive continuous improvement in data engineering methodologies and tooling

• Ensure new outputs align with existing datasets and downstream analytics requirements

• Collaborate with engineering and analytics teams to support delivery and ways of working

• Strong experience writing, deploying, and optimising code (Python, SQL, or similar)

• Hands-on experience with Databricks and Apache Spark (or equivalent)

• Solid understanding of databases and efficient analytical query design

• Experience with CI/CD pipelines, workflow automation, and Infrastructure as Code

• Proven experience developing, testing, and deploying complex data models

• Exposure to complex data process migration projects

• Experience using version control systems in collaborative environments

• Hands-on experience with Microsoft Azure

• Experience with tools such as DBT and AI-assisted Scripting tools

• Experience setting up or maintaining Tableau Cloud

Desirable:

• Experience with geospatial data and spatial analysis techniques