Senior Data Engineer

Location: UK-based | Contract: 12 months

Role Overview

We are seeking an experienced Senior Data Engineer for a 12-month contract to build and automate scalable data pipelines. The role will focus on developing secure, robust and efficient data infrastructure on Google Cloud Platform (GCP), enabling high-quality, analysis-ready datasets and machine learning.

Key Responsibilities

• Design secure cloud-based (GCP) data storage, transfer, transformation and quality control processes for multi-terabyte datasets.
• Develop automated workflows for metadata harmonisation, data validation, de-identification and image quality checks.
• Link imaging artefacts, including segmentations and annotations, to source data and deliver analysis-ready datasets.
• Develop production-grade Python solutions, supported by testing, CI/CD, monitoring and documentation.
• Collaborate with ML engineers, software engineers and imaging specialists to optimise datasets for scientific and AI/ML applications.
• Apply AI/ML techniques to automate anomaly detection, identify data inconsistencies and improve ingestion triage.

Essential Skills and Experience

• Strong Python data engineering skills and significant SQL experience, including schema design.
• Experience building and operating ETL/ELT pipelines using orchestration frameworks.
• Hands-on experience with large-scale cloud object storage, such as GCP, AWS or Azure.
• Experience with CI/CD, DevOps and agile software development practices.
• Essential to have ONE of the following:

1. A PhD in a computational discipline
2. MSc in a computational discipline plus two years' imaging data experience
3. Or, at least two years' hands-on medical imaging data experience.