Contract Senior Data Engineer
6-week contract | Remote | Outside IR35 | Active SC required | Immediate start
I'm supporting a client looking for a hands-on Senior Data Engineer to join a high-impact programme building a secure, AI-ready data platform.
You'll design and deliver production-grade data pipelines across batch and Real Time workloads, helping create a trusted knowledge layer that supports AI applications and autonomous agents.
What you'll be doing
- Building scalable distributed data pipelines
- Developing batch and streaming ingestion processes
- Creating robust data models for structured and unstructured data
- Implementing data lineage, provenance and metadata management
- Supporting knowledge graphs, entity resolution and data fusion
- Integrating data platforms with AI and agent-based applications
- Deploying services in secure cloud and containerised environments
What they're looking for
- Strong Python
- Spark/PySpark
- Kafka, Flink, Iceberg and Trino
- Data modelling, lineage and provenance
- Knowledge graphs and entity resolution
- AWS or Azure
- Docker and Kubernetes
- Experience with geospatial or time-series data
- Experience delivering in secure environments
- Active SC clearance
- Available to start immediately