Our client is one of the largest financial institutions in its sector, serving millions of customers across many international markets. It is running a major data and AI transformation programme and is engaging experienced contractors to deliver key parts of its cloud-native data platform and production AI capabilities.
- Outside IR35, with a clearly defined scope of deliverables
- London based but hybrid working 3 days per week
- Competitive day rate - they want the best!
The engagement
You will deliver a defined scope of data engineering work supporting production ML and generative AI use cases, including fraud detection, credit risk, customer personalisation and LLM-powered tools. You will decide how the work is done, working with the client’s data science, ML engineering and architecture teams to deliver agreed outcomes against programme milestones.
Key deliverables
- Design and build scalable batch and real-time data pipelines supporting ML and AI workloads
- Deliver feature stores, curated datasets and data products for model training and inference
- Build data infrastructure for generative AI, including RAG pipelines, vector databases and embedding workflows
- Deliver data versioning, lineage and drift monitoring capabilities to support MLOps
- Put data quality, observability and reliability controls in place across critical pipelines
- Ensure all delivered solutions meet governance, security and regulatory requirements (GDPR, model risk management, operational resilience)
- Provide full documentation and a structured knowledge handover when the engagement ends
Skills and experience
- Strong track record as a contract Data Engineer, with senior-level delivery experience
- Operating through your own limited company
- Advanced Python and SQL
- Hands-on experience with Spark and/or Databricks
- Commercial experience on AWS, Azure or GCP
- Proven delivery of data pipelines supporting ML or AI in production
- Strong grasp of data modelling, ELT/ETL and lakehouse architectures
- Experience with orchestration tools (Airflow, Dagster or similar)
- CI/CD and infrastructure-as-code experience (e.g. Terraform)
Desirable
- Streaming experience (Kafka, Kinesis, Flink)
- GenAI tooling, such as vector databases (Pinecone, Weaviate, pgvector), LangChain/LlamaIndex and embedding pipelines
- MLOps platforms (MLflow, SageMaker, Vertex AI, Azure ML)
- Previous contracts in banking, insurance or other regulated environments
- Data governance and cataloguing tools (Unity Catalog, Collibra, Alation)
Why this contract?
- Outside IR35, with a clearly defined scope of deliverables
- High-profile, well-funded AI programme with real potential to extend
- Modern tech stack and enterprise-scale data
- Hybrid working with a flexible on-site pattern