£550 - £650 per day
Outside Spy
London, UK
Senior Data Engineer/Data Platform Engineer (Databricks) Contract | Outside IR35 Remote (UK) £550-£650 per day (DOE) 6 months We're partnering with a forward-thinking Data & AI consultancy that is helping to scale a Databricks Lakehouse platform. They are looking for a Senior Data Engineer/Data Platform Engineer who can operate across both Data Engineering & Platform Engineering. This is an end-to-end hands-on role. What You'll Be Doing: Designing and building end-to-end data pipelines using Databricks (PySpark/SQL/Delta Lake) Developing and managing robust, scalable Lakehouse architectures Implementing Delta Live Tables (DLT) for reliable, testable, production-grade pipelines Optimising performance using: Working with Unity Catalog to implement Centralised governance Leveraging Databricks Workflows/Jobs for orchestration Building CI/CD pipelines for data & platform deployments (Terraform, GitHub Actions, Azure DevOps etc.) Enabling Real Time and...