£850 per day
Outside Spy
City Of London, England, United Kingdom
🔥 Senior / Lead Data Engineer – Databricks / Spark (High-Performance Platform) £850 p/d OUTSIDE IR35 (higher for Lead) 12-month rolling (multi-year programme) 1 day/week – St Paul’s, London We’re hiring a Senior & Lead Data Engineer to build a Databricks lakehouse platform in a high-performance, business-critical Front office trading environment . This is a hands-on engineering role focused on building and optimising large-scale distributed data systems . This is a highly technical team operating at scale, we’re looking for engineers with deep data engineering expertise, strong low-level Spark knowledge , and experience building high-performance systems using modern Databricks and AI-driven platforms. . What you’ll do Build and optimise Spark pipelines on Databricks Develop a lakehouse platform (Medallion architecture) Own data modelling, architecture, and pipeline design Work with large-scale data (TB–PB) Drive performance,...