£350 - £400 per day
Outside Spy
South West England, UK
We're supporting a major financial-systems transformation programme and are looking for a Senior Databricks Engineer to help build and enhance a scalable data-engineering framework used across critical reporting processes. You'll operate as the senior hands-on engineer, shaping reusable libraries, optimising PySpark pipelines, and guiding offshore developers to deliver high-quality, production-ready code. You'll work across ingestion, validation, transformation, and mapping layers within a Databricks-on-Azure environment, helping to establish consistent engineering patterns and ensuring all deliveries meet high standards of performance, traceability, and maintainability. What you'd be doing: Building and extending reusable Databricks/PySpark libraries (ingestion, validation, transformation, mapping). Developing scalable, optimised PySpark pipelines aligned to metadata-driven or hybrid data models. Implementing robust validation and control logic suitable for...