15 databricks consultant jobs found

Hiring! Databricks Consultant   Role Title: Databricks Consultant Location: London, Hybrid Duration: Initial 3 months Rate: Market Related Engagement: Outside IR35     We are seeking a seasoned Databricks Consultant with deep expertise in Energy & Commodities Trading to design, accelerate, and optimize our trading data platform. Acting as the bridge between trading desks, quants, and engineering teams, you will leverage the Databricks Lakehouse to deliver scalable, real-time pipelines powering trading decisions, risk management, and market analytics.   Key Responsibilities    Data Architecture: Build and optimize ETL/ELT pipelines using Databricks, Spark (PySpark/Scala), and Delta Lake for structured/unstructured energy market data.   Trading Analytics: Partner with Quants, Risk Managers, and Traders to implement models, curve generation, position tracking, and risk metrics (e.g., VaR). Performance Optimization: Tune clusters and SQL warehouses for...

Hiring! Databricks Consultant Role Title: Databricks Consultant Location: London, Hybrid Duration: Initial 3 months Rate: Market Related Engagement: Outside IR35 We are seeking a seasoned Databricks Consultant with deep expertise in Energy & Commodities Trading to design, accelerate, and optimize our trading data platform. Acting as the bridge between trading desks, quants, and engineering teams, you will leverage the Databricks Lakehouse to deliver scalable, Real Time pipelines powering trading decisions, risk management, and market analytics. Key Responsibilities Data Architecture: Build and optimize ETL/ELT pipelines using Databricks, Spark (PySpark/Scala), and Delta Lake for structured/unstructured energy market data. Trading Analytics: Partner with Quants, Risk Managers, and Traders to implement models, curve generation, position tracking, and risk metrics (eg, VaR). Performance Optimization: Tune clusters and SQL warehouses for low-latency,...

Hays are now looking for a Databricks Consultant / SME for one of our local clients: Flexible rate - Outside IR35 1 day a week in Swindon, the rest is WFH Initial 6 month contract (extensions likely) We're seeking a highly experienced Databricks specialist who can confidently navigate the platform end-to-end, including leading migrations from legacy setups using DBFS-mounted tables and Hive Metastore. You'll bring strong AWS knowledge, hands-on experience working with S3 via Python, a solid understanding of data storage formats, and practical Python development expertise. What you'll be doing Lead the migration of Databricks assets (notebooks, jobs, clusters) from DBFS to Unity Catalog Define and implement a scalable, standardised migration approach across teams Support teams with ad-hoc Databricks issues related to migration and platform usage Optimise the Databricks environment for structure, access, and governance Automate infrastructure and deployments...

Hays are now looking for a Databricks Consultant / SME for one of our local clients: Flexible rate - Outside IR35 1 day a week in Swindon, the rest is WFH Initial 6 month contract (extensions likely) We 're seeking a highly experienced Databricks specialist who can confidently navigate the platform end-to-end, including leading migrations from legacy setups using DBFS-mounted tables and Hive Metastore. You 'll bring strong AWS knowledge, hands-on experience working with S3 via Python, a solid understanding of data storage formats, and practical Python development expertise. What you 'll be doing Lead the migration of Databricks assets (notebooks, jobs, clusters) from DBFS to Unity Catalog Define and implement a scalable, standardised migration approach across teams Support teams with ad-hoc Databricks issues related to migration and platform usage Optimise the Databricks environment for structure, access, and governance Automate...

Hays are now looking for a Databricks Consultant/SME for one of our local clients: Flexible rate - Outside IR35 1 day a week in Swindon, the rest is WFH Initial 6 month contract (extensions likely) We're seeking a highly experienced Databricks specialist who can confidently navigate the platform end-to-end, including leading migrations from Legacy setups using DBFS-mounted tables and Hive Metastore. You'll bring strong AWS knowledge, hands-on experience working with S3 via Python, a solid understanding of data storage formats, and practical Python development expertise. What you'll be doing Lead the migration of Databricks assets (notebooks, jobs, clusters) from DBFS to Unity Catalog Define and implement a scalable, standardised migration approach across teams Support teams with ad-hoc Databricks issues related to migration and platform usage Optimise the Databricks environment for structure, access, and governance Automate infrastructure and deployments using...

Senior Data Engineer - Azure Central government | Outside IR35 | Remote | 6 months + SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets. You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial. Requirements: Strong commercial experience delivering data engineering solutions in Azure. Strong hands-on experience working with...

Senior Data Engineer – Azure Central government | Outside IR35 | Remote | 6 months + SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets. You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial. Requirements: Strong commercial experience delivering data engineering solutions in Azure. Strong hands-on experience...

Data Engineer (Azure Databricks & Geospatial Data) 6-month contract Remote working (UK) Outside IR35 £475 per day The Opportunity: We are currently seeking an experienced Data Engineer to join a high-profile data transformation programme, helping to build and enhance a modern cloud-based data platform using Azure technologies, who combines strong Azure Databricks expertise with modern data engineering practices and a passion for solving complex data challenges. This role will focus on designing and developing scalable data engineering solutions within Azure Databricks, supporting the creation of robust data pipelines and contributing to the evolution of a modern Lakehouse architecture. The successful candidate will also work extensively with geospatial datasets, making this an excellent opportunity for engineers with experience in spatial data processing and geospatial analytics. Working within a collaborative Agile delivery environment, you...

Azure Data Engineer (Government Digital Services) 6-month contract Remote working (UK) Outside IR35 Market rates The Opportunity: We are supporting a major public sector organisation on the appointment of an experienced Data Engineer to join a high-profile data and analytics programme on an initial 6-month contract basis. Working within a multidisciplinary data team, you will play a key role in designing, developing and optimising modern cloud-based data solutions that support critical environmental, scientific and operational decision-making across the organisation. This role offers the opportunity to work with large-scale data platforms, geospatial datasets and advanced analytics capabilities, helping to drive innovation and improve access to trusted, high-quality data. The successful candidate will contribute to the ongoing development of the organisation's strategic data capabilities, including work across the client's advanced cloud-based...

Solution Architect - Outside IR35 Up to £650 Long-Term Opportunity on a Rolling Contract April Start Date Hybrid Working in London Responsibilities and Technical Requirements Extensive experience in solution and integration architecture , designing and delivering scalable, enterprise-grade integration patterns across complex ecosystems Strong data architecture / warehousing and data integration experience Strong background in data architecture , including hands-on design and implementation of data warehouses, data marts, and lakehouse platforms to support MI, BI, and AI use cases Proven consulting capability , with strong analytical thinking, problem-solving, and communication skills; able to effectively bridge technical and non-technical stakeholders Engineering-led mindset with the ability to lead deep technical design discussions , particularly across integration, data flows, and system interoperability Experienced in collaborating with...

Solution Architect - Outside IR35 Up to £650 Long-Term Opportunity on a Rolling Contract May Start Date Hybrid Working in London Responsibilities and Technical Requirements Extensive experience in solution and integration architecture , designing and delivering scalable, enterprise-grade integration patterns across complex ecosystems Strong data architecture / warehousing and data integration experience Strong background in data architecture , including hands-on design and implementation of data warehouses, data marts, and lakehouse platforms to support MI, BI, and AI use cases Proven consulting capability , with strong analytical thinking, problem-solving, and communication skills; able to effectively bridge technical and non-technical stakeholders Engineering-led mindset with the ability to lead deep technical design discussions , particularly across integration, data flows, and system interoperability...

DATA PROGRAMME MANAGER LONDON, HYBRID (2 DAYS PER WEEK) OUTSIDE IR35 £350 TO 400 PER DAY This is a senior contract opportunity to lead a high-impact data transformation programme within the insurance sector. The role offers the chance to operate at a genuinely strategic level, shaping data direction, influencing senior stakeholders, and steering a complex speciality lines transformation across modern Azure data platforms. The Company They are a well-established insurance organisation undergoing a significant data-led transformation across their speciality lines portfolio. Data is a core strategic priority, with strong executive sponsorship and a clear mandate to modernise pricing and analytics capabilities. The environment is collaborative, business-facing, and focused on long-term value creation rather than short-term delivery. The Role and Deliverables Lead the end-to-end data programme for a speciality lines pricing data warehouse transformation. Define...

Solution Architect - Outside IR35 Up to £650 Long-Term Opportunity on a Rolling Contract May Start Date Hybrid Working in London Responsibilities and Technical Requirements Extensive experience in solution and integration architecture , designing and delivering scalable, enterprise-grade integration patterns across complex ecosystems Strong data architecture / warehousing and data integration experience Strong background in data architecture , including hands-on design and implementation of data warehouses, data marts, and lakehouse platforms to support MI, BI, and AI use cases Proven consulting capability , with strong analytical thinking, problem-solving, and communication skills; able to effectively bridge technical and non-technical stakeholders Engineering-led mindset with the ability to lead deep technical design discussions , particularly across integration, data flows, and system interoperability...

Data Programme Manager 6 months London - 2 days per week £350-400pd Outside IR35 We are seeking a highly experienced Data Programme Manager to drive a strategic Speciality lines Data transformation within the insurance domain. This is a senior, business-facing leadership role that goes beyond delivery management-focused on shaping data strategy, influencing senior stakeholders, and guiding end-to-end programme execution. The ideal candidate will combine deep expertise in Azure data platforms with a management consulting mindset , bringing the ability to define data imperatives, articulate strategic narratives, and lead governance-driven transformation initiatives. Key Responsibilities Strategic Leadership & Programme Direction Lead the data transformation agenda for pricing data warehouse initiatives, aligning with broader strategic (SL) objectives. Define and articulate data vision, imperatives, roadmap, and...

Technical Data Programme Lead/Manager Financial Services | 3 Days Onsite In Swindon | Outside IR35 Contract Are you an experienced Technical Data Programme Lead who could take the reins of a critical data transformation programme for a financial services firm. Why You'll Want This Role You'll have genuine influence. You're not joining a project where everything's already decided. You're stepping into an early-maturity data environment where your expertise will directly shape the strategy. You'll report to the COO and work directly with Board and Executive level stakeholders who actually want to hear what you think. You'll build something meaningful. You'll lead a 12-18 month Data transformation programme You'll design the roadmap, make the critical technology decisions, and define how value gets delivered. This is your programme to own. You'll transition from chaos to capability. Right now, delivery is largely outsourced to a third-party consultancy....