22 azure databricks engineer jobs found

Location: Fully Remote (UK) Rate: £500/day Outside IR35 Contract: Initial 3 months (likely extension) We're working with a financial services organisation embarking on a large-scale cloud transformation, migrating from a Legacy on-premises estate to a modern Azure and Databricks platform. They're looking for an experienced DevOps Engineer to help build and maintain their cloud platform, automate deployments and support the wider migration programme. Key responsibilities: Build and maintain Azure cloud infrastructure and Databricks environments Develop and enhance CI/CD pipelines and deployment automation Ensure platform reliability, security and operational performance Work closely with Agile delivery teams through sprint planning, stand-ups and retrospectives Support cloud migration, landing zone improvements and integrations with platforms such as Snowflake Essential skills: Azure Terraform Databricks Azure DevOps GitHub CI/CD...

Cloud Platform Engineer (Terraform/Terragrunt) Contract | Outside IR35 | 3-6 months | £500-600/day | Mostly Remote The Role A growing Data & AI consultancy requires an experienced Cloud Platform Engineer to support several enterprise data platform implementations. You'll focus on Infrastructure as Code, building reusable cloud infrastructure for modern data platforms using Terraform and Terragrunt. Although many projects utilise Databricks, candidates with strong cloud engineering experience across comparable Azure data technologies will also be considered. Responsibilities Design Infrastructure as Code solutions Build reusable Terraform modules Deploy cloud infrastructure using Terragrunt Automate platform deployments Support Azure-based data platforms Work alongside Data Engineers and Solution Architects Essential Skills Terraform Terragrunt Infrastructure as Code Azure Python CI/CD Git Desirable Databricks...

Senior Geospatial Engineer 6-month contract Remote Working Outside IR35 Market Rates (c£500 per day) The Opportunity: Our client is supporting a major UK Government Agency on the delivery of a strategic geospatial data platform and is seeking an experienced Senior Geospatial Engineer to join a multidisciplinary Agile team for an initial 6-month temporary contract.. This is an exciting opportunity to help design, build and support modern cloud-native geospatial data services that underpin critical national decision-making. You'll play a key role in developing scalable geospatial processing pipelines, integrating spatial datasets from multiple sources and delivering high-quality services for analytics, reporting and operational applications. Working alongside Data Engineers, Architects, GIS specialists and Product teams, you'll contribute to the development of robust geospatial engineering capabilities using modern cloud technologies, open-source GIS...

Azure | Databricks | SQL | Outside IR35 | Hybrid THE COMPANY We 're partnering with a global mining organisation that is investing heavily in the evolution of its enterprise data platform. Following significant growth and a wider transformation programme, they 're looking to bring in an experienced Senior Data Engineer to strengthen the technical capability of the team and support the delivery of several high-profile data initiatives. This is a business that places real value on engineering best practice and is looking for someone who can provide immediate technical expertise, influence engineering standards through delivery and help solve complex data engineering challenges across the organisation. THE ROLE This is a hands-on Senior Data Engineering contract where you 'll operate as a senior individual contributor within a highly collaborative team. Rather than leading people, you 'll lead technically, owning complex engineering problems, partnering with...

Senior Data Engineer Contract Role Outside IR35 | £500-550/day | Liverpool (3 days on-site) | Hybrid | Initial 6 Months We have a new Senior Data Engineer contract opportunity with client of ours based in Liverpool with 3 days required per week on-site. You’ll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, and offers an initial 6-month contract with an immediate start and strong potential for extension. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices. Migrate and transform data into a Databricks Lakehouse architecture. Ensure data quality, reliability, and scalability for analytics and reporting. Collaborate with stakeholders to deliver robust solutions aligned with business needs. Support production environments and...

Join a high-impact team transforming data infrastructure with cutting-edge Databricks technology in Liverpool. Salary: £500 - 550 per day Senior Data Engineer Contract Role Outside IR35 | £500-550/day | Liverpool (3 days on-site) | Hybrid | Initial 6 Months We have a new Senior Data Engineer contract opportunity with client of ours based in Liverpool with 3 days required per week on-site. You'll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, and offers an initial 6-month contract with an immediate start and strong potential for extension. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices Migrate and transform data into a Databricks Lakehouse architecture Ensure data quality, reliability, and scalability for analytics and...

Senior Data Engineer Contract Role Outside IR35 | £500-550/day | Liverpool (3 days on-site) | Hybrid | Initial 6 months We have a new Senior Data Engineer contract opportunity with client of ours based in Liverpool with 3 days required per week on-site. You'll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, and offers an initial 6-month contract with an immediate start and strong potential for extension. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices. Migrate and transform data into a Databricks Lakehouse architecture. Ensure data quality, reliability, and scalability for analytics and reporting. Collaborate with stakeholders to deliver robust solutions aligned with business needs. Support production environments and troubleshoot performance issues....

🚨 Senior Data Engineer | Outside IR35 | £550–£675/day | Central London I'm currently partnering with a global organisation undergoing a major transformation of its data platform and engineering capability. They're looking to bring in an experienced Senior Data Engineer to help define engineering standards, improve platform performance and deliver scalable, enterprise-grade data solutions. This is an excellent opportunity to join a high-performing team where you'll have a real influence over architecture, engineering best practices and the future direction of the data platform. 📍 The Opportunity Senior Data Engineer Outside IR35 £550–£650 per day (depending on experience) 6-month initial contract ASAP Start Central London – 1-2 days onsite per week What You'll Be Doing As a Senior Data Engineer you'll be responsible for designing, building and optimising modern cloud-based data platforms while helping establish engineering standards across the...

Data/AI Engineer (Databricks) - Outside of IR35Contract We're taking an AI decision-support product from proof-of-concept to full production on Databricks and need a hands-on engineer to build, run and own it. It analyses data across ~1,000 sites, uses an LLM (Anthropic Claude) to generate per-site recommendations, and includes a conversational agent that lets managers question their own data. Delivery role, not advisory - you'll fill our gap in Databricks engineering, LLM pipelines and agent development, and build the capability in-house. Initial 6 Month Contract (Ext) & Remote Working What you'll do Build ingestion pipelines (PySpark) into a governed medallion layer in Unity Catalog. Productionise the LLM pipeline - run Claude across the estate on a schedule, with retries and validation gates. Build and tune the conversational agent - grounding, guardrails, benchmarking. Own evaluation (prompt versioning, MLflow) and CI/CD across dev/UAT/prod. Essential...

£600 per day Outside IR35 6 Month Contract We're supporting a major UK financial services organisation that is investing heavily in AI, automation and next-generation digital capabilities. They are looking for an experienced AI Platform Engineer to help accelerate the adoption of enterprise AI solutions, build reusable capabilities, and deliver production-ready AI and automation services across the business. This is a hands-on engineering role where you'll work closely with business stakeholders, architects, security teams and technology partners to transform AI opportunities into scalable solutions while maintaining strong governance and operational standards. The Role You will: Build and enhance AI-powered applications and automation solutions. Integrate and operationalise Large Language Models including GPT, Claude and Gemini. Develop AI agents, workflow automation and Retrieval-Augmented Generation (RAG) solutions. Design and develop integrations using REST APIs,...

£600 per day | Outside IR35 | 6 Month Contract We're supporting a major UK financial services organisation that is investing heavily in AI, automation and next-generation digital capabilities. They are looking for an experienced AI Platform Engineer to help accelerate the adoption of enterprise AI solutions, build reusable capabilities, and deliver production-ready AI and automation services across the business. This is a hands-on engineering role where you'll work closely with business stakeholders, architects, security teams and technology partners to transform AI opportunities into scalable solutions while maintaining strong governance and operational standards. The Role You will: Build and enhance AI-powered applications and automation solutions. Integrate and operationalise Large Language Models including GPT, Claude and Gemini. Develop AI agents, workflow automation and Retrieval-Augmented Generation (RAG) solutions. Design and develop integrations using REST APIs,...

£600 per day | Outside IR35 | 6 Month Contract We 're supporting a major UK financial services organisation that is investing heavily in AI, automation and next-generation digital capabilities. They are looking for an experienced AI Platform Engineer to help accelerate the adoption of enterprise AI solutions, build reusable capabilities, and deliver production-ready AI and automation services across the business. This is a hands-on engineering role where you 'll work closely with business stakeholders, architects, security teams and technology partners to transform AI opportunities into scalable solutions while maintaining strong governance and operational standards. The Role You will: Build and enhance AI-powered applications and automation solutions. Integrate and operationalise Large Language Models including GPT, Claude and Gemini. Develop AI agents, workflow automation and Retrieval-Augmented Generation (RAG) solutions. Design and develop integrations...

£600 per day | Outside IR35 | 6 Month Contract We're supporting a major UK financial services organisation that is investing heavily in AI, automation and next-generation digital capabilities. They are looking for an experienced AI Platform Engineer to help accelerate the adoption of enterprise AI solutions, build reusable capabilities, and deliver production-ready AI and automation services across the business. This is a hands-on engineering role where you'll work closely with business stakeholders, architects, security teams and technology partners to transform AI opportunities into scalable solutions while maintaining strong governance and operational standards. The Role You will: Build and enhance AI-powered applications and automation solutions. Integrate and operationalise Large Language Models including GPT, Claude and Gemini. Develop AI agents, workflow automation and Retrieval-Augmented Generation (RAG) solutions. Design and develop integrations using REST...

Data Engineer - South West England - 6 months - £500pd Outside IR35 - Local Authority - A major public sector organisation in the South West of England is seeking an experienced Data Engineer to lead the design, build and operation of enterprise data platforms, data pipelines and analytical data products. Working within a modern Digital, Data & Technology function, you will be responsible for engineering scalable, secure and reliable data solutions that enable trusted reporting, analytics and operational decision-making. You will work alongside architects, analysts, service teams and stakeholders to deliver robust data platforms whilst driving engineering standards, automation and continuous improvement across the organisation's data estate. This is an exciting opportunity to contribute to a significant data transformation programme and help shape the future of the organisation's data engineering capability. - Key Responsibilities: Data Platform & Pipeline...

Data Engineer - Snowflake / 3NF Rate - £550 - £600 per day - Outside IR35 Location - London, once a month onsite Duration - Initial 6 Month Contract - Extensions Expected The Opportunity: We're supporting a major UK household brand within its loyalty and rewards division as it continues to invest heavily in its data platform and wider data strategy. As part of this growth, they are looking to engage experienced Data Engineers to help design, build and enhance cloud based data solutions using AWS, Snowflake and DBT. Working alongside senior technical leadership, you'll play a key role in developing scalable data products, improving platform capability and delivering high quality data solutions that support critical business outcomes. This is an excellent opportunity to join a long term programme within a mature engineering environment where data is a strategic priority. Key Responsibilities: Develop, maintain and optimise data pipelines and data products within...

Data Engineer - Snowflake/3NF Rate - £550 - £600 per day - Outside IR35 Location - London, once a month onsite Duration - Initial 6 Month Contract - Extensions Expected The Opportunity: We're supporting a major UK household brand within its loyalty and rewards division as it continues to invest heavily in its data platform and wider data strategy. As part of this growth, they are looking to engage experienced Data Engineers to help design, build and enhance cloud based data solutions using AWS, Snowflake and DBT. Working alongside senior technical leadership, you'll play a key role in developing scalable data products, improving platform capability and delivering high quality data solutions that support critical business outcomes. This is an excellent opportunity to join a long term programme within a mature engineering environment where data is a strategic priority. Key Responsibilities: Develop, maintain and optimise data pipelines and data products within...

Data Engineer - Snowflake / 3NF Rate - £550 - £600 per day - Outside IR35 Location - London, once a month onsite Duration - Initial 6 Month Contract - Extensions Expected The Opportunity: We 're supporting a major UK household brand within its loyalty and rewards division as it continues to invest heavily in its data platform and wider data strategy. As part of this growth, they are looking to engage experienced Data Engineers to help design, build and enhance cloud based data solutions using AWS, Snowflake and DBT. Working alongside senior technical leadership, you 'll play a key role in developing scalable data products, improving platform capability and delivering high quality data solutions that support critical business outcomes. This is an excellent opportunity to join a long term programme within a mature engineering environment where data is a strategic priority. Key Responsibilities:...

Data Engineer - Data Migration Programme | London (Hybrid) | Contract - up to £500/d (outside IR35) Are you a Data Engineer with hands-on experience delivering enterprise data migration solutions? Our client - a fast-scaling European digital infrastructure provider with 100+ sites across the continent - is looking for a Data Engineer to join a major transformation programme consolidating multiple operational systems into a single target platform. You'll be at the centre of the migration workstream: building the pipelines, transformation logic, and validation frameworks that move data from legacy systems into the new target operating platform - working closely with the Data Workstream Lead, business SMEs, and application teams. What you'll be doing: Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling Implementing source-to-target mappings and transformation logic for the...

Data Engineer | Hybrid | South Wales | 3 months initially | Outside IR35 IntaPeople are excited to be appointed to recruit an experienced Data Engineer for a team that needs additional project resource for an interim period of time. You will be joining a small data team in this area of the business which will work with external partners to build out the organisations data capability offering. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust, scalable, and secure data pipelines and platform that enable them to make data -driven decisions. You’ll work closely with the ‘Head of Data Engineering’ to grow out this data function with the recruitment of further data engineering colleagues. You’ll be exposed to a wide range of projects that include internal and external suppliers. Essential Skills Proven experience as a Data Engineer Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles....

Data Engineer - Data Migration Programme | London (Hybrid) | Contract - up to £500/d (outside IR35) Are you a Data Engineer with hands-on experience delivering enterprise data migration solutions? Our client - a fast-scaling European digital infrastructure provider with 100+ sites across the continent - is looking for a Data Engineer to join a major transformation programme consolidating multiple operational systems into a single target platform. You 'll be at the centre of the migration workstream: building the pipelines, transformation logic, and validation frameworks that move data from legacy systems into the new target operating platform - working closely with the Data Workstream Lead, business SMEs, and application teams. What you 'll be doing: Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling Implementing source-to-target mappings and transformation logic...