9 azure databricks engineer jobs found in London

Cloud Platform Engineer (Terraform/Terragrunt) Contract | Outside IR35 | 3-6 months | £500-600/day | Mostly Remote The Role A growing Data & AI consultancy requires an experienced Cloud Platform Engineer to support several enterprise data platform implementations. You'll focus on Infrastructure as Code, building reusable cloud infrastructure for modern data platforms using Terraform and Terragrunt. Although many projects utilise Databricks, candidates with strong cloud engineering experience across comparable Azure data technologies will also be considered. Responsibilities Design Infrastructure as Code solutions Build reusable Terraform modules Deploy cloud infrastructure using Terragrunt Automate platform deployments Support Azure-based data platforms Work alongside Data Engineers and Solution Architects Essential Skills Terraform Terragrunt Infrastructure as Code Azure Python CI/CD Git Desirable Databricks...

Azure | Databricks | SQL | Outside IR35 | Hybrid THE COMPANY We 're partnering with a global mining organisation that is investing heavily in the evolution of its enterprise data platform. Following significant growth and a wider transformation programme, they 're looking to bring in an experienced Senior Data Engineer to strengthen the technical capability of the team and support the delivery of several high-profile data initiatives. This is a business that places real value on engineering best practice and is looking for someone who can provide immediate technical expertise, influence engineering standards through delivery and help solve complex data engineering challenges across the organisation. THE ROLE This is a hands-on Senior Data Engineering contract where you 'll operate as a senior individual contributor within a highly collaborative team. Rather than leading people, you 'll lead technically, owning complex engineering problems, partnering with...

🚨 Senior Data Engineer | Outside IR35 | £550–£675/day | Central London I'm currently partnering with a global organisation undergoing a major transformation of its data platform and engineering capability. They're looking to bring in an experienced Senior Data Engineer to help define engineering standards, improve platform performance and deliver scalable, enterprise-grade data solutions. This is an excellent opportunity to join a high-performing team where you'll have a real influence over architecture, engineering best practices and the future direction of the data platform. 📍 The Opportunity Senior Data Engineer Outside IR35 £550–£650 per day (depending on experience) 6-month initial contract ASAP Start Central London – 1-2 days onsite per week What You'll Be Doing As a Senior Data Engineer you'll be responsible for designing, building and optimising modern cloud-based data platforms while helping establish engineering standards across the...

Data/AI Engineer (Databricks) - Outside of IR35Contract We're taking an AI decision-support product from proof-of-concept to full production on Databricks and need a hands-on engineer to build, run and own it. It analyses data across ~1,000 sites, uses an LLM (Anthropic Claude) to generate per-site recommendations, and includes a conversational agent that lets managers question their own data. Delivery role, not advisory - you'll fill our gap in Databricks engineering, LLM pipelines and agent development, and build the capability in-house. Initial 6 Month Contract (Ext) & Remote Working What you'll do Build ingestion pipelines (PySpark) into a governed medallion layer in Unity Catalog. Productionise the LLM pipeline - run Claude across the estate on a schedule, with retries and validation gates. Build and tune the conversational agent - grounding, guardrails, benchmarking. Own evaluation (prompt versioning, MLflow) and CI/CD across dev/UAT/prod. Essential...

Data Engineer - South West England - 6 months - £500pd Outside IR35 - Local Authority - A major public sector organisation in the South West of England is seeking an experienced Data Engineer to lead the design, build and operation of enterprise data platforms, data pipelines and analytical data products. Working within a modern Digital, Data & Technology function, you will be responsible for engineering scalable, secure and reliable data solutions that enable trusted reporting, analytics and operational decision-making. You will work alongside architects, analysts, service teams and stakeholders to deliver robust data platforms whilst driving engineering standards, automation and continuous improvement across the organisation's data estate. This is an exciting opportunity to contribute to a significant data transformation programme and help shape the future of the organisation's data engineering capability. - Key Responsibilities: Data Platform & Pipeline...

£600 per day Outside IR35 6 Month Contract We're supporting a major UK financial services organisation that is investing heavily in AI, automation and next-generation digital capabilities. They are looking for an experienced AI Platform Engineer to help accelerate the adoption of enterprise AI solutions, build reusable capabilities, and deliver production-ready AI and automation services across the business. This is a hands-on engineering role where you'll work closely with business stakeholders, architects, security teams and technology partners to transform AI opportunities into scalable solutions while maintaining strong governance and operational standards. The Role You will: Build and enhance AI-powered applications and automation solutions. Integrate and operationalise Large Language Models including GPT, Claude and Gemini. Develop AI agents, workflow automation and Retrieval-Augmented Generation (RAG) solutions. Design and develop integrations using REST APIs,...

£600 per day | Outside IR35 | 6 Month Contract We're supporting a major UK financial services organisation that is investing heavily in AI, automation and next-generation digital capabilities. They are looking for an experienced AI Platform Engineer to help accelerate the adoption of enterprise AI solutions, build reusable capabilities, and deliver production-ready AI and automation services across the business. This is a hands-on engineering role where you'll work closely with business stakeholders, architects, security teams and technology partners to transform AI opportunities into scalable solutions while maintaining strong governance and operational standards. The Role You will: Build and enhance AI-powered applications and automation solutions. Integrate and operationalise Large Language Models including GPT, Claude and Gemini. Develop AI agents, workflow automation and Retrieval-Augmented Generation (RAG) solutions. Design and develop integrations using REST APIs,...

£600 per day | Outside IR35 | 6 Month Contract We 're supporting a major UK financial services organisation that is investing heavily in AI, automation and next-generation digital capabilities. They are looking for an experienced AI Platform Engineer to help accelerate the adoption of enterprise AI solutions, build reusable capabilities, and deliver production-ready AI and automation services across the business. This is a hands-on engineering role where you 'll work closely with business stakeholders, architects, security teams and technology partners to transform AI opportunities into scalable solutions while maintaining strong governance and operational standards. The Role You will: Build and enhance AI-powered applications and automation solutions. Integrate and operationalise Large Language Models including GPT, Claude and Gemini. Develop AI agents, workflow automation and Retrieval-Augmented Generation (RAG) solutions. Design and develop integrations...

£600 per day | Outside IR35 | 6 Month Contract We're supporting a major UK financial services organisation that is investing heavily in AI, automation and next-generation digital capabilities. They are looking for an experienced AI Platform Engineer to help accelerate the adoption of enterprise AI solutions, build reusable capabilities, and deliver production-ready AI and automation services across the business. This is a hands-on engineering role where you'll work closely with business stakeholders, architects, security teams and technology partners to transform AI opportunities into scalable solutions while maintaining strong governance and operational standards. The Role You will: Build and enhance AI-powered applications and automation solutions. Integrate and operationalise Large Language Models including GPT, Claude and Gemini. Develop AI agents, workflow automation and Retrieval-Augmented Generation (RAG) solutions. Design and develop integrations using REST...