152 data engineer jobs found

Senior Data Engineer (Contract) Outside IR35 Location: London (Hybrid 2 days per week on-site, mandatory ) Contract: Initial 6 months with strong likelihood of extension IR35: Outside IR35 We're working with an established, data-driven business looking for a Senior Data Engineer to join a small, high-impact data team click apply for full job details

Lead Data Engineer Key Points Location: London Or Reading, Hybrid Duration: 12 months Rate: Competitive Day Rate, Outside IR35 Overview This is an opportunity to join a leading organisation undertaking a major cloud transformation and data modernisation programme, delivering enterprise-scale data solutions across a complex technology landscape. As a Lead Data Engineer, you will provide technical leadership across the design, development, automation, and optimisation of cloud-based data platforms, ensuring secure, scalable, and high-performing solutions are delivered to support business and operational objectives. Working closely with architects, stakeholders, analysts, and engineering teams, you will drive best practice across data engineering, infrastructure automation, CI/CD, and cloud technologies while mentoring and leading other engineers within the delivery team. Key Responsibilities Lead the design and delivery of enterprise-scale data engineering...

AI Data Engineer - Agentic AI In Prod - Eval's - Context Engineering - RAG - LLM's - AWS Bedrock AI Data Engineer - Agentic AI In Prod - Eval's - Context Engineering - RAG - LLM's - AWS Bedrock requirement for an urgent start. The AI Data Engineer - Agentic AI In Prod - Eval's - Context Engineering - RAG - LLM's - AWS Bedrock will be working for us, Blackstone&, at an enterprise client in London AI Data Engineer - Agentic AI In Prod - Eval's - Context Engineering - RAG - LLM's - AWS Bedrock Key Skills A data engineering background with a strong, current understanding of how AI systems consume data. You know the difference between building pipelines for analytics and building pipelines for agents. Hands-on experience with AWS, including the data services (S3, Glue, Lambda, RDS) and AI services (Bedrock, Knowledge Bases) and how they connect. The ability to take unstructured data and transform it into structured, agent-ready formats in production, not just in a...

Remote working U.K *SC and NPPV3 clearance essential* Outside IR35 *Please do NOT apply if you do not hold SC/NPPV3 clearance, these are non negotiables* We're looking for a Data Engineer/Developer to join a specialist team delivering innovative data solutions within the law enforcement and digital investigations space. This role centres on transforming complex investigative and forensic datasets into structured intelligence, developing automated data processing workflows, and supporting the integration of policing data standards into modern analytical platforms. You'll work with large volumes of digital evidence and intelligence data, designing robust transformation pipelines and automation that enable investigators and analysts to derive value from complex information quickly and accurately. This is an excellent opportunity for someone with a background in digital forensics, eDiscovery, law enforcement data, or data engineering who enjoys solving complex...

Lead Data Engineer Key Points Location: London Or Reading, Hybrid Duration: 12 months Rate: Competitive Day Rate, Outside IR35 Overview This is an opportunity to join a leading organisation undertaking a major cloud transformation and data modernisation programme, delivering enterprise-scale data solutions across a complex technology landscape. As a Lead Data Engineer, you will provide technical leadership across the design, development, automation, and optimisation of cloud-based data platforms, ensuring secure, scalable, and high-performing solutions are delivered to support business and operational objectives. Working closely with architects, stakeholders, analysts, and engineering teams, you will drive best practice across data engineering, infrastructure automation, CI/CD, and cloud technologies while mentoring and leading other engineers within the delivery team. Key Responsibilities Lead the design and delivery of enterprise-scale data engineering...

Azure | Databricks | SQL | Outside IR35 | Hybrid THE COMPANY We 're partnering with a global mining organisation that is investing heavily in the evolution of its enterprise data platform. Following significant growth and a wider transformation programme, they 're looking to bring in an experienced Senior Data Engineer to strengthen the technical capability of the team and support the delivery of several high-profile data initiatives. This is a business that places real value on engineering best practice and is looking for someone who can provide immediate technical expertise, influence engineering standards through delivery and help solve complex data engineering challenges across the organisation. THE ROLE This is a hands-on Senior Data Engineering contract where you 'll operate as a senior individual contributor within a highly collaborative team. Rather than leading people, you 'll lead technically, owning complex engineering problems, partnering with...

Senior Data Engineer Contract Role Outside IR35 | £500-550/day | Liverpool (3 days on-site) | Hybrid | Initial 6 Months We have a new Senior Data Engineer contract opportunity with client of ours based in Liverpool with 3 days required per week on-site. You’ll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, and offers an initial 6-month contract with an immediate start and strong potential for extension. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices. Migrate and transform data into a Databricks Lakehouse architecture. Ensure data quality, reliability, and scalability for analytics and reporting. Collaborate with stakeholders to deliver robust solutions aligned with business needs. Support production environments and...

Contract Data Engineer / Developer Remote working U.K (Some travel maybe needed to sites in the U.K **SC and NPPV3 clearance essential** Outside IR35 **Please do NOT apply if you do not hold SC/NPPV3 clearance, these are non negotiables** We are seeking an experienced SC/NPPV3 cleared Data Engineer / Developer on a short term initial contract to support the delivery of innovative data solutions within a secure policing environment. This is an opportunity to work on projects that transform and integrate complex intelligence and forensic datasets, helping to improve operational capabilities through automation and modern data engineering practices. Essential Skills & Experience Experience within UK policing, law enforcement, government or national security environments. Understanding of digital forensic data handling and processing. Experience developing IES-to-SCREENING conversion solutions. Knowledge of SCREENING artefacts or policing...

Join a high-impact team transforming data infrastructure with cutting-edge Databricks technology in Liverpool. Salary: £500 - 550 per day Senior Data Engineer Contract Role Outside IR35 | £500-550/day | Liverpool (3 days on-site) | Hybrid | Initial 6 Months We have a new Senior Data Engineer contract opportunity with client of ours based in Liverpool with 3 days required per week on-site. You'll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, and offers an initial 6-month contract with an immediate start and strong potential for extension. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices Migrate and transform data into a Databricks Lakehouse architecture Ensure data quality, reliability, and scalability for analytics and...

Senior Data Engineer Contract Role Outside IR35 | £500-550/day | Liverpool (3 days on-site) | Hybrid | Initial 6 months We have a new Senior Data Engineer contract opportunity with client of ours based in Liverpool with 3 days required per week on-site. You'll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, and offers an initial 6-month contract with an immediate start and strong potential for extension. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices. Migrate and transform data into a Databricks Lakehouse architecture. Ensure data quality, reliability, and scalability for analytics and reporting. Collaborate with stakeholders to deliver robust solutions aligned with business needs. Support production environments and troubleshoot performance issues....

🚨 Senior Data Engineer | Outside IR35 | £550–£675/day | Central London I'm currently partnering with a global organisation undergoing a major transformation of its data platform and engineering capability. They're looking to bring in an experienced Senior Data Engineer to help define engineering standards, improve platform performance and deliver scalable, enterprise-grade data solutions. This is an excellent opportunity to join a high-performing team where you'll have a real influence over architecture, engineering best practices and the future direction of the data platform. 📍 The Opportunity Senior Data Engineer Outside IR35 £550–£650 per day (depending on experience) 6-month initial contract ASAP Start Central London – 1-2 days onsite per week What You'll Be Doing As a Senior Data Engineer you'll be responsible for designing, building and optimising modern cloud-based data platforms while helping establish engineering standards across the...

Senior Data Engineer (Contract) – Outside IR35 Location: London (Hybrid – 2 days per week on-site, mandatory ) Contract: Initial 6 months with strong likelihood of extension IR35: Outside IR35 We're working with an established, data-driven business looking for a Senior Data Engineer to join a small, high-impact data team. This is an opportunity for a hands-on technical specialist to take ownership of a critical data platform, improving existing infrastructure while building scalable foundations for the future. This role is ideal for someone who enjoys solving complex data engineering challenges, has strong opinions on best practice, and is comfortable working independently while partnering closely with business stakeholders. What you'll be doing Design, build and optimise end-to-end data pipelines into Google BigQuery Integrate data from CRM and digital marketing platforms, including HubSpot, Google Ads, Meta Ads, Microsoft Ads and LinkedIn Ads Improve the...

Data/AI Engineer (Databricks) - Outside of IR35Contract We're taking an AI decision-support product from proof-of-concept to full production on Databricks and need a hands-on engineer to build, run and own it. It analyses data across ~1,000 sites, uses an LLM (Anthropic Claude) to generate per-site recommendations, and includes a conversational agent that lets managers question their own data. Delivery role, not advisory - you'll fill our gap in Databricks engineering, LLM pipelines and agent development, and build the capability in-house. Initial 6 Month Contract (Ext) & Remote Working What you'll do Build ingestion pipelines (PySpark) into a governed medallion layer in Unity Catalog. Productionise the LLM pipeline - run Claude across the estate on a schedule, with retries and validation gates. Build and tune the conversational agent - grounding, guardrails, benchmarking. Own evaluation (prompt versioning, MLflow) and CI/CD across dev/UAT/prod. Essential...

Fabric Data Engineer | Remote | Outside IR35 | £450 - £500 | Salesforce We are supporting a leading organisation on the expansion of their modern data platform and are looking for a Fabric Data Engineer to play a key role in designing, building, and optimising their data architecture. For this role it is crucial that you have experience as a fabric data engineer but also working with salesforce data. This role will focus on leveraging the Microsoft Fabric ecosystem alongside Salesforce data , delivering high-quality, scalable data solutions that enable advanced analytics and reporting across the business. Key Responsibilities Design, build, and maintain data pipelines within Microsoft Fabric Integrate and transform Salesforce data into a unified data platform. Develop and optimise ETL/ELT processes for performance and scalability. Implement data modelling best practices (star schema, dimensional modelling). Collaborate with stakeholders to translate business...

Data Engineer - South West England - 6 months - £500pd Outside IR35 - Local Authority - A major public sector organisation in the South West of England is seeking an experienced Data Engineer to lead the design, build and operation of enterprise data platforms, data pipelines and analytical data products. Working within a modern Digital, Data & Technology function, you will be responsible for engineering scalable, secure and reliable data solutions that enable trusted reporting, analytics and operational decision-making. You will work alongside architects, analysts, service teams and stakeholders to deliver robust data platforms whilst driving engineering standards, automation and continuous improvement across the organisation's data estate. This is an exciting opportunity to contribute to a significant data transformation programme and help shape the future of the organisation's data engineering capability. - Key Responsibilities: Data Platform & Pipeline...

SC Cleared Data Engineer - Fully Remote - £350 - £375pd Outside IR35 - 6 Months Rolling I'm working with a government consultancy who are looking for an SC Cleared Data Engineer for a long term project. They need someone with strong PostgreSQL experience. This role is fully remote and Outside IR35. Skills: Strong commercial PostgreSQL/Postgres experience Experience implementing data transformations within PostgreSQL Strong SQL development skills Good understanding of database design Active SC Clearance 1 Stage interview process. SC Cleared Data Engineer - Fully Remote - £350 - £375pd Outside IR35 - 6 Months Rolling

Data Engineer - Snowflake / 3NF Rate - £550 - £600 per day - Outside IR35 Location - London, once a month onsite Duration - Initial 6 Month Contract - Extensions Expected The Opportunity: We're supporting a major UK household brand within its loyalty and rewards division as it continues to invest heavily in its data platform and wider data strategy. As part of this growth, they are looking to engage experienced Data Engineers to help design, build and enhance cloud based data solutions using AWS, Snowflake and DBT. Working alongside senior technical leadership, you'll play a key role in developing scalable data products, improving platform capability and delivering high quality data solutions that support critical business outcomes. This is an excellent opportunity to join a long term programme within a mature engineering environment where data is a strategic priority. Key Responsibilities: Develop, maintain and optimise data pipelines and data products within...

Data Engineer - Snowflake/3NF Rate - £550 - £600 per day - Outside IR35 Location - London, once a month onsite Duration - Initial 6 Month Contract - Extensions Expected The Opportunity: We're supporting a major UK household brand within its loyalty and rewards division as it continues to invest heavily in its data platform and wider data strategy. As part of this growth, they are looking to engage experienced Data Engineers to help design, build and enhance cloud based data solutions using AWS, Snowflake and DBT. Working alongside senior technical leadership, you'll play a key role in developing scalable data products, improving platform capability and delivering high quality data solutions that support critical business outcomes. This is an excellent opportunity to join a long term programme within a mature engineering environment where data is a strategic priority. Key Responsibilities: Develop, maintain and optimise data pipelines and data products within...

Data Engineer - Snowflake / 3NF Rate - £550 - £600 per day - Outside IR35 Location - London, once a month onsite Duration - Initial 6 Month Contract - Extensions Expected The Opportunity: We 're supporting a major UK household brand within its loyalty and rewards division as it continues to invest heavily in its data platform and wider data strategy. As part of this growth, they are looking to engage experienced Data Engineers to help design, build and enhance cloud based data solutions using AWS, Snowflake and DBT. Working alongside senior technical leadership, you 'll play a key role in developing scalable data products, improving platform capability and delivering high quality data solutions that support critical business outcomes. This is an excellent opportunity to join a long term programme within a mature engineering environment where data is a strategic priority. Key Responsibilities:...

Data Engineer - Data Migration Programme | London (Hybrid) | Contract - up to £500/d (outside IR35) Are you a Data Engineer with hands-on experience delivering enterprise data migration solutions? Our client - a fast-scaling European digital infrastructure provider with 100+ sites across the continent - is looking for a Data Engineer to join a major transformation programme consolidating multiple operational systems into a single target platform. You 'll be at the centre of the migration workstream: building the pipelines, transformation logic, and validation frameworks that move data from legacy systems into the new target operating platform - working closely with the Data Workstream Lead, business SMEs, and application teams. What you 'll be doing: Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling Implementing source-to-target mappings and transformation logic...