176 data engineer jobs found

Role: * Developing and implementing SQL scripts to populate and differentially refresh a modelled data warehouse in Azure-Fabric. * ETL and general End-To-End Datawarehouse development knowledge - data-modelling experience essential. * Extensive knowledge of Power BI - extending underlying data/semantic models and developing dashboards Responsibilities: * Must be capable of working in an Agile manner and owning packages of work from inception through to completion * Liaising with project managers and business stakeholders to ensure key milestones are met. * Must be able to work in a pressurised environment to agreed design standards and within timescales Skillsets: * Extensive T-SQL * Kimball Modelling experience essential (star schema preferred) * Extensive Power BI/DAX Experience This is a 3 month initial contract with unlimited potential for extension, working for a fast-growing, development house offering unlimited potential for the right candidate - several people...

We are seeking 3 experienced SC Cleared Data Engineers with strong expertise in AWS Glue to work for our client in the defence sector. You will support the design, development, and optimisation of cloud-based data integration and analytics solutions. You will play a key role in building scalable ETL pipelines, data lakes, and data processing frameworks within AWS, enabling the organisation to deliver high-quality data products and insights. We are looking for people with extensive commercial experience with AWS Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. You will also need experience with several of the following: Amazon Redshift, AWS Lambda, Amazon Athena, Amazon RDS, Amazon EMR, Amazon EventBridge, Amazon Kinesis, AWS Step Functions, Amazon SQS/SNS and AWS CloudWatch. These roles are outside IR35 and...

SC Data Engineer - Remote - 6 Months Rolling - £500 - £600pd Outside IR35 I'm working with a Government consultancy looking to hire an SC Cleared Data Engineer for a long term project. Remote £500 - £600pd Outside IR35 Skills: Microsoft Azure , AWS or other cloud platforms. Azure Data Factory / Synapse / Databricks. Apache Spark / PySpark. Snowflake. Kafka or other event-streaming technologies. Docker and Kubernetes. Terraform or Infrastructure as Code. CI/CD tooling such as Azure DevOps, GitHub Actions or Jenkins. Data lakes and lakehouse architectures. PostgreSQL, SQL Server or Oracle. 1 Stage interview process. SC Data Engineer - Remote - 6 Months Rolling - £500 - £600pd Outside IR35

Senior Data Engineer – FinTech | Contract I’m working with a growing FinTech business that is investing heavily into its Data platform as part of a wider transformation programme. They’re looking for a Senior Data Engineer to join the team and help design, build and modernise scalable data pipelines and infrastructure. The role: Build and optimise scalable data pipelines Work across a modern cloud-based Data platform Support a wider Data transformation programme Improve data quality, reliability and performance Work closely with Data, Engineering and Product teams Key experience: Strong Python & SQL Databricks and/or Snowflake Spark dbt AWS, Azure or GCP Modern data architecture & pipelines Experience within FinTech, Banking, Payments or Financial Services beneficial Contract: 6 months initially Location: London / Hybrid IR35: Outside IR35 Rate: £600–£700 per day Senior Data Engineer – FinTech | Contract

Senior Databricks Data Engineer Contract | Outside IR35 | 3-6 Months | October start date The Role We're supporting a growing Data & AI consultancy that has secured several new Databricks engagements across both public and private sector clients. Due to continued project wins, they're looking to add multiple experienced Databricks Data Engineers who can hit the ground running on enterprise data platform projects. You'll be responsible for designing and building scalable Databricks solutions, developing modern Lakehouse architectures and delivering production-ready data pipelines. Responsibilities Design and develop Databricks Lakehouse solutions Build Bronze, Silver and Gold data models Develop scalable ETL/ELT pipelines using Python and SQL Work with Delta Lake and modern Databricks features Optimise performance across Spark workloads Collaborate with architects and client stakeholders Support CI/CD and deployment best practices Essential...

Senior Data Engineer - Snowflake - dbt - Python - Manchester - Contract We're looking for an experienced Data Engineer to join a project building a new platform. The focus of the role is on data ingestion, transformation and reporting, with data being integrated into Snowflake. Key Responsibilities: Extract and integrate data from REST APIs Build and maintain data pipelines into Snowflake Support MI reporting and data requirements Develop and manage data transformations using dbt Work with Python and orchestration tools such as Windmill or Apache Airflow Essential Skills: Strong Python experience Hands-on Snowflake experience Experience with dbt Experience extracting data via REST APIs Experience with Windmill, Apache Airflow, or similar orchestration tools Strong data engineering and pipeline development experience Contract Details: Rate: Up to £400 per day (Outside IR35) Location: Manchester Working Pattern: 4 days per week on-site...

Data Engineer Contract - Outside IR35 - £500-600 per day DOE - Hybrid in London A fast-growing global digital marketing group is building a new enterprise Data Warehouse on Google Cloud and needs experienced contractors to accelerate delivery. You'll join an established team, take direction from the lead engineer and add value from week one. You'll be: Building out the warehouse on GCP and BigQuery Delivering ingestion pipelines from multiple source systems Implementing a Medallion (Bronze / Silver / Gold) architecture Developing dimensional data models You'll have: Strong Python and SQL BigQuery / GCP as your core platform Data warehousing and data modelling experience Data ingestion experience Medallion framework experience The role is 3 days a week in London (non negotiable) and can pay up to £600 Outside IR35. It will be for an initial 3 month period. Data Engineer Contract - Outside IR35 - £500-600 per day DOE - Hybrid in London

🚨 URGENT CONTRACT OPPORTUNITY | Data Engineer | Outside IR35 Oliver Bernard have recently partnered with a growing organisation that is scaling out its Data Engineering function and looking to add Data Engineers ASAP . The immediate focus is on building out a new Data Warehouse , so we're looking for engineers who are comfortable getting hands-on across data pipelines, modelling and warehouse architecture. We're looking for experience with: 🔹 Python & SQL 🔹 GCP & BigQuery 🔹 Data Warehousing 🔹 Data Modelling 🔹 Data Ingestion 🔹 Medallion Architecture This is a great opportunity for a Mid–Senior Data Engineer to join an active project, take direction from the existing team and make an immediate impact. 📍 London | 3 days in office 💰 Up to £550/day 📄 Outside IR35 ⏱️ 3-month initial contract 🚀 Immediate start If you're available and this sounds relevant, apply below or drop me a message for more information....

🚨 Data Engineer | Contract | Outside IR35 | up to £500 per day Oliver Bernard have recently partnered with a growing organisation that is looking to bring in Data Engineers on an initial 3-month contract to support the build-out of a new Data Warehouse . They’re looking for Mid–Senior level Data Engineers who can hit the ground running, take direction and help accelerate a project that’s already underway. Tech stack & experience: Python & SQL GCP & BigQuery Data Warehousing Data Modelling Data Ingestion Medallion Architecture / Framework 📍 London – 3 days per week in the office 💰 up to £500 Outside IR35 (depending on experience) 📄 Outside IR35 ⏱️ 3-month initial contract 🚀 Immediate start If you're a Data Engineer with strong Data Warehousing experience and available for a new contract, apply below for more information.

Senior Data Engineer – AWS / Lakehouse Contract: 3 months | Fully Remote | Outside IR35 We are seeking an experienced Data Engineer for a three-month project delivering cloud-based data engineering and integration solutions. This is a hands-on role requiring strong AWS expertise , practical experience with Apache Iceberg and Apache Spark , and a solid understanding of unstructured data processing and integration patterns . You will work closely with technical and delivery teams to build reliable data pipelines, develop lakehouse capabilities and integrate data across systems. Key responsibilities Design, build and optimise data pipelines using AWS Glue, S3, Lambda and Apache Spark . Develop and maintain lakehouse solutions using Apache Iceberg , supporting efficient data ingestion, transformation and access. Build workflows for ingesting, processing and transforming unstructured data . Develop integrations using API Gateway, Lambda and...

Data Engineer Tecknuovo is a digital delivery partner with a Deliberately Different approach. This means we focus on people, not technology. We move at pace and ensure Zero Dependency on us at the end of each project. What you'll be working towards We are currently looking to engage with SC Cleared Data Engineers on a large organisation project within the public sector. The successful candidate will have experience with: Azure Python Synapse SQL DB *Please note this requires active Security Clearance* Your Journey : Passing the TeckBar The Teckbar is a benchmark we set for our associates to make sure we consistently deploy bestin-class teams to work with our clients. Talent Screen: Our Talent Team will be in touch to talk Tecknuovo, the role & values Tech Screen: We'll focus on real-life experience and deep dive into your technical background Offer: Job Done! During the process, we promise you'll have: An understanding of...

AWS Data Engineer Contract: 6 months Rate: £400 per day IR35 Status: Outside IR35 Location: Remote/Hybrid Overview We are seeking an experienced AWS Data Engineer to join a growing consultancy on an initial 6-month contract. You'll be responsible for designing, building, and optimising modern data platforms and pipelines, enabling analytics, reporting, and AI-driven initiatives across the business. This role is ideal for someone with strong AWS experience and a background working with modern data tooling including dbt, PySpark, Airflow, Redshift, Iceberg, OpenSearch, Knowledge Graphs, Python, and CircleCI . Key Responsibilities Design and develop scalable ETL/ELT data pipelines using Python and PySpark Build and maintain data transformation frameworks using dbt Develop and orchestrate workflows using Apache Airflow Deliver high-performance data warehouse solutions within Amazon Redshift Support the implementation and optimisation of Apache Iceberg...

Senior Data Engineer - Snowflake - dbt - Python - Manchester - Contract We're looking for an experienced Data Engineer to join a project building a new platform. The focus of the role is on data ingestion, transformation and reporting, with data being integrated into Snowflake. Key Responsibilities: Extract and integrate data from REST APIs Build and maintain data pipelines into Snowflake Support MI reporting and data requirements Develop and manage data transformations using dbt Work with Python and orchestration tools such as Windmill or Apache Airflow Essential Skills: Strong Python experience Hands-on Snowflake experience Experience with dbt Experience extracting data via REST APIs Experience with Windmill, Apache Airflow, or similar orchestration tools Strong data engineering and pipeline development experience Contract Details: Rate: Up to £400 per day (Outside IR35) Location: Manchester Working Pattern: 4 days per week...

Senior Data Engineer - Snowflake - dbt - Python - Manchester - Contract We're looking for an experienced Data Engineer to join a project building a new platform. The focus of the role is on data ingestion, transformation and reporting, with data being integrated into Snowflake. Key Responsibilities: Extract and integrate data from REST APIs Build and maintain data pipelines into Snowflake Support MI reporting and data requirements Develop and manage data transformations using dbt Work with Python and orchestration tools such as Windmill or Apache Airflow Essential Skills: Strong Python experience Hands-on Snowflake experience Experience with dbt Experience extracting data via REST APIs Experience with Windmill, Apache Airflow, or similar orchestration tools Strong data engineering and pipeline development experience Contract Details: Rate: Up to £400 per day (Outside IR35) Location: Manchester Working Pattern: 4 days per week...

Remote (UK based candidates only) | Initial 6-Month Contract | Outside IR35 | Possibility for extension We're working with a consulting client who's partnering with a leading financial services organisation looking to hire an AWS Data Engineer to help build and enhance their cloud-based data platform. Key Skills Required Strong AWS data engineering experience Hands-on expertise with DBT and PySpark Proven Python development skills Experience with Apache Airflow for orchestration Strong knowledge of Amazon Redshift Experience with Apache Iceberg and modern data lake architectures Familiarity with OpenSearch for search and analytics solutions Exposure to Knowledge Graph technologies and semantic data modelling CI/CD experience using CircleCI Responsibilities Design and develop scalable data pipelines and ETL processes Build and optimise cloud-native data solutions on AWS Develop data models and transformations using DBT and PySpark Automate...

Senior Data Engineer - AWS/Lakehouse Contract: 3 months | Fully Remote | Outside IR35 We are seeking an experienced Data Engineer for a three-month project delivering cloud-based data engineering and integration solutions. This is a hands-on role requiring strong AWS expertise , practical experience with Apache Iceberg and Apache Spark , and a solid understanding of unstructured data processing and integration patterns . You will work closely with technical and delivery teams to build reliable data pipelines, develop lakehouse capabilities and integrate data across systems. Key responsibilities Design, build and optimise data pipelines using AWS Glue, S3, Lambda and Apache Spark . Develop and maintain lakehouse solutions using Apache Iceberg , supporting efficient data ingestion, transformation and access. Build workflows for ingesting, processing and transforming unstructured data . Develop integrations using API Gateway, Lambda and EventBridge ,...

Remote (UK based candidates only) | Initial 6-Month Contract | Outside IR35 | Possibility for extension We 're working with a consulting client who 's partnering with a leading financial services organisation looking to hire an AWS Data Engineer to help build and enhance their cloud-based data platform. Key Skills Required Strong AWS data engineering experience Hands-on expertise with DBT and PySpark Proven Python development skills Experience with Apache Airflow for orchestration Strong knowledge of Amazon Redshift Experience with Apache Iceberg and modern data lake architectures Familiarity with OpenSearch for search and analytics solutions Exposure to Knowledge Graph technologies and semantic data modelling CI/CD experience using CircleCI Responsibilities Design and develop scalable data pipelines and ETL processes Build and optimise cloud-native data solutions on AWS Develop data...

AWS Data Engineer Contract: 6 Months Rate: £400 per day IR35 Status: Outside IR35 Location: Remote / Hybrid Overview We are seeking an experienced AWS Data Engineer to join a growing consultancy on an initial 6-month contract. You 'll be responsible for designing, building, and optimising modern data platforms and pipelines, enabling analytics, reporting, and AI-driven initiatives across the business. This role is ideal for someone with strong AWS experience and a background working with modern data tooling including dbt, PySpark, Airflow, Redshift, Iceberg, OpenSearch, Knowledge Graphs, Python, and CircleCI . Key Responsibilities Design and develop scalable ETL/ELT data pipelines using Python and PySpark Build and maintain data transformation frameworks using dbt Develop and orchestrate workflows using Apache Airflow Deliver high-performance data warehouse solutions within Amazon Redshift Support...

Location: West London | Hybrid – 2–3 days WFO Design, build & support scalable data models and distributed ETL pipelines Strong Python + Advanced SQL Google BigQuery / GCP and cloud-based data warehousing Strong DBT for data pipelines and transformations Dimensional modelling , data flow and analytics/reporting DataOps, CI/CD, TDD and Agile practices Snowflake, Iceberg & Lakehouse architecture Troubleshoot data incidents and ensure platform reliability Stakeholder collaboration and requirements analysis Lead/mentor engineers and contribute to data architecture/governance Bonus: Customer/Commerce data, third-party integrations, BDD, AI/ML Mandatory: Data Engineering + Advanced SQL + Python + BigQuery/GCP + DBT + Data Modelling + ETL + CI/CD. Senior Data Engineer - Job desc…

Palantir Foundry Data Engineer/Outside IR35/Remote/6 Month Contract We are seeking an experienced Palantir Foundry Data Engineer to join a high-profile programme delivering data-driven solutions for a major client. This is an exciting opportunity to work on complex datasets, build scalable data pipelines, and develop data products within the Palantir Foundry ecosystem. The successful candidates will be a hands on engineer with proven commercial experience delivering solutions using Palantir Foundry, alongside strong data engineering expertise. Role Requirements: Strong commercial experience working as a Data Engineer. Proven hands-on experience with Palantir Foundry. Experience building and maintaining data pipelines within Foundry. Strong Python development skills. Advanced SQL skills. Experience with data integration, transformation and ETL/ELT processes. Experience working with large and complex datasets. Strong problem-solving and stakeholder management skills....