27 aws data engineer jobs found in London

Remote (UK based candidates only) Initial 6-Month Contract Outside IR35 Possibility for extension We're working with a consulting client who's partnering with a leading financial services organisation looking to hire an AWS Data Engineer to help build and enhance their cloud-based data platform. Key Skills Required Strong AWS data engineering experience Hands-on expertise with DBT and PySpark Proven Python development skills Experience with Apache Airflow for orchestration Strong knowledge of Amazon Redshift Experience with Apache Iceberg and modern data lake architectures Familiarity with OpenSearch for search and analytics solutions Exposure to Knowledge Graph technologies and semantic data modelling CI/CD experience using CircleCI Responsibilities Design and develop scalable data pipelines and ETL processes Build and optimise cloud-native data solutions on AWS Develop data models and transformations using DBT and PySpark...

AWS Data Engineer Contract: 6 Months Rate: £400 per day IR35 Status: Outside IR35 Location: Remote/Hybrid Overview We are seeking an experienced AWS Data Engineer to join a growing consultancy on an initial 6-month contract. You'll be responsible for designing, building, and optimising modern data platforms and pipelines, enabling analytics, reporting, and AI-driven initiatives across the business. This role is ideal for someone with strong AWS experience and a background working with modern data tooling including dbt, PySpark, Airflow, Redshift, Iceberg, OpenSearch, Knowledge Graphs, Python, and CircleCI . Key Responsibilities Design and develop scalable ETL/ELT data pipelines using Python and PySpark Build and maintain data transformation frameworks using dbt Develop and orchestrate workflows using Apache Airflow Deliver high-performance data warehouse solutions within Amazon Redshift Support the implementation and optimisation of...

URGENT | AWS Data Engineer - Migration We're seeking a strong & hands-on AWS Data Engineering contractor, ASAP start, for an urgent replacement contract Rate: Up to £500-525 per day, Outside IR35 Working Patterns: Remote-first, London (up to 1 day p/w on-site). Contract: 3-6 months (likely extension) Sector: Financial Services About: We're supporting a major cloud transformation programme focused on migrating a large-scale legacy ETL estate consisting of several thousand batch jobs from Ab Initio to a modern, serverless AWS data platform. This is a hands-on Senior Data Engineer role where you'll play a key part in defining migration patterns and delivering production-ready AWS Glue solutions. Person Requirements: Strong AWS Data Engineer - ideally AWS Certified. Ideally, you'll bring proven experience delivering Ab Initio → AWS Glue (PySpark) migration programmes Strong hands-on AWS Data Engineering expertise, particularly AWS Glue ,...

AWS Data Engineer - Migration We're seeking a strong & hands-on AWS Data Engineering contractor, ASAP start, for an urgent replacement contract Rate: Up to £500-525 per day, Outside IR35 Working Patterns: Remote-first, London (up to 1 day p/w on-site). Contract: 3-6 months (likely extension) Sector: Financial Services About: We're supporting a major cloud transformation programme focused on migrating a large-scale Legacy ETL estate consiting of several thousand batch jobs from Ab Initio to a modern, serverless AWS data platform. This is a hands-on Senior Data Engineer role where you'll play a key part in defining migration patterns and delivering production-ready AWS Glue solutions. Person Requirments: Strong AWS Data Engineer - ideally AWS Certified. Idelaly, you'll bring proven experience delivering Ab Initio AWS Glue (PySpark) migration programmes Strong hands-on AWS Data Engineering expertise, particularly AWS Glue , S3 , Athena and...

Remote (UK based candidates only) | Initial 6-Month Contract | Outside IR35 | Possibility for extension We 're working with a consulting client who 's partnering with a leading financial services organisation looking to hire an AWS Data Engineer to help build and enhance their cloud-based data platform. Key Skills Required Strong AWS data engineering experience Hands-on expertise with DBT and PySpark Proven Python development skills Experience with Apache Airflow for orchestration Strong knowledge of Amazon Redshift Experience with Apache Iceberg and modern data lake architectures Familiarity with OpenSearch for search and analytics solutions Exposure to Knowledge Graph technologies and semantic data modelling CI/CD experience using CircleCI Responsibilities Design and develop scalable data pipelines and ETL processes Build and optimise cloud-native data solutions on AWS Develop data...

AWS Data Engineer Contract: 6 Months Rate: £400 per day IR35 Status: Outside IR35 Location: Remote / Hybrid Overview We are seeking an experienced AWS Data Engineer to join a growing consultancy on an initial 6-month contract. You 'll be responsible for designing, building, and optimising modern data platforms and pipelines, enabling analytics, reporting, and AI-driven initiatives across the business. This role is ideal for someone with strong AWS experience and a background working with modern data tooling including dbt, PySpark, Airflow, Redshift, Iceberg, OpenSearch, Knowledge Graphs, Python, and CircleCI . Key Responsibilities Design and develop scalable ETL/ELT data pipelines using Python and PySpark Build and maintain data transformation frameworks using dbt Develop and orchestrate workflows using Apache Airflow Deliver high-performance data warehouse solutions within Amazon Redshift Support...

Remote (UK based candidates only) | Initial 6-Month Contract | Outside IR35 | Possibility for extension We're working with a consulting client who's partnering with a leading financial services organisation looking to hire an AWS Data Engineer to help build and enhance their cloud-based data platform. Key Skills Required Strong AWS data engineering experience Hands-on expertise with DBT and PySpark Proven Python development skills Experience with Apache Airflow for orchestration Strong knowledge of Amazon Redshift Experience with Apache Iceberg and modern data lake architectures Familiarity with OpenSearch for search and analytics solutions Exposure to Knowledge Graph technologies and semantic data modelling CI/CD experience using CircleCI Responsibilities Design and develop scalable data pipelines and ETL processes Build and optimise cloud-native data solutions on AWS Develop data models and transformations using DBT and PySpark Automate...

AWS Data Engineer - MigrationWe're seeking a strong & hands-on AWS Data Engineering contractor, ASAP start, for an urgent replacement contract  Rate: Up to £500-525 per day, Outside IR35  Working Patterns: Remote-first, London (up to 1 day p/w on-site).  Contract: 3-6 months (likley extension) Sector: Financial Services About:  We're supporting a major cloud transformation programme focused on migrating a large-scale legacy ETL estate consiting of several thousand batch jobs from Ab Initio to a modern, serverless AWS data platform. This is a hands-on Senior Data Engineer role where you'll play a key part in defining migration patterns and delivering production-ready AWS Glue solutions.  Person Requirments: Strong AWS Data Engineer - ideally AWS Certified.  Idelaly, you'll bring proven experience delivering Ab Initio → AWS Glue (PySpark) migration programmes Strong hands-on AWS Data Engineering expertise, particularly AWS Glue, S3, Athena and serverless data platforms....

AWS Data Engineer Contract: 6 months Rate: £400 per day IR35 Status: Outside IR35 Location: Remote/Hybrid Overview We are seeking an experienced AWS Data Engineer to join a growing consultancy on an initial 6-month contract. You'll be responsible for designing, building, and optimising modern data platforms and pipelines, enabling analytics, reporting, and AI-driven initiatives across the business. This role is ideal for someone with strong AWS experience and a background working with modern data tooling including dbt, PySpark, Airflow, Redshift, Iceberg, OpenSearch, Knowledge Graphs, Python, and CircleCI . Key Responsibilities Design and develop scalable ETL/ELT data pipelines using Python and PySpark Build and maintain data transformation frameworks using dbt Develop and orchestrate workflows using Apache Airflow Deliver high-performance data warehouse solutions within Amazon Redshift Support the implementation and optimisation of Apache Iceberg...

Senior Python Engineer - AI & Microservices £450 PD to £600 PD (Outside IR35) | 12 month Contract | 2 days onsite in London (Hybrid) | ASAP Start Our trusted technology partner is developing innovative products and is looking for an experienced Senior Python Engineer/Back End Developer to join a fast-moving team. You will develop Python microservices, scalable services, voice chat, and data pipelines, using AI technologies including ASR, TTS, and LLMs. The ideal candidate will have strong Python skills, a pragmatic delivery-focused approach and experience working within either a SaaS, Digital-Rich, Assessment, Subscription or Ed-tech environment. Key Responsibilities: Develop and maintain scalable Python services, microservices, voice chat, and data pipelines. Work with the Tech Lead and wider team on architecture, technical decisions, and solution design. Collaborate with product, data science, QA, design, and subject matter experts to deliver new features....

C++ Software Engineer - Outside IR35 Contract London, UK Long-Term Engagement on a Rolling Contract Hybrid Working We have partnered with a leading Technology Firm who are looking to add a Software Engineer with skills on C++ to their Market Data team! The successful candidate will have experience in Financial Markets Technology and Real Time market data expertise. It's a Front Office position so you must be comfortable speaking with Portfolio Managers, Traders, C-Suite etc... Responsibilities will include: Architecture and Implementation of Low Latency C++ systems (robust, resilient, accurate, stable and fast) - by doing this you will position the client as a leader in Quant Trading. Work alongside hardware and software teams to build Real Time market data processing. Define, implement and enforce SLAs, policies and metrics to monitor the area. Develop Systems, Interfaces and tools to historical market data simulations to increase research...

We’re on a mission to back the UK’s small businesses like no one else Small businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start-up with the stability of a public company. It’s a unique mix that gives Circlers the autonomy to take ownership and the scale to make an impact that truly counts. We’re a high-performing team that chooses to lift each other up. We challenge, we champion, and we have each other’s backs - because we know that when we stand together, we move faster and build better. The impact is real: Last year alone, the businesses on our platform generated £7.2bn for the UK economy Come and join a mission that matters! [Read our Impact Report] | [See our Trustpilot] The role As a Consultant Principal Salesforce Engineer, you'll: Work on...

Moving enterprise certificate services onto a new platform takes more than a straightforward migration – the integrations, automation and security controls all need to work when they reach live operation. As a PKI Engineer, you’ll take a migration already in motion and help deliver an enterprise PKI as a Service platform built around AppViewX. You’ll work closely with the lead technical specialist, building integrations, automating certificate workflows and solving the practical challenges that emerge as applications move onto the new service. This is hands-on delivery work where you’ll have the opportunity to see what you build progress into live operation during the six-month assignment. What’s in it for you £650–£700 per day, outside IR35 Six-month contract working on an active enterprise PKIaaS migration Hybrid working from Leeds, London or Edinburgh Hands-on involvement with AppViewX and enterprise certificate...

£450 per day | Outside IR35 | London office 1-2 days per month My client is seeking an experienced Cloud Engineer to design, build and operate AI-powered automation solutions. You will work alongside five colleagues at the intersection of cloud engineering, enterprise data and artificial intelligence, using AWS services and large language models to improve business processes and support better decision-making. You will be required to attend the London office occasionally. Key responsibilities of the Cloud Engineer Design and deploy cloud-native automation solutions using agentic AI and generative AI technologies. Build applications with AWS Bedrock and related AWS services. Develop intelligent workflows and autonomous agents to automate business and operational processes. Integrate AI solutions with enterprise data platforms, including Teradata. Build scalable Python services, APIs and automation tools. Use Datadog to monitor performance, troubleshoot issues...

Moving enterprise certificate services onto a new platform takes more than a straightforward migration - the integrations, automation and security controls all need to work when they reach live operation. As a PKI Engineer, you'll take a migration already in motion and help deliver an enterprise PKI as a Service platform built around AppViewX. You'll work closely with the lead technical specialist, building integrations, automating certificate workflows and solving the practical challenges that emerge as applications move onto the new service. This is hands-on delivery work where you'll have the opportunity to see what you build progress into live operation during the six-month assignment. What's in it for you £650 - £700 per day, outside IR35 Six-month contract working on an active enterprise PKIaaS migration Hybrid working from Leeds, London or Edinburgh Hands-on involvement with AppViewX and enterprise certificate infrastructure Opportunity to take...

£450 per day | Outside IR35 | London office 1–2 days per month My client is seeking an experienced Cloud Engineer to design, build and operate AI-powered automation solutions. You will work alongside five colleagues at the intersection of cloud engineering, enterprise data and artificial intelligence, using AWS services and large language models to improve business processes and support better decision-making. Key responsibilities of the Cloud Engineer Design and deploy cloud-native automation solutions using agentic AI and generative AI technologies. Build applications with AWS Bedrock and related AWS services. Develop intelligent workflows and autonomous agents to automate business and operational processes. Integrate AI solutions with enterprise data platforms, including Teradata. Build scalable Python services, APIs and automation tools. Use Datadog to monitor performance, troubleshoot issues and improve observability. Work with data engineering teams to...

Senior Java Developer | Outside IR35 | Remote We are looking for an experienced Java Developer to support the development of modern, user-focused digital services on a large-scale public sector programme. You will work as part of a multidisciplinary engineering team, building and improving secure, resilient cloud-native applications. The Role This is a hands-on engineering role with a core focus on Java Back End development, while contributing across the wider delivery life cycle. You will develop services, APIs and integrations, work with TypeScript-based Front End applications, and help improve the cloud infrastructure and delivery pipelines that support the platform. Key Responsibilities Build, enhance and maintain Back End services and APIs using Java and Spring Boot. Contribute to TypeScript Front End development, delivering accessible and maintainable user journeys. Design and develop solutions using PostgreSQL, with a focus on reliable data handling and performance....

C++ Software Engineer - Outside IR35 Contract London, UK Long-Term Engagement on a Rolling Contract Hybrid Working We have partnered with a leading Technology Firm who are looking to add a Software Engineer with skills on C++ to their Market Data team! The successful candidate will have experience in Financial Markets Technology and Real Time market data expertise. It's a Front Office position so you must be comfortable speaking with Portfolio Managers, Traders, C-Suite etc... Responsibilities will include: Architecture and Implementation of Low Latency C++ systems (robust, resilient, accurate, stable and fast) - by doing this you will position the client as a leader in Quant Trading. Work alongside hardware and software teams to build Real Time market data processing. Define, implement and enforce SLAs, policies and metrics to monitor the area. Develop Systems, Interfaces and tools to historical market data simulations to increase research...

ML ENGINEER - SC CLEARED - OUTSIDE IR35 - CENTRAL LONDON (1 DAY ONSITE) - 6 MONTH CONTRACT TechShack is recruiting an ML Engineer for a 6 month contract, outside IR35, supporting a UK Government department on an AI-enabled data and business systems programme. Central London, on site 1 day per week. This role requires active SC clearance. Candidates who do not meet this criteria cannot be considered. THE PROGRAMME The programme covers two key deliverables: a new MCP (Model Context Protocol) server enabling an internal AI assistant to securely query business data in natural language, and an AI-powered MVP automating the capture, summarisation and submission of business information from Outlook and Teams. KEY RESPONSIBILITIES - Design and implement a new MCP server using the organisation's existing data platform/API - Enable natural language querying of business datasets via an internal AI assistant - Integrate relevant datasets based on defined user and business requirements...

I'm working with a client who is scaling their Databricks platform to support AI and GenAI use cases, and they need people who can make sure it's governed properly from the start. This is about hands-on Databricks delivery, not just certifications. This is a remote first contract but you must be based in the UK. This is outside IR35. What they're building Unity Catalog as the single governance layer across data, ML models and AI assets Governed GenAI and agent workloads using Mosaic AI and Agent Bricks Secure, auditable AI pipelines from ingestion to model serving, all within the Databricks platform Databricks project experience we're looking for Unity Catalog implementations or migrations from Hive metastore, including metastore design, catalog and schema structure, and workspace and environment separation Fine-grained access control in Unity Catalog: row filters, column masks, and attribute-based access control (ABAC) with governed tags Unity Catalog lineage...