104 data engineer jobs found in London

New Role: Data Engineer (Pharma / Life Sciences) Pharma Experience Required £600 per day Outside IR35 6 Month Contract UK-based (Hybrid) Working with a client in the pharma space building out their data platform to support research and lab analytics. Looking for a Data Engineer with: - 6+ Years experience - Pharma / life sciences experience required (2 years at the very least) - Strong SQL and Python - Experience building ETL / ELT pipelines - Cloud data platforms (AWS / GCP / Azure) - Data warehousing and modelling experience - Power BI for reporting and stakeholder dashboards (Or similar) - Experience working with lab / scientific datasets

Senior Data Engineer - Contract - Outside IR35 3 days per week onsite, Central London £600 per day 6 months (extensions possible) FinTech | London We’re partnering with a fast-growing FinTech at the heart of Private Market Investments. What They’re Looking For Strong grounding in computer science fundamentals and data modelling Solid experience across the software delivery lifecycle as it applies to data Commercial experience with Python (and strong SQL skills) Experience with streaming and data processing (e.g. Kafka, Spark, Athena or similar) Hands-on experience with Azure Familiarity with containerisation and orchestration Clear communicator who can explain technical decisions to non-technical stakeholders Why Join? Work on genuinely difficult engineering problems Exposure to large, complex systems in real production environments A culture built by engineers, for engineers 3 days per week onsite, Central London £600 per day 6...

Data Engineer Location: Remote/London occasional visits to London Rate: £350 Day Outside IR35 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You'll be responsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering. This role offers the opportunity to work with leading technologies, collaborate with data architects and scientists, and make a significant impact in a fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals....

Senior Azure Data Engineer - Wealth Management (Outside IR35, 9-Month Contract, Hybrid London) Contract | 9 months | Outside IR35 | Hybrid (London with flexibility) A leading UK Wealth Management firm undergoing a major digital and data transformation programme is seeking an experienced Senior Azure Data Engineer to design and deliver a greenfield, end-to-end data warehouse and analytics platform. This position is a hands-on, lead engineering role requiring deep Azure expertise, architectural decision-making experience, and a strong background within wealth & asset management data environments. Key Responsibilities Lead the design and delivery of a full Azure-based data warehouse and medallion architecture (Bronze/Silver/Gold). Drive architectural decisions (integration patterns, dimensional models, API frameworks) and produce ADRs. Build secure, scalable source integrations across file, database, and API endpoints. Develop robust batch + incremental ELT/ETL...

London - 1 or 2 days per week onsite - City of London 6 months contract £570 per day - Outside IR35 Senior Application Developer London - Hybrid working (1 - 2 day per week office visit required) 6 months contract - £570 per day - Outside IR35 About the Role We are looking for a Senior Application Developer to design and build a robust PostgreSQL-based data platform that will underpin our investment reporting, risk analytics, regulatory disclosures and performance measurement. This is a genuinely high-impact, greenfield opportunity. You will have real ownership of the platform design and lead the migration away from Databricks and Excel-driven processes - leaving a lasting mark on infrastructure that sits at the heart of our investment operations. What You'll Be Doing You will lead the design and build of a scalable, secure PostgreSQL data platform to support: Portfolio holdings and valuations Performance and attribution reporting Risk analytics...

All our office locations considered: Newbury, Reading, London, Liverpool, Glasgow (UK); xc5 xa0ibenik, Croatia (considered) We 're on the hunt for builders No, we 've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as telecoms, insurance, finance and mortgages. First and foremost we seek strong Consultants; so if you are ready to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We 're Intuita - a fast growing consultancy that 's making waves in both the consultancy and technology space. With our ambitious goals for the year ahead and beyond, we are looking for talented individuals to...

Sibling is seeking a Freelance Data Engineer to architect a green-energy analytics platform. This is a hands-on, high-scale role focused on processing global telemetry data. Bio Architect & Code: Build robust, scalable ETL pipelines using PySpark and Databricks. Optimize: Refactor existing Spark jobs for maximum performance and cost-efficiency. Integrate: Deploy production-grade solutions within Azure (Unity Catalog, Delta Lake). Collaborate: Act as the technical bridge between Data Science and Business stakeholders. Expertise: Deep, recent experience in PySpark and large-scale Databricks environments. Cloud: Strong Azure experience (ADF, ADLS Gen2). DevOps: Proven track record with CI/CD, Git, and data engineering best practices. Compliance: Must have the Right to Work in the UK (No sponsorship available). Contract Details: Rate: Competitive Market Day Rate. Timeline: Kick-off in April, running through year-end. Assessment: Confirmed Outside...

Data Engineer Outside IR35 £450 - £500 6 months Hybrid London We're supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You'll be responsible for developing the code that drives their data pipelines, using Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end-to-end processing. Deliver new technical features and components aligned to approved solution designs and business requirements. Enhance, extend, and tune existing data frameworks to support additional use cases and improved performance. Create, manage, and optimise Databricks Workflows , including orchestration logic and operational behaviours. Carry out testing, performance tuning, and provide day-to-day operational support for data pipelines. Work...

Data Engineer - ADF I am looking for an experienced Data Engineer to join a complex, enterprise-level organisation on an initial 6-month contract. You'll play a key role in designing, building and optimising scalable data solutions within a modern cloud environment. Key experience required: * Azure Data Factory * Azure SQL * Snowflake * DBT * Strong data modelling expertise You'll be comfortable working in complex environments, shaping robust data architectures and delivering high-quality, reliable data pipelines. Fully remote Must be UK-based Outside IR35 If you're a seasoned contractor who can hit the ground running, I'd love to hear from you.

Data Engineer Tecknuovo is a digital delivery partner with a Deliberately Different approach. This means we focus on people, not technology. We move at pace and ensure Zero Dependency on us at the end of each project. Our mission is to challenge our industry's norm of supplier dependency. We don't only build and deliver solutions - we train and up-skill our customer's teams to transfer complete ownership to them after we exit the project. We help our customers achieve lasting transformation. We are Techies, chefs, wannabe sportsmen, coders, mothers, fathers, readers, superheroes, bookworms. What you'll be working towards We are currently looking to engage with Data Engineers on a large organisation project within the public sector. The successful candidate will have: AWS, AWS Glue, and S3 (Cloud) Python Gitlab, GitHub MLFlow *Please note this requires Active Security Clearance* Your Journey : Passing the TeckBar The Teckbar is a benchmark we set...

Snowflake Data Engineer - Outside IR35 - Remote About the Role We are seeking a highly skilled Snowflake Data Enginee r to design, build, and optimize scalable data solutions on the Snowflake cloud data platform. You will play a critical role in developing data pipelines, ensuring data integrity, and enabling advanced analytics and business intelligence across the organization. This role requires strong expertise in Snowflake Inc . , modern cloud ecosystems, and data warehousing best practices. Key Responsibilities Design, develop, and maintain scalable data pipelines and ELT processes using Snowflake Build and optimize data models (star schema, snowflake schema, dimensional modeling) Implement data ingestion frameworks from structured and unstructured data sources Optimize performance through clustering, partitioning, and query tuning Develop and maintain data quality and validation frameworks Integrate...

Data Engineer | Outside IR35 | £450 - £500 | 6 months | Hybrid London We’re supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You’ll be responsible for developing the code that drives their data pipelines, using Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end‑to‑end processing. Deliver new technical features and components aligned to approved solution designs and business requirements. Enhance, extend, and tune existing data frameworks to support additional use cases and improved performance. Create, manage, and optimise Databricks Workflows , including orchestration logic and operational behaviours. Carry out testing, performance tuning, and provide day‑to‑day operational support for data...

Join a global data team at a leading brand where your leadership will drive high-priority projects that put data at the heart of business transformation. Salary: £550 - 600 per day Data Engineer, Team Lead – Contract 3 month contract – outside IR35 This role will sit within a global data team for a large brand, and will service multiple high priority projects across a portfolio, with data at the heart of it. You'll bring significant long-term experience in data engineering and project team leadership. You will need experience working across operational relational databases and analytics data platforms. They require an experienced individual comfortable working in a dynamic, fast-paced environment. You will have the opportunity to adapt your approach as project demands and opportunities vary. Key Responsibilities: Leading a small project team of 3-4 data engineers, supporting with daily activities, code reviews, driving standards and best practices Contribute to...

Data Engineer | Outside IR35 | £450 - £500 | 6 months | Hybrid London We’re supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You’ll be responsible for developing the code that drives their data pipelines, using Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end‑to‑end processing. Deliver new technical features and components aligned to approved solution designs and business requirements. Enhance, extend, and tune existing data frameworks to support additional use cases and improved performance. Create, manage, and optimise Databricks Workflows , including orchestration logic and operational behaviours. Carry out testing, performance tuning, and provide day‑to‑day operational support for...

Data Engineer - AWS Redshift - 4 months, remote, to £500 p/d outside IR35 A Data Engineer is required to work on the migration of data from a 3rd party CRM into AWS Redshift. You will have extensive data engineering experience and have migrated data, ETL pipelines into AWS Redshift. You will have good knowledge of SQL, Python, Power BI and data analytics with strong communication skills. The role will involve working as part of a small team, liaising with the 3rd party supplier, migrating data, data pipelines into AWS redshift and training the team in Redshift. As a Data Engineer you will have the following: Data engineering AWS Redshift Data lake Data bricks Data ETL pipelines SQL Python Power BI Data analytics Excellent communication skills 4 months initially. Data Engineer, Datawarehouse Developer, BI Developer, data warehouse, business intelligence, MI, management information, AWS, Amazon Web Services, Redshift, Red shift, SQL, SQL Server,...

Data Engineer | Outside IR35 | £450 - £500 | 6 months | Hybrid London We're supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You'll be responsible for developing the code that drives their data pipelines, using Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end to end processing. Deliver new technical features and components aligned to approved solution designs and business requirements. Enhance, extend, and tune existing data frameworks to support additional use cases and improved performance. Create, manage, and optimise Databricks Workflows , including orchestration logic and operational behaviours. Carry out testing, performance tuning, and provide day to day operational support for data...

Data Engineer | Outside IR35 | £450 - £500 | 6 months | Hybrid London We're supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You'll be responsible for developing the code that drives their data pipelines, using Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end-to-end processing. Deliver new technical features and components aligned to approved solution designs and business requirements. Enhance, extend, and tune existing data frameworks to support additional use cases and improved performance. Create, manage, and optimise Databricks Workflows , including orchestration logic and operational behaviours. Carry out testing, performance tuning, and provide day-to-day...

Databricks Data Engineer £500 - £550 per day Outside IR35 We 're partnering with a leading online retail company that 's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create personalised journeys for millions of shoppers worldwide. The Role As a Senior Data Engineer, you 'll play a key role in developing and optimising the backbone of the company 's data platform. You 'll be responsible for building and maintaining large-scale, real-time data pipelines that power analytics, machine learning, and operational systems across the business. You 'll collaborate with software engineers, data scientists, and analytics teams to ensure the platform delivers reliable, high-quality, and compliant data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture...

Data Engineer l Informatica l Data governance l SQL Database l Databricks l Stakeholder management l integration l Financial Services I £500- £525 per day | Outside IR35 | 3-6-month initial | Hybrid Remote - London One of my consulting partners is kicking off a major data governance and integration programme for a leading insurance client, and we 're looking for three strong Data Engineers with deep experience implementing and optimising Informatica solutions end-to-end from both on prem and cloud systems. Core Skills Required Extensive Informatica experience (IICS / PowerCenter / IDMC) across design, build, integration, and deployment Strong background in Data Governance , including: Enterprise metadata management Data lineage setup and optimisation Data quality rules, profiling, and stewardship workflows Policy framework implementation Governance operating model support Experience working with Informatica...

🚀 Senior Data Engineer – Storage Optimisation Engagement 🚀 📍London (Hybrid) 📅 Starting ASAP for an initial 8 week engagement 💰 Outside IR35 - rate depending on experience We’re supporting a client looking for a Senior Data Engineer to lead a short-term, high-impact storage optimisation engagement within an ML-heavy environment. This is not a generic BAU role – it’s a focused piece of work with clear deliverables, governance ownership and measurable impact. 🔑 The Role • Assess large-scale storage usage across ML data prep, training and experimentation • Design and execute structured clean-up & optimisation strategies • Implement retention policies and lifecycle governance • Reduce reliance on manual storage management • Deliver a high-level data engineering roadmap • You’ll work closely with ML and Infrastructure engineers, mapping workflows and introducing sustainable improvements. 🎯 We’re looking for someone who: 👉 Has strong...