Outside Spy
Remote (United Kingdom)
Senior Data Engineer – AWS / Lakehouse Contract: 3 months | Fully Remote | Outside IR35 We are seeking an experienced Data Engineer for a three-month project delivering cloud-based data engineering and integration solutions. This is a hands-on role requiring strong AWS expertise , practical experience with Apache Iceberg and Apache Spark , and a solid understanding of unstructured data processing and integration patterns . You will work closely with technical and delivery teams to build reliable data pipelines, develop lakehouse capabilities and integrate data across systems. Key responsibilities Design, build and optimise data pipelines using AWS Glue, S3, Lambda and Apache Spark . Develop and maintain lakehouse solutions using Apache Iceberg , supporting efficient data ingestion, transformation and access. Build workflows for ingesting, processing and transforming unstructured data . Develop integrations using API Gateway, Lambda and...