Outside Spy
London, UK
SC Cleared Data Engineer Outside IR35 London 3 months Initially SR2 have partnered with a public sector focused consultancy who are looking to hire an SC Cleared Data Engineer for a long term project within the central government. This role requires a deep understanding of Data Enigineering best practices and expertise with AWS, Apache Spark, datawarehousing, data modelling and SQL. You will play a critical role in designing, building and maintaining our data infrastructure to support, high-performance datapipelines and analytical platforms. Key Responsibilities: Design and build scalable, secure data pipelines using AWS and Apache Spark Develop and optimise data models and datasets for analytics using Redshift and other cloud data platforms Collaborate with analysts, data scientists, and business teams to translate data requirements into clean, validated datasets Monitor and improve ETL/ELT workflows, ensuring data quality and performance Champion best practices...