£750 - £825 per day
Outside Spy
Remote (United Kingdom)
Lead Data Engineer - AWS - Python - SQL - SC Eligible Lead Data Engineer - AWS - Python - SQL - SC Eligible requirement for an urgent start. The Lead Data Engineer - AWS - Python - SQL - SC Eligible will be leading a public sector Data Programme. The Role: Leading and line managing a team of data engineers, and growing their skills through pairing, review and coaching Designing how new source systems are integrated into the platform, from batch database extracts to API feeds Setting engineering standards for testing, CI/CD, documentation and data quality, and making sure they're followed Making architecture decisions across S3, Athena, Glue, Iceberg, dbt and Airflow, and writing them down so others can follow the reasoning Owning infrastructure as code in Terraform and keeping deployments repeatable Agreeing scope, priorities and delivery dates with product owners, system owners and senior data users Replacing manual or fragile pipelines with automated ones...