Outside Spy
United Kingdom
Job Title: Contract Data Engineer - SC Cleared Location: UK Remote Duration: 6 months Day rate: Competitive market rate - Outside IR35 Responsibilities Design, build and maintain scalable data pipelines on AWS Develop and orchestrate workflows using Airflow (or Prefect) Ingest, transform and model data so it is reliable and ready for analytics and machine learning Work with data scientists to support ML and computer vision workloads, including model training and tracking pipelines Write clean, tested, production-grade Python and SQL Work with DevOps Engineers on deploying pipelines into a Kubernetes and Terraform environment Follow secure engineering practices suitable for a government programme Requirements Active SC Clearance (essential) British Citizenship (essential, due to the secure nature of the project) Strong commercial experience as a Data Engineer Advanced Python and SQL Pipeline orchestration with Airflow or Prefect Hands-on experience...