Role: Data Test Engineer - Automation & Manual
Location: London
Status: Outside IR35
Clearance: VALID SC CLEARANCE IS MANDATORY.
Rate: Neg
Duration: Initial 3 months (Extensions due)
Overview
We are looking for an experienced Data Test Engineer to support the testing and quality assurance of a modern Data Lakehouse environment and associated data products.
The role will focus on building scalable automated testing across data pipelines while also carrying out hands-on manual and exploratory testing. You will act as the quality gate between engineering and UAT, ensuring data products are accurate, reliable and ready for business validation.
The Role
You will:
Design and develop reusable automated data-testing frameworks, scripts and pipelines.
Test data pipelines and ETL/ELT processes across ingestion, transformation and curated/modelled layers.
Automate testing for schema validation, reconciliation, completeness, transformation logic, data quality and integrity.
Validate data across Lakehouse and Medallion Architecture layers.
Own System Integration Testing (SIT), end-to-end and regression testing prior to UAT.
Reconcile data from source through transformation to the final data product.
Carry out manual and exploratory testing where required.
Validate calculations, business rules, functionality and outputs against requirements.
Identify, document and manage defects through remediation and retesting.
Work closely with Data Engineers, Architects, Product teams and business stakeholders.
Essential Experience
Strong background in Data Testing, covering both automation and manual testing.
Experience building automated data-testing frameworks/scripts.
Strong ETL/ELT and data pipeline testing experience.
Good understanding of Data Lakehouse and Medallion architectures.
Strong data interrogation, validation and reconciliation skills.
Experience testing schema, transformations, data quality, completeness and integrity.
Strong experience with SIT, E2E testing, regression testing and defect management.
Experience testing complete data products against business, functional and technical requirements.
Comfortable working within Agile data/engineering environments.
Outside Spy discovers all the Outside IR35 IT contract opportunities for members.