Title: Data Quality Engineer
Rate: Neg
Location: Remote - occasional office travel in London
Duration: 5 months (extension likely)
IR35: Outside IR35
Clearance: YOU MUST HOLD ACTIVE SC CLEARANCE USED WITHIN LAST 12 MONTHS
This is a specialist Data Quality role, not a general Data Engineering position. Applicants must have demonstrable hands-on Data Quality experience.
We are seeking an experienced Data Quality Engineer with strong Python and SQL skills and proven experience implementing Data Quality frameworks, rules and automated controls within cloud-based data environments.
Key Responsibilities
Identify and prioritise Critical Data Elements (CDEs), including associated data models and quality metrics.
Perform data profiling to identify anomalies, inconsistencies and quality issues.
Translate business requirements into technical Data Quality rules and validation checks.
Define and configure DQ thresholds, tolerances and automated controls.
Develop Python and SQL-based Data Quality checks across data pipelines.
Support dbt transformations, testing and documentation, alongside Airflow scheduling and orchestration.
Develop DQ monitoring, dashboards and reporting capabilities.
Investigate Data Quality issues, identify root causes and support remediation.
Essential Experience
Strong hands-on Python and SQL.
Proven experience in Data Quality profiling, rule definition, validation and automated controls.
Experience with Critical Data Elements, DQ metrics, tolerances and issue management.
Ability to translate business Data Quality requirements into technical solutions.
Experience working with cloud-based data platforms and ETL/ELT pipelines.
dbt and Apache Airflow.
AWS (S3, Athena, Glue).
Data Quality dashboards and reporting.
Data governance, metadata management and data lineage.
Outside Spy discovers all the Outside IR35 IT contract opportunities for members.