£400 - £500 per day
Outside Spy
Remote (United Kingdom, Remote, Home based)
Data Engineer/Data Engineering/Azure/Databricks/Ingestion/Pipelines/API/Azure API Management (APIM)/Python/3-month contract/Outside IR35/Fully remote/£400 - 500 per day. One of our leading clients is looking to recruit a Data Engineer. Location - Remote/home based/WFH Duration - Initial 3 month Day Rate - £400-500 per day Outside IR35 Role/Responsibilities: Define and build a data lake architecture on Azure (ADLS + Databricks) Layered data model (bronze/silver/gold) for ingestion, processing, and reporting Develop ingestion patterns from API sources (batch and streaming) Establish data governance, metadata, and access controls Define storage structures, naming conventions, and schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and...