Outside Spy
Remote (Remote , UK)
Data Engineer - Outside IR35 Contract - SC Cleared - Remote working Digital Skills are working with a client that is in need of a skilled and experienced Data Engineer, who will help lead the development of secure batch/Real Time data platforms leveraging the latest commercial and open-source technologies. This involves getting data from various sources, getting it into the right format, assuring alignment to target models, and ensuring that users can get the data quickly for analysis. For this role, the successful candidate must have SC clearance that is currently active. Responsibilities Create and maintain optimal data pipeline architecture Write unit/integration tests, contribute to documentation via collaboration tools, eg Confluence and SharePoint Conduct logical and physical database design Conduct data analysis, identifying feasible solutions and enhancements to data processing challenges Ensures that data models are consistent with the data...