Data Engineer at Public Sector, Scotland, £425-£450 per day

£425 - £450 per day
Duration not stated Information Technology

Contract Description

* 6 month contract within the public sector
* Hybrid working - Occasional travel to Scotland
* £450 per day outside IR35


Data Engineer

Our public sector client is looking for a Data Engineer to join them in the process of creating a new Data Warehouse to enhance the data analytics capability and ensure robust data governance and data management.

You will be involved in the collaborative development of internal casework-profiling solutions using data extraction & processing techniques applied to semi-structured and unstructured documents and forms. You will also be expected to deliver robust and resilient data integration solutions and automation of data products and services to ensure that the Data Warehouse is fit-for-purpose.

Skills and Experience

Significant commercial experience with the following technology:
* Python
* PostgreSQL
* REST APIs
* Modern DevOps and CI/CD practices and tooling including Docker, GitLab CI, AWS CodePipeline, AWS CDK and AWS CloudFormation
* Expertise in SQL, data transformation and analysis
* Delivering high quality software collaboratively in high-performing, cross-functional development teams.
* Experience implementing data ETLs, data streaming systems and data integration solutions
* Experience working in the Agile delivery models - such as Scrum and/or Kanban frameworks.
* Developing within Digital First or GDS quality standards
* Data warehousing
* Hybrid on-premises/cloud solutions
* AWS Glue, Step Functions, Lambda functions, S3, RDS, Data Migration Service

Day to Day

Develop solutions to streamline the production of customer data products and reports

Assist in activities to migrate data processes from on-prem to AWS cloud

Contribute to the development and delivery of resilient solutions to integrate corporate data into the RoS data warehouse

Support the delivery of ongoing data engineering activities

Ensure technical resiliency of all data integration solutions and services

Support the delivery of ongoing data engineering activities

Enhance and support existing data product outputs for both internal and external customers.

Next Steps

If you are interested in finding out more about this role, please apply with your up to date CV and I will endeavour to get back to you.

Talent International UK Limited and it's subsidary Rethink Digital Gurus Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this opportunity, you accept the T&C's, Privacy Policy and Disclaimers which can be found at talentinternational.co.uk