Contract Outside IR35 Senior Data Engineer/Python/C# Developer - Energy Trading - London Up to £600 per day
*Only candidates with Power/Gas/LNG/Oil/Ags/Metals commercial experience will be considered*
Global Energy Trading company is embarking on a new Digitalisation Program, to transform how data is managed and utilised within the Energy business. The ambition is to deliver next generation of big data infrastructure, develop a range of data-driven, highly automated data pipelines to facilitate and enhance the trading business, as well as optimisation of physical assets.
Working together with the Data Team, you will be developing the next generation of Data Infrastructure. Working with data pipelines, data management, and data analysis to help automate and optimise business.
The role will require versatility as the individual will be required to work on Python and/or C# related projects in addition.
The role
- Develop, construct, test and maintain data pipelines (ETL/ELT)
- Design, implement and maintain data quality and assurance tools
- Perform data profiling, testing and monitoring
- Understand requirements from data owners and implement data quality KPIs and monitoring pipelines
- Operationalize data management policies and automate data governance KPIs
- Follow good data governance standards and help define data policies and processes
- Cleansing, Pre-Processing and delivery of data for prescriptive and predictive modelling
- Working with data scientists and data engineers to build out scalable models
- Develop Data visualisation and Business Intelligence dashboards
- Take ownership of the assigned projects, including understanding and gathering requirements, designing the solutions, building and maintaining completed industrialised solutions.
Your experience
- Established Data Engineering background with Energy/Commodities Trading (Power/Gas/LNG/Oil/Ags/Metals)
- Experience with creating and managing data pipelines within (ETL/ELT)
- Fluent in Python and/or C# programming
- Hands on experience with SQL
- Comfortable with Pandas and/or Spark Dataframes
- Experience with structured, semi-structured, and unstructured data
Beneficial
- Experienced using data testing frameworks
- Experience working with data lake technology