We initiated our Open Data project in early 2023 to align with Ofgem’s data best practices and improve access to our data sources.
Creating a metadata catalogue and roles matrix
To start our work, we gained a comprehensive understanding of all the data that falls under RECCo’s control. We created a metadata catalogue containing detailed information about this data, including its source (such as the EES, GES, RPA Reports, etc.). We also created a roles and responsibilities matrix identifying the metadata owner, data controller, and data processor. While RECCo typically assumes the role of metadata owner and data controller, there are instances where other code bodies hold this responsibility.
Enhancing accessibility through classification
Our metadata catalogue provides in-depth descriptions of each data item and its classification based on our model. We have categorised data into four categories: “Always Open,” indicating unrestricted sharing; “Conditionally Open,” allowing sharing with stipulated conditions; “Personal,” permitting sharing with appropriate consent; and “Restricted,” barring sharing except under exceptional circumstances.
Key progress
In the summer of 2023, we published two papers: “Open Data Review” and “Consumer Consent: Consumer-focused Findings.” Since then, we have been working on two REC Change Proposals. The first proposal, R0118, simplified the data access request process and enabled REC data to be expanded to new user groups for new valid purposes. This proposal went live in December 2023.
The second proposal, R0148, proposes introducing classification-based access. This will allow data items classified as ‘Always Open’ to be made widely available without restriction while ensuring appropriate controls on data items, where required, to ensure the fair application of data protection regulations. This proposal recently completed the consultation phase, and we are currently reviewing the responses. The team is also working on analysing the options for the best solution to make the ‘Always Open’ data items easily available.
Our next steps
Looking ahead, pending approval of R0118, we plan to implement the process for approving data requests based on classification. We also plan to implement a technical solution that ensures unrestricted access to ‘Always Open’ data items. We will then look at other REC-controlled data sets to see how these can be shared more easily.
We were pleased to see the recent Ofgem Call for Input: Data Sharing in a Digital Future, as we have worked closely with Ofgem since our Open Data project started. We remain committed to sharing our progress and insights with Ofgem and the industry so we can work towards improved data transparency and accessibility in the retail energy market.
