Unlocking Public Sector Data: Introducing Research Data Scotland’s New Researcher Access Service
Joahna Kuiper / Better Images of AI / Little data houses / CC-BY 4.0
Unlocking Public Sector Data: Introducing Research Data Scotland’s New Researcher Access Service
By Jennifer Campbell, Digital Delivery Lead, Research Data Scotland
on 22 May 2024
Research Data Scotland’s mission is to unlock the potential of public sector data for the benefit of public good. We work with other organisations in Scotland and the UK to build on, and transform, key aspects of the data research system.
One of the primary ways we’re doing this is through our new Researcher Access Service, which offers a faster and simpler way for researchers to apply for and gain access to public sector data for research in the public good. This service, which launched in April 2024, offers a streamlined, end-to-end digital route for researchers to apply for data access and seek approval via a simplified approvals process.
Initially, this new pathway offers access to nine datasets, which include some of the most commonly-used health data:
Outpatient Appointments and Attendances - Scottish Morbidity Record (SMR00): Jan 1997 onwards
General Acute Inpatient and Day Case - Scottish Morbidity Record (SMR01): April 1997 onwards
Maternity Inpatient and Day Case - Scottish Morbidity Record (SMR02): April 1997 onwards
Mental Health Inpatient and Day Case - Scottish Morbidity Record (SMR04): April 1997 onwards
Scottish Cancer Registry (SMR06): April 1997 onwards
Prescribing Information System (PIS): January 2015 onwards
Scotland Accident and Emergency: January 2011 onwards
National Records of Scotland (NRS) - Birth Registrations: 1981 onwards
National Records of Scotland (NRS) - Death Registrations: 2015 onwards
As we’ve taken an Agile approach to delivering the service, we’re deliberately starting small and building the service iteratively and incrementally based on user feedback. In future, we hope to expand the range and type of datasets available through the Researcher Access Service to make it even more valuable to researchers.
With our initial release of the Researcher Access Service, it’s been essential for us to balance simplicity with security; taking a risk-based approach to ensure proposed research receives the right level of scrutiny before data access is granted.
The AI Conundrum
As part of this, we’ve determined that at least for now, projects involving the use of AI tools shouldn’t go through this streamlined pathway as they are likely to be seen as higher risk and may not align with the risk appetite of data owners, or indeed the public.
But we also know that AI tools bring huge opportunities to speed up research and gain even more valuable insights from the data, and we don’t want to put any unnecessary barriers in the way. With that in mind, we’re keen to explore the ways in which AI may be used safely as part of research involving sensitive, individual-level data, specifically:
What do we mean when we say ‘AI’ in this context? What type of tools might be most useful?
When is it appropriate to allow the use of these tools? What conditions might need to be in place?
How might they be used in a way that is safe and doesn’t put anyone’s data at risk?
Who might have a view on the use of AI in public sector data research, including data owners, members of the public, public sector bodies and others?
We’ve also been conscious to ensure our technology choices are designed with the potential to introduce automation and AI tools to help streamline data application and access processes. The Researcher Access Service is built on a modern low-code platform that offers us the opportunity to utilise AI in order to improve workflow and reduce manual processing.
As we move forward with the development of the Researcher Access, we plan to engage with the research community and others to inform our approach in this area. If you’d like to be involved, please sign up to our Engagement contact list.
To stay updated with Research Data Scotland, subscribe to our mailing list and follow us on X (Twitter) and LinkedIn.