4 March 2014 — The Register
‘Pseudonymised’ data mapped, stored in Google BigQuery, sparking offshore data panic
The UK’s National Health Service (NHS) and the NHS Information Centre are riding out a three-pronged privacy storm.
The first privacy incident starts with this PA Consulting document titled “Placing the patient at the centre of healthcare: PA report on the future of healthcare.”
On page eight, a section titled “The cloud can transform the way the NHS connects and uses data” the discussion turns to “an archive called Hospital Episode Statistics (HES)” that contains “a huge amount of detailed data” about the activity of “every Hospital in England.” The data set occupied a one-terabyte disk drive and as PA Consulting tried to ready it for analysis they found it “took several hours” just to load it into “a traditional Microsoft SQL database”.
In an attempt to hasten analysis of the document, here’s what happened next:
“The alternative was to upload it to the cloud using tools such as Google Storage and use BigQuery to extract data from it. As PA has an existing relationship with Google, we pursued this route (with appropriate approval). This showed that it is possible to get even sensitive data in the cloud and apply proper safeguards.”
The results of this approach were good, from a technical point of view at least. PA’s people report that “queries that took all night on our servers were returned in under 30 seconds using BigQuery” and “Within two weeks of starting to use the Google tools we were able to produce interactive maps directly from HES queries in seconds.”
Early this week, the PA Consulting document was brought to the attention of Sarah Wollaston, MP for Totnes, Brixham and the South Hams. Here’s her reaction to the news.
— Sarah Wollaston MP (@drwollastonmp) March 3, 2014
A privacy panic has ensued, with PA Consulting accused of sending personal data offshore and imperilling privacy.
The NHS Information Centre’s response to Wollaston came in this statement, which offers this explanation:
“The NHS Information Centre (NHS IC) signed an agreement to share pseudonymised Hospital Episodes Statistics data with PA Consulting in November 2011.
This included Hospital Episode Statistics on Admitted Patient Care (1999/00 to Provisional 2011/12), Outpatient (2003/4 to Provisional 2011/12) and A&E (2007/8 to Provisional 2011/12). This agreement lasted to November 2012 and was amended in December 2012 to extend to November 2015.
The agreement obliged PA Consulting to abide by conditions to protect the confidentiality of the data, including restricting the data to a named list of individuals, a prohibition on sharing any information with risk of identifying individuals and a requirement to destroy the data after the agreement end date.
PA Consulting used a product called Google BigQuery to manipulate the datasets provided and the NHS IC was aware of this. The NHS IC had written confirmation from PA Consulting prior to the agreement being signed that no Google staff would be able to access the data; access continued to be restricted to the individuals named in the data sharing agreement.”
The second incident has been highlighted by privacy group Medconfidential, which in this post leads users to claims made by geographical information systems and marketing outfit Beacon Dosdsworth to the effect that it can use HES data to “better understand the health needs of local communities and populations and identify trends and patterns in order to target health improvement more effectively.”
Beacon Dodsworth has updated the page we’ve linked to above with the following text:
“Following recent concerns regarding our access to HES data and its use in P2People & Places, we would like to clarify that we have never had direct access to the raw HES data.”
The third privacy incident concerns an outfit called Earthware that writes here that it created “a demo online map we had created to demonstrate how HES data might be displayed in a mapping environment.”
That map quickly earned the ire of the HSCIC, which asked for it to be taken down. Earthware did so and offered the following statement:
Earthware immediately withdrew this map from our website upon request from the HSCIC and popped out this statement.
“Earthware would like to clarify the following:
- The map displayed mock data held by a third party who provided this data to Earthware via a web API
- We do not hold nor have we ever held HES data on our servers
- No patient identifiable data was ever displayed on the map
Earthware are confident that we have not breached any legal or regulatory rules regarding the licencing or publication of HES data.
We will continue to co-operate fully with the HSCIC if required.”
The HSCIC has issued its own statement about the incident, writing “We are investigating urgently the source of the data used by Earthware UK and whether controls demanded of any organisation using data have been maintained. After this investigation we will take any necessary action.”
A busy time, then, for HSCIC’s spin doctors and a yet more evidence that health data is travelling rather further, and faster, than anyone imagined. ®