Category Archives: Tips and tricks

Help Me Investigate’s first ebook: 8,000 Holes: How the 2012 Olympic Torch Relay Lost its Way

As the Olympic Torch Relay enters its final week Help Me Investigate has published our first ebook: 8,000 Holes: How the 2012 Olympic Torch Relay Lost its Way.

The book details how exactly the 8,000 torchbearer places were allocated – and how that process made it impossible for Olympic torch relay organisers LOCOG to meet key promises about the numbers of places available to the public, and to young people.

It builds on the work done over the past few weeks by users of HMI Olympics – and adds some new revelations alongside interviews that provide an insight into how the process affected those involved.

It’s free at https://leanpub.com/8000holes – or you can choose to pay whatever you like, with all proceeds going to the Brittle Bone Society.

Can you help? Crowdsourcing mystery torchbearers with The Guardian

Yesterday we published a spreadsheet?on The Guardian's Datablog?of?500 torchbearers running without a story.?Want to help investigate??

There are plenty of curious names in there alongside the sporting stars, celebs and genuine community heroes – including a recurring appearance of the names of telecomms execs.

There are tips on tracing people here?and a?selection of those with images?if you want to pitch in and help us clear up all 500. We're already a third of the way there.?

You'll find the spreadsheet here.

To get access, post a comment, tweet @HMIolympics or email paul at helpmeinvestigate.com

More on how we investigated Olympic sponsor torchbearers

I've written a piece for the Telegraph about the process behind our investigation on Help Me Investigate the Olympics. This expands on some of the details in a previous post for The Guardian, adding how the collaborative publishing process contributed to the investigation.?

The investigation continues, with our most recent story being broken on BBC Radio WM. If you want to get involved let me know.

How we investigated Olympic sponsor torchbearers

Details unearthed by the ongoing investigation have been picked up by a range of national and local newspapers and broadcast outlets.?

We are still unearthing leads, so if you want to get involved let me know.

A search engine for data from FOI responses

Tony Hirst?has created two basic tools that allow you to search for data supplied in response to FOI requests: this search tool for local councils; and this one for universities?(ignore the word 'council' – it's an error).

The data is limited to requests made via WhatDoTheyKnow (which accounts for around 10% of FOI requests) and responses with spreadsheets attached (rather than PDFs, for example) – but it's still a useful tool.

His?post about his experiment?provides more detail, including possible further developments:

"It strikes me that if I crawled the response pages, I could build my own index of data files, catalogued according to FOI request titles, in effect generating a ?fake? data.gov.uk or data.ac.uk opendata catalogue as powered by FOI requests?? (What would be really handy in the local council requests would be if the responses were tagged with with appropriate?LGSL code or IPSV terms?(indexing on the way out) as a form of useful public metadata that can help put the FOI released data to work??)
"Insofar as the requests may or may not be useful as signaling particular topic areas as good candidates as ?standard? open data releases, I still need to do some text analysis on the request titles.
"[…] PS via a post on HelpMeInvestigate, I came across this list of?FOI responses to requests made to the NHS Prescription Pricing Division. From a quick skim, some of the responses have ?data? file attachments, though in the form of PDFs rather than spreadsheets/CSV. However, it would be possible to scrape the pages to at least identify ones that do have attachments (which is a clue they may contain data sets?)"

“Public Business: A new way of supporting public interest journalism” – Maha Rafi Atal at Hacks/Hackers London

Maha Rafi Atal started her talk at Hacks/Hackers London by describing the cognitive dissonance of studying to be a business journalist, with the ethics and aspirations that involves, with the day-to-day reality of business journalism as it occurs in newsrooms.

Whilst the financial crisis was unfolding, she explained, at the time when the public most needed an understanding of what was happening, the ability for news organisations to do decent business coverage was contracting.

In part, she said, this is because it is a highly technical and specialised area of reporting, and journalists are no longer able to get the training they need in reading company reports or state finance predictions.

This is especially crucial when a story like financial collapse is moving from the specialist business pages into being the main splash of the day.

There is a skills gap at the intersections where stories might be involving both the business and the politics desk, or the business and the science desk.

She suggested that business reporting was uniquely conflicted. Unlike any other area of a news organisation, the business desk has to report directly on the very companies that are bankrolling the operation via advertising.

The drive for 24 hour digital news has increased everybody’s output to the extent that journalists have to rely on keeping contacts at big companies happy in order to be able to churn out the required number of stories a day, and the increasing scarcity of advertising dollars means it is now much harder for an organisation to run stories that might “burn” an advertising account with negative coverage. She described this as “the dual capture of journalists”.

Public Business started as a research project to try and find out these things about business journalism, and Maha said they rather naively fixed up interviews with editors, walked in knowing nothing, and basically asked “So why are you doing this all wrong then?” Which sounded somehow vaguely familiar to me.

The premise now is that people can apply to Public Business for funding to support investigative business journalism, or projects that are too costly or time-consuming for a newsroom to undertake.

They are also building a platform to encourage collaboration between journalists and academic researchers.

Maha made the point that people had actually spotted that the housing crash was coming, or the off-shore drilling by a particular company was a disaster waiting to happen, but that often these claims were based on research that didn’t get published until it was issued as a mighty academic tome two years later that no journalist was ever going to read beyond the abstract anyway.

The idea is that people receiving grants from Public Business will do their journalistic endeavours on the platform, making that available for researchers to collaborate – it sounds something like Help Me Investigate but with a specific focus on business reporting.

Maha Rafi Atal was very passionate that decent reporting of the financial sector was a vital public service. “We are all investors now” she said, pointing out that anyone with a pension, whether they actively manage it or not, effectively owns a basket of shares in companies. There is a duty to help people understand that.

Maha finished with an appeal for donations, and, since this was Hacks/Hackers an appeal for developers to help work on the platform side of the service. You can contact Public Business via Twitter – @publicbusiness – or on email: publicbusinessmedia@gmail.com.

This blog post is cross-posted from currybetdotnet – “Supporting public interest business journalism” – Maha Rafi Atal at Hacks/Hackers London