When will the #TeamSnowden newspapers admit to using the same spying tools as the spooks at the NSA and GCHQ?

Power – wielded by government spooks or corporate surveillance specialists focused on us -- can be addictive - ‘Willy Bonkers,’ Marzia Faggin, 2011

Power – wielded by technology giants, NSA spooks or media surveillance specialists with sights trained on us — can be addictive
– ‘Willy Bonkers,’ Marzia Faggin, 2013

John Naughton http://memex.naughtons.org/

John Naughton

We offer, in this entry, links that will let readers draw their own conclusions about our belief that the Guardian and New York Times should soon supply full disclosures of their own use of Hadoop, the ‘spying tool’ that the UK and US secret services have been using in so-called ‘mass surveillance’. They must do no less if they wish to hang on to their reputations as great newspapers.

To put the Snowden leaks in proper context, the reporting and editorialising on them should have been shaped by John Naughton – who is not only the technology columnist for the Guardian’s sister-newspaper, The Observer, but an electrical engineer, vice-president of a Cambridge college, and emeritus professor for ‘the public understanding of technology’ at Britain’s Open University. As long ago as last July, he had a small blue fit about media coverage of the Snowden saga – in a column well worth reading, beyond these extracts:

Repeat after me: Edward Snowden is not the story. The story is what he has revealed about the hidden wiring of our networked world. […] This insight seems to have escaped most of the world’s mainstream media […] The obvious explanations are: incorrigible ignorance; the imperative to personalise stories; or gullibility in swallowing US government spin, which brands Snowden as a spy rather than a whistleblower. […] No US-based internet company can be trusted to protect our privacy or data. The fact is that Google, Facebook, Yahoo, Amazon, Apple and Microsoft are all integral components of the US cyber-surveillance system.

We discovered his six month-old protest in a happy accident in which it came up with search terms we used in searching for our last post-Gutenberg entry. Reader, our eyes popped. How, we wondered, had The Guardian not merely buried what Naughton had to say – full fathom five — but marched on with personalising and puffing up the story to such a degree that …

• the technology giants got left out entirely as inventors, enablers and co-operators in surveillance

• newspapers using the identical surveillance techniques conveniently hid this fact behind the Snowden uproar they manufactured

How did The Guardian justify to its conscience avoiding any mention in editorials or reports on Snowden/NSA/GCHQ that in 2011, it actually gave Hadoop, the most powerful surveillance tool – the subject of last week’s post here – a coveted techie award? Curious readers should look up this record in that newspaper’s archive of technology coverage:

Apache Hadoop takes top prize at Media Guardian Innovation Awards

How was conferring that honour explained by the Guardian reporter, Marie Winckler? She quoted one of the software architects responsible for Hadoop: ‘Apache Hadoop pushes data management forward by empowering enterprises to make sense of their increasingly large and diverse collections of data.’ One of the first commenters on this asked sardonically, ‘So what does it do, translated from corporate-speak?’

Ah! He could have found the answer in a 2009 story in the technology section of The New York Times – also a heavy user of Hadoop, and The Guardian’s publishing partner and co-generator of the Snowden hullabaloo. These sections of the piece explained why newspapers find Hadoop so handy for studying their readers, when we click on their sites:

The core concepts behind the software were nurtured at Google.

[…]

[Hadoop] opened the possibility of asking a question about Google’s data — like what did all the people search for before they searched for BMW — and it began ascertaining more and more about the relationships between groups of Web sites, pictures and documents.

Some readers will be scratching their heads, by this point – thinking, but isn’t uncovering patterns and interconnections like these in our web searches and private behaviour  on the net the reason why Edward Snowden sentenced UK and US government spooks to the naughty corner? Yes indeed. This 2009 article in the computer magazine Infoworld answers a few more questions:

What’s the New York Times doing with Hadoop?’: A Times software engineer talks about how Hadoop is driving business innovation at the newspaper and Web site

Just innovating for commerce, then, nothing so disgusting as spying … Well, not exactly. Here is what the incredulous reader must study next – even if the verbing of the noun ‘surveillance’ brings on an attack of hives :

How The Guardian is Quietly and Repeatedly Spying on You

It was almost shocking when I first installed a browser add-on called Ghostery and began to click on various articles at The Guardian. With each click, I discovered that this news publication, which has been primarily tasked with reporting on Edward Snowden and top secret surveillance operations conducted by the National Security Agency, has been surveilling its own readers.

[T]hese publications, while taking on the pious, sanctimonious role of privacy purists, are using multiple third party resources to collect detailed information about nearly every visitor who reads one of the various posts about how the use of digital technology should be a completely private affair. … [ … continues …]

Zounds! At last print, led by The New York Review of Books, picks up the real surveillance story: the NSA and GCHQ spooks are followers, not leaders

24/7 surveillance: eyes, cameras, mirrors … cameras in and behind mirrors? - postgutenberg[at]gmail.com

24/7 surveillance: eyes, cameras, mirrors, clear and fuzzy views … cameras in and behind mirrors?
– postgutenberg[at]gmail.com

Not for ages has there been a pudding quite as over-egged as the one presented as the news story of 2013 – the Orwellian mass surveillance exposé which, as it unravels, shows the UK and US governments hardly initiating nonstop monitoring but, rather, striving to keep up with companies like Facebook, Apple, Microsoft and Google in gathering intimate information about us and watching what we do.

Why are you learning about this on a blog, not on the front page of any well-known newspaper? Because any dissenting voices in the new ‘participatory media’ – the blogosphere, online-only journals, social networking sites and other evolving sources of facts – are still drowned out by the megaphones of the brand names at the top of the old media pyramid, names we were brought up to revere. Until those amplifiers are shared through a formal restructuring of media ownership and operation – which could be a long wait — correcting misguided and misleading information will tend to be maddeningly slow, no matter how big the story.

Two of the finest of the old guard, The Guardian and The New York Times, have yet to give any sign of noticing the shifting narrative about surveillance. This is unsurprising. They love the attention they have won from pinning Big-Brother-run-amok behaviour exclusively on the UK and US governments, and the hailstorms of congratulations from commenters and colleagues in other parts of the media that they unwittingly led astray. Both newspapers chose – apparently without much critical thinking – to gratify Edward Snowden’s wish to be fêted as a hero for torrential leaking of extremely sensitive information related to national security. 

The clearest de-bunking of the myth constructed from the Snowden leaks has come from The New York Review of Books – it so happens, after someone at post-Gutenberg wrote late last November to two editors on that publication, the editor-in-chief, Robert Silvers, and the one in charge of covering technology. The email was not about mass surveillance. But it did include a link to this blog when our home page displayed more than one post deconstructing the souped-up hullabaloo with our usual careful citations, and pointing to corporate technology giants as the round-the-clock watchers we should really be worrying about – even if the NSA appears to have outdone them in spying techniques (see yesterday’s ‘N.S.A. Devises Radio Pathway Into Computers’ in the NY Times).

In the week in which we communicated with that rightly esteemed publication, the NYRB’s contribution to the discussion was ‘The NSA’s Threat to Global Free Speech,’  to be followed shortly by ‘The Snowden Leaks and the Public,’ and ‘The NSA on Trial’. In fact, searching on ‘NSA and NYRB’ brings up a first page of Google links to articles in that publication last year all singing the same tune as The Guardian and The New York Times.

Then came an abrupt switch in direction. … Was it a mere coincidence that last week, about six weeks after the NYRB received a web address for post-Gutenberg — and roughly as long as it takes a publication as methodical as that Review to put together a report — its site featured a piece titled, ‘How Your Data Are Being Deeply Mined’, beginning,

The recent revelations regarding the NSA’s collection of the personal information and the digital activities of millions of people across the world have attracted immense attention and public concern. But there are equally troubling and equally opaque systems run by advertising, marketing, and data-mining firms that are far less known. Using techniques ranging from supermarket loyalty cards to targeted advertising on Facebook, private companies systematically collect very personal information, from who you are, to what you do, to what you buy. Data about your online and offline behavior are combined, analyzed, and sold to marketers, corporations, governments, and even criminals. The scope of this collection, aggregation, and brokering of information is similar to, if not larger than, that of the NSA, yet it is almost entirely unregulated and many of the activities of data-mining and digital marketing firms are not publicly known at all.

Compare that with part of our own offering on the subject, in the week we wrote to the NYRB,  titled, ‘In the shift “from God to Google” do we want our spooks stuck in the age of typewriters …?’:

The Guardian – railing ad nauseam about spooks — is oddly tongue-tied about corporate surveillance. The explanation for this is surely the potential embarrassment of having to admit the true extent of the newspaper’s own monitoring of its readers’ behaviour.

[…]

Onora O’Neill, a down-to-earth philosopher — specialising in justice, public trust and accountability – who is also a member of the House of Lords (Baroness O’Neill of Bengarve) commendably unaffiliated to any political party, is one of the few sounding this particular alarm. ‘Insofar as [government spies at the NSA and GCHQ] collect content, I might be … worried,’ she said recently, ‘but by the same token I would worry equally about Facebook, who collect content, and in particular a lot of personal content.’

The NYRB added, in the same report on data mining:

[W]e may be more concerned with government surveillance than with marketers or data brokers collecting personal information, but this ignores the fact that the government regularly purchases data from these companies. ChoicePoint, now owned by Elsevier, was an enormous data aggregator that combined personal data extracted from public and private databases, including Social Security numbers, credit reports, and criminal records. It maintained 17 billion records on businesses and individuals, which it sold to approximately 100,000 clients, including thirty-five government agencies and seven thousand federal, state, and local law enforcement agencies.

Again, compare that with a point made here earlier. Last September, this blog warned that the blinkers needed to come off too many commentators on the NSA and Britain’s GCHQ – to let them appreciate that we should be protesting not just about spooks but anyone amassing personal data about us. In an entry about reader-commenters on newspaper sites correcting the unbalanced coverage of mass surveillance, we said:

Stores of information, once they are gathered, can acquire new owners. 

By the end of 2013, when the Guardian and New York Times were running editorials campaigning for the virtual canonisation of Snowden, the Guardian’s commendably independent-minded sister publication, The Observer, was changing tack in the same direction as the NYRB. The standfirst for an editorial there read: ‘Digital behemoths have perfected surveillance as a business model.’

Did the ‘digital behemoths’ scream in protest about that attack on nonstop surveillance as their ‘business model’? On 30 December, The Guardian, perhaps in sympathy with their plea – and conceivably worried about losing its own right to spy on readers, justified as market research — actually ran a blog post by an American academic, titled ‘The primary NSA issue isn’t privacy, it’s authority’:

[O]nce we say some amount of data is too much to have, then we will end up debating the line around too much knowledge and that is a line I never want to see drawn. If we start to say that bad things can happen merely if knowledge exists, then too soon we fall into the trap of controlling the extent of knowledge – who may know what and how much they may know and thus who may say what to whom.

Imagine how the spooks at the NSA and GCHQ must have smiled about reading that.

N.B.: As we post, The Guardian site has a lamentation by Senator John McCain about ‘overreach’ by the NSA. In a menu of other offerings in the right-hand column on the same page, there is this bit of clickbait: ‘US will not enter bilateral no-spy agreement with Germany … Despite assurance from Barack Obama, United States has not ruled out bugging political leaders’ calls, claims German paper.’

We somehow doubt that much of what the NSA or GCHQ do will change, after a crowd-calming interlude of more or less cosmetic modifications of their practices. Spies can no more stop spying with every available advance on James Bond’s arsenal of gadgetry than journalists can stop wheedling secrets out of sources with charm, or casinos discourage impulsive and compulsive gambling, or prostitutes start dressing like nuns …