33 Comments

Summary:

There’s been a lot of chatter about the newspaper industry in recent weeks — about whether newspaper companies should find something like iTunes, or use micropayments as a way to charge people for the news, or sue Google, or all of the above — and how […]

There’s been a lot of chatter about the newspaper industry in recent weeks — about whether newspaper companies should find something like iTunes, or use micropayments as a way to charge people for the news, or sue Google, or all of the above — and how journalism is at risk because newspapers are dying. But there’s been very little discussion about something that has the potential to fundamentally change the way that newspapers function (or at least one newspaper in particular), and that is the release of the New York Times’ open API for news stories. The Times has talked about this project since last year sometime, and it has finally happened; as developer Derek Gottfrid describes on the Open blog, programmers and developers can now easily access 2.8 million news articles going back to 1981 (although they are only free back to 1987) and sort them based on 28 different tags, keywords and fields.

It’s possible that this kind of thing escapes the notice of traditional journalists because it involves programming, and terms like API (which stands for “application programming interface”), and is therefore not really journalism-related or even media-related, and can be understood only by nerds and geeks. But if there’s one thing that people like Adrian Holovaty (lead developer of Django and founder of Everyblock) have shown us, it is that broadly speaking, content — including the news — is just data, and if it is properly parsed and indexed it can become something quite incredible: a kind of proto-journalism, that can be formed and shaped in dozens or even hundreds of different ways.

Doing this with all of the various elements of the news — names, places, events, details — on a large enough basis can reveal hidden patterns or connections that might not only improve an existing story but lead to new and completely unexpected ones. At the moment, only the research departments of newspapers have the tools to do this, but opening up an API the way the New York Times has can put those tools into anyone’s hands, allowing them to pursue projects and avenues that newspaper reporters and researchers might never think of. And from the point of view of the Times as a media outlet and business, it turns the paper into a kind of platform for other services and features. That makes the paper and its content more valuable, and could lead to all kinds of commercial licensing possibilities and partnerships — not to mention being good marketing.

This kind of thinking is at the core of Jeff Jarvis’s book “What Would Google Do?” His main point is that virtually any business can benefit from thinking about making its data more open, allowing others to remix and manipulate it to see what comes out, and then taking advantage of what can be learned from those experiments. All the New York Times is doing is using its article database in the same way that Google uses its map database, or the Google Earth satellite-imagery database — as a foundation upon which other things can be built. The Times deserves kudos for pursuing such a open model rather than locking its articles up and trying to charge people for every view. I have no doubt that they will benefit far more from such an approach in the long run than would ever be possible with a pay-per-view strategy.

  1. Youshould google computer assisted reporting andjoin me at that org’s conference next month

    Share
  2. This is pretty amazing — turning a newspaper into an application service. But I’m a little surprised that it’s taken this venerable newspaper so long.

    Someone in the NY Times seems to have been thoughtful enough that they permitted Perl developers to work on and donate work done on the Perl module Devel::NYTProf (http://tinyurl.com/cm7b5r) back to the community. Yet it sounds like all upper management could do about their decline of dead tree readership was to blame the Internet.

    It’s a business approach that seems weird, yet Google didn’t really have much of a solid business plan when they started — AdWords just tipped up as a Good Idea, and is one that now earns them piles of dough. I think the NY Times is going to see a very good return on this move, both financially and mood-wise.

    To quote a good friend of mine, “This is going to be huge.”

    Share
  3. Manju Mahishi Sunday, February 8, 2009

    NY Times certainly deserves a lot of praise for this effort.

    I fully agree that this open model has the potential to spawn many interesting and useful applications – while being a terrific marketing vehicle for NYT.

    Thanks for sharing this Matthew.

    -Manju Mahishi

    Share
  4. Thank you for recognizing it as a platform that is meant to be built upon – it is a subtle point that often gets lost.

    Share
  5. [...] Its great to see people grokking that the NYTimes has to become a platform to survive. [...]

    Share
  6. [...] is social as it should be. Matthew Ingram opines that “newspaper as a platform” could be the silver bullet: And from the point of view [...]

    Share
  7. All the NYT APIs are Mashery Made, and those folks are happy to support other media owners who want to move in the same direction. [disc: i'm a mashery co-founder]

    Share
  8. @scott rafer
    i thought mashery didnt make api’s. you guys just manage them post-development.

    Share
  9. This is a great development; and the combination of open access to some of the best news and editorial coverage in the world along with the NYT brand is sure to spawn innovative new business applications (that NYT should benefit from).

    Interestingly, the NYT’s own Brad Stone wrote an article about major brands opening up APIs in September: http://tinyurl.com/3kakh3 indicating that the Times had been working on this since last May.

    Share
  10. @Derek — thanks for your efforts in building the foundation. It will be really interesting to see what people do with it.

    Share

Comments have been disabled for this post