Stay on Top of Enterprise Technology Trends
Get updates impacting your industry from our GigaOm Research Community
Public relations news monitor Meltwater, which is still refusing to pay UK newspapers for crawling their websites, has now been blocked from indexing Times Online, the most serious of Rupert Murdoch’s UK newspapers.
The news site, which is due to go behind a paywall this spring and which had already blocked the NewsNow news monitor in January, enacted the block via the standard robots.txt protocol on Tuesday. It means thousands of Meltwater customers around the world won’t get to inform clients when their company is mentioned in The Times.
The move stems from an increasing desire, from both Murdoch’s News International specifically and the rest of the UK press, that commercial crawlers pay them to crawl their sites.
In January, the Newspaper Licensing Agency (NLA) – which is owned by eight leading UK national news publishers and, for years, had charged clippings agencies to photocopy their pages – introduced two new licenses requiring (1) that agencies pay between £5,000 and £10,000 per year to crawl online papers and (2) that agencies’ clients pay £58 a year to receive that intelligence.
Most such companies complied. News aggregator NewsNow tried to make the issue a matter of broad web principle with its Right2Link campaign. But it complied by removing NLA members’ stories from its pay-for service, leaving Meltwater – formerly called Magenta News – the only non-compliant agency.
The way the NLA sees it, news monitors are effectively making a copy of articles when they process articles to provide the categorisation and alerts that are so valuable to PR clients.
Meltwater, seeing differently, in December went to the UK’s Copyright Tribunal to challenge the fairness of the NLA’s new licenses – a ruling is still awaited, though the tribunal on Monday, a day before Times Online’s block ruled the Meltwater can go ahead with its challenge. The NLA is only charging crawlers that charge for a service, so Google (NSDQ: GOOG) is off the hook.
Murdoch’s News International is not exercising the NLA’s new licenses despite being an NLA member. But News Corp (NYSE: NWS) has, of course, been very keen of late to stress that users of its content, like search sites, should be paying it. Unclear how much News International is asking for, compared with the NLA’s £5,000-to-£10,000-a-year demand.