<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:media="http://search.yahoo.com/mrss/"
	>

<channel>
	<title>GigaOM &#187; Gnip</title>
	<atom:link href="http://gigaom.com/tag/gnip/feed/" rel="self" type="application/rss+xml" />
	<link>http://gigaom.com</link>
	<description></description>
	<lastBuildDate>Wed, 19 Jun 2013 21:52:13 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.com/</generator>
<cloud domain='gigaom.com' port='80' path='/?rsscloud=notify' registerProcedure='' protocol='http-post' />
<image>
		<url>http://0.gravatar.com/blavatar/0db8f6557d022075dbbf010c54d46d93?s=96&#038;d=http%3A%2F%2Fs2.wp.com%2Fi%2Fbuttonw-com.png</url>
		<title>GigaOM &#187; Gnip</title>
		<link>http://gigaom.com</link>
	</image>
	<atom:link rel="search" type="application/opensearchdescription+xml" href="http://gigaom.com/osd.xml" title="GigaOM" />
	<atom:link rel='hub' href='http://gigaom.com/?pushpress=hub'/>
		<item>
		<title>As the firehose matures, Twitter tightens grip on valuable asset</title>
		<link>http://gigaom.com/2012/11/29/as-the-firehose-matures-twitter-tightens-grip-on-valuable-asset/</link>
		<comments>http://gigaom.com/2012/11/29/as-the-firehose-matures-twitter-tightens-grip-on-valuable-asset/#comments</comments>
		<pubDate>Fri, 30 Nov 2012 00:39:01 +0000</pubDate>
		<dc:creator>Eliza Kern</dc:creator>
				<category><![CDATA[datasift]]></category>
		<category><![CDATA[Gnip]]></category>
		<category><![CDATA[Jodee Rich]]></category>
		<category><![CDATA[PeopleBrowsr]]></category>
		<category><![CDATA[Real Time Search]]></category>
		<category><![CDATA[Topsy]]></category>
		<category><![CDATA[Twitter]]></category>

		<guid isPermaLink="false">http://gigaom.com/?p=589450</guid>
		<description><![CDATA[PeopleBrowsr, a company that provides marketing analytics based on the full stream of data from Twitter called the firehose, is suing Twitter for access to that stream. While Twitter is closing down who has access to the firehose, it shows where the company is headed.<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=589450&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>This summer, Twitter <a href="https://dev.twitter.com/blog/changes-coming-to-twitter-api" target="_blank">showed that it had no problems playing favorites</a> when it <a href="http://gigaom.com/2012/08/21/after-tumultuous-summer-developers-cast-wary-eye-on-twitter/" target="_blank">came to developers using its API to build a business</a>. So when it comes to the company&#8217;s firehose &#8211; the unfiltered deluge of <a href="http://www.fordschool.umich.edu/video/newest/1975704207001/" target="_blank">1 billion tweets every two and half days</a> &#8212; it&#8217;s becoming apparent the company will continue to play favorites there as well, limiting who has access to one of the company&#8217;s most valuable assets.</p>
<p><a href="http://www.scribd.com/doc/114846303/Rich-Declaration-PB-v-TW-Restraining-Order-28-Nov-12" target="_blank">Twitter is currently being sued by PeopleBrowsr</a>, a company that has had full access to Twitter&#8217;s firehose, after Twitter said it would restrict PeopleBrowsr&#8217;s access to the firehose following the expiration of a previous contract. From Twitter&#8217;s perspective, it makes sense to consolidate who is accessing and re-distributing that data due to the scope of the data and work involved in transmitting those tweets. But it hasn&#8217;t always been this way, and PeopleBrowsr is challenging Twitter&#8217;s earlier commitment to openness when it comes to that firehose of data.</p>
<p>In 2010, Twitter licensed its full firehose to both big guys like Bing, Microsoft, and Google, <a href="http://blog.twitter.com/2010/03/enabling-rush-of-innovation.html" target="_blank">as well as several startups focused on realtime search</a>, with then-Twitter spokesman Sean Garrett <a href="http://gigaom.com/2010/03/01/what-is-taking-a-sip-from-the-twitter-firehose-going-to-cost-you/" target="_blank">explaining that they wanted to build partnerships</a> that were “sustainable and scalable.”</p>
<blockquote><p>With access to the full Firehose of data, it is possible to move far beyond the Twitter experiences we know today. In fact, we’re pretty sure that some amazing innovation is possible. Today, we’re happily turning the Firehose on for some new partners focused mainly on exploring the incredibly rich field of real-time search and discovery. We are thrilled to announce that <a href="http://www.ellerdale.com/">Ellerdale</a>, <a href="http://collecta.com/">Collecta</a>, <a href="http://www.kosmix.com/">Kosmix</a>, <a href="http://www.scoopler.com/">Scoopler</a>, <a href="http://www.twazzup.com/">twazzup</a>, <a href="http://www.crowdeye.com/">CrowdEye</a>, and Chainn Search join us as partners. These companies range from funded startups to part-time, one-person operations so we came up with a fair way to license access that scales with their business. If you think there may be a potential partnership involving access to the Firehose, let&#8217;s start a conversation.</p></blockquote>
<p>Clearly, that conversation about access to the firehose has changed since 2010. A <a href="http://searchengineland.com/as-deal-with-twitter-expires-google-realtime-search-goes-offline-84175" target="_blank">highly-public partnership with Google broke down</a>, killing Google&#8217;s realtime search product that relied on the firehose of data. Twitter and Bing re-negotiated their terms in 2010, with <a href="http://allthingsd.com/20110715/with-google-gone-for-now-twitter-tries-to-come-to-terms-with-microsofts-bing/" target="_blank">AllThingsD reporting at the time</a> that Twitter was asking about $30 million for the access. And most of the startups who recieved access in 2010 are no longer powering search engines: <a href="http://blog.ellerdale.com/2010/07/ellerdale-has-been-acquired-by.html" target="_blank">Ellerdale was acquired by Flipboard in July 2010</a>, Collecta has <a href="http://collecta.com/" target="_blank">removed their &#8220;customer-facing site</a>,&#8221; Kosmix <a href="http://news.walmart.com/news-archive/2011/04/18/walmart-announces-acquisition-of-social-media-company-kosmix" target="_blank">was acquired by WalMart in April 2011</a>, Scoopler <a href="http://techcrunch.com/2011/07/20/google-justspotted/" target="_blank">shut down after the team was acquired by Google to work on Google+ in 2011</a>, and CrowdEye <a href="http://www.crowdeye.com/" target="_blank">shut down after the founders said they were unable to build a profitable business</a>.</p>
<p>So who&#8217;s still has access and distribution rights to the firehose? The full list of companies with commercial partnerships isn&#8217;t publicly available, but there are a few like Bing and <a href="http://www.salesforce.com/company/news-press/press-releases/2012/06/120614.jsp" target="_blank">Salesforce</a> that have publicized this relationship, and <a href="https://dev.twitter.com/programs/twitter-certified-products/products" target="_blank">several companies listed as part of Twitter&#8217;s certified program</a> do have firehose access and can provide enterprise access to that data for other companies who are interested. Duncan Greatwood, CEO of Topsy, which is one of the companies licensed to re-distribute the data, said that including Topsy&#8217;s archives, there are now more than 250 billion tweets. That makes it unrealistic, in his opinion, that many companies would be prepared to access the full stream &#8212; most companies only access smaller percentages.</p>
<p>But <a href="https://twitter.com/WingDude" target="_blank">PeopleBrowsr CEO Jodee Rich</a> said his company relies on full access to the firehose to serve its customers, and an agreement with one of the other providers wouldn&#8217;t make sense.</p>
<p>&#8220;The nature of those agreements are so short-term that no one could possibly build a viable business on those agreements,&#8221; he said in an interview. In Rich&#8217;s legal statement, <a href="http://www.scribd.com/doc/114846303/Rich-Declaration-PB-v-TW-Restraining-Order-28-Nov-12" target="_blank">which is available online here</a>, he notes that PeopleBrowsr was paying Twitter more than $1 million per year for firehose access.</p>
<p>Topsy, Gnip and DataSift are three providers who license the full firehose of data from Twitter and then re-sell portions of it to either developers building products with the data (showing your influence on Twitter, for instance), or to marketers and brands using sections of tweets to track conversations and trends on the network. PeopleBrowsr is arguing in the court documents that being forced to get data from one of these companies would compromise its ability to serve its clients, since it previously had full access. <a href="http://www.scribd.com/doc/114851067/Twitter-Response-to-Plaintiff" target="_blank">Twitter counters that it&#8217;s totally within its rights to change the terms</a> given that its initial contract with PeopleBrowsr has run its course:</p>
<blockquote><p>But as Twitter has grown, its contracting practices have matured. Where it once contracted directly with just a handful of data customers like PeopleBrowsr, it now has hundreds of data customers. In order to handle that broad commercial demand in a consistent and transparent manner Twitter has created channel resyndication partnerships with Gnip, DataSift, and Topsy. PeopleBrowsr is free to contract with any of them, just as its competitors do. What it is not free to do is insist that Twitter preserve forever its earlier business model, or continue to be bound by a contract that expired more than a year ago.</p></blockquote>
<p>A Twitter spokesperson replied that, &#8220;We believe the case is without merit and will vigorously defend against it.&#8221;</p>
<p><a href="http://blog.peoplebrowsr.com/2012/11/peoplebrowsr-wins-temporary-restraining-order-compelling-twitter-to-provide-firehose-access/" target="_blank">PeopleBrowsr has won a restraining order that forces Twitter to continue firehose access</a> for the time being. <a href="http://gigaom.com/2012/08/16/twitter-rolls-out-expected-restrictions-to-api-use/" target="_blank">As we&#8217;ve learned this year</a>, building your company on top of another company&#8217;s data is so inherently risky. But the lawsuit does demonstrate the value Twitter&#8217;s data has grown to hold, and the lengths companies will go to secure it.</p>
<br />  <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=589450&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" /><p><a href="http://pubads.g.doubleclick.net/gampad/jump?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=359559"><img src="http://pubads.g.doubleclick.net/gampad/ad?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=359559" /></a></p><p><strong>Related research and analysis from GigaOM Pro:</strong><br />Subscriber content. <a href="http://pro.gigaom.com/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=589450+as-the-firehose-matures-twitter-tightens-grip-on-valuable-asset&utm_content=elizakern">Sign up for a free trial</a>.</p><ul><li><a href="http://pro.gigaom.com/2011/09/the-future-of-mobile-a-segment-analysis-by-gigaom-pro/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=589450+as-the-firehose-matures-twitter-tightens-grip-on-valuable-asset&utm_content=elizakern">The future of mobile: a segment analysis by GigaOM Pro</a></li><li><a href="http://pro.gigaom.com/2011/04/newnet-q1-content-farms-and-niche-networks-on-the-rise/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=589450+as-the-firehose-matures-twitter-tightens-grip-on-valuable-asset&utm_content=elizakern">NewNet Q1: Content Farms and Niche Networks on the Rise</a></li><li><a href="http://pro.gigaom.com/2011/04/finding-the-value-in-social-media-data/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=589450+as-the-firehose-matures-twitter-tightens-grip-on-valuable-asset&utm_content=elizakern">Finding the Value in Social Media Data</a></li></ul>]]></content:encoded>
			<wfw:commentRss>http://gigaom.com/2012/11/29/as-the-firehose-matures-twitter-tightens-grip-on-valuable-asset/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
	
		<media:thumbnail url="http://gigaompaidcontent.files.wordpress.com/2012/02/twitter-bird-perched-on-gavel-o.png?w=150" />
		<media:content url="http://gigaompaidcontent.files.wordpress.com/2012/02/twitter-bird-perched-on-gavel-o.png?w=150" medium="image">
			<media:title type="html">Twitter Bird perched on gavel</media:title>
		</media:content>

		<media:content url="http://2.gravatar.com/avatar/bd7905cba2440e49d86bd328573730f7?s=96&#38;d=retro&#38;r=PG" medium="image">
			<media:title type="html">elizakern</media:title>
		</media:content>
	</item>
		<item>
		<title>Greenplum and Kaggle launch big data matchmaking service</title>
		<link>http://gigaom.com/2012/10/23/greenplum-kaggle-play-big-data-matchmakers/</link>
		<comments>http://gigaom.com/2012/10/23/greenplum-kaggle-play-big-data-matchmakers/#comments</comments>
		<pubDate>Tue, 23 Oct 2012 12:03:13 +0000</pubDate>
		<dc:creator>Barb Darrow</dc:creator>
				<category><![CDATA[big data]]></category>
		<category><![CDATA[EMC]]></category>
		<category><![CDATA[Gnip]]></category>
		<category><![CDATA[Greenplum]]></category>
		<category><![CDATA[kaggle]]></category>
		<category><![CDATA[tableau]]></category>
		<category><![CDATA[Twitter]]></category>

		<guid isPermaLink="false">http://gigaom.com/?p=576147</guid>
		<description><![CDATA[EMC's Greenplum division hopes to encourage users of its Chorus big data application to reach out to the Kaggle community of data scientists to do real-world work. The company also inked partnerships with Gnip and Tableau and open-sourced a version of Chorus.<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=576147&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>Sometimes it&#8217;s hard for data scientists and big data sets to find each other. That&#8217;s the problem that EMC&#8217;s Greenplum division and Kaggle are taking on with a new partnership. <a href="http://gigaom.com/data/can-kaggle-make-data-science-a-spectator-sport/">Kaggle</a> is a predictive modeling platform that sponsors competitions in which data scientists compete to solve big data problems.</p>
<p>Under the new alliance, Kaggle&#8217;s community of big data eggheads can use <a href="http://gigaom.com/cloud/emc-gets-it-big-data-needs-apps-too/">Greenplum&#8217;s Chorus big data application</a> to solve real-world problems.</p>
<p>&#8220;We&#8217;ve had good adoption of Chorus and companies&#8217; internal data workers are using it to do data science so they now have the tools, but honestly they don&#8217;t have all the people they need,&#8221; said Josh Klahr,  VP of product management for Greenplum. &#8220;Now you can search the Kaggle community based on rank, expertise, location and invite them to work on your challenge using Greenplum Chorus.&#8221;</p>
<h2>Playing Yenta to big data players</h2>
<p>Kaggle ranks its participants much the way the USTA ranks tennis players. And that community is growing fast &#8212; when Kaggle started fundraising in August, there were 11,000 members, now there are close to 60,000, said Anthony Goldbloom, CEO of Kaggle, who said this is the first such vendor partnership Kaggle has done. (<a href="http://gigaom.com/data/forget-your-fancy-data-science-try-overkill-analytics/">GigaOM has worked with Kaggle and Splunk </a>on the <a href="http://www.kaggle.com/c/predict-wordpress-likes">GigaOM WordPress Challenge: Splunk Innovation Prospect</a>.)</p>
<p>Also on the partner ecosystem front, Greenplum inked a deal that gives Chorus users access to <a href="http://gnip.com/">Gnip&#8217;s</a> historical Twitter feeds and will let Chorus users import Twitter streams into their Chorus sandbox for analysis. And finally, Chorus is partnering with <a href="http://www.tableau.com/">Tableau</a>, the popular analytics tool so that users can provision Tableau workbooks from their Chorus data sources.</p>
<p>Big data is one area where building a broad ecosystem of data providers is incredibly important. Putting good data scientists together with great data sets is incredibly important, said Ben Woo, managing director of research firm <a href="http://www.neuralytics.com/">Neuralytics</a>. &#8220;Big data is awfully short on the kinds of people who&#8217;ve done this work before and, frankly, people who give a damn. This sort of matchmaking is valuable.&#8221;</p>
<h2>Goal: Melding public and private data to spark new insights</h2>
<p>This convergence of publicly available &#8220;sentiment&#8221; data from sources like Twitter and internal business data lets data scientists ask interesting questions or find interesting questions to ask. For example, a pharmaceutical company has lots of its own data on a new drug. What it may not have is the sort of information about unforeseen side effects that might surface on Twitter or blogs after the drug is released.  &#8221;If you can match Twitter feeds and patient forums, you can find out unexpected things &#8212; see that maybe people are switching from your drug to another. Analyzing that discussion can be incredibly important,&#8221;  Goldbloom said.</p>
<p>In related news, Greenplum, as promised last spring, is open sourcing Chorus as the <a href="http://www.openchorus.org/">OpenChorus Project</a> under the Apache 2.0 license.</p>
<p><em><a title="Attribution License" href="http://creativecommons.org/licenses/by/2.0/">Feature photo courtesy of</a> Flickr user <a href="http://www.flickr.com/photos/kevinkrejci/">Kevin Krejci</a></em></p>
<br />  <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=576147&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" /><p><a href="http://pubads.g.doubleclick.net/gampad/jump?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=885052"><img src="http://pubads.g.doubleclick.net/gampad/ad?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=885052" /></a></p><p><strong>Related research and analysis from GigaOM Pro:</strong><br />Subscriber content. <a href="http://pro.gigaom.com/?utm_source=data&utm_medium=editorial&utm_campaign=auto3&utm_term=576147+greenplum-kaggle-play-big-data-matchmakers&utm_content=gigabarb">Sign up for a free trial</a>.</p><ul><li><a href="http://pro.gigaom.com/2012/01/12-tech-leaders-resolutions-for-2012/?utm_source=data&utm_medium=editorial&utm_campaign=auto3&utm_term=576147+greenplum-kaggle-play-big-data-matchmakers&utm_content=gigabarb">12 tech leaders’ resolutions for 2012</a></li><li><a href="http://pro.gigaom.com/report/sql-on-hadoop-roadmap-2013/?utm_source=data&utm_medium=editorial&utm_campaign=auto3&utm_term=576147+greenplum-kaggle-play-big-data-matchmakers&utm_content=gigabarb">Sector RoadMap: SQL-on-Hadoop platforms in 2013</a></li><li><a href="http://pro.gigaom.com/2012/03/a-near-term-outlook-for-big-data/?utm_source=data&utm_medium=editorial&utm_campaign=auto3&utm_term=576147+greenplum-kaggle-play-big-data-matchmakers&utm_content=gigabarb">A near-term outlook for big data</a></li></ul>]]></content:encoded>
			<wfw:commentRss>http://gigaom.com/2012/10/23/greenplum-kaggle-play-big-data-matchmakers/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:thumbnail url="http://gigaom2.files.wordpress.com/2012/10/6259499293_b577b94cfd_z.jpg?w=150" />
		<media:content url="http://gigaom2.files.wordpress.com/2012/10/6259499293_b577b94cfd_z.jpg?w=150" medium="image">
			<media:title type="html">big data</media:title>
		</media:content>

		<media:content url="http://1.gravatar.com/avatar/4af03439988d64f816da72496325cb73?s=96&#38;d=retro&#38;r=PG" medium="image">
			<media:title type="html">gigabarb</media:title>
		</media:content>
	</item>
		<item>
		<title>Data markets: in search of new business models</title>
		<link>http://pro.gigaom.com/2012/08/data-markets-in-search-of-new-business-models/</link>
		<comments>http://pro.gigaom.com/2012/08/data-markets-in-search-of-new-business-models/#comments</comments>
		<pubDate>Wed, 22 Aug 2012 06:55:34 +0000</pubDate>
		<dc:creator>Paul Miller</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[aggdata]]></category>
		<category><![CDATA[Amazon]]></category>
		<category><![CDATA[API]]></category>
		<category><![CDATA[Box]]></category>
		<category><![CDATA[buzzdata]]></category>
		<category><![CDATA[Collaboration]]></category>
		<category><![CDATA[data]]></category>
		<category><![CDATA[Data Hub CKAN]]></category>
		<category><![CDATA[Data Marketplace]]></category>
		<category><![CDATA[data-markets]]></category>
		<category><![CDATA[Datafiniti]]></category>
		<category><![CDATA[datamarket]]></category>
		<category><![CDATA[datasift]]></category>
		<category><![CDATA[Economist]]></category>
		<category><![CDATA[Economist Intelligence Unit]]></category>
		<category><![CDATA[Eurostat]]></category>
		<category><![CDATA[Factual]]></category>
		<category><![CDATA[Gapminder]]></category>
		<category><![CDATA[Gnip]]></category>
		<category><![CDATA[infochimps]]></category>
		<category><![CDATA[Microsoft]]></category>
		<category><![CDATA[PowerPivot]]></category>
		<category><![CDATA[redmonk]]></category>
		<category><![CDATA[SourceForge]]></category>
		<category><![CDATA[Starbucks]]></category>
		<category><![CDATA[tableau]]></category>
		<category><![CDATA[Windows Azure]]></category>
		<category><![CDATA[Windows Azure Marketplace]]></category>
		<category><![CDATA[Wolfram Alpha]]></category>
		<category><![CDATA[World Bank]]></category>

		<guid isPermaLink="false">http://pro.gigaom.com/?p=119676</guid>
		<description><![CDATA[A number of new data markets have emerged in the past few years that provide access to data for decision making. It's early days, however, with plenty of kinks to work out on both the technology side and with business models.<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=555666&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>From information on U.S. census returns to the location of every Starbucks in Canada, the demand for data to support decision making is increasing. Fittingly, a number of new data markets have emerged in the past few years that provide access to this data. A wide range of companies exists in this space, and often there are more differences than similarities in the various products on offer, not to mention the many different financial models. This report describes the basics of a data market, explores the ways in which various companies are beginning to position their offerings, and looks for evidence that there is sufficient demand for this market segment to prove sustainable.</p>
<br />  <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=555666&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" /><p><a href="http://pubads.g.doubleclick.net/gampad/jump?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=434858"><img src="http://pubads.g.doubleclick.net/gampad/ad?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=434858" /></a></p><p><strong>Related research and analysis from GigaOM Pro:</strong><br />Subscriber content. <a href="http://pro.gigaom.com/?utm_source=pro&utm_medium=editorial&utm_campaign=auto3&utm_term=555666+data-markets-in-search-of-new-business-models&utm_content=cloudofdata">Sign up for a free trial</a>.</p><ul><li><a href="http://pro.gigaom.com/2012/01/infrastructure-q4-big-data-gets-bigger-and-saas-startups-shine/?utm_source=pro&utm_medium=editorial&utm_campaign=auto3&utm_term=555666+data-markets-in-search-of-new-business-models&utm_content=cloudofdata">Infrastructure Q4: Big data gets bigger and SaaS startups shine</a></li><li><a href="http://pro.gigaom.com/2011/09/the-future-of-mobile-a-segment-analysis-by-gigaom-pro/?utm_source=pro&utm_medium=editorial&utm_campaign=auto3&utm_term=555666+data-markets-in-search-of-new-business-models&utm_content=cloudofdata">The future of mobile: a segment analysis by GigaOM Pro</a></li><li><a href="http://pro.gigaom.com/2012/03/big-data-beyond-analytics/?utm_source=pro&utm_medium=editorial&utm_campaign=auto3&utm_term=555666+data-markets-in-search-of-new-business-models&utm_content=cloudofdata">Big data: beyond analytics</a></li></ul>]]></content:encoded>
			<wfw:commentRss>http://pro.gigaom.com/2012/08/data-markets-in-search-of-new-business-models/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:thumbnail url="https://gigaom-pro-files.s3.amazonaws.com/files/2012/08/datamarkets1.jpg?w=150" />
		<media:content url="https://gigaom-pro-files.s3.amazonaws.com/files/2012/08/datamarkets1.jpg?w=150" medium="image">
			<media:title type="html">datamarkets1</media:title>
		</media:content>

		<media:content url="http://1.gravatar.com/avatar/7c1b4afa924d36a76027fe2be0543eeb?s=96&#38;d=retro&#38;r=PG" medium="image">
			<media:title type="html">cloudofdata</media:title>
		</media:content>
	</item>
		<item>
		<title>Marketing is dead, long live marketing</title>
		<link>http://gigaom.com/2012/08/13/marketing-is-dead-long-live-marketing/</link>
		<comments>http://gigaom.com/2012/08/13/marketing-is-dead-long-live-marketing/#comments</comments>
		<pubDate>Mon, 13 Aug 2012 19:15:04 +0000</pubDate>
		<dc:creator>Barb Darrow</dc:creator>
				<category><![CDATA[big data]]></category>
		<category><![CDATA[Cloud Computing]]></category>
		<category><![CDATA[CMO]]></category>
		<category><![CDATA[datasift]]></category>
		<category><![CDATA[Facebook]]></category>
		<category><![CDATA[Gnip]]></category>
		<category><![CDATA[marketing]]></category>
		<category><![CDATA[social networking]]></category>
		<category><![CDATA[Twitter]]></category>

		<guid isPermaLink="false">http://gigaom.com/?p=552247</guid>
		<description><![CDATA[In the era of cloud computing and big data, chief marketing officers can either sink or swim depending on their ability to recognize the importance of the consumer information available to them and are able to capture and put it to use.<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=552247&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p>Depending on what research you believe, chief marketing officers are either more powerful than they&#8217;ve ever been &#8212; or they&#8217;re on their way out.</p>
<p>Early this year,a <a href="http://my.gartner.com/portal/server.pt?open=512&amp;objID=202&amp;mode=2&amp;PageID=5553&amp;resId=1871515&amp;ref=Webinar-Calendar">Gartner</a> analyst predicted that CMOs will have bigger IT budget power than CIOs by 2017. Naturally, that analysis was quickly <a href="http://www.forbes.com/sites/lisaarthur/2012/02/08/five-years-from-now-cmos-will-spend-more-on-it-than-cios-do/">bandied about by CMOs</a>.</p>
<p>But last week, in a blog post unambiguously titled <a href="http://blogs.hbr.org/cs/2012/08/marketing_is_dead.html">&#8220;Marketing is Dead</a>,&#8221; Bill Lee wrote that CMOs, as a species, are under fire.</p>
<p>Lee, president of the Lee Consulting Group which focuses on &#8220;customer engagement,&#8221; cited data from <a href="http://www.fournaisegroup.com/Marketers-Lack-Credibility.asp?_fwaHound=15127937_12185_15127937_0_0_0_0">a 2011 Fournaise Marketing Group study </a>suggesting that CEOs don&#8217;t see ROI on marketing efforts and are sick of being asked for marketing money with no discernible payoff. On top of that,  Lee posits that shoppers don&#8217;t pay attention to traditional marketing anymore. Ouch.</p>
<h2>Cloud and big data reshape the marketing role</h2>
<p><a href="http://gigaom.com/cloud/marketing-is-dead-long-live-marketing/shutterstock_97220924/" rel="attachment wp-att-552332"><img  title="shutterstock_97220924" src="http://gigaom2.files.wordpress.com/2012/08/shutterstock_97220924.jpg?w=300&#038;h=270" alt="" width="300" height="270" class="alignleft size-medium wp-image-552332" /></a>Underlying this seeming contradiction is that marketing is being redefined in the era of cloud-delivered, self-service applications and services and web-connected consumers. Several CIOs and CTOs have told me that they agree that CMOs gaining clout in their businesses &#8212; but the most successful CMOs are those who &#8220;get&#8221; that effective marketing is both broader and more focused than it&#8217;s been in the past.</p>
<p>&#8220;Broader&#8221; here means that the channels are no longer limited to radio, TV, print and online publications but social networks as well. CMOs who understand that the data flowing in via Twitter and Facebook is an important source of market intelligence &#8212; a big data feed that must be monitored and tapped.</p>
<h2>Filtering the social networks</h2>
<p>The explosion of social networking use means that &#8220;multi-channel&#8221; marketing is more multi-channel than ever. You don&#8217;t have to just track newspaper, TV and radio &#8220;thought leaders,&#8221; you need to watch for your company&#8217;s own thought leaders &#8212; your best customers and what they&#8217;re saying. That means narrower, less scattershot messaging &#8212; why hit up people who are not even remotely interested in your product or service? The idea is that your thought leaders will convince others that your offering is worth a look.</p>
<p>At the very least, you&#8217;d better know <a href="http://gigaom.com/2011/11/17/twitter-is-a-stream-but-its-also-a-reservoir-of-data/">Gnip</a> and <a href="http://gigaom.com/cloud/social-net-sifter-datasift-adds-7-2m-to-its-war-chest/">DataSift.</a></p>
<p>Lee wrote:</p>
<blockquote><p>Many firms spend lots of resources pursuing outside influencers who&#8217;ve gained following on the Web and through social media. A better approach is to find and cultivate <em>customer </em>influencers and give them something great to talk about.</p></blockquote>
<p>There&#8217;s more insight here in a <a href="http://blog.tridentcap.com/2012/07/customer-centricity-requires-cmos-to-drive-data-and-channel-integration.html">blog</a> post by Evangelos Simoudis, senior managing director of Trident Capital. Simoudis wrote:</p>
<blockquote><p>In order to become customer-centric and deliver a consistent message to each individual regardless of the communication channel, companies must first integrate all their customer- and prospect-related data.  Up to now, organizations would silo the various types of customer-related data.</p></blockquote>
<p>So whether a given CMO has clout or is about to get pink-slipped depends a lot on her ability to understand the importance of this data trove and capture and make use of that big data resource.</p>
<p><em>Feature image courtesy of Shutterstock user <a href="http://www.shutterstock.com/gallery-286462p1.html">lznogood</a></em></p>
<p><em>Thumbnail photo courtesy of Shutterstock user <a href="http://www.shutterstock.com/gallery-287881p1.html">Aaron Amat</a></em></p>
<br />  <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=552247&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" /><p><a href="http://pubads.g.doubleclick.net/gampad/jump?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=468803"><img src="http://pubads.g.doubleclick.net/gampad/ad?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=468803" /></a></p><p><strong>Related research and analysis from GigaOM Pro:</strong><br />Subscriber content. <a href="http://pro.gigaom.com/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=552247+marketing-is-dead-long-live-marketing&utm_content=gigabarb">Sign up for a free trial</a>.</p><ul><li><a href="http://pro.gigaom.com/2011/04/finding-the-value-in-social-media-data/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=552247+marketing-is-dead-long-live-marketing&utm_content=gigabarb">Finding the Value in Social Media Data</a></li><li><a href="http://pro.gigaom.com/report/sector-roadmap-social-customer-service-in-2013/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=552247+marketing-is-dead-long-live-marketing&utm_content=gigabarb">Sector RoadMap: Social customer service in 2013</a></li><li><a href="http://pro.gigaom.com/2012/03/a-near-term-outlook-for-big-data/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=552247+marketing-is-dead-long-live-marketing&utm_content=gigabarb">A near-term outlook for big data</a></li></ul>]]></content:encoded>
			<wfw:commentRss>http://gigaom.com/2012/08/13/marketing-is-dead-long-live-marketing/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
	
		<media:thumbnail url="http://gigaom2.files.wordpress.com/2012/08/marketing-e1344863139934.jpg?w=150" />
		<media:content url="http://gigaom2.files.wordpress.com/2012/08/marketing-e1344863139934.jpg?w=150" medium="image">
			<media:title type="html">marketing</media:title>
		</media:content>

		<media:content url="http://1.gravatar.com/avatar/4af03439988d64f816da72496325cb73?s=96&#38;d=retro&#38;r=PG" medium="image">
			<media:title type="html">gigabarb</media:title>
		</media:content>

		<media:content url="http://gigaom2.files.wordpress.com/2012/08/shutterstock_97220924.jpg?w=300" medium="image">
			<media:title type="html">shutterstock_97220924</media:title>
		</media:content>
	</item>
		<item>
		<title>Social net sifter DataSift adds $7.2M to its war chest</title>
		<link>http://gigaom.com/2012/05/02/social-net-sifter-datasift-adds-7-2m-to-its-war-chest/</link>
		<comments>http://gigaom.com/2012/05/02/social-net-sifter-datasift-adds-7-2m-to-its-war-chest/#comments</comments>
		<pubDate>Wed, 02 May 2012 11:00:50 +0000</pubDate>
		<dc:creator>Barb Darrow</dc:creator>
				<category><![CDATA[Britain]]></category>
		<category><![CDATA[datasift]]></category>
		<category><![CDATA[Europe]]></category>
		<category><![CDATA[Facebook]]></category>
		<category><![CDATA[Gnip]]></category>
		<category><![CDATA[Rob Bailey]]></category>
		<category><![CDATA[social networks]]></category>
		<category><![CDATA[Twitter]]></category>
		<category><![CDATA[UK]]></category>

		<guid isPermaLink="false">http://gigaom.com/?p=516067</guid>
		<description><![CDATA[Businesses are hungry to understand more about the public perception of their products and services by tapping social networking sources. That demand is why DataSift, which sorts through tons of social network data, garnered $7.2 million in additional funding from existing backers.<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=516067&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p><a href="http://gigaom2.files.wordpress.com/2012/05/datasift2.jpg"><img  title="datasift2" src="http://gigaom2.files.wordpress.com/2012/05/datasift2.jpg?w=300&#038;h=199" alt="" width="300" height="199" class="alignleft size-medium wp-image-516142" /></a>The desire of companies to better understand the public perception of their products and reputation via social media shows no sign of abating. That&#8217;s why <a href="http://datasift.com/">DataSift</a>, the company that sorts through tons of Twitter, Facebook  and other social network data, has garnered an additional $7.2 million in venture funding from existing backers <a href="http://www.grppartners.com/" target="_blank">GRP Partners</a> and <a href="http://www.iaventures.com/" target="_blank">IA Ventures</a>.</p>
<p>That money comes as a follow-on to the <a href="http://gigaom.com/2011/07/11/datasift-twitter-funding/">$6 million already raised</a> in a Series A round last summer, and $1.5 million in seed funding.  The new cash will be used for product development and to hire more engineers, customer service and sales reps, the company said. DataSift, which launched in the U.K. in 2010, <a href="http://gigaom.com/2011/11/16/datasift-brings-its-twitter-act-to-san-francisco/">opened a San Francisco office</a> early this year.<br />
<a href="http://gigaom.com/cloud/datasift-now-gulps-two-years-from-the-twitter-firehose/">DataSift</a> and <a href="http://gigaom.com/2012/04/10/gnip-adds-data-from-chinas-largest-social-network/">Gnip</a> are the only companies authorized by Twitter to funnel and parse the Twitter firehose of social media data &#8212; information that many companies see as critical for planning service, promotion and marketing campaigns and then gauging their success (or lack thereof).</p>
<p>Companies from consumer electronics manufacturers to fast food chains all watch the Twitter feed &#8212; as well as Facebook, blogs, YouTube and other social network sources &#8212; collecting data that they then analyze along with their own internal metrics to see how online (or in-store) promotions are working. In early April, DataSift said it was also <a href="http://www.marketwire.com/press-release/datasift-fuses-social-news-monitoring-help-businesses-better-understand-how-news-spreads-1639499.htm">integrating with Newscred</a> so that customers could study how news and perceptions spread in the media.</p>
<p>In a statement, DataSift CEO Robert Bailey said the company had not been actively seeking new financing but that GRP and IA Ventures came forward with this offer. The fact that they stepped up helps eliminate distraction that comes with raising new funding, he added.</p>
<p>Expect DataSift to use its a some of this money to add new data sources and services, as it and Gnip try to one-up each other. In February, DataSift announced its ability to <a href="http://gigaom.com/cloud/datasift-now-gulps-two-years-from-the-twitter-firehose/">sort through two years into Twitter data</a> &#8212; Gnip can only go back 30 days. In mid April, <a href="http://www.webpronews.com/tumblr-and-gnip-partner-up-to-offer-data-firehose-2012-04">Gnip announced an exclusive partnership with Tumblr</a>, the fast-growing blogging site. It seems that arms race is bound to continue.</p>
<br />  <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=516067&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" /><p><a href="http://pubads.g.doubleclick.net/gampad/jump?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=27535"><img src="http://pubads.g.doubleclick.net/gampad/ad?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=27535" /></a></p><p><strong>Related research and analysis from GigaOM Pro:</strong><br />Subscriber content. <a href="http://pro.gigaom.com/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=516067+social-net-sifter-datasift-adds-7-2m-to-its-war-chest&utm_content=gigabarb">Sign up for a free trial</a>.</p><ul><li><a href="http://pro.gigaom.com/2011/07/newnet-q2-google-closes-the-quarter-with-a-bang/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=516067+social-net-sifter-datasift-adds-7-2m-to-its-war-chest&utm_content=gigabarb">NewNet Q2: Google closes the quarter with a bang</a></li><li><a href="http://pro.gigaom.com/2011/04/finding-the-value-in-social-media-data/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=516067+social-net-sifter-datasift-adds-7-2m-to-its-war-chest&utm_content=gigabarb">Finding the Value in Social Media Data</a></li><li><a href="http://pro.gigaom.com/2010/10/what-enterprise-software-vendors-could-learn-from-the-consumer-space/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=516067+social-net-sifter-datasift-adds-7-2m-to-its-war-chest&utm_content=gigabarb">What Enterprise Software Vendors Could Learn from the Consumer Space</a></li></ul>]]></content:encoded>
			<wfw:commentRss>http://gigaom.com/2012/05/02/social-net-sifter-datasift-adds-7-2m-to-its-war-chest/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:thumbnail url="http://gigaom2.files.wordpress.com/2012/05/datasift2.jpg?w=150" />
		<media:content url="http://gigaom2.files.wordpress.com/2012/05/datasift2.jpg?w=150" medium="image">
			<media:title type="html">datasift2</media:title>
		</media:content>

		<media:content url="http://1.gravatar.com/avatar/4af03439988d64f816da72496325cb73?s=96&#38;d=retro&#38;r=PG" medium="image">
			<media:title type="html">gigabarb</media:title>
		</media:content>

		<media:content url="http://gigaom2.files.wordpress.com/2012/05/datasift2.jpg?w=300" medium="image">
			<media:title type="html">datasift2</media:title>
		</media:content>
	</item>
		<item>
		<title>Gnip adds data from China&#8217;s largest social network</title>
		<link>http://gigaom.com/2012/04/10/gnip-adds-data-from-chinas-largest-social-network/</link>
		<comments>http://gigaom.com/2012/04/10/gnip-adds-data-from-chinas-largest-social-network/#comments</comments>
		<pubDate>Tue, 10 Apr 2012 14:20:26 +0000</pubDate>
		<dc:creator>Derrick Harris</dc:creator>
				<category><![CDATA[China]]></category>
		<category><![CDATA[Gnip]]></category>
		<category><![CDATA[Sina Weibo]]></category>
		<category><![CDATA[social media]]></category>
		<category><![CDATA[Twitter]]></category>

		<guid isPermaLink="false">http://gigaom.com/?p=509265</guid>
		<description><![CDATA[Social-media data aggregator Gnip is taking on its biggest data source yet -- China's Sina Weibo microblogging service. The plaform has more than 300 million users, so it only makes sense that Gnip users would want to know what people there are talking about.<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=509265&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p><a href="http://gigaom2.files.wordpress.com/2012/04/weibo.jpg"><img  title="weibo" src="http://gigaom2.files.wordpress.com/2012/04/weibo.jpg?w=300&#038;h=204" alt="" width="300" height="204" class="alignleft size-medium wp-image-509304" /></a>Social-media data aggregator <a href="http://gnip.com">Gnip</a> is taking on its biggest data source yet &#8212; China&#8217;s <a href="http://translate.google.com/translate?hl=en&amp;sl=zh-CN&amp;u=http://weibo.com/&amp;ei=7D-ET8XbGuO62gX9xeiFCQ&amp;sa=X&amp;oi=translate&amp;ct=result&amp;resnum=2&amp;ved=0CD4Q7gEwAQ&amp;prev=/search%3Fq%3Dsina%2Bweibo%26hl%3Den%26prmd%3Dimvns">Sina Weibo</a> microblogging service. China has the most Internet users in the world and is fast becoming a critical market for consumer sales, so it only makes sense that Gnip users would want to know what people there are talking about.</p>
<p>Gnip is best known as being one of two companies <a href="http://gigaom.com/2011/11/17/twitter-is-a-stream-but-its-also-a-reservoir-of-data/">with full access to the Twitter firehose</a>, but Twitter is actually just one of dozens of sources of Gnip&#8217;s data. &#8220;Although Twitter is obviously an incredibly valuable source of data, it&#8217;s just one conversation that&#8217;s happening,&#8221; Gnip COO Chris Moody told me during a recent call. Indeed.</p>
<p>According to Gnip, Sina Weibo has more than 300 million users, including Chinese celebrities, politicians and executives. International brands such as Nike, Starbucks and Adidas already have a strong presence on the platform, as well. Now, Gnip&#8217;s customers, primarily marketing-software companies that combine to serve more than 90 percent of the Fortune 500, can get a view into what Sina Weibo users are talking about, too.</p>
<p>Yes, the web, like the world, is wide, and international companies care about users outside the United States. Sina Weibo is Gnip&#8217;s first wholly international data source, but it wouldn&#8217;t be surprising to see it eventually add any of the other regional social media platforms that give Facebook and Twitter a run for their money among the local populations.</p>
<br />  <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=509265&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" /><p><a href="http://pubads.g.doubleclick.net/gampad/jump?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=99757"><img src="http://pubads.g.doubleclick.net/gampad/ad?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=99757" /></a></p><p><strong>Related research and analysis from GigaOM Pro:</strong><br />Subscriber content. <a href="http://pro.gigaom.com/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=509265+gnip-adds-data-from-chinas-largest-social-network&utm_content=dharrisstructure">Sign up for a free trial</a>.</p><ul><li><a href="http://pro.gigaom.com/2011/04/finding-the-value-in-social-media-data/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=509265+gnip-adds-data-from-chinas-largest-social-network&utm_content=dharrisstructure">Finding the Value in Social Media Data</a></li><li><a href="http://pro.gigaom.com/2011/07/newnet-q2-google-closes-the-quarter-with-a-bang/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=509265+gnip-adds-data-from-chinas-largest-social-network&utm_content=dharrisstructure">NewNet Q2: Google closes the quarter with a bang</a></li><li><a href="http://pro.gigaom.com/2010/10/what-enterprise-software-vendors-could-learn-from-the-consumer-space/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=509265+gnip-adds-data-from-chinas-largest-social-network&utm_content=dharrisstructure">What Enterprise Software Vendors Could Learn from the Consumer Space</a></li></ul>]]></content:encoded>
			<wfw:commentRss>http://gigaom.com/2012/04/10/gnip-adds-data-from-chinas-largest-social-network/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:thumbnail url="http://gigaom2.files.wordpress.com/2012/04/weibo.jpg?w=150" />
		<media:content url="http://gigaom2.files.wordpress.com/2012/04/weibo.jpg?w=150" medium="image">
			<media:title type="html">weibo</media:title>
		</media:content>

		<media:content url="http://0.gravatar.com/avatar/9e48ffa0913f65c577727457dd63023f?s=96&#38;d=retro&#38;r=PG" medium="image">
			<media:title type="html">dharrisstructure</media:title>
		</media:content>

		<media:content url="http://gigaom2.files.wordpress.com/2012/04/weibo.jpg?w=300" medium="image">
			<media:title type="html">weibo</media:title>
		</media:content>
	</item>
		<item>
		<title>DataSift now gulps two years from the Twitter firehose</title>
		<link>http://gigaom.com/2012/02/28/datasift-now-gulps-two-years-from-the-twitter-firehose/</link>
		<comments>http://gigaom.com/2012/02/28/datasift-now-gulps-two-years-from-the-twitter-firehose/#comments</comments>
		<pubDate>Tue, 28 Feb 2012 08:01:36 +0000</pubDate>
		<dc:creator>Barb Darrow</dc:creator>
				<category><![CDATA[@NYT]]></category>
		<category><![CDATA[datasift]]></category>
		<category><![CDATA[facebook-inc]]></category>
		<category><![CDATA[Gnip]]></category>
		<category><![CDATA[Twitter]]></category>
		<category><![CDATA[twitter-inc]]></category>

		<guid isPermaLink="false">http://gigaom.com/?p=490690</guid>
		<description><![CDATA[The new DataSift Historics can examine Twitter feeds going back two years -- something that consumer product and other companies might find very useful in their product design, pricing and promotion decisions. The service will be available in April.<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=490690&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p><a href="http://gigaom2.files.wordpress.com/2012/02/datasiftscreen-shot-2012-02-27-at-9-54-21-pm.jpg"><img  title="datasiftScreen Shot 2012-02-27 at 9.54.21 PM" src="http://gigaom2.files.wordpress.com/2012/02/datasiftscreen-shot-2012-02-27-at-9-54-21-pm-e1330397839242.jpg?w=300&#038;h=201" alt="" width="300" height="201" class="alignright size-medium wp-image-490697" /></a><a href="http://datasift.com/historics/">DataSift&#8217;s new Historics service</a> promises to mine the Twitter archives going back two years for insights that could guide business decisions on future strategies.</p>
<p>With an estimated 250 million tweets posted daily, Twitter is a huge trove of data about things as mundane as celebrity wardrobe malfunctions or as weighty as rebellions in the Middle East. What some have called the &#8220;<a href="http://gigaom.com/2011/07/11/datasift-twitter-funding/">Twitter firehose&#8221; </a>&#8211; DataSift says there were 250 billion tweets in 2010 &#8212; can be an invaluable information source, provided the right data can be found and filtered. That&#8217;s what DataSift brings to the table.</p>
<p>The company will say more about that other gold mine of information &#8212; Facebook &#8212; and how it can tap into that in a few weeks, a spokeswoman said.</p>
<p>DataSift&#8217;s current service handles only very recent tweets. <a href="http://gigaom.com/2008/11/04/gnip-raises-35-million/">Gnip,</a> the only other company Twitter has authorized to work with its data, can go back 30 days; DataSift Historics will dial back to Jan. 2010.</p>
<p>While some might question how valuable months- or years-old information really is, DataSift CEO Rob Bailey said companies planning new products, promotions or price changes would do well to study the impact of their past actions before proceeding and that Twitter is the perfect venue for that.</p>
<p>&#8220;Companies spend a lot of money designing new products and social network reaction can be a huge accelerant or a countervailing force,&#8221; he said.</p>
<p>A phone maker working on a new model would be well served to go back to see what customers thought of its last release &#8212; what they liked and didn&#8217;t like about the screen size, resolution and features, for example. If a price change is under consideration, a smart company might go back to see how past price actions were positioned and received.</p>
<p>In addition, it is helpful for businesses to know which Twitter users have the most influence and followers and to study their tweets carefully.</p>
<p>Bailey said DataSift works closely with Twitter to make sure the data is handled properly. &#8220;Users are extremely sensitive to privacy so we spent four to five months checking out the data . . . if people have deleted tweets, we make sure they stay deleted,&#8221; Bailey said.</p>
<p>DataSift Historics will be broadly available in April.</p>
<br />  <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=490690&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" /><p><a href="http://pubads.g.doubleclick.net/gampad/jump?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=644520"><img src="http://pubads.g.doubleclick.net/gampad/ad?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=644520" /></a></p><p><strong>Related research and analysis from GigaOM Pro:</strong><br />Subscriber content. <a href="http://pro.gigaom.com/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=490690+datasift-now-gulps-two-years-from-the-twitter-firehose&utm_content=gigabarb">Sign up for a free trial</a>.</p><ul><li><a href="http://pro.gigaom.com/2011/11/going-social-recommendations-engines-need-to-factor-in-consumer-reviews/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=490690+datasift-now-gulps-two-years-from-the-twitter-firehose&utm_content=gigabarb">Going social: Recommendations engines need to factor in consumer reviews</a></li><li><a href="http://pro.gigaom.com/2011/04/finding-the-value-in-social-media-data/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=490690+datasift-now-gulps-two-years-from-the-twitter-firehose&utm_content=gigabarb">Finding the Value in Social Media Data</a></li><li><a href="http://pro.gigaom.com/2012/08/data-markets-in-search-of-new-business-models/?utm_source=cloud&utm_medium=editorial&utm_campaign=auto3&utm_term=490690+datasift-now-gulps-two-years-from-the-twitter-firehose&utm_content=gigabarb">Data markets: in search of new business models</a></li></ul>]]></content:encoded>
			<wfw:commentRss>http://gigaom.com/2012/02/28/datasift-now-gulps-two-years-from-the-twitter-firehose/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:thumbnail url="http://gigaom2.files.wordpress.com/2012/02/datasiftscreen-shot-2012-02-27-at-9-54-21-pm-e1330397839242.jpg?w=150" />
		<media:content url="http://gigaom2.files.wordpress.com/2012/02/datasiftscreen-shot-2012-02-27-at-9-54-21-pm-e1330397839242.jpg?w=150" medium="image">
			<media:title type="html">datasiftScreen Shot 2012-02-27 at 9.54.21 PM</media:title>
		</media:content>

		<media:content url="http://1.gravatar.com/avatar/4af03439988d64f816da72496325cb73?s=96&#38;d=retro&#38;r=PG" medium="image">
			<media:title type="html">gigabarb</media:title>
		</media:content>

		<media:content url="http://gigaom2.files.wordpress.com/2012/02/datasiftscreen-shot-2012-02-27-at-9-54-21-pm-e1330397839242.jpg?w=300" medium="image">
			<media:title type="html">datasiftScreen Shot 2012-02-27 at 9.54.21 PM</media:title>
		</media:content>
	</item>
		<item>
		<title>Gnip and WordPress deepen ties, expand data partnership</title>
		<link>http://gigaom.com/2012/01/17/gnip-wordpress-partnership-expansion/</link>
		<comments>http://gigaom.com/2012/01/17/gnip-wordpress-partnership-expansion/#comments</comments>
		<pubDate>Tue, 17 Jan 2012 16:00:45 +0000</pubDate>
		<dc:creator>Colleen Taylor</dc:creator>
				<category><![CDATA[API]]></category>
		<category><![CDATA[Automattic]]></category>
		<category><![CDATA[Automattic Inc]]></category>
		<category><![CDATA[Blog hosting services]]></category>
		<category><![CDATA[Blog software]]></category>
		<category><![CDATA[Boulder]]></category>
		<category><![CDATA[Business Partnership]]></category>
		<category><![CDATA[Business/Finance]]></category>
		<category><![CDATA[Chris Moody]]></category>
		<category><![CDATA[Colorado]]></category>
		<category><![CDATA[Content Management Systems]]></category>
		<category><![CDATA[COO]]></category>
		<category><![CDATA[datasift]]></category>
		<category><![CDATA[facebook-inc]]></category>
		<category><![CDATA[Gnip]]></category>
		<category><![CDATA[IntenseDebate]]></category>
		<category><![CDATA[PHP programming language]]></category>
		<category><![CDATA[social media]]></category>
		<category><![CDATA[social media content]]></category>
		<category><![CDATA[social media data]]></category>
		<category><![CDATA[social media streams]]></category>
		<category><![CDATA[StumbleUpon Inc]]></category>
		<category><![CDATA[technologyinternet]]></category>
		<category><![CDATA[Tumblr]]></category>
		<category><![CDATA[Twitter]]></category>
		<category><![CDATA[twitter-inc]]></category>
		<category><![CDATA[united states]]></category>
		<category><![CDATA[wordpress]]></category>
		<category><![CDATA[World Wide Web]]></category>

		<guid isPermaLink="false">http://gigaom.com/?p=471483</guid>
		<description><![CDATA[Exclusive. Gnip is making it very clear it's not just about Twitter anymore. The company, which provides aggregated API access to a variety of social media streams, has significantly expanded its partnership with Automattic, the company that runs WordPress.com. <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=471483&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p><strong><a href="http://gigaom2.files.wordpress.com/2012/01/gnip.jpg"><img  title="gnip" src="http://gigaom2.files.wordpress.com/2012/01/gnip.jpg?w=708" alt=""   class="alignright size-full wp-image-471490" /></a>Exclusive.</strong> <a href="http://www.gnip.com">Gnip</a> is making it very clear it&#8217;s not just about Twitter anymore. The company, which provides <a href="http://gigaom.com/2008/09/11/gnip-more-than-ping-spelled-backwards/">aggregated API access</a> to a variety of social media streams, has significantly expanded its partnership with Automattic, the company that runs WordPress.com. (See disclosure.)</p>
<p>Gnip is now the first company authorized to resell firehose access to the public data from WordPress.com, the comment platform IntenseDebate, and WordPress.org sites that have opted into the Jetpack plugin. Gnip has had a relationship with WordPress for some time, but this partnership will give Gnip a 70-percent increase in its coverage of blog posts and comments through the popular WordPress service, which <a href="http://gigaom.com/2011/11/10/confirmed-wordpress-crosses-60-million-blogs/">now powers more than 60 million blogs</a> worldwide.</p>
<h2>Twitter brings news, but WordPress has analysis</h2>
<p>The Boulder, Colo.-based Gnip is probably best known as the <a href="http://blog.programmableweb.com/2010/11/17/gnip-selling-twitter-firehose-access-but-you-cant-display-tweets/">first company authorized</a> to resell access to Twitter&#8217;s data firehose back in November 2010, but Gnip currently provides access to some 30 different sources including Facebook, StumbleUpon, Tumblr, Vimeo, and others. In fact, today Gnip works with hundreds of customers, such as Radian6, that are collectively serving social media data to over 90 percent of the Fortune 500.</p>
<p>Also, the difference between Twitter data and WordPress data is significant for businesses, Gnip President and COO Chris Moody said in a recent interview. &#8220;News breaks on Twitter, but you&#8217;re not getting deep sentiment analysis with the data there. That comes with blogs, like what WordPress powers,&#8221; he said. &#8220;Twitter&#8217;s a great initial signal but WordPress blogs give you better sentiment. Companies tracking what&#8217;s going on in social media need the full picture.&#8221;</p>
<p>The expansion of the WordPress deal is just the first in many new partnership deals Gnip has on deck for 2012, as the company fields more demand for social media content. &#8220;We&#8217;re effectively doubling down with WordPress and bringing some new data to the market,&#8221; Moody said. &#8220;Twitter opening up its firehose to us has really had a domino effect in the world of publishers, and now other publishers have noted that it&#8217;s important for businesses to have access to this data.&#8221;</p>
<h2>Competition at the Twitter firehose</h2>
<p>There&#8217;s another big reason it makes sense for Gnip to expand its other content sources: It has competition on the Twitter front. DataSift, the only <a href="https://dev.twitter.com/docs/twitter-data-providers">other company authorized</a> to provide access to Twitter firehose data, <a href="http://gigaom.com/2011/11/16/datasift-brings-its-twitter-act-to-san-francisco/">launched in the U.S.</a> in Nov. 2011. Not surprisingly, though, Moody maintains Gnip has not been &#8220;paying attention&#8221; to DataSift&#8217;s growth, as it&#8217;s been &#8220;so focused on our own business.&#8221;</p>
<p>The thing is, that line is actually somewhat believable in Gnip&#8217;s case, as the booming demand for social media data is keeping the company quite busy. It now has 33 people, more than triple its size from just a year ago, Moody said. Meanwhile, the company has not taken on outside funding since Nov. 2010; its total VC investment is around $6.5 million.</p>
<p>One thing is certain: Better access to more data is good for both brands and the social media companies that host the conversations about them. It&#8217;ll be exciting to see what else Gnip and other companies in the space have on deck for the months ahead.</p>
<p><em><strong>Disclosure:</strong> Automattic, maker of WordPress.com, is backed by True Ventures, a venture capital firm that is an investor in the parent company of this blog, GigaOm. Om Malik, founder of GigaOm, is also a venture partner at True.</em></p>
<br />  <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=471483&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" /><p><a href="http://pubads.g.doubleclick.net/gampad/jump?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=778669"><img src="http://pubads.g.doubleclick.net/gampad/ad?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=778669" /></a></p><p><strong>Related research and analysis from GigaOM Pro:</strong><br />Subscriber content. <a href="http://pro.gigaom.com/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=471483+gnip-wordpress-partnership-expansion&utm_content=colleengigaom">Sign up for a free trial</a>.</p><ul><li><a href="http://pro.gigaom.com/report/sector-roadmap-content-personalization-in-2013/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=471483+gnip-wordpress-partnership-expansion&utm_content=colleengigaom">Sector RoadMap: Content personalization in 2013</a></li><li><a href="http://pro.gigaom.com/2012/01/12-tech-leaders-resolutions-for-2012/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=471483+gnip-wordpress-partnership-expansion&utm_content=colleengigaom">12 tech leaders’ resolutions for 2012</a></li><li><a href="http://pro.gigaom.com/report/sector-roadmap-social-customer-service-in-2013/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=471483+gnip-wordpress-partnership-expansion&utm_content=colleengigaom">Sector RoadMap: Social customer service in 2013</a></li></ul>]]></content:encoded>
			<wfw:commentRss>http://gigaom.com/2012/01/17/gnip-wordpress-partnership-expansion/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
	
		<media:thumbnail url="http://gigaom2.files.wordpress.com/2012/01/gnip.jpg?w=150" />
		<media:content url="http://gigaom2.files.wordpress.com/2012/01/gnip.jpg?w=150" medium="image">
			<media:title type="html">gnip</media:title>
		</media:content>

		<media:content url="http://2.gravatar.com/avatar/ed0d90bf7f6d9ccb90e0d71364b80349?s=96&#38;d=retro&#38;r=PG" medium="image">
			<media:title type="html">colleengigaom</media:title>
		</media:content>

		<media:content url="http://gigaom2.files.wordpress.com/2012/01/gnip.jpg" medium="image">
			<media:title type="html">gnip</media:title>
		</media:content>
	</item>
		<item>
		<title>What&#8217;s the right social cocktail for you?</title>
		<link>http://gigaom.com/2011/12/18/moody-gnip-social-cocktail/</link>
		<comments>http://gigaom.com/2011/12/18/moody-gnip-social-cocktail/#comments</comments>
		<pubDate>Sun, 18 Dec 2011 17:00:22 +0000</pubDate>
		<dc:creator>Chris Moody, Gnip</dc:creator>
				<category><![CDATA[Chris Moody]]></category>
		<category><![CDATA[Facebook]]></category>
		<category><![CDATA[Gnip]]></category>
		<category><![CDATA[Netflix]]></category>
		<category><![CDATA[online-social-networking]]></category>
		<category><![CDATA[social media]]></category>
		<category><![CDATA[Twitter]]></category>
		<category><![CDATA[wordpress]]></category>

		<guid isPermaLink="false">http://gigaom.com/?p=455744</guid>
		<description><![CDATA[The largest companies in the world are in process of figuring out how they can incorporate public social conversations into their daily business operations. Chris Moody from social media data company Gnip explains why social media for your company is not a one-size-fits-all. <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=455744&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p><a href="http://gigaom2.files.wordpress.com/2011/12/5510809888_094111804e_b.jpeg"><img  title="Cocktail" src="http://gigaom2.files.wordpress.com/2011/12/5510809888_094111804e_b-e1323993498473.jpeg?w=300&#038;h=200" alt="" width="300" height="200" class="alignleft size-medium wp-image-455745" /></a>Based upon the 30 billion public social activities we are delivering each month, I can confidently state that the largest companies in the world are in process of figuring out how they can incorporate public social conversations into their daily business operations.  From supply chain management to PR crisis management, the role of public social data in the enterprise is no longer framed around the question of “why does this data matter?”  That said, we are still in the very early stages of corporate adoption and there are plenty of unanswered questions for most companies.   Once enterprises get past asking why this data is important, the next obvious question to address is: which public social data is best for performing business analysis and decision-making?  Facebook?  Twitter?  Google+?, WordPress (see disclosure below)?</p>
<p>We’ve been trying to help our customers answer the “which data” question for the last couple of years by providing anecdotal insights via examples we’ve seen across the industry. Although this approach has provided reasonable guidance, we’ve recognized for a while that there was an opportunity to take a more systematic, research-based approach to answering the question. This summer, we hired a Data Scientist to help us analyze and understand the data needs across various business use cases. The early results suggest that there are at least two key attributes that play a role in answering the “which data” question — <em>reaction time</em> and <em>depth</em>.</p>
<h2><strong>Reaction time</strong></h2>
<p>From the launch of the next gadget to the death of Osama Bin Laden, significant portions of social conversations are based around events. By analyzing social conversations around specific events, results quickly emerge illustrating that some social networks have faster reaction times to events than others.  For example, we looked at the social conversations happening around Netflix on October 25<sup>th</sup>, which was the day after Netflix announced their most recent earnings.</p>
<p><a href="http://gigaom2.files.wordpress.com/2011/12/netflix1.jpg"><img  title="Netflix" src="http://gigaom2.files.wordpress.com/2011/12/netflix1.jpg?w=708" alt=""   class="aligncenter size-full wp-image-455749" /></a></p>
<p>As you would probably guess, Twitter reacted quickly to the news that Netflix opened down significantly. You can see from the chart that peak Twitter conversation happened within moments of the market opening and quickly trailed off.  Studying other conversational data sources such as WordPress it is clear that the overall reaction time was slower as compared to Twitter and the area of the conversation curve was much greater.  As you would expect, the reaction time for blog comments from WordPress significantly trailed the blogs themselves. It is interesting to note that peak Twitter activity corresponded to the opening bell where WordPress comments peaked well after the market closed.  I’m highlighting a very compressed event here, but we’ve studied enough events to see that these curves hold for slower developing events too such as political elections.</p>
<p>One other aspect of social sources as they relate to reaction times is whether an event was an expected event or an unexpected event.  The reaction time curves behave differently between a hurricane (expected natural disaster) and an earthquake (unexpected natural disaster), but I’ll have to save the details of this for a future blog post.</p>
<h2><strong>Depth</strong></h2>
<p>The amount of content that can be analyzed for insights across public social conversations varies significantly by source.  One of the key benefits of a source like Twitter is that the reaction times are fast which is great for business use cases requiring early signal detection.  However, the amount of content you can analyze for deeper insights on a single tweet payload itself is relatively concise.   On the flip side, sources like blogs, forums, and videos are more likely to be rich in opinion, sentiment, and engagement. In our Netflix example, Tweets such as “NFLX gaps down 35% on open!” tell you what happened, while blog posts like “How Netflix Lost 800,000 Members, and Good Will” have the deeper analysis to tell you why something happened.  Measuring depth is non-trivial, but there are lots of ways to get a feel for the depth of a network.  For example, one simple way to get a reasonable level of accuracy is to just look at the byte size of the various social activities.  Another way to gauge depth is to look at the area under the reaction time curve.  The bigger the area, the more likely you are to get a wide range of views and perspectives.</p>
<h2><strong>Mixing the perfect social cocktail</strong></h2>
<p>Which public social data is best for performing business analysis and decision-making?  The answer: it depends upon the business use case.</p>
<p><a href="http://gigaom2.files.wordpress.com/2011/12/clouds.jpg"><img  title="Clouds" src="http://gigaom2.files.wordpress.com/2011/12/clouds.jpg?w=708" alt=""   class="aligncenter size-full wp-image-455750" /></a></p>
<p>PR crisis management is typically very dependent on ultra fast reaction times so a source like Twitter can be great for early signal detection of a potential problem.  The same company might also be analyzing different public social conversations to inform their product development roadmap.   Millisecond reaction time for product development use cases isn’t typically a necessity.  In fact, a company may prefer in-depth analysis of historical conversation data over realtime conversations in order to make decisions about future products.  A far more important component for product development is the insight that can be gained from analyzing deep social conversations, opinions, etc.  One thing is clear from our early exploration; very few business use cases can be served completely by a single source of public social data.</p>
<h2><strong>Lots more work to do</strong></h2>
<p>This is just the beginning.  We are continuing to explore the role of different social data sources across different use cases.  Reaction time and depth are two important components, but we also recognize there are plenty of other variables to consider.  As we discover more we will continue to share our findings.  Our goal is to help businesses understand the appropriate social cocktail for the use cases they need to support.  Stay tuned …</p>
<p><em>Chris Moody is the President and COO at Gnip, a realtime social media data delivery company. He serves on the National Technical Advisory Board of Year Up, is an advisor to several technology startups, and is an active TechStars mentor.</em></p>
<p><strong>Disclosure:</strong> WordPress.com is backed by True Ventures, a venture capital firm that is an investor in the parent company of this blog, Giga Omni Media. Om Malik, founder of Giga Omni Media, is also a venture partner at True.</p>
<p><em><a title="Attribution License" href="http://creativecommons.org/licenses/by/2.0/">Image courtesy of</a> Flickr user <a href="http://www.flickr.com/photos/aoifemac/">aoife mac</a>.</em></p>
<br />  <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=455744&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" /><p><a href="http://pubads.g.doubleclick.net/gampad/jump?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=456289"><img src="http://pubads.g.doubleclick.net/gampad/ad?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=456289" /></a></p><p><strong>Related research and analysis from GigaOM Pro:</strong><br />Subscriber content. <a href="http://pro.gigaom.com/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=455744+moody-gnip-social-cocktail&utm_content=gigaguest">Sign up for a free trial</a>.</p><ul><li><a href="http://pro.gigaom.com/2011/04/finding-the-value-in-social-media-data/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=455744+moody-gnip-social-cocktail&utm_content=gigaguest">Finding the Value in Social Media Data</a></li><li><a href="http://pro.gigaom.com/2012/01/12-tech-leaders-resolutions-for-2012/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=455744+moody-gnip-social-cocktail&utm_content=gigaguest">12 tech leaders’ resolutions for 2012</a></li><li><a href="http://pro.gigaom.com/2011/11/connected-world-the-consumer-technology-revolution/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=455744+moody-gnip-social-cocktail&utm_content=gigaguest">Connected world: the consumer technology revolution</a></li></ul>]]></content:encoded>
			<wfw:commentRss>http://gigaom.com/2011/12/18/moody-gnip-social-cocktail/feed/</wfw:commentRss>
		<slash:comments>5</slash:comments>
	
		<media:thumbnail url="http://gigaom2.files.wordpress.com/2011/12/5510809888_094111804e_b-e1323993498473.jpeg?w=150" />
		<media:content url="http://gigaom2.files.wordpress.com/2011/12/5510809888_094111804e_b-e1323993498473.jpeg?w=150" medium="image">
			<media:title type="html">Cocktail</media:title>
		</media:content>

		<media:content url="http://1.gravatar.com/avatar/4411542bbd7a2a9a2fc2a1b38809e45c?s=96&#38;d=retro&#38;r=PG" medium="image">
			<media:title type="html">gigaguest</media:title>
		</media:content>

		<media:content url="http://gigaom2.files.wordpress.com/2011/12/5510809888_094111804e_b-e1323993498473.jpeg?w=300" medium="image">
			<media:title type="html">Cocktail</media:title>
		</media:content>

		<media:content url="http://gigaom2.files.wordpress.com/2011/12/netflix1.jpg" medium="image">
			<media:title type="html">Netflix</media:title>
		</media:content>

		<media:content url="http://gigaom2.files.wordpress.com/2011/12/clouds.jpg" medium="image">
			<media:title type="html">Clouds</media:title>
		</media:content>
	</item>
		<item>
		<title>Twitter is a stream, but it&#8217;s also a reservoir</title>
		<link>http://gigaom.com/2011/11/17/twitter-is-a-stream-but-its-also-a-reservoir-of-data/</link>
		<comments>http://gigaom.com/2011/11/17/twitter-is-a-stream-but-its-also-a-reservoir-of-data/#comments</comments>
		<pubDate>Thu, 17 Nov 2011 23:07:48 +0000</pubDate>
		<dc:creator>Mathew Ingram</dc:creator>
				<category><![CDATA[Analysis]]></category>
		<category><![CDATA[data]]></category>
		<category><![CDATA[datasift]]></category>
		<category><![CDATA[Gnip]]></category>
		<category><![CDATA[ThinkUp]]></category>
		<category><![CDATA[Twitter]]></category>

		<guid isPermaLink="false">http://gigaom.com/?p=441342</guid>
		<description><![CDATA[Twitter may be an ever-flowing stream of information, but as it becomes a more mainstream source of news and commentary it also becomes a huge reservoir of data that can be analyzed, and that's what startups like ThinkUp and DataSift and Gnip are trying to do <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=441342&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" />]]></description>
				<content:encoded><![CDATA[<p><a href="http://gigaom2.files.wordpress.com/2011/03/1804295568_5b2235ab33_z.png"><img  title="1804295568_5b2235ab33_z" src="http://gigaom2.files.wordpress.com/2011/03/1804295568_5b2235ab33_z.png?w=300&#038;h=200" alt="" width="300" height="200" class="alignleft size-medium wp-image-324770" /></a></p>
<p>The idea of a stream of constantly changing real-time information wasn&#8217;t invented by Twitter, but it&#8217;s <a href="http://gigaom.com/2011/04/25/the-future-of-media-storify-and-the-curatorial-instinct/">probably one of the closest approximations of that idea for many users</a>. To some extent, the appeal is the same as any stream: to watch it flow by, to step into it now and then. But there&#8217;s also a lot of potential value in that stream if you could capture it and analyze it, and that &#8216;s where a number of startups and services are focusing their gaze, including <a href="http://thinkupapp.com/">ThinkUp</a> &#8212; which just launched a 1.0 version &#8212; and DataSift, which <a href="http://www.readwriteweb.com/archives/what_a_tweet_can_tell_you.php">also just launched</a>. And Gnip plans to sell data from the Twitter firehose to analysts and traders who want to tap into <a href="http://blog.gnip.com/launching-gnip-marketstream-partnership-with-stocktwits/">the zeitgeist of the Twitter-sphere</a>.</p>
<p>ThinkUp is an app designed by former Lifehacker editor Gina Trapani, and comes from <a href="http://expertlabs.org">Expert Labs</a>, the non-profit technology incubator and advisory group run by Anil Dash that has helped the Obama administration (among others) figure out how to use digital technology for social purposes (Dash <a href="http://gigaom.com/2011/06/03/what-media-companies-need-to-learn-from-startups/">also runs a consulting firm called Activate media</a>). When installed by an individual user or company, it takes in data from Twitter accounts &#8212; as well as Facebook pages and Google+ accounts &#8212; then makes it easy to see patterns or to analyze the effectiveness of certain tweets or updates.</p>
<h2>ThinkUp tracks and analyzes, but also archives</h2>
<p>I&#8217;ve been using the app for several months now, and it&#8217;s quite fascinating to see the amount of data available. (<a href="http://www.mathewingram.com/thinkup/">You can see some of my data here if you are interested</a>.) The dashboard shows the most retweeted content, the times of day when tweets get the most activity, the individual users who respond most, and provides all kinds of charts and graphs for presenting that information visually. For me it&#8217;s mostly curiosity, but if you&#8217;re running a corporate account, I can see how this kind of data would be hugely useful (<a href="http://techpresident.com/blog-entry/thinkup-wild">the White House has been using it for some time</a>) &#8212; and you can export and even embed it easily, since ThinkUp has an open API.</p>
<p><a href="http://gigaom2.files.wordpress.com/2011/11/screen-shot-2011-11-17-at-5-17-33-pm.png"><img  title="Screen Shot 2011-11-17 at 5.17.33 PM" src="http://gigaom2.files.wordpress.com/2011/11/screen-shot-2011-11-17-at-5-17-33-pm.png?w=708" alt=""   class="aligncenter size-full wp-image-441346" /></a></p>
<p>Although the information and insights are important, both Dash and <a href="http://lifehacker.com/5859873/thinkup-archives-and-analyzes-your-social-media-life">Trapani also mentioned</a> another potential benefit of ThinkUp: It acts as an ongoing archive of all your content, whether it&#8217;s tweets or retweets or status updates or even photos and videos. As Dash points out, <a href="http://dashes.com/anil/2011/11/thinkup-1.0.html">with any content you upload to a social network of some kind, there&#8217;s a very real risk it will one day disappear</a>. And while Facebook and Google let you download your data, Twitter doesn&#8217;t provide any way of getting tweets you might have posted in the past. <a href="http://gigaom.com/2011/06/01/new-twitter-search-is-nice-but-still-needs-work/">The company&#8217;s search only goes back about a week</a>, and even services like Topsy are less than perfect if you want to find a specific message. Says Dash:</p>
<blockquote><p>The companies behind these networks can, and someday will, destroy all of those moments. Delete them from the record. Forever. With no advance notice&#8230; history shows us that it happens. Over and over and over. The clips uploaded to Google Videos, the sites published to Geocities, the entire relationships that began and ended on Friendster: They&#8217;re all gone.</p></blockquote>
<p>In addition to the archiving aspect, however, the really powerful feature that services like ThinkUp can offer is the ability to spot patterns in your Twitter or other social-networking activity. Looking at this data over time could help identify all kinds of different things, particularly for corporate users &#8212; what content produced a response and when, who the influencers with respect to your content are. (In what seems to be a veiled reference to Klout&#8217;s ranking of users, Dash <a href="http://dashes.com/anil/2011/11/thinkup-1.0.html">also said ThinkUp &#8220;does not, and will never display some arbitrary score to your profile.&#8221;</a>)</p>
<h2>DataSift and Gnip also filter and resell the firehose</h2>
<p>That&#8217;s also the idea behind more ambitious data-filtering services such as DataSift, which was started by British programmer Nick Halstead, which got access to the Twitter firehose as part of a deal with Twitter when it <a href="http://techcrunch.com/2010/08/12/twitter-tweet-button/">took over the retweet button he created as part of his startup Tweetmeme</a>. DataSift uses semantic filtering to detect patterns in the Twitter stream and is aiming its service at corporations and brands that want to see what kind of reaction their content is getting in social networks (DataSift currently filters just Twitter, but plans to add Facebook and Google+). DataSift launched on Thursday, <a href="http://gigaom.com/2011/07/11/datasift-twitter-funding/">and is backed by GRP Partners and IA Ventures</a>.</p>
<p>The other company that has access to the full Twitter firehose of data is Gnip, which <a href="http://blog.gnip.com/gnip-twitter-partnership/">signed a deal with Twitter to resell that data to companies last year</a>. And Gnip on Thursday announced a partnership with StockTwits (see disclosure below) to provide a feed of both Twitter data and related information from the StockTwits investment community <a href="http://blog.gnip.com/launching-gnip-marketstream-partnership-with-stocktwits/">to traders and venture funds who are trying to find patterns in that social activity</a> around stocks or companies. At least one hedge fund has <a href="http://www.bloomberg.com/news/2010-12-22/hedge-fund-will-track-twitter-to-predict-stockmarket-movements.html">an entire trading strategy that is based on an analysis</a> of Twitter and sentiment related to stocks and the markets.</p>
<p>Not that long ago, Twitter was seen as mostly a social plaything, but as it has become a crucial player in everything <a href="http://gigaom.com/2011/01/29/twitter-facebook-egypt-tunisia/">from the revolutions of the Arab Spring</a> to the planning and scheduling of television events like the Oscars, it has become more obvious that there is value in that stream, provided you have the right filters.</p>
<p><em><strong>Disclosure</strong>: StockTwits is backed by True Ventures, a venture capital firm that is an investor in the parent company of this blog, Giga Omni Media. Om Malik, founder of Giga Omni Media, is also a venture partner at True.</em></p>
<p><em>Post and thumbnail photos <a href="http://creativecommons.org/licenses/by-sa/2.0/deed.en">courtesy</a> of Flickr user <a href="http://www.flickr.com/photos/15237218@N00/2218489999/">Luc Legay</a></em></p>
<br />  <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=gigaom.com&#038;blog=14960843&#038;post=441342&#038;subd=gigaom2&#038;ref=&#038;feed=1" width="1" height="1" /><p><a href="http://pubads.g.doubleclick.net/gampad/jump?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=933629"><img src="http://pubads.g.doubleclick.net/gampad/ad?iu=/1008864/GigaOM_RSS_300x250&#038;sz=300x250&#038;c=933629" /></a></p><p><strong>Related research and analysis from GigaOM Pro:</strong><br />Subscriber content. <a href="http://pro.gigaom.com/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=441342+twitter-is-a-stream-but-its-also-a-reservoir-of-data&utm_content=mathewingram">Sign up for a free trial</a>.</p><ul><li><a href="http://pro.gigaom.com/2012/08/data-markets-in-search-of-new-business-models/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=441342+twitter-is-a-stream-but-its-also-a-reservoir-of-data&utm_content=mathewingram">Data markets: in search of new business models</a></li><li><a href="http://pro.gigaom.com/2012/08/flash-analysis-is-twitter-on-the-cusp-of-building-a-business/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=441342+twitter-is-a-stream-but-its-also-a-reservoir-of-data&utm_content=mathewingram">Readers weigh in: future prospects for Twitter</a></li><li><a href="http://pro.gigaom.com/2012/03/4-ipad-apps-to-help-wrangle-data/?utm_source=tech&utm_medium=editorial&utm_campaign=auto3&utm_term=441342+twitter-is-a-stream-but-its-also-a-reservoir-of-data&utm_content=mathewingram">4 iPad apps to help wrangle data</a></li></ul>]]></content:encoded>
			<wfw:commentRss>http://gigaom.com/2011/11/17/twitter-is-a-stream-but-its-also-a-reservoir-of-data/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
	
		<media:thumbnail url="http://gigaom2.files.wordpress.com/2011/03/1804295568_5b2235ab33_z.png?w=150" />
		<media:content url="http://gigaom2.files.wordpress.com/2011/03/1804295568_5b2235ab33_z.png?w=150" medium="image">
			<media:title type="html">1804295568_5b2235ab33_z</media:title>
		</media:content>

		<media:content url="http://0.gravatar.com/avatar/0bdf7ab171ade0708a11fa3378e6d8cb?s=96&#38;d=retro&#38;r=PG" medium="image">
			<media:title type="html">Mathew</media:title>
		</media:content>

		<media:content url="http://gigaom2.files.wordpress.com/2011/03/1804295568_5b2235ab33_z.png?w=300" medium="image">
			<media:title type="html">1804295568_5b2235ab33_z</media:title>
		</media:content>

		<media:content url="http://gigaom2.files.wordpress.com/2011/11/screen-shot-2011-11-17-at-5-17-33-pm.png" medium="image">
			<media:title type="html">Screen Shot 2011-11-17 at 5.17.33 PM</media:title>
		</media:content>
	</item>
	</channel>
</rss>
