Cloud computing and big data are in the enterprise to stay, but making the most of them presents challenges for IT decision makers. The future belongs to those companies who can work through legacy tools, ongoing security issues and the data scientist shortage. Read more at GigaOM Pro »
A new Portable Consent Form could make it easier — and more palatable — for individuals to donate their anonymized genetic data to science at large. The goal of the Consent to Research project is nothing less than the open-sourcing of the genetic data pool. Read more »
There are now more than half a dozen commercial Hadoop distributions in the market, and almost every enterprise with big data challenges is tinkering with the Apache Foundation-licensed software. A new report examines the key disruptive trends shaping the Hadoop platform market. Read more at GigaOM Pro »
If you don’t think venture capitalists and other investors love all things big data, think again. In the past three days alone, companies claiming some connection to big data — either analyzing and/or storing large volumes of data — have announced at least $56 million in new funding. Read more »
IBM’s big data platform will support the Cloudera Hadoop distribution, a surprising decision given the reservations the two companies had expressed about each other before. That gives IBM and rival Oracle at least one thing in common: Oracle’s Big Data Appliance runs Cloudera too. Read more »
It’s beginning to look like there will be no free-standing analytics companies left. IBM is buying Vivisimo for the “discovery and navigation” expertise that companies use to access and analyze (what else?) big data. The news come a week after IBM bought Varicent, another analytics company. Read more »
VMware has acquired Cetas, a startup that provides analytics atop the Hadoop platform. Terms of the deal haven’t been disclosed, but Cetas is an 18-month-old company with tens of paying customers that didn’t need to rush into an acquisition. So, why did VMware buy it? Read more »
DataPop, a startup using big data to deliver custom online ads, has raised a $7 million Series B round. The company’s technology uses big data techniques such as natural-language processing and semantic association to automatically generate online ads based on what a web user has searched for. Read more »
Big data and the marketing world go together like peanut butter and jelly. Marketers want to present their brands in the most-effective manner possible and always put the right ad in front of the right person. Big data makes that possible at a whole new level. Read more »
Big data meets the quantitative self with a project to collect every heartbeat for science. Dr. Leslie Saxon wants everyone to send in their heartbeat data to a website to create a database to track heart health. Such a database could help predict heart health. Read more »
Already a heavy user of Apache Software Foundation projects, Twitter is now giving back to the organization financially as a sponsor. It’s difficult to think of a situation where Apache sponsorship wouldn’t be the right move and, it’s definitely the right thing for Twitter to do. Read more »
The highly anticipated Splunk IPO has not disappointed, with shares up 90 percent from their opening price at one point. Intense trading tripped NYSE circuit breakers. Surging interest in Splunk reflects a belief that the era of big data is just beginning. Read more »
Ravel Data, a promising big data startup best known for its open source graph database called GoldenOrb, has sold its assets to marketing-and-communications firm W2O Group. According to sources, the company had been winding down for about a month after expanding faster than business actually demanded. Read more »
This quarter saw Amazon Web Services finally relaxing its public-cloud-only stance and launching services to support hybrid-cloud deployments. Meanwhile, Hadoop players moved to make their platforms more accessible to mainstream BI analysts and database administrators. A new quarterly report analyzes these trends and provides a near-term outlook. Read more at GigaOM Pro »
Skybox Imaging, a startup that wants to capture and analyze high-resolution photos and videos of the Earth, has raised $70 million in Series C funding. The money will help Skybox its lineup of software engineers and data scientists that might be its secret sauce. Read more »
PureDiscovery, a Dallas-based big data startup, thinks it has the has the answer to outdated enterprise search technology, and it’s called BrainSpace. Its goal is to let users find information that matters without having to search for it, to bring data to users. Read more »
If you’re an amateur poet and love big data, high-performance system vendor AMAX has a deal for you. The company is conducting a contest to find the best haiku on big data. But I’m sharing my poems right here. Read more »
The desire for more and increasingly specific analytics continues with IBM’s acquisition of Varicent Software. Banks, insurance companies, and retailers use Varicent software to look at data across finance, sales, human resources and IT departments to determine how to boost sales, according to IBM. Read more »
The Atlantic recently published an article on what politicans know about voters, complete with market research data that breaks down consumer preferences by poltical party and likely turnout on voting day. There are some strong associations that lack political explanations. I want to know why. Read more »
The headline might sound like buzzword stew, but it couldn’t be any truer. For companies willing to make the leap to cloud services, there will be a lot of companies willing to make big data as easy as paying your bill every month. Read more »
After years of beating around the bush, SAP declares that it is a database company and will take on the biggest kid on the block. It’s about time. It’s funding startups to build applications for Hana and Sybase. But beating Oracle won’t be easy. Read more »
For years, Oracle has wowed Wall Street with fat software margins: Large companies depending on Oracle relational databases pay what it takes to keep them up and running. It’s unclear whether Oracle can carry that dominance over into the Big Data era, however. Read more »
Dataminr, a New York-based start-up that has been quietly building a global sensor network powered by Twitter, is now introducing its technology to the public today, showing how its real-time engine can act as an early warning system for enterprise and government customers. Read more »
If your organization doesn’t have a strategy for big data now, you will need one in the future. Here we discuss the difference between big data and traditional business intelligence, as well as the considerations executives should take into account as they plan their big data strategies. Read more at GigaOM Pro »
Social and mobile analytics startup Kontagent has expanded its business to include a data-mining service powered by Hive, the SQL-like interface for querying data stored within Hadoop. It’s a smart move by the company, and one that other cloud-based analytics providers would be wise to replicate. Read more »
The federal government talked a lot about grand scientific visions when it unveiled its big data agenda last week, but the government has consumers on its mind, too. Specifically, it doesn’t want to unduly hinder innovation, and it might even be willing to provide data. Read more »
If you have a lot of unstructured data, don’t have (or want) a Hadoop cluster and can write Python jobs, Mortar Data has got the service for you. The New York-based startup is jumping into the fray with possibly the most lightweight Hadoop service yet. Read more »
I loved this talk by Jer Thorp, currently the data-artist-in-residence at the New York Times. His work has appeared in my publications but it is the first time I have seem him speak about humanizing data. This talk for Tedx Vancouver is highly recommended. Read more »
Managed hosting provider Sungard is getting into the big data space with a new Hadoop service that gives users on-demand access to the popular data-storage and processing platform. Called Unified Analytics Service, Sungard’s new offering joins the growing ranks of cloud-based Hadoop offerings. Read more »
An effort to build a telescope that can see back 13 billion years to the creation of the universe is prompting a five year €32 million ($42.7 million) effort to create a low-power supercomputer and networks to handle the data the new telescope will generate. Read more »
Violin Memory is a force to be reckoned with in the storage world. It’s not just the industry shift toward solid-state drives replacing slower, less-efficient hard disk drives that’s driving Violin’s value through the roof, though, it’s also the company’s very strategic set of investors. Read more »
By pumping hundreds of millions of dollars into big data research and development, the Obama administration thinks it can push the current state of the art well beyond what’s possible today, and into entirely new research areas. It’s a noble goal, but also a necessary one. Read more »
The White House released the details of its $200 million-plus annual big data strategy, which includes lots of access to funding and data for researchers.The administration is banking on big data having revolutionary effects on par with the Internet, which federal dollars financed decades ago. Read more »
Big data must really be big to get its own White House-sanctioned research and development initiative. The White House Office of Science and Technology Policy will host a live webcast Thursday to outline how the government can “help big data” efforts. Read more »
If you’ve ever wondered what would happen if the top two teams in the Netflix Prize competition united and put their predictive analytics skills to work together, you’ll soon find out. On Tuesday, big data service provider Opera Solutions acquired Austrian predictive analytics specialist Commendo. Read more »
Key to understanding big data is to move beyond simply examining the technology for data storage and analytics engines. Organizations preparing for a data-centric economy should also examine the roles of data quality, data obesity and data markets in the future of modern enterprises. Read more at GigaOM Pro »
In the latest dispatch from the too-much-information bureau, on-demand ride service Uber has calculated the prevalence of one-night stands among its customer base. It’s another example of what companies can find out if they’re just able to think of the right questions. Read more »
The technological hurdles to embracing big data are well-known at this point, but strong anti-data corporate culture might be an even bigger obstacle. The changes required to listen to the data and, possibly, to transform a company’s business model take a lot of work. Read more »
The problem for many companies is that user information is spread across hundreds or even thousands of different fields in various databases, and it’s difficult to compile it in real time. But doing that successfully is becoming increasingly important, says WiBiData at Structure:Data. Read more »
“Anticipation denotes intelligence.” Zubin Dowlaty, VP and head of innovation and development of analytics-outsourcing firm Mu Sigma, said at Structure:Data that’s what companies need to be striving for and in this era of big data, the barriers to achieving that have fallen away. Read more »
