Science has a data problem, There’s been a rash of experiments that no one can reproduce and studies that have to be retracted, But there are some nascent efforts to address this credibility crisis by changing the way the data is handled. Read more »
There’s an epidemic going on in science: experiments that no one can reproduce, studies that have to be retracted, and the emergence of a lurking data reliability iceberg. Read more »
Few companies today have the time or the analytics expertise to apply statistics and complex data modeling to regular or even daily business decisions and operations. Now, however, an ecosystem of companies is emerging to fill this need. Read more at GigaOM Pro »
Data-warehouse providers are quickly adding Hadoop distributions, or even their own versions of Hadoop, into their architecture, adding further cost advantages to collections of extremely large data sets. Finding the talent to manage this newly converged environment will not be easy, but it presents tremendous opportunity for companies willing to take some risk. Read more at GigaOM Pro »
Cloud computing is finally starting to add value to business, as those in charge of cloud within enterprises are moving from talking to doing. That much was very evident in the first quarter of 2013. Read more at GigaOM Pro »
Companies are rushing to embrace the promise of big data to understand both their businesses and the ways in which customers interact with them. But effective data-based decisions are not made in response to simplistic data reporting; they are made in response to considered and ongoing data analysis. Read more at GigaOM Pro »
Helping to redefine this talent management is workforce analytics, a powerful combination of highly sophisticated computer algorithms and predictive models. Linking this market to business success can help HR professionals convince corporate bean counters to bankroll the crunching of human-capital data. Read more »
Damian Black, CEO of SQLstream, talks about why data flow computing is experiencing a rebirth and what it could mean for scaling in the cloud. Read more »
There’s been something of a perfect storm in the data world over the past several years. Companies are sitting on more data than ever before, yet it’s never been easier or cheaper to analyze all that information to solve problems and create new business opportunities. Read more »
Preserving consumer trust gets a lot of lip service. But a new report from the World Economic Forum actually attempts to translate its value into dollars and cents. Read more »
This quarter saw Amazon Web Services finally relaxing its public-cloud-only stance and launching services to support hybrid-cloud deployments. Meanwhile, Hadoop players moved to make their platforms more accessible to mainstream BI analysts and database administrators. A new quarterly report analyzes these trends and provides a near-term outlook. Read more at GigaOM Pro »
Big data today, is what the web was in 1993. We knew the web was something and that it might get big, but few of us really understood what “big” meant. Today, I believe we aren’t even scratching the surface of the big data opportunity. Read more »
When Amazon Web Services launched AWS Storage Gateway last month, the move seemed logical, almost expected. Carlos Escapa, CEO of VirtualSharp Software, argues that the real challenge lies not in restoring data, but in recovering services when disaster strikes. Read more »
For the most part, cloud-related laws on the books or in the works right now are almost entirely about data, and data has “gravity.” The more important it is, the more likely services and applications are going to move to the data, rather than vice versa. Read more »
Pentaho is moving its business intelligence tools to the Apache license to make them more compatible with big data technologies that already operate under that license. Pentaho’s Kettle extract, transform, load (ETL) technology was previously available under the LGPL or lesser Gnu General Public License. Read more »
Big data has become a big buzzword. But for companies to benefit from it, they need more than technology – they need a plan. Consultant Chad Richeson has developed seven steps to help business leaders make sure their big data strategy delivers the results they want. Read more »
One of the year’s largest smart grid conferences — DistribuTECH — closes today in San Antonio, Texas. It’s like the CES for utilities, power companies and the vendors that are trying to sell them stuff. Here are the top 10 trends I took away. Read more »
There has been a remarkable flowering of companies over the past year or two, all riding a wave of developer and investor enthusiasm for the loosely defined concept of “big data.” But given that the big data startup market is probably overvalued and headed for a ... Read more at GigaOM Pro »
Shaw, a Canadian ISP said this week that its movies and on demand service would be exempt from its data caps. Such a move places Shaw’s upcoming Movie Club service at an advantage to a competitive movie streaming service such as Netflix. Read more »
Hadoop has been used by large web companies for applications such as search engines, but the reality is that the project is so much more. This report takes a closer look, examining what Hadoop is (and isn’t), who’s doing what to productize it and why we can expect to see the market pick up serious steam in 2011. We profile the growing number of companies — from startups like MapR to Cloudera, the arguable leader in the space — using Hadoop, the challenges still hindering widespread adoption and where potential users can expect the market to go as we move through 2011 and beyond. Companies mentioned in this report include Yahoo, Facebook, EMC, Teradata and Appistry. For a full list of companies, and to read the full report, sign up for a free trial. Read more at GigaOM Pro »
Utilities are going to have to manage nine times the data they do today if they want to adapt to the smart grid, and that will be a $34 billion market by 2020, Lux Research predicts. Read more »
If you pay attention to the energy sector, then you’ve witnessed the recent parade of home energy management software launched by startups, huge IT firms and veteran electrical meter companies. With firms like Microsoft, Google and, most recently, GE entering the home energy management software space, ... Read more at GigaOM Pro »
