The largest players in the Hadoop market are already raising money and sky-high valuations, employing hundreds of people and, in some cases, looking at nine-figure revenues. If you’re trying to get a sense of whether Hadoop is for real, these details might help. Read more »
The growth of public and private cloud services places new demands on the IT organization, particularly when it comes to the scale, agility and management of the data center. SDNs are a response to those demands, providing opportunities for IT managers to improve their network operations. Read more at GigaOM Pro »
Facebook has open sourced a new system called Corona for scheduling and managing Hadoop jobs. Corona attempts to do away with many of the problems that come along with massive-scale Hadoop operations, and soon looks to take Facebook’s Hadoop deployment beyond just MapReduce. Read more »
Mobile-application development specialist Appcelerator bought big data startup Nodeable on Wednesday, although the deal wasn’t exactly what Nodeable was planning for when it launched in 2011. Founder and CEO Dave Rosenberg shares some of the lessons he learned trying to break into the big data space. Read more »
Guess what, accurately predicting the outcomes of elections really isn’t a partisan affair. What Nate Silver and several others accomplished in perfectly predicting the election isn’t about finding data to support their desired outcomes. It’s about processing reams of imperfect data and figuring out what matters. Read more »
There’s shift happening in the world of online data collection, meaning consumers might expect to get paid for access to their data rather than always playing the role of uncompensated mark. Done right, it’s a system where both sides of the equation stand to win. Read more »
The delivery of real-time query makes Hadoop accessible to more users — and by orders of magnitude. Its significance goes well beyond delivering a database management system (DBMS) kind of query engine that other products have had for decades. Rather, Hadoop as a platform now supports a whole new paradigm of analytics. With the introduction of real-time query, Hadoop has taken a major step toward unifying the majority of big data analytic applications onto one platform. This research paper targets information technology professionals who have in-depth experience with traditional RDBMS and seek to understand where the Hadoop ecosystem and big data analytics fit. Read more at GigaOM Pro »
Hack/reduce will launch its cool new work space near Cambridge’s Kendall Square on Thursday. The goal of the effort is to bring together the best big data people from private and public sectors and academia to train up the next generation of data scientists. Read more »
It’s one day before the presidential election, and the results from computer models and other data analyses are in, with most experts giving President Obama a higher probability of winning than challenger Mitt Romney. That’s no lock, however: while data doesn’t lie, models sometimes do. Read more »
BillGuard, a crowd-sourced financial protection service that flags suspicious activity for consumers, is taking its services to mobile wallet app Lemon, which has 2.5 million users on iOS and Android. Now, Lemon users can check their balance on stored cards, see recent transactions and suspicious activity. Read more »
In just a few years, big data has turned from a buzzword and concept best left for large web companies into a force that drives much of our digital lives. Here are five technological trends that will change how data is processed and consumed going forward. Read more »
App analytics and advertising firm is raising $25 million from Crosslink Capital as it builds out internationally and looks at a possible IPO by the second half of 2013. The company is riding the boom in mobile as more consumers turn to smartphones and tablets. Read more »
A new research paper from Google highlights the importance of big data in creating consumer-friendly services such as voice search on smartphones. More data helps train smarter models, which can then better predict what someone say next — letting you keep your eyes on the road. Read more »
Forget what comes after infinity, we at GigaOm were worried about a smaller problem, namely what comes after a yottabyte. Well now we know the answer to that problem — a 1 followed by 27 zeros (a yottabyte only has 24 zeros), otherwise known as a brontobyte. Read more »
EMC is beefing up its RSA security division with the planned acquisition of big-data-focused startup Silver Tail Systems. The company’s software detects malicious activity by monitoring and analyzing site visitors’ behavior in order to determine whether it’s harmless or potentially harmful. The company claims multiple large […] Read more »
Sandy is certainly living up to its promise as a destructive force, but it’s also serving as a teaching tool for companies whose business is big data. They’re releasing new dashboards, products and case studies demonstrating how data analysis before can save lives and money later. Read more »
Rackspace is busy building a Hadoop service, giving the company one more avenue to compete with cloud kingpin Amazon Web Services. However, the two services — along with several others on the market — highlight just how different seemingly similar cloud services can be. Read more »
Tictrac, a U.K.-based startup, integrates with data from a range of third-party apps and tools — from those that monitor health and activity to those that track social activity and fundraising — to help users make the most of their personal data. Read more »
Dell is donating an ARM-based server to the Apache Software Foundation so contributors can test their projects on new, energy-efficient hardware architectures. Big data projects such as Hadoop and Cassandra are low-hanging fruit, but many webscale applications likely could use them to save power. Read more »
Cloudera has joined the fray of Hadoop companies trying to turn the big data platform into an engine for exploring data interactively using standard SQL. As the biggest company in the space, its new technology called Impala could go a long way toward changing Hadoop’s image. Read more »
Former Yahoo cloud VP Todd Papaioannou and Facebook engineer Jonathan Gray are trying to big data for programmers with a new platform service called Continuuity. It’s a development environment and runtime layer that sits atop a company’s Hadoop infrastructure and abstracts the complexity of writing apps. Read more »
EMC’s Greenplum division hopes to encourage users of its Chorus big data application to reach out to the Kaggle community of data scientists to do real-world work. The company also inked partnerships with Gnip and Tableau and open-sourced a version of Chorus. Read more »
Analytics startup Platfora is finally showing off its next-generation business intelligence software to the world, combining Hadoop, in-memory processing and HTML5 into an impressive product. It’s entering a competitive market full of large incumbents and other innovative startups all trying to change how we do BI. Read more »
BloomReach, which offers a big data parsing service that etailers can use to juice their web sites, netted $25 million in new funding which it will use to boost both sales and marketing and research and development efforts. Read more »
Analytics is not a new field, but its evolution into ‘big data’ shows how much of a growth industry it is. That means facing up to issues such as the need for talent and good models. Read more »
The cloud is a great thing when it comes to storing large quantities of data, but getting it into and out of cloud-storage services can be difficult. Technologies that speed that process up can allow for new uses of that data, says Aspera CEO Michelle Munson. Read more »
Hadoop is getting closer to business intelligence thanks to a slew of new products ranging from a SQL database built atop Hadoop to an appliance packaging the two alongside a full complement of servers. On Wednesday, Birst, Teradata and Splice Machine got into the act. Read more »
Datasift, the UK company that has access to the Twitter firehose analyzes petabytes of tweets and ships terabytes of insights around the world. And the infrastructure needs to keep up. That and dark social were topics of interest today at Structure:Europe. Read more »
Although older generations might still view cloud computing as an emerging trend, their children take it for granted, largely forgoing physical devices for cloud services. We might as well come get on board and maybe change the world in the process. Read more »
A new study shows that the BBC and the New York Times have the most reach and influence on Twitter among news organizations. The findings are just a taste of what we can expect as researchers apply data-based network analysis to patterns of news consumption. Read more at paidContent »
Hadoop startup Hadapt has made its unified Hadoop-and-SQL analytic architecture even easier by adding native advanced analytic functions and integrating tightly with Tableau’s powerful BI software. It’s a sign of things to come as Hadoop and traditional SQL-based BI become cozy across the board. Read more »
According to Equinix CTO Lane Patterson, CIOs are still learning what can and what can’t be done in the cloud. Ultimately, it’s a matter of trust. Read more »
Europe’s Helix Nebula project is addressing the technical, legal, and procedural issues that today make it difficult to seamlessly move jobs from one cloud to another at scale. Lessons learned from it could provide a window through which we can see Europe’s cloud provision taking shape. Read more at GigaOM Pro »
The usual suspects Amazon and VMware made significant announcements in cloud in the third quarter, while Hadoop remained the talk of the town in big data. Emerging trends in software-defined networking and flash storage stirred up lots of M&A and venture investment in the quarter. Read more at GigaOM Pro »
The big data revolution is in its early innings, and it is about to get even more exciting. Ravi Mhatre, managing director at Lightspeed Venture Partners, discusses the disruptive innovations that are helping make data fast, intuitive and easy to analyze. Read more »
In the new app economy, organizations no longer own all the data they need to make accurate business decisions. This loss of control requires data marketplaces and data syndication models that few enterprises are currently prepared for. Apigee’s Anant Jhingran looks at three important steps that companies need to take to succeed in the app economy. Read more »
Social data pulled from online health forums and the comments section of blogs is helping patients learn about side effects to various drugs and could ultimately help them figure out the medications that suit them best. Read more »
A team of University of Notre Dame researchers has developed an algorithm for solving Sudoku puzzles that doesn’t require it to guess at all. Rather, it’s able to discern patterns even with sparse available information and automatically determine which numbers go where. Read more »
Rent prices are higher than ever, but a growing number of startups are working to analyze our homes’ energy use so we can save money by using less power. Their approaches might differ, but data and analytics are the ties that binds them all. Read more »
A handful of leaders in health data suggest that data-driven personalized health approaches could achieve mainstream adoption in five years, with some saying valuable but intermittent work could happen even sooner. Read more »
