Netflix dives into AWS usage monitoring with Ice
Very few Amazon Web Services customers know that infrastructure better than Netflix. Now it’s open sourcing its tool for tracking AWS use and spending. Read more »
A real-time bonanza: Facebook’s Wormhole and Yahoo’s streaming Hadoop
photo: Shutterstock / agsandrew
This week, both Facebook and Yahoo detailed new efforts to manage real-time data flows within their myriad systems. Yahoo’s work is an open source implementation of Storm designed to run on the same cluster as Hadoop and even share resources. Read more »
IBM throws its weight behind MongoDB for mobile apps
IBM and 10gen are collaborating on a standard that would make it easier to write applications that can access data from both MongoDB and relational systems such as IBM DB2. Read more »
Cloudera adds search to Hadoop distro and says it’s just getting started
Cloudera’s new search feature, based on the Apache Solr project, is the latest move by the company to expand the utility of its Hadoop distribution. It’s also far from the last. Read more »
WibiData gets $15M to help it become the Hadoop application company
photo: Christophe Bisciglia (left) and Aaron Kimball (right)
Startup WibiData has raised another $15 million and wants to turn the lessons it has learned in the field into generic software that can let anyone build predictive applications on Hadoop. Read more »
Concurrent is building a Hadoop assembly line in open source
photo: Shutterstock / PENGYOU91
Cascading creator Concurrent has developed a new open source tool called Pattern for running machine learning models on Hadoop clusters. When combined with its SQL tool called Lingual, users can move data from one stage to another easily. Read more »
We’re witnessing the rise of the graph in big data
Graph databases and graph-processing applications have been popping up all over the place lately, and now they’re starting to go commercial. On Tuesday, popular open source project GraphLab joined the ranks of graph startups. Read more »
The promise of better data has MetLife investing $300M in new tech
MetLife is building new products on new technologies thanks to a $300 million investment in new technology and new skills. One of the first products is a MongoDB-based app that puts all of customers’ information in one place. Read more »
MapR releases M7, its commercial HBase distro
photo: Shutterstock / concept w
MapR on Wednesday released its commercial version of HBase called M7, the first such product on the market, that the company claims is bigger, faster and better than the open source version. Read more »
With Impala now GA, Cloudera’s CEO sizes up the SQL-on-Hadoop market
Cloudera’s Impala engine for interactive SQL queries on Hadoop data is now generally available, and CEO Mike Olson gives his lay of the competitive landscape. Read more »
Welcome to Berkeley: Where Hadoop isn’t nearly fast enough
photo: AMPLab
Hadoop not fast enough for you? Then you might want to get to know AMPLab, a University of California, Berkeley team developing faster versions of many core Hadoop components. Read more »
Subscriber Content
Cloud and data first-quarter 2013: analysis and outlook
Cloud computing is finally starting to add value to business, as those in charge of cloud within enterprises are moving from talking to doing. That much was very evident in the first quarter of 2013. Read more at GigaOM Pro »
‘Linux of online learning’ gets stronger: edX and Stanford team up to build open source platform
Despite its initial efforts at building its own open-source online learning platform, Stanford said it will fold that platform into the edX platform launched by Harvard and MIT. Read more »
Facebook builds a database benchmark for a graph-powered world
Facebook has built a new open source tool for benchmarking graph databases, called LinkBench. And although the chances are your infrastructure and workloads look nothing like Facebook’s, the good news is LinkBench was built with configurability in mind. Read more »
Big, open data: MapR on Github and Yelp’s dataset challenge
MapR is releasing open source code and partnering with Canonical on Ubuntu, while Netflix is releasing some data for for developers to play with. Sounds like a good day for openness. Read more »
Concurrent gets $4M for higher-level Hadoop
photo: Concurrent CTO Chris Wensel
Cascading proprietor Concurrent has secured $4 million in venture capital in order to advance its efforts toward easing the development of big data applications. Read more »
Storage player Basho open sources Riak CS
Riak CS distributed cloud storage technology has always been sort of open-sourcey but not really open sourced. That’s changing now with Basho putting it under the Apache 2 license. Read more »
In battle for Hadoop, MapR raises $30M
Hadoop vendor is racking up customers and on Monday it announced a $30 million venture-capital investment that brings its total funding to $59 million since launching in 2011. Read more »
Subscriber Content
How the mega data center is changing the hardware and data center markets
photo: Facebook
Mega data centers’ innovations in serviceability, automatically detecting and recovering from failures, procurement practices, and so forth will become standard practice in all modern data centers. Read more at GigaOM Pro »
Don’t blame security breaches on open source technology – the problem is lack of oversight
photo: pryzmat/Shutterstock.com
Open source software is an easy punching bag when security breaches arise. But getting rid of open source isn’t the answer — it is too valuable. Instead, we need to take some key steps to ensure the security of components throughout development. Read more »
Hadoop through the years: A GigaOM retrospective
We were there very early on for the birth of Hadoop and its maturation into a vital data analysis tool. Here’s a look back at some of our best stories. Read more »
For sale from Pivotal Initiative: Cloud Foundry
The new VMware-EMC spinoff has started selling Cloud Foundry PaaS software and support and opened up the effort to outside committers. Read more »
The history of Hadoop: From 4 nodes to the future of data
In the first of our four-part multi-media series on Hadoop, the people who helped build Hadoop talk about its birth, its promise and the challenges in moving it from webscale to just large-scale. Read more »
How and why LinkedIn is becoming an engineering powerhouse
Five years ago, LinkedIn was a shell of the technology company it is today. Here’s an inside look at where it came from, what it’s become and where it’s going. Read more »
This week’s 10 best data stories (so far)
There has been a lot of data news already this week — some big, some interesting, and some both. Here’s a collection of the stuff you shouldn’t, or don’t want to, miss. Read more »
How former Mozilla VP Damon Sicore plans to make Edmodo into an ‘engineering brand’
Barely two weeks on the job, Damon Sicore, ed tech startup Edmodo’s new VP of engineering, talks about the company’s technological priorities and challenges and how he plans to create an engineering culture. Read more »
Red Hat open sources its take on Hadoop storage
photo: Red Hat
Red Hat is the latest company offering an alternative to the Hadoop Distributed File System, only this one is open source and ties into Red Hat’s bigger vision of hybrid cloud computing. Read more »
It turns out a lot of companies like building their own storage gear
photo: Backblaze
Backblaze pioneered the concept of open source storage hardware in 2009, and its designs have caught on. Hundreds of institutions — including Netflix and Shutterfly — use the designs, which have just entered their third generation. Read more »
DARPA puts $3M into startup pushing big data in Python
photo: Shutterstock / argus
As part of its new big-data-focused XDATA initiative, DARPA has invested $3 million in a startup called Continuum Analytics. The company’s aim is to extend Python’s prowess in scientific computing into the world of big data and analytics. Read more »
Why is OpenStack adoption slower in Europe?
photo: David Meyer
We all know Europe’s a bit behind the curve on cloud, but that’s not the only reason the fast-growing IaaS platform is finding the going tougher there than elsewhere. Read more »
Chef Alton Brown on adapting the recipe to the social media age
photo: Serious Eats
In a digital world, the recipe has transformed from a static set of instructions into a kind of open-source code which any cook and adjust or reformulate. Food Network’s Alton Brown proposes to embrace that trend to create a form of living recipe. Read more »
Mortar Data wants to become a Hadoop developer’s best friend
photo: Shutterstock / isak55
Writing Hadoop queries doesn’t have to be hard and neither does sharing data according to Mortar Data, which just released an open source framework for Hadoop applications. The idea is that groups of people can more easily collaborate on building apps around giant data sets. Read more »
Subscriber Content
How search can unlock the power of big data
Big data tools such as Cassandra and Hadoop are transforming how data is stored and exploited at scale. But without similarly capable search technologies, enterprise adopters face challenges when it comes to gaining insights from that data. Read more at GigaOM Pro »
WibiData open sources Kiji to make HBase easier
HBase is a great option for developing big data applications, but it’s not necessarily easy to use. WibiData is addressing this by open sourcing a portion of its predictive analytics infrastructure that adds structure to data, followed eventually by a whole HBase development framework called Kiji. Read more »
Facebook open sources Corona — a better way to do webscale Hadoop
Facebook has open sourced a new system called Corona for scheduling and managing Hadoop jobs. Corona attempts to do away with many of the problems that come along with massive-scale Hadoop operations, and soon looks to take Facebook’s Hadoop deployment beyond just MapReduce. Read more »
Rackspace versus Amazon: The big data edition
Rackspace is busy building a Hadoop service, giving the company one more avenue to compete with cloud kingpin Amazon Web Services. However, the two services — along with several others on the market — highlight just how different seemingly similar cloud services can be. Read more »
Red Hat wants more competition
photo: JULIADEBOER PHOTOGRAPHY
Red Hat CTO Brian Stevens sees it as a ‘personal disappointment’ that there aren’t more companies lining up to follow his firm’s highly lucrative open source subscription path. Read more »
A truly open cloud has to be open source, says OpenNebula
photo: JULIADEBOER PHOTOGRAPHY
Many cloud providers say they are open, or based on open-source technology, but in order to be truly open a service has to be backed by a community of users who contribute to making the technology better, says the founder of OpenNebula Read more »
Subscriber Content
Examining open hybrid cloud options for the enterprise
A major cloud trend over the past decade has been open source, but at present there is no one standard all providers obey. But anyone looking for a longer-term alternative to AWS now has two exciting new prospects: OpenStack and OpenShift. Read more at GigaOM Pro »
7 reasons why Europe really matters to cloud computing
It’s not home to Google, Amazon or Facebook, but from plucky entrepreneurs to the world’s most-advanced computing systems, Europe has a lot more to offer the world of cloud computing and web infrastructure than might meet the eye. Here are seven reasons why it matters. Read more »
