Use cases at the Strata conference show that information gleaned from Hadoop and other big data technologies can bring companies new revenue streams and cut expenditures. Read more »
There has been a lot of data news already this week — some big, some interesting, and some both. Here’s a collection of the stuff you shouldn’t, or don’t want to, miss. Read more »
Intel’s getting into the open source software business with it’s own version of Hadoop. It joins a host of startups as well as EMC Greenplum in building a distribution for big data. Read more »
Known for its supercomputing storage capabilities, DataDirect Networks is introducing a box for running Hadoop jobs, and a company executive sees the Hadoop hardware trend continuing. Read more »
EMC Greenplum rolled out a new Hadoop distribution that fuses the popular big data platform with its flagship MPP database technology. Co-founder Scott Yara thinks the company’s huge investment puts it in the catbird seat among Hadoop vendors. Read more »
Hortonworks Data Platform for Windows, now in beta, brings Hadoop to Excel and SQL Server (and vice versa.) Read more »
More and more companies and open source projects are trying to let users run SQL queries from inside Hadoop itself. Here’s a list of what’s available and, on a high level, how they work. Read more »
Red Hat is the latest company offering an alternative to the Hadoop Distributed File System, only this one is open source and ties into Red Hat’s bigger vision of hybrid cloud computing. Read more »
Citus Data has expanded its high-speed, analytic database called CitusDB beyond Postgres and into Hadoop. Up next, MongoDB and just about anything else you can think of. Read more »
HStreaming has raised $1 million and is ready to take its message of real-time processing on Hadoop mainstream. In a world tired of batch processing only, that message should be well received. Read more »
After almost three years of operating in stealth mode, Think Big Analytics is stepping out to consult with and educate more companies on big data analytics. Read more »
A group of Stanford researchers recently ran a complex fluid dynamics workload across more than a million cores on the Sequoia supercomputer. It’s an impressive feat and might foretell a future where parallel programming becomes commonplace even on our smartphones. Read more »
Cloud provider Joyent has a new Hadoop offering that the company claims can outperform most others on the market. However, the company says Hadoop is just its foray into big data and is promising bigger, better things to come. Read more »
The fourth quarter in cleantech saw attention paid to two prominent, publicly traded companies: EV maker Tesla and newly minted public listing SolarCity. It remains a transitional period for the sector as investment declines, with a shift toward those companies able to scale with little additional capital. Read more »
Netflix is at it again, this time showing off its homemade architecture for running Hadoop workloads in the Amazon Web Services cloud. It’s all about the flexibility of being able to run, manage and access multiple clusters while eliminating as many barriers as possible. Read more »
Despite the idea that a server is a server, the needs of different computing customers differ widely. For those thinking about selling infrastructure, software or even services understanding the difference in computing and IT styles will help you hone your pitch and find your buyer. Read more »
I recently spent 11 days in Beijing meeting lots of companies trying to make it in cloud computing and big data. Here are seven with which I had a chance to sit down and learn about their businesses and how to sell cloud computing in China. Read more »
Besides the skyrocketing growth of data itself, there are several key technology trends we will be watching in 2013. That list includes a renaissance in the database market, next-generation SaaS-based BI and visualization tools, and data warehousing as a service. Read more at GigaOM Pro »
Sure, more data scientists would be great. But Scott Brave, of Baynote, says the better solution is to create analytics products that are so easy to use that you don’t even need a data scientist. Read more »
A lot happened in the world of data analysis this year. Here’s a list of the most-popular and generally most-interesting things I’ve had the fortune to cover in 2012 — from Hadoop to the Supreme Court to Bollywood stars. Read more »
Whether they’re building big data applications or just trying to gather some insights from their mobile apps, developers have more need than ever for analytics tools. It’s a good thing so many companies are building tools designed with developers’ needs and skills in mind. Read more »
Everyone’s talking about the greatness of big data, but we’re nowhere near the promised land of what’s possible when we turn data loose on our lives. Here are three things to watch that could affect how companies and everday people consume all that info. Read more »
The way the industry will use cloud-computing technology in 2013 will require following the existing adoption patterns and trends into the New Year. Those trends include the rise of standards, big data’s role in the cloud, industry-specific clouds, security, and more. Read more at GigaOM Pro »
Cloudera netted big bucks to accelerate its Hadoop push into enterprises and around the world. The Palo Alto, Calif. company says its framework is the most widely deployed of several available Hadoop distributions. Read more »
Big data can make lives better, but it can also ensure bigger profits. That’s the pitch that Guavus, a real-time data analysis platform is sharing with mobile operators. If they show Guavus the data, the software can help them optimize pricing and capacity spending. Read more »
At the AWS Re: Invent conference, engineers from Pinterest, Flipboard and Yelp detailed some of the strategies their companies employ in order to keep costs low as computing demand increases. The keys are keeping an eagle eye on usage and using the right types of resources. Read more »
According to Amazon Web Services Chief Data Scientist Matt Wood, big data and cloud computing are nearly a match made in heaven. Limitless, on-demand and inexpensive resources open up new worlds of possibility, and a central platform makes it easy for communities to share huge datasets. Read more »
A startup called BitDeli is trying to democratize analytics by letting developers create custom metrics and dashboards using Python scripts instead of having to try Hadoop. What frameworks like Rails were to web development, Co-founder and CEO Ville Tuulos says, BitDeli is to analytics. Read more »
Writing Hadoop queries doesn’t have to be hard and neither does sharing data according to Mortar Data, which just released an open source framework for Hadoop applications. The idea is that groups of people can more easily collaborate on building apps around giant data sets. Read more »
Big data tools such as Cassandra and Hadoop are transforming how data is stored and exploited at scale. But without similarly capable search technologies, enterprise adopters face challenges when it comes to gaining insights from that data. Read more at GigaOM Pro »
Mortar Data has raised $1.8 million for its cloud-based service that wraps Hadoop in a custom — and supposedly developer-friendly — blend of Pig and Python, meaning even novice Hadoop programmers can be writing jobs in about an hour. Read more »
What’s true in the rest of the world is true for security software, as well: more data means more intelligence. Thanks to the emergence of new techniques for storing, collecting and analyzing data, there’s a new wave of security companies looking smarter than ever. Read more »
HBase is a great option for developing big data applications, but it’s not necessarily easy to use. WibiData is addressing this by open sourcing a portion of its predictive analytics infrastructure that adds structure to data, followed eventually by a whole HBase development framework called Kiji. Read more »
Hadoop is nothing without applications, and Continuuity aims to deliver those apps by making Hadoop something developers can work and innovate with. Its efforts haven’t gone unnoticed — the company just closed a $10 million Series A round from a who’s who of big data VCs. Read more »
Zoomdata has a plan for business intelligence that involves tacking the difficult problem of streaming data, and doing so with a mobile-device-first mindset. The result is pretty and compelling in theory, but it’s technologically challenging and will face tough competition from new and old vendors alike. Read more »
Less than a month after unveiling its Hadoop analytics engine to great fanfare, Platfora has raised $20 million to realize its mission of displacing the business intelligence and data warehouse incumbents. It’ll need every dime: although the competition is old, it’s also rich, entrenched and determined. Read more »
The largest players in the Hadoop market are already raising money and sky-high valuations, employing hundreds of people and, in some cases, looking at nine-figure revenues. If you’re trying to get a sense of whether Hadoop is for real, these details might help. Read more »
Facebook has open sourced a new system called Corona for scheduling and managing Hadoop jobs. Corona attempts to do away with many of the problems that come along with massive-scale Hadoop operations, and soon looks to take Facebook’s Hadoop deployment beyond just MapReduce. Read more »
Mobile-application development specialist Appcelerator bought big data startup Nodeable on Wednesday, although the deal wasn’t exactly what Nodeable was planning for when it launched in 2011. Founder and CEO Dave Rosenberg shares some of the lessons he learned trying to break into the big data space. Read more »
VC-backed Upstart aims to help smart college graduates fund the startups of their dreams in return for a slice of their future earnings. So what’s so wrong with that? Plenty, according to Daniel Abadi, chief scientist of Hadapt and associate professor at Yale. Read more »
