EMC-VMware spinoff Pivotal is putting its money behind Tachyon, an in-memory distributed file system developed by the same research lab that created Apache Spark. The goal is to improve the company's "data lake" strategy by giving applications a faster way to access and share data.…
Read MoreResearch
Big data startup Mortar expands beyond Hadoop using tech created at Spotify
Mortar, a startup helping developers launch Hadoop jobs in the Amazon cloud, is offering a managed version of the open source Luigi tool for managing big data pipelines. Created at Spotify, Luigi lets users tackle complex workflows that may or may not involve Hadoop at all.…
Read MoreDatabricks demolishes big data benchmark to prove Spark is fast on disk, too
Apache Spark is taking the big data world by storm, but the folks at Databricks wanted to disprove a misconception that its only performance advantages over Hadoop MapReduce come in-memory.…
Read MoreTeradata doubles down on Hadoop again, this time in the cloud and with Cloudera
Teradata and Cloudera have signed a deal that includes some technology integrations as well as joint sales and marketing efforts. Teradata is also launching its own Hadoop cloud service, which will be available by the year's end.…
Read MoreZoomData raises $17M to become the visualization layer for big data
ZoomData has raised another $17 million for its visualization technology that was built with stream processing and iPads in mind, but has since made the leap to historical data and desktops, as well.…
Read MoreCloudera bought DataPad because data scientists need tooling, too
Cloudera has acquired a data-visualization startup called DataPad, the founding team of which specializes in data analysis using the Python programming language. As Hadoop competition heats up, Cloudera might be ramping up its Python tooling in order to attract more data scientists and developers.…
Read MoreLinkedIn details Pinot, its new analytics system that powers its data applications
LinkedIn’s various data-tracking features, like generating who has recently viewed a user’s profile and keeping tabs on which people are following particular companies, are all fueled by the new data system.…
Read MoreBig data startup Continuuity becomes Cask and is now completely open source
Users of Cask's open-source big data PaaS will have three options: CDAP Free, CDAP Standard and CDAP Enterprise.…
Read MoreStanford class on mining massive datasets is now on Coursera
“Mining Massive Datasets,” a Stanford course taught by a trio of instructors including Kosmix and Junglee founder, and former Amazon technology director, Anand…
Read MoreSQL-on-Hadoop tech Apache Drill is ready to use and part of MapR’s distro
MapR has integrated the Apache Drill SQL-on-Hadoop engine into its big data platform. MapR led the development of Drill, which is part of a larger movement within the company toward building a stronger open-source culture.…
Read MoreHortonworks lays out a future for Hive that includes transactions, Spark and sub-second queries
Hortonworks is working on a new initiative called Stinger.next, which it hopes will remake Apache Hive into a much more-capable SQL engine within the next year and a half. A greatly improved Hive could put other vendors on the defensive explainging why their products are better.…
Read MoreTeradata embraces the big data ecosystem, buys Think Big Analytics
Data warehouse vendor Teradata continues to step up its game in the broader big data market, this time by acquiring consulting firm Think Big Analytics, which specializes in helping clients deploy open source technologies and build analytics applications.…
Read MoreFewer companies are hiring ‘data scientists,’ but data science is still hot
According to statistics from job site Indeed.com, postings including the phrase "data scientist" are dropping like a rock, while those including the phrases "data science" and "big data" are on the rise. It might signal a realization by employers that those unicorns don't exist.…
Read MoreHadoop jobs should soon be able to run easily, and securely, inside Docker containers
Hadoop startup Altiscale is close to completing its mission to make Docker a suitable environment for running Hadoop jobs. One of the big remaining issues has to do with network security and ensuring bad neighbors don't spoil the party for everyone in multi-tenant environments.…
Read MoreHortonworks gets more serious about real-time data with Kafka integration
Hortonworks has added Apache Kafka to tis Hadoop software platform as a technical preview. Kafka isn't the most popular tool in the world, but it's widely used among large web companies, making it a useful add-on for luring customers of that ilk.…
Read MoreMicrosoft unveils Azure DocumentDB, a NoSQL database as a service
Microsoft is expanding its Azure platform again, this time rolling out a NoSQL database service as well as a new search tool. It's the kind of innovation Microsoft needs to focus on if it's going to lure new developers and really compete in the cloud.…
Read MoreIs HBase’s slow and steady approach winning the NoSQL race?
The NoSQL dichotomy of MongoDB and Cassandra obscures the growing influence of Apache HBase…
Read MoreSQL-on-Hadoop startup Splice Machine adds $3M in funding
Splice Machine, a San Francisco-based startup promising to turn HBase into a relational database that can even handle transactional workloads, has added…
Read MoreThe lab that created Spark wants to speed up everything, including cures for cancer
AMPLab, the University of California, Berkeley, research group responsible for making Spark a household name in big data, has a lot more tricks up its sleeve. They range from databases to machine learning, and even include tools that could help treat cancer.…
Read MoreHere’s why HP invested $50M in the Hortonworks approach to Hadoop
Hortonworks CEO Rob Bearden came on the Structure Show this week to discuss many thing, including HP's $50 million investment in the Hadoop startup, the competitive landscape in Hadoop and why the time is now right for big data applications to succeed.…
Read MorePinterest explains how it runs a souped-up version of Hadoop
The social scrapbook and visual discovery site, which processes about a petabyte of data daily, uses the Hadoop-as-a-service startup Qubole to handle Hadoop jobs and Puppet for its data processing configuration.…
Read MoreHP joins the Hadoop backers club, pours $50M into Hortonworks
Another day, another Hadoop investment. This time, it's Hewlett-Packard bankrolling Hortonworks to the tune of $50 million. Your move, Cloudera.…
Read MoreSpark and Tez, out of phase
With the release of Hadoop 2.0, MapReduce takes a back seat. But who in the front seat will take the wheel?…
Read MoreCloudera: Impala’s it for interactive SQL on Hadoop; everything else will move to Spark
There was a lot of news about Spark's ascension in the big data ranks this week, as well as some speculation. According to Cloudera's Mike Olson, his company is widely embracing Spark -- including to run Hive -- but not in place of Impala.…
Read More