Sqrrl Enterprise, a commercial version of the National Security Agency’s Accumulo database technology, is now generally available. As one might expect, it’s all about security and analytics at a massive scale. Read more »
What can we expect the IoT landscape to look like, and how will its impact be felt? And is the attention being given by governments, manufacturers, and industry players merited, or is this just a fad? In this paper we look at the trends leading the growth of the internet of things, its components, and its characteristics. We examine the scale of the different opportunities and early examples of use cases. Finally, we look at potential inhibitors to adoption and potential challenges, notably around security, privacy, and system failure. Read more at GigaOM Pro »
SpaceCurve has raised another $10 million for its database technology designed to make sense of massive amounts of data from sensors, social media, mobile devices and other streaming sources. Read more »
Accel has launched its Big Data Fund 2, a followup on the equally large fund the venture capital firm started in November 2011. Rather than seeking products that target data scientists, it wants those targeting business users. Read more »
GE Healthcare is pushing a system called Corvix for doing agent-based simulations on complex problems. In India, the technology simulated a population of 80 million people in order to determine the best places to build medical facilities. Read more »
This week, both Facebook and Yahoo detailed new efforts to manage real-time data flows within their myriad systems. Yahoo’s work is an open source implementation of Storm designed to run on the same cluster as Hadoop and even share resources. Read more »
Raymie Stata spent seven years working on the guts of Hadoop as a VP, chief architect and CTO at Yahoo. His new Hadoop startup, called Altiscale, has raised a $12 million from some prominent investors. Read more »
Google Image Search just got a whole lot better, and the company’s purpose-built machine learning system infrastructure is a big reason why. No surprise, Jeff Dean helped build it. Read more »
A storage startup called SageCloud is looking to deliver low-cost backup storage to the masses who want Facebook-like cold storage without resorting to tape, cloud services or building their own gear. Read more »
Startup InternMatch has raised $4 million in a Series A round meant to help the company build out its engineering team. Read more »
Cyber threats are now a critical issue affecting the national security of nation countries worldwide. At the same time, the IT world is witnessing a wave of new innovation, and there are numerous business opportunities for technologies built around the emerging market sectors of mobile and cloud computing. These technologies and the companies creating with them will form the future of cloud security over the next several years. Read more at GigaOM Pro »
WalmartLabs has acquired a predictive analytics startup called Inkiru to bolster its ability to create better customer experiences through data. The division of Walmart was created in 2011 on a foundation of big data. Read more »
Hardware sales, Fusion adoption (or lack thereof) are two key factors to explore when Oracle goes through its fourth quarter earnings next week. Read more »
There’s much debate still to be had over the NSA’s recently uncovered data-collection practices, but some of the technologies underlying them are out in the open. Here’s what we know already. Read more »
The past few days have seen a blizzard of leaks about surveillance activity by the government’s ultra-secret NSA arm, including data collection from phone companies and internet giants. Here is what you need to know about this developing story. Read more »
As Facebook’s user base swells larger and larger, data about users is growing much faster, and the social networking giant has developed a faster way to analyze it all with its Presto query engine. Read more »
How does the NSA analyze all the data it’s collecting from cell phone users? With a massive database system built with just such scale and workloads in mind. Read more »
Cloudera’s new search feature, based on the Apache Solr project, is the latest move by the company to expand the utility of its Hadoop distribution. It’s also far from the last. Read more »
Sure, a lot of data scientists spend their days trying to optimize ads or movie recommendations, but a growing number are spending their free time tackling bigger causes. Read more »
PayPal co-founder Max Levchin’s new startup Glow is the latest to bring big data to couples struggling to conceive. But it also effectively offers those couples an insurance policy on getting pregnant. Read more »
While the rest of the Hadoop world is trying to distance itself from Hive with new interactive engines, Hortonworks is trying to make it faster. It might actually be a sound strategy. Read more »
Even F1 racing is trying to save energy and as it navigates changes from V-8 to V-6 cars, there are lots of big data problems to be solved. Read more »
The big data skeptics have been getting louder over the past few months, but the message doesn’t resonate too loudly. No one said big data was perfect data. Read more »
Ancestry.com wants to help users of the family-history site share their discoveries. Now it’s devised methods for turning isolated facts into full-on stories. Read more »
Science has a data problem, There’s been a rash of experiments that no one can reproduce and studies that have to be retracted, But there are some nascent efforts to address this credibility crisis by changing the way the data is handled. Read more »
University of Illinois researchers have created an app and a sensor-filled cradle that turn an iPhone into a mobile spectrophotometer. The combination of that mobile lab data and metadata such as location might prove very valuable. Read more »
Startup WibiData has raised another $15 million and wants to turn the lessons it has learned in the field into generic software that can let anyone build predictive applications on Hadoop. Read more »
Cascading creator Concurrent has developed a new open source tool called Pattern for running machine learning models on Hadoop clusters. When combined with its SQL tool called Lingual, users can move data from one stage to another easily. Read more »
A group of researchers from Columbia and Stanford have created a method for turning complex cellular datasets into visualizations that map the similarities between tens of thousands of cells within a tissue sample. Read more »
Analytics provider Alteryx has raised another $12 million as it tries to make statistical analysis a more consumer-friendly experience. Read more »
Few companies today have the time or the analytics expertise to apply statistics and complex data modeling to regular or even daily business decisions and operations. Now, however, an ecosystem of companies is emerging to fill this need. Read more at GigaOM Pro »
Tableau had a successful IPO, closing the trading day up 64 percent and raking in $254 million. CEO Christian Chabot says the company is now set to make itself known around the world. Read more »
Database startup Drawn to Scale, creator of the SQL-on-Hadoop technology called Spire, is closing down. The company’s product, Spire, was one of the first SQL-on-Hadoop technologies. Read more »
Tableau’s initial public offering is on Friday, and expectations are high. The company has inspired much of the next-generation analytics space, and how it fares could be telling about just how powerful the data movement is. Read more »
When it comes to using big data technology effectively, there’s a lot to like about SaaS. When companies like BloomReach create and analyze massive web-wide data sets, they automate insights that almost no individual company could discover on its own. Read more »
Graph databases and graph-processing applications have been popping up all over the place lately, and now they’re starting to go commercial. On Tuesday, popular open source project GraphLab joined the ranks of graph startups. Read more »
With its acquisition of Lucky Sort, Twitter seems to be acknowledging that it’s a data company after all. The plan appears to be building a services that would do for Twitter equivalent to services such as Google Trends and Google Analytics. Read more »
If the big data era is really going to revolutionize our world, visualizations that let more people make sense of data will be critical. Here are six startups trying to change how we interact with and look at our data. Read more »
British privacy advocates have reacted with horror to the idea of EE and market research firm Ipsos Mori selling anonymized customer data. On balance, they shouldn’t worry so much. Read more »
Data-warehouse providers are quickly adding Hadoop distributions, or even their own versions of Hadoop, into their architecture, adding further cost advantages to collections of extremely large data sets. Finding the talent to manage this newly converged environment will not be easy, but it presents tremendous opportunity for companies willing to take some risk. Read more at GigaOM Pro »
