This quarter saw Amazon Web Services finally relaxing its public-cloud-only stance and launching services to support hybrid-cloud deployments. Meanwhile, Hadoop players moved to make their platforms more accessible to mainstream BI analysts and database administrators. A new quarterly report analyzes these trends and provides a near-term outlook. Read more at GigaOM Pro »
Skybox Imaging, a startup that wants to capture and analyze high-resolution photos and videos of the Earth, has raised $70 million in Series C funding. The money will help Skybox its lineup of software engineers and data scientists that might be its secret sauce. Read more »
PureDiscovery, a Dallas-based big data startup, thinks it has the has the answer to outdated enterprise search technology, and it’s called BrainSpace. Its goal is to let users find information that matters without having to search for it, to bring data to users. Read more »
If you’re an amateur poet and love big data, high-performance system vendor AMAX has a deal for you. The company is conducting a contest to find the best haiku on big data. But I’m sharing my poems right here. Read more »
The desire for more and increasingly specific analytics continues with IBM’s acquisition of Varicent Software. Banks, insurance companies, and retailers use Varicent software to look at data across finance, sales, human resources and IT departments to determine how to boost sales, according to IBM. Read more »
The Atlantic recently published an article on what politicans know about voters, complete with market research data that breaks down consumer preferences by poltical party and likely turnout on voting day. There are some strong associations that lack political explanations. I want to know why. Read more »
The headline might sound like buzzword stew, but it couldn’t be any truer. For companies willing to make the leap to cloud services, there will be a lot of companies willing to make big data as easy as paying your bill every month. Read more »
After years of beating around the bush, SAP declares that it is a database company and will take on the biggest kid on the block. It’s about time. It’s funding startups to build applications for Hana and Sybase. But beating Oracle won’t be easy. Read more »
For years, Oracle has wowed Wall Street with fat software margins: Large companies depending on Oracle relational databases pay what it takes to keep them up and running. It’s unclear whether Oracle can carry that dominance over into the Big Data era, however. Read more »
Dataminr, a New York-based start-up that has been quietly building a global sensor network powered by Twitter, is now introducing its technology to the public today, showing how its real-time engine can act as an early warning system for enterprise and government customers. Read more »
If your organization doesn’t have a strategy for big data now, you will need one in the future. Here we discuss the difference between big data and traditional business intelligence, as well as the considerations executives should take into account as they plan their big data strategies. Read more at GigaOM Pro »
Social and mobile analytics startup Kontagent has expanded its business to include a data-mining service powered by Hive, the SQL-like interface for querying data stored within Hadoop. It’s a smart move by the company, and one that other cloud-based analytics providers would be wise to replicate. Read more »
The federal government talked a lot about grand scientific visions when it unveiled its big data agenda last week, but the government has consumers on its mind, too. Specifically, it doesn’t want to unduly hinder innovation, and it might even be willing to provide data. Read more »
If you have a lot of unstructured data, don’t have (or want) a Hadoop cluster and can write Python jobs, Mortar Data has got the service for you. The New York-based startup is jumping into the fray with possibly the most lightweight Hadoop service yet. Read more »
I loved this talk by Jer Thorp, currently the data-artist-in-residence at the New York Times. His work has appeared in my publications but it is the first time I have seem him speak about humanizing data. This talk for Tedx Vancouver is highly recommended. Read more »
Managed hosting provider Sungard is getting into the big data space with a new Hadoop service that gives users on-demand access to the popular data-storage and processing platform. Called Unified Analytics Service, Sungard’s new offering joins the growing ranks of cloud-based Hadoop offerings. Read more »
An effort to build a telescope that can see back 13 billion years to the creation of the universe is prompting a five year €32 million ($42.7 million) effort to create a low-power supercomputer and networks to handle the data the new telescope will generate. Read more »
Violin Memory is a force to be reckoned with in the storage world. It’s not just the industry shift toward solid-state drives replacing slower, less-efficient hard disk drives that’s driving Violin’s value through the roof, though, it’s also the company’s very strategic set of investors. Read more »
By pumping hundreds of millions of dollars into big data research and development, the Obama administration thinks it can push the current state of the art well beyond what’s possible today, and into entirely new research areas. It’s a noble goal, but also a necessary one. Read more »
The White House released the details of its $200 million-plus annual big data strategy, which includes lots of access to funding and data for researchers.The administration is banking on big data having revolutionary effects on par with the Internet, which federal dollars financed decades ago. Read more »
Big data must really be big to get its own White House-sanctioned research and development initiative. The White House Office of Science and Technology Policy will host a live webcast Thursday to outline how the government can “help big data” efforts. Read more »
If you’ve ever wondered what would happen if the top two teams in the Netflix Prize competition united and put their predictive analytics skills to work together, you’ll soon find out. On Tuesday, big data service provider Opera Solutions acquired Austrian predictive analytics specialist Commendo. Read more »
Key to understanding big data is to move beyond simply examining the technology for data storage and analytics engines. Organizations preparing for a data-centric economy should also examine the roles of data quality, data obesity and data markets in the future of modern enterprises. Read more at GigaOM Pro »
In the latest dispatch from the too-much-information bureau, on-demand ride service Uber has calculated the prevalence of one-night stands among its customer base. It’s another example of what companies can find out if they’re just able to think of the right questions. Read more »
The technological hurdles to embracing big data are well-known at this point, but strong anti-data corporate culture might be an even bigger obstacle. The changes required to listen to the data and, possibly, to transform a company’s business model take a lot of work. Read more »
The problem for many companies is that user information is spread across hundreds or even thousands of different fields in various databases, and it’s difficult to compile it in real time. But doing that successfully is becoming increasingly important, says WiBiData at Structure:Data. Read more »
“Anticipation denotes intelligence.” Zubin Dowlaty, VP and head of innovation and development of analytics-outsourcing firm Mu Sigma, said at Structure:Data that’s what companies need to be striving for and in this era of big data, the barriers to achieving that have fallen away. Read more »
Hadoop may be the current leader of the pack when it comes to handling big data, but LexisNexis says at Structure:Data the system it developed for its own internal data use — and recently open-sourced — is a viable alternative and in some cases is superior. Read more »
One solution to the big data skills shortage has been consulting firms that specialize in deploying big data systems companies need to make sense of their information. These companies will continue to play a vital role in helping us make sense of the the data deluge. Read more at GigaOM Pro »
Machine-generated data, the non-intelligible zeros and ones that are generated by sensors and other devices, is no longer just for geeks. While it looks like gibberish forward-thinking consumers are already pressing that “gibberish” data into service, according to speakers at Structure: Data 2012. Read more »
Next-generation online banking service ZestCash uses data to help qualify people for short term loans. The company explains at Structure:Data it has been giving $300 to $800 loans to users based on thousands of variables, which are boiled down to 10 models. Read more »
Companies are grappling with how to make use of all their data, facing the challenge of teasing out insights quickly and with flexibility. Moving to the cloud opens up security and privacy questions. But the effort can be worth it, says Google’s Ju-kay Kwek at Structure:Data. Read more »
Businesses understand now that big data can help them wring revenue out of once-unproductive assets. But that just fuels an exploding demand for bigger, faster, and more precise big data applications, experts speaking at Structure:Data say. Read more »
Big data now touches everything from enterprises to smart-meter startups, while Hadoop is fast becoming the leading tool to analyze that data, and debates around privacy abound. GigaOM Pro analysts offer insights on what to consider when it comes to big data decisions for your business. Read more at GigaOM Pro »
EMC’s acquisition of Pivotal Labs proves the company really understands the big data market. Namely, that big data won’t go anywhere without great applications, and EMC isn’t the company to help customers figure out how to build theirs. Read more »
Raghu Ramakrishnan, who was the top scientist for several of Yahoo’s key technology efforts, is now a technical fellow with Microsoft’s server and tools unit. This is the latest sign that Yahoo is struggling to retain key technologists. Read more »
Holding onto millions of pieces of archived content it still wanted to monetize, the Associated Press turned to MarkLogic’s NoSQL non-relational database designed for XML files. As publishers try to leverage their years worth of archived, often not tagged content, they’ll need new tools. Read more »
Web companies like Google and Facebook invest incredible resources in making sure they know everything about their infrastructures and how server-level issues are affecting the applications that comprise their lifeblood. The rest of the business world is now catching on. Read more »
Businesses can now leverage big data for the benefit of driving marketing insights. According to Ajay Agarwal of Bain Capital Ventures, this fundamental shift will create several multi-billion dollar winners, and new technology companies will emerge as the marketing equivalents of Salesforce and SAP. Read more »
In September, I profiled six companies doing big data in the cloud, and here are nine more. One of the themes of Structure:Data is “putting big data to work,” and there’s no easier way to get started doing so than with a cloud service. Read more »
