Security-software company Sourcefire is trying to help large-enterprise IT teams leverage big data analytics in fighting malware. A new product, called FireAMP, utilizes a cloud-based analytics approach to let IT teams dig deep to find out the hows, wheres and whys of their malware problems. Read more »
DynamoDB, AWS’ latest effort to rock the technology establishment, has many implications for other players in the big data and cloud computing markets. A new GigaOM Pro research note examines just who is affected, and how. Read more at GigaOM Pro »
It’s not surprising that Box CEO Aaron Levie says CIOs are ready to approve big corporate cloud storage deals. But it is somewhat surprising that outside experts with no dog in this fight agree that cloud storage is coming to the enterprise. Read more »
The fourth quarter may have lacked a dominating big-event product announcement like Q3’s Facebook platform extension or Q2’s unveiling of Google+, but the NewNet world continued to buzz along. In the battle for mind share, everyone wanted to be a platform. Meanwhile, consumer and social technologies continued to gain momentum, and new vehicles for content and service discovery presented both challenges and opportunities for NewNet companies. And it is hard to ignore the overcrowded but growing world of daily deals. This quarterly report analyzes these trends and others, and it also provides a near-term outlook of trends, technologies and companies to watch in 2012. Companies mentioned in the report include Amazon, Facebook and Socialcast. For a full list of companies, and to read the full report, sign up for a free trial. Read more at GigaOM Pro »
Although the first couple years of commercial Hadoop attention have been characterized by an attitude of “Hadoop is great, but …”, the tone is changing as Hadoop vendors increase the platform’s palatableness with each new iteration. No longer is Hadoop necessarily an epic undertaking rife with pitfalls. Read more »
For anyone thinking the big data trend is a flash in the pan, there’s some new evidence to the contrary. A hefty 75 percent of IT pros and developers responding to a new Linux Foundation survey have their eyes firmly on this big data phenomenon. Read more »
Continuing a yearlong trend, the fourth quarter in big IT was all about big data, and Hadoop in particular. Still, many are beginning to recognize the software framework’s shortcomings, which is why this quarter also saw more attention for startups claiming easy analytics and real-time processing. Elsewhere in infrastructure, SaaS startups made out well and valuations for these companies are getting higher, and naturally there was news from the AWS camp. This quarterly wrap-up examines these events and more, including the quarter’s dark spot, the hike in prices in the hard-drive manufacturing space due to the floods in Thailand. Companies mentioned in this report include Calxeda, Heroku, Rackspace, Salesforce.com and Tier3. For a full list of companies, and to read the full report, sign up for a free trial. Read more at GigaOM Pro »
Metamarkets is readying its cloud-based big data platform for significant business growth by making key personnel changes and spreading its wings into new industries. Co-founder Mike Driscoll is stepping up to CEO, and the company is moving into the gaming and social media spaces. Read more »
In a meeting of analytics minds, Birst and ParAccel are putting Birst’s graphical reporting gloss atop ParAccel’s analytics database.
Deals like this are the latest proof that big data is important but the ability to put that data into a useable format is also key. Read more »
Netflix dominates the business of streaming movies and television into consumers’ homes, but a new business model developed by big data firm Opera Solutions could help give cable companies the inside track. The model is combination of peer-to-peer networking via set-top boxes and big data algortihms. Read more »
Oracle’s Big Data Appliance is now for sale, featuring Cloudera’s Hadoop distribution and management tools. Regardless of what anybody thinks about Oracle’s strategy, the deal is a coup for Cloudera as it tries to fend off competition from fellow Hadoop startups Hortonworks and MapR. Read more »
I spent some time playing with Google Insights to find out what parts of the country are most interested in technology and when that interest hit its peak. It wasn’t surprising to see Silicon Valley rank highly, but did you know Utah was into next-generation programming? Read more »
Big data is often talked about as a phenomenon that lets organizations create narratives from their volumes of data. That is an apt characterization when we are talking about connecting the dots among disparate and possibly disconnected data sets. However, when we are talking about anything ... Read more at GigaOM Pro »
1010data says it now hosts more than 5 trillion records for its customers. If 1010data’s growth is a microcosm of the greater market, it’s no wonder there’s so much excitement around scalable data stores such as Hadoop, NoSQL databases and massively parallel analytic databases. Read more »
In the world of science, cloud computing provides an ideal platform for crowdsourcing scientific problems across the whole world of researchers, giving them access to data sets and the computing resources to analyze them. If big data is any indicator, scientific crowdsourcing should catch on. Read more »
Digital recipes and cookbooks need to emulate the world of digital music. By creating a standard recipe format similar to the MP3, we could overcome the artificial barriers between cooking Websites, apps and our bookshelves. Only then could we be build truly comprehensive digital cooking libraries. Read more »
Mu Sigma has closed a $108 million investment round to expand its analytics-outsourcing business. Mu Sigma takes customers’ data and it turns it into business insights, meaning customers don’t have to built their own in-house big data expertise. It’s an already-profitable business that’s only getting bigger. Read more »
How does the cloud market for the next year look? There will be no silver linings or lemonade. This research note, part of GigaOM Pro’s outlook for 2012, examines startups’ chances to challenge traditional enterprise IT practices, cloud pricing models, the true state of federated clouds, and how IT jobs will change in the coming months. Expect plenty of defensive M&A, cloud lock-in, phantom data discovery, outages, availability headaches, pricing confusion and job displacement over the next 12 months. Read more at GigaOM Pro »
Google announced that it’s ending its Academic Cloud Computing Initiative, a joint program with IBM and the National Science Foundation that gave researchers access to a massive Hadoop cluster on which to run their data-intensive projects. The company says access to such resources is now common. Read more »
Money has turned the Hadoop community, once united under the Apache banner and the cuddly stuffed-toy-elephant logo, into something resembling a frat house: Everyone’s under the same roof, but there’s plenty of machismo to go around. If it’s not good business; it is good theater. Read more »
The discovery of a new type of chemical bond by the National Center for Supercomputing Applications at University of Illinois at Urbana-Champaign shows exactly how supercomputers and big data are combining to become the microscope of the future. Read more »
For those in a perpetual snit about personal data privacy, here’s bold proposal from Michael Driscoll: Donate your own medical data. And do it now — don’t wait till you’re dead. What better way to make big data truly relevant — and helpful — to real live people? Read more »
Beyond Hadoop, there’s a lot more to think about when it comes to big data, ranging from where companies will actually find workers to how they’ll deal with an impending privacy-policy onslaught. The answers won’t be easy to come by, but they could be critical. Read more »
It is becoming abundantly apparent that, while there is still focus on install rates of physical smart meters, what will matter in the future is how well the data from these smart meters can be secured by utilities and how well utilities can use that data ... Read more at GigaOM Pro »
Microsoft’s Windows Azure platform as a service (PaaS) now supports Node.js, the popular server-side JavaScript development framework. That could give Azure more traction beyond the Microsoft .NET faithful. Also new: a limited trial of Hadoop-based distribution for Azure. Read more »
Northwestern University is doing its bit to feed the need for analytics skills in this era of big data. NU’s McCormick School of Engineering launched a new Master of Science degree in analytics and is accepting applications for the inaugural class. Read more »
IBM plans to acquire retail data analytics company DemandTec in an all-cash deal valued at $440 million, continuing Big Blue’s buys in big data businesses. DemandTec has two especially compelling elements for IBM: It adds to its big data expertise, and it’s vertically focused. Read more »
LexisNexis is pressing MarkLogic’s technology into service for its just-launched Lexis Advance legal service. MarkLogic’s document storage, search and analytics technology replaces legacy home-built code as part of a platform modernization and big data push. Read more »
Greenplum has announced its Unified Analytics Platform, a packaging of the Greenplum Database and Hadoop distribution along with its long-awaited Chorus software. Chorus is really what ties everything together, providing a platform to explore both types of data and to share interesting data sets and findings. Read more »
Digital Reasoning, a somewhat shadowy specialist in big data analytics for the U.S. intelligence community, announced B Series funding and named industry vet John Brennan to its board. Funding came from CIA-backed In-Q-Tel, as well as some Silver Lake Sumeru partners and other unnamed investors. Read more »
However it’s defined, the concept of big data ultimately boils down to money. But I think there’s a line we shouldn’t cross when it comes to using analytics to squeeze every last dollar out of an operation. It’s between things we want and things we need. Read more »
What exactly is Carrier IQ doing with your smartphone data? It claims that only its selling network performance metrics to operators. But relationships it has with media analytics firms and handset makers imply otherwise. With 150 million smartphones tracked Carrier IQ has big data goldmine. Read more »
Analyst powerhouses IDC and Gartner both rolled out their latest cloud computing and big data predictions and statistics Thursday morning, and while some are bold, others should have you saying “Duh.” Here’s what they have to say, and how that squares with what I’m seeing. Read more »
Silk, the browser for Amazon’s new Kindle Fire, utilizes Amazon’s cloud. But don’t think AWS is the Kindle Fire’s only cloud connection. In a post on Tuesday, Pulse’s Greg Bayer explained how his company’s news-reading app actually runs atop Google’s App Engine Platform-as-a-Service offering. Read more »
By 2020 it is estimated that 20–50 billion devices will be connected to the Internet. Many of these devices will be collecting health data or will be connected to health and medical devices in the home, the hospital or the wider environment. The Internet of things (IoT), meanwhile, refers to the growth of sensors and things that connect to the Internet via RFID, Bluetooth, ZigBee and satellite. In health care, its growth is likely to open new disruptive business opportunities for services that add value to the data collected. This paper provides a preliminary overview of the landscape of opportunities and drivers in the current health and health care environments and highlights some of the challenges that remain. Companies mentioned in this report include IBM, Arrayent Health, Kaiser Permanente and Ford. For a full list of companies, and to read the full report, sign up for a free trial. Read more at GigaOM Pro »
HPCC Systems, the division of LexisNexis that’s pushing a big-data processing-and-delivery platform to compete with Hadoop, has tuned its software to run on Amazon’s cloud computing platform. Interested developers can now experiment with the open source software without having to wrangle physical servers. Read more »
Retroficiency, a startup out of MIT that uses software and big data to create energy retrofits for buildings, has raised a round of $3.2 million from Point Judith Capital and has acquired the energy efficiency division of Nexamp, called Clean Energy Solutions. Read more »
So the big data backlash begins. The Hadoop framework does a lot, but some experts — including those who push non-Hadoop options — say it’s not enough for many specialized apps where a build-your-own Hadoop implementation costs too much to be a real contender. Read more »
With its new Idol 10 software, Hewlett-Packard brings together key Vertica and Autonomy technologies acquired over the last year for an assault on knotty big data problems. HP says the software can collect and analyze unstructured data including video, audio and social net feeds. Read more »
Today, I read a press release from Sourcefire touting its “big data” approach to security and the fact that its Immunet anti-malware-for-PCs product is now monitoring 2 million endpoints. I reached out to find out what’s under Immunet’s covers and, no surprise, found Hadoop. Read more »
