In his latest book, The Human Face of Big Data, photojournalist Rick Smolan depicts the many ways big data is transforming the world. On Tuesday, he and his team released an iPad app that puts an interactive twist on many of the book’s examples. Read more »
Everywhere you look, there’s another option for sharing your medical data in the name of the greater good. These efforts are not for nothing: Because of there scale and geographic reach, crowdsourced data banks have the potential to revolutionze how medical research is conducted. Read more »
If your doctor asks you to touch his or her iPhone at your next phyiscal, don’t be alarmed. It’s likely they have an AliveCor iPhone case; the device measures pulse through two fingers and can provide a detailed electro-cardiogram when held to your chest. Read more »
According to Amazon Web Services Chief Data Scientist Matt Wood, big data and cloud computing are nearly a match made in heaven. Limitless, on-demand and inexpensive resources open up new worlds of possibility, and a central platform makes it easy for communities to share huge datasets. Read more »
A startup called BitDeli is trying to democratize analytics by letting developers create custom metrics and dashboards using Python scripts instead of having to try Hadoop. What frameworks like Rails were to web development, Co-founder and CEO Ville Tuulos says, BitDeli is to analytics. Read more »
Writing Hadoop queries doesn’t have to be hard and neither does sharing data according to Mortar Data, which just released an open source framework for Hadoop applications. The idea is that groups of people can more easily collaborate on building apps around giant data sets. Read more »
There’s no shortage of great minds using big data techniques to improve the quality of our medical treatments, but sometimes they can’t get access to the data they need most. Improving access to genetic data, for example, might just help cure cancer. Read more »
A group of British researchers recently analyzed 2.5 million newspaper articles in order to prove that new data analysis techniques, such as machine learning and natural-language processing, can accurately classify media content. They hope their approach can save academicians untold hours of manual labor. Read more »
According to the New York Times, National Football League teams are often years behind their peers in other professional sports when it comes to data analysis. Machine learning could help teams make more sense of the myriad variables that currently keep them relying on human intuition. Read more »
Online dating startup Zoosk uses big data techniques and technologies for a lot more than just computing which members might make the best mates. Data from its young audience well versed in social media lets the company design a user experience that matches their expectations. Read more »
Competitive advantage used to come from using pricey enterprise applications to create operational efficiencies. Ross Mason of MuleSoft says SaaS and APIs have killed that model, and the future belongs to companies that integrate applications to discover new business models. Read more »
In the fight about royalties from streaming media services like Pandora, Popular cellist Zoë Keating says she’s willing to give up the money in exchange for data. It’s an idea that’s gaining traction elsewhere, too, as more companies are paying consumers for their truly valuable data. Read more »
Eight years after forming, a startup called BeyondCore is finally launching publicly with a product it claims can revolutionize analytics. Rather than making analysts search for the needle in the haystack, BeyondCore says it remove the human element and deliver that needle on a silver platter. Read more »
Big data tools such as Cassandra and Hadoop are transforming how data is stored and exploited at scale. But without similarly capable search technologies, enterprise adopters face challenges when it comes to gaining insights from that data. Read more at GigaOM Pro »
New York-based data analytics startup SumAll announced that it has raised $6 million in a Series A round led by Battery Ventures and including Wellington Partners. Launched last year, SumAll helps smaller businesses analyze and visualize a comprehensive set of their data. Read more »
A report by Europe’s cybersecurity agency points out several flaws with the proposed ‘right to be forgotten’. A big one has to do with the challenges presented by the increasing use of aggregated data. Read more »
Even if you don’t agree with ZestFinance’s business, it’s hard to argue with its grasp of big data and applied mathematics. Now, the company has added a human touch to machine learning in order to make its models for assessing repayment risk even more accurate. Read more »
Prague-based social media analytics startup Socialbakers on Monday announced that it had raised $6 million in funding from Index Ventures and Earlybird Venture Capital. The startup says that more than a fifth of all Fortune 500 companies are its clients. Read more »
Mortar Data has raised $1.8 million for its cloud-based service that wraps Hadoop in a custom — and supposedly developer-friendly — blend of Pig and Python, meaning even novice Hadoop programmers can be writing jobs in about an hour. Read more »
Companies such as Inrix are making their money helping commuters and commercial drivers find the fastest routes through traffic, but their reach could go much further. Creative organizations can apply the data in entirely new areas, and crowdsourcing means seeing how the world moves. Read more »
By accessing and combining publicly-available datasets, health innovators are letting patients and others view connections between physicians. The so-called “DocGraph,” as one hacktivist calls it, could give patients a valuable window into who their doctors trust. Read more »
What’s true in the rest of the world is true for security software, as well: more data means more intelligence. Thanks to the emergence of new techniques for storing, collecting and analyzing data, there’s a new wave of security companies looking smarter than ever. Read more »
Project Glass, Google’s augmented reality smart glasses, is the ultimate expression of the wearable tech trend. Paul Armstrong of @TheMediaIsDying says that whether you like it or not, the technology is coming–and the changes are going to be profound for the media business. Read more »
HBase is a great option for developing big data applications, but it’s not necessarily easy to use. WibiData is addressing this by open sourcing a portion of its predictive analytics infrastructure that adds structure to data, followed eventually by a whole HBase development framework called Kiji. Read more »
Hadoop is nothing without applications, and Continuuity aims to deliver those apps by making Hadoop something developers can work and innovate with. Its efforts haven’t gone unnoticed — the company just closed a $10 million Series A round from a who’s who of big data VCs. Read more »
Zoomdata has a plan for business intelligence that involves tacking the difficult problem of streaming data, and doing so with a mobile-device-first mindset. The result is pretty and compelling in theory, but it’s technologically challenging and will face tough competition from new and old vendors alike. Read more »
Less than a month after unveiling its Hadoop analytics engine to great fanfare, Platfora has raised $20 million to realize its mission of displacing the business intelligence and data warehouse incumbents. It’ll need every dime: although the competition is old, it’s also rich, entrenched and determined. Read more »
The largest players in the Hadoop market are already raising money and sky-high valuations, employing hundreds of people and, in some cases, looking at nine-figure revenues. If you’re trying to get a sense of whether Hadoop is for real, these details might help. Read more »
The growth of public and private cloud services places new demands on the IT organization, particularly when it comes to the scale, agility and management of the data center. SDNs are a response to those demands, providing opportunities for IT managers to improve their network operations. Read more at GigaOM Pro »
Facebook has open sourced a new system called Corona for scheduling and managing Hadoop jobs. Corona attempts to do away with many of the problems that come along with massive-scale Hadoop operations, and soon looks to take Facebook’s Hadoop deployment beyond just MapReduce. Read more »
Mobile-application development specialist Appcelerator bought big data startup Nodeable on Wednesday, although the deal wasn’t exactly what Nodeable was planning for when it launched in 2011. Founder and CEO Dave Rosenberg shares some of the lessons he learned trying to break into the big data space. Read more »
Guess what, accurately predicting the outcomes of elections really isn’t a partisan affair. What Nate Silver and several others accomplished in perfectly predicting the election isn’t about finding data to support their desired outcomes. It’s about processing reams of imperfect data and figuring out what matters. Read more »
There’s shift happening in the world of online data collection, meaning consumers might expect to get paid for access to their data rather than always playing the role of uncompensated mark. Done right, it’s a system where both sides of the equation stand to win. Read more »
The delivery of real-time query makes Hadoop accessible to more users — and by orders of magnitude. Its significance goes well beyond delivering a database management system (DBMS) kind of query engine that other products have had for decades. Rather, Hadoop as a platform now supports a whole new paradigm of analytics. With the introduction of real-time query, Hadoop has taken a major step toward unifying the majority of big data analytic applications onto one platform. This research paper targets information technology professionals who have in-depth experience with traditional RDBMS and seek to understand where the Hadoop ecosystem and big data analytics fit. Read more at GigaOM Pro »
Hack/reduce will launch its cool new work space near Cambridge’s Kendall Square on Thursday. The goal of the effort is to bring together the best big data people from private and public sectors and academia to train up the next generation of data scientists. Read more »
It’s one day before the presidential election, and the results from computer models and other data analyses are in, with most experts giving President Obama a higher probability of winning than challenger Mitt Romney. That’s no lock, however: while data doesn’t lie, models sometimes do. Read more »
BillGuard, a crowd-sourced financial protection service that flags suspicious activity for consumers, is taking its services to mobile wallet app Lemon, which has 2.5 million users on iOS and Android. Now, Lemon users can check their balance on stored cards, see recent transactions and suspicious activity. Read more »
In just a few years, big data has turned from a buzzword and concept best left for large web companies into a force that drives much of our digital lives. Here are five technological trends that will change how data is processed and consumed going forward. Read more »
App analytics and advertising firm is raising $25 million from Crosslink Capital as it builds out internationally and looks at a possible IPO by the second half of 2013. The company is riding the boom in mobile as more consumers turn to smartphones and tablets. Read more »
A new research paper from Google highlights the importance of big data in creating consumer-friendly services such as voice search on smartphones. More data helps train smarter models, which can then better predict what someone say next — letting you keep your eyes on the road. Read more »
