Stay on Top of Enterprise Technology Trends
Get updates impacting your industry from our GigaOm Research Community
DataTorrent, a startup building a stream-processing engine for Hadoop that it claims can analyze more than 1 billion data events per second, announced on Tuesday that its flagship product generally available. Stream processing is becoming more important as we move into an era of connected devices, ubiquitous sensors and fast-paced web platforms such as Twitter. Data is flowing into systems faster than ever, and many companies would like to get some use out of it in real time; in some cases, even hours-old data could be considered stale. Other products and projects addressing stream processing on Hadoop include Apache Storm, Spark Streaming and Samza, and Amazon Kinesis.