While webscale data center operators such as eBay are deploying custom-built data center containers designed for maximum performance and efficiency, IO Data Centers is pushing modular data centers for the rest of us. Its IO.Anywhere modules aren’t designed for HPC, but do promise flexibility. Read more »
In a webscale data center, peak efficiency feels like a blast furnace. I stepped into the hot aisle of Dell Modular Data Center and 1,920 servers blasted 115-degree air right in my face. If eBay’s Dean Nelson has his way, that was just the beginning. Read more »
OMGPOP can thank the cloud for its acquisition by Zynga on Wednesday. The gaming startup, whose Draw Something iPhone used cloud computing and a NoSQL database to scale from zero (relatively speaking) to more than 35 million downloads in three weeks and never miss a beat. Read more »
It all seems so easy: You log into Facebook, update your status, tell everyone where you are and — voila! — your Timeline is geospatial. Only, while it’s just one extra step for you to add location, building that capability was a tad more complicated for Facebook. Read more »
Twitter has been on a tear lately when it comes to open sourcing big-data tools. The latest two are Cassie, a client for managing Cassandra clusters, and Scalding, a MapReduce framework for simplifying the creation of Hadoop jobs. Big data won’t be black magic forever. Read more »
Zynga is in a tricky position technologically thanks to its new frenemy status with Facebook. Zynga claims 240 million active users, and it wants a lot more, but scaling to those heights might require one heck of a computing infrastructure. Read more »
With more than 45 million users already connected to his company’s cloud storage service, Dropbox CEO Drew Houston knows he has an infrastructure challenge ahead of him. That, Houston says, is a big reason Dropbox bought Cove, which brings with it Facebook engineering cred. Read more »
Facebook’s S-1 filing shows the company is all about infrastructure. The ad revenue and user experience it relies on to exist mean Facebook can’t afford to take it easy on IT, which means shareholders and users will both find plenty of reasons to get upset. Read more »
Somewhat lost in the greater story of Amazon Web Services’ new DynamoDB NoSQL database is that the new service runs atop a solid-state storage system. By abstracting those SSDs behind a NoSQL service, AWS is trying to prove that hardware presents greater opportunities than Infrastructure-as-a-Service alone. Read more »
Google announced that it’s ending its Academic Cloud Computing Initiative, a joint program with IBM and the National Science Foundation that gave researchers access to a massive Hadoop cluster on which to run their data-intensive projects. The company says access to such resources is now common. Read more »
At last week’s MongoSV conference in Santa Clara, Calif., a number of users shared their experiences with the MongoDB NoSQL database. One common theme: NoSQL is necessary for a lot of use cases, but it’s not for companies afraid of hard work. Read more »
Never content with good enough when it comes to speed, Facebook has taken its open-source PHP-boosting HipHop technology to the next level for programmers. With the new HipHop Virtual Machine, Facebook claims it has improved upon HipHop interpreter performance by 60 percent. Read more »
Facebook held a Tech Talk on Monday night explaining how it built a MySQL environment capable of handling everything the company needs in terms of scale, performance and availability. Based on what I heard, it looks like critics of Facebook’s MySQL environment might be wrong. Read more »
E-commerce site Etsy has grown to 25 million unique visitors and 1.1 billion page views per month, and it’s generating the data volumes to match. Using tools such as Hadoop and Splunk, Etsy is turning terabytes of data per day into a better product. Read more »
Over the past couple years, Facebok has released details on a number of its internal efforts to automate and simplify the management of its massive infrastructure. As reliance on web applications and cloud services become more common, Facebook’s tools and technologies could be a cash cow. Read more »
Last quarter we highlighted the fast maturation of the Platform-as-a-Service and big data spaces. Those two trends only picked up speed during the third quarter of 2011. Joining them on the cusp of IT greatness, though, are the OpenStack project and flash storage. The former gathered serious validation from big-name companies, while the latter saw less funding than last quarter but a significant number of product launches. Of course, the third quarter wasn’t all lollipops and rose petals. We saw new computing technologies and delivery models such as tablets wreak havoc on both HP and Cisco, and there are concerns (aren’t there always?) about how the Internet will handle our increased use of streaming video and cloud computing. Unfortunately for HP and Cisco, the latter problem might be an easier fix than the strategic woes facing them. Additional companies mentioned in this report include CloudBees, Rackspace, Engine Yard and Joyent. For a full list of companies, and to read the full report, sign up for a free trial. Read more at GigaOM Pro »
Traditionally, scientists and researchers develop the latest and greatest techniques in computing, which trickle down corporate data centers where they’re relevant. But with big data — the process of analyzing voluminous quantities of data in new, unique ways — it’s industry that’s driving the innovation ship. Read more »
Earlier this year, rumors swirled about whether Twitter had actually moved into a new Utah data center, or if it was forced to move its operations to a different facility. Now there are reports that Twitter is leasing more data center space, this time in Atlanta. Read more »
When you’re running a large web infrastructure, automation is critical to ensure that administrators aren’t spending their every waking seconds putting dealing with downed servers. Google, Yahoo and other pioneers had to figure out how to automate failover in their data centers. Now it’s Facebook’s turn. Read more »
MongoDB-based startup 10gen has raised $20 million in a Series D funding round. The latest round speaks to the popularity of the MongoDB document database among large companies, even though the hype around NoSQL has lessened considerably over the past year. Read more »
Cotendo is leveraging Equinix’s global data center footprint to give itself 30 points of presence, letting Cotendo focus on differentiating elsewhere. The companies released details of their partnership Thursday morning, including a quadrupling of Cotendo’s customer base to 400 from 100 in the past two years. Read more »
Google, which serves about 7 percent of the world’s overall web traffic, isn’t any ordinary company. Google Research Director Peter Norvig recently shared some of the considerations that Google takes into account when designing its infrastructure and systems to operate at Internet scale. Read more »
For anyone who didn’t know, Facebook is a huge Hadoop user, and it does some very cool things to stretch the open source big data platform to meet Facebook’s unique needs. Today, it detailed how it migrated its 30-petabyte cluster from one data center to another. Read more »
Two weeks ago, a post quoting Michael Stonebraker, who questioned the relevance of MySQL and Facebook’s use of it, sparked an overwhelmingly negative response. The true state of the database market appears to be that while SQL has its place, ideal uses are fading fast. Read more »
Nginx creator Igor Sysoev is planning a company based around the wildly popular open-source web server. Sysoev announced the decision on the Ngnix blog Monday morning, writing that the commercial entity’s primary goals will be better support and more consistent feature releases. Read more »
Google spent $917 million on infrastructure during the second quarter, continuing an upward trend that helps ensure new services like Google+ keep running. It’s the eight consecutive quarter of increased capital expenditures for Google, which is now spending at near-record levels. Read more »
Big processors or little processors, scale-up or scale-out, on-premise or in the cloud: the answers might not be as easy as one would think. Web-style, scale-out architectures, low-power server processors and cloud computing are getting more attention by the day, but they have their limits. Read more »
According to database pioneer Michael Stonebraker, Facebook is operating a huge, complex MySQL implementation equivalent to “a fate worse than death.” It’s actually a predicament all too common among web startups, for which the solution might be a class of databases referred to as NewSQL. Read more »
Sometimes, the geeks come out of the shadows and hit the mainstream consciousness. Remember the early ’00s and the rush of publicity for Ruby and Ajax as they became the calling cards of Web 2.0? Node.js looks like the next candidate for such mainstream elevation. Read more »
Among the biggest problems with developing applications for the cloud is scaling the database layer. GenieDB, a competitor in our recent Structure 2011 LaunchPad competition, wants to give its customers the benefits of both SQL and NoSQL to scale across data centers. Read more »
Hadoop is a very valuable tool, but it’s far from perfect. While Apache, Cloudera, EMC, MapR and Yahoo focus on core architectural issues, there is a group of vendors trying to make Hadoop a more-fulfilling experience by focusing on business-level concerns such as applications and utilization. Read more »
At Google’s I/O event last month, the company announced new features and a new pricing model for its App Engine PaaS offering, and now the web giant thinks it’s prepared to compete with companies like Red Hat and Salesforce.com in bringing enterprise users to its platform. Read more »
Online dating service eHarmony is using SeaMicro’s specialized Intel Atom-powered servers as the foundation of its Hadoop infrastructure, demonstrating that big data applications such as Hadoop might be a killer app for low-powered micro servers. Read more »
When Steve Jobs flashed inside images of Apple’s new cloud data center during his WWDC keynote on Monday, he ignited a mini firestorm of speculation about just kind hardware is filling its immense surface area. Everyone seems to agree that HP and Teradata were big winners. Read more »
Apple officially launched its much-hyped iCloud suite of services at its Worldwide Developer Conference today, and although the capabilities are sure to be the talk of the town, it’s Apple’s cloud infrastructure that makes it all work. Steve Jobs said as much during his WWDC keynote. Read more »
Facebook today published an interesting visualization of just how complex its codebase is. Actually, the visualization is part of an application within the company, but it gets the point across: Making code changes is no small feat when every module is dependent on so many others. Read more »
According to a post today on the Facebook Engineering blog, the social networking leader undertook an effort called “Project Triforce,” which involved provisioning a replica production region from an existing cluster, to ensure the site could run smoothly across three regions without falling on its face. Read more »
The advent of Web 2.0 and its principles of scaling out and designing to fail have brought about something of a sea change in how companies buy servers. For evidence, one needn’t look any further than Dell, which is making a killing selling micro servers. Read more »
The most interesting part about yesterday’s announcement that Groupon is using the Cloudera Distribution of Hadoop wasn’t the actual use but, rather, the insight that Groupon is “building a world-class infrastructure” of which Hadoop will be a key part. But recruiting big-data-savvy talent is getting rather pricey. Read more »
Nutanix startup that sells an appliance combining computing and storage on the same nodes, has raised $13.2 million. The company is developing an appliance combining computing and storage on the same server nodes, a story that should resonate with customers concerned with scalability and performance. Read more »
