Amazon’s Import/Export Service, which allows companies with large data sets to mail their files to Amazon’s cloud is now available to all. The success of the service points to several business opportunities when it comes to optimizing bandwidth, cloud portability and creating markets for big data.

Amazon’s Import/Export Service, which allows folks with large data sets to mail their files to the company’s storage and compute clouds, has moved from beta to general availability. We wrote last year when the service launched about how our broadband infrastructure isn’t robust enough to handle terabytes of information quickly and affordably, which meant that certain AWS clients with large data sets would find the ability to put their data on storage drives and pop them in the mail to Amazon both faster and a better deal than sending it via the web.

A year later Amazon has opened the service up to everyone, and offers some use cases that drive home both the value of cloud computing and the amazing masses of data that are being processed on the cloud. The company’s Open Solutions Group, for example, uses AWS to parallel process more than 40 terabytes of geospatial data, yielding results in hours instead of years. “Within just days our customers have disks and data in hand, and can begin modeling, analyzing, and visualizing the results of our geo-processing work,” Brian Levy, president and CEO of Open Solutions Group, is quoted as saying.

What will really be cool is when customers of Open Solutions no longer bring that data in-house for analysis. At that point we’d have a broadband network robust enough to send such information out to customers, but also a culture at enterprises that finds it acceptable to take the data and perform the modeling within a compute cloud. But first it will have to be easier to move the data from one cloud to another than it is currently (and ideally not involve the U.S. Post Office), and would likely require a special-purpose cloud dedicated to data analytics.

I think providing a faster way to move the data (such as Aspera does), ensuring open standards for the data so that it’s portable, and possibly special purpose high-performance computing clouds are emerging business opportunities for startups and established companies. I also think processing big data on compute clouds is leading to very interesting business opportunities, which I outlined in a GigaOM Pro research note a few weeks back (sub req’d). Anyone interested in either of these should really come to our Structure 2010 conference in San Francisco later this month where we’ll be discussing exactly these sorts of opportunities. Or you can talk about it in the comments below.

You’re subscribed! If you like, you can update your settings

By Stacey Higginbotham

You're subscribed! If you like, you can update your settings

  1. Overnight Fedex can be extremely high bandwidth.

  2. Never underestimate the bandwidth of a stationwagon filled with tapes. At present, it is even higher in bandwidth than even the fastest of data pipes that you can construct using new technology today.

    I don’t think it’s a move backwards to use “snail mail”, but it’s actually the quickest way to transfer, lets say a few hundred terabytes of data within 24 hours with overnight courier.

  3. To give another vendor’s perspective, as an Infrastructure-as-a-Service provider we see vendor lock-in and many concerns surrounding data control holding back cloud adoption. We believe that the technology exists now to address many of those concerns and make IaaS significantly more accessible and open from a data portability point of view. It is very much a case of users demanding the data portability they require from vendors.

    In our opinion all cloud services should have a clearly defined and easy to follow way to get data both in and out of the cloud. Whether this is SaaS, PaaS or IaaS, all should incorporate easy ways to take ownership back of data as a matter of principal, without additional charges or barriers. It should be just as easy to get data out of a cloud as it is to put it in.

    We’ve addressed issues of data lock-in and data portability by developing direct FTP over SSL access to our cloud. Thus far we are the only IaaS provider to offer such a feature. Users can FTP in and our entire drive images. Migrating out of CloudSigma’s cloud is as simple as connecting via FTP and downloading your server disk images. We believe this is both convenient and, because bandwidth between data centers and clouds is relatively high, very quick also.

  4. Self-Publish Your Book Worldwide. | Airsoft Gun Silencer Sunday, June 13, 2010

    [...] When Amazon Resorts to Snail Mail, There's a Business Opportunity [...]

  5. Amazon Reinvents ‘Terascale Sneakernet’ Sunday, June 13, 2010

    [...] been a similar horrified reaction to the Amazon news from commentators who feel that the Internet somehow just ought to be faster at transferring data than something as old-fashioned and non-virtual as a national courier [...]

  6. Mortgage Document | Refinance My Mortgage Wednesday, June 16, 2010

    [...] When Amazon Resorts to Snail Mail, There’s a Business Opportunity [...]

  7. Is Consumer Content Up Next for Aspera?: Cloud Computing News « Friday, February 4, 2011

    [...] with Amazon Web Services, too, on efforts that help mitigate the need for joint customers to physically ship their hard drives to the cloud computing provider. Munson says Aspera’s fasp product can speed transfers to Amazon EC2 by about 100 times, [...]

Comments have been disabled for this post