17 Comments

Summary:

The discussion around NoSQL seems to have evolved from abolishing SQL databases to coexisting with SQL databases, and then to SQL is actually regaining momentum. Is SQL regaining favor, even among webscale types? Was it ever out of favor?

The discussion around NoSQL seems to have evolved from abolishing SQL databases to coexisting with SQL databases, and then to SQL is actually regaining momentum. Is SQL winning back favor, even among webscale types? Was it ever out of favor?

We saw evidence of this momentum shift back to SQL-based databases this week, with Facebook’s Jonathan Heiliger signing onto the advisory board of clustered SQL startup Clustrix. Facebook famously invented the NoSQL Cassandra database but still relies on the venerable MySQL-plus-memcached combination for the brunt of its critical operations. Additionally, Xeround now offers a scalable MySQL database on Amazon EC2, and database guru Michael Stonebraker recently launched his latest SQL-based startup, VoltDB. Will a scalable SQL option always win out against a NoSQL option? Even for unstructured data?

Once we’re no longer talking about serving data, but rather just about storing large volumes of it, NoSQL can seem nearly obsolete. For organizations willing to pay for data warehousing and analysis tools, the options are limitless: massively parallel software, data warehouse appliances, distributed file systems, and the list goes on. Pick your poison. Have lots of unstructured data to analyze and don’t want to pay for software? Try Hadoop. Plus, it might very well work with your existing data management software.

None of this is to say that NoSQL databases aren’t quality options. They actually vary greatly in terms of ideal uses, and some are gaining quite a bit of popularity. Aside from Membase, projects like Cassandra, CouchDB, MongoDB and Riak are maturing fast and gaining in popularity. But they’ve also been the cause of some noteworthy outages as of late. Perhaps these are just growing pains, but try telling that to most CIOs.

It’s a case of familiar versus unfamiliar, and the voices backing a better version of the status quo are getting louder. It will be tough, but not impossible, for NoSQL to be heard.

Read the full post here.

Image courtesy of Flickr user popculturegeek.com.

  1. Perhaps what is actually needed is a database with multiple “personalities” that can appear to be a set of relational tables and be queried using SQL when needed, but can also behave as a NoSQL database too, so you get the best of all possible worlds. And something preferably ideally tried and tested in the real-world to please those CIOs. Perhaps something like this: http://www.mgateway.com/docs/universalNoSQL.pdf

    Share
  2. Derrik

    I think that what were witnessing is more of a convergence of trends rather then a split into two camps.

    In other words that idea from the NoSQL worlds such as de-centralized data structures, relaxed consistency, dynamic schemas, map-reduce starting to merge with the semantics of SQL.

    This reminds me the emergence of Object database back in the
    90’s. When OO came to the word we started with specilized OO databases but at the end it was the O/R mapping tools that won the war. This is very similar to what we can already see with Google Big Table that is using JPA facade onto of its BiGTable datastore, the same goes with Hive and Hadoop and so forth.

    So the right strategy would be having NoSQL backend with SQL front-end on one end, and SQL engines starting to add support for dynamic data structures and map/reduce and de-centralized deployment on other end.

    You can find more details on that analysis on my post <href=”http://www.dzone.com/links/r/yesql_an_overview_of_the_various_query_semantics.html”>YeSQL and new one that i just published yesterday NoCAP

    Nati S
    GigaSpaces

    Share
  3. Hi Derrick,

    Very interesting analysis. Trends are always coming and going – at the end the good technologies stick.
    If SQL scalability interests you, I suggest you take a look at scalebase – who built the first database load balancer, allowing any SQL database to reach unlimited scaling.

    Share
  4. EMC’s new appliance built on general-purpose Intel Westmere EP processors and with Greenplum technology is also a product that supports the view that SQL is going nowhere. Oracle’s Exadata, Teradata’s 2580, Netezza’s TwinFin appliance offerings also cater to big data market on SQL databases. So far NOSQL seems to be a niche play with mostly support/consulting based business models.

    Share
  5. Just make better connections to articles that have been posted on gigaom.

    Previously, it was all about 2015 being the year that machine data explodes past user-generated data (look back at your IDC report coverage). And it is an actual exponential explosion.

    Think about that for a minute. All google does is gather user-generated data over HTTP, archive, index it, makes it available. But a single, easily accessible machine like a modern DNA sequencer in the hands of a small number of scientists right now could exhaust the entire storage device market (not the enterprise storage market, ALL storage devices mades) of 2010 just entirely on their own.

    So what we’re looking at now is not SQL vs NoSQL.

    What we’re seeing now is all the swirly mess that goes along with people actually thinking about their data over the next few years, and how it should be stored, accessed and relayed.

    We’re experimenting with different ways of storing data. Different ways of accessing it. And I don’t know anyone that’s completely replacing SQL with “NoSQL”. Everyone is doing both. Everyone is doing all of it. Google is a great example of a company that has MySQL and in-house solutions across all “nosql” market.

    Everyone is starting to think about how to put the right data in the right spot for the right reasons, rather than simply using MySQL because it was already installed or Oracle because it’s “enterprise”.

    Share
  6. It doesn’t matter if NoSQL will ultimately “win” or not. if NoSQL made the “regular” SQL guys start, stop sitting on their asses and thinking about problems they left untouched for decades that’s good enough :)

    Share
  7. A couple thoughts:

    (1) We are seeing developers in quite a few cases developers are preferring MongoDB for application development over a traditional (rdbms) approach because it makes development easier: in large part because of schema flexibility greatly increases agility of their development; also for some problems, the data models map more naturally. So it’s worth noting with “NoSQL” that it is not all about scale: there are other potential benefits. A good test is to do one project with mongodb and then see if one, as a software developer, wants to go back to the traditional approach.

    (2) It’s pretty clear to me that “one size fits all” is over. We already have products specifically for reporting and BI (hadoop, greenplum, aster, vertica, neteeza, …) — what I think we will see next is a little bit of specialization on the “online” side of the database world. Traditional RDBMS for highly transactional problems (such as banking); nosql for rapid development and easy scaling.

    But why not just test drive these things and see for one’s self? Almost everything in the space is open source, I would encourage developers to kick the tires a bit.

    dwight/mongodb

    Share
  8. I would add CloudB (http://code.google.com/p/cloudb) to the list, although it’s an hybrid system that can support [ideally] also SQL databases.

    Share
  9. hi, two thoughts

    (1) a lot of people are liking NoSQL (and the one I know about, MongoDB) because it makes application development easier. The flexible schema characteristics and document-oriented model can be quite helpful for speeding development. Thus I think “it’s not all about scale”. Do one project with it and you may not go back!

    (2) The one thing I know for sure is that mongodb has great momentum and every month is bigger than the last. Over 1MM download/year run rate.

    thanks
    dwight/mongodb

    Share
  10. Derrick Harris Sunday, October 17, 2010

    I couldn’t agree more with most of the comments, especially as they relate to a combination of data solutions for different applications. My point with the post (actually, for the original, expanded version on GigaOM Pro) is that we’ve been seeing a SQL resurgence after a period where all we heard was that NoSQL is the future, with scalability often being cited as the primary differentiation.

    @arnon: I think that might be exactly what happened. The question now is whether NoSQL options can get a fair chance if SQL proves itself scalable enough.

    Share

Comments have been disabled for this post