The commercialisation of Memcached

From Matthew Asselt Blog:


There has been a significant increase in interest in the Memcached, the open source distributed memory object-caching system, in recent months, as a number of vendors look to exploit its popularity in Web 2.0 and social networking environments.

Like Hadoop, which has become the focus of a number of commercial plays, it would appear that the time is right for commercialization of Memcached. But what is it, here did it come from, and what are the chances for vendors to rake in serious cash? Here are the details.

What is it?
Pronounced mem-cash-dee, Memcached was originally created by Danga Interactive (the developer of LiveJournal, which was acquired by Six Apart in 2005) to speed up the performance of dynamic Web applications by alleviating database load. Memcached has become an industry standard for improving the performance of dynamic websites.

The code is available from the remaining Danga website, as well as from Google Code, and the main server is under the BSD license.

What is is for?
Memcached is designed to speed-up the performance of dynamic web applications by providing a memory cache of frequently accessed objects, reducing the load requirements on the database toer and improving application performance.

What is it not?
Memcached is often associated with improving the scalability of web application infrastructure, but as this post from dormando illustrates, it is not actually designed to enable scale-out architectures.

    “What memcached really is, is a giant floating magnifying glass. It takes what you have already built and makes stretch ten times further. I insist on not confusing caching with scaleout as when your little stretch-armstrong of a website hits that tenfold limit, you’re still screwed.”

<p>Other things Memcached is not <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">include</a> a database, a queue system and a proxy.</p>
<p><strong>Who uses it?</strong><br />
Example users <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">include</a> LiveJournal, Slashdot, Wikipedia, SourceForge and Kayak. For an overview of Facebook&rsquo;s use of Memcached, see <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">here</a>. In fact Facebook <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">claims</a> to have become the largest user of memcached and actively contributes modifications back to the project</p>
<p><strong>Who is supporting Memcached?</strong><br />
Until recently the list of corporate backers was small. MySQL included support for Memcached in its <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">MySQL Enterprise</a> subscription, while in February Sun provided Memcached support as part of its <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">GlassFish Web Stack</a>.</p>
<p>Then the floodgates opened. In April Gear6 <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">launched</a> its Gear6 Web Cache, a Memcached appliance, as did <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">Virident</a>, and <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">Schooner Information Technology</a>. (Subscribers can see our formal assessments of <a _base_href="" href=";source=search-web">Gear6</a>, <a _base_href="" href=";source=search-web">Virident</a> and <a _base_href="" href=";source=search-web">Schooner</a>).</p>
<p>Additionally, EnterpriseDB is using Memcached as the basis for <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">Infinite Cache</a>, which provides a cache behind the database to improve the performance of read-intensive transactional applications (our formal take is <a _base_href="" href=";source=search-web">here</a>). Meanwhile <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">NorthScale</a> provides Memcached training, services and support, and has plenty of other plans up its sleeve.</p>
<p>All of these vendors, and more, are either already contributing improvements to the Memcached code, or plan to do so, further increasing its relevance.</p>
<p><strong>Other points of interest</strong><br />
Microsoft&rsquo;s <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">Velocity</a> project has been described by the company as its attempt to replicate Memcached for Windows environments. <a _base_href="" onclick="javascript:urchinTracker ('/outbound/article/');" href="">Terracotta</a>, the Java caching vendor, reports seeing increased usage of Memcached in competitive environments. It arguably faces the biggest threat from the rise of commercial Memcached support providers.</p>
Founder and CEO