Jangro.com - Latest Comments in Website Performance Tools: How I Installed Memcached

Re: Website Performance Tools: How I Installed Memcached

MorganLighter — Mon, 11 Jun 2007 23:28:55 -0000

Scott - What a lifesaver you are. Our site had some issues as described above last year and what a debacle. With memcache and your instructions for installation, we won't run into this problem again. One respondent said he'd buy you a beer - heck, I'll buy you dinner! Thanks.

Re: Website Performance Tools: How I Installed Memcached

Sean — Sun, 27 May 2007 13:32:55 -0000

We memcached some internal API stuff about a month ago at b5media.com, and it drastically improved things. DB load was slashed by 2/3. I'm looking forward to caching more stuff!

I'd suggest building packages out of libevent, memcached, and the PECL module to make it easier to manage your servers. My blog has some links on the latter, libevent ships with a .spec file, and memcached is only a couple of files.

Sean

Re: Website Performance Tools: How I Installed Memcached

Sudhir — Wed, 02 May 2007 10:11:23 -0000

Hey Scott,

Great work with the article, you saved me a ton of time in getting the memcacheed working with PHP!.
I owe you a beer :) Keep up your good work.

Re: Website Performance Tools: How I Installed Memcached

matthieu — Tue, 24 Apr 2007 15:52:42 -0000

Thank you for this article ; I couldn't find the library not found error for the libevent. I'm sure this article is useful to dozens of people :-)

Re: Website Performance Tools: How I Installed Memcached

Nicholas Thompson — Sun, 11 Mar 2007 12:39:13 -0000

No probs - glad to help. I've already implemented this in my ThingyMaJig site. It brought page generation times from 400ms to just over 100ms. Thats MASSIVE!

I'm currently (litterally - i'm doing it NOW) working with a friend to create an official module for Drupal. He's made a very good start (the base for TMJ) and I'm extending it.

Re: Website Performance Tools: How I Installed Memcached

Scott — Sun, 11 Mar 2007 12:36:30 -0000

It was a total hack, Nick, yeah.

thanks for adding this. great info.

--scott

Re: Website Performance Tools: How I Installed Memcached

Nicholas Thompson — Sun, 11 Mar 2007 11:54:42 -0000

Regarding this error:

memcached: error while loading shared libraries: libevent-1.3a.so.1: cannot open shared object file: No such file or directory

I tried making the symlink as you suggested (except for me, it was in lib64) and it worked, but it left a little bit of a "hack-like" taste in my mouth.

I noticed the first line is ld.so.cache. With a little research, I found an alternative and less hack-tasting (imho) method: in /etc/ld.so.conf.d/ make a file called libevent.conf and write in this file the path to the libevent libraries (eg /usr/local/lib). Finally, run ldconfig (as root) and the cache get regenerated.

The advantage of this method is that as the cache gets checked before the system path, it means the system does less "looking" for the file. In any case - both methods work.

Thanks for this blog!

Re: Website Performance Tools: How I Installed Memcached

fernando — Tue, 06 Mar 2007 09:08:44 -0000

You'd be surprise how well lighttpd with PHP does... and you can load balance php across servers, and now that you have memcached you can store sessions on memcached and things will fly... I can't say enough good things about lighttpd.

Here is a great post on their blog:
http://blog.lighttpd.net/ar...

Re: Website Performance Tools: How I Installed Memcached

Scott — Mon, 05 Mar 2007 08:57:30 -0000

thanks fernando.

Yeah, that's next on the list. getting lighttpd set up for serving the static assets like images.

Re: Website Performance Tools: How I Installed Memcached

Gene Kavner — Fri, 02 Mar 2007 02:36:30 -0000

Scott -- I was hit with the exact problem you described last week. The brand new Blog Window widget that I created became so popular that my server was getting hit at an average of 2-3 times per second. I didn't expect the load to go up so fast. Unfortunately, this overwhelmed the hosting site I was using. I'm using ASP.NET so your trick doesn't help me, however, I rearchitected by implementing the cache in the ASP.NET code. Also, upgraded to a dedicated dual-proc, 4GB system, so the CPU meter now barely budges even under heavy load.

Re: Website Performance Tools: How I Installed Memcached

Scott — Wed, 28 Feb 2007 21:19:41 -0000

Hey Mark, we've got a number of dedicated servers. Nice for when you've got to do stuff like this.

Re: Website Performance Tools: How I Installed Memcached

mark from 45n5.com — Wed, 28 Feb 2007 19:42:54 -0000

what type of setup do you have for hosting your sites? I've never ventured outside of shared hosting, and never needed to.

Re: Website Performance Tools: How I Installed Memcached

ddn — Wed, 28 Feb 2007 18:08:39 -0000

You'll definitely see the difference as traffic ramps up. It may not be so much a speed thing as scalability. You should be able to drop the number of queries to the DB by several orders of magnitude.

Have fun.

Re: Website Performance Tools: How I Installed Memcached

Scott — Wed, 28 Feb 2007 16:47:20 -0000

Jury's out on that ddn. I was just so happy to get it running that I wanted to write about it before I forgot all the details.

Tried it out in a few spots and got some 2x improvements -- but we're talking about milisecond execution times on DB hits, so there isn't much room for improvement on those.

I'll follow up when I've got some meatier results.