Updated: Feb. 10, 2011, 5:55 p.m.

Beanstalkd

beanstalkd is a simple, fast work queue. A Python based gui named django-jack is available and a wealth of client libraries.

Installation on Ubuntu

# Install
sudo apt-get install beanstalkd

# Enable
vim /etc/default/beanstalkd

# Start
sudo service beanstalkd start

Useful parameters include:

# Persisting the queue on restart
-b DIR   binlog directory (must be absolute path if used with -d)
-s BYTES set the size of each binlog file (default is 10485760)
-f MS    fsync at most once every MS milliseconds (use -f 0 for "always fsync")
-F       never fsync (default)

# Bind address and system user
-l ADDR  listen on address (default is 0.0.0.0)
-p PORT  listen on port (default is 11300)
-u USER  become user and group

# Message sizes
-z BYTES set the maximum job size in bytes (default is 65535)

Preferred Libraries