May 01

atbr (large-scale and low-latency in-memory key-value pair store) now supports websocket-based sharding for parallel deployments.

Websocket Sharding Example

Checkout and install atbr

$ git clone
$ cd atbr
$ sudo ./

Start 3 servers loaded with data

$ cd atbrserver
$ python 8585 shard_data_1.tsv
$ python 8686 shard_data_2.tsv
$ python 8787 shard_data_3.tsv

Start shard server talking to shards

$ python localhost:8585 \
          localhost:8686 localhost:8787

Connect to shard server and lookup key=key1

$ python key1

Stay tuned for other updates on atbr, here is a rough roadmap.

  • Increased concurrency and threadsafety support
  • Increased reliability in sharded deployments (with Apache Zookeeper)
  • Simplified and automated sharded deployment on AWS and clusters
  • Benchmarks
  • Comparison with other storage alternative (e.g. HBase, Redis, MongoDB, CouchDB and Cassandra)
  • End-to-end examples (from hadoop/mapreduce jobs to serving)
  • (in-memory) map(reduce) support with Lua or C++
  • Thrift support
  • Avro support
  • large-scale graph processing example (ref: NetworkX)
  • Case studies


Best regards,

Amund Tveit (@atveit)

Digg This
Reddit This
Stumble Now!
Buzz This
Vote on DZone
Share on Facebook
Bookmark this on Delicious
Kick It on
Shout it
Share on LinkedIn
Bookmark this on Technorati
Post on Twitter
Google Buzz (aka. Google Reader)

One Response to “atbr – supports websocket-based sharding”

  1. atbr now has Apache Thrift support Says:

    […] atbr – supports websocket-based sharding May 02 […]

Leave a Reply

preload preload preload