atbr – supports websocket-based sharding

atbr (large-scale and low-latency in-memory key-value pair store) now supports websocket-based sharding for parallel deployments.

Websocket Sharding Example

Checkout and install atbr

$ git clone
$ cd atbr
$ sudo ./

Start 3 servers loaded with data

$ cd atbrserver
$ python 8585 shard_data_1.tsv
$ python 8686 shard_data_2.tsv
$ python 8787 shard_data_3.tsv

Start shard server talking to shards

$ python localhost:8585 \
          localhost:8686 localhost:8787

Connect to shard server and lookup key=key1

$ python key1

Stay tuned for other updates on atbr, here is a rough roadmap.

  • Increased concurrency and threadsafety support
  • Increased reliability in sharded deployments (with Apache Zookeeper)
  • Simplified and automated sharded deployment on AWS and clusters
  • Benchmarks
  • Comparison with other storage alternative (e.g. HBase, Redis, MongoDB, CouchDB and Cassandra)
  • End-to-end examples (from hadoop/mapreduce jobs to serving)
  • (in-memory) map(reduce) support with Lua or C++
  • Thrift support
  • Avro support
  • large-scale graph processing example (ref: NetworkX)
  • Case studies


Best regards,

Amund Tveit (@atveit)

This entry was posted in cloud computing and tagged , , , , , , , . Bookmark the permalink.

One Response to atbr – supports websocket-based sharding

  1. Pingback: atbr now has Apache Thrift support