Monthly Archives: May 2012

A large-scale in-memory storage example – social network data

This posting is a follow-up to the large-scale low-latency (RAM-based) storage related price estimates in my previous posting Main takeaways from Accel’s Big Data Conference. Assume you were to store and index large amounts of social network updates in-memory, e.g. … Continue reading

Posted in in-memory, information retrieval, infrastructure, RAM | Leave a comment

Main takeaways from Accel’s Big Data Conference

Attended Accel Partners Big Data conference last week. It was a good event with many interesting people, a very crude estimate of distribution: 1/3 VCs/investors, 1/3 startup tech people, 1/3 big corp tech people. My personal 2 key takeaways from … Continue reading

Posted in cloud computing | Tagged , , , , | 3 Comments

atbr now has Apache Thrift support

atbr (large-scale and low-latency in-memory key-value pair store) now supports Apache Thrift for easier integration with other Hadoop services. Thrift Example Checkout and install atbr [code] $ git clone git@github.com:atbrox/atbr.git $ cd atbr $ sudo ./INSTALL.sh [/code] Prerequisite Install/compile Apache … Continue reading

Posted in cloud computing | Tagged , , , , | Leave a comment

atbr – supports websocket-based sharding

atbr (large-scale and low-latency in-memory key-value pair store) now supports websocket-based sharding for parallel deployments. Websocket Sharding Example Checkout and install atbr [code] $ git clone git@github.com:atbrox/atbr.git $ cd atbr $ sudo ./INSTALL.sh [/code] Start 3 servers loaded with data … Continue reading

Posted in cloud computing | Tagged , , , , , , , | 1 Comment