Monthly Archives: May 2012

A large-scale in-memory storage example – social network data

Posted on May 16, 2012 by Amund Tveit

This posting is a follow-up to the large-scale low-latency (RAM-based) storage related price estimates in my previous posting Main takeaways from Accel’s Big Data Conference. Assume you were to store and index large amounts of social network updates in-memory, e.g. … Continue reading →

Posted in in-memory, information retrieval, infrastructure, RAM | Leave a comment

Main takeaways from Accel’s Big Data Conference

Posted on May 14, 2012 by Amund Tveit

Attended Accel Partners Big Data conference last week. It was a good event with many interesting people, a very crude estimate of distribution: 1/3 VCs/investors, 1/3 startup tech people, 1/3 big corp tech people. My personal 2 key takeaways from … Continue reading →

Posted in cloud computing | Tagged , , , , | 3 Comments

atbr now has Apache Thrift support

Posted on May 2, 2012 by Amund Tveit

atbr (large-scale and low-latency in-memory key-value pair store) now supports Apache Thrift for easier integration with other Hadoop services. Thrift Example Checkout and install atbr Prerequisite Install/compile Apache Thrift – http://thrift.apache.org/ Compile a atbr thrift server and connect using python … Continue reading →

Posted in cloud computing | Tagged , , , , | Leave a comment

atbr – supports websocket-based sharding

Posted on May 1, 2012 by Amund Tveit

atbr (large-scale and low-latency in-memory key-value pair store) now supports websocket-based sharding for parallel deployments. Websocket Sharding Example Checkout and install atbr Start 3 servers loaded with data Start shard server talking to shards Connect to shard server and lookup … Continue reading →

Posted in cloud computing | Tagged , , , , , , , | 1 Comment