Notes on Concepts, Tools and Frameworks

[Concepts]

Consistent Hashing: instead of MOD, hash() to certain point within 0-2^31. Range based

[Logistics\Glue]

Zookeeper: locking\service finder\leader election\node maintenance\coordination (Paxos etc.)

Google Chubby: locking service

[Messaging]

Kafka: Pub\Sub queue-based messaging, persistent, distributed. Using ZooKeeper a lot. 
　　　  Used for notification service, stream processing etc.

[Caching]

Memcached: distributed, just cache.

Redis: both caching and persistent storage. More versatile

[NoSQL DB]

MongoDB\CouchDB: Document based, like BSON format based

BigTable\HBase: Column based

Cassandra\DynamoDB: Key-Value store