fxjwind

Consistent Hashing算法及相关技术

摘要： Distributed Algorithms in NoSQL Databases, http://highlyscalable.wordpress.com/2012/09/18/distributed-algorithms-in-nosql-databases/ NOSQL Patterns, http://horicky.blogspot.com/2009/11/nosql-patterns... 阅读全文

posted @ 2013-04-13 15:24 fxjwind 阅读(795) 评论(0) 推荐(0)

Vector Clocks, 时间向量

摘要： Why Vector Clock are Easy or Hard? Amazon's Dynamo, 4.4版本化的数据常用的版本化技术 Timestamps seem to be an obvious solution for developing a chronological order. However, timestamps “rely on synchronized c... 阅读全文

posted @ 2013-04-13 11:39 fxjwind 阅读(1195) 评论(0) 推荐(0)

全序, 分布式一致性的本质

摘要： A brief history of Consensus_ 2PC and Transaction Commit (译) 对于一致性问题很好的综述 Time Clocks and the Ordering of Events in a Distributed System(译) --Leslie Lamport 偏序和全序 Lamport的“Time, Clocks and th... 阅读全文

posted @ 2013-04-13 11:24 fxjwind 阅读(3458) 评论(2) 推荐(1)

Paxos Made Simple

摘要： The Part-Time Parliament，Lamport，1998，ACM Transactions on Computer Systems. 晦涩的原文 http://research.microsoft.com/en-us/um/people/lamport/pubs/lamport-paxos.pdf Paxos Made Simple http://www.cs.utexas... 阅读全文

posted @ 2013-04-11 15:45 fxjwind 阅读(1164) 评论(0) 推荐(0)

Strong Consistency, 强一致性技术概述

摘要： http://horicky.blogspot.com/2009/11/nosql-patterns.html A brief history of Consensus_ 2PC and Transaction Commit (译) 对于一致性问题很好的综述 2 Phase Commit(译) Master Slave (or Single Master)Model Under t... 阅读全文

posted @ 2013-04-03 17:36 fxjwind 阅读(1769) 评论(0) 推荐(0)

Anti-Entropy Protocols

摘要： http://highlyscalable.wordpress.com/2012/09/18/distributed-algorithms-in-nosql-databases/, Distributed Algorithms in NoSQL Databases http://www.cnblogs.com/chen77716/archive/2011/03/24/2130798.html... 阅读全文

posted @ 2013-04-02 15:59 fxjwind 阅读(3765) 评论(0) 推荐(0)

Spark - A Fault-Tolerant Abstraction for In-Memory Cluster Computing

摘要： http://spark-project.org/ 项目首页 http://shark.cs.berkeley.edu/ shark项目主页 Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing 为什么需要Spark? 当前已经有比较多的compu... 阅读全文

posted @ 2013-03-30 14:46 fxjwind 阅读(2120) 评论(1) 推荐(0)

Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center

摘要： http://incubator.apache.org/mesos/research.html, Mesos Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center 为什么需要Mesos? 现在有越来越多的compute framework, 并且每个framework都有自己的适用场景和优缺点... 阅读全文

posted @ 2013-03-27 16:55 fxjwind 阅读(1034) 评论(0) 推荐(0)

Columnar Storage

摘要： http://the-paper-trail.org/blog/columnar-storage/ You’re going to hear a lot about columnar storage formats in the next few months, as a variety of distributed execution engines are beginning to c... 阅读全文

posted @ 2013-03-26 17:31 fxjwind 阅读(1161) 评论(0) 推荐(0)

Linkedin Kafka Design

摘要： http://kafka.apache.org/07/design.html中文版的设计文档, http://www.oschina.net/translate/kafka-designOverviewUse cases for activity stream and operational data"动态汇总（News feed）"功能。将你朋友的各种活动信息广播给你相关性以及排序。通过使用计数评级（count rating）、投票（votes）或者点击率（ click-through）判定一组给定的条目中那一项是最相关的.安全：网站需要屏蔽行为不端的网络爬虫（crawl 阅读全文

posted @ 2013-03-22 14:45 fxjwind 阅读(1602) 评论(0) 推荐(0)