Kafka#4:存储设计 分布式设计 源码分析

https://sites.google.com/a/mammatustech.com/mammatusmain/kafka-architecture/4-kafka-detailed-architecture.pdf?attredirects=2&d=1

https://news.ycombinator.com/item?id=7386652

https://www.quora.com/Why-does-Kafka-scale-better-than-other-messaging-systems-like-RabbitMQ

https://stackoverflow.com/questions/48665257/why-kafka-index-files-use-memory-mapped-files-but-log-files-dont

kafka 設計文檔,设计哲学。。。。

https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals

https://cwiki.apache.org/confluence/display/KAFKA/Index

https://cwiki.apache.org/confluence/display/KAFKA/KIP-101+-+Alter+Replication+Protocol+to+use+Leader+Epoch+rather+than+High+Watermark+for+Truncation

https://cwiki.apache.org/confluence/display/KAFKA/Writing+a+Driver+for+Kafka

Exactly Once Delivery and Transactional Messaging

design details

https://docs.google.com/document/d/11Jqy_GjUGtdXJK94XGsEIK7CP1SnQGdp2eF0wSw9ra8/

https://thehoard.blog/how-kafkas-storage-internals-work-3a29b02e026

https://thehoard.blog/building-a-kafka-that-doesnt-depend-on-zookeeper-2c4701b6e961

 

https://cwiki.apache.org/confluence/display/KAFKA/KIP-98+-+Exactly+Once+Delivery+and+Transactional+Messaging

https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka

https://cwiki.apache.org/confluence/display/KAFKA/Idempotent+Producer

 

KAFKA protocol

http://kafka.apache.org/protocol.html

https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToTheKafkaProtocol-ProduceRequest

 

ProduceRecord协议的实现----- important!!!!!!!!!!

http://blog.csdn.net/chunlongyu/article/details/52651960

 

Kafka源码深度解析-序列5 -Producer -RecordAccumulator队列分析

http://blog.csdn.net/chunlongyu/article/details/52704213

 

Kafka源码深度解析-序列15 -Log文件结构与flush刷盘机制

http://blog.csdn.net/chunlongyu/article/details/53784033

 

Kafka源码深度解析-序列14 -Server核心组件之3-SocketServer与NIO- 1+N+M 模型

http://blog.csdn.net/chunlongyu/article/details/53036414

http://blog.csdn.net/aabv54321/article/details/54892641

 

Kafka源码深度解析-序列8 -Consumer -Fetcher实现原理与offset确认机制

http://blog.csdn.net/chunlongyu/article/details/52796639

 

Kafka源码深度解析-序列2 -Producer -Metadata的数据结构与读取、更新策略

http://blog.csdn.net/chunlongyu/article/details/52622422

 

Kafka源码深度解析-序列3 -Producer -Java NIO

http://blog.csdn.net/chunlongyu/article/details/52636762

 

KAFKA源码分析

https://www.jianshu.com/p/aa274f8fe00f

https://www.jianshu.com/p/22d4a733ec5d

 

Kafka#4:存储设计

http://blog.csdn.net/kisimple/article/details/42747197

 

为了加速index文件的读写, 采用了文件内存映射的方式

https://www.jianshu.com/p/e20449a396b1

 

Zero-Copy tech

https://www.ibm.com/developerworks/library/j-zerocopy/index.html

Zero Copy I: User-Mode Perspective

http://www.linuxjournal.com/article/6345

Kafka Zero-Copy 使用分析

https://www.jianshu.com/p/d47de3d6d8ac

 

Kafka#3:分布式设计

http://blog.csdn.net/kisimple/article/details/42747097

 

apache kafka系列之源码分析走读-server端网络架构分析

http://blog.csdn.net/lizhitao/article/details/38442733

 

apache kafka系列之源码分析走读-SocketServer分析

http://blog.csdn.net/lizhitao/article/details/44698323

http://blog.csdn.net/wl044090432/article/details/50987168

 

apache kafka系列之源码分析走读-kafkaApi详解

http://blog.csdn.net/lizhitao/article/details/43987319

http://blog.csdn.net/u014393917/article/details/52042920

 

kafka源码解析之十二KafkaController(上篇)

http://blog.csdn.net/wl044090432/article/details/51118966

 

kafka源码解析之十一KafkaApis

http://blog.csdn.net/wl044090432/article/details/51068413

 

Kafka源码深度解析-序列14 -Server核心组件之3-SocketServer与NIO- 1+N+M 模型

http://blog.csdn.net/chunlongyu/article/details/53036414

 

Kafka源码深度解析-序列4 -Producer -network层核心原理

http://blog.csdn.net/chunlongyu/article/details/52651960

 

Kafka源码深度解析-序列3 -Producer -Java NIO

http://blog.csdn.net/chunlongyu/article/details/52636762

posted on 2018-01-05 18:51  暖风的风  阅读(403)  评论(0编辑  收藏  举报

导航