打赏
摘要: 不多说,直接上干货! 一切来源于官网 3.1 Broker Configs The essential configurations are the following: broker.id log.dirs zookeeper.connect broker.id log.dirs zookeepe 阅读全文
posted @ 2017-04-26 14:56 大数据和AI躺过的坑 阅读(1144) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 3. CONFIGURATION 3.1 Broker Configs 3.2 Producer Configs 3.3 Consumer Configs 3.3.1 New Consumer Configs 3.3.2 Old Consumer Configs 阅读全文
posted @ 2017-04-26 14:51 大数据和AI躺过的坑 阅读(190) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 2.5 Legacy APIs A more limited legacy producer and consumer api is also included in Kafka. These old Scala APIs are deprecated and 阅读全文
posted @ 2017-04-26 14:34 大数据和AI躺过的坑 阅读(206) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 2.4 Connect API The Connect API allows implementing connectors that continually pull from some source data system into Kafka or pus 阅读全文
posted @ 2017-04-26 14:32 大数据和AI躺过的坑 阅读(253) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 2.3 Streams API The Streams API allows transforming streams of data from input topics to output topics. Examples showing how to use 阅读全文
posted @ 2017-04-26 14:30 大数据和AI躺过的坑 阅读(311) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 2.2 Consumer API The Consumer API allows applications to read streams of data from topics in the Kafka cluster. Examples showing ho 阅读全文
posted @ 2017-04-26 11:27 大数据和AI躺过的坑 阅读(268) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 2.1 Producer API The Producer API allows applications to send streams of data to topics in the Kafka cluster. Examples showing how 阅读全文
posted @ 2017-04-26 11:06 大数据和AI躺过的坑 阅读(295) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 2. APIS Kafka includes four core apis: The Producer API allows applications to send streams of data to topics in the Kafka cluster. 阅读全文
posted @ 2017-04-26 11:03 大数据和AI躺过的坑 阅读(376) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 1.5 Upgrading From Previous Versions Upgrading from 0.8.x, 0.9.x, 0.10.0.x or 0.10.1.x to 0.10.2.0 从0.8.x, 0.9.x 或 0.10.0.X 升级到 0.1 阅读全文
posted @ 2017-04-26 10:58 大数据和AI躺过的坑 阅读(831) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 1.4 Ecosystem There are a plethora of tools that integrate with Kafka outside the main distribution. The ecosystem page lists many 阅读全文
posted @ 2017-04-26 10:49 大数据和AI躺过的坑 阅读(302) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Step 8: Use Kafka Streams to process data Kafka Streams is a client library of Kafka for real-time stream processing and analyzing 阅读全文
posted @ 2017-04-26 10:47 大数据和AI躺过的坑 阅读(395) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Step 7: Use Kafka Connect to import/export data Writing data from the console and writing it back to the console is a convenient pl 阅读全文
posted @ 2017-04-26 10:39 大数据和AI躺过的坑 阅读(682) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Step 6: Setting up a multi-broker cluster So far we have been running against a single broker, but that's no fun. For Kafka, a sing 阅读全文
posted @ 2017-04-26 10:29 大数据和AI躺过的坑 阅读(372) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Step 5: Start a consumer Kafka also has a command line consumer that will dump out messages to standard output. If you have each of 阅读全文
posted @ 2017-04-26 10:18 大数据和AI躺过的坑 阅读(208) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Step 4: Send some messages Kafka comes with a command line client that will take input from a file or from standard input and send 阅读全文
posted @ 2017-04-26 10:16 大数据和AI躺过的坑 阅读(226) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Step 3: Create a topic Let's create a topic named "test" with a single partition and only one replica: We can now see that topic if 阅读全文
posted @ 2017-04-26 09:01 大数据和AI躺过的坑 阅读(343) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Step 2: Start the server Kafka uses ZooKeeper so you need to first start a ZooKeeper server if you don't already have one. You can 阅读全文
posted @ 2017-04-26 08:52 大数据和AI躺过的坑 阅读(274) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 不要局限于,这个版本,我只是以最新的版本,来做个引子,让大家对官网的各个kafka版本懂得如何独立去看。 over 阅读全文
posted @ 2017-04-26 08:48 大数据和AI躺过的坑 阅读(234) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Commit Log Kafka can serve as a kind of external commit-log for a distributed system. The log helps replicate data between nodes an 阅读全文
posted @ 2017-04-26 08:47 大数据和AI躺过的坑 阅读(218) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Event Sourcing Event sourcing is a style of application design where state changes are logged as a time-ordered sequence of records 阅读全文
posted @ 2017-04-26 08:46 大数据和AI躺过的坑 阅读(197) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Stream Processing Many users of Kafka process data in processing pipelines consisting of multiple stages, where raw input data is c 阅读全文
posted @ 2017-04-26 08:45 大数据和AI躺过的坑 阅读(238) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Log Aggregation Many people use Kafka as a replacement for a log aggregation solution. Log aggregation typically collects physical 阅读全文
posted @ 2017-04-26 08:44 大数据和AI躺过的坑 阅读(324) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Metrics Kafka is often used for operational monitoring data. This involves aggregating statistics from distributed applications to 阅读全文
posted @ 2017-04-26 08:43 大数据和AI躺过的坑 阅读(215) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Website Activity Tracking The original use case for Kafka was to be able to rebuild a user activity tracking pipeline as a set of r 阅读全文
posted @ 2017-04-26 08:41 大数据和AI躺过的坑 阅读(317) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Messaging Kafka works well as a replacement for a more traditional message broker. Message brokers are used for a variety of reason 阅读全文
posted @ 2017-04-26 08:40 大数据和AI躺过的坑 阅读(247) 评论(0) 推荐(0)
摘要: 不多说,直接上干货! 一切来源于官网 Putting the Pieces Together This combination of messaging, storage, and stream processing may seem unusual but it is essential to K 阅读全文
posted @ 2017-04-26 08:35 大数据和AI躺过的坑 阅读(251) 评论(0) 推荐(0)