2017年10月31日
Avro schemas are defined with JSON . This facilitates implementation in languages that already have JSON libraries.
摘要： https://avro.apache.org/docs/current/ Introduction Apache Avro™ is a data serialization system. Avro provides: Rich data structures. A compact, fast, 阅读全文
posted @ 2017-10-31 23:45 papering 阅读(206) 评论(0) 推荐(0)
Storage Types and Storage Policies
摘要： https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html Introduction Archival Storage is a solution to decouple gr 阅读全文
posted @ 2017-10-31 23:38 papering 阅读(305) 评论(0) 推荐(0)
splittability A SequenceFile can be split by Hadoop and distributed across map jobs whereas a GZIP file cannot be.
摘要： splittability CompressedStorage CompressedStorage CompressedStorage Skip to end of metadata Created by Confluence Administrator, last modified by Left 阅读全文
posted @ 2017-10-31 23:26 papering 阅读(309) 评论(0) 推荐(0)
This means that only a small number of nodes must be read from disk to retrieve an item.
摘要： http://cis.stvincent.edu/html/tutorials/swd/btree/btree.html Introduction A B-tree is a specialized multiway tree designed especially for use on disk. 阅读全文
posted @ 2017-10-31 21:51 papering 阅读(165) 评论(0) 推荐(0)
Apache Kafka® is a distributed streaming platform. What exactly does that mean?
摘要： https://kafka.apache.org/intro.html 阅读全文
posted @ 2017-10-31 17:03 papering 阅读(159) 评论(0) 推荐(0)
(t,p,o) t:p>=o there cannot be more consumer instances in a consumer group than partitions
摘要： https://kafka.apache.org/intro.html Kafka as a Messaging System How does Kafka's notion of streams compare to a traditional enterprise messaging syste 阅读全文
posted @ 2017-10-31 12:03 papering 阅读(198) 评论(0) 推荐(0)
Goldilocks
摘要： limit 阅读全文
posted @ 2017-10-31 11:22 papering 阅读(151) 评论(0) 推荐(0)
Sqoop
摘要： rmds mapper 阅读全文
posted @ 2017-10-31 11:21 papering 阅读(123) 评论(0) 推荐(0)
Spark SQL includes a cost-based optimizer, columnar storage and code generation to make queries fast.
摘要： https://spark.apache.org/sql/ Performance & Scalability Spark SQL includes a cost-based optimizer, columnar storage and code generation to make querie 阅读全文
posted @ 2017-10-31 00:10 papering 阅读(168) 评论(0) 推荐(0)