papering - 博客园

2017年11月2日

the algebra of modulo-2 sums disk failure recovery

摘要： x=y x_+_y=0 The bit in any position is the modulo-2 sum of all the bits in the corresponding positions of all other disks. 阅读全文

posted @ 2017-11-02 19:42 papering 阅读(192) 评论(0) 推荐(0)

define tensorflow and run it

摘要： u 阅读全文

posted @ 2017-11-02 17:54 papering 阅读(186) 评论(0) 推荐(0)

data-><-desion

摘要： dd 阅读全文

posted @ 2017-11-02 17:46 papering 阅读(145) 评论(0) 推荐(0)

moving from a host-centric infrastructure to a container-centric infrastructure

摘要： https://kubernetes.io/docs/concepts/overview/what-is-kubernetes/ Why do I need Kubernetes and what can it do? At a minimum, Kubernetes can schedule an 阅读全文

posted @ 2017-11-02 16:37 papering 阅读(491) 评论(0) 推荐(0)

Why containers? Why should we care? 新旧容器的对比

摘要： https://kubernetes.io/docs/concepts/overview/what-is-kubernetes/ The Old Way to deploy applications was to install the applications on a host using th 阅读全文

posted @ 2017-11-02 16:33 papering 阅读(295) 评论(0) 推荐(0)

max(N,k)

摘要： selection problem 阅读全文

posted @ 2017-11-02 15:19 papering 阅读(161) 评论(0) 推荐(0)

Routine Subroutine Coroutine 子程序协程子例程

摘要：真实世界的并发编程 https://jyywiki.cn/OS/2022/slides/7.slides#/2/3 高性能计算程序：特点 “A technology that harnesses the power of supercomputers or computer clusters to 阅读全文

posted @ 2017-11-02 14:53 papering 阅读(595) 评论(0) 推荐(0)

为编译器的实现者提供一个精确的定义：ANSI C

摘要：编译器的实现常用C++编译器推荐_w3cschool https://www.w3cschool.cn/cpp/cpp-zxm72ps8.html 常用C++编译器推荐由 Alma 创建，最后一次修改 2018-05-15 常用C++编译器推荐常用C++编译器推荐由 Alma 创建，最后阅读全文

posted @ 2017-11-02 14:18 papering 阅读(449) 评论(0) 推荐(0)

前端数据上报堆栈信息收集

摘要： onError: function(e) { let msg = e.toString(); // ReferenceError - JavaScript | MDN https://developer.mozilla.org/zh-CN/docs/Web/JavaScript/Reference/ 阅读全文

posted @ 2017-11-02 11:09 papering 阅读(211) 评论(0) 推荐(0)

统计与数学 induction 归纳 deduction 演绎吴喜之老师

摘要： “统计的思维方式是归纳（induction），也就是从数据所反映的现实得到比较一般的模型，希望以此解释数据所代表的那部分世界。这和以演绎（deduction）问哦主的数学思维方式相反，演绎是在一些人为的假定（或者在一个公理系统）之下，推导出各种结论。” 阅读全文

posted @ 2017-11-02 10:29 papering 阅读(495) 评论(0) 推荐(0)

Java Message Service

摘要： en.wikipedia.org/wiki/Java_Message_Service Messaging is a form of loosely coupled distributed communication, where in this context the term 'communica 阅读全文

posted @ 2017-11-02 09:26 papering 阅读(309) 评论(0) 推荐(0)

Message-oriented middleware

摘要： en.wikipedia.org/wiki/Message-oriented_middleware Message-oriented middleware (MOM) is software or hardware infrastructure supporting sending and rece 阅读全文

posted @ 2017-11-02 09:22 papering 阅读(326) 评论(0) 推荐(0)

HDFS HBase Solr Which one? 从访问模式角度决策

摘要： HDFS 压缩性能最优、扫描速度最快；不支持随机访问，仅支持昂贵、复杂的文件查询 HBase适合随机访问 Solr 适合检索需求 HBase访问单个记录的时间为毫秒级别，而HDFS不支持随机访问。 HBase的扫描速度大约是HDFS的1/10-1/8。 HBase 深入浅出 https://www. 阅读全文

posted @ 2017-11-02 09:08 papering 阅读(192) 评论(0) 推荐(0)

graph querying

摘要： querying 阅读全文

posted @ 2017-11-02 00:12 papering 阅读(139) 评论(0) 推荐(0)

2017年11月1日

Java代码优化（长期更新）

摘要： Java代码优化（长期更新）阅读全文

posted @ 2017-11-01 23:53 papering 阅读(145) 评论(0) 推荐(0)

A Short Introduction to Boosting

摘要： http://www.site.uottawa.ca/~stan/csi5387/boost-tut-ppr.pdf Boosting is a general method for improving the accuracy of any given learning algorithm. Th 阅读全文

posted @ 2017-11-01 23:32 papering 阅读(360) 评论(0) 推荐(0)

Boosting AdaBoosting Algorithm

摘要： http://math.mit.edu/~rothvoss/18.304.3PM/Presentations/1-Eric-Boosting304FinalRpdf.pdf Consider MIT Admissions 【qualitative quantitative】 • 2-class sy 阅读全文

posted @ 2017-11-01 21:46 papering 阅读(332) 评论(0) 推荐(0)

Transforming Auto-encoders

摘要： http://www.cs.toronto.edu/~hinton/absps/transauto6.pdf The artificial neural networks that are used to recognize shapes typically use one or more laye 阅读全文

posted @ 2017-11-01 16:58 papering 阅读(448) 评论(0) 推荐(0)

Dynamic Routing Between Capsules

摘要： https://arxiv.org/abs/1710.09829 阅读全文

posted @ 2017-11-01 16:49 papering 阅读(326) 评论(0) 推荐(0)

empirical risk minimization

摘要： Empirical_risk_minimization 阅读全文

posted @ 2017-11-01 16:28 papering 阅读(173) 评论(0) 推荐(0)

Reducing the Dimensionality of Data with Neural Networks

摘要： http://www.cs.toronto.edu/~hinton/science.pdf High-dimensional data can be converted to low-dimensional codes by training a multilayer neural network 阅读全文

posted @ 2017-11-01 16:08 papering 阅读(425) 评论(0) 推荐(0)

Geoffrey E. Hinton

摘要： https://www.cs.toronto.edu/~hinton/ Geoffrey E. Hinton I am an Engineering Fellow at Google where I manage Brain Team Toronto, which is a new part of 阅读全文

posted @ 2017-11-01 15:56 papering 阅读(692) 评论(0) 推荐(0)

Dropout: A Simple Way to Prevent Neural Networks fromOverfitting

摘要： https://www.cs.toronto.edu/~hinton/absps/JMLRdropout.pdf Deep neural nets with a large number of parameters are very powerful machine learning systems 阅读全文

posted @ 2017-11-01 15:25 papering 阅读(649) 评论(0) 推荐(0)

Write Custom Java to Create LZO Files

摘要： https://cwiki.apache.org/confluence/display/Hive/LanguageManual+LZO LanguageManual LZO LanguageManual LZO LanguageManual LZO Skip to end of metadata C 阅读全文

posted @ 2017-11-01 00:03 papering 阅读(422) 评论(0) 推荐(0)

2017年10月31日

Avro schemas are defined with JSON . This facilitates implementation in languages that already have JSON libraries.

摘要： https://avro.apache.org/docs/current/ Introduction Apache Avro™ is a data serialization system. Avro provides: Rich data structures. A compact, fast, 阅读全文

posted @ 2017-10-31 23:45 papering 阅读(210) 评论(0) 推荐(0)

Storage Types and Storage Policies

摘要： https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html Introduction Archival Storage is a solution to decouple gr 阅读全文

posted @ 2017-10-31 23:38 papering 阅读(309) 评论(0) 推荐(0)

splittability A SequenceFile can be split by Hadoop and distributed across map jobs whereas a GZIP file cannot be.

摘要： splittability CompressedStorage CompressedStorage CompressedStorage Skip to end of metadata Created by Confluence Administrator, last modified by Left 阅读全文

posted @ 2017-10-31 23:26 papering 阅读(313) 评论(0) 推荐(0)

This means that only a small number of nodes must be read from disk to retrieve an item.

摘要： http://cis.stvincent.edu/html/tutorials/swd/btree/btree.html Introduction A B-tree is a specialized multiway tree designed especially for use on disk. 阅读全文

posted @ 2017-10-31 21:51 papering 阅读(170) 评论(0) 推荐(0)

Apache Kafka® is a distributed streaming platform. What exactly does that mean?

摘要： https://kafka.apache.org/intro.html 阅读全文

posted @ 2017-10-31 17:03 papering 阅读(164) 评论(0) 推荐(0)

(t,p,o) t:p>=o there cannot be more consumer instances in a consumer group than partitions

摘要： https://kafka.apache.org/intro.html Kafka as a Messaging System How does Kafka's notion of streams compare to a traditional enterprise messaging syste 阅读全文

posted @ 2017-10-31 12:03 papering 阅读(199) 评论(0) 推荐(0)

Goldilocks

摘要： limit 阅读全文

posted @ 2017-10-31 11:22 papering 阅读(152) 评论(0) 推荐(0)

Sqoop

摘要： rmds mapper 阅读全文

posted @ 2017-10-31 11:21 papering 阅读(126) 评论(0) 推荐(0)

Spark SQL includes a cost-based optimizer, columnar storage and code generation to make queries fast.

摘要： https://spark.apache.org/sql/ Performance & Scalability Spark SQL includes a cost-based optimizer, columnar storage and code generation to make querie 阅读全文

posted @ 2017-10-31 00:10 papering 阅读(171) 评论(0) 推荐(0)

2017年10月30日

Sparksql 取代 Hive？

摘要： sparksql hive https://databricks.com/blog/2014/07/01/shark-spark-sql-hive-on-spark-and-the-future-of-sql-on-spark.html https://cwiki.apache.org/conflu 阅读全文

posted @ 2017-10-30 23:43 papering 阅读(690) 评论(0) 推荐(0)

Eliminates these repeated computation in multi aggregations query

摘要： https://github.com/pingcap/tispark/commit/dcca23bfa1aa0c356a4280d82bc8301c0de08318 阅读全文

posted @ 2017-10-30 20:56 papering 阅读(231) 评论(0) 推荐(0)

rule-based optimizer cost-based optimizer

摘要： SQL processing uses the following main components to execute a SQL query: The Parser checks both syntax and semantic analysis. The Optimizer uses cost 阅读全文

posted @ 2017-10-30 20:01 papering 阅读(519) 评论(0) 推荐(0)

Groovy

摘要： https://en.wikipedia.org/wiki/Groovy_(programming_language) Groovy offers simple, consistent syntax for handling lists and maps, reminiscent of Java's 阅读全文

posted @ 2017-10-30 19:54 papering 阅读(218) 评论(0) 推荐(0)

Interface AutoCloseable

摘要： https://docs.oracle.com/javase/tutorial/essential/exceptions/try.html https://docs.oracle.com/javase/8/docs/api/java/lang/AutoCloseable.html An object 阅读全文

posted @ 2017-10-30 17:20 papering 阅读(252) 评论(0) 推荐(0)

throws ? catch checked unchecked

摘要： ThrowableClass Error (unchecked) Exception IOException (checked) RuntimeException (unchecked) 阅读全文

posted @ 2017-10-30 14:58 papering 阅读(186) 评论(0) 推荐(0)

18 ？ 21

摘要： This is for MyHDFSCat = 18+3 阅读全文

posted @ 2017-10-30 10:04 papering 阅读(329) 评论(0) 推荐(0)