摘要: paxos paxos use in mesos http://mesos.apache.org/documentation/latest/replicated-log-internals/ zab use in zookeeper, zab v.s. paxos https://cwiki.apa阅读全文
posted @ 2016-12-18 19:09 yanghuahui 阅读(90) 评论(0) 编辑
摘要: # best way to see log file less +F /var/log/syslog (equals: less /var/log/syslog, then shift+f) # see dmesg when it changes watch -n 0.1 "dmesg | tail -n 30" # use xargs with find find . -type x...阅读全文
posted @ 2016-09-30 12:19 yanghuahui 阅读(52) 评论(0) 编辑
摘要: 此defer非golang中的defer https://tour.golang.org/flowcontrol/12 这个代码是不会抛出exception的,twitter中defer主要用途是并发启动一些命令,不会相互block。 refer to: https://github.com/twi阅读全文
posted @ 2016-08-30 14:30 yanghuahui 阅读(67) 评论(0) 编辑
摘要: generate a patch and apply a patch, refer to https://ariejan.net/2009/10/26/how-to-create-and-apply-a-patch-with-git/阅读全文
posted @ 2016-06-13 18:13 yanghuahui 阅读(129) 评论(0) 编辑
摘要: import java.util.concurrent.Callable; /** * Created by huahui.yang on 1/29/16. */ public class RetryWrapper<A> { public A retry(Callable<A> callable) 阅读全文
posted @ 2016-01-29 12:47 yanghuahui 阅读(199) 评论(0) 编辑
摘要: #!/usr/bin/python# 8th November, 2009# update manager failed, giving me the error:# 'files list file for package 'xxx' is missing final newline'...阅读全文
posted @ 2015-12-31 15:24 yanghuahui 阅读(259) 评论(0) 编辑
摘要: 在YARN上开发长服务,需要注意fault-tolerance,本篇文章对appmaster的平滑重启的一个参数做了解析,如何设置可以有助于达到appmaster平滑重启。在yarn-site.xml有个参数/** * The maximum number of application atte...阅读全文
posted @ 2015-10-26 15:07 yanghuahui 阅读(1598) 评论(0) 编辑
摘要: 这边记录ubuntu安装过程,首先是官网文档If you haven’t already done so, log into your Ubuntu instance.Open a terminal window.Add the newgpgkey.$ apt-key adv --keyserver...阅读全文
posted @ 2015-10-13 16:09 yanghuahui 阅读(5504) 评论(0) 编辑
摘要: http://www.swiss-scalability.com/2014/12/install-hdp-22-on-ubuntu-1404-trusty.html在新加节点上运行sed -e "s/14.04/12.04/g" -i /etc/*-release阅读全文
posted @ 2015-10-08 17:25 yanghuahui 阅读(92) 评论(0) 编辑
摘要: 问题:自己写了一个yarn上的application,发现nodemanager过段时间,会out of memory退出,把nodemanager的heap memory从1G增大到2G也是无法避免NM程序OOM开启NM的jmx监控-Dcom.sun.management.jmxremote -D...阅读全文
posted @ 2015-08-25 13:20 yanghuahui 阅读(183) 评论(0) 编辑