大数据 - 随笔分类 - 企图穿越

摘要：1. install hadoop 2. install hbase 3.build hadoop cd $HADOOP_HOME mvn clean package -Pdist -DskipTests -f ./cloudera-pom.xml 4. build hbase cd $HBASE_HOME mvn clean package -Pdist -DskipTests -f ./pom... 阅读全文

posted @ 2013-07-17 23:02 企图穿越阅读(5340) 评论(0) 推荐(0)

[Hadoop] 实际应用场景之 - 百度 - Zhu_Julian's Notes (朱显杰的技术博客） - 博客频道 - CSDN.NET

摘要：[Hadoop] 实际应用场景之 - 百度 - Zhu_Julian's Notes (朱显杰的技术博客） - 博客频道 - CSDN.NET: "" (Via.) 阅读全文

posted @ 2013-06-23 17:21 企图穿越阅读(168) 评论(0) 推荐(0)

hue

摘要：refer: http://archive.cloudera.com/cdh/3/hue/manual.html http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/4.2.0/CDH4-Installation-Guide/cdh4ig_topic_15_4.html http://blog.csdn.net/... 阅读全文

posted @ 2013-06-20 19:58 企图穿越阅读(163) 评论(0) 推荐(0)

Flume-NG + HDFS + HIVE 日志收集分析 | EyeLu技术Blog

摘要：Flume-NG + HDFS + HIVE 日志收集分析 | EyeLu技术Blog: ""(Via.) 阅读全文

posted @ 2013-05-31 10:44 企图穿越阅读(462) 评论(0) 推荐(0)

分布式计算solutions

摘要：参考链接：http://www.infoq.com/cn/presentations/facebook-HBase-solutionshttp://www.infoq.com/cn/presentations/facebook-massive-data-schema-evolution?utm_source=infoq&utm_medium=related_content_link&utm_campaign=relatedContent_presentations_clkhttp://www.infoq.com/cn/news/2013/02/Phoenix-HBase-SQL 阅读全文

posted @ 2013-05-03 18:41 企图穿越阅读(136) 评论(0) 推荐(0)

关于HADOOP_HEAPSIZE参数(转)

摘要：原文链接： http://www.oratea.net/?p=821HADOOP_HEAPSIZE参数是控制hadoop的jvm内存大小的。这个参数的设置要结合当前服务器的内存情况。今天测试环境的hadoop出现问题，一些与jvm相关的操作都会报内存不够的错误，如下：[hadoop@jdk1.6.0_20]$jps ErroroccurredduringinitializationofVM Couldnotreserveenoughspaceforobjectheap CouldnotcreatetheJavavirtualmachine.查看发现当前的HADOOP_HEAPSIZE大小为50 阅读全文

posted @ 2013-04-23 21:48 企图穿越阅读(2485) 评论(0) 推荐(0)

配置hadoop压缩 : hadoop build lzo

摘要：1.下载lzowget 'https://github.com/cloudera/hadoop-lzo/tarball/0.4.14' -O hadoop-lzo-0.4.14.tar.gz --no-check-certificate2.编译lzotar zxf hadoop-lzo-0.4.14.tar.gzcd ./cloudera-hadoop-lzo-8aa0605/JAVA_HOME=${JAVA_HOME} C_INCLUDE_PATH=${HADOOP_HOME}/lzo-2.06/include LIBRARY_PATH=${HADOOP_HOME}/lzo- 阅读全文

posted @ 2013-04-23 21:22 企图穿越阅读(428) 评论(0) 推荐(0)

log4j:ERROR Could not connect to remote log4j server at [localhost]. We will try again later.

摘要：fix:1.namenode用chukwa的log4j.properties配置文件。2.datanode用自带配置文件。3.namenode节点本地需要启动chukwa agent start,保证本地可以连接log4j server。阅读全文

posted @ 2013-04-23 21:20 企图穿越阅读(2370) 评论(0) 推荐(0)

CDH3U3 FAILED: Error in metadata: javax.jdo.JDOFatalInternalException: Unexpected exception caught.

摘要：fix:参考url :http://stackoverflow.com/questions/6853445/hive-doesnt-work-on-install 阅读全文

posted @ 2013-04-23 21:19 企图穿越阅读(283) 评论(0) 推荐(0)

chukwa 丢失日志

摘要：fix:原因是改设备器类型之后日志文件名发生变化。阅读全文

posted @ 2013-04-23 20:37 企图穿越阅读(82) 评论(0) 推荐(0)

scribe 2.1 + hadoop-0.20.2-cdh3u3 + thrift-0.2.0 bug

摘要：[root@xxxxxxxx-xxxxx scribe]# echo "test message 3" | examples/scribe_cat -h localhost:1463 test [Fri Apr 20 14:52:09 2012] "[test] Creating new category from model default" [Fri Apr 20 14:52:09 2012] "store thread starting" [Fri Apr 20 14:52:09 2012] "[hdfs] Conne 阅读全文

posted @ 2013-04-23 20:36 企图穿越阅读(316) 评论(0) 推荐(0)

企图穿越

随笔分类 - 大数据

公告