spark 0.9 with hadoop 2.2

default spark is built with spark 1.x

I replace hadoop*1.0.4.jar in lib_managed with hadoop*2.2.0.jar,

but all jar files will be updated back into 1.0.4 after sbt assembly.

The below command will lead you to the success :

SPARK_HADOOP_VERSION=2.2.0 sbt/sbt clean compile package assembly

posted @ 2014-03-09 15:22  enyun  阅读(212)  评论(0)    收藏  举报