spark 0.9 with hadoop 2.2
default spark is built with spark 1.x
I replace hadoop*1.0.4.jar in lib_managed with hadoop*2.2.0.jar,
but all jar files will be updated back into 1.0.4 after sbt assembly.
The below command will lead you to the success :
SPARK_HADOOP_VERSION=2.2.0 sbt/sbt clean compile package assembly
浙公网安备 33010602011771号