03 2014 档案

spark note about LassoSuite.scala in mllib
摘要：test regression/lasso in spark-shellimport org.apache.spark.SparkContextimport org.apache.spark.mllib.regression.LassoModelimport org.apache.spark.mllib.regression.LassoWithSGDimport org.apache.spark.mllib.util.LinearDataGenerator...simpleprinciple introduction 阅读全文
posted @ 2014-03-11 06:27 enyun 阅读(299) 评论(0) 推荐(0)
spark 0.9 with hadoop 2.2
摘要：default spark is built with spark 1.xI replace hadoop*1.0.4.jar in lib_managed with hadoop*2.2.0.jar,but all jar files will be updated back into 1.0.4 after sbt assembly.The below command will lead you to the success :SPARK_HADOOP_VERSION=2.2.0 sbt/sbt clean compile package assembly 阅读全文
posted @ 2014-03-09 15:22 enyun 阅读(214) 评论(0) 推荐(0)