老司机的spark maven pom文件
pom文件一:
4.0.0
com.glsx
spark-demo
1.0-SNAPSHOT
jar
spark-demo
http://maven.apache.org
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<jdk.version>1.7</jdk.version>
<scala.version>2.10.5</scala.version>
${artifactId}
maven-compiler-plugin
${jdk.version}
${jdk.version}
maven-surefire-plugin
**/*Tests.java
org.scala-tools
maven-scala-plugin
compile
testCompile
src/main/java
-Xms64m
-Xmx1024m
junit
junit
3.8.1
test
org.scala-lang
scala-library
${scala.version}
org.scala-lang
scala-reflect
${scala.version}
org.scala-lang
scala-compiler
${scala.version}
org.scala-lang
scala-swing
${scala.version}
pom文件二:
4.0.0
com.pl.bdeu.bigdata
fantasia
1.0-SNAPSHOT
2008
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<scala.version>2.10.6</scala.version>
<spark.version>1.6.2</spark.version>
<hadoop.version>2.6.0</hadoop.version>
scala-tools.org
Scala-Tools Maven2 Repository
http://scala-tools.org/repo-releases
scala-tools.org
Scala-Tools Maven2 Repository
http://scala-tools.org/repo-releases
org.scala-lang
scala-library
${scala.version}
junit
junit
3.8.1
test
org.specs
specs
1.2.5
test
org.apache.spark
spark-core_2.10
${spark.version}
org.apache.spark
spark-sql_2.10
${spark.version}
org.apache.spark
spark-hive_2.10
${spark.version}
org.apache.spark
spark-streaming_2.10
${spark.version}
org.apache.spark
spark-mllib_2.10
${spark.version}
org.apache.hadoop
hadoop-client
${hadoop.version}
org.apache.spark
spark-streaming-kafka_2.10
${spark.version}
mysql
mysql-connector-java
5.1.6
org.json
json
20090211
com.fasterxml.jackson.core
jackson-core
2.4.3
com.fasterxml.jackson.core
jackson-databind
2.4.3
com.fasterxml.jackson.core
jackson-annotations
2.4.3
com.alibaba
fastjson
1.1.41
fastutil
fastutil
5.0.9
src/main/scala
src/test/scala
org.scala-tools
maven-scala-plugin
compile
testCompile
${scala.version}
-target:jvm-1.5
org.apache.maven.plugins
maven-eclipse-plugin
true
ch.epfl.lamp.sdt.core.scalabuilder
ch.epfl.lamp.sdt.core.scalanature
org.eclipse.jdt.launching.JRE_CONTAINER
ch.epfl.lamp.sdt.launching.SCALA_CONTAINER
org.scala-tools
maven-scala-plugin
${scala.version}
我喜欢一无所有,这样就只能一步一步的创造世界...