每日博客——使用Maven对Java独立应用程序进行编译打包
使用Maven对Java独立应用程序进行编译打包
1. 安装Maven
网盘下载 apache-maven-3.9.2-bin.zip
链接为:https://pan.baidu.com/s/181shkgg-i0WEytQMqeeqxA(提取码:9ekc )
sudo unzip /export/server/apache-maven-3.9.2-bin.zip -d /export/server/ cd /export/server/ sudo mv apache-maven-3.9.2/ ./maven sudo chown -R hadoop ./maven
2. Java应用程序代码
cd /export/server
mkdir -p sparkapp2/src/main/java
在 ./sparkapp2/src/main/java 下建立一个名为 SimpleApp.java 的文件(vim ./sparkapp2/src/main/java/SimpleApp.java),添加代码如下:
import org.apache.spark.api.java.*; import org.apache.spark.api.java.function.Function; import org.apache.spark.SparkConf; public class SimpleApp { public static void main(String[] args) { String logFile = "file:///export/server/spark/README.md"; // Should be some file on your system SparkConf conf=new SparkConf().setMaster("local").setAppName("SimpleApp"); JavaSparkContext sc=new JavaSparkContext(conf); JavaRDD<String> logData = sc.textFile(logFile).cache(); long numAs = logData.filter(new Function<String, Boolean>() { public Boolean call(String s) { return s.contains("a"); } }).count(); long numBs = logData.filter(new Function<String, Boolean>() { public Boolean call(String s) { return s.contains("b"); } }).count(); System.out.println("Lines with a: " + numAs + ", lines with b: " + numBs); } }
该程序依赖Spark Java API,因此我们需要通过Maven进行编译打包。在./sparkapp2目录中新建文件pom.xml,命令如下:
cd /export/server/sparkapp2
vim pom.xml
在pom.xml中添加相关依赖
<project>
<groupId>cn.edu.xmu</groupId>
<artifactId>simple-project</artifactId>
<modelVersion>4.0.0</modelVersion>
<name>Simple Project</name>
<packaging>jar</packaging>
<version>1.0</version>
<repositories>
<repository>
<id>jboss</id>
<name>JBoss Repository</name>
<url>http://repository.jboss.com/maven2/</url>
</repository>
</repositories>
<dependencies>
<dependency> <!-- Spark dependency -->
<groupId>org.apache.spark</groupId>
<artifactId>spark-core_2.12</artifactId>
<version>3.4.0</version>
</dependency>
</dependencies>
</project>
3.使用Maven打Java程序
cd ~/sparkapp2
/export/server/maven/bin/mvn package
如出现下信息,说明生成Jar包成功:

参考博客:https://dblab.xmu.edu.cn/blog/4322/

浙公网安备 33010602011771号