Hadoop集群中运行MapReduce程序错误记录

1. Exception in thread "main" java.lang.SecurityException: Invalid signature file digest for Manifest main attributes
1. 　　先将上传的jar包文件所有者修改为当前用户

   sudo chown tianliuyang:tianliuyang MapReduceDemo.jar 

    

2. 将jar包中的META-INF/*.RSA META-INF/*.DSA META-INF/*.SF 删除

   sudo zip -d MapResuceDemo.jar META-INF/*.RSA META-INF/*.DSA META-INF/*.SF

    

3. 再次执行WC程序即可

   hadoop jar MapResuceDemo.jar  /user/tly/input /user/tly/output

2. Note: System times on machines may be out of sync. Check system time and time zones.
   1. 　　是由于集群中的服务器时间不一致造成的,需要配置集群同步时间ntp,详情请见hadoop集群中配置ntp时间同步服务器