hive on tez遇到tez起不来的问题

问题log：

hive> insert overwrite local directory '/test' select * from user;
Tez session was closed. Reopening...

一直hang在Tez session was closed. Reopening...

解决方法：

查看hive的log，里面有很多datanode不能替换的错：java.io.IOException: Failed to replace a bad datanode on the existing pipeline due to no more good datanodes being available to try.

还有一些访问权限错误：org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied

之后发现上面这些都不是真正的原因，yarn的资源不够是root cause.

删掉了一些yarn的application中一直hang住的job：

yarn application -kill application_1497579216916_0113

重新运行就没问题了。