hive不能向sequencefile格式的表插入数据

1.问题示例：

hive (test)> create table t_sequencefile(c1 string,c2 int,c3 string,c4 string)
              > row format delimited fields terminated by '\t' stored as sequencefile;
OK

hive (test)> insert overwrite table t_sequencefile select * from t_textfile;
Query ID = grid_20211027002607_77b73c0b-f3b9-45e5-b9b0-bf4652df1d2b
Total jobs = 3
Launching Job 1 out of 3
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapreduce.job.reduces=<number>
Starting Job = job_1635258384646_0001, Tracking URL = http://master:8088/proxy/application_1635258384646_0001/
Kill Command = /home/grid/Hadoop/hadoop-3.3.1/bin/mapred job -kill job_1635258384646_0001
Hadoop job information for Stage-1: number of mappers: 0; number of reducers: 0
2021-10-27 00:29:24,598 Stage-1 map = 0%, reduce = 0%
Ended Job = job_1635258384646_0001 with errors
Error during job, obtaining debugging information...
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 msec

hive (test)> select * from t_sequencefile;

OK
Time taken: 0.878 seconds

 

2.解决方案：

（1）方案一：直接在hive进行参数设置，参数为：hive.exec.mode.local.auto

示例：hive (test)> set hive.exec.mode.local.auto=true;

 

（2）方案二：向Hive配置文件hive-site.xml加入下列参数，可一劳永逸解决问题。

　　<property>
　　<name>hive.exec.mode.local.auto</name>
　　<value>true</value>
　　<description>Let Hive determine whether to run in local mode automatically</description>
　　</property>

 

3.问题原因分析：

直接错误：

　　“Error during job, obtaining debugging information...
　　FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask”

直接原因：

　　失败原因 经查发现发现/tmp/hadoop/.log提示java.lang.OutOfMemoryError: Java heap space，

　　原因是namenode内存空间不够，jvm不够新job启动导致（笔者采用虚拟机虚拟的节点，设置的有效可支持内存不足）。

可参考：

可参考1： https://blog.csdn.net/young_0609/article/details/109239322

可参考2：https://www.it610.com/article/1297838385011957760.htm