摘要:
试试在DBOutputFormat 的Reducer 阶段有几十万的记录要插入,就会报错内存溢出。可以尝试 在mapred-site.xml 里面修改 mapred.child.java.opts -Xmx512m Java opts for the task tracker child processes. The following symbol, if present, will be interpolated: @taskid@ is replaced by current TaskID. Any other occurrences of '@' will go un.
阅读全文