sqoop运行时提示内存不足的解决办法

得知mapreduce的运行内存不足,主要为这一段
Diagnostics: Container [pid=13688,containerID=container_e07_1533215502568_0002_02_000001] is running beyond physical memory limits. Current usage: 180.2 MB of 170 MB physical memory used; 1.9 GB of 357.0 MB virtual memory used. Killing container.

在yarn.site 中设置 yarn.scheduler.minimum-allocation-mb 的值为256MB问题解决

yarn.scheduler.minimum-allocation-mb
256

如果提示虚拟内存不足,可以关闭检查,如下设置

yarn.nodemanager.vmem-check-enabled
false
Whether virtual memory limits will be enforced for containers.

posted @ 2020-02-24 16:39  最爱番茄炒蛋  阅读(1494)  评论(0编辑  收藏  举报