logstash retrying failed action with response code: 429

使用logstash进行同步的时候报如下错误:

09:08:22.284 [[main]>worker4] INFO  logstash.outputs.elasticsearch - retrying failed action with response code: 429 ({"type"=>"es_rejected_execution_exception", "reason"=>"rejected execution of org.elasticsearch.transport.TransportService$7@6d1e3b7a on EsThreadPoolExecutor[bulk, queue capacity = 200, org.elasticsearch.common.util.concurrent.EsThreadPoolExecutor@3cd6876e[Running, pool size = 8, active threads = 8, queued tasks = 200, completed tasks = 651632]]"})

 

判断应该是es的写入性能不行,修改es的配置添加如下配置,然后重启es生效

 

thread_pool.bulk.queue_size: 10000 # 写入队列大小
indices.memory.index_buffer_size: 30%

posted @ 2023-03-06 15:59  kuroniko  阅读(269)  评论(0编辑  收藏  举报