Fork me on GitHub 0

RuntimeError:Expected to have finished reduction in the prior iteration

 

 解决办法:

添加find_unused_parameters=true

model=torch.nn.parallel.DistributedDataParallel(model,find_unused_parameters=true)

 

posted @ 2020-07-18 20:17  amazingcode  阅读(6422)  评论(0编辑  收藏  举报