RuntimeError:Expected to have finished reduction in the prior iteration

 

 解决办法：

添加find_unused_parameters=true

model=torch.nn.parallel.DistributedDataParallel(model,find_unused_parameters=true)