calculate_gain

torch.nn.init.calculate_gain(nonlinearity,param=None)

对于给定的非线性函数，返回推荐的增益值。这些值如下所示：

 

 

 

relu_gain=nn.init.calculate_gain("relu")
print("relu_gain",relu_gain)
'''
relu_gain 1.4142135623730951