摘要: 激活函数总结 1 统一数学表达 Hadamard product或element-wise product 多见\(\odot\)或\(\circ\)。在GLU论文中:\(\otimes\) is the element-wise product between matrices. ⭐由于在数学上\ 阅读全文