zz ALiBi（Attention with Linear Biases）位置编码详解：LLM无需额外训练就能处理超长文本

https://zhuanlan.zhihu.com/p/656684326

alibi

 

https://developer.aliyun.com/article/1694249

AI大模型位置编码详解

 

https://awesomeml.com/attention-with-linear-biases/

ALiBi（Attention with Linear Biases）位置编码详解：LLM无需额外训练就能处理超长文本