higress 接入外部模型做AI网关

#安装higress省略

1、添加模型服务商

 2、添加消费者令牌

 3、添加AI模型路由接口

 

4、请求验证

curl -sv http:// <higress-gateway-ip>/v1/chat/completions \
-X POST \
-H 'Content-Type: application/json' \
-H "Authorization: Bearer xxxxxx" \
-H 'Host: token.sensenova.cn' \
-d \
'{
"model": "sensenova-6.7-flash-lite",
"messages": [
{
"role": "user",
"content": "Hello!"
}
]
}'