litellm 使用介绍

作用： 为claude code 做代理，支持其他模型

• litellm_config.yaml

model_list:
  - model_name: kimik2.5
    litellm_params:
      model: anthropic/aisearch_s3_dsv3_1basexxx
      api_key: os.environ/OPENROUTER_API_KEY
      api_base: https://aichat.xxx.com/api/anthropic
      custom_llm_provider: "anthropic"
      extra_headers:
        x-api-key: os.environ/OPENROUTER_API_KEY

  - model_name: m123b
    litellm_params:
      model: openai/aisearch_devstral_123bxxx
      api_key: os.environ/OPENROUTER_API_KEY
      api_base: https://antchat.xxx.com/v1
      custom_llm_provider: "openai"
      extra_headers:
        x-api-key: os.environ/OPENROUTER_API_KEY

litellm_settings:
  modify_params: true
  drop_params: true

• 开启代理

OPENROUTER_API_KEY=<账号> litellm --config litellm_config.yaml --port 8000  2>&1 | tee debug.log

• 使用claude

ANTHROPIC_BASE_URL=http://0.0.0.0:8000 ANTHROPIC_MODEL=kimik2.5 ANTHROPIC_DEFAULT_HAIKU_MODEL=kimik2.5 claude