LZH-YS1998
6c8d3f3dc9
- get_context_window() now reads litellm.get_model_info().max_input_tokens instead of get_max_tokens(), which returns the output cap and severely under-reported the window for every mapped model (e.g. deepseek 8k vs 1M) - models litellm cannot map fall back to 128000 with a single warning per model instead of warning on every call and returning None - raise LLMConfig.max_tokens default 8192 -> 32768 to match the template - README: configure the API key directly in llm_config.yaml; document max_tokens / context_window in the example Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
24 lines
886 B
YAML
24 lines
886 B
YAML
# LLM config template: no API keys committed. Set api_key or api_key_env after opc init.
|
|
llm:
|
|
default_model: "openai/gpt-5.4"
|
|
api_base: "https://openrouter.ai/api/v1"
|
|
api_key: ""
|
|
# api_key_env: "OPENROUTER_API_KEY"
|
|
|
|
temperature: 1
|
|
max_tokens: 32768
|
|
routing: {}
|
|
fallback: {}
|
|
|
|
# Optional: total input context window, used as the denominator for the
|
|
# context-usage ring and to trigger auto-summarization. Auto-detected via
|
|
# litellm for most OpenAI / Anthropic models; models litellm cannot map
|
|
# (e.g. deepseek/doubao/glm or proxy / self-hosted endpoints) fall back to
|
|
# 128000. Set this only when the fallback is wrong for your model.
|
|
# Scalar applies to the default model:
|
|
# context_window: 200000
|
|
# Or per-model (wins over the scalar); keys are matched by model name:
|
|
# context_window_overrides:
|
|
# gpt-5.4: 400000
|
|
# claude-sonnet-4.5: 200000
|