An AgentLlmProxyRequest is a type used exclusively in the llm.proxies array to specify the requirement of an LLM proxy.
In Docker and Executable runtimes, a resolved LLM proxy request will set
environment variables, prefixed with CORAL_PROXY_$NAME. For example, the request:
Could produce the following environment variables:
The server will not launch agents that it cannot resolve proxies for!
name
required
The name of the proxy request.
Requirements
- The name must be between 1 and 32 characters long.
- The name must contain only uppercase alphanumeric characters and underscores.
- The name must be unique.
required
The LLM request format. Current supported types are:
models
required
A list of models that this request will accept. Only one of the listed models will be used.
Requirements
- The name of a model must be between 1 and 128 characters long.
- There must be 32 or fewer models listed.