Add vLLM models authentication diagnostics
This commit is contained in:
@@ -263,14 +263,15 @@ host; unlike the backend base endpoint, its path and query are allowed. Null
|
||||
means fallback, while an explicit blank value is invalid.
|
||||
|
||||
Omitted/null `authentication` leaves the provider's diagnostic default in
|
||||
effect; `openrouter` defaults to `openrouter_key` and the generic provider has
|
||||
no default. A non-null object's optional `kind` is trimmed and case-normalized; accepted
|
||||
effect; `openrouter` defaults to `openrouter_key`, `vllm` defaults to
|
||||
`vllm_models`, and the generic provider has no default. A non-null object's
|
||||
optional `kind` is trimmed and case-normalized; accepted
|
||||
values are `none`, `openrouter_key`, and `vllm_models`. Its omitted/null endpoint
|
||||
uses the adapter's backend-relative destination (`openrouter_key` appends
|
||||
`/key` to the effective backend base); an explicit endpoint follows the same
|
||||
full-URL rules as reachability. `none` declares authentication inapplicable.
|
||||
Without a selected adapter, or for `vllm_models`, authentication diagnostics
|
||||
currently report an unsupported selection. An endpoint-only authentication
|
||||
Without a selected adapter, authentication diagnostics report an unsupported
|
||||
selection. An endpoint-only authentication
|
||||
block overrides the destination of a provider default; `kind: none` suppresses
|
||||
that default.
|
||||
These values are configuration only: engine construction does not contact a
|
||||
|
||||
@@ -73,6 +73,15 @@ not validation of the full account document. Other statuses and unrecognized
|
||||
recognition allowance reports `authentication_response_limit_exceeded`, leaving
|
||||
credential acceptance unknown; see the [public reason](../../smoke_diagnostics.go).
|
||||
|
||||
The `vllm_models` adapter issues one `GET` to `/models` relative to the
|
||||
configured base unless an explicit diagnostic endpoint is supplied. It sends
|
||||
an available credential but does not require one. A 200 response is recognized
|
||||
when it is a JSON object with `object: "list"` and an array-valued `data`;
|
||||
empty arrays are accepted. A 401 means rejection; other responses do not
|
||||
establish acceptance. Recognition uses the same bounded response handling as
|
||||
the key probe. Acceptance does not establish that authentication is enforced or
|
||||
that inference is authorized.
|
||||
|
||||
Diagnostic HTTP evidence describes the last request observed at Promptkit's
|
||||
RoundTripper boundary and any response associated with it. It includes the
|
||||
selected destination without URL user information, response status, and
|
||||
|
||||
@@ -202,6 +202,8 @@ Validation: smoke selection/authentication tests and existing OpenRouter contrac
|
||||
|
||||
## Stage 6 — vLLM Models Authentication Adapter
|
||||
|
||||
**Completed.**
|
||||
|
||||
- Implement `vllm_models` beside the OpenRouter adapter, sharing generic HTTP
|
||||
execution and bounded recognition helpers rather than duplicating transport.
|
||||
Select it by default for `vllm` and allow explicit use on other providers.
|
||||
|
||||
Reference in New Issue
Block a user