Variable: vllm

const vllm: (config) => AdapterFactory

Defined in: adapters/src/vllm.ts:9

vLLM's OpenAI-compatible serving endpoint. Defaults to http://localhost:8000/v1 — the standard vllm serve ... port.

#Parameters

#config

OpenAICompatibleConfig

#Returns

AdapterFactory