Providers
llamacpp
llama.cpp server — run GGUF models on CPU or GPU with minimal overhead.
import { llamacpp } from '@agentskit/adapters'
const adapter = llamacpp({
url: 'http://localhost:8080',
})#Options
| Option | Type | Default |
|---|---|---|
url | string | http://localhost:8080 |
fetch | typeof fetch | global |
#Why llamacpp
- Runs everywhere, including Raspberry Pi + embedded.
- GGUF quantizations from 4-bit to 16-bit.
#Related
Explore nearby
- PeerProviders
25 native chat and embedder adapters, plus higher-order adapters that compose candidates. Separate from the 140-provider models catalog.
- PeerChoosing an adapter
Capability decision table and rules of thumb for picking a chat adapter.
- PeerHosted chat adapters
17 managed-LLM adapters. Same contract; swap by changing one import.