Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Providers

The providers subsystem connects Veyyon to model APIs and normalizes their auth, request, and response formats.

Responsibility

  • Maintain the catalog of supported model providers and their capabilities.
  • Resolve a model slug to a provider and its ModelInfo.
  • Authenticate requests with API keys, access tokens, or OAuth credentials.
  • Translate between the provider-specific wire format and the engine’s protocol types.

Implementation

The provider stack lives in the @veyyon/ai package.

ComponentRole
Provider adaptersPer-provider connection and wire-format adapters
API client registryOpenAI-compatible API client registry
Provider detailsProvider metadata, auth mode, and endpoints
Model catalogModel catalog and per-model capabilities
Model registrySlug resolution to provider + model info

Key concepts

  • Provider metadata — a provider’s auth mode and endpoint configuration.
  • Model info — per-model capabilities such as context window and vision support.
  • Auth material — resolved from API keys, access tokens, or OAuth credentials.

See Models and providers and Provider stack and bring-your-own-key for how to add your own keys and choose models.