Manage LLM providers and models, sync pricing from external registries, run health checks, and configure per-organization API keys for independent billing.
Entity Enricher supports a wide range of LLM providers. Each provider can have multiple models with individual pricing, capabilities, and configuration.
Each model tracks its capabilities, which are displayed as icons in the model selector:
| Capability | Description |
|---|---|
| Vision | Can process image and visual inputs |
| Tool Calls | Supports function calling / tool use |
| Audio Input | Can process audio inputs |
| PDF Input | Can process PDF documents |
| Prompt Caching | Supports prompt caching for cost reduction |
| Reasoning | Extended thinking / chain-of-thought capabilities |
Keep model pricing up to date by syncing from external registries. The sync process detects new models, price changes, and removed models automatically.
The default pricing source. Fetches from LiteLLM's community-maintained registry on GitHub with real API model names, pricing, context lengths, and capabilities.
Covers ~30 providers. Does not include display names, benchmarks, or generation speed.
An alternative source from pricepertoken.com. Includes display names, benchmarks (coding and math scores), and generation speed (tokens per second).
Covers ~20 providers. Provides richer metadata than LiteLLM.
Proactively validate whether models are reachable by running a minimal health check prompt. This catches broken models before users encounter errors during enrichment.
Health checks can be run on all models, a specific provider's models, or a single model. Results stream in real time via SSE with a progress bar showing pass/fail counts.
When an enrichment call fails with a “model not found” error, the model is automatically deactivated to prevent repeated failures. This happens in real time during normal enrichment operations.
| Deactivation Reason | Set By | Auto-Reactivated? |
|---|---|---|
| Model Not Found | Enrichment errors or health checks | Yes (by pricing sync or validation) |
| Sync Removed | Pricing sync (model disappeared) | Yes (if model reappears in registry) |
| Manual | Admin toggle in UI | No (manual reactivation only) |
Organizations can configure their own LLM provider API keys for independent billing and usage tracking. The system uses a two-tier key resolution with LRU selection:
Per-organization keys configured in the API Keys page. Supports multiple keys per provider with LRU rotation. Encrypted with Fernet.
System-wide keys managed by administrators. Shared across all organizations. Also supports multiple keys per provider with LRU rotation.
Each enrichment records which key was used, so you can track costs per key. Keys include health check support, usage counters, and are automatically disabled on permanent failures (invalid key, payment required). Rate-limited keys are temporarily backed off while other keys in the pool are used. Learn how to manage keys in the API Keys guide.
Export your entire provider and model configuration as JSON for backup or transfer to another instance. Import configurations in merge mode (add new, skip existing) or replace mode (overwrite everything).
The export includes provider settings, model configurations, pricing, and capabilities — but excludes API keys for security. After importing, you will need to configure API keys separately.