Gateway
Adaline Gateway is a single SDK to interact with 300+ LLMs. It runs entirely locally — no proxy, no data leaves your environment.Installation
Quick Start
Key Features
- Unified interface — One API for OpenAI, Anthropic, Google, Azure, Bedrock, Groq, Together AI, Open Router, Vertex, XAI, and custom providers
- Fully local — No proxy server, no data leaves your environment
- Streaming — First-class async generator support for streaming responses
- Embeddings — Generate embeddings across providers with a single interface
- Tool calls — Execute tool calls returned by LLMs
- Plugins — Pluggable cache, HTTP client, logger, and queue backends
- Batching & retries — Built-in configurable queues with automatic retry and exponential backoff
- OpenTelemetry — Native telemetry integration
- Isomorphic — Works in Node.js and browsers (with
dangerouslyAllowBrowser)
Packages
| Package | Description |
|---|---|
@adaline/gateway | Core gateway SDK |
@adaline/types | Shared types for config, messages, tools, etc. |
@adaline/openai | OpenAI provider |
@adaline/anthropic | Anthropic provider |
@adaline/google | Google provider |
@adaline/azure | Azure OpenAI provider |
@adaline/bedrock | AWS Bedrock provider |
@adaline/groq | Groq provider |
@adaline/togetherai | Together AI provider |
@adaline/open-router | Open Router provider |
@adaline/vertex | Google Vertex provider |
@adaline/xai | xAI provider |
API Reference
Gateway Class
Core class for chat completions, streaming, embeddings, and tool calls.
Types
Config, messages, tools, and response types.
Examples
Practical examples for common use cases.