Config
Configuration types for controlling model behavior.Config
TheConfig function creates a Zod schema for parsing model configuration. All fields are optional and provider-specific.
Common Fields
Controls randomness.
0 is deterministic, higher values are more creative. Range: 0 to 2.Maximum number of tokens to generate.
Nucleus sampling threshold. Range:
0 to 1.Penalize tokens based on frequency. Range:
-2 to 2.Penalize tokens based on presence. Range:
-2 to 2.Stop sequences that halt generation.
Random seed for deterministic outputs (provider support varies).
Embedding Config
For embedding models, the config supports:The encoding format for embeddings. Common values:
"float", "base64".The number of dimensions for the output embeddings.