aioptions

Create options for AI provider requests.

📝Syntax

options = aioptions()
options = aioptions(name, value, ...)

📄Description

aioptions creates a scalar struct used by aiask.

The default provider is ollama, the default model is llama3, and the default endpoint is http://127.0.0.1:11434/api/generate.

Supported options are Provider, Model, Endpoint, TokenEnvVar, Timeout, SystemPrompt, Think, NumPredict, and Temperature.

For Ollama, Think, NumPredict, and Temperature are sent in the request payload. Use them to keep local model responses bounded.

💡Examples

Create Ollama options for a local model.

opts = aioptions('Provider', 'ollama', ...
                 'Model', 'llama3.2', ...
                 'Endpoint', 'http://127.0.0.1:11434/api/generate', ...
                 'Timeout', 180, ...
                 'Think', false, ...
                 'NumPredict', 200, ...
                 'Temperature', 0);

🔗See Also

aiask aimodels

🕔Version History

Version	Description
2.0.0	initial version

Edit this page on GitHub