Add versioned docs for v2.1 (#1903)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
3 months ago
Add versioned docs for v2.1 (#1903)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
3 months ago
Add versioned docs for v2.1 (#1903)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
3 months ago
Add versioned docs for v2.1 (#1903)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
3 months ago
docs(models): paged attention is requested automatically, not unconditionally enabled
The local-model paged-attention note collapsed three branches into one
absolute sentence. `MistralLlama::paged_attention_config` returns
`None` when the device is CPU or when the build is not
`all(feature = "cuda", target_family = "unix")`, and the engine
downgrades to dense attention again for architectures with no paged
kernel (the Multi-head Latent Attention GGUFs) — so a CUDA+Unix build
is necessary, not sufficient.
From v2.2.0 (spiceai/spiceai#11990) the note is also wrong to say no
configuration is needed: `FileModelParams::paged_attention` accepts
`auto` (default) or `disabled`, and `disabled` forces dense
attention. It is a `from: file:` parameter only —
`HuggingFaceModelParams` has no such field and `from_hf` calls
`paged_attention_config` unconditionally.
Scoped accordingly: the branch distinction lands in v2.0.x-v2.3.x and
vNext; the escape hatch only in v2.2.x, v2.3.x and vNext.
a month ago
Add versioned docs for v2.1 (#1903)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
3 months ago
Add versioned docs for v2.1 (#1903)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
3 months ago
docs(tools): the sampling tools are not in the `auto` group since v2.0
`SpiceToolsOptions::Auto` stopped including `sample_distinct_columns`,
`random_sample`, and `top_n_sample` in v2.0.0 — they are only provided by
`all`, `search_registry`, and `nsql`, or by naming them individually.
Also adds the two `auto` tools the table never listed (`get_readiness`,
`get_current_datetime`) and the `nsql` / `disabled` tool-group values.
2 months ago