title: 'Machine Learning Models' sidebar_label: 'Machine Learning Models' sidebar_position: 8 pagination_prev: null pagination_next: null tags:

• models

Removed in v2.2: Support for loading and serving traditional machine learning (ONNX) models for inference was removed in v2.2, along with the /v1/predict and /v1/models/{name}/predict prediction endpoints. See the v2.1 docs (opens in a new tab) for documentation of this feature.

Spice no longer loads or serves traditional machine learning (ONNX) models. The Models (opens in a new tab) component now serves large language models (LLMs) only.

For LLM configuration and usage, see Large Language Models (opens in a new tab).