title: 'Models Grade Report'
description: 'Spice AI graded Large-Language-Model (LLM) evaluation report'
sidebar_label: 'Models Grade Report'
sidebar_position: 4
hide_table_of_contents: true
This document presents the evaluation report for various Large-Language-Models (LLMs) graded by Spice AI. The models are assessed based on their basic capabilities, quality of tool calls, and accuracy of output when integrated with Spice.
For more details on how model grades are evaluated in Spice, refer to the model grading criteria (opens in a new tab).
| Model | Spice Grade | Model Provider | Context Window<br/ >Max Output Tokens | Chat Completion | Response Format(Structued Outputs) | Tools | RecursiveTool Calling | Reasoning | Streaming | Model Release Date | Spice Version |
|---|
o3-mini-2025-01-31 (Reasoning effort: high) | A | openai | 200k tokens<br/ >100k tokens | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 2025-01-31 | v1.0.2 |
o3-mini-2025-01-31 (Reasoning effort: medium) | B | openai | 200k tokens<br/ >100k tokens | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 2025-01-31 | v1.0.2 |
o3-mini-2025-01-31 (Reasoning effort: low) | C | openai | 200k tokens<br/ >100k tokens | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 2025-01-31 | v1.0.2 |
o1-2024-12-17 (Reasoning effort: high) | C | openai | 200k tokens<br/ >100k tokens | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | 2024-12-17 | v1.0.2 |
o1-2024-12-17 (Reasoning effort: medium) | C | openai | 200k tokens<br/ >100k tokens | ✅ | ✅ |