Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data apps and agents.

Spice provides four industry standard APIs in a lightweight, portable runtime (single binary/container):

1. SQL Query & Search: HTTP, Arrow Flight, Arrow Flight SQL, ODBC, JDBC, and ADBC APIs; vector_search and text_search UDTFs.
2. OpenAI-Compatible APIs: HTTP APIs for OpenAI SDK compatibility, local model serving (CUDA/Metal accelerated), and hosted model gateway.
3. Iceberg Catalog REST APIs: A unified Iceberg REST Catalog API.
4. MCP HTTP+SSE APIs: Integration with external tools via Model Context Protocol (MCP) using HTTP and Server-Sent Events (SSE).

🎯 Goal: Developers can focus on building data apps and AI agents confidently, knowing they are grounded in data.

Spice's primary features include:

• Data Federation: SQL query across any database, data warehouse, or data lake. Scale from single-node to distributed multi-node query execution. Learn More.
• Data Materialization and Acceleration: Materialize, accelerate, and cache database queries with Arrow, DuckDB, SQLite, PostgreSQL, or Spice Cayenne (Vortex). Read the MaterializedView interview - Building a CDN for Databases
• Enterprise Search: Keyword, vector, and full-text search with Tantivy-powered BM25 and petabyte-scale vector similarity search via Amazon S3 Vectors or pgvector for structured and unstructured data.
• AI apps and agents: An AI-database powering retrieval-augmented generation (RAG) and intelligent agents with OpenAI-compatible APIs and MCP integration. Learn More.

If you want to build with DataFusion, DuckDB, or Vortex, Spice provides a simple, flexible, and production-ready engine you can just use.

📣 Read the Spice.ai 1.0-stable announcement.

Spice is built-on industry leading technologies including Apache DataFusion, Apache Arrow, Arrow Flight, SQLite, and DuckDB.

🎥 Watch the CMU Databases Accelerating Data and AI with Spice.ai Open-Source

🎥 Watch How to Query Data using Spice, OpenAI, and MCP

🎥 Watch How to search with Amazon S3 Vectors

Why Spice?

Spice simplifies building data-driven AI applications and agents by making it fast and easy to query, federate, and accelerate data from one or more sources using SQL, while grounding AI in real-time, reliable data. Co-locate datasets with apps and AI models to power AI feedback loops, enable RAG and search, and deliver fast, low-latency data-query and AI-inference with full control over cost and performance.

Latest Capabilities

• Spice Cayenne Data Accelerator: Simplified multi-file acceleration using the Vortex columnar format + SQLite metadata. Delivers DuckDB-comparable performance without single-file scaling limitations.
• Multi-Node Distributed Query: Scale query execution across multiple nodes with Apache Ballista integration for improved performance on large datasets.
• Acceleration Snapshots: Bootstrap accelerations from S3 for fast cold starts (seconds vs. minutes). Supports ephemeral storage with persistent recovery.
• Iceberg Table Writes: Write to Iceberg tables using standard SQL INSERT INTO for data ingestion and transformation—no Spark required.
• Petabyte-Scale Vector Search: Native Amazon S3 Vectors integration manages the full vector lifecycle from ingestion to embedding to querying. SQL-integrated hybrid search with RRF.

How is Spice different?

1. AI-Native Runtime: Spice combines data query and AI inference in a single engine, for data-grounded AI and accurate AI.

2. Application-Focused: Designed to run distributed at the application and agent level, often as a 1:1 or 1:N mapping between app and Spice instance, unlike traditional data systems built for many apps on one centralized database. It’s common to spin up multiple Spice instances—even one per tenant or customer.

3. Dual-Engine Acceleration: Supports both OLAP (Arrow/DuckDB) and OLTP (SQLite/PostgreSQL) engines at the dataset level, providing flexible performance across analytical and transactional workloads.

4. Disaggregated Storage: Separation of compute from disaggregated storage, co-locating local, materialized working sets of data with applications, dashboards, or ML pipelines while accessing source data in its original storage.

5. Edge to Cloud Native: Deploy as a standalone instance, Kubernetes sidecar, microservice, or cluster—across edge/POP, on-prem, and public clouds. Chain multiple Spice instances for tier-optimized, distributed deployments.

How does Spice compare?

Data Query and Analytics

Feature	Spice	Trino / Presto	Dremio	ClickHouse	Materialize
Primary Use-Case	Data & AI apps/agents	Big data analytics	Interactive analytics	Real-time analytics	Real-time analytics
Primary deployment model	Sidecar	Cluster	Cluster	Cluster	Cluster
Federated Query Support	✅	✅	✅	―	―
Acceleration/Materialization	✅ (Arrow, SQLite, DuckDB, PostgreSQL)	Intermediate storage	Reflections (Iceberg)	Materialized views	✅ (Real-time views)
Catalog Support	✅ (Iceberg, Unity Catalog, AWS Glue)	✅	✅	―	―
Query Result Caching	✅	✅	✅	✅	Limited
Multi-Modal Acceleration	✅ (OLAP + OLTP)	―	―	―	―
Change Data Capture (CDC)	✅ (Debezium)	―	―	―	✅ (Debezium)

AI Apps and Agents

Feature	Spice	LangChain	LlamaIndex	AgentOps.ai	Ollama
Primary Use-Case	Data & AI apps	Agentic workflows	RAG apps	Agent operations	LLM apps
Programming Language	Any language (HTTP interface)	JavaScript, Python	Python	Python	Any language (HTTP interface)
Unified Data + AI Runtime	✅	―	―	―	―
Federated Data Query	✅	―	―	―	―
Accelerated Data Access	✅	―	―	―	―
Tools/Functions	✅ (MCP HTTP+SSE)	✅	✅	Limited	Limited
LLM Memory	✅	✅	―	✅	―
Hybrid Search	✅ (Keyword, Vector, & Full-Text-Search)	✅	✅	Limited	Limited
Caching	✅ (Query and results caching)	Limited	―	―	―
Embeddings	✅ (Built-in & pluggable models/DBs)	✅	✅	Limited	―

✅ = Fully supported ❌ = Not supported Limited = Partial or restricted support

Example Use-Cases

Data-grounded Agentic AI Applications

• OpenAI-compatible API: Connect to hosted models (OpenAI, Anthropic, xAI, Amazon Bedrock) or deploy locally (Llama, NVIDIA NIM) with OpenAI Responses API support for advanced interactions. AI Gateway Recipe
• Federated Data Access: Query using SQL and NSQL (text-to-SQL) across databases, data warehouses, and data lakes with advanced query push-down for fast retrieval. Scale to distributed multi-node query execution with Apache Ballista. Federated SQL Query Recipe
• Search and RAG: Search and retrieve context with accelerated embeddings for retrieval-augmented generation (RAG) workflows. Native Amazon S3 Vectors integration for petabyte-scale vector search. Full-text search (FTS) via Tantivy-powered BM25 and vector similarity search (VSS) integrated into SQL via text_search and vector_search UDTFs. Reciprocal rank fusion (RRF) for hybrid search. Amazon S3 Vectors Cookbook Recipe
• LLM Memory and Observability: Store and retrieve history and context for AI agents while gaining deep visibility into data flows, model performance, and traces. LLM Memory Recipe | Observability & Monitoring Features Documentation

Database CDN and Query Mesh

• Data Acceleration: Co-locate materialized datasets in Arrow, SQLite, DuckDB, PostgreSQL, or Cayenne (Vortex+SQLite) with applications for sub-second query. Bootstrap from snapshots stored in S3 for fast cold starts. Write to Iceberg tables with standard SQL INSERT INTO. DuckDB Data Accelerator Recipe
• Resiliency and Local Dataset Replication: Maintain application availability with local replicas of critical datasets. Recover from federated source outages using acceleration snapshots. Local Dataset Replication Recipe
• Responsive Dashboards: Enable fast, real-time analytics by accelerating data for frontends and BI tools with configurable refresh schedules. Sales BI Dashboard Demo
• Simplified Legacy Migration: Use a single endpoint to unify legacy systems with modern infrastructure, including federated SQL querying across multiple sources. Federated SQL Query Recipe

Retrieval-Augmented Generation (RAG)

• Unified Search with Vector Similarity: Perform efficient vector similarity search across structured and unstructured data sources with native Amazon S3 Vectors integration for petabyte-scale vector storage and querying. The Spice runtime manages the vector lifecycle: ingesting data, embedding it using AWS Bedrock (Amazon Titan, Cohere), HuggingFace models, or Model2Vec (500x faster static embeddings), and storing in S3 Vector buckets or pgvector. Supports cosine similarity, Euclidean distance, or dot product. SQL-integrated search via vector_search and text_search UDTFs with hybrid search using reciprocal rank fusion (RRF). Example: SELECT * FROM vector_search(my_table, 'search query', 10) WHERE condition ORDER BY _score;. Amazon S3 Vectors Cookbook Recipe
• Semantic Knowledge Layer: Define a semantic context model to enrich data for AI. Semantic Model Feature Documentation
• Text-to-SQL: Convert natural language queries into SQL using built-in NSQL and sampling tools for accurate query. Text-to-SQL Recipe

FAQ

• Is Spice a cache? No specifically; you can think of Spice data acceleration as an active cache, materialization, or data prefetcher. A cache would fetch data on a cache-miss while Spice prefetches and materializes filtered data on an interval, trigger, or as data changes using CDC. In addition to acceleration Spice supports results caching.

• Is Spice a CDN for databases? Yes, a common use-case for Spice is as a CDN for different data sources. Using CDN concepts, Spice enables you to ship (load) a working set of your database (or data lake, or data warehouse) where it's most frequently accessed, like from a data-intensive application or for AI context.

➡️ Docs FAQ

Watch a 30-sec BI dashboard acceleration demo

https://github.com/spiceai/spiceai/assets/80174/7735ee94-3f4a-4983-a98e-fe766e79e03a

See more demos on YouTube.

Supported Data Connectors

Name	Description	Status	Protocol/Format
databricks (mode: delta_lake)	Databricks	Stable	S3/Delta Lake
delta_lake	Delta Lake	Stable	Delta Lake
dremio	Dremio	Stable	Arrow Flight
duckdb	DuckDB	Stable	Embedded
file	File	Stable	Parquet, CSV
github	GitHub	Stable	GitHub API
postgres	PostgreSQL	Stable
s3	S3	Stable	Parquet, CSV
mysql	MySQL	Stable
spice.ai	Spice.ai	Stable	Arrow Flight
graphql	GraphQL	Release Candidate	JSON
dynamodb	Amazon DynamoDB	Release Candidate
databricks (mode: spark_connect)	Databricks	Beta	Spark Connect
flightsql	FlightSQL	Beta	Arrow Flight SQL
iceberg	Apache Iceberg	Beta	Parquet
mssql	Microsoft SQL Server	Beta	Tabular Data Stream (TDS)
odbc	ODBC	Beta	ODBC
snowflake	Snowflake	Beta	Arrow
spark	Spark	Beta	Spark Connect
oracle	Oracle	Alpha	Oracle ODPI-C
abfs	Azure BlobFS	Alpha	Parquet, CSV
clickhouse	Clickhouse	Alpha
debezium	Debezium CDC	Alpha	Kafka + JSON
gcs, gs	Google Cloud Storage	Alpha	Parquet, CSV, JSON
kafka	Kafka	Alpha	Kafka + JSON
ftp, sftp	FTP/SFTP	Alpha	Parquet, CSV
glue	AWS Glue	Alpha	Iceberg, Parquet, CSV
http, https	HTTP(s)	Alpha	Parquet, CSV, JSON
imap	IMAP	Alpha	IMAP Emails
localpod	Local dataset replication	Alpha
mongodb	MongoDB	Alpha
sharepoint	Microsoft SharePoint	Alpha	Unstructured UTF-8 documents
scylladb	ScyllaDB	Alpha
smb	SMB (Server Message Block)	Alpha	SMB
elasticsearch	ElasticSearch	Roadmap

Supported Data Accelerators

Name	Description	Status	Engine Modes
cayenne	Spice Cayenne (Vortex)	Release Candidate	file
arrow	In-Memory Arrow Records	Stable	memory
duckdb	Embedded DuckDB	Stable	memory, file
postgres	Attached PostgreSQL	Release Candidate	N/A
sqlite	Embedded SQLite	Release Candidate	memory, file

Supported Model Providers

Name	Description	Status	ML Format(s)	LLM Format(s)
openai	OpenAI (or compatible) LLM endpoint	Release Candidate	-	OpenAI-compatible HTTP endpoint
file	Local filesystem	Release Candidate	ONNX	GGUF, GGML, SafeTensor
huggingface	Models hosted on HuggingFace	Release Candidate	ONNX	GGUF, GGML, SafeTensor
spice.ai	Models hosted on the Spice.ai Cloud Platform		ONNX	OpenAI-compatible HTTP endpoint
azure	Azure OpenAI		-	OpenAI-compatible HTTP endpoint
bedrock	Amazon Bedrock (Nova models)	Alpha	-	OpenAI-compatible HTTP endpoint
anthropic	Models hosted on Anthropic	Alpha	-	OpenAI-compatible HTTP endpoint
xai	Models hosted on xAI	Alpha	-	OpenAI-compatible HTTP endpoint

Supported Embeddings Providers

Name	Description	Status	ML Format(s)	LLM Format(s)*
openai	OpenAI (or compatible) LLM endpoint	Release Candidate	-	OpenAI-compatible HTTP endpoint
file	Local filesystem	Release Candidate	ONNX	GGUF, GGML, SafeTensor
huggingface	Models hosted on HuggingFace	Release Candidate	ONNX	GGUF, GGML, SafeTensor
model2vec	Static embeddings (500x faster)	Release Candidate	Model2Vec	-
azure	Azure OpenAI	Alpha	-	OpenAI-compatible HTTP endpoint
bedrock	AWS Bedrock (e.g., Titan, Cohere)	Alpha	-	OpenAI-compatible HTTP endpoint

Supported Vector Stores

Name	Description	Status
s3_vectors	Amazon S3 Vectors for petabyte-scale vector storage and querying	Alpha
pgvector	PostgreSQL with pgvector extension	Alpha
duckdb_vector	DuckDB with vector extension for efficient vector storage and search	Alpha
sqlite_vec	SQLite with sqlite-vec extension for lightweight vector operations	Alpha

Supported Catalogs

Catalog Connectors connect to external catalog providers and make their tables available for federated SQL query in Spice. Configuring accelerations for tables in external catalogs is not supported. The schema hierarchy of the external catalog is preserved in Spice.

Name	Description	Status	Protocol/Format
spice.ai	Spice.ai Cloud Platform	Stable	Arrow Flight
unity_catalog	Unity Catalog	Stable	Delta Lake
databricks	Databricks	Beta	Spark Connect, S3/Delta Lake
iceberg	Apache Iceberg	Beta	Parquet
glue	AWS Glue	Alpha	CSV, Parquet, Iceberg

⚡️ Quickstart (Local Machine)

https://github.com/spiceai/spiceai/assets/88671039/85cf9a69-46e7-412e-8b68-22617dcbd4e0

Installation

Install the Spice CLI:

On macOS, Linux, and WSL:

Or using brew:

On Windows using PowerShell:

Usage

Step 1. Initialize a new Spice app with the spice init command:

A spicepod.yaml file is created in the spice_qs directory. Change to that directory:

Step 2. Start the Spice runtime:

Example output will be shown as follows:

The runtime is now started and ready for queries.

Step 3. In a new terminal window, add the spiceai/quickstart Spicepod. A Spicepod is a package of configuration defining datasets and ML models.

The spicepod.yaml file will be updated with the spiceai/quickstart dependency.

The spiceai/quickstart Spicepod will add a taxi_trips data table to the runtime which is now available to query by SQL.

Step 4. Start the Spice SQL REPL:

The SQL REPL inferface will be shown:

Enter show tables; to display the available tables for query:

Enter a query to display the longest taxi trips:

Output:

⚙️ Runtime Container Deployment

Using the Docker image locally:

In a Dockerfile:

Using Helm:

🏎️ Next Steps

Explore the Spice.ai Cookbook

The Spice.ai Cookbook is a collection of recipes and examples for using Spice. Find it at https://github.com/spiceai/cookbook.

Using Spice.ai Cloud Platform

Access ready-to-use Spicepods and datasets hosted on the Spice.ai Cloud Platform using the Spice runtime. A list of public Spicepods is available on Spicerack: https://spicerack.org/.

To use public datasets, create a free account on Spice.ai:

1. Visit spice.ai and click Try for Free.

2. After creating an account, create an app to generate an API key.

Once set up, you can access ready-to-use Spicepods including datasets. For this demonstration, use the taxi_trips dataset from the Spice.ai Quickstart.

Step 1. Initialize a new project.

Step 2. Log in and authenticate from the command line using the spice login command. A pop up browser window will prompt you to authenticate:

Step 3. Start the runtime:

Step 4. Configure the dataset:

In a new terminal window, configure a new dataset using the spice dataset configure command:

Enter a dataset name that will be used to reference the dataset in queries. This name does not need to match the name in the dataset source.

Enter the description of the dataset:

Enter the location of the dataset:

Select y when prompted whether to accelerate the data:

You should see the following output from your runtime terminal:

Step 5. In a new terminal window, use the Spice SQL REPL to query the dataset

The output displays the results of the query along with the query execution time:

You can experiment with the time it takes to generate queries when using non-accelerated datasets. You can change the acceleration setting from true to false in the datasets.yaml file.

📄 Documentation

Comprehensive documentation is available at spiceai.org/docs.

Over 45 quickstarts and samples available in the Spice Cookbook.

🔌 Extensibility

Spice.ai is designed to be extensible with extension points documented at EXTENSIBILITY.md. Build custom Data Connectors, Data Accelerators, Catalog Connectors, Secret Stores, Models, or Embeddings.

🔨 Upcoming Features

🚀 See the Roadmap for upcoming features.

🤝 Connect with us

We greatly appreciate and value your support! You can help Spice in a number of ways:

• Build an app with Spice.ai and send us feedback and suggestions at hey@spice.ai or on Discord, X, or LinkedIn.
• File an issue if you see something not quite working correctly.
• Join our team (We’re hiring!)
• Contribute code or documentation to the project (see CONTRIBUTING.md).
• Follow our blog at spiceai.org/blog

⭐️ star this repo! Thank you for your support! 🙏