Spice OSS
Spice AI
Spice OSS
Spice AI

Spice AI Announces Contribution of TableProviders for PostgreSQL, MySQL, DuckDB, and SQLite to the Apache DataFusion Project

Luke Kim
Founder and CEO

Spice AI has contributed new TableProviders for PostgreSQL, MySQL, DuckDB, and SQLite to the Apache DataFusion project. This addition reflects our commitment to building together in the data and AI ecosystem and supporting the open-source community.

What is Apache DataFusion?

Apache DataFusion is a high-performance query engine built on Apache Arrow. It allows you to execute SQL queries quickly and efficiently on data stored in various formats. By using the in-memory columnar format of Apache Arrow, DataFusion speeds up data processing and works natively with other Arrow-based tools.

About the Spice OSS Project

Spice OSS is an open-source project from Spice AI that provides developers with a unified SQL query interface to locally materialize, accelerate, and query datasets from any database, data warehouse, or data lake. Spice OSS incorporates Apache DataFusion as its SQL query engine.

Our goal with Spice OSS is to make data and AI-driven development more accessible. By contributing to projects like DataFusion and Arrow, we can help making accessing and using data better for everyone building in the space.

New TableProviders for DataFusion

We've initially added TableProviders for PostgreSQL, MySQL, DuckDB, and SQLite to DataFusion. This expands the range of data sources you can query using DataFusion. And we plan to add more in the future.

  • PostgreSQL: A robust and extensible open-source relational database.
  • MySQL: A reliable and user-friendly open-source relational database.
  • DuckDB: An in-process SQL OLAP database for analytical queries.
  • SQLite: A lightweight, disk-based database commonly used in embedded systems.

These new TableProviders make DataFusion even more versatile, allowing you to work with your existing databases and data lakes more easily.

Our Commitment to Data and AI

At Spice AI, we believe in the power of open-source and the potential of data and AI. By contributing to Apache DataFusion, we're helping to advance data processing technology and make powerful tools available to developers everywhere.

To learn more about Spice AI and our open-source projects, check out our GitHub repository. You can also explore Apache DataFusion at datafusion.apache.org.

Stay tuned for more updates from Spice AI as we continue to contribute to the data and AI ecosystem.

Work with Spice AI

Interested in working with Spice AI or looking to learn a little more about the work we do? We are always looking for our next big challenge. Book an introductory call via our Calendly. Take a deeper look at our enterprise offerings by visiting Spice.ai.

Visit Spice.ai
Share

Latest Articles

Spice Cloud Platform

Spice Cloud v1.8.0: Iceberg Write Support, Acceleration Snapshots & More

Announcing Spice Cloud v1.8.0 - now with Iceberg write support, acceleration snapshots, partitioned S3 Vectors indexes, & a new AI SQL function

By
Wyatt Wenzel
-
October 8, 2025
All Articles
Spice AI

Making Object Storage Operational for Real-Time and AI Workloads

Object storage and open table formats like Apache Iceberg and Delta Lake have become foundational to modern data architectures for their scalability and cost efficiency. However, they’re not built for real-time, AI-driven workloads that demand low latency and sophisticated querying. Spice extends these technologies by federating and accelerating data, enabling hybrid search and inference, and transforming object storage into a high-performance data layer for operational applications and AI agents.

By
Wyatt Wenzel
-
October 6, 2025
All Articles
Spice Cloud Platform
Spice AI

Spice Cloud v1.7.0: DataFusion v49, Full-Text Search Updates & More

Spice Cloud v1.7.0 includes DataFusion v49, EmbeddingGamma support, and real-time indexing for full-text search

By
Wyatt Wenzel
-
September 24, 2025
All Articles