Announcing the release of Spice v1.0.5 🧊
Spice v1.0.5 expands Iceberg support with the introduction of the Iceberg Data Connector, in addition to the existing Iceberg Catalog Connector. This new connector enables direct dataset creation and configuration for specific Iceberg objects, enabling federated and accelerated SQL queries on Apache Iceberg tables.
Performance improvements include object-store optimized Parquet pruning in append mode, where object-store metadata is now leveraged alongside Hive partitioning to optimize file pruning. This results in faster and more efficient queries.
DuckDB has been upgraded to v1.2.0, along with additional stability improvements, including improved graceful shutdown and the ability to configure the DuckDB memory limit.
Additional updates include support for the Arrow Map type.
New Iceberg Data Connector: Enables direct dataset creation and querying of Iceberg tables.
Example usage in spicepod.yaml:
For detailed setup instructions, authentication options, and configuration parameters, refer to the Iceberg Data Connector documentation.
Improved Parquet pruning in append mode: Uses object-store metadata for more efficient file pruning.
DuckDB upgrade to v1.2.0 with improved graceful shutdown: Read the DuckDB v1.2.0 announcement for details, including breaking changes for map and list_reduce. Graceful shutdown of DuckDB has been improved for better stability across restarts.
Configurable DuckDB memory limit: Use the duckdb_memory_limit parameter to set the DuckDB acceleration memory limit:
To upgrade to v1.0.5, use one of the following methods:
CLI:
Homebrew:
Docker:
Pull the spiceai/spiceai:1.0.5 image:
For available tags, see DockerHub.
Helm:
Full Changelog: https://github.com/spiceai/spiceai/compare/v1.0.4...v1.0.5