Spice Catalog Connectors

Catalog connectors expose external data catalogs for federated SQL queries, preserving the source schema hierarchy.

Basic Configuration

catalogs:
  - from: <connector>
    name: <catalog_name>
    params:
      # connector-specific parameters
    include:
      - 'schema.*'     # optional: filter tables

Supported Catalogs

Connector	From Format	Description
unity_catalog	unity_catalog	Databricks Unity Catalog
databricks	databricks	Databricks with Spark Connect
iceberg	iceberg	Apache Iceberg catalogs
spice.ai	spice.ai	Spice.ai Cloud Platform
glue	glue	AWS Glue Data Catalog

Examples

Unity Catalog

catalogs:
  - from: unity_catalog
    name: unity
    params:
      unity_catalog_endpoint: https://my-workspace.cloud.databricks.com
      databricks_token: ${ secrets:DATABRICKS_TOKEN }
    include:
      - 'my_schema.*'

Iceberg with S3

catalogs:
  - from: iceberg
    name: iceberg_catalog
    params:
      iceberg_catalog_type: rest
      iceberg_rest_uri: https://my-iceberg-catalog.com

Spice.ai Platform

catalogs:
  - from: spice.ai
    name: spiceai
    include:
      - 'tpch.*'

Querying Catalog Tables

Tables are accessed using the full path: <catalog>.<schema>.<table>

SELECT * FROM unity.my_schema.customers LIMIT 10;

Include Patterns

Filter which tables to expose using glob patterns:

include:
  - 'prod_schema.*'           # all tables in prod_schema
  - '*.customers'             # customers table in any schema
  - 'analytics.sales_*'       # tables starting with sales_ in analytics

Documentation

• Catalog Connectors Overview
• Catalogs Reference