Spice LLM Tools

Tools extend LLM capabilities with runtime functions like SQL queries, search, and external integrations.

Enabling Tools on Models

models:
  - from: openai:gpt-4o
    name: assistant
    params:
      openai_api_key: ${ secrets:OPENAI_API_KEY }
      tools: auto    # enable all default tools

Built-in Tools

Tool	Description	Group
list_datasets	List available datasets	auto
sql	Execute SQL queries	auto
table_schema	Get table schema	auto
search	Vector similarity search	auto
sample_distinct_columns	Sample distinct column values	auto
random_sample	Random row sampling	auto
top_n_sample	Top N rows by ordering	auto
memory:load	Load stored memories	memory
memory:store	Store new memories	memory
websearch	Search the web	-

Tool Groups

Group	Description
auto	All default runtime tools
memory	Memory persistence tools

Examples

SQL and Search Tools

models:
  - from: openai:gpt-4o
    name: analyst
    params:
      tools: sql, search, table_schema

With Memory

datasets:
  - from: memory:store
    name: llm_memory
    access: read_write

models:
  - from: openai:gpt-4o
    name: assistant
    params:
      tools: auto, memory

Web Search Tool

tools:
  - name: web
    from: websearch
    params:
      engine: perplexity
      perplexity_auth_token: ${ secrets:PERPLEXITY_TOKEN }

models:
  - from: openai:gpt-4o
    name: researcher
    params:
      tools: auto, web

MCP Server Integration

tools:
  - name: external_tools
    from: mcp
    params:
      mcp_endpoint: http://localhost:3000/mcp

Custom Tool Configuration

Define custom tools in the tools section:

tools:
  - name: my_search
    from: websearch
    description: 'Search the web for information'
    params:
      engine: perplexity
      perplexity_auth_token: ${ secrets:PERPLEXITY_TOKEN }

Documentation

• LLM Tools Overview
• Tools Reference
• Web Search
• MCP Integration
• Memory