AI Gateway Provider Switching Skill

Multi-provider AI configuration for Cloodle platform.

Trigger

• AI provider configuration
• Model switching requests
• API key setup

Supported Providers

Local (Ollama/LM Studio)

AI_PROVIDER=ollama
OLLAMA_BASE_URL=http://localhost:11434
OLLAMA_MODEL=llama3.2

Anthropic (Sonnet/Haiku)

AI_PROVIDER=anthropic
ANTHROPIC_API_KEY=sk-ant-...
ANTHROPIC_MODEL=claude-sonnet-4-20250514

HuggingFace (GPT-OSS)

AI_PROVIDER=huggingface
HF_API_KEY=hf_...
HF_MODEL=gpt-oss-20b

Provider Switching Logic

def get_llm():
    provider = os.getenv("AI_PROVIDER", "ollama")

    if provider == "ollama":
        from langchain_ollama import ChatOllama
        return ChatOllama(
            base_url=os.getenv("OLLAMA_BASE_URL"),
            model=os.getenv("OLLAMA_MODEL", "llama3.2")
        )
    elif provider == "anthropic":
        from langchain_anthropic import ChatAnthropic
        return ChatAnthropic(
            model=os.getenv("ANTHROPIC_MODEL")
        )
    elif provider == "huggingface":
        from langchain_huggingface import HuggingFaceEndpoint
        return HuggingFaceEndpoint(
            repo_id=os.getenv("HF_MODEL")
        )

Model Recommendations

Use Case	Provider	Model
Development	Ollama	llama3.2
Production Chat	Anthropic	claude-sonnet
Cost Sensitive	HuggingFace	gpt-oss-20b
High Quality	Anthropic	claude-opus

Environment File Location

/opt/cloodle/tools/ai/multi_agent_rag_system/.env

Test Provider

curl http://localhost:11434/api/tags  # Ollama