Phone Agent Skill

Runs a local FastAPI server that acts as a real-time voice bridge.

Architecture

Twilio (Phone) <--> WebSocket (Audio) <--> [Local Server] <--> Deepgram (STT)
                                                  |
                                                  +--> OpenAI (LLM)
                                                  +--> OpenAI TTS or ElevenLabs (TTS)

Prerequisites

1. Twilio Account: Phone number + TwiML App.
2. Deepgram API Key: For fast speech-to-text.
3. OpenAI API Key: For conversation logic + TTS (default).
4. ElevenLabs API Key (optional): For higher-quality TTS (set TTS_PROVIDER=elevenlabs).