Portkey Python SDK

The Portkey Python SDK provides a unified interface to 200+ LLMs through the Portkey AI Gateway. Built on top of the OpenAI SDK for seamless compatibility, it adds production-grade features: automatic fallbacks, retries, load balancing, semantic caching, guardrails, and comprehensive observability.

Additional References:

• API Reference - Response structures, error handling
• Advanced Features - Tool calling, embeddings, audio, images
• Framework Integrations - LangChain, LlamaIndex, Strands, Google ADK
• Provider Configuration - Azure, AWS Bedrock, Vertex AI setup

Installation

pip install portkey-ai