Back to discover
ToolsBuild with AI

LiteLLM

Connect model providers through a Python SDK or a self-hosted gateway.

Visit official website

Choose the integration

LiteLLM offers a Python library for developers integrating model calls into an application, and a gateway for teams managing access centrally. For the SDK alone, the smaller core package omits the dashboard and gateway command-line entry points. Choose the core or full distribution: the documentation says they cannot be installed together.

A bounded DeepSeek exercise

The DeepSeek integration requires your provider API key and a model name with the deepseek/ prefix; its table includes deepseek/deepseek-flash. Suggested first task: use the documented completion() call to send a short paragraph you wrote and request a summary. Inspect the returned response and compare the summary with your paragraph. This is a proposed exercise, not a test we performed.

Sources(2)