EN 中文

vLLM-Client

Rust Client for vLLM OpenAI-compatible API

English Docs 中文文档
🚀
Async
Tokio runtime, fully async
📡
Streaming
SSE with real-time delta
🔧
Tool Calling
Function calling made easy
🖼️
Multimodal
Image input support
🔄
OpenAI Compatible
API aligned with openai-python
🛡️
Type Safe
Strong types with Serde
streaming_example.rs