PaddlePaddle / FastDeploy

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

3,657 716 Language: Python License: Apache-2.0 Updated: 15d ago

ernie ernie-45 ernie-45-vl inference llm llm-serving openai serving vllm