跳转到主要内容
scheduling

共 2 篇相关文章

相关标签： llm inference batching vllm continuous batching

批处理与调度：推理服务的灵魂

ai-systems / llm-inference

LLM Inference Batching Scheduling +3

Gavel: Heterogeneity-Aware Cluster Scheduling (OSDI'20)

ai-systems / distributed-training

scheduling cluster heterogeneous GPU +1