Expert Kit is an efficient foundation of Expert Parallelism (EP) MoE model Inference on heterogenous hardware.
最近更新: 10个月前The Community repo is to store all the information about openEuler Community, inclouding governance, SIGs(project teams), Communications and etc.
最近更新: 10个月前vLLM is a fast and easy-to-use library for LLM inference and serving.
最近更新: 11个月前release management including key features, release plan, development and branch plan, release scope and notes
最近更新: 11个月前QA repo provides rules about how QA team runs and how contributors to this project, also includes test cases and framework
最近更新: 12个月前Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
最近更新: 1年前