A vLLM (0.12.0) out-of-tree platform plugin that enables running vLLM on NPU (Ascend/torch_npu).
最近更新: 16小时前Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature set.
最近更新: 2个月前Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature set.
最近更新: 3个月前Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature set.
最近更新: 3个月前OmniAdaptor is the glue layer component between OmniOperator, Spark, and Flink.
最近更新: 5个月前OmniStateStore is an open-source and high-performance state storage engine for Flink.
最近更新: 5个月前OmniStream operator acceleration is implemented using native code (C/C++) to optimize Flink SQL and DataStream operators.
最近更新: 5个月前OmniOperator operator acceleration is implemented using native code (C/C++) to optimize big data SQL operators.
最近更新: 5个月前