Popular repositories Loading

1. xllm xllm Public

   Forked from jd-opensource/xllm

   A high-performance inference engine for LLMs, optimized for diverse AI accelerators.

   C++ 1

2. xllm-service xllm-service Public

   Forked from jd-opensource/xllm-service

   A flexible serving framework that delivers efficient and fault-tolerant LLM inference for clustered deployments.

   C++ 1

3. nnfusion nnfusion Public

   Forked from microsoft/nnfusion

   A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.

   C++

4. Co-locate Co-locate Public

   Forked from guessmewho233/CoGNN_info_for_SC22

   C++

5. revised_metis revised_metis Public

   C

6. sglang_rlhf sglang_rlhf Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python