Pinned Loading

1. SRSWTI/knivesysl SRSWTI/knivesysl Public

   bare-cuda fp6 inference engine for qwen3.8-27b on one rtx 5090 — sm120 tensor-core kernels, 256k context, near-lossless perf too!

   Cuda

2. SRSWTI/shooting-brake SRSWTI/shooting-brake Public

   run a 118b moe on one 5090 and two intel b70s. 88 tok/s. yes cuda and sycl both runtimes talking to each other. beating rtx pro 6000 on 120k ctx plus.

   C++

3. SRSWTI/bodega-inference-engine SRSWTI/bodega-inference-engine Public

   fastest runtime for apple silicon.

   Python 90 3

4. cutlass cutlass Public

   Forked from intel/sycl-tla

   SYCL* Templates for Linear Algebra (SYCL*TLA) - SYCL based CUTLASS implementation for Intel GPUs

   C++

5. llvm-project llvm-project Public

   Forked from llvm/llvm-project

   The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

   LLVM

6. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python