Skip to content
#

intel-arc

Here are 70 public repositories matching this topic...

Open recipes, engine patches, and benchmark harnesses for LLM inference on Intel Arc Pro B60/B70 (Battlemage, Xe2). MoE 35B at 160 t/s decode / 7.5K t/s prefill single-stream, 27B at 50~ t/s decode / 1.7K t/s prefill single stream. vLLM XPU MTP unlocked. Muse Glimmer recipe added!!

  • Updated Aug 31, 2026
  • Python

Makes Intel Arc Pro B70 GPUs actually fast on Ubuntu Server. 11 llama.cpp cherry-picks that fix the big B70 bugs (MoE slot-init SEGV, Q8_0 reorder crash, OOM reorder, missing BF16 GET_ROWS, wrong Xe2 warptile, slow K-quant DMMV, etc.) + Mesa 26 + runtime env workarounds + SYCL/Vulkan backend-selection rules. 2-7x speedup on 4x B70, bench-verified.

  • Updated May 10, 2026
  • Python

Field-tested guide: multi-GPU vLLM tensor-parallel (TP=2/TP=4) on Intel Arc Pro B70 (Battlemage BMG-G31, Xe2) on Linux. Driver setup (xe force_probe=e223), bare-metal vLLM + oneAPI 2025.3, the compute-runtime multi-root USM + triton-xpu init_devices fixes, FP8/int4-AutoRound quant, root-cause error reports. AI-agent readable (AGENTS.md).

  • Updated Jun 13, 2026
  • Shell

Add this topic to your repo

To associate your repository with the intel-arc topic, visit your repo's landing page and select "manage topics."

Learn more