Skip to content
View NolanHo's full-sized avatar

Organizations

@heptagonhust @Pivot-Studio

Block or report NolanHo

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
NolanHo/README.md

Hi, I'm Nolan.Ho

LLM infrastructure engineer & researcher — making millions of LLMs train and serve reliably.

🧭 About Me

  • 🔬 Research Scientist & Infra Lead @ Mind Lab — building managed infrastructure for training and serving millions of LLMs. My work spans distributed RL training systems, large-scale LoRA training, CUDA kernel optimization, KV cache storage, and self-evolving agent infrastructure
  • 🎓 Cryptography grad from HUST (华中科技大学) · Co-founded NoEdgeAI / Doc2X (backed by MiraclePlus)
  • 💼 Ex-DeepSeek SRE · Ex-ByteDance / Volcengine Storage Engineer
  • 💻 Rust · Go · TypeScript · Python · CUDA — distributed systems, LLM training/inference, KV cache, RL infrastructure
  • 🌐 From engineering to research — making complex systems run reliably, discovering new problems along the way
  • 🎮 Also: anime, investments, systems theory, cognitive science

🔥 Spirit

Megumin — one spell, one path

Megumin devoted her entire life to a single spell — explosion, and nothing else.

何か成す者とは歩み続ける愚者である、成せぬ者とは歩めを止めた賢者である

"成一事者,矢志不渝之愚者;毁一事者,停滞不前之贤者"

—— ロクでなし魔術講師と禁忌教典

💥 Explosion Chant

黒より黒く 闇より暗き漆黒に — 比黑色还要黑,暗之漆黑

我が深紅の混淆を望みたもう — 融合著我之真红吧

覚醒のとき来た��り — 觉醒的时刻已经到来

無謬の境界に落ちし理 — 坠入无谬之境界

無行の歪みとなりて — 形成无形之扭曲

現出せよ! — 出现吧!

Explosion!!

📈 GitHub Activity

NolanHo stats card

Snake contribution animation

3D contribution graph

Pinned Loading

  1. pegainfer-project/pegainfer pegainfer-project/pegainfer Public

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Rust 668 103

  2. CurvineIO/curvine CurvineIO/curvine Public

    AI-Native & Cloud-Native FS: A high-performance file semantic layer for cloud object storage, integrated with high-speed cache. CNCF Sandbox Project.

    Rust 924 110

  3. AReaL AReaL Public

    Forked from areal-project/AReaL

    The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.

    Python

  4. rayrust rayrust Public

    ray sdk for rust

    Rust 3

  5. ray-project/ray ray-project/ray Public

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    Python 43.7k 8k

  6. rustrain rustrain Public

    Rust 3