About Me

I am an M.S. student in Computer Science at UC San Diego, advised by Prof. Hao Zhang in the Hao AI Lab, and I hold a B.S. from ShanghaiTech University advised by Prof. Kewei Tu. My research lies at the intersection of Machine Learning Systems and generative models, with a focus on efficient inference, scalable video generation, and world models.

I am currently a Student Researcher at ByteDance Seed Infra, where I own the internal TPU kernel agent system with multi-agent scheduling and a self-evolving knowledge base, accelerated attention end-to-end by 25%, and optimize MoE and fused TPU kernels for large-scale LLM inference. At the Hao AI Lab, I am a core contributor and code owner of FastVideo (3.7K+ stars), leading next-gen video sparse attention research and co-leading quantization-aware distillation releases. I helped build and ship DreamVerse, a real-time video generation workspace that streams 1080p clips on a single GPU.

I am a core contributor to HiLS-Attention, a learned chunk-wise sparse attention achieving 64× context-length extrapolation with up to 13.5× prefill and 15.7× decode speedup — I built its official SGLang serving backend. Earlier, I was the lead author of FlashMHF, a Multi-Head FFN architecture backed by IO-aware Triton/CUDA kernels that cuts peak memory by 3–5×.

Publications

HiLS-Attention

Hierarchical Sparse Attention Done Right

Tencent Hunyuan Team (Core Contributor)

arXiv Preprint, Jul 2026

Native chunk-wise sparse attention that learns top-K chunk retrieval end-to-end under LM loss via landmark-token summaries, achieving 64× context-length extrapolation. Built the official SGLang serving backend as the paper's reference inference system. Up to 13.5× prefill and 15.7× decode speedup over dense attention.

Flash Multi-Head Feed-Forward Network

Flash Multi-Head Feed-Forward Network

Minshen Zhang*, Xiang Hu*, Jianguo Li, Wei Wu, Kewei Tu

arXiv Preprint, 2025

We propose Flash Multi-Head FFN (FlashMHF), a novel architecture replacing standard FFNs in Transformers. Backed by IO-aware Triton/CUDA kernels and dynamic sub-networks, FlashMHF reduces peak memory by 3-5x and accelerates inference while improving performance over SwiGLU.

Projects

ByteDance Seed Infra

TPU Multi-Agent Kernel Optimization Framework

Seed Infra, ByteDance (Code Owner)

Internal Project, Jun 2026 - Present

Code owner of internal TPU kernel agent with multi-agent scheduling and self-evolving knowledge base. Accelerated attention end-to-end by 25% (186μs → 136μs) via DMA pipelining, emit pipeline, and instruction issue reduction; also optimized pre-attention and post-attention kernels in Pallas, achieving up to 2.24× speedup over XLA. Optimized MoE kernel: 5.41× LQQ quantization speedup, 5% MoE end-to-end improvement.

FastVideo

FastVideo (3.7K+ Stars)

Hao AI Lab (Core Contributor & Code Owner)

Open-Source Project, Oct 2025 - Present

Open-source framework for fast and scalable video generation. Optimized LTX 2.3 T2V/I2V inference on a single NVIDIA GB300 to 3× faster than a single H100. Co-led the Quantization-Aware Distillation release (NVFP4/FP8 targeting RTX 5090/4090/3090, 1.7s end-to-end for 5s video). Trained a world model achieving SOTA object-consistency extrapolation, published at ICML 2026 Workshop.

DreamVerse: Real-Time Video Generation

DreamVerse: Real-Time Video Generation

Hao AI Lab (Core Contributor)

Open-Source Release, May 2026

A real-time video generation workspace for "vibe directing" — steering generation through natural-language iteration instead of one-shot prompting. Built on the open-weights LTX-2 model with a FastVideo backend runtime and a Blackwell-optimized pipeline (NVFP4 inference, FA4, torch.compile), streaming 30s 1080p clips with under 5s wait on a single NVIDIA B200. As a core contributor, I built session-based audio–visual continuity for seamless multi-segment generation and accelerated backend inference through kernel benchmarking and fusion.

CUDA/C++ Parallel Image Rendering

CUDA/C++ Parallel Image Rendering

Minshen Zhang

Personal Project, 2023

Built a C++ path tracer supporting Lambertian, metal, dielectric, and emissive materials. Implemented motion blur, depth of field, and volumetric effects. Accelerated rendering via CUDA parallelization and importance sampling, achieving ~200× speedup vs. single-threaded CPU baseline.

Education

University of California, San Diego

Sep 2025 - Dec 2026 (Expected)

Master of Science in Computer Science and Engineering

Teaching Assistant, CSE 291 / DSC 291: Machine Learning Systems

La Jolla, CA

University of California, Berkeley

Aug 2023 - Jan 2024

Exchange Student, EECS Department

Berkeley, CA

ShanghaiTech University

Sep 2021 - Jun 2025

Bachelor of Engineering in Computer Science and Technology

Shanghai, China

Honors & Awards

2025 Outstanding Graduate of ShanghaiTech University
2024 Outstanding Student, ShanghaiTech University
2024 Teaching Assistant, CS100 Computer Programming, ShanghaiTech University
2022 Outstanding Student, ShanghaiTech University