Gangmuk Lim
website picture

I am a fourth year Ph.D. student at the Computer Science Department of the University of Illinois Urbana-Champaign. I am working with Professor Brighten Godfrey, and also closely working with Professor Radhika Mittal. Also, I earned my Bachelor and Master at the Computer Science at UNIST, South Korea, working with Professor Myeongjae Jeon.

I am broadly interested in system and networking. My current focus is research on infrastructure, specifically for LLM inference. I aim to improve application performance, reduce costs, and enhance reliability by making infrastructure more application-aware.

My research are/were LLM inference request routing system (Lodestar), Multi-cluster request routing system for microservice applications (SLATE), Verification for cluster manager (Kivi), and GPU sharing framework for DNN training (Zico).

Most likely, you can find me on the 3rd floor at Siebel Center for Computer Science at Urbana, IL (or at a cafe in Urbana-Champaign)

LinkedIn, GitHub, CV

News!

May, 2026
Will start the summer internship at Microsoft Research, Redmond!
May, 2026
My first Tandemn blog post has been release. Check it out! Your LLM Inference Cluster Is Probably Operating Suboptimally.
May, 2026
I have been building self-optimizing LLM inference infrastructure with the amazing team, Tandemn. It is fully open-source. Check it out! Tandemn-system.
Jul, 2025
SLATE: Service Layer Traffic Engineering was accepted to NSDI '26!
Jan, 2025
Started the internship at Bytedance, Compute Infra team, Seattle. Cloud-native infrastructure for GenAI inference. (project AIBrix)
Sep, 2024
Opportunities and Challenges in Service Layer Traffic Engineering was accepted to HotNets '24! See you at Irvine, CA!
Apr, 2024
Kivi was accepted to USENIX ATC '24! Thank USENIX ATC for the travel grant.
Nov, 2023
Gave a talk at KubeCon '23 about Kivi, Chicago, IL. talk
Nov, 2023
Gave a talk at EnvoyCon '23 about SLATE, Chicago, IL. talk
Mar, 2023
Gave a talk at IstioCon '23 about SLATE, Virtual.

Publication

NSDI'26
SLATE: Service Layer Traffic Engineering
Gangmuk Lim*, Aditya Prerepa*, Brighten Godfrey, Radhika Mittal
(* co-first author)
arXiv
AIBrix: Towards Scalable, Cost-Effective Large Language Model Inference Infrastructure
AIBrix team
arXiv:2504.03648, March 2025.
HotNets'24
Opportunities and Challenges in Service Layer Traffic Engineering
Gangmuk Lim*, Aditya Prerepa*, Brighten Godfrey, Radhika Mittal
(* co-first author)
USENIX ATC'24
Kivi: Verification for Cluster Management
Bingzhe Liu, Gangmuk Lim, Ryan Beckett, P. Brighten Godfrey.
USENIX ATC'21
Zico: Efficient GPU Memory Sharing for Concurrent DNN Training
Gangmuk Lim, Jeongseob Ahn, Wencong Xiao, Youngjin Kwon, Myeongjae Jeon.
ICDE'20
Approximate Quantiles for Data Center Telemetry Monitoring (short paper)
Gangmuk Lim, Myeongjae Jeon, Stavros Volos, Mohamed Hassan, Ze Jin.

Experiences

May 2026 - Present
Microsoft Research, Research Intern
Redmond, WA
Aug 2025 - Present
Tandemn, Researcher and engineer
Remote
Jan 2025 - Jun 2025
Bytedance AIBrix Team, Research Intern
Bellevue, WA
Jul 2021 - Apr 2022
Rebellions, Research Engineer
Seongnam, Korea
Jun 2018 - Aug 2018
Ghent University IDLab-MEDIA, Research Intern
Ghent, Belgium

Other facts about me

Sports

I love doing all different kinds of sports such as basketball, running, swimming, freediving, tennis, and more. So, half of my joints have been gone…

Backpacking

In the past, I enjoyed rather extreme backpacking trips, mostly solo trips. Extreme as in no plan, no reservation (hotel or transportation), just a backpack and taking a flight to a new place by myself, not knowing where to go other than the first city. It is like an unopened gift box. I did it intentionally to meet as many new and diverse people as possible and hidden gems in the world. And it definitely worked. This extreme style of traveling started from a solo backpacking that I made at 15 years old to Japan where I lost all the cashes I had and cried on a random street. The places I have been are from Japan, Thailand, India, Nepal, Myammar, Cambodia, Morroco, all Europe countries except for the north part, etc.