website picture

I am a fifth-year Ph.D. student in the Computer Science Department at the University of Illinois Urbana-Champaign, where I work with Professor Brighten Godfrey and collaborate closely with Professor Radhika Mittal. Before that, I earned my B.S. and M.S. in Computer Science at UNIST, South Korea, working with Professor Myeongjae Jeon.

I am broadly interested in systems and networking. My current research focuses on making infrastructure more intelligent. By making it application-aware, I aim to improve application performance, reduce costs, and enhance reliability. I work on request-level resource scheduling for LLM inference serving and post-training. I have also worked on multi-cluster request routing for microservice applications and verification for cluster management systems.

Most likely, you can find me on the 3rd floor of the Siebel Center for Computer Science in Urbana, IL, or at a cafe in Urbana-Champaign.

LinkedIn, GitHub, CV

News!

May, 2026
I will be interning at Microsoft Research in the RiSE group this summer!
May, 2026
My first Tandemn blog post has been release. Check it out! Your LLM Inference Cluster Is Probably Operating Suboptimally.
Jul, 2025
SLATE: Service Layer Traffic Engineering was accepted to NSDI '26!
Jan, 2025
Started the internship at Bytedance, Compute Infra team, Seattle. Cloud-native infrastructure for GenAI inference. (project AIBrix)
Sep, 2024
Opportunities and Challenges in Service Layer Traffic Engineering was accepted to HotNets '24! See you at Irvine, CA!
Apr, 2024
Kivi was accepted to USENIX ATC '24! Thank USENIX ATC for the travel grant.
Nov, 2023
Gave a talk at KubeCon '23 about Kivi, Chicago, IL. talk
Nov, 2023
Gave a talk at EnvoyCon '23 about SLATE, Chicago, IL. talk
Mar, 2023
Gave a talk at IstioCon '23 about SLATE, Virtual.

Experiences

May 2026 - Aug 2026
Microsoft Research RiSE Group, Research Intern
Redmond, WA
Aug 2025 - Sep 2026
Tandemn, Research engineer
Remote
Jan 2025 - Jun 2025
Bytedance AIBrix Team, Research Intern
Bellevue, WA
Jul 2021 - Apr 2022
Rebellions, Research Engineer
Seongnam, Korea
Jun 2018 - Aug 2018
Ghent University IDLab-MEDIA, Research Intern
Ghent, Belgium

Publication

HotNets'26
The Cloud Should Adapt to Its Applications, Not the Other Way Around! [paper]
Sachin Ashok*, Karuna Grewal*, Talha Waheed, Gangmuk Lim, Gerard Matthew, Aditya S Prerepa, P. Brighten Godfrey, Justin Hsu, Radhika Mittal
(* co-first author)
arXiv
Koi: Evidence-Guided, Self-Calibrating Planning for Multi-Cloud, Heterogeneous LLM Inference Fleets [paper] [code] [blog]
Mankeerat Sidhu*, Gangmuk Lim*, Hetarth Chopra, Maximillian Eisenberg, Quan Hao Ng, Aryan Gosaliya, Shu Liu, Luka Govedič, Jiaxin Shan, Hongkuan Zhou, Vikram Sharma Mailthody, P. Brighten Godfrey, Ion Stoica
arXiv preprint arXiv:2610.24355, 2026.
(* co-first author)
arXiv
Lodestar: An Online-Learning LLM Inference Router [paper] [code]
Gangmuk Lim, Wanyu Zhao, Brighten Godfrey, Jiaxin Shan, Le Xu, Liguang Xie
arXiv preprint arXiv:2606.00946, 2026.
NSDI'26
SLATE: Service Layer Traffic Engineering [paper] [code]
Gangmuk Lim, Aditya Prerepa, Brighten Godfrey, Radhika Mittal
23rd USENIX Symposium on Networked Systems Design and Implementation (NSDI), 2026.
arXiv
AIBrix: Towards Scalable, Cost-Effective Large Language Model Inference Infrastructure [paper] [code]
AIBrix team
arXiv:2504.03648, March 2025.
HotNets'24
Opportunities and Challenges in Service Layer Traffic Engineering [paper]
Gangmuk Lim*, Aditya Prerepa*, Brighten Godfrey, Radhika Mittal
(* co-first author)
USENIX ATC'24
Kivi: Verification for Cluster Management [paper] [code]
Bingzhe Liu, Gangmuk Lim, Ryan Beckett, P. Brighten Godfrey.
USENIX ATC'21
Zico: Efficient GPU Memory Sharing for Concurrent DNN Training [paper]
Gangmuk Lim, Jeongseob Ahn, Wencong Xiao, Youngjin Kwon, Myeongjae Jeon.
ICDE'20
Approximate Quantiles for Data Center Telemetry Monitoring (short paper) [paper]
Gangmuk Lim, Myeongjae Jeon, Stavros Volos, Mohamed Hassan, Ze Jin.

Other facts about me

Backpacking

In the past, I enjoyed rather extreme backpacking trips, mostly solo trips. Extreme as in no plan, no reservation (hotel or transportation), just a backpack and taking a flight to a new place by myself, not knowing where to go other than the first city. It is like an unopened gift box. I did it intentionally to meet as many new and diverse people as possible and hidden gems in the world. And it definitely worked. This extreme style of traveling started from a solo backpacking that I made at 15 years old to Japan where I lost all the cashes I had and cried on a random street. The places I have been are from Japan, Thailand, India, Nepal, Myammar, Cambodia, Morroco, all Europe countries except for the north part, etc.

Sports

I love doing all different kinds of sports such as basketball, freediving, tennis, swimming, and more. So, half of my joints already have been gone…

Coffee

I love coffee, especially light-roasted coffee brewed as pour-over. Some of the roasteries that I really like are Sey Coffee (NYC, NY), DAK Coffee Roasters (Rotterdam, Netherlands), Coffee Place (Gyeongju, Korea), Kuraso Coffee (Kyoto, Japan), Gwang Coffee (Jeonju, Korea), and Metric (Chicago, IL). If you know of a great cafe or roastery, please email me!