Gangmuk Lim
website picture

I am a fourth year Ph.D. student at the Computer Science Department of the University of Illinois Urbana-Champaign. I am working with Professor Brighten Godfrey, and also closely working with Professor Radhika Mittal. Also, I earned my Bachelor and Master at the Computer Science at UNIST, South Korea, working with Professor Myeongjae Jeon.

I am broadly interested in system and networking. My current research focuses on cloud infrastructure, specifically for LLM inference. I aim to improve application performance, reduce costs, and enhance reliability by making infrastructure more application-aware. My projects include request routing for microservices in geo-distributed clusters (SLATE), ML-based routing for LLM inference in heterogeneous GPU clusters, verification for reliable cluster management (Kivi), and Memory-aware ML training job co-location framework (Zico).

Most likely, you can find me on the 3rd floor at Siebel Center for Computer Science at Urbana, IL (or at a cafe in Urbana-Champaign)

LinkedIn, GitHub, CV

News!

Jul, 2025
SLATE: Service Layer Traffic Engineering was accepted to NSDI '26!
Jan, 2025
Started internship at Bytedance, Compute Infra team, Seattle. Cloud-native infrastructure for GenAI inference. (project AIBrix)
Sep, 2024
Opportunities and Challenges in Service Layer Traffic Engineering was accepted to HotNets '24! See you at Irvine, CA!
Apr, 2024
Kivi was accepted to USENIX ATC '24! Thank USENIX ATC for the travel grant.
Nov, 2023
Gave a talk at KubeCon '23 about Kivi, Chicago, IL. talk
Nov, 2023
Gave a talk at EnvoyCon '23 about SLATE, Chicago, IL. talk
Mar, 2023
Gave a talk at IstioCon '23 about SLATE, Virtual.

Publication

[NSDI '26]SLATE: Service Layer Traffic Engineering
Gangmuk Lim*, Aditya Prerepa*, Brighten Godfrey, Radhika Mittal
In Proceedings of the 23rd USENIX Symposium on Networked Systems Design and Implementation (NSDI'26), Renton, WA, May 2026.
(* co-first author)
[arXiv]AIBrix: Towards Scalable, Cost-Effective Large Language Model Inference Infrastructure
Jiaxin Shan, Varun Gupta, Le Xu, Haiyang Shi, Jingyuan Zhang, Ning Wang, Linhui Xu, Rong Kang, Tongping Liu, Yifei Zhang, Yiqing Zhu, Shuowei Jin, Gangmuk Lim, Binbin Chen, Zuzhi Chen, Xiao Liu, Xin Chen, Kante Yin, Chak-Pong Chung, Chenyu Jiang, Yicheng Lu, Jianjun Chen, Caixue Lin, Wu Xiang, Rui Shi, Liguang Xie
arXiv:2504.03648, March 2025.
[HotNets '24]Opportunities and Challenges in Service Layer Traffic Engineering
Gangmuk Lim*, Aditya Prerepa*, Brighten Godfrey, Radhika Mittal
(*co-first author)
In Proceedings of the 23rd ACM Workshop on Hot Topics in Networks (HotNets'24), Irvine, California, November 2024.
[USENIX ATC '24]Kivi: Verification for Cluster Management
Bingzhe Liu, Gangmuk Lim, Ryan Beckett, P. Brighten Godfrey.
In Proceedings of the 2024 USENIX Annual Technical Conference (USENIX ATC'24), Santa Clara, CA, July 2024.
[USENIX ATC '21]Zico: Efficient GPU Memory Sharing for Concurrent DNN Training
Gangmuk Lim, Jeongseob Ahn, Wencong Xiao, Youngjin Kwon, Myeongjae Jeon.
In Proceedings of the 2021 USENIX Annual Technical Conference (USENIX ATC'21), July 2021.
[ICDE '20]Approximate Quantiles for Data Center Telemetry Monitoring (short paper)
Gangmuk Lim, Myeongjae Jeon, Stavros Volos, Mohamed Hassan, Ze Jin.
In Proceedings of the 36th IEEE International Conference on Data Engineering (ICDE'20), Dallas, Texas, April 2020.

Experiences

Jan 2025 - Jun 2025
Research Intern, Compute Infra Team
Bytedance
Seattle, WA
Jul 2021 - Apr 2022
Software Engineer
Rebellions
Seongnam, Korea
Jun 2018 - Aug 2018
Research Intern, Media Lab
Ghent University
Ghent, Belgium

Other Facts about me

Sports

I love doing all different kinds of sports such as basketball, running, swimming, freediving, tennis, and more. So, half of my joints have been gone…

Backpacking

In the past, I enjoyed rather extreme backpacking trips, mostly solo trips. Extreme as in no plan, no reservation (hotel or transportation), just a backpack and taking a flight to a new place by myself, not knowing where to go other than the first city. It is like an unopened gift box. I did it intentionally to meet as many new and diverse people as possible and hidden gems in the world. And it definitely worked. This extreme style of traveling started from a solo backpacking that I made at 15 years old to Japan where I lost all the cashes I had and cried on a random street. The places I have been are from Japan, Thailand, India, Nepal, Myammar, Cambodia, Morroco, all Europe countries except for the north part, etc.