Jingwei Zuo(左京伟)

I am an incoming Ph.D. student at Rice University CS department. Currently, I am a senior undergrad at Tsinghua University.

My research focuses on efficient machine learning systems.

Email: jingwei.zuo [at] rice [dot] edu

Research

My main research question is:

👉 How to increase the efficiency of machine learning systems?

💡 How I develop such a research focus?
Nowadays, modern deep neural networks, represented by large language models (LLMs), have an enormous number of parameters and consume significant amounts of energy. Scaling up the model to achieve superior capabilities is important, whereas keeping the cost down is also important. The energy OpenAI’s ChatGPT uses each year to respond to the users’ requests could power 43,204 U.S. homes for the entire year.[1] It is an outrageous number, which consolidates my belief that we should make every endeavor to cut down the cost of AI models, thereby making the new technology accessible to everybody and making the earth a greener one.

News

01/23/2025: 🎉 DuoAttention accepted by ICLR 2025!

Publications

DuoAttention Illustration

DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads

Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, Junxian Guo, Shang Yang, Haotian Tang, Yao Fu, Song Han
ICLR 2025
AgentVerse Illustration

AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors

Weize Chen*, Yusheng Su*, Jingwei Zuo, Cheng Yang, Chenfei Yuan, Chi-Min Chan, Heyang Yu, Yaxi Lu, Yi-Hsin Hung, Chen Qian, Yujia Qin, Xin Cong, Ruobing Xie, Zhiyuan Liu, Maosong Sun, Jie Zhou
ICLR 2024


Experiences

Carnegie Mellon University

Pittsburgh, PA, USA
2024.07-10
Remote Research Internship
InfiniAI Lab, advised by Prof. Beidi Chen

Massachusetts Institute of Technology

Cambridge, MA, USA
2023.10-2024.05
Research Internship
Han Lab, advised by Prof. Song Han

Tsinghua University

Beijing, China
2023.03-09
Research Internship
Natural Language Processing Lab (THUNLP), advised by Prof. Zhiyuan Liu


Educations

Tsinghua University

2021.09-Present
B.Eng. in Electrical Engineering
B.S. in Fundamental Sciences (Math & Physics)

Northeastern University

2023.09-12
Exchange student at College of Engineering
Selected on Dean's list


To Learn More About Me

Ideals
I would love to witness a world where humans could obtain more convenience, harmony, and happiness. Undeniably, my current research interest is only one minute factor contributing to this grand (and probably quixote) ideal. But the thing is, I would not like my research to go against this prospect at any time and under any circumstance. I advocate for the open source community.
Other Experiences
I went to Northeastern University for a one-semester exchange program in 2023 Fall and had a gorgeous time there! I love traveling around and have been to Hong Kong, Macao, Japan, Singapore, Australia, the US and of course many places of interest in mainland China.
Fun Facts
When I get nervous, I like to scratch my hair😬. So next time you see me doing that in a debate, you know you've got me there.
Hobbies
I love playing tennis🎾 because smashing the ball just feels great. I also like listening to all kinds of music🎶, ranging from Mandopop (e.g. Jay Chou) to classical music (e.g. Tchaikovski). Sometimes I sing👨‍🎤. I like to travel and explore new places:).

Contacts

Feel free to reach out to me by email! If you are in Beijing now, probably we may even have an in-person coffee-chat! I am always glad to talk to someone else, because other’s talk often inspires me and my words may inspire others too:)