PLST: Process-Level Sharer Tracking for Large-Scale Coherence Management
Jiong Feng, Yanhua Chen, Yu Deng, Jiayi Huang
IEEE International Symposium on High-Performance Computer Architecture (HPCA), March 2027. (Accepted)
NOTE: Names with underline are my students
PLST: Process-Level Sharer Tracking for Large-Scale Coherence Management
Jiong Feng, Yanhua Chen, Yu Deng, Jiayi Huang
IEEE International Symposium on High-Performance Computer Architecture (HPCA), March 2027. (Accepted)
Hardware Prefetch Multicast
Yanhua Chen, Jiong Feng, Zhe Wang, Christopher J. Hughes, Jiayi Huang
IEEE International Symposium on High-Performance Computer Architecture (HPCA), March 2027. (Accepted)
Resilient and Bandwidth-Efficient Collective Communication on Mesh Networks
Junwei Cui, Le Qin, Weilin Cai, Yanhua Chen, Fengbin Tu, Jiayi Huang
IEEE International Symposium on High-Performance Computer Architecture (HPCA), March 2027. (Accepted)
Hemlet: A Heterogeneous Compute-in-Memory Chiplet Architecture for Vision Transformers
Cong Wang*, Zexin Fu*, Jiayi Huang, Shanshi Huang
IEEE International Conference on Computer Design (ICCD), November 2026.
Glaive: Cleaving Bandwidth and Latency Scheduling for Efficient Non-uniform All-to-All Collective Communication
Le Qin, Junwei Cui, Weilin Cai, Chenyu Yuan, Jiayi Huang
IEEE/ACM International Symposium on Microarchitecture (MICRO), November 2026.
NB-Walker: Non-blocking Page Table Walker to Enhance Address Translation in NUMA GPUs
Zihang Chen, Lieven Eeckhout, Hongyuan Liu, Tianao Ge, Xinkai Wang, Jiayi Huang
IEEE/ACM International Symposium on Microarchitecture (MICRO), November 2026.
Mining Tensor/Neuron-Level Sparsity to Maximize Mixture-of-Experts Potential in Post-Training and Inference
Weilin Cai, Le Qin, Shwai He, Junwei Cui, Ang Li, Jiayi Huang
International Conference on Machine Learning (ICML), July 2026.
Mapping and Communication Optimizations with Fault Tolerance for Wafer-Scale LLM Inference
Junwei Cui, Le Qin, Weilin Cai, Jiayi Huang
IEEE/ACM International Symposium on Computer Architecture (ISCA), June–July 2026.
cuPTW: Leveraging Idle Compute Units for Massively Parallel GPU Page Table Walks
Zihang Chen, Tianao Ge, Lieven Eeckhout, Hongyuan Liu, Jiayi Huang
ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, June 2026.
FlexTrain: Scalable Hybrid-Parallel Training with Elastic Resource Utilization and Consistent Accuracy
Weilin Cai*, Diandian Gu*, Baoquan Zhong*, Jun Wang*, Zhuolin Zheng*, Gaohong Liu, Kaihua Jiang, Shuguang Wang, Wencong Xiao, Jiayi Huang
Ninth Annual Conference on Machine Learning and Systems (MLSys), May 2026.
Capacity-Aware Inference: Mitigating The Straggler Effect in Mixture of Experts
Shwai He, Weilin Cai, Jiayi Huang, Ang Li
International Conference on Learning Representations (ICLR), April 2026.
XTree on EquiMesh: Topology and Algorithm Co-Design for Collective Communication
Junwei Cui, Le Qin, Weilin Cai, Jiayi Huang
Design, Automation and Test in Europe Conference (DATE), April 2026.
Harmony: A Hardware-Mapping Co-Exploration Framework for Hybrid CIM-based Vision Transformer Accelerator
Yihang Zuo, Zexin Fu, Cong Wang, Yuchao Wu, Jiayi Huang, Yuzhe Ma
International Symposium on Quality Electronic Design (ISQED), April 2026.
Best Paper Award
Software Prefetch Multicast: Sharer-Exposed Prefetching for Bandwidth Efficiency in Manycore Processors
Yanhua Chen, Jiong Feng, Zhe Wang, Christopher J. Hughes, Jiayi Huang
IEEE/ACM International Symposium on Microarchitecture (MICRO), October 2025.
Optimizing All-to-All Collective Communication with Fault Tolerance on Torus Networks
Le Qin, Junwei Cui, Weilin Cai, Meng Niu, Yan Yang, Jiayi Huang
IEEE/ACM International Symposium on Microarchitecture (MICRO), October 2025.
Optimizing Heterogeneous Compute-in-Memory with Hybrid Dataflow and In-Network Reduction for Vision Transformer
Zexin Fu, Yihang Zuo, Yuzhe Ma, Jiayi Huang
IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED), August 2025.
Shortcut-connected Expert Parallelism for Accelerating Mixture of Experts
Weilin Cai, Juyong Jiang, Le Qin, Junwei Cui, Sunhung Kim, Jiayi Huang
International Conference on Machine Learning (ICML), July 2025.
Impact: ScMoE adopted in Meituan's LongCat LLMs [560B LongCat-Flash] [1.6T LongCat-2.0]
Push Multicast: A Speculative and Coherent Interconnect for Mitigating Manycore CPU Communication Bottleneck
Jiayi Huang, Yanhua Chen, Zhe Wang, Christopher J. Hughes, Yufei Ding, Yuan Xie
IEEE International Symposium on High Performance Computer Architecture (HPCA), March 2025.
Communication Algorithm-Architecture Co-Design for Distributed Deep Learning
Jiayi Huang, Pritam Majumder, Sungkeun Kim, Abdullah Muzahid, Ki Hwan Yum, and Eun Jung Kim
IEEE/ACM International Symposium on Computer Architecture (ISCA), June 2021.
[paper] [link] [bibtex] [slides] [lightning] [poster] [example]
Active-Routing: Compute on the Way for Near-Data Processing
Jiayi Huang, Ramprakash Reddy Puli, Pritam Majumder, Sungkeun Kim, Rahul Boyapati, Ki Hwan Yum, and Eun Jung Kim
IEEE International Symposium on High Performance Computer Architecture (HPCA) , February 2019.
Approx-NoC: A Data Approximation Framework for Network-On-Chip Architectures
Rahul Boyapati, Jiayi Huang, Pritam Majumder, Ki Hwan Yum, and Eun Jung Kim
IEEE/ACM International Symposium on Computer Architecture (ISCA) , July 2017.
Fly-Over: A Light-Weight Distributed Power-Gating Mechanism for Energy-Efficient Networks-on-Chip
Rahul Boyapati*, Jiayi Huang*, Ningyuan Wang, Kyung Hoon Kim, Ki Hwan Yum, and Eun Jung Kim
IEEE International Parallel & Distributed Processing Symposium (IPDPS), May–June 2017.
PLFC: Preemptive Lossy Flow Control for Chiplet-based Systems
Jiong Feng, Yanhua Chen, Kunlin Li, Zhengrong Wang, Jiayi Huang
IEEE Chiplet Workshop: Standard, Circuits and Systems, October 2025.
Best Poster Award
Coloring Big Graphs with AlphaGoZero
Jiayi Huang, Mostofa Patwary, Gregory Diamos
arXiv preprint arXiv:1902.10162, 2019.
Fly-Over: A Light-Weight Distributed Power-Gating Mechanism for Energy-Efficient Networks-on-Chip
Rahul Boyapati*, Jiayi Huang*,
Ningyuan Wang, Kyung Hoon Kim, Ki Hwan Yum, and Eun Jung Kim
International Conference on Parallel Architectures and Compilation Techniques (PACT), September 2016.