+ - G. Li, D. Hoang*, K. Bhardwaj, M. Lin, Z. Wang, and R. Marculescu
“Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities”
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024. [Paper] [Code]
+
- E. Oikonomou, G. Holste*, N. Yuan, A. Coppi, R. McNamara, N. Haynes, A. Vora, E. Velazquez, F. Li, V. Menon, S. Kapadia, T. Gill, G. Nadkarni, H. Krumholz, Z. Wang, D. Ouyang, and R. Khera
“A Multimodality Video-Based AI Biomarker for Aortic Stenosis Development and Progression”
JAMA Cardiology, 2024. [Paper] [Code]
- W. Chen*, X. Gong*, J. Wu*, Y. Wei, H. Shi, Z. Yan, Y. Yang, and Z. Wang
“Understanding and Accelerating Neural Architecture Search with Training-Free and Theory-Grounded Metrics”
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023. [Paper] [Code]
- Z. Jiang*, G. Zheng, Y. Cheng, A. Awadallah, and Z. Wang
“CR-MoE: Consistent Routed Mixture-of-Experts for Scaling Contrastive Learning”
Transactions on Machine Learning Research (TMLR), 2023. [Paper] [Code]
diff --git a/research.html b/research.html
index d5c4c18..be7e24a 100644
--- a/research.html
+++ b/research.html
@@ -184,9 +184,9 @@ Theme 1: Efficient and Scalable Learning through Intrinsic Low Dimensionalit
Selected Notable Works:
+
- J. Zhao, Z. Zhang*, B. Chen, Z. Wang, A. Anandkumar, and Y. Tian, "GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection”, arXiv:2403.03507, 2024. [Paper] [Code]
- A. Jaiswal*, S. Liu*, T. Chen*, Z Wang, "The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter”, Advances in Neural Information Processing Systems (NeurIPS), 2023. [Paper] [Code]
- Z. Zhang*, Y. Sheng, T. Zhou, T. Chen*, L. Zheng, R. Cai*, Z. Song, Y. Tian, C. Ré, C. Barrett, Z. Wang, and B. Chen, "H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models”, Advances in Neural Information Processing Systems (NeurIPS), 2023. [Paper] [Code]
- - D. Hoang*, S. Liu*, R. Marculescu, and Z. Wang, "Revisiting Pruning at Initialization Through the Lens of Ramanujan Graph”, International Conference on Learning Representations (ICLR), 2023. (Oral) [Paper] [Code]
- T. Chen*, Z. Zhang*, A. Jaiswal*, S. Liu*, and Z. Wang, "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers”, International Conference on Learning Representations (ICLR), 2023. (Spotlight) [Paper] [Code]
- T. Chen*, J. Frankle, S. Chang, S. Liu, Y. Zhang, Z. Wang, and M. Carbin, “The Lottery Ticket Hypothesis for Pre-trained BERT Networks”, Advances in Neural Information Processing Systems (NeurIPS), 2020. [Paper] [Code]
diff --git a/spring_24.html b/spring_24.html
index d9d5fa1..311d3ba 100644
--- a/spring_24.html
+++ b/spring_24.html
@@ -301,7 +301,7 @@ Spring 24 - Introduction to Computer Vision
-
4/04 Thursday
+
4/04 Thursday
4/09 Tuesday
Object Detection and Segmentation (1)