Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
hsiaolinhu committed Dec 19, 2024
1 parent 32fae3c commit 8bc0439
Show file tree
Hide file tree
Showing 4 changed files with 36 additions and 5 deletions.
6 changes: 4 additions & 2 deletions _pages/includes/news.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,16 @@
# 🔥 News
- *2024.11*: One paper is accepted by COLING 2025! [PMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuning](https://arxiv.org/abs/2409.16722)
- *2024.9*: One paper is accepted by NeurIPS 2025! [Enhancing In-Context Learning with just SVD-Based Pruning: A Theoretical Perspective](https://arxiv.org/abs/2406.03768)
- *2024.6*: Xiaomi Young Scholar Research Program (PI: Yong Liu) received approval, focusing on fine-tuning edge LLMs for personalized services.
- *2024.5*: One Paper is accepted by KDD 2025! [LLMs may Dominate Information Access](https://arxiv.org/abs/2310.20501)
- *2023.12*: Started internship at Xiaomi AI Lab, focusing on efficient fine-tuning of edge LLMs.
- *2023.10*: Our work on [LLMs may Dominate Information Access: Neural Retrievers are Biased Towards LLM-Generated Texts](https://arxiv.org/abs/2310.20501) is out!

<!-- - *2023.10*: Our work on [LLMs may Dominate Information Access: Neural Retrievers are Biased Towards LLM-Generated Texts](https://arxiv.org/abs/2310.20501) is out!
- *2023.06*: Excited to be awarded as Third Prize in the [MindSpore](https://www.mindspore.cn/) Large Language Model Innovation Training Camp.
- *2023.03*: Prof. Yong Liu presents our paper on generalization error of gederated leanring at AI TIME [[Video](https://www.bilibili.com/video/BV1Wk4y1i7Xv?t=231.7)].
- *2023.03*: I attend the [2023 Workshop on Machine Learning Theory and Foundations](https://iiis.tsinghua.edu.cn/show-10351-1.html), Microsoft Research Asia.
- *2023.03*: I Write a blog on statistical learning theory to AI4Science Community. See in [AI4Science101 blogs](https://ai4science101.github.io/blogs/statistical_learning_theory/).
- *2023.01*: One paper is accepted by ICLR!
- *2023.01*: One paper is accepted by ICLR 2023! -->


<!--
Expand Down
35 changes: 32 additions & 3 deletions _pages/includes/pub.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,20 @@

# 📝 Publications
## 🎙 Generalization
## 🎙 Federated Learning Generalization

<div class='paper-box'><div class='paper-box-image'><div><div class="badge">AAAI 2025</div><img src='images/zo-dsgd.png' alt="sym" width="100%"></div></div>
<div class='paper-box-text' markdown="1">

[Stability and Generalization of Zeroth-Order Decentralized Stochastic Gradient Descent with Changing Topology] \\
**Xiaolin Hu**, Zixuan Gong, Gengze Xu, Wei Liu, Jian Luan, Bin Wang, Yong Liu

<!-- [**Project**](https://github.com/xiaulinhu/pinn-pytorch) <strong><span class='show_paper_citations' data='4FA6C0AAAAAJ:LkGwnXOMwfcC'></span></strong> -->

- This paper provides the first generalization analysis of ZO-DSGD with changing topology.
- The obtained generalization bounds align with SGD in (strongly) convex cases and with DSGD in non-convex cases.
- The results reflect the impact of client count, sample size, and topology on generalization performance.
</div>
</div>


<div class='paper-box'><div class='paper-box-image'><div><div class="badge">ICLR 2023</div><img src='images/fl-gen.png' alt="sym" width="100%"></div></div>
Expand All @@ -9,7 +23,7 @@
[Generalization Bounds for Federated Learning: Fast Rates, Unparticipating Clients and Unbounded Losses](https://openreview.net/forum?id=-EHqoysUYLx) \\
**Xiaolin Hu**, Shaojie Li, Yong Liu

[**Video**](https://www.bilibili.com/video/BV1Wk4y1i7Xv?t=565.5) <strong><span class='show_paper_citations' data='4FA6C0AAAAAJ:qjMakFHDy7sC'></span></strong>
[**Video**](https://www.bilibili.com/video/BV1Wk4y1i7Xv?t=565.5) <strong><span class='show_paper_citations' data='6CSzbVEAAAAJ:KlAtU1dfN6UC'></span></strong>

- This paper provides a theoretical analysis of generalization error of federated learning.
- We assume that the heterogeneous clients are sampled from a meta-distribution. In this framework, we characterize the generalization error for unparticipating clients.
Expand All @@ -26,13 +40,28 @@
[A Deep Learning Framework for Solving Rectangular Waveguide Problems](https://ieeexplore.ieee.org/document/9331654) \\
**Xiaolin Hu**, Nicholas E. Buri, **APMC 2020** <span style="color:red">(Oral)</span> \| [![](https://img.shields.io/github/stars/xiaulinhu/pinn-pytorch?style=social&label=Code+Stars)](https://github.com/xiaulinhu/pinn-pytorch)

[**Project**](https://github.com/xiaulinhu/pinn-pytorch) <strong><span class='show_paper_citations' data='4FA6C0AAAAAJ:LkGwnXOMwfcC'></span></strong>
[**Project**](https://github.com/xiaulinhu/pinn-pytorch) <strong><span class='show_paper_citations' data='6CSzbVEAAAAJ:0EnyYjriUFMC'></span></strong>
- We employ Physics Informed Neural Networks (PINNs) to solve rectangular waveguide problems.
- We successfully apply PINNs to the task of solving electric and magnetic fields, which can be described by partial differential equations (PDEs).
- We also show the applicability of the framework for predicting the unknown parameters such as wavenumber.
</div>
</div>

<div class='paper-box'><div class='paper-box-image'><div><div class="badge">AAAI 2025</div><img src='images/dangan.jpeg' alt="sym" width="100%"></div></div>
<div class='paper-box-text' markdown="1">

[人工智能时代下档案工作的变革:机遇、挑战与应对策略] \\
陈晓婷,徐拥军,胡啸林

<!-- [**Project**](https://github.com/xiaulinhu/pinn-pytorch) <strong><span class='show_paper_citations' data='4FA6C0AAAAAJ:LkGwnXOMwfcC'></span></strong> -->

- 与中国人民大学信息资源管理学院合作,讨论人工智能时代下档案工作变革的机遇,挑战和应对策略。
- 人工智能在档案工作中具有诸多应用类型与场景,能有效提升档案各个业务环节的自动化和智能化水平。
- 人工智能也存在对档案管理的安全风险,从而给档案工作者带来新的挑战,有必要通过风险规制避免风险。
</div>
</div>


- ``APMC 2019`` [Capacity Estimation of MIMO Systems via Support Vector Regression](https://ieeexplore.ieee.org/abstract/document/9038838) \\
**Xiaolin Hu**, Nicholas E. Buri, **APMC 2019** <span style="color:red">(Oral)</span>

Expand Down
Binary file added images/dangan.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added images/zo-dsgd.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 8bc0439

Please sign in to comment.