About Me

Expected Graduation: June 2027. Open to full-time Research Scientist / Research Engineer / Member of Technical Staff roles.

Please feel free to contact me at to discuss potential opportunities.

I am a Ph.D. candidate at the Provable Responsible AI and Data Analytics (PRADA) Lab at the King Abdullah University of Science and Technology (KAUST), advised by Prof. Di Wang. I am also doing a research internship at the Microsoft Research Asia (MSRA), working with Dr. Xingxing Zhang.

Previously, I was an algorithm engineer in the Trustworthy AI Research Group at JD Explore Academy, JD.com, Inc.. I received an MPhil in Engineering and IT from The University of Sydney, advised by Prof. Dacheng Tao, and a B.Sc. in Mathematics and Applied Mathematics from the South China University of Technology, advised by Prof. Chuhua Xian.

Contact
shaopeng.fu@kaust.edu.sa
shaopengfu15@gmail.com

Research Summary

I develop principled methods and scalable infrastructure for reliable and efficient LLM post-training, adversarial robustness, scalable evaluation, and adversarial-training-inspired data synthesis. My research combines deep learning theory with system-level optimization to improve the training and evaluation of reasoning models. Recent topics include:

If you are interested in collaborating with me or discussing my research, please feel free to contact me through email.

News

- 08/2025: I accepted the invitation to serve as a reviewer for [AISTATS 2026](https://aistats.org/aistats2026/). - 06/2025: I started an research internship at the [Microsoft Research Asia (MSRA)](https://www.microsoft.com/en-us/research/lab/microsoft-research-asia/)! - 05/2025: One paper was accepted to [IEEE Transactions on Information Theory](https://ieeexplore.ieee.org/document/11005570)! - 02/2025: I accepted the invitation to serve as a reviewer for [NeurIPS 2025](https://openreview.net/group?id=NeurIPS.cc/2025/Conference). - 02/2025: We released our new paper ["Short-length Adversarial Training Helps LLMs Defend Long-length Jailbreak Attacks: Theoretical and Empirical Evidence"](https://arxiv.org/abs/2502.04204). - 12/2024: I accepted the invitation to serve as a reviewer for [ICML 2025](https://openreview.net/group?id=ICML.cc/2025/Conference). - 09/2024: I accepted the invitation to serve as a reviewer for [AISTATS 2025](https://aistats.org/aistats2025/). - 08/2024: I accepted the invitation to serve as a reviewer for [ICLR 2025](https://openreview.net/group?id=ICLR.cc/2025/Conference). - 08/2024: We released our new paper ["Pre-trained Encoder Inference: Revealing Upstream Encoders In Downstream Machine Learning Services"](https://www.arxiv.org/abs/2408.02814). - 07/2024: I accepted the invitation to serve as a PC member for [AAAI 2025](https://openreview.net/group?id=AAAI.org/2025/Conference). - 05/2024: I passed my Qualifying Exam! - 05/2024: I accepted the invitation to serve as a reviewer for [NeurIPS 2024](https://openreview.net/group?id=NeurIPS.cc/2024/Conference). - 04/2024: I will serve as an AEC member for [CCS 2024](https://www.sigsac.org/ccs/CCS2024/). - 01/2024: Our paper on [robust overfitting and NTK](https://openreview.net/forum?id=1op5YGZu8X) was accepted to [ICLR 2024](https://openreview.net/group?id=ICLR.cc/2024/Conference)! - 12/2023: I accepted the invitation to serve as a reviewer for [ICML 2024](https://openreview.net/group?id=ICML.cc/2024/Conference). - 10/2023: We released our new paper ["Theoretical Analysis of Robust Overfitting for Wide DNNs: An NTK Approach"](https://arxiv.org/abs/2310.06112). - 09/2023: I accepted the invitation to serve as a reviewer for [AISTATS 2024](https://aistats.org/aistats2024/). - 08/2023: I started my Ph.D. journey at the [King Abdullah University of Science and Technology](https://www.kaust.edu.sa/)! - 08/2023: I accepted the invitation to serve as a reviewer for [ICLR 2024](https://openreview.net/group?id=ICLR.cc/2024/Conference). - 05/2023: I started a research internship at the [PRADA Lab](http://www.pradalab.org/) @ [KAUST](https://www.kaust.edu.sa/), hosted by [Prof. Di Wang](https://shao3wangdi.github.io/)! - 03/2023: I accepted the invitation to serve as a reviewer for [NeurIPS 2023](https://openreview.net/group?id=NeurIPS.cc/2023/Conference). - 12/2022: I accepted the invitation to serve as a reviewer for [ICML 2023](https://openreview.net/group?id=ICML.cc/2023/Conference). - 07/2022: I accepted the invitation to serve as a reviewer for [ICLR 2023](https://openreview.net/group?id=ICLR.cc/2023/Conference). - 03/2022: I accepted the invitation to serve as a reviewer for [NeurIPS 2022](https://openreview.net/group?id=NeurIPS.cc/2022/Conference). - 01/2022: Two papers were accepted to [ICLR 2022](https://openreview.net/group?id=ICLR.cc/2022/Conference)!

Selected Publications [Full List] [Google Scholar]

* indicates co-first authors.

LLM Code Generation


  • RefineRL: Advancing Competitive Programming with Self-Refinement Reinforcement Learning
    [arXiv]
    Shaopeng Fu, Xingxing Zhang, Li Dong, Di Wang, and Furu Wei
    arXiv preprint 2026

Adversarial Robustness


  • Dual-Adversarial Safety Alignment: Cultivating Intrinsic Threat Comprehension in LRMs
    [arXiv] [Code]
    Hongli Shen*, Shaopeng Fu*, Qinbo Zhang, Jian Li, and Di Wang
    arXiv preprint 2026

  • Accelerating Suffix Jailbreak attacks with Prefix-Shared KV-cache
    [arXiv] [Code]
    Xinhai Wang*, Shaopeng Fu*, Shu Yang, Liangyu Wang, Tianhang Zheng, and Di Wang
    arXiv preprint 2026

  • Understanding and Improving Continuous LLM Adversarial Training via In-context Learning Theory
    [Link] [arXiv] [Code]
    Shaopeng Fu and Di Wang
    ICLR 2026

  • Short-length Adversarial Training Helps LLMs Defend Long-length Jailbreak Attacks: Theoretical and Empirical Evidence
    [Link] [arXiv] [Video] [Code]
    Shaopeng Fu, Liang Ding, Jingfeng Zhang, and Di Wang
    NeurIPS 2025

  • Theoretical Analysis of Robust Overfitting for Wide DNNs: An NTK Approach
    [OpenReview] [IEEE] [arXiv] [Video] [Code]
    Shaopeng Fu and Di Wang
    ICLR 2024
    IEEE Transactions on Information Theory

Data/Model Privacy


  • Pre-trained Encoder Inference: Revealing Upstream Encoders In Downstream Machine Learning Services
    [arXiv] [Code]
    Shaopeng Fu, Xuexue Sun, Ke Qing, Tianhang Zheng, and Di Wang
    arXiv preprint 2024

  • Robust Unlearnable Examples: Protecting Data Against Adversarial Learning
    [Link] [arXiv] [Video] [Code]
    Shaopeng Fu, Fengxiang He, Yang Liu, Li Shen, and Dacheng Tao
    ICLR 2022

  • Knowledge Removal in Sampling-based Bayesian Inference
    [Link] [arXiv] [Video] [Code]
    Shaopeng Fu*, Fengxiang He*, and Dacheng Tao
    ICLR 2022

Services

  • Conference Reviewer: ICML (2022-2026) / ICLR (2022-2026) / NeurIPS (2021-2026) / AISTATS (2021, 2024-2026)
  • Conference Committee: CCS 2024 (Artifact Evaluation) / AAAI 2025
  • Journal Reviewer: Neurocomputing / TMLR / IEEE TIT / IEEE TPAMI / IEEE TNNLS / IEEE TCYB / Springer NPL

Selected Awards

  • International Collegiate Programming Contest (ICPC)
    • Gold Medal: Asia Regional Contest Shenyang Site (2018; Rank: 6/186)
    • Silver Medals (3x): Asia-East Continent Final Xi’an Site (2018), Asia Regional Contest Qingdao Site (2017), and Asia Regional Contest Xi’an Site (2017)
  • National Scholarship (2x): 2017 & 2018
  • ICML Silver Reviewer: 2026