Skip to main navigation Skip to search Skip to main content

LMEraser: Large Model Unlearning via Adaptive Prompt Tuning

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

Abstract

To address the growing demand for privacy protection in machine learning, we propose an efficient and exact machine unlearning method for Large Models, called LMEraser. LMEraser takes a divide-and-conquer strategy with an adaptive prompt tuning mechanism to isolate data influence effectively. The training dataset is partitioned into public and private datasets. Public data are used to train the backbone of the model. Private data are clustered based on their diversity, and each cluster tunes a tailored prompt independently. This approach enables targeted unlearning by updating affected prompts, significantly reduces unlearning costs and maintains high model performance. Evaluations show that LMEraser reduces unlearning costs by 100 times compared to prior work without compromising model utility. © 2025 by the author(s).
Original languageEnglish
Title of host publicationProceedings of the 28th International Conference on Artificial Intelligence and Statistics (AISTATS) 2025
EditorsYingzhen Li, Stephan Mandt, Shipra Agrawal, Emtiyaz Khan
PublisherML Research Press
Pages2026-2034
Publication statusPublished - 2025
Event28th International Conference on Artificial Intelligence and Statistics (AISTATS 2025) - Splash Beach Resort in Mai Khao, Phuket, Thailand
Duration: 3 May 20255 May 2025
https://aistats.org/aistats2025/

Publication series

NameProceedings of Machine Learning Research
Volume258
ISSN (Print)2640-3498

Conference

Conference28th International Conference on Artificial Intelligence and Statistics (AISTATS 2025)
Abbreviated titleAISTATS2025
PlaceThailand
CityPhuket
Period3/05/255/05/25
Internet address

Funding

The authors sincerely thank the reviewers for their invaluable feedback. This work was supported in part by the Research Grants Council of Hong Kong under RIF (Research Impact Fund) R1012-21, R6021-20F, RFS2122-1S04, GRF grant (CityU 11211422), C2004-21G, C1029-22G, C6015-23G, and N CityU139/21, and in part by the Innovation and Technology Commission of Hong Kong (ITC) under Mainland-Hong Kong Joint Funding Scheme (MHKJFS) under Grant MHP/135/23. This work was also supported by the InnoHK initiative, The Government of the HKSAR, and the Laboratory for AI-Powered Financial Technologies (AIFT).

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'LMEraser: Large Model Unlearning via Adaptive Prompt Tuning'. Together they form a unique fingerprint.

Cite this