Skip to main navigation Skip to search Skip to main content

Personalized Deep Research: A User-Centric Framework, Dataset, and Hybrid Evaluation for Knowledge Discovery

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

2 Downloads (CityUHK Scholars)

Abstract

Deep Research agents driven by LLMs have automated the scholarly discovery pipeline, from planning and query formulation to iterative web exploration. Yet they remain constrained by a static, ''one-size-fits-all'' retrieval paradigm. Current systems fail to adaptively adjust the depth and breadth of exploration based on the user's existing expertise or latent interests, frequently resulting in reports that are either redundant for experts or overly dense for novices. To address this, we introduce Personalized Deep Research (PDR), a framework that integrates dynamic user context into the core retrieval-reasoning loop. Rather than treating personalization as a post-hoc formatting step, PDR unifies user profile modeling with iterative query development, dual-stage (private/public) retrieval, and context-aware synthesis. This allows the system to autonomously align research sub-goals with user intent and optimize the stopping criteria for evidence collection. To facilitate benchmarking, we release the PDR Dataset, covering four realistic user tasks, and propose a hybrid evaluation framework combining lexical metrics with LLM-based judgments to assess factual accuracy and personalization alignment. Experimental results against commercial baselines demonstrate that PDR significantly improves retrieval utility and report relevance, effectively bridging the gap between generic information retrieval and personalized knowledge acquisition. The resource is available to the public at∼ https://github.com/Applied-Machine-Learning-Lab/SIGIR2026_PDR. © 2026 Owner/Author.
Original languageEnglish
Title of host publicationSIGIR '26
Subtitle of host publicationProceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval
PublisherAssociation for Computing Machinery
Pages3284-3291
Number of pages8
ISBN (Print)979-8-4007-2599-9
DOIs
Publication statusPublished - Jul 2026
Event49th International SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2026) - Melbourne Convention and Exhibition Center, Melbourne | Naarm, Australia
Duration: 20 Jul 2026 → 24 Jul 2026
https://sigir2026.org/en-AU

Publication series

NameSIGIR - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval

Conference

Conference49th International SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2026)
Abbreviated titleACM SIGIR 2026
PlaceAustralia
CityMelbourne | Naarm
Period20/07/26 → 24/07/26
Internet address

Bibliographical note

Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).

Funding

This research was partially supported by National Natural Science Foundation of China (No.62502404), Hong Kong Research Grants Council (Research Impact Fund No.R1015-23, Collaborative Research Fund No.C1043-24GF, General Research Fund No. 11218325), Institute of Digital Medicine of City University of Hong Kong (No.9229503), and Huawei (Huawei Innovation Research Program).

Research Keywords

  • llm agents
  • personalized deep research
  • retrieval-augmented generation
  • user profiling

Publisher's Copyright Statement

  • This full text is made available under CC-BY-NC-ND 4.0. https://creativecommons.org/licenses/by-nc-nd/4.0/

Fingerprint

Dive into the research topics of 'Personalized Deep Research: A User-Centric Framework, Dataset, and Hybrid Evaluation for Knowledge Discovery'. Together they form a unique fingerprint.

Cite this