Skip to main navigation Skip to search Skip to main content

Adapting Large Language Models for Encrypted Traffic Analysis Services: An Efficient Realization with Mixture of LoRA Experts

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

Abstract

As encrypted traffic grows, traditional rule-based and deep learning methods struggle with engineering costs and encryption complexity. While Large Language Models (LLMs) offer promise for traffic analysis via pre-trained feature learning, they face challenges in handling diverse tasks, retaining pre-training knowledge, and adapting efficiently. To address these issues, we propose a new traffic representation learning method and a new Parameter-Efficient Fine-Tuning (PEFT) method for multi-task encrypted traffic analysis services, called TrafficLLM. TrafficLLM alleviates task heterogeneity by utilizing a universal multi-task prompt template and addresses pre-training knowledge forgetting by integrating Singular Value Decomposition based Low-Rank Adaptation (SVD-LoRA). To further reduce the cost of adapting to multiple tasks, we combine the strengths of the Mixture of Experts (MoE) for multi-task learning with SVD-LoRA for PEFT, enabling efficient multi-task traffic analysis. Additionally, we introduce task-aware gating functions to dynamically assign different weights to experts, facilitating the efficient fusion of expert knowledge. Comprehensive experiments on 7 datasets across 5 downstream tasks demonstrate that TrafficLLM delivers superior analysis performance and resource efficiency compared to state-of-the-art models, including DeepSeek, NetGPT, ET-BERT, and TFE-GNN. Detailed analysis of throughput, memory usage, and latency further highlights the practical advantages of TrafficLLM.

© 2026 IEEE. All rights reserved, including rights for text and data mining, and training of artificial intelligence and similar technologies. Personal use is permitted, but republication/redistribution requires IEEE permission.
Original languageEnglish
Pages (from-to)906-919
Number of pages14
JournalIEEE Transactions on Services Computing
Volume19
Issue number2
Online published9 Mar 2026
DOIs
Publication statusPublished - Mar 2026

Funding

This work was supported in part by the Hong Kong Research Grants Council under Grant CityU 11218322, Grant 11219524, Grant R6021-20F, Grant R1012-21, Grant RFS21221S04, Grant C2004-21G, Grant C1029-22G, Grant C6015-23G, and Grant N_CityU139/21, and in part by the Innovation and Technology Commission (ITC) under the Joint Mainland-Hong Kong Funding Scheme (MHKJFS) under Grant MHP/135/23. This work was also supported in part by the InnoHK initiative, the Government of the HKSAR, in part by the Laboratory for AI-Powered Financial Technologies (AIFT), and in part by the Guangdong and Hong Kong Universities “1+1+1” Joint Research Collaboration Scheme.

Research Keywords

  • Encrypted traffic classification
  • LLMs
  • LoRA
  • Mixture of Experts

RGC Funding Information

  • RGC-funded

Fingerprint

Dive into the research topics of 'Adapting Large Language Models for Encrypted Traffic Analysis Services: An Efficient Realization with Mixture of LoRA Experts'. Together they form a unique fingerprint.

Cite this