Online Learning for Context-Aware Multi-User Package Delivery System with Unmanned Vehicles

With the development of e-commerce and smart cities, utilizing unmanned vehicles to deliver packages has emerged as one of the most important methods to make customers receive packages efficiently and effectively. Hence, how to reasonably utilize multiple unmanned vehicles at the same time is a problem. Another main challenging issue is how to satisfy customers' personalized need. In this paper, we propose a novel context-aware multi-armed bandit-based online learning algorithm with active partition method for context space. To solve the massive injecting data flow problem, we utilize a tree-based structure expanding from top to bottom to choose different vehicles, which supports ever-increasing big metering datasets with historical and contextual information. We prove that our proposed context-aware online learning algorithm achieves sublinear regret performance. Experiment results show our proposal can enhance customers' satisfaction and reduce space cost tremendously.