The Wisdom of 1,170 Teams: Lessons and Experiences from a Large Indoor Localization Competition

Yuming Hu; Xiubin Fan; Zhimeng Yin; Feng Qian; Zhe Ji; Yuanchao Shu; Yeqiang Han; Qiang Xu; Jie Liu; Paramvir Bahl

doi:10.1145/3570361.3592507

The Wisdom of 1,170 Teams: Lessons and Experiences from a Large Indoor Localization Competition

Yuming Hu, Xiubin Fan, Zhimeng Yin, Feng Qian^*, Zhe Ji, Yuanchao Shu, Yeqiang Han, Qiang Xu, Jie Liu, Paramvir Bahl

^*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

4 Citations (Scopus)

Abstract

We organized an online fingerprint-based indoor localization competition in 2021. It attracted 1,170 teams worldwide. The teams were provided with a 60 GB dataset including WiFi, BLE, IMU, and geomagnetic field strength data collected from 204 buildings to build their localization algorithms, which were then evaluated against a separate test dataset. The competition received 28,009 submissions. The top team achieved an average accuracy of 1.50m. This paper reports the lessons we learned from analyzing the submissions, as well as our experiences in organizing the competition, through both qualitatively studying the teams’ algorithms and quantitatively characterizing the competition results. © 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM.

Original language	English
Title of host publication	ACM MobiCom '23
Subtitle of host publication	Proceedings of the 2023 The 29th Annual International Conference on Mobile Computing and Networking
Place of Publication	New York, NY
Publisher	Association for Computing Machinery
Pages	566-580
ISBN (Print)	978-1-4503-9990-6
DOIs	https://doi.org/10.1145/3570361.3592507
Publication status	Published - 2023
Event	29th Annual International Conference on Mobile Computing and Networking, MobiCom 2023 - Riu Plaza España Hotel, Madrid, Spain Duration: 2 Oct 2023 → 6 Oct 2023 https://sigmobile.org/mobicom/2023/

Conference

Conference	29th Annual International Conference on Mobile Computing and Networking, MobiCom 2023
Abbreviated title	ACM MobiCom 2023
Place	Spain
City	Madrid
Period	2/10/23 → 6/10/23
Internet address	https://sigmobile.org/mobicom/2023/

Bibliographical note

Research Unit(s) information for this publication is provided by the author(s) concerned.

Funding

We thank the anonymous reviewers and our shepherd fortheir insightful comments. Zhimeng Yin’s research was sup-ported by NSF China 62102332, ECS CityU 21216822, and CityUniversity of Hong Kong 9610491. Jie Liu’s research is partlysupported by the National Key R&D Program of China underGrant 2021ZD0110905, and an Open Competition Programof Heilongjiang Province under Grant 2021ZXJ05A03

Research Keywords

Indoor Localization
Fingerprinting
Online Competition

RGC Funding Information

RGC-funded

Access Output

10.1145/3570361.3592507

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

ECS: Enabling Interference Resilience for Low-Power Wide-Area Networks through a Cross-Layer Framework
YIN, Z. (Principal Investigator / Project Coordinator)
1/12/22 → …
Project: Research

Cite this

Hu, Y., Fan, X., Yin, Z., Qian, F., Ji, Z., Shu, Y., Han, Y., Xu, Q., Liu, J., & Bahl, P. (2023). The Wisdom of 1,170 Teams: Lessons and Experiences from a Large Indoor Localization Competition. In ACM MobiCom '23: Proceedings of the 2023 The 29th Annual International Conference on Mobile Computing and Networking (pp. 566-580). Association for Computing Machinery. https://doi.org/10.1145/3570361.3592507

@inproceedings{1cda88c12e0240dd802834dcdc3cfd48,

title = "The Wisdom of 1,170 Teams: Lessons and Experiences from a Large Indoor Localization Competition",

abstract = "We organized an online fingerprint-based indoor localization competition in 2021. It attracted 1,170 teams worldwide. The teams were provided with a 60 GB dataset including WiFi, BLE, IMU, and geomagnetic field strength data collected from 204 buildings to build their localization algorithms, which were then evaluated against a separate test dataset. The competition received 28,009 submissions. The top team achieved an average accuracy of 1.50m. This paper reports the lessons we learned from analyzing the submissions, as well as our experiences in organizing the competition, through both qualitatively studying the teams{\textquoteright} algorithms and quantitatively characterizing the competition results. {\textcopyright} 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM.",

keywords = "Indoor Localization, Fingerprinting, Online Competition",

author = "Yuming Hu and Xiubin Fan and Zhimeng Yin and Feng Qian and Zhe Ji and Yuanchao Shu and Yeqiang Han and Qiang Xu and Jie Liu and Paramvir Bahl",

note = "Research Unit(s) information for this publication is provided by the author(s) concerned.; 29th Annual International Conference on Mobile Computing and Networking, MobiCom 2023, ACM MobiCom 2023 ; Conference date: 02-10-2023 Through 06-10-2023",

year = "2023",

doi = "10.1145/3570361.3592507",

language = "English",

isbn = "978-1-4503-9990-6",

pages = "566--580",

booktitle = "ACM MobiCom '23",

publisher = "Association for Computing Machinery",

address = "United States",

url = "https://sigmobile.org/mobicom/2023/",

}

Hu, Y, Fan, X , Yin, Z, Qian, F, Ji, Z, Shu, Y, Han, Y, Xu, Q, Liu, J & Bahl, P 2023, The Wisdom of 1,170 Teams: Lessons and Experiences from a Large Indoor Localization Competition. in ACM MobiCom '23: Proceedings of the 2023 The 29th Annual International Conference on Mobile Computing and Networking. Association for Computing Machinery, New York, NY, pp. 566-580, 29th Annual International Conference on Mobile Computing and Networking, MobiCom 2023, Madrid, Spain, 2/10/23. https://doi.org/10.1145/3570361.3592507

The Wisdom of 1,170 Teams: Lessons and Experiences from a Large Indoor Localization Competition. / Hu, Yuming; Fan, Xiubin ; Yin, Zhimeng et al.
ACM MobiCom '23: Proceedings of the 2023 The 29th Annual International Conference on Mobile Computing and Networking. New York, NY: Association for Computing Machinery, 2023. p. 566-580.

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - The Wisdom of 1,170 Teams

T2 - 29th Annual International Conference on Mobile Computing and Networking, MobiCom 2023

AU - Hu, Yuming

AU - Fan, Xiubin

AU - Yin, Zhimeng

AU - Qian, Feng

AU - Ji, Zhe

AU - Shu, Yuanchao

AU - Han, Yeqiang

AU - Xu, Qiang

AU - Liu, Jie

AU - Bahl, Paramvir

N1 - Research Unit(s) information for this publication is provided by the author(s) concerned.

PY - 2023

Y1 - 2023

N2 - We organized an online fingerprint-based indoor localization competition in 2021. It attracted 1,170 teams worldwide. The teams were provided with a 60 GB dataset including WiFi, BLE, IMU, and geomagnetic field strength data collected from 204 buildings to build their localization algorithms, which were then evaluated against a separate test dataset. The competition received 28,009 submissions. The top team achieved an average accuracy of 1.50m. This paper reports the lessons we learned from analyzing the submissions, as well as our experiences in organizing the competition, through both qualitatively studying the teams’ algorithms and quantitatively characterizing the competition results. © 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM.

AB - We organized an online fingerprint-based indoor localization competition in 2021. It attracted 1,170 teams worldwide. The teams were provided with a 60 GB dataset including WiFi, BLE, IMU, and geomagnetic field strength data collected from 204 buildings to build their localization algorithms, which were then evaluated against a separate test dataset. The competition received 28,009 submissions. The top team achieved an average accuracy of 1.50m. This paper reports the lessons we learned from analyzing the submissions, as well as our experiences in organizing the competition, through both qualitatively studying the teams’ algorithms and quantitatively characterizing the competition results. © 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM.

KW - Indoor Localization

KW - Fingerprinting

KW - Online Competition

U2 - 10.1145/3570361.3592507

DO - 10.1145/3570361.3592507

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 978-1-4503-9990-6

SP - 566

EP - 580

BT - ACM MobiCom '23

PB - Association for Computing Machinery

CY - New York, NY

Y2 - 2 October 2023 through 6 October 2023

ER -

Hu Y, Fan X , Yin Z, Qian F, Ji Z, Shu Y et al. The Wisdom of 1,170 Teams: Lessons and Experiences from a Large Indoor Localization Competition. In ACM MobiCom '23: Proceedings of the 2023 The 29th Annual International Conference on Mobile Computing and Networking. New York, NY: Association for Computing Machinery. 2023. p. 566-580 Epub 2023 Oct 2. doi: 10.1145/3570361.3592507

The Wisdom of 1,170 Teams: Lessons and Experiences from a Large Indoor Localization Competition

Abstract

Conference

Bibliographical note

Funding

Research Keywords

RGC Funding Information

Access Output

Other Access Options

Permanent Link

Fingerprint

Projects

ECS: Enabling Interference Resilience for Low-Power Wide-Area Networks through a Cross-Layer Framework

Cite this