NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Image

Boaz Arad; Radu Timofte; Ohad Ben-Shahar; Yi-Tun Lin; Graham Finlayson; Shai Givati; Jiaojiao Li; Chaoxiong Wu; Rui Song; Yunsong Li; Fei Liu; Zhiqiang Lang; Wei Wei; Lei Zhang; Jiangtao Nie; Yuzhi Zhao; Lai-Man Po; Qiong Yan; Wei Liu; Tingyu Lin; Youngjung Kim; Changyeop Shin; Kyeongha Rho; Sungho Kim; Zhiyu ZHU; Junhui HOU; He Sun; Jinchang Ren; Zhenyu Fang; Yijun Yan; Hao Peng; Xiaomei Chen; Jie Zhao; Tarek Stiebel; Simon Koppers; Dorit Merhof; Honey Gupta; Kaushik Mitra; Biebele Joslyn Fubara; Mohamed Sedky; Dave Dyke; Atmadeep Banerjee; Akash Palrecha; null Sabarinathan; K Uma; D Synthiya Vinothini; B Sathya Bama; S M Md Mansoor Roomi

doi:10.1109/CVPRW50498.2020.00231

NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Image

Boaz Arad^*, Radu Timofte, Ohad Ben-Shahar, Yi-Tun Lin, Graham Finlayson, Shai Givati, Jiaojiao Li^*, Chaoxiong Wu, Rui Song, Yunsong Li, Fei Liu, Zhiqiang Lang^*, Wei Wei, Lei Zhang, Jiangtao Nie, Yuzhi Zhao^*, Lai-Man Po, Qiong Yan, Wei Liu, Tingyu LinYoungjung Kim^*, Changyeop Shin, Kyeongha Rho, Sungho Kim, Zhiyu ZHU, Junhui HOU^*, He Sun^*, Jinchang Ren, Zhenyu Fang, Yijun Yan, Hao Peng^*, Xiaomei Chen, Jie Zhao, Tarek Stiebel^*, Simon Koppers, Dorit Merhof, Honey Gupta^*, Kaushik Mitra, Biebele Joslyn Fubara^*, Mohamed Sedky, Dave Dyke, Atmadeep Banerjee, Akash Palrecha^*, Sabarinathan^*, K Uma, D Synthiya Vinothini, B Sathya Bama, S M Md Mansoor Roomi

^*Corresponding author for this work

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

170 Citations (Scopus)

Abstract

This paper reviews the second challenge on spectral reconstruction from RGB images, i.e., the recovery of whole- scene hyperspectral (HS) information from a 3-channel RGB image. As in the previous challenge, two tracks were provided: (i) a "Clean" track where HS images are estimated from noise-free RGBs, the RGB images are themselves calculated numerically using the ground-truth HS images and supplied spectral sensitivity functions (ii) a "Real World" track, simulating capture by an uncalibrated and unknown camera, where the HS images are recovered from noisy JPEG-compressed RGB images. A new, larger-than-ever, natural hyperspectral image data set is presented, containing a total of 510 HS images. The Clean and Real World tracks had 103 and 78 registered participants respectively, with 14 teams competing in the final testing phase. A description of the proposed methods, alongside their challenge scores and an extensive evaluation of top performing methods is also provided. They gauge the state-of-the-art in spectral reconstruction from an RGB image.

Original language	English
Title of host publication	Proceedings - 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops
Publisher	IEEE Computer Society
Pages	1806-1822
ISBN (Print)	9781728193601
DOIs	https://doi.org/10.1109/CVPRW50498.2020.00231
Publication status	Published - Jun 2020
Event	2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2020) - Virtual, Seattle, United States Duration: 14 Jun 2020 → 19 Jun 2020

Publication series

Name	IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
Volume	2020-June
ISSN (Print)	2160-7508
ISSN (Electronic)	2160-7516

Conference

Conference	2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2020)
Country/Territory	United States
City	Seattle
Period	14/06/20 → 19/06/20

Bibliographical note

Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).

Access Output

10.1109/CVPRW50498.2020.00231

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Arad, B., Timofte, R., Ben-Shahar, O., Lin, Y.-T., Finlayson, G., Givati, S., Li, J., Wu, C., Song, R., Li, Y., Liu, F., Lang, Z., Wei, W., Zhang, L., Nie, J., Zhao, Y., Po, L.-M., Yan, Q., Liu, W., ... Md Mansoor Roomi, S. M. (2020). NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Image. In Proceedings - 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (pp. 1806-1822). Article 9150756 (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops; Vol. 2020-June). IEEE Computer Society. https://doi.org/10.1109/CVPRW50498.2020.00231

@inproceedings{ea59650ff3ca47189ff90a6c1ce4971f,

title = "NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Image",

abstract = "This paper reviews the second challenge on spectral reconstruction from RGB images, i.e., the recovery of whole- scene hyperspectral (HS) information from a 3-channel RGB image. As in the previous challenge, two tracks were provided: (i) a {"}Clean{"} track where HS images are estimated from noise-free RGBs, the RGB images are themselves calculated numerically using the ground-truth HS images and supplied spectral sensitivity functions (ii) a {"}Real World{"} track, simulating capture by an uncalibrated and unknown camera, where the HS images are recovered from noisy JPEG-compressed RGB images. A new, larger-than-ever, natural hyperspectral image data set is presented, containing a total of 510 HS images. The Clean and Real World tracks had 103 and 78 registered participants respectively, with 14 teams competing in the final testing phase. A description of the proposed methods, alongside their challenge scores and an extensive evaluation of top performing methods is also provided. They gauge the state-of-the-art in spectral reconstruction from an RGB image.",

author = "Boaz Arad and Radu Timofte and Ohad Ben-Shahar and Yi-Tun Lin and Graham Finlayson and Shai Givati and Jiaojiao Li and Chaoxiong Wu and Rui Song and Yunsong Li and Fei Liu and Zhiqiang Lang and Wei Wei and Lei Zhang and Jiangtao Nie and Yuzhi Zhao and Lai-Man Po and Qiong Yan and Wei Liu and Tingyu Lin and Youngjung Kim and Changyeop Shin and Kyeongha Rho and Sungho Kim and Zhiyu ZHU and Junhui HOU and He Sun and Jinchang Ren and Zhenyu Fang and Yijun Yan and Hao Peng and Xiaomei Chen and Jie Zhao and Tarek Stiebel and Simon Koppers and Dorit Merhof and Honey Gupta and Kaushik Mitra and Fubara, {Biebele Joslyn} and Mohamed Sedky and Dave Dyke and Atmadeep Banerjee and Akash Palrecha and Sabarinathan and K Uma and Vinothini, {D Synthiya} and {Sathya Bama}, B and {Md Mansoor Roomi}, {S M}",

note = "Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).; 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2020) ; Conference date: 14-06-2020 Through 19-06-2020",

year = "2020",

month = jun,

doi = "10.1109/CVPRW50498.2020.00231",

language = "English",

isbn = "9781728193601",

series = "IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops",

publisher = "IEEE Computer Society",

pages = "1806--1822",

booktitle = "Proceedings - 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops",

address = "United States",

}

Arad, B, Timofte, R, Ben-Shahar, O, Lin, Y-T, Finlayson, G, Givati, S, Li, J, Wu, C, Song, R, Li, Y, Liu, F, Lang, Z, Wei, W, Zhang, L, Nie, J, Zhao, Y , Po, L-M, Yan, Q, Liu, W, Lin, T, Kim, Y, Shin, C, Rho, K, Kim, S, ZHU, Z , HOU, J, Sun, H, Ren, J, Fang, Z, Yan, Y, Peng, H, Chen, X, Zhao, J, Stiebel, T, Koppers, S, Merhof, D, Gupta, H, Mitra, K, Fubara, BJ, Sedky, M, Dyke, D, Banerjee, A, Palrecha, A, Sabarinathan, Uma, K, Vinothini, DS, Sathya Bama, B & Md Mansoor Roomi, SM 2020, NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Image. in Proceedings - 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops., 9150756, IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, vol. 2020-June, IEEE Computer Society, pp. 1806-1822, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2020), Seattle, Washington, United States, 14/06/20. https://doi.org/10.1109/CVPRW50498.2020.00231

NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Image. / Arad, Boaz; Timofte, Radu; Ben-Shahar, Ohad et al.
Proceedings - 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. IEEE Computer Society, 2020. p. 1806-1822 9150756 (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops; Vol. 2020-June).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Image

AU - Arad, Boaz

AU - Timofte, Radu

AU - Ben-Shahar, Ohad

AU - Lin, Yi-Tun

AU - Finlayson, Graham

AU - Givati, Shai

AU - Li, Jiaojiao

AU - Wu, Chaoxiong

AU - Song, Rui

AU - Li, Yunsong

AU - Liu, Fei

AU - Lang, Zhiqiang

AU - Wei, Wei

AU - Zhang, Lei

AU - Nie, Jiangtao

AU - Zhao, Yuzhi

AU - Po, Lai-Man

AU - Yan, Qiong

AU - Liu, Wei

AU - Lin, Tingyu

AU - Kim, Youngjung

AU - Shin, Changyeop

AU - Rho, Kyeongha

AU - Kim, Sungho

AU - ZHU, Zhiyu

AU - HOU, Junhui

AU - Sun, He

AU - Ren, Jinchang

AU - Fang, Zhenyu

AU - Yan, Yijun

AU - Peng, Hao

AU - Chen, Xiaomei

AU - Zhao, Jie

AU - Stiebel, Tarek

AU - Koppers, Simon

AU - Merhof, Dorit

AU - Gupta, Honey

AU - Mitra, Kaushik

AU - Fubara, Biebele Joslyn

AU - Sedky, Mohamed

AU - Dyke, Dave

AU - Banerjee, Atmadeep

AU - Palrecha, Akash

AU - Sabarinathan, null

AU - Uma, K

AU - Vinothini, D Synthiya

AU - Sathya Bama, B

AU - Md Mansoor Roomi, S M

N1 - Full text of this publication does not contain sufficient affiliation information. With consent from the author(s) concerned, the Research Unit(s) information for this record is based on the existing academic department affiliation of the author(s).

PY - 2020/6

Y1 - 2020/6

N2 - This paper reviews the second challenge on spectral reconstruction from RGB images, i.e., the recovery of whole- scene hyperspectral (HS) information from a 3-channel RGB image. As in the previous challenge, two tracks were provided: (i) a "Clean" track where HS images are estimated from noise-free RGBs, the RGB images are themselves calculated numerically using the ground-truth HS images and supplied spectral sensitivity functions (ii) a "Real World" track, simulating capture by an uncalibrated and unknown camera, where the HS images are recovered from noisy JPEG-compressed RGB images. A new, larger-than-ever, natural hyperspectral image data set is presented, containing a total of 510 HS images. The Clean and Real World tracks had 103 and 78 registered participants respectively, with 14 teams competing in the final testing phase. A description of the proposed methods, alongside their challenge scores and an extensive evaluation of top performing methods is also provided. They gauge the state-of-the-art in spectral reconstruction from an RGB image.

AB - This paper reviews the second challenge on spectral reconstruction from RGB images, i.e., the recovery of whole- scene hyperspectral (HS) information from a 3-channel RGB image. As in the previous challenge, two tracks were provided: (i) a "Clean" track where HS images are estimated from noise-free RGBs, the RGB images are themselves calculated numerically using the ground-truth HS images and supplied spectral sensitivity functions (ii) a "Real World" track, simulating capture by an uncalibrated and unknown camera, where the HS images are recovered from noisy JPEG-compressed RGB images. A new, larger-than-ever, natural hyperspectral image data set is presented, containing a total of 510 HS images. The Clean and Real World tracks had 103 and 78 registered participants respectively, with 14 teams competing in the final testing phase. A description of the proposed methods, alongside their challenge scores and an extensive evaluation of top performing methods is also provided. They gauge the state-of-the-art in spectral reconstruction from an RGB image.

UR - http://www.scopus.com/inward/record.url?scp=85089667281&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-85089667281&origin=recordpage

U2 - 10.1109/CVPRW50498.2020.00231

DO - 10.1109/CVPRW50498.2020.00231

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 9781728193601

T3 - IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

SP - 1806

EP - 1822

BT - Proceedings - 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops

PB - IEEE Computer Society

T2 - 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2020)

Y2 - 14 June 2020 through 19 June 2020

ER -

Arad B, Timofte R, Ben-Shahar O, Lin YT, Finlayson G, Givati S et al. NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Image. In Proceedings - 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. IEEE Computer Society. 2020. p. 1806-1822. 9150756. (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops). doi: 10.1109/CVPRW50498.2020.00231

NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Image

Abstract

Publication series

Conference

Bibliographical note

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this