Crowd Counting by Adaptively Fusing Predictions from an Image Pyramid

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review

60 Scopus Citations
View graph of relations

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publicationBritish Machine Vision Conference 2018, BMVC 2018
PublisherBMVA Press
Publication statusPublished - Sept 2018

Publication series

NameBritish Machine Vision Conference, BMVC

Conference

Title29th British Machine Vision Conference (BMVC 2018)
LocationNorthumbria University
PlaceUnited Kingdom
CityNewcastle
Period3 - 6 September 2018

Abstract

Because of the powerful learning capability of deep neural networks, counting performance via density map estimation has improved significantly during the past several years. However, it is still very challenging due to severe occlusion, large scale variations, and perspective distortion. Scale variations (from image to image) coupled with perspective distortion (within one image) result in huge scale changes of the object size. Earlier methods based on convolutional neural networks (CNN) typically did not handle this scale variation explicitly, until Hydra-CNN and MCNN. MCNN uses three columns, each with different filter sizes, to extract features at different scales. In this paper, in contrast to using filters of different sizes, we utilize an image pyramid to deal with scale variations. It is more effective and efficient to resize the input fed into the network, as compared to using larger filter sizes. Secondly, we adaptively fuse the predictions from different scales (using adaptively changing per-pixel weights), which makes our method adapt to scale changes within an image. The adaptive fusing is achieved by generating an across-scale attention map, which softly selects a suitable scale for each pixel, followed by a 1x1 convolution. Extensive experiments on three popular datasets show very compelling results.

Citation Format(s)

Crowd Counting by Adaptively Fusing Predictions from an Image Pyramid. / Kang, Di; Chan, Antoni .
British Machine Vision Conference 2018, BMVC 2018. BMVA Press, 2018. (British Machine Vision Conference, BMVC).

Research output: Chapters, Conference Papers, Creative and Literary WorksRGC 32 - Refereed conference paper (with host publication)peer-review