Yang, H. and Chu, X. and Zhang, L. and Sun, Y. and Li, D. and Maybank, Steve (2022) QuadNet: quadruplet loss for multi-view learning in baggage re-identification. Pattern Recognition 126 , p. 108546. ISSN 0031-3203.
|
Text
QuadNet.pdf - Author's Accepted Manuscript Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (1MB) | Preview |
Abstract
Recently, baggage re-identification (ReID) has become an attractive topic in computer vision because it plays an important role in intelligent surveilance. However, the wide variations in different views of baggage items degrade baggage ReID performance. In this paper, a novel QuadNet is proposed to solve the multi-view problem in baggage ReID at three levels. At the sample level, we propose a multi-view sampling strategy which samples hard examples from multiple identities in multiple views. The sampled baggage items are used to construct quadruplets. At the feature level, view-aware attentional local features are extracted from discriminative regions in each view. These local features are fused with global features to obtain better representations of the quadruplets. At the loss level, a multi-view quadruplet loss operating on the representations of quadruplets is proposed to reduce the intra-class distances caused by view variations and increase the inter-class distances of baggage items captured in the same view. A random local blur data augmentation is proposed to handle the motion blur which is often found in baggage images. The multi-task learning of materials is introduced to obtain discriminative features based on the materials of baggage surfaces. Extensive experiments on three ReID datasets, MVB, Market-1501 and VeRi-776, indicate the remarkable effectiveness and good generalization of the QuadNet model. It has achieved the state-of-the-art performance on the three datasets.
Metadata
Item Type: | Article |
---|---|
Keyword(s) / Subject(s): | Baggage re-identification, Multi-view learning, Quadruplet loss, View-aware features |
School: | Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences |
Depositing User: | Steve Maybank |
Date Deposited: | 15 Jun 2022 04:31 |
Last Modified: | 09 Aug 2023 12:52 |
URI: | https://eprints.bbk.ac.uk/id/eprint/47343 |
Statistics
Additional statistics are available via IRStats2.