QuadNet: quadruplet loss for multi-view learning in baggage re-identification

Yang, H. and Chu, X. and Zhang, L. and Sun, Y. and Li, D. and Maybank, Steve (2022) QuadNet: quadruplet loss for multi-view learning in baggage re-identification. Pattern Recognition 126 , p. 108546. ISSN 0031-3203.

Abstract

Recently, baggage re-identification (ReID) has become an attractive topic in computer vision because it plays an important role in intelligent surveilance. However, the wide variations in different views of baggage items degrade baggage ReID performance. In this paper, a novel QuadNet is proposed to solve the multi-view problem in baggage ReID at three levels. At the sample level, we propose a multi-view sampling strategy which samples hard examples from multiple identities in multiple views. The sampled baggage items are used to construct quadruplets. At the feature level, view-aware attentional local features are extracted from discriminative regions in each view. These local features are fused with global features to obtain better representations of the quadruplets. At the loss level, a multi-view quadruplet loss operating on the representations of quadruplets is proposed to reduce the intra-class distances caused by view variations and increase the inter-class distances of baggage items captured in the same view. A random local blur data augmentation is proposed to handle the motion blur which is often found in baggage images. The multi-task learning of materials is introduced to obtain discriminative features based on the materials of baggage surfaces. Extensive experiments on three ReID datasets, MVB, Market-1501 and VeRi-776, indicate the remarkable effectiveness and good generalization of the QuadNet model. It has achieved the state-of-the-art performance on the three datasets.

Metadata

Statistics

DownloadsShow export options

Export as XMLJSONCSV

Activity Overview

6 month trend

76Downloads

6 month trend

53Hits

Additional statistics are available via IRStats2.

Archive Staff Only (login required)

Edit/View Item