BIROn - Birkbeck Institutional Research Online

    QuadNet: quadruplet loss for multi-view learning in baggage re-identification

    Yang, H. and Chu, X. and Zhang, L. and Sun, Y. and Li, D. and Maybank, Steve (2022) QuadNet: quadruplet loss for multi-view learning in baggage re-identification. Pattern Recognition 126 , p. 108546. ISSN 0031-3203.

    [img]
    Preview
    Text
    QuadNet.pdf - Author's Accepted Manuscript
    Available under License Creative Commons Attribution Non-commercial No Derivatives.

    Download (1MB) | Preview

    Abstract

    Recently, baggage re-identification (ReID) has become an attractive topic in computer vision because it plays an important role in intelligent surveilance. However, the wide variations in different views of baggage items degrade baggage ReID performance. In this paper, a novel QuadNet is proposed to solve the multi-view problem in baggage ReID at three levels. At the sample level, we propose a multi-view sampling strategy which samples hard examples from multiple identities in multiple views. The sampled baggage items are used to construct quadruplets. At the feature level, view-aware attentional local features are extracted from discriminative regions in each view. These local features are fused with global features to obtain better representations of the quadruplets. At the loss level, a multi-view quadruplet loss operating on the representations of quadruplets is proposed to reduce the intra-class distances caused by view variations and increase the inter-class distances of baggage items captured in the same view. A random local blur data augmentation is proposed to handle the motion blur which is often found in baggage images. The multi-task learning of materials is introduced to obtain discriminative features based on the materials of baggage surfaces. Extensive experiments on three ReID datasets, MVB, Market-1501 and VeRi-776, indicate the remarkable effectiveness and good generalization of the QuadNet model. It has achieved the state-of-the-art performance on the three datasets.

    Metadata

    Item Type: Article
    Keyword(s) / Subject(s): Baggage re-identification, Multi-view learning, Quadruplet loss, View-aware features
    School: Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences
    Depositing User: Steve Maybank
    Date Deposited: 15 Jun 2022 04:31
    Last Modified: 09 Aug 2023 12:52
    URI: https://eprints.bbk.ac.uk/id/eprint/47343

    Statistics

    Activity Overview
    6 month trend
    81Downloads
    6 month trend
    54Hits

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item