Paul, S and Dutta, T and Biswas, S (2021) Universal Cross-Domain Retrieval: Generalizing Across Classes and Domains. In: 18th IEEE/CVF International Conference on Computer Vision, ICCV 2021, 11 - 17 October 2021, Virtual, Online, pp. 12036-12044.
|
PDF
IEEE_ICCV_2021.pdf - Published Version Download (2MB) | Preview |
Abstract
In this work, for the first time, we address the problem of universal cross-domain retrieval, where the test data can belong to classes or domains which are unseen during training. Due to dynamically increasing number of categories and practical constraint of training on every possible domain, which requires large amounts of data, generalizing to both unseen classes and domains is important. Towards that goal, we propose SnMpNet (Semantic Neighbourhood and Mixture Prediction Network), which incorporates two novel losses to account for the unseen classes and domains encountered during testing. Specifically, we introduce a novel Semantic Neighborhood loss to bridge the knowledge gap between seen and unseen classes and ensure that the latent space embedding of the unseen classes is semantically meaningful with respect to its neighboring classes. We also introduce a mix-up based supervision at image-level as well as semantic-level of the data for training with the Mixture Prediction loss, which helps in efficient retrieval when the query belongs to an unseen domain. These losses are incorporated on the SE-ResNet50 backbone to obtain SnMpNet. Extensive experiments on two large-scale datasets, Sketchy Extended and DomainNet, and thorough comparisons with state-of-the-art justify the effectiveness of the proposed model. © 2021 IEEE
| Item Type: | Conference Proceedings |
|---|---|
| Publication: | Proceedings of the IEEE International Conference on Computer Vision |
| Publisher: | Institute of Electrical and Electronics Engineers Inc. |
| Additional Information: | The copyright for this article belongs to author |
| Department/Centre: | Division of Electrical Sciences > Computer Science & Automation |
| Date Deposited: | 19 May 2022 09:50 |
| Last Modified: | 19 May 2022 09:50 |
| URI: | https://eprints.iisc.ac.in/id/eprint/71897 |
Actions (login required)
 |
View Item |
