DMCA
Street-to-Shop: Cross-Scenario Clothing Retrieval via Parts Alignment and Auxiliary Set (2012)
| Citations: | 21 - 6 self |
BibTeX
@MISC{Liu12street-to-shop:cross-scenario,
author = {Si Liu and et al.},
title = {Street-to-Shop: Cross-Scenario Clothing Retrieval via Parts Alignment and Auxiliary Set},
year = {2012}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
In this paper, we address a practical problem of cross-scenario clothing retrieval- given a daily human photo cap-tured in general environment, e.g., on street, finding simi-lar clothing in online shops, where the photos are captured more professionally and with clean background. There are large discrepancies between daily photo scenario and on-line shopping scenario. We first propose to alleviate the human pose discrepancy by locating 30 human parts detected by a well trained hu-man detector. Then, founded on part features, we propose a two-step calculation to obtain more reliable one-to-many similarities between the query daily photo and online shop-ping photos: 1) the within-scenario one-to-many similari-ties between a query daily photo and the auxiliary set are derived by direct sparse reconstruction; and 2) by a cross-scenario many-to-many similarity transfer matrix inferred offline from an extra auxiliary set and the online shopping set, the reliable cross-scenario one-to-many similarities be-tween the query daily photo and all online shopping photos are obtained. We collect a large online shopping dataset and a daily photo dataset, both of which are thoroughly labeled with 15 clothing attributes via Mechanic Turk. The extensive exper-imental evaluations on the collected datasets well demon-strate the effectiveness of the proposed framework for cross-scenario clothing retrieval.
Keyphrases
cross-scenario clothing retrieval auxiliary set query daily photo part alignment daily photo scenario practical problem online shop-ping photo mechanic turk daily photo dataset extra auxiliary set direct sparse reconstruction part feature two-step calculation daily human photo reliable one-to-many similarity hu-man detector online shopping human part simi-lar clothing cross-scenario many-to-many similarity transfer matrix clothing attribute general environment clean background extensive exper-imental evaluation on-line shopping scenario reliable cross-scenario one-to-many similarity human pose discrepancy shopping photo within-scenario one-to-many similari-ties large discrepancy large online shopping dataset online shop
