End-to-end multi-modal product matching in fashion e-commerce

arXiv:2403.11593v1 Announce Type: new
Abstract: Product matching, the task of identifying different representations of the same product for better discoverability, curation, and pricing, is a key capability for online marketplace and e-commerce companies. We present a robust multi-modal product matching system in an industry setting, where large datasets, data distribution shifts and unseen domains pose challenges. We compare different approaches and conclude that a relatively straightforward projection of pretrained image and text encoders, trained through contrastive learning, yields state-of-the-art results, …

abstract arxiv capability commerce companies cs.cv curation data datasets distribution e-commerce fashion industry key large datasets marketplace modal multi-modal pricing product robust type