PECOS: Prediction for Enormous and Correlated Output Spaces. (arXiv:2010.05878v2 [cs.LG] UPDATED)

Many large-scale applications amount to finding relevant results from an
enormous output space of potential candidates. For example, finding the best
matching product from a large catalog or suggesting related search phrases on a
search engine. The size of the output space for these problems can range from
millions to billions, and can even be infinite in some applications. Moreover,
training data is often limited for the long-tail items in the output space.
Fortunately, items in the output space are …

arxiv prediction