all AI news
Equilibrium Aggregation: Encoding Sets via Optimization. (arXiv:2202.12795v2 [cs.LG] UPDATED)
July 5, 2022, 1:12 a.m. | Sergey Bartunov, Fabian B. Fuchs, Timothy Lillicrap
stat.ML updates on arXiv.org arxiv.org
Processing sets or other unordered, potentially variable-sized inputs in
neural networks is usually handled by aggregating a number of input tensors
into a single representation. While a number of aggregation methods already
exist from simple sum pooling to multi-head attention, they are limited in
their representational power both from theoretical and empirical perspectives.
On the search of a principally more powerful aggregation strategy, we propose
an optimization-based method called Equilibrium Aggregation. We show that many
existing aggregation methods can be …
More from arxiv.org / stat.ML updates on arXiv.org
Jobs in AI, ML, Big Data
Data Scientist (m/f/x/d)
@ Symanto Research GmbH & Co. KG | Spain, Germany
Data Operations Analyst
@ Workday | Poland, Warsaw
Reference Data Specialist - Operations Analyst
@ JPMorgan Chase & Co. | Bengaluru, Karnataka, India
Data Scientist (Redwood City)
@ Anomali | Redwood City, CA
Software Engineer, Database - Languages & Relational Technologies
@ YugabyteDB | United States (Remote) or Sunnyvale, CA
Data Analyst (m/f/d) Online Marketing
@ StepStone Group | Düsseldorf, Germany