Nov. 15, 2023, 1:05 p.m. | /u/reverendCappuccino

Machine Learning www.reddit.com

Hello everyone,
I am just looking for materials and papers to interpret the features learnt by MLP-Mixer models.
For ConvNets we can plot convolutional kernels and pattern that maximally activate units, so we have at least a vague idea of what the net captures and responds to.
For Vision Transformers, linear embedding is analogue to the first conv layer and we can still see things such as color blurs, edge detectors, color filters. For self-supervised pretrained models we sometimes see …

embedding features hello interpretability least linear machinelearning materials mlp plot transformers units vision vision transformers

Machine Learning Postdoctoral Fellow

@ Lawrence Berkeley National Lab | Berkeley, Ca

Senior Data Engineer (Microsoft Azure)

@ Capco | UK - London

Senior Data Analyst

@ Publicis Groupe | Bengaluru, India

Senior Data Engineer

@ Press Ganey | Chicago, IL, United States

Senior Data Scientist (remote from EU)

@ PriceHubble | Vienna, Vienna, Austria - Remote

Data Science Co-op

@ Novelis | Atlanta, GA, United States