all AI news
MLP-Mixer Interpretability [D][R]
Nov. 15, 2023, 1:05 p.m. | /u/reverendCappuccino
Machine Learning www.reddit.com
I am just looking for materials and papers to interpret the features learnt by MLP-Mixer models.
For ConvNets we can plot convolutional kernels and pattern that maximally activate units, so we have at least a vague idea of what the net captures and responds to.
For Vision Transformers, linear embedding is analogue to the first conv layer and we can still see things such as color blurs, edge detectors, color filters. For self-supervised pretrained models we sometimes see …
embedding features hello interpretability least linear machinelearning materials mlp plot transformers units vision vision transformers
More from www.reddit.com / Machine Learning
Jobs in AI, ML, Big Data
Machine Learning Postdoctoral Fellow
@ Lawrence Berkeley National Lab | Berkeley, Ca
Senior Data Engineer (Microsoft Azure)
@ Capco | UK - London
Senior Data Analyst
@ Publicis Groupe | Bengaluru, India
Senior Data Engineer
@ Press Ganey | Chicago, IL, United States
Senior Data Scientist (remote from EU)
@ PriceHubble | Vienna, Vienna, Austria - Remote
Data Science Co-op
@ Novelis | Atlanta, GA, United States