all AI news
MLP-Mixer Interpretability [D][R]
Nov. 15, 2023, 1:05 p.m. | /u/reverendCappuccino
Machine Learning www.reddit.com
I am just looking for materials and papers to interpret the features learnt by MLP-Mixer models.
For ConvNets we can plot convolutional kernels and pattern that maximally activate units, so we have at least a vague idea of what the net captures and responds to.
For Vision Transformers, linear embedding is analogue to the first conv layer and we can still see things such as color blurs, edge detectors, color filters. For self-supervised pretrained models we sometimes see …
embedding features hello interpretability least linear machinelearning materials mlp plot transformers units vision vision transformers
More from www.reddit.com / Machine Learning
[D] software to design figures
11 hours ago |
www.reddit.com
[Discussion] Should I go to ICML and present my paper?
1 day, 5 hours ago |
www.reddit.com
Jobs in AI, ML, Big Data
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Lead Data Modeler
@ Sherwin-Williams | Cleveland, OH, United States