[R]PFAS might be a better embedding space for words compared to vectors and possibly even more compute efficient

https://huggingface.co/blog/TuringsSolutions/pfafresearch

So this blog went over most peoples heads but basically it captures a lot more information of words compared to vectors it actually seems like it could potentially be better then vectors when scaled up. It has more dimensionality compared to vectors. Other geometric representations are being looked into as well like triangle space, square space and more to find the optimal geometric encoding for word relationships that might be better at modeling information compared to vectors. It has …

blog dimensionality information machinelearning space square vectors words