Have there been fruitful attempts to decode sentence embeddings?

Web: https://www.reddit.com/r/LanguageTechnology/comments/vi5jwd/have_there_been_fruitful_attempts_to_decode/

When producing sentence embeddings (e.g. with `sentence-transformers`), I've been wondering if there have been some successful attempts to decode such embeddings.

I understand that this isn't trivial to achieve because of the pooling-layer. but decoding sentence embeddings could be extremely valuable for a wide variety of use cases such as text summation.

Any interesting research or projects to share on this topic?

languagetechnology