Brainstorming // Semantic similarity of text

Hey everyone, as part of a project (data cannot be disclosed) I am comparing around 5000 sentences by their semantic content. The aim is to find pairs / groups of sentences with an exact or almost exact content. The sentences are all very domain heavy and often contain similar words in different contexts. Creating tf-idf vectors and grouping with cosine similarity works somewhat okay. Word frequency clustering did dnot work well, as many of the domain specific works are dominating …

aim cluster clustering data hey languagetechnology part project semantic text tf-idf vectors words work