Nov. 6, 2022, 1:38 a.m. | /u/ethiopianboson

Natural Language Processing www.reddit.com

I was watching a tutorial for spacy. There code (which I put below doesn't make it clear which type of word embedding is used). They were able to find word similarity between words with scores.

​

​

nlp = spacy.load("en\_core\_web\_md") **with** open ("data/wiki\_us.txt", "r") **as** f: text = f.read() doc = nlp(text) sentence1 = list(doc.sents)\[0\]

your\_word = "dog" ms = nlp.vocab.vectors.most\_similar( np.asarray(\[nlp.vocab.vectors\[nlp.vocab.strings\[your\_word\]\]\]), n=10) words = \[nlp.vocab.strings\[w\] **for** w **in** ms\[0\]\[0\]\] distances = ms\[2\] print(words)

​

*# Similarity of tokens and …

bert embedding languagetechnology spacy type word2vec

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

DevOps Engineer (Data Team)

@ Reward Gateway | Sofia/Plovdiv