all AI news
How do I extract a contextualized BERT token embedding from a sentence embedding?
Jan. 13, 2022, 8:17 a.m. | /u/akardashian
Natural Language Processing www.reddit.com
Apologies if this is really simple, I just want to double check. If I have a contextualized representation of a sentence, say "Look at this cat.", and I want to extract the contextualized token representation of "cat", how would I go about doing this?
I was thinking of first extracting the word ID with id = tokenizer.convert_tokens_to_ids(tokenizer.tokenize('cat'))[0], then match the word ID to its token position in the sentence with tok_index = input_ids.index(id). Later, after passing the sentence through the …
!-->More from www.reddit.com / Natural Language Processing
What Do You Love About NLP?
1 day, 11 hours ago |
www.reddit.com
How to Install and Deploy LLaMA 3 Into Production
2 days, 4 hours ago |
www.reddit.com
The Languages AI Is Leaving Behind
5 days, 4 hours ago |
www.reddit.com
NLP: building a sentiment model
6 days, 1 hour ago |
www.reddit.com
ReFT: Representation Finetuning for Language Models
1 week, 6 days ago |
www.reddit.com
Jobs in AI, ML, Big Data
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Staff Software Engineer, Generative AI, Google Cloud AI
@ Google | Mountain View, CA, USA; Sunnyvale, CA, USA
Expert Data Sciences
@ Gainwell Technologies | Any city, CO, US, 99999