Feb. 25, 2024, 8:01 p.m. | /u/khaliiil

Natural Language Processing www.reddit.com

For example:
Suppose I have this text as input: "my name"
Why does the gpt do a forward pass for each token ( it would start by token and then try to predict my then do the same for name etc).

*Why does it try to predict an information that it already has?*

Why not pass "my name" as input and only then try to predict the next token?

decoder example gpt languagetechnology next prompt text the decoder the prompt token transformer transformer models

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US

Research Engineer

@ Allora Labs | Remote

Ecosystem Manager

@ Allora Labs | Remote

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US