Web: https://www.reddit.com/r/MachineLearning/comments/xkk9q9/d_viterbi_or_beam_search_should_not_be_used_for/

Sept. 21, 2022, 11:13 p.m. | /u/markpwoodward

Machine Learning reddit.com

Unless there are some constraints on the output sequence (like a dictionary) or transition probabilities (like a very simple p(x\_{t+1}|x\_t) language model), the path that maximizes the probability over the logits is the path that goes through the symbol with the max logit for each time step.

So Viterbi and beam search (unless you are very unlucky) will just return argmax(logits, axis=1), where logits has shape (input\_time\_steps, num symbols).

Yet, I see lectures encouraging students to use Viterbi or beam …

inference machinelearning search

Postdoctoral Fellow: ML for autonomous materials discovery

@ Lawrence Berkeley National Lab | Berkeley, CA

Research Scientists

@ ODU Research Foundation | Norfolk, Virginia

Embedded Systems Engineer (Robotics)

@ Neo Cybernetica | Bedford, New Hampshire

2023 Luis J. Alvarez and Admiral Grace M. Hopper Postdoc Fellowship in Computing Sciences

@ Lawrence Berkeley National Lab | San Francisco, CA

Senior Manager Data Scientist

@ NAV | Remote, US

Senior AI Research Scientist

@ Earth Species Project | Remote anywhere

Research Fellow- Center for Security and Emerging Technology (Multiple Opportunities)

@ University of California Davis | Washington, DC

Staff Fellow - Data Scientist

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

Staff Fellow - Senior Data Engineer

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

Research Engineer - VFX, Neural Compositing

@ Flawless | Los Angeles, California, United States

[Job-TB] Senior Data Engineer

@ CI&T | Brazil

Data Analytics Engineer

@ The Fork | Paris, France