June 2, 2023, 11:53 p.m. | /u/Mbando

Natural Language Processing www.reddit.com

Are there heuristics for estimating training costs (or training hours by GPU) for fine tuning models? If I want to train a 7b parameter model on 890m tokens, how do I even ballpark that?

costs fine-tuning gpu heuristics languagetechnology tokens training training costs

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

C003549 Data Analyst (NS) - MON 13 May

@ EMW, Inc. | Braine-l'Alleud, Wallonia, Belgium

Marketing Decision Scientist

@ Meta | Menlo Park, CA | New York City