all AI news
The Tokenizer Playground
March 19, 2024, 2:18 a.m. |
Simon Willison's Weblog simonwillison.net
I built a tool like this a while ago, but this one is much better: it provides an interface for experimenting with tokenizers from a wide range of model architectures, including Llama, Claude, Mistral and Grok-1 - all running in the browser using Transformers.js.
Via @xenovacom
ai architectures browser claude generativeai grok llama llms mistral playground running the browser tool transformers via
More from simonwillison.net / Simon Willison's Weblog
How an empty S3 bucket can make your AWS bill explode
1 day, 14 hours ago |
simonwillison.net
My approach to HTML web components
1 day, 15 hours ago |
simonwillison.net
Why SQLite Uses Bytecode
1 day, 20 hours ago |
simonwillison.net
Jobs in AI, ML, Big Data
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Data Scientist
@ Publicis Groupe | New York City, United States
Bigdata Cloud Developer - Spark - Assistant Manager
@ State Street | Hyderabad, India