all AI news
The power of two random choices, visualized
Feb. 6, 2024, 10:21 p.m. |
Simon Willison's Weblog simonwillison.net
The power of two random choices, visualized
Grant Slatton shares a visualization illustrating "a favorite load balancing technique at AWS": pick two nodes at random and then send the task to whichever of those two has the lowest current load score.
Why just two nodes? "The function grows logarithmically, so it's a big jump from 1 to 2 and then tapers off *real* quick."
aws big current function grant power random scaling shares visualization
More from simonwillison.net / Simon Willison's Weblog
What You Need to Know about Modern CSS (Spring 2024 Edition)
2 days, 3 hours ago |
simonwillison.net
I'm writing a new vector search SQLite Extension
4 days, 14 hours ago |
simonwillison.net
Jobs in AI, ML, Big Data
Lead Developer (AI)
@ Cere Network | San Francisco, US
Research Engineer
@ Allora Labs | Remote
Ecosystem Manager
@ Allora Labs | Remote
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote