GPUs on Fly.io are available to everyone!

GPUs on Fly.io are available to everyone!

We've been experimenting with GPUs on Fly for a few months for Datasette Cloud. They're well documented and quite easy to use - any example Python code you find that uses NVIDIA CUDA stuff generally Just Works. Most interestingly of all, Fly GPUs can scale to zero - so while they cost $2.50/hr for a A100 40G (VRAM) and $3.50/hr for a A100 80G you can configure them to stop running when the …

ai cloud code cuda datasette datasettecloud easy example fly generativeai gpus llms nvidia nvidia cuda python scale whisper