May 23, 2024, 5:01 p.m. | Sophia Parafina

DEV Community dev.to

From the ollama help discord channel:



Docker compose: How do you pull a model automatically with container creation?



The conundrum of containerizing Ollama is that it must be running to pull a model. If you run ollama using docker compose, it doesn't provide a way to pull a model from the ollama registry. What's a budding generative AI nerd to do?


The answer is more docker compose, as in docker compose exec, which runs a script to download a model. …

compose discord docker generative nerd ollama registry running

AI Focused Biochemistry Postdoctoral Fellow

@ Lawrence Berkeley National Lab | Berkeley, CA

Senior Data Engineer

@ Displate | Warsaw

Solutions Engineer

@ Stability AI | United States

Lead BizOps Engineer

@ Mastercard | O'Fallon, Missouri (Main Campus)

Senior Solution Architect

@ Cognite | Kuala Lumpur

Senior Front-end Engineer

@ Cognite | Bengaluru