The Easiest Ways to Run LLMs Locally - Docker Model Runner Tutorial

Download Docker Desktop: https://docs.docker.com/desktop/ Docker Model Runner Docs: https://docs.docker.com/ai/model-runner/

Great video! Thanks Tim! As someone who was a very poor coder five years ago and worked only in research making simple scripts, your videos have really helped me expand my knowledge in so many different areas!

This was exactly what I needed after struggling to get decent perfs on Windows with an AMD card. Running the container on the underlying Linux looks to be the way to go.

Thanks Tim...always great stuff. I know your typical audience is more "current" in dev tools and patterns, but if you ever decide to expand your reach, I think a series or even channel focused on those of us who coded years ago, and are now returning thanks to the fun and efficiency of JIT learning with AI would be a hit. A _coding with and for AI for dummies_ would have at least 1 sub. Thanks again for all the great content.

Thank you for this video. Much needed. Please make a video on using local LLM model from docker model runner in goose ai desktop(window).

Thanks Tim, as always very clear...

Thank you very much. Your video is very useful.

Thanks Tim, very neat!

Love it❤ thanks for sharing

This is a huge shift for local AI workflows I’ve been managing prompt logic with Genum AI and having something like Docker’s model runner just makes it way easier to keep everything self-contained and production-ready anyone else setting up local stacks like this?