This AI Model Runs On Your Phone (With No Internet)!

For those of you wondering about an Android option...AnythingLLM will let you run models either directly on your phone, _or_ have your phone make use of your desktop PC and all its compute power. Either way "offline" in the sense that they're not dependent on cloud services. You're welcome.

For the adventurous types this could be the start of back up survival app or first aid app, all that’s required is a solar or mechanical charging and it’s the off grid encyclopaedia of everything.

Would be interesting to see performance metrics (CPU, GPU and RAM usage) while running these.

You know there's gonna be stories of things like this soon: "How do I stop the hijackers on my plane? Make no mistakes! 100 words or less!"

This will be very handy for zombie apocalypse.

I love this kind of simple practical information

Can I ask it "what the dog doin'?"

Having an offline LLM would be so helpful during a zombie apocalypse when there is a global internet outage. For information like first aid, how to light a fire, which areas to look for supplies, food, weapons, etc. And if you are running low on juice, all you need is a solar power battery.

It runs great on my new iPad Pro 13 inch M5. Now all we need is for it to generate images and videos.🥰

Thanks, Matt! I was waiting to hear details of this news from you. You explain it best!