grimlockcel
Whitepill Jedi
★★★★★
- Joined
- Dec 11, 2025
- Posts
- 4,190
- Online time
- 1d 9h
Okay I recently have been looking into Locally ran offline ai LLM's. If you aren't familiar it's an ai chatbot that can be ran on a consumer grade device no cost, no internet and uncensored/based.
You can run some on your phone which is what I am going to explain. So basically if you have a decent phone, Iphone 11 - Iphone17, or the Android equivalent of those and anything in between, you can run a very capable AI model with no internet. The one I recommend you use is "Huihui-Qwen3-4B-Instruct-2507-abliterated-GGUF".
This one is essentially a fully modified/uncensored version of its base model, meaning you can talk about literally anything with it I believe and its smart enough to solve a lot of math equations and give advice, for example if you told it, "I am stuck on an island with no internet just my phone and a solar battery charger how can I survive?" it would actually give you good advice and save your life. You wouldn't need to worry about "Oh I have no signal".
Okay so if you want to be able to do this I'll give you a simple tutorial, go on the app store on your phone and download "Enclave" its the one I personally use and press the top left corner menu and then the top right corner + button, then search up the model "Huihui-Qwen3-4B-Instruct-2507-abliterated-GGUF" and it will download, and that's basically it, you can now use it.



You can run some on your phone which is what I am going to explain. So basically if you have a decent phone, Iphone 11 - Iphone17, or the Android equivalent of those and anything in between, you can run a very capable AI model with no internet. The one I recommend you use is "Huihui-Qwen3-4B-Instruct-2507-abliterated-GGUF".
This one is essentially a fully modified/uncensored version of its base model, meaning you can talk about literally anything with it I believe and its smart enough to solve a lot of math equations and give advice, for example if you told it, "I am stuck on an island with no internet just my phone and a solar battery charger how can I survive?" it would actually give you good advice and save your life. You wouldn't need to worry about "Oh I have no signal".
Okay so if you want to be able to do this I'll give you a simple tutorial, go on the app store on your phone and download "Enclave" its the one I personally use and press the top left corner menu and then the top right corner + button, then search up the model "Huihui-Qwen3-4B-Instruct-2507-abliterated-GGUF" and it will download, and that's basically it, you can now use it.





