I decided my 10-year-old mini PC hadn’t suffered enough, so I made it run a local LLM
www.makeuseof.com/my-old-mini-pc-hadnt-suffered-enough-so-i-made-it-run-a-local-llm/
- My smallest model made some surprisingly big mistakes. Larger models improved the answers, but I still need to checked them
- I ran out of patience before I ran out of RAM. The models fit comfortably, but short answers could take minutes
- I’m retiring this setup, but I’m just getting started with local AI. The Zotac helped me decide whether better hardware would be worth exploring