New FOSS All-Local AI with Ollama, Gemma 2, and Fabric
Seriously smart all-local AI with excellant documentation and clear well-commented code: https://github.com/MikeyBeez/RAGAgent.
Seriously smart all-local AI with excellant documentation and clear well-commented code: https://github.com/MikeyBeez/RAGAgent.
If you're on macOS, check out the MLX community: https://huggingface.co/mlx-community - Ollama not needed, potentially more efficient(?). The Gemma 2 27B model was broken as of a few days ago, but a fix is already committed and underway to the pip repo. Gemma 2 9B works directly.
This was not submitted as a link so you can't click on it. That doesn't really follow the HN convention.
PS: Personally I prefer ollama + openwebui <3 For its extensibility. Though I like the playful approach here.
Gemma2 isn't FOSS, it has a rather peculiar license.
See also: https://x.com/justinetunney/status/1808165898743878108