New ask Hacker News story: Ask HN: Local RAG with private knowledge base

Ask HN: Local RAG with private knowledge base
2 by zephodb | 0 comments on Hacker News.
Looking for a free, local, open source RAG solution for running a reference library with 1000s of technical PDFs and word docs. Tried the Ollama + open webui, Ollama+Anything LLM with opensource models such as Llama3.2 etc. As expected the more documents we feed the lower the accuracy. Doing it for a bunch of senior citizens who still love geeking out.

Comments

Popular posts from this blog

How can Utilize Call Center Outsourcing for Increase your Business Income well?

New ask Hacker News story: Is someone trying to steal credit for inventing the eTicket?