New ask Hacker News story: Ask HN: Best on device LLM tooling for PDFs?

Ask HN: Best on device LLM tooling for PDFs?
2 by martinald | 1 comments on Hacker News.
I've got very used to using the "big" LLMs for analysing PDFs Now llama.cpp has vision support; I tried out PDFs with it locally (via LM Studio) but the results weren't as good as I hoped for. One time it insisted it couldn't do "OCR", but gave me an example of what the data _could_ look like - which was the data. The other major problem is sometimes PDFs are actually made up of images; and it got super confused on those as well. Given this is so new I'm struggling to find any tools which make this easier.

Comments

Popular posts from this blog

How can Utilize Call Center Outsourcing for Increase your Business Income well?

New ask Hacker News story: Is someone trying to steal credit for inventing the eTicket?