New ask Hacker News story: Run Google Gemma 2 2B 100% Locally

Run Google Gemma 2 2B 100% Locally
4 by esleightholm | 3 comments on Hacker News.
Google just released Gemma 2 2B and you can run it on Mac (and other devices), 100% local, powered by llama.cpp! 1. brew install llama.cpp 2. ./llama-cli --hf-repo google/gemma-2-2b-it-GGUF \ --hf-file 2b_it_v2.gguf \ -p "Write a poem about cats as a labrador" -cnv With this, I created a Local RAG Knowledge and Answering System with Google Gemma 2 2B and Marqo. Check it out: https://ift.tt/mzk6C0c Link also in the comments!

Comments

Post a Comment

Popular posts from this blog

New ask Hacker News story: Brother Printers Sending Ink Data to Amazon?

Brother Printers Sending Ink Data to Amazon? 29 by Ajay-p | 13 comments on Hacker News. A most unusual thing. Every once in a while I get an email from Amazon that it's time to re-order Brother ink. I always delete these because I rarely print, but also figure it's just Amazon reminding me to buy something. Today I decided to opt out/unsubscribe once and for all. Instead I see this at the bottom of the email: "Click here to view or manage settings, including the option to opt out if you are already using another replenishment service. This took me to https://ift.tt/nMGIXiy "The data shown is based on estimated consumption reported by smart devices and orders you place through Amazon." Here it had a link to "Consumption history" which upon clicking showed me the ink levels of my Brother printer for the past two weeks . Date and time. WTF?! It is not apparent that I can disable this function. Can anyone else duplicate? Update : This is part of Alexa it
Read more

New ask Hacker News story: Tell HN: Equifax free credit report dark patterns

Tell HN: Equifax free credit report dark patterns 4 by PopAlongKid | 0 comments on Hacker News. For years, I have been obtaining free annual credit reports (annualcreditreport.com) which must be provided by law. Recently, for the first time, when I tried to obtain my Equifax report, I was prompted for an email address and a mobile phone number, a new requirement that apparently cannot be bypassed. The other two bureaus, and Equifax previously, confirmed identity by asking knowledge based questions. They do not need my phone or email for anything. Next, trying to obtain the report by phone instead of web site per instructions, I got to the point where I entered my ZIP code on the phone keypad, the voice menu system correctly repeated the number back to me, but every time I press 1 to indicate it is correct, the system acts like it got an invalid response and only gives me the option to enter further information by voice, not by the phone keypad. Just as with my phone number and email
Read more