New ask Hacker News story: Ask HN: Browser-UI with multi-LLM for the team?

Ask HN: Browser-UI with multi-LLM for the team?
2 by tobwen | 1 comments on Hacker News.
I'm looking to provide our 4-person team access to various LLMs, including OpenAI, Anthropic, Meta's Llama, and some others. I want to have browser-based UI (like ChatGPT) to upload files, get Markdown-reponses and have price control to avoid unexpected high costs at the end of the month. My current plan is to purchase API keys from different LLM providers and use LiteLLM as a proxy to setup cost limits OR to use OpenRouter.ai (potentially still using LiteLLM). LibreChat currently doesn't support "passing through" uploads, but this feature is expected to be implemented this week: https://ift.tt/qefScEp My Questions: 1. Is my approach using LiteLLM or OpenRouter with a UI a viable solution? I believe this could be more cost-effective than purchasing monthly chat accounts for each of the four users. 2. Are there other UIs similar to ChatGPT and Anthropic's interfaces, for the case that the new LibreChat attachment feature is too instable?

Comments

Post a Comment

Popular posts from this blog

New ask Hacker News story: Brother Printers Sending Ink Data to Amazon?

Brother Printers Sending Ink Data to Amazon? 29 by Ajay-p | 13 comments on Hacker News. A most unusual thing. Every once in a while I get an email from Amazon that it's time to re-order Brother ink. I always delete these because I rarely print, but also figure it's just Amazon reminding me to buy something. Today I decided to opt out/unsubscribe once and for all. Instead I see this at the bottom of the email: "Click here to view or manage settings, including the option to opt out if you are already using another replenishment service. This took me to https://ift.tt/nMGIXiy "The data shown is based on estimated consumption reported by smart devices and orders you place through Amazon." Here it had a link to "Consumption history" which upon clicking showed me the ink levels of my Brother printer for the past two weeks . Date and time. WTF?! It is not apparent that I can disable this function. Can anyone else duplicate? Update : This is part of Alexa it
Read more

New ask Hacker News story: Tell HN: Equifax free credit report dark patterns

Tell HN: Equifax free credit report dark patterns 4 by PopAlongKid | 0 comments on Hacker News. For years, I have been obtaining free annual credit reports (annualcreditreport.com) which must be provided by law. Recently, for the first time, when I tried to obtain my Equifax report, I was prompted for an email address and a mobile phone number, a new requirement that apparently cannot be bypassed. The other two bureaus, and Equifax previously, confirmed identity by asking knowledge based questions. They do not need my phone or email for anything. Next, trying to obtain the report by phone instead of web site per instructions, I got to the point where I entered my ZIP code on the phone keypad, the voice menu system correctly repeated the number back to me, but every time I press 1 to indicate it is correct, the system acts like it got an invalid response and only gives me the option to enter further information by voice, not by the phone keypad. Just as with my phone number and email
Read more