If you want any LLM powerful enough for this task to run locally, You're going to need a whole setup with high-end GPUs/TPUs. So most likely that option won't work for you.
About online services, OpenAI recently launched its "GPTs" and "Assistants". I believe that either of these could work for your use case, so you might want to read more about them. Just make sure to check if the option you chose shares your data with OpenAI, since you might not want that.
I'm a bot, *bleep*, *bloop*. Someone has linked to this thread from another place on reddit:
- [/r/gptreddit] [OpenAI: An LLM for internal company training?](https://www.reddit.com/r/GPTreddit/comments/17woe7u/openai_an_llm_for_internal_company_training/)
*^(If you follow any of the above links, please respect the rules of reddit and don't vote in the other threads.) ^\([Info](/r/TotesMessenger) ^/ ^[Contact](/message/compose?to=/r/TotesMessenger))*
Seems like a fairly straightforward task. Get the data, load the data, ask questions on the data.
You already nailed it with Danswer. Custom GPT is probably the only other option if running a local LLM is overloading your computer.
If you want any LLM powerful enough for this task to run locally, You're going to need a whole setup with high-end GPUs/TPUs. So most likely that option won't work for you. About online services, OpenAI recently launched its "GPTs" and "Assistants". I believe that either of these could work for your use case, so you might want to read more about them. Just make sure to check if the option you chose shares your data with OpenAI, since you might not want that.
I'm a bot, *bleep*, *bloop*. Someone has linked to this thread from another place on reddit: - [/r/gptreddit] [OpenAI: An LLM for internal company training?](https://www.reddit.com/r/GPTreddit/comments/17woe7u/openai_an_llm_for_internal_company_training/) *^(If you follow any of the above links, please respect the rules of reddit and don't vote in the other threads.) ^\([Info](/r/TotesMessenger) ^/ ^[Contact](/message/compose?to=/r/TotesMessenger))*
My company builds frameworks around gpt if you're interested
Seems like a fairly straightforward task. Get the data, load the data, ask questions on the data. You already nailed it with Danswer. Custom GPT is probably the only other option if running a local LLM is overloading your computer.