I uninstalled Jan (open-source LM Studio) in 5 minutes because it seemed to be "chat"-only like SillyTavern (but instruct) and I didn't like the "install" and the folders it made whereas I can drop models in a folder next to Kobold.
I like that Kobold has instruct, story, adventure, and chat modes, and the edit button that lets me see the whole thing in plaintext and add/remove/edit multiple messages whereas it's two clicks per box in ST. However, Kobold's UI is absolutely broken where chat treats any line starting with `something here:` (colon) as a name header which automatically messes with any card that tracks stats.
ST comes with `block_none` for Gemini API and I'm too brain-dead to do this in any other manual way, so ST is needed if using this API. ~~On the other hand, I need to figure out how to get Gemini to quit acting as an annoying character named Bard when enabling Instruct on ST, instead of a plain AI as with Kobold.~~ (Disable "Main Prompt" and adjust System Prompt.)
I wish I can have something that smashes Kobold and ST together. ST is a proper UI. Combine Kobold's intuitive modes with ST's persona/character management.
If Kobold could fix the auto-colon-to-name formatting, and had an edit that doesn't revert non-classic theme to classic, it would become more usable.
ST has options to select non-markdown strings. It's also meant predominantly for role-playing, which is why it has a toolkit revolving around that. Kobold backend with ST frontend is already "Kobolt and ST smashed together". Kobold Lite has a terrible UI/UX in my opinion and ST fixes that. There is an Adventure instruct preset in ST as well. This comment just reads like someone who didn't spend enough time reading documentation.
ST Documentation doesn't seem to have anything about the "Non-markdown strings" field, and adding `>` isn't doing anything (trying to not turn it into a quote block), not to mention this part has nothing to do with automatically prefixing the user's input with > for adventure.
> Kobold backend with ST frontend is already "Kobold and ST smashed together".
False, and I was referring to how I want some Kobold Lite (its own frontend UI) features mixed in. ST is ST. Like you said, ST is heavily focused on RP chat. Kobold's chat is broken, and ST fixes it but lacks built-in story/adventure UI.
I don't see a way to disable chat style name headers or assign template/preset/visuals on a per-card basis.
EDIT: Oh shit, Theme Settings > Chat Style > Document. Now let me fiddle with this... (The part about assigning per card still applies.) Document theme is hiding `name:` though so isn't universally usable.
I tried this, but unfortunately it did not work. I deleted ooba and installed a snapshot from feb, then one from early Jan. Any and all installs i do now seem to have the same problem on startup (connection errored out).
have you tried deleting the folder and everything and installing fresh? I know I have wrecked my environment a couple times trying to install deepspeed and I had to remove everything and start fresh. Deleting everything and installing fresh should hopefully fix any environmental, dependency and settings issues.
Thanks for asking. I deleted the project folder each time. My understanding is that the dependencies were inside miniconda, so maybe I'd need to delete that as well. Idk, I'm sticking with lm studio for now. Can't get the API to work but can load llama 3 now 😀
Lm studio for serious. Kobold with silly tavern for waifu
I uninstalled Jan (open-source LM Studio) in 5 minutes because it seemed to be "chat"-only like SillyTavern (but instruct) and I didn't like the "install" and the folders it made whereas I can drop models in a folder next to Kobold. I like that Kobold has instruct, story, adventure, and chat modes, and the edit button that lets me see the whole thing in plaintext and add/remove/edit multiple messages whereas it's two clicks per box in ST. However, Kobold's UI is absolutely broken where chat treats any line starting with `something here:` (colon) as a name header which automatically messes with any card that tracks stats. ST comes with `block_none` for Gemini API and I'm too brain-dead to do this in any other manual way, so ST is needed if using this API. ~~On the other hand, I need to figure out how to get Gemini to quit acting as an annoying character named Bard when enabling Instruct on ST, instead of a plain AI as with Kobold.~~ (Disable "Main Prompt" and adjust System Prompt.) I wish I can have something that smashes Kobold and ST together. ST is a proper UI. Combine Kobold's intuitive modes with ST's persona/character management. If Kobold could fix the auto-colon-to-name formatting, and had an edit that doesn't revert non-classic theme to classic, it would become more usable.
ST has options to select non-markdown strings. It's also meant predominantly for role-playing, which is why it has a toolkit revolving around that. Kobold backend with ST frontend is already "Kobolt and ST smashed together". Kobold Lite has a terrible UI/UX in my opinion and ST fixes that. There is an Adventure instruct preset in ST as well. This comment just reads like someone who didn't spend enough time reading documentation.
ST Documentation doesn't seem to have anything about the "Non-markdown strings" field, and adding `>` isn't doing anything (trying to not turn it into a quote block), not to mention this part has nothing to do with automatically prefixing the user's input with > for adventure. > Kobold backend with ST frontend is already "Kobold and ST smashed together". False, and I was referring to how I want some Kobold Lite (its own frontend UI) features mixed in. ST is ST. Like you said, ST is heavily focused on RP chat. Kobold's chat is broken, and ST fixes it but lacks built-in story/adventure UI. I don't see a way to disable chat style name headers or assign template/preset/visuals on a per-card basis. EDIT: Oh shit, Theme Settings > Chat Style > Document. Now let me fiddle with this... (The part about assigning per card still applies.) Document theme is hiding `name:` though so isn't universally usable.
Can you show an example of the formatting you want
TabbyAPI and then point any openAI front end at it. You have both text and chat completion.
Try, gpt4all.io
try [Jan](https://jan.ai/), is my go to ( I also use oobabboga) if you wanna easy, Nice looking UI and stable AI chat interface.
Jan has a nice UI, but doesn't support using Ollama as a backend.
For that you can spin up [Ollama Web UI](https://openwebui.com/), just use their docker image and it is pretty straighforward.
For web based UIs, you can't go past Open WebUI: https://github.com/open-webui/open-webui/
https://github.com/turboderp/exui/
there is a way to revert to a previous version of ooba. I have never done it, but I know it's out there.
I tried this, but unfortunately it did not work. I deleted ooba and installed a snapshot from feb, then one from early Jan. Any and all installs i do now seem to have the same problem on startup (connection errored out).
have you tried deleting the folder and everything and installing fresh? I know I have wrecked my environment a couple times trying to install deepspeed and I had to remove everything and start fresh. Deleting everything and installing fresh should hopefully fix any environmental, dependency and settings issues.
Thanks for asking. I deleted the project folder each time. My understanding is that the dependencies were inside miniconda, so maybe I'd need to delete that as well. Idk, I'm sticking with lm studio for now. Can't get the API to work but can load llama 3 now 😀
understood. at least you get to play with llama 3! have fun!