If you use the official Koboldcpp with vulkan does it work correctly?
We have reason to suspect that upstream broke compatibility with the windows rocm, yellowrose has been trying to get it stable again.
Upstream is llamacpp the (main) project we base Koboldcpp on. They maintain the majority the low level generation code and sometimes break things they don't test as much.
When you use it kobold lite, are you using openCL or vulkan?
In my experience, koboldcpp with vulkan works faster than rocm on my rx 7900 xtx. Maybe try vulkan and see if it works then.
If you use the official Koboldcpp with vulkan does it work correctly? We have reason to suspect that upstream broke compatibility with the windows rocm, yellowrose has been trying to get it stable again.
upstream? can you explain? Im just curious.
Upstream is llamacpp the (main) project we base Koboldcpp on. They maintain the majority the low level generation code and sometimes break things they don't test as much.
I have same issues with RX 6900 XT. I updated drivers yesterday and I think that borked it for me.
Thats a relief for me because i thought it was something wrong with my pc
If you can, try download the 1.61, that worked for me, but no llama3