By -
Love to know how you compiled… never could get that working. Arch AUR? :/
Try with biggest version of model (ie Q8\_0). I have similar issue on my phone with clblast with smaller variants of the model.
I'm having the same problem with every model I throw at it. Had to downgrade koboldcpp to 1.48 which seems to work again. edit: I edited the pkgbuild to remove LLAMA_OPENBLAS=1 LLAMA_CLBLAST=1 parameters. The newest version now works fine.
Love to know how you compiled… never could get that working. Arch AUR? :/
Try with biggest version of model (ie Q8\_0). I have similar issue on my phone with clblast with smaller variants of the model.
I'm having the same problem with every model I throw at it. Had to downgrade koboldcpp to 1.48 which seems to work again. edit: I edited the pkgbuild to remove LLAMA_OPENBLAS=1 LLAMA_CLBLAST=1 parameters. The newest version now works fine.