Can I run this on my laptop.
Is there any LLM models that are neatly wrapped as an app I can run on windows ?
back
1 comments
KoboldCPP.
Just keep in mind that you need to properly format the chat, and that better finetunes will be available in ~2 weeks.