Version 0.3b
In the "OFFLINE AI" folder, there is a "GGML.exe" that works on port 5001 (based on LostRuins/koboldcpp).
"Harlen", New example character in Pygmalion format, should also work with other models too.
Words for substitution need to have a "$" in front (e.g., $NAME).
You can delete error messages.
Minor fixes.
To run an offline language model:
Open the "OFFLINE AI" folder.
Run "GGML.exe".
Select the ".bin" model.
Run "GPTits.exe".
Change the "Operation Mode" to "External URL".
Use the URL: "http://localhost:5001/api/v1/generate"
Tested models:
ggml-vic13b-uncensored-q4_0.bin
Link: https://huggingface.co/vicuna/ggml-vicuna-13b-1.1/tree/main
pygmalion-6b-v3-ggml-ggjt-q4_0.bin
Link: https://huggingface.co/concedo/pygmalion-6bv3-ggml-ggjt/tree/main
If you have good results with any other model, please share it with us on Discord.