Sugoi LLM 14B 32B Download links
I already created some tutorials for how to run these two models locally with ollama and LM Studio. I'll add tutorial for oobabooga soon and
I already created some tutorials for how to run these two models locally with ollama and LM Studio. I'll add tutorial for oobabooga soon and also how to link these setups with Sugoi Toolkit
14B gguf q4_k_m:
https://sugoi-file.sfo3.cdn.digitaloceanspaces.com/sugoi14b.gguf
32B gguf q4_k_m:
https://sugoi-file.sfo3.cdn.digitaloceanspaces.com/sugoi32b.gguf
Connect with LM Studio
https://blog.sugoitoolkit.com/tutorial-sugoi-llm-14b-and-32b/
Connect with Ollama
https://blog.sugoitoolkit.com/sugoi-llm-14b-32b-with-ollama/
Connect with Oobabooga
https://blog.sugoitoolkit.com/sugoi-llm-14b-32b-with-lm-studio/
Connect with Sugoi Toolkit (after you use either of the programs above)
https://blog.sugoitoolkit.com/connecting-sugoi-14b-32b-to-sugoi-toolkit/
If you found anything interesting, feel free to share on our Discord server so everyone can learn from it
Comments (3)
Trying them out now, thanks!
Been waiting for this for a while, really surprised to see they are already in gguf format so i don't have to convert them for llama.cpp. Since I only have 12GB of vram I'll have to figure out how to quantize a bit... Are the models already uncensored? Or should I do an abliteration pass? In any case, thanks a lot!
All the models are uncensored
