ysn-rfd/chatbench-llama3-8b-GGUF

chatbench-llama3-8b

Model creator: microsoft
Original model: microsoft/chatbench-llama3-8b
GGUF quantization: provided by ysn-rfd using llama.cpp

Special thanks

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

ollama run "hf.co/ysn-rfd/chatbench-llama3-8b-GGUF:Q5_0"

Use with LM Studio

lms load "ysn-rfd/chatbench-llama3-8b-GGUF"

Use with llama.cpp CLI

llama-cli --hf "ysn-rfd/chatbench-llama3-8b-GGUF:Q5_0" -p "The meaning to life and the universe is"

Use with llama.cpp Server:

llama-server --hf "ysn-rfd/chatbench-llama3-8b-GGUF:Q5_0" -c 4096