ubergarm
/

GigaChat3-10B-A1.8B-GGUF

Text Generation

Model card Files Files and versions

GigaChat3-10B-A1.8B-GGUF

33.1 GB

1 contributor

History: 13 commits

ubergarm's picture

add usage tips

32dca8d 18 days ago

images
add a few more small quants 18 days ago
.gitattributes

1.65 kB

requires a PR for llama.cpp check the REAMDE.md 18 days ago
GigaChat3-10B-A1.8B-IQ2_KT.gguf

4.16 GB
xet

Upload GigaChat3-10B-A1.8B-IQ2_KT.gguf with huggingface_hub 18 days ago
GigaChat3-10B-A1.8B-IQ4_KSS.gguf

6.08 GB
xet

Upload GigaChat3-10B-A1.8B-IQ4_KSS.gguf with huggingface_hub 18 days ago
GigaChat3-10B-A1.8B-IQ5_K.gguf

8.16 GB
xet

Upload GigaChat3-10B-A1.8B-IQ5_K.gguf with huggingface_hub 18 days ago
GigaChat3-10B-A1.8B-Q8_0.gguf

11.4 GB
xet

Upload GigaChat3-10B-A1.8B-Q8_0.gguf with huggingface_hub 18 days ago
GigaChat3-10B-A1.8B-smol-IQ1_KT.gguf

3.27 GB
xet

Upload GigaChat3-10B-A1.8B-smol-IQ1_KT.gguf with huggingface_hub 18 days ago
README.md

8.27 kB

add usage tips 18 days ago
imatrix-GigaChat3-10B-A1.8B-BF16.dat

31.6 MB
xet

Upload imatrix-GigaChat3-10B-A1.8B-BF16.dat with huggingface_hub 18 days ago