MaziyarPanahi
/

Llama-3-70B-Instruct-v0.1-GGUF

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions

Llama-3-70B-Instruct-v0.1-GGUF

368 GB

1 contributor

History: 4 commits

MaziyarPanahi's picture

Update README.md (#3)

00907f1 verified over 1 year ago

.gitattributes

3.69 kB

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q2_K.gguf

26.4 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q3_K_L.gguf

37.1 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q3_K_M.gguf

34.3 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q3_K_S.gguf

30.9 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q4_K_M.gguf

42.5 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q4_K_S.gguf

40.3 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_M.gguf-00001-of-00006.gguf

9.32 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_M.gguf-00002-of-00006.gguf

8.72 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_M.gguf-00003-of-00006.gguf

8.56 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_M.gguf-00004-of-00006.gguf

8.42 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_M.gguf-00005-of-00006.gguf

8.48 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_M.gguf-00006-of-00006.gguf

6.45 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_S.gguf-00001-of-00006.gguf

8.97 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_S.gguf-00002-of-00006.gguf

8.56 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_S.gguf-00003-of-00006.gguf

8.4 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_S.gguf-00004-of-00006.gguf

8.29 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_S.gguf-00005-of-00006.gguf

8.29 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q5_K_S.gguf-00006-of-00006.gguf

6.16 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q6_K.gguf-00001-of-00006.gguf

10.7 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q6_K.gguf-00002-of-00006.gguf

10.2 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q6_K.gguf-00003-of-00006.gguf

10 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q6_K.gguf-00004-of-00006.gguf

9.89 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q6_K.gguf-00005-of-00006.gguf

9.89 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
Llama-3-70B-Instruct-v0.1.Q6_K.gguf-00006-of-00006.gguf

7.18 GB
xet

Upload folder using huggingface_hub (#1) over 1 year ago
README.md

3.09 kB

Update README.md (#3) over 1 year ago
imatrix.dat

24.9 MB
xet

Upload folder using huggingface_hub (#1) over 1 year ago