Original model: Soulbound-8B by Akashiurahara
Available ExLlamaV3 0.0.16 quants
| Type | Size | CLI |
|---|---|---|
| H8-4.0BPW | 5.09 GB | Copy-paste the line / Download the batch file |
| H8-6.0BPW | 6.83 GB | Copy-paste the line / Download the batch file |
| H8-8.0BPW | 8.58 GB | Copy-paste the line / Download the batch file |
Requirements: A python installation with huggingface-hub module to use CLI.