Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Qwen2.5-7B-Instruct-quantized.w8a8
like
2
Follow
Red Hat AI
1.76k
Text Generation
Safetensors
32 languages
qwen2
qwen
qwen2_5
qwen2_5_instruct
w8a8
int8
vllm
conversational
text-generation-inference
compressed-tensors
8-bit precision
arxiv:
2211.10438
arxiv:
2210.17323
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
2
Deploy
Use this model
ef83fcc
Qwen2.5-7B-Instruct-quantized.w8a8
Commit History
Update README.md
ef83fcc
verified
robgreenberg3
commited on
May 30, 2025
Update README.md (
#2
)
d08f739
verified
robgreenberg3
commited on
May 20, 2025
Update README.md
750b734
verified
alexmarques
commited on
May 14, 2025
Create README.md
4689c1b
verified
alexmarques
commited on
Apr 16, 2025
Upload folder using huggingface_hub
9f62e45
verified
alexmarques
commited on
Oct 9, 2024
initial commit
4b27a9c
verified
alexmarques
commited on
Oct 9, 2024