Hugging Face's logo

Inference Optimization
community
Activity Feed

AI & ML interests

None defined yet.

Recent Activity

ChibuUkachi  updated a model 2 days ago
inference-optimization/Qwen3-4B-Thinking-2507.w4a16
krishnateja95  updated a model 2 days ago
inference-optimization/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head
ChibuUkachi  updated a model 2 days ago
inference-optimization/Qwen3-30B-A3B-Instruct-2507.w4a16
View all activity

inference-optimization 's collections 2

Mixed Precision Models
Collection of Mixed Precision LLaMA and Qwen Models
KV Cache Quantization
Collection on FP8 Quantization of Weights, Activations and KV Cache
Mixed Precision Models
Collection of Mixed Precision LLaMA and Qwen Models
KV Cache Quantization
Collection on FP8 Quantization of Weights, Activations and KV Cache