Update README.md
Browse files
README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
-
# Llama 3.2 1B MLA - Multi-head Latent Attention Model
|
| 5 |
|
| 6 |
This repository contains a version of Llama 3.2 1B converted to use Multi-head Latent Attention (MLA) instead of Group Query Attention (GQA).
|
| 7 |
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
+
# Llama 3.2 1B MLA - Multi-head Latent Attention Model (Experimental)
|
| 5 |
|
| 6 |
This repository contains a version of Llama 3.2 1B converted to use Multi-head Latent Attention (MLA) instead of Group Query Attention (GQA).
|
| 7 |
|