Add Artificial Analysis evaluations for ministral-3b

#9
by davidlms - opened
Files changed (1) hide show
  1. README.md +53 -3
README.md CHANGED
@@ -16,11 +16,61 @@ license: apache-2.0
16
  inference: false
17
  base_model:
18
  - mistralai/Ministral-3-3B-Base-2512
19
- extra_gated_description: >-
20
- If you want to learn more about how we process your personal data, please read
21
- our <a href="https://mistral.ai/terms/">Privacy Policy</a>.
22
  tags:
23
  - mistral-common
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
24
  ---
25
 
26
  # Ministral 3 3B Instruct 2512
 
16
  inference: false
17
  base_model:
18
  - mistralai/Ministral-3-3B-Base-2512
19
+ extra_gated_description: If you want to learn more about how we process your personal
20
+ data, please read our <a href="https://mistral.ai/terms/">Privacy Policy</a>.
 
21
  tags:
22
  - mistral-common
23
+ model-index:
24
+ - name: Ministral-3-3B-Instruct-2512
25
+ results:
26
+ - task:
27
+ type: evaluation
28
+ dataset:
29
+ name: Artificial Analysis Benchmarks
30
+ type: artificial_analysis
31
+ metrics:
32
+ - name: Artificial Analysis Intelligence Index
33
+ type: artificial_analysis_intelligence_index
34
+ value: 21.8
35
+ - name: Artificial Analysis Coding Index
36
+ type: artificial_analysis_coding_index
37
+ value: 13
38
+ - name: Artificial Analysis Math Index
39
+ type: artificial_analysis_math_index
40
+ value: 22
41
+ - name: Mmlu Pro
42
+ type: mmlu_pro
43
+ value: 0.524
44
+ - name: Gpqa
45
+ type: gpqa
46
+ value: 0.358
47
+ - name: Hle
48
+ type: hle
49
+ value: 0.053
50
+ - name: Livecodebench
51
+ type: livecodebench
52
+ value: 0.247
53
+ - name: Scicode
54
+ type: scicode
55
+ value: 0.144
56
+ - name: Aime 25
57
+ type: aime_25
58
+ value: 0.22
59
+ - name: Ifbench
60
+ type: ifbench
61
+ value: 0.268
62
+ - name: Lcr
63
+ type: lcr
64
+ value: 0.117
65
+ - name: Terminalbench Hard
66
+ type: terminalbench_hard
67
+ value: 0
68
+ - name: Tau2
69
+ type: tau2
70
+ value: 0.249
71
+ source:
72
+ name: Artificial Analysis API
73
+ url: https://artificialanalysis.ai
74
  ---
75
 
76
  # Ministral 3 3B Instruct 2512