Add IFEval score to metrics (#2)
Browse files- Add IFEval score to metrics (b4bbb89cdfec15934d34e79103b7a4ccb4e43127)
Co-authored-by: Lewis Tunstall <lewtun@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -14,6 +14,23 @@ tags:
|
|
| 14 |
- convAI
|
| 15 |
- conversational
|
| 16 |
pipeline_tag: text-generation
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
---
|
| 18 |
# Phi-2-super (SFT + cDPO)
|
| 19 |
|
|
|
|
| 14 |
- convAI
|
| 15 |
- conversational
|
| 16 |
pipeline_tag: text-generation
|
| 17 |
+
model-index:
|
| 18 |
+
- name: phi-2-super
|
| 19 |
+
results:
|
| 20 |
+
# IFEval
|
| 21 |
+
- task:
|
| 22 |
+
type: text-generation
|
| 23 |
+
name: Text Generation
|
| 24 |
+
dataset:
|
| 25 |
+
name: Instruction Following Eval
|
| 26 |
+
type: wis-k/instruction-following-eval
|
| 27 |
+
metrics:
|
| 28 |
+
- type: acc
|
| 29 |
+
name: prompt_level_loose_acc
|
| 30 |
+
value: 0.2717
|
| 31 |
+
source:
|
| 32 |
+
name: LightEval
|
| 33 |
+
url: https://github.com/huggingface/lighteval
|
| 34 |
---
|
| 35 |
# Phi-2-super (SFT + cDPO)
|
| 36 |
|