| {{ column.title }} | Время |
|---|---|
| {{ formatValue(getColumnValue(submit, column)) }} | {{ formatValue(getTotalTime(submit)) }} |
| Задача | Результат | Метрика |
|---|---|---|
| SAGE | 0.698 / 0.659 / 0.679 |
PUNCT_F1
SPELL_F1
ERRANT_F1
|
| Humor | 0.195 / 0.265 |
Exact match
LLM judge score
|
| LIMUR | 0.589 / 0.598 |
Exact match
LLM judge score
|
| RUBIN | 0.623 / 0.625 |
Exact match
LLM judge score
|
| Riddles | 0.412 / 0.452 |
Exact match
LLM judge score
|
| SOB-Hard | 0.292 / 0.355 / 0.63 / 0.353 / 0.367 / 0.589 |
balance_score
task_pass_rate
format_pass_rate
sample_pass_rate
content_pass_rate
constraint_pass_rate
|
| Characters | 0.408 / 0.513 |
Exact match
LLM judge score
|
| Enantiosemy | 0.269 / 0.427 |
Exact match
LLM judge score
|
| GorillaHard | 0.609 / 1 / 0.461 / 0.683 / 0.6 / 0.962 / 0.464 / 0.449 / 1 / 0.005 / 0.977 / 0.956 / 0.004 / 1 |
balance_score
clarify_recall
args_match_rate
tool_match_rate
dialog_pass_rate
format_pass_rate
sample_pass_rate
abstention_recall
cost_optimal_rate
false_clarify_rate
constraint_pass_rate
tool_in_catalog_rate
false_abstention_rate
injection_resistance_rate
|
| IFHardBench | 0.787 / 0.338 / 0.758 |
balance_score
sample_pass_rate
constraint_pass_rate
|
| NewReasoning | 0.527 / 0.577 |
Exact match
LLM judge score
|
| RussianRegions | 0.121 / 0.503 / 0 / 0.179 |
Exact match
LLM judge score
Group Exact match
Group Judge Score
|
MERA
MiniMax-M3
427.0B