Yi-Coder-9B-Chat

MERA Created at 16.07.2025 11:06

0.206

The overall result

Ratings for leaderboard tasks

The table will scroll to the left

Task name	Result	Metric
YABLoCo	0.135 / 0.024	EM pass@k
stRuCom	0.192	chrF
RealCode	0.067 / 0.988	pass@k execution_success
UnitTests	0.168	CodeBLEU
ruCodeEval	0.35 / 0.362 / 0.372	pass@k
JavaTestGen	0.229 / 0.59	pass@k compile@1
ruHumanEval	0.173 / 0.197 / 0.201	pass@k
RealCodeJava	0.255 / 0.983	pass@k execution_success
CodeLinterEval	0.145 / 0.157 / 0.164	pass@k
ruCodeReviewer	0.009 / 0.078 / 0.016 / 0.016 / 0.016	chrF BLEU judge@1 judge@5 judge@10
CodeCorrectness	0.364	EM

Information about the submission

Mera version

v.1.0.0

Torch Version

2.7.0

The version of the codebase

e77f33f

CUDA version

12.6

Precision of the model weights

bfloat16

Seed

1234

Batch

Transformers version

4.53.0

The number of GPUs and their type

1 x NVIDIA A100-SXM4-80GB

Architecture

local-chat-completions

Team:

MERA

Name of the ML model:

Yi-Coder-9B-Chat

Link to the ML model:

https://huggingface.co/01-ai/Yi-Coder-9B-Chat

Model size

8.8B

Model type:

Opened

SFT

Architecture description:

Yi-Coder is a series of open-source code language models that delivers state-of-the-art coding performance with fewer than 10 billion parameters. Key features: Excelling in long-context understanding with a maximum context length of 128K tokens. Supporting 52 major programming languages

Yi-Coder-9B-Chat

Ratings for leaderboard tasks

Information about the submission

Team:

Name of the ML model:

Link to the ML model:

Model size

Model type:

Architecture description:

Confirm the deletion of the sub