An industrial benchmark for modern Russian-speaking LLMs
Industrial aquaculture | Feeding of fish and other aquatic organisms | Mariculture. Breeding of crayfish and shrimps. Artificial pearl cultivation | Ichthyopathology: veterinary medicine, prevention and optimization of fish farming technologies | Botany | General agriculture | Crop production | General genetics | The basics of breeding | Seed production and seed science | Forage production and meadow farming | Reclamation farming | Technologies of cultivation of agricultural crops | Farming systems on various agricultural landscapes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0,653386 | 0,667954 | 0,580508 | 0,569106 | 0,757709 | 0,635036 | 0,625 | 0,746154 | 0,80695 | 0,683721 | 0,57037 | 0,655556 | 0,705426 | 0,717949 |
0,64 | 0,65 | 0,58 | 0,53 | 0,75 | 0,67 | 0,59 | 0,77 | 0,72 | 0,69 | 0,58 | 0,61 | 0,69 | 0,73 |
0,498 | 0,444 | 0,4195 | 0,3902 | 0,3348 | 0,4197 | 0,375 | 0,5 | 0,4865 | 0,4186 | 0,3667 | 0,4593 | 0,438 | 0,5348 |
0,3506 | 0,3166 | 0,2119 | 0,2805 | 0,2555 | 0,2591 | 0,256 | 0,2962 | 0,2741 | 0,2884 | 0,237 | 0,2852 | 0,3372 | 0,359 |
0,3546 | 0,2625 | 0,1695 | 0,2154 | 0,2291 | 0,2555 | 0,1875 | 0,2923 | 0,3012 | 0,2465 | 0,1741 | 0,3667 | 0,2713 | 0,4396 |
0,2032 | 0,251 | 0,1314 | 0,2073 | 0,1674 | 0,2774 | 0,2202 | 0,25 | 0,3127 | 0,2279 | 0,2185 | 0,2296 | 0,1783 | 0,3187 |
Industrial aquaculture | Feeding of fish and other aquatic organisms | Mariculture. Breeding of crayfish and shrimps. Artificial pearl cultivation | Ichthyopathology: veterinary medicine, prevention and optimization of fish farming technologies |
---|---|---|---|
0,653386 | 0,667954 | 0,580508 | 0,569106 |
0,64 | 0,65 | 0,58 | 0,53 |
0,498 | 0,444 | 0,4195 | 0,3902 |
0,3506 | 0,3166 | 0,2119 | 0,2805 |
0,3546 | 0,2625 | 0,1695 | 0,2154 |
0,2032 | 0,251 | 0,1314 | 0,2073 |
Botany | General agriculture | Crop production | General genetics | The basics of breeding | Seed production and seed science | Forage production and meadow farming | Reclamation farming | Technologies of cultivation of agricultural crops | Farming systems on various agricultural landscapes |
---|---|---|---|---|---|---|---|---|---|
0,757709 | 0,635036 | 0,625 | 0,746154 | 0,80695 | 0,683721 | 0,57037 | 0,655556 | 0,705426 | 0,717949 |
0,75 | 0,67 | 0,59 | 0,77 | 0,72 | 0,69 | 0,58 | 0,61 | 0,69 | 0,73 |
0,3348 | 0,4197 | 0,375 | 0,5 | 0,4865 | 0,4186 | 0,3667 | 0,4593 | 0,438 | 0,5348 |
0,2555 | 0,2591 | 0,256 | 0,2962 | 0,2741 | 0,2884 | 0,237 | 0,2852 | 0,3372 | 0,359 |
0,2291 | 0,2555 | 0,1875 | 0,2923 | 0,3012 | 0,2465 | 0,1741 | 0,3667 | 0,2713 | 0,4396 |
0,1674 | 0,2774 | 0,2202 | 0,25 | 0,3127 | 0,2279 | 0,2185 | 0,2296 | 0,1783 | 0,3187 |
Biochemistry | Clinical laboratory diagnostics | Microbiology | Normal physiology | General chemistry | General Surgery | Anatomy | Pathological anatomy | Pathophysiology | Biology (parasitology) | Propaedeutics of internal diseases | Bioorganic chemistry | Biophysics | Hygiene | Faculty Surgery | Histology | Pharmacology |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0,914815 | 0,866667 | 0,92963 | 0,940741 | 0,7 | 0,814815 | 0,87037 | 0,862963 | 0,87037 | 0,877778 | 0,877778 | 0,82963 | 0,803704 | 0,818519 | 0,851852 | 0,837037 | 0,914815 |
0,91 | 0,86 | 0,91 | 0,94 | 0,75 | 0,79 | 0,83 | 0,81 | 0,88 | 0,86 | 0,89 | 0,8 | 0,76 | 0,81 | 0,79 | 0,85 | 0,91 |
0,6074 | 0,663 | 0,663 | 0,6296 | 0,5074 | 0,5704 | 0,4556 | 0,5519 | 0,5889 | 0,6185 | 0,6111 | 0,5333 | 0,5407 | 0,6037 | 0,5407 | 0,5333 | 0,6556 |
0,5074 | 0,5148 | 0,5815 | 0,5222 | 0,4259 | 0,4963 | 0,437 | 0,4926 | 0,4704 | 0,5407 | 0,5296 | 0,4481 | 0,3926 | 0,5259 | 0,4037 | 0,4333 | 0,5444 |
0,3444 | 0,4185 | 0,3926 | 0,4222 | 0,3185 | 0,3778 | 0,3556 | 0,363 | 0,3926 | 0,3778 | 0,4037 | 0,3519 | 0,3741 | 0,3815 | 0,3481 | 0,3333 | 0,3741 |
0,3667 | 0,3185 | 0,3481 | 0,3519 | 0,2222 | 0,3074 | 0,2926 | 0,2704 | 0,337 | 0,3148 | 0,3667 | 0,2963 | 0,2926 | 0,3037 | 0,2852 | 0,3185 | 0,3556 |
A new standard in the evaluation of current models
Fast, expert-based, transparent, built on the best industry data. Easy objective assessment
Industrial benchmarks
MERA INDUSTRIAL evaluates deep expert model knowledge using specific industry standards. Сompare the models to the real performance of market leaders
Industry expertise
We developed our tests with the best experts from Russia's leading universities. The tests are customized for key industry sectors, taking into account their unique needs.
Openness and transparency
MERA provides open code, fixed run parameters and detailed reports, helping to deepen the understanding of models
Partners and participants
Integrated expertise based on industry standards
Our approach combines quantitative metrics and qualitative analysis to identify outliers, limits of generalization, and potential sources of error at different stages — from benchmark compliance to detailed analysis of strengths and weaknesses.

Industry-focused tasks for any level of expertise
Catalog of diverse industry tasks validated by top experts, reflecting the specifics of your field

Transparent methodology for testing generative models
Have a look at the detailed description of the methodology for creating a benchmark
Uniting leaders for the future of technology
The Alliance for Artificial Intelligence is a unique organization created to unite the efforts of leading technology companies, researchers and experts. Our mission is to accelerate the development and implementation of artificial intelligence in the key areas, such as education, science and business.
Learn More About The Alliance