Параметры генерации:
labtabvqa - until=["\n\n"];do_sample=false;temperature=0; \nrealvqa - until=["\n\n"];do_sample=false;temperature=0; \nruclevr - until=["\n\n"];do_sample=false;temperature=0; \nrucommonvqa - until=["\n\n"];do_sample=false;temperature=0; \nruhhh_image - until=["\n\n"];do_sample=false;temperature=0; \nrumathvqa - until=["\n\n"];do_sample=false;temperature=0; \nrunaturalsciencevqa_biology - until=["\n\n"];do_sample=false;temperature=0; \nrunaturalsciencevqa_chemistry - until=["\n\n"];do_sample=false;temperature=0; \nrunaturalsciencevqa_earth_science - until=["\n\n"];do_sample=false;temperature=0; \nrunaturalsciencevqa_physics - until=["\n\n"];do_sample=false;temperature=0; \nschoolsciencevqa_biology - until=["\n\n"];do_sample=false;temperature=0; \nschoolsciencevqa_chemistry - until=["\n\n"];do_sample=false;temperature=0; \nschoolsciencevqa_earth_science - until=["\n\n"];do_sample=false;temperature=0; \nschoolsciencevqa_economics - until=["\n\n"];do_sample=false;temperature=0; \nschoolsciencevqa_history_all - until=["\n\n"];do_sample=false;temperature=0; \nschoolsciencevqa_history_ru - until=["\n\n"];do_sample=false;temperature=0; \nschoolsciencevqa_physics - until=["\n\n"];do_sample=false;temperature=0; \nunisciencevqa_applied_sciences - until=["\n\n"];do_sample=false;temperature=0; \nunisciencevqa_business - until=["\n\n"];do_sample=false;temperature=0; \nunisciencevqa_cultural_studies - until=["\n\n"];do_sample=false;temperature=0; \nunisciencevqa_fundamental_sciences - until=["\n\n"];do_sample=false;temperature=0; \nunisciencevqa_health_and_medicine - until=["\n\n"];do_sample=false;temperature=0; \nunisciencevqa_social_sciences - until=["\n\n"];do_sample=false;temperature=0; \nweird - until=["\n\n"];do_sample=false;temperature=0;

Размер контекста:
labtabvqa, realvqa, ruclevr, rucommonvqa, ruhhh_image, rumathvqa, runaturalsciencevqa_biology, runaturalsciencevqa_chemistry, runaturalsciencevqa_earth_science, runaturalsciencevqa_physics, schoolsciencevqa_biology, schoolsciencevqa_chemistry, schoolsciencevqa_earth_science, schoolsciencevqa_economics, schoolsciencevqa_history_all, schoolsciencevqa_history_ru, schoolsciencevqa_physics, unisciencevqa_applied_sciences, unisciencevqa_business, unisciencevqa_cultural_studies, unisciencevqa_fundamental_sciences, unisciencevqa_health_and_medicine, unisciencevqa_social_sciences, weird - 4096

Описание темплейта:
{%- for message in messages -%} \n {%- if loop.first and messages[0]['role'] != 'system' -%} \n {{'<|im_system|>system<|im_middle|>You are a helpful assistant<|im_end|>'}} \n {%- endif -%} \n {%- if message['role'] == 'system' -%} \n {{'<|im_system|>'}} \n {%- endif -%} \n {%- if message['role'] == 'user' -%} \n {{'<|im_user|>'}} \n {%- endif -%} \n {%- if message['role'] == 'assistant' -%} \n {{'<|im_assistant|>'}} \n {%- endif -%} \n {{- message['role'] -}} \n {{'<|im_middle|>'}} \n {%- if message['content'] is string -%} \n {{- message['content'] + '<|im_end|>' -}} \n {%- else -%} \n {%- for content in message['content'] -%} \n {%- if content['type'] == 'image' or 'image' in content or 'image_url' in content -%} \n {{'<|media_start|>image<|media_content|><|media_pad|><|media_end|>'}} \n {%- else -%} \n {{content['text']}} \n {%- endif -%} \n {%- endfor -%} \n {{'<|im_end|>'}} \n {%- endif -%} \n{%- endfor -%} \n{%- if add_generation_prompt -%} \n {{'<|im_assistant|>assistant<|im_middle|>'}} \n{%- endif -%}