Preset Configs¶
You can check the config using the following command:
flexeval_presets <config_name>
EvalSetup¶
code_chat¶
code_generation¶
en_chat¶
en_generation¶
en_multiple_choice¶
en_perplexity¶
en_vision¶
ja_chat¶
ja_generation¶
ja_multiple_choice¶
ja_vision¶
translation¶
translation_chat¶
Metric¶
- assistant_eval_en_single_turn
- assistant_eval_ja_single_turn
- elyza_tasks_100_eval
- heron_bench_judge
- j_multi_challenge_eval
- multi_challenge_eval