Skip to content

Fix mmlu_pro fewshot answers leaking into user role under chat template#3693

Open
kiwaku wants to merge 1 commit intoEleutherAI:mainfrom
kiwaku:fix/mmlu-pro-chat-template-fewshot
Open

Fix mmlu_pro fewshot answers leaking into user role under chat template#3693
kiwaku wants to merge 1 commit intoEleutherAI:mainfrom
kiwaku:fix/mmlu-pro-chat-template-fewshot

Commits

Commits on Apr 9, 2026