Skip to content

fix: paths where to save metrics with eval results#8

Open
yurakuratov wants to merge 2 commits intoai-forever:mainfrom
yurakuratov:main
Open

fix: paths where to save metrics with eval results#8
yurakuratov wants to merge 2 commits intoai-forever:mainfrom
yurakuratov:main

Conversation

@yurakuratov
Copy link
Copy Markdown

@yurakuratov yurakuratov commented Sep 2, 2024

e.g.,
running

python eval.py -p ./predictions/mistral_7b_v03_instr_32k.json

will result in saving metrics to results/predictions instead of results/mistral_7b_v03_instr_32k.json.

This PR fixes it. Also formats the metrics file to be more readable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant