Request the Drivelm data file conversation_drivelm_eval_rag_top1.json

[Jiancheng25]

Hello, project maintainers,

Thank you for open-sourcing this valuable project. When I used the script in the repository to download the DriveLM dataset, I noticed that the conversation_drivelm_eval_rag_top1.json file was missing, causing an error during training that the file could not be found.

I have successfully downloaded and prepared the other data files, but the JSON file for the evaluation set does not appear to be included in the provided data package. Could you please upload or provide a download link for this file?

Thank you very much!

Best wishes!

[javyduck]

hi sorry, the name should be conversation_drivelm_val_rag_top1.json
and the file is here: https://github.com/AI-secure/SafeAuto/blob/main/data/conversation/drivelm/conversation_drivelm_val_rag_top1.json

[javyduck]

Hi, thanks for the interest in our work, and sorry for the confusion caused by the naming! The DriveLM evaluation file is actually named conversation_drivelm_val_rag_top1.json (val instead of eval), and it is already included in the repo: https://github.com/AI-secure/SafeAuto/blob/main/data/conversation/drivelm/conversation_drivelm_val_rag_top1.json

The training/eval scripts that referenced the wrong *_eval_* filenames (scripts/finetune_drivelm.sh and scripts/eval_drivelm.sh) have now been fixed on the latest main, so everything should run out of the box without renaming any files. Please pull the latest code and let me know if you hit any other problem!