[megatron] add opt-in distributed HF checkpoint export#1831

dinhxuanvu wants to merge 2 commits into

NovaSky-AI:mainNovaSky-AI/SkyRL:mainfrom

dinhxuanvu:vdinh/megatron-distributed-hf-exportdinhxuanvu/SkyRL:vdinh/megatron-distributed-hf-exportCopy head branch name to clipboard