[megatron] Accept dtype-string optimizer_config_kwargs (coerce exp_avg_dtype etc. to torch.dtype)#1805

Merged

SumanthRH merged 4 commits into

NovaSky-AI:mainfrom

dyurk-lila:feat/optimizer-state-dtype-coercion

Jul 10, 2026

Commits on Jul 1, 2026

[megatron] Accept dtype-string optimizer_config_kwargs (coerce exp_avg_dtype etc. to torch.dtype)
dyurk-lila
committed
docs: tighten optimizer dtype comments
dyurk-lila
committed

Commits on Jul 8, 2026

test: narrow optimizer dtype coercion coverage
dyurk-lila
committed

Commits on Jul 10, 2026

test: make optimizer dtype test CPU-only
dyurk-lila
committed