Skip to content
This repository was archived by the owner on Oct 31, 2023. It is now read-only.

Have fix potential typo #4

Open
guspan-tanadi wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Have fix potential typo #4

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
6e44d50
Have fix typo a word
guspan-tanadi Mar 30, 2023
9eec0b1
Also have fix potential typo
guspan-tanadi Mar 30, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion configs/cfg_flip_huge14.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ def get_config():

# save memory
config.partitioning.partition_states = True
# flatten params in optmizer
# flatten params in optimizer
config.opt.flatten_params = True

return config
4 changes: 2 additions & 2 deletions configs/default.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,11 +19,11 @@ def get_config():
config.laion_path = ""

config.learning_rate = 4e-6 # this is the base lr per 256 batch-size
config.warmup_epochs = 40.0 # virutual imagenet epochs
config.warmup_epochs = 40.0 # virtual imagenet epochs
config.min_abs_lr = 0.0
config.warmup_abs_lr = 0.0

config.num_epochs = 10000.0 # virutual imagenet epochs
config.num_epochs = 10000.0 # virtual imagenet epochs
config.log_every_steps = 200
config.save_every_epochs = 100

Expand Down