Add more streamlined local and single_gpu support, allow use of 8 bit adam optimizer#57

Open

asutermo wants to merge 16 commits intoStability-AI:masterfrom

asutermo:user/andrew/StableCascadeSingleGPU

Commits on Feb 16, 2024

tweaks to work local
Andrew Suter-Morris
committed
uncomment, more changes
Andrew Suter-Morris
committed
check path
asutermo
committed
print more
asutermo
committed
logs
asutermo
committed
Add checks for device, Local slurm id first, then cuda, then cpui
asutermo
committed
single gpu
asutermo
committed
barrier if not single gpu
asutermo
committed
remove bitsandbytes for now
asutermo
committed
more fixes
asutermo
committed
cleanup sys
asutermo
committed
cleanup: remove unused imports
asutermo
committed
setup 8bit adam
asutermo
committed
8bit adam support, move config
Andrew Suter-Morris
committed
pathing
Andrew Suter-Morris
committed

Commits on Feb 19, 2024

don't allow single_gpu and fsdp
Andrew Suter-Morris
committed