Skip to content

Activity

Showing most recent first

Merge pull request #3 from tcapelle/main

Pull request merge
hkprojpushed 5 commits to main • 4ddbe9a…f73abd3 • 
on Apr 10, 2024

added slides

hkprojpushed 1 commit to main • 1217c06…4ddbe9a • 
on Dec 19, 2023

added no_sync block

hkprojpushed 1 commit to main • ab8860f…1217c06 • 
on Dec 15, 2023

added template to transform any project into ddp

hkprojpushed 1 commit to main • ad1d4e6…ab8860f • 
on Dec 15, 2023

disable tokenizers parallelism

hkprojpushed 1 commit to main • 8015851…ad1d4e6 • 
on Dec 14, 2023

bugfix on config

hkprojpushed 1 commit to main • 26e8b00…8015851 • 
on Dec 14, 2023

printing debug info from all local nodes, but each indicating its rank

hkprojpushed 1 commit to main • 92d8020…26e8b00 • 
on Dec 14, 2023

added comments and type definitions

hkprojpushed 2 commits to main • 9601659…92d8020 • 
on Dec 14, 2023

added gradient retention

hkprojpushed 1 commit to main • dee260e…9601659 • 
on Dec 12, 2023

added gradient computation from scratch notebook

hkprojpushed 1 commit to main • aac622d…dee260e • 
on Dec 12, 2023

fixed instructions

hkprojpushed 1 commit to main • bb40cf8…aac622d • 
on Dec 8, 2023

fixed instructions

hkprojpushed 1 commit to main • 301837a…bb40cf8 • 
on Dec 8, 2023

fixed instructions

hkprojpushed 1 commit to main • b6421d5…301837a • 
on Dec 8, 2023

added instructions for paperspace

hkprojpushed 1 commit to main • b82c2b6…b6421d5 • 
on Dec 8, 2023

removed distributed sampler from validation data loader

hkprojpushed 1 commit to main • 76cf0b2…b82c2b6 • 
on Dec 8, 2023

disable progress bar on local_rank > 0

hkprojpushed 1 commit to main • 402d058…76cf0b2 • 
on Dec 8, 2023

only printing on local_rank 0

hkprojpushed 1 commit to main • 480b818…402d058 • 
on Dec 8, 2023

added global_step to tqdm progbar during train

hkprojpushed 1 commit to main • 1ebf3ec…480b818 • 
on Dec 8, 2023

added verbose logging

hkprojpushed 2 commits to main • 455d5ec…1ebf3ec • 
on Dec 8, 2023

resume from latest checkpoint + reuse w&b run id

hkprojpushed 2 commits to main • dc45ee3…455d5ec • 
on Dec 8, 2023

removed pin_memory from dataloader

hkprojpushed 1 commit to main • e319ba3…dc45ee3 • 
on Dec 8, 2023

shuffle DistributedSampler

hkprojpushed 1 commit to main • 5a15d07…e319ba3 • 
on Dec 8, 2023

added ddp integration

hkprojpushed 1 commit to main • 788cded…5a15d07 • 
on Dec 8, 2023

updated requirements for torch

hkprojpushed 2 commits to main • 2170d38…788cded • 
on Dec 8, 2023

fixed project name on wandb

hkprojpushed 2 commits to main • b308eae…2170d38 • 
on Dec 8, 2023

updated README

hkprojpushed 1 commit to main • ac8474f…b308eae • 
on Dec 8, 2023

removed tensorboard ignore (obsolete)

hkprojpushed 4 commits to main • 5deb93d…ac8474f • 
on Dec 8, 2023

training with w&b becomes the default training script

hkprojpushed 2 commits to main • 02cf37d…5deb93d • 
on Dec 8, 2023

added requirements and conda env

hkprojpushed 1 commit to main • e3dfa29…02cf37d • 
on Dec 8, 2023

added weights&biases integration

hkprojcreated main • e3dfa29 • 
on Dec 8, 2023