Skip to content

Latest commit

 

History

History

advanced

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
1-hydra-config.ipynb
1-hydra-config.ipynb
 
 
2-flash-attention-2.ipynb
2-flash-attention-2.ipynb
 
 
README.md
README.md
 
 

README.md

Advanced

Collection of advanced examples and tutorials - which at the moment are a bit mixed together.

Index

  • 1-hydra-config.ipynb: here we show how to use Hydra to configure your training and testing scripts.
  • 2-flash-attention-2.ipynb: this notebook shows the effects of different SDPA (Scaled Dot-Product Attention) implementations on the training of a model.