Skip to content

Hanhpt23/SmallGPT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 

Repository files navigation

SmallGPT

I have developed a compact GPT model capable of predicting subsequent words from input sequences, drawing inspiration from Andrej Karpathy

Contents:

  1. Learn the encode-decode technique by character level
  2. Build a model that can predict the next word based on a given sentence
  3. Using the Transformer technique from Attention Is All You Need paper
  4. Train model on The Raven poem written by Edgar Allan Poe
  5. Test model

About

Buidling a small GPT

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published