Skip to content

rdyzakya/MiniCharGPT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MiniCharGPT

Remake of GPT, character level

We have 2 models:

  1. model.pth
    • Trained on names.txt for 5 epoch
    • embedding dim 768
    • ff dim 1024
    • n head 8
    • n block 6
  2. model-hispanic.pth
    • Trained on names2.txt for 10 epoch
    • embedding dim 512
    • ff dim 1024
    • n head 4
    • n block 3

About

Remake of GPT, character level

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published