Skip to content

bujardeari/lightweight-finetuning-off-foundation-model

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 

Repository files navigation

lightweight-finetuning-off-foundation-model

Applying lightweight finetuning to gpt2

Install the needed packages

!pip install transformers datasets peft

Run python3 main.py to run the script locally in your machine.

A machine with GPU is recomended. If you need to run on CPU than you need to adjust some of the training_arg so that you dont run out of memory.

About

Applying lightweight finetuning to gpt2

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published