Applying lightweight finetuning to gpt2
Install the needed packages
!pip install transformers datasets peft
Run python3 main.py to run the script locally in your machine.
A machine with GPU is recomended. If you need to run on CPU than you need to adjust some of the training_arg so that you dont run out of memory.