README.md

Human Alignment

Dataset

You can download the dataset from the link, and put it in the data directory.

Requirement

You can install the environment using the following command.

pip install -r requirements.txt

Evaluation

• TruthfulQA

bash eval_TruthfulQA.sh

• Crows Pairs

bash eval_Crows_Pairs.sh

• WinoGender

bash eval_WinoGender.sh

• RealToxityPrompts

bash eval_RealToxityPrompts.sh