Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
nbalepur authored Jan 27, 2024
1 parent 5e33597 commit 49d4fdd
Showing 1 changed file with 11 additions and 5 deletions.
16 changes: 11 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,10 +24,16 @@ The most important files in this repository are as follows:
* `/scripts/`: Sample bash scripts to run our code

## Model Usage
Nugget
There are four relevant files:
* `/model/run_hf.py`: Code to run all possible prompt formats, except the second step of the
* `/model/run_hf_question.py`: Contains the code for generating our plots
* `/scripts/`: Sample bash scripts to run our code

There are six relevant files:
* `/model/run_hf.py`: Code to run all possible prompt formats, except the second step of the inferring the question strategy and the random question prompt
* `/model/run_hf_remote.py`: Version of `run_hf.py` that works with models on the huggingface hub where you need to trust remote code (i.e. Phi)
* `/model/extract_generated_questions.py`: After running step one of the inferring the question strategy in the above two Python scripts, this will extract the questions generated by the LLM. This must be run before either of the last two Python scripts
* `/model/extract_random_questions.py`: This will sample a random set of questions from the test set. for the LLM to use. This must be run before either of the last two Python files
* `/model/run_hf_question.py`: Code to run the second step of the inferring the question strategy and the random question prompt
* `/model/run_hf_question_remote.py`: Version of `run_hf_question.py` that works with models on the huggingface hub where you need to trust remote code (i.e. Phi)


## Evaluation Usage


0 comments on commit 49d4fdd

Please sign in to comment.