Skip to content

Commit

Permalink
add samples
Browse files Browse the repository at this point in the history
  • Loading branch information
WuTheFWasThat committed Feb 14, 2019
1 parent c2dae27 commit e3e1ad5
Show file tree
Hide file tree
Showing 2 changed files with 20,009 additions and 1 deletion.
10 changes: 9 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ Code and samples from the paper "Language Models are Unsupervised Multitask Lear

## Installation

Download the model data:
Download the (small, 117M parameter) model data:
```
gsutil rsync -r gs://gpt-2/models/ models/
```
Expand All @@ -27,3 +27,11 @@ There are various flags for controlling the samples:
```
python3 src/main.py --top_k 40 --temperature 0.7 | tee samples
```

While we have not yet released GPT-2 itself, you can see some unconditional samples (with default settings of temperature 1 and no truncation) in `gpt2-samples.txt`.

## Future work

We may release code for evaluating the models on various benchmarks.

We are still considering release of the larger models.
Loading

0 comments on commit e3e1ad5

Please sign in to comment.