Skip to content

Commit

Permalink
fix capitalization
Browse files Browse the repository at this point in the history
  • Loading branch information
kjappelbaum committed May 29, 2024
1 parent e69196f commit 9ba594d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/usage.md
Original file line number Diff line number Diff line change
Expand Up @@ -145,7 +145,7 @@ tokenizer = SliceTokenizer(

All `Xtal2txtTokenizer` instances inherit from {ref}`PreTrainedTokenizer <regression_transformer>` and accept arguments compatible with the HuggingFace tokenizer.

## Tokenizers with special Number tokenization
## Tokenizers with special number tokenization

The `special_num_token` argument (by default `False`) can be set to true to tokenize numbers in a special way as designed and implemented by {ref}`RegressionTransformer <regression_transformer>`.

Expand Down

0 comments on commit 9ba594d

Please sign in to comment.