Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Token counter in prompt field #22

Open
cathykc opened this issue Aug 11, 2020 · 0 comments
Open

Token counter in prompt field #22

cathykc opened this issue Aug 11, 2020 · 0 comments

Comments

@cathykc
Copy link
Contributor

cathykc commented Aug 11, 2020

https://openai-api.slack.com/archives/C015JAN056F/p1597165057206700

  • David Schnurr

https://repl.it/@schnerd/gpt2-tokenizer
huggingface/tokenizers#63

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant