From f0c48bd89a442819b39605ca117ecabd293bfdd7 Mon Sep 17 00:00:00 2001 From: Arthur <48595927+ArthurZucker@users.noreply.github.com> Date: Fri, 15 Nov 2024 21:51:39 +0100 Subject: [PATCH] Update README.md with install from source --- README.md | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/README.md b/README.md index 2a9cd055a..dd5dbe41b 100644 --- a/README.md +++ b/README.md @@ -39,6 +39,19 @@ We provide bindings to the following languages (more to come!): - [Python](https://github.com/huggingface/tokenizers/tree/main/bindings/python) - [Node.js](https://github.com/huggingface/tokenizers/tree/main/bindings/node) - [Ruby](https://github.com/ankane/tokenizers-ruby) (Contributed by @ankane, external repo) + +## Installation + +You can install from source using: +```bash +pip install git+https://github.com/huggingface/tokenizers.git#subdirectory=bindings/python +``` + +our install the released versions with + +```bash +pip install tokenizers +``` ## Quick example using Python: