update doc: add builtin models using guide

Signed-off-by: mgqa34 <[email protected]>
FederatedAI · Jun 21, 2023 · 10e95f8 · 10e95f8
1 parent 75cad43
commit 10e95f8
Show file tree

Hide file tree

Showing 2 changed files with 20 additions and 1 deletion.
diff --git a/README.md b/README.md
@@ -24,4 +24,5 @@ Use [FATE-LLM deployment packages](https://github.com/FederatedAI/FATE/wiki/Down
 
 ## Quick Start
 - [Federated ChatGLM-6B Training](./doc/tutorial/ChatGLM-6B_ds.ipynb)
-- [GPT-2 Training](./doc/tutorial/GPT2-example.ipynb)
+- [GPT-2 Training](./doc/tutorial/GPT2-example.ipynb)
+- [Builtin Models](./doc/tutorial/builtin_models.md)
diff --git a/doc/tutorial/builtin_models.md b/doc/tutorial/builtin_models.md
@@ -0,0 +1,18 @@
+## Builtin Models
+FATE-LLM provide some builtin models, users can use them simply to efficiently train their language models.
+To use these models, please read the using tutorial of [ChatGLM-6B Training Guide](./ChatGLM-6B_ds.ipynb) and [GPT2 Training Guide](GPT2-example.ipynb).   
+After reading the training tutorial above, it's easy to use other models listing in the following tabular by changing `module_name`, `class_name`, `dataset` to `ModuleName`, `ClassName`, `DatasetName` respectively list below.
+
+
+
+| Model          | ModuleName        | ClassName                         | DataSetName      | 
+| -------------- | ----------------- | --------------------------------- | ---------------- |
+| LLaMA-7B       | pellm.llama       | LLAMAForCausalLM                  | llama_tokenizer  |                              
+| ChatGLM-6B     | pellm.chatglm     | ChatGLMForConditionalGeneration   | glm_tokenizer    |                              
+| GPT-2          | pellm.gpt2        | GPT2                              | nlp_tokenizer    |                              
+| ALBERT         | pellm.albert      | Albert                            | nlp_tokenizer    |                              
+| BART           | pellm.bart        | Bart                              | nlp_tokenizer    |                              
+| BERT           | pellm.bert        | Bert                              | nlp_tokenizer    |                              
+| DeBERTa        | pellm.deberta     | Deberta                           | nlp_tokenizer    |                              
+| DistilBERT     | pellm.distilbert  | DistilBert                        | nlp_tokenizer    |                              
+| RoBERTa        | pellm.roberta     | Roberta                           | nlp_tokenizer    |