-
-
Notifications
You must be signed in to change notification settings - Fork 168
Embedding
Calamdor edited this page Mar 10, 2024
·
8 revisions
This tab appears only for training Embeddings.
- Base embedding (default - blank): fill it only if you want to train more to an existing embedding, leave it empty for a new embedding.
- Token Count (default - 1): The number of tokens to use for your embedding. The size of a token changes per model. 2 can be ok for simple embeddings, more can help for more complex prompts.
- Initial embedding text (default - * ): The initial embedding text used when creating a new embedding. Keep this short, either as '*' or 'a man' or 'a woman' for example
- Embedding Weight Data Type (default - float32): What the embedding will be loaded into memory as. As embeddings are small, there is little reason to move to bfloat16, but it is an option.