Skip to content

Commit

Permalink
minor edits
Browse files Browse the repository at this point in the history
  • Loading branch information
aishaeldeeb committed Aug 20, 2024
1 parent e88341d commit 1f04bb7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion content/concepts.md
Original file line number Diff line number Diff line change
Expand Up @@ -156,7 +156,7 @@ Image from: https://www.tensorops.ai/post/what-are-quantized-llms

Imagine you have a large language model pre-trained on a general corpus and you want to fine-tune it for sentiment analysis on a specific dataset. Using LoRa, you decompose the model’s weight matrices into low-rank components and update these components with your sentiment analysis data. If you use QLoRa, you would quantize these low-rank components to save even more resources and accelerate inference.

#### References
## References
[Complete Guide to Subword Tokenization Methods in the Neural Era](https://blog.octanove.org/guide-to-subword-tokenization/)
[Summary of the tokenizers](https://huggingface.co/docs/transformers/tokenizer_summary)
[Word Embedding: Basics](https://medium.com/@hari4om/word-embedding-d816f643140)
Expand Down

0 comments on commit 1f04bb7

Please sign in to comment.