6 Pretraining a Transformer from Scratch through RoBERTa _ Transformers for Natural Language Processing and Computer Vision - Third Edition.pdf