This repository has been archived by the owner on Aug 10, 2023. It is now read-only.
support pre-trained models (BERT, RoBERTa, BART, T5, MBART);
add regression loss, bucket relative positional encoding and self-dependency units;
support compression (gz, bz2, xz) and character-level text data processing;
support unicode standardization and Chinese desegmentation;
configure BF/FP16 and inference mode for pytorch;
fix & enhancement.