This is an unofficial implementation of the paper "Attention is all you need" https://arxiv.org/abs/1706.03762
Clone the repo, then create a conda envirnoment from envirnoment.yml and install the dependecies.
conda env create --file=environment.yml
conda activate transformer
pip install -r requirements.txtYou will find an example of translation task (en-it) in the folder train_example.
cd train_example
python train_translator.py -b [batch_size] --lr [learning_rate]