https://arxiv.org/abs/2004.08994
Adversarial Training for Large Neural Language Models (Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao)
lm 프리트레이닝/파인튜닝에 대한 adversarial 트레이닝. MS팀이 NLP에 adversarial training을 적용하는 것에 관심이 많은 듯.
#adversarial_training #language_model #pretraining #finetuning