LANGMODEL_DIR=<Path to BioLM: it should be trained on SQuAD>

[gongye19]

Sorry to bother you, but where could i find the pretrained LM on SQuAD, it seems the model in this work was not provided.

[wonjininfo]

Hi @gongye19 ,
Thank you for your interest in our work.

Yes, we did not release the SQuAD-trained checkpoint at the moment, but you can train it with the same code in the repository.

We will further consider releasing SQuAD-trained checkpoints soon, but this will take some time. So I'd suggest you train the model by yourself.

---

Script for training on the SQuAD dataset is also available in the example script file. (Please note that the training codes for SQuAD are commented out.)

For example, the following codes set hyper-parameters for training the model on the SQuAD dataset.

SeqTagQA/train_list_example.sh

Lines 9 to 14 in 644bce0

	# To train LMs on SQuAD, un-comment these lines
	#export LANGMODEL_DIR=dmis-lab/biobert-v1.1
	#export DATA_DIR=<Path to DATA>/DATA/SQuAD-SeqTagQA/squad-20201030
	#export MAX_EPOCH=50
	#export LEARN_RATE=5e-5
	#export OUTPUT_DIR=<Output path>/20220130-squad_${METHOD}_lr${LEARN_RATE}_iter-${NUM_ITER}

(Please also comment out the # To train LMs on List-question dataset part in the following lines in the same file).

Thank you!
Best,
Wonjin