Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IOPO get_dataset ValueError: The dataset is not applicable in the current training stage. #178

Open
xiamaozi11 opened this issue Dec 9, 2024 · 1 comment

Comments

@xiamaozi11
Copy link

File "/home/xia/patent/jiaodi/IOPO/Method-IOPO/src/llamafactory/train/iopo/workflow.py", line 44, in run_iopo
dataset_module = get_dataset(model_args, data_args, training_args, stage="iopo", **tokenizer_module)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/xia/patent/jiaodi/IOPO/Method-IOPO/src/llamafactory/data/loader.py", line 233, in get_dataset
dataset = _get_merged_dataset(data_args.dataset, model_args, data_args, training_args, stage)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/xia/patent/jiaodi/IOPO/Method-IOPO/src/llamafactory/data/loader.py", line 151, in _get_merged_dataset
raise ValueError("The dataset is not applicable in the current training stage.")
ValueError: The dataset is not applicable in the current training stage.

@AIRobotZhang
Copy link
Contributor

File "/home/xia/patent/jiaodi/IOPO/Method-IOPO/src/llamafactory/train/iopo/workflow.py", line 44, in run_iopo dataset_module = get_dataset(model_args, data_args, training_args, stage="iopo", **tokenizer_module) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/xia/patent/jiaodi/IOPO/Method-IOPO/src/llamafactory/data/loader.py", line 233, in get_dataset dataset = _get_merged_dataset(data_args.dataset, model_args, data_args, training_args, stage) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/xia/patent/jiaodi/IOPO/Method-IOPO/src/llamafactory/data/loader.py", line 151, in _get_merged_dataset raise ValueError("The dataset is not applicable in the current training stage.") ValueError: The dataset is not applicable in the current training stage.

The code has been updated as follows:
67e9698

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants