-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
training error #2
Comments
Hi, could you provide a more information? For example, what options did you use for training and in which file at which line of the code did this error happen. |
By the way, using different folders in vto datasetsets, it returns diferent errror. Seemingly that the " if cfg.use_jacobian:" in Handle_dataset.py at line 506 in HandleControlledSequence class is not called.How to activate the parameter cfg. Thanks for your help and your selfless open sourse contribution |
Hi, thanks for the info. I updated |
Hi, |
thank you. |
What's more , how can i find the default data /data/batch1/moving1_topo1_Cotton? |
This is a data used only in the early stage of the project with a different representation and setting. We don't have plan on releasing it. |
add:: the memory is gradually fill up |
Hi, thanks for the question. DDP will only work properly if all the meshes contain the same number of triangles, and it's always not the case when multiple meshes are included in the training. In general, DDP should not be used for this project, and it is only there for very special cases as a proof of concept to explore the gain of using DDP during our development - which turns out to be not worth the effort. |
Hi, I would recommend you to run the training without DDP, on a single GPU. Because DDP is only there for an early stage proof of concept, and we didn't test if it is compatible with our latest network implementation. A more memory and computational efficient implementation will be used without DDP. Training without DDP on an RTX 3090 for 48 hours would give you the same result as in the demo video. Hope this can be helpful. |
thanks, I would like to confirm that gt.pkl is the data before model processing , while prediction.pkl is the final data generated by the model |
Hi, |
hi,could you provide a complete project roadmap, i think my roadmap is somthing wrong |
AttributeError: 'HandleControlledSequence' object has no attribute 'L' how to prefix it . I'm looking forward for your reply
The text was updated successfully, but these errors were encountered: