Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Baking chunk size for sequences #51

Conversation

jrsndl
Copy link

@jrsndl jrsndl commented Oct 23, 2024

Changelog Description

Supporting deadline rendering of Nuke baking jobs (Extract Review Intermediate) with multi chunks.
The Chunk size is copied from the ayon+settings://deadline/publish/NukeSubmitDeadline/chunk_size

Additional info

Might close ynput/ayon-nuke#3

Testing notes:

  1. Set Extract Review Intermediate to jpg
  2. Make sure you do not have Nuke Slate present (see bug)
  3. Publish Nuke render on Deadline
  4. Check Number of tasks for baking job in Deadline Monitor, it should be > 1

@mkolar mkolar requested review from jakubjezek001 and robin-ynput and removed request for robin-ynput October 29, 2024 11:51
@jakubjezek001 jakubjezek001 added sponsored This is directly sponsored by a client or community member type: enhancement Improvement of existing functionality or minor addition labels Oct 31, 2024
Copy link
Member

@moonyuet moonyuet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Published Successfully in Nuke
image
Also rendered in farm successfully
image

@kalisp
Copy link
Member

kalisp commented Nov 7, 2024

If this PR is about to have chunk size dynamic for Baking job, it will be obsolete by #49 where it will be controlled by Profile/could be overridden by artist.

Would it be important to separate chunks/other JobInfo fields per render vs baking job (eg. have different chunk for render, different one for baking)? Currently it is not possible, not sure how the model in Setting would like for that.

@BigRoy
Copy link
Contributor

BigRoy commented Nov 7, 2024

If this PR is about to have chunk size dynamic for Baking job, it will be obsolete by #49 where it will be controlled by Profile/could be overridden by artist.

Actually - I think what the intent is.. is that if you were to write out a video file you want the chunk size to be infinitely large because multiple machines couldn't render out to the same file. Something tells me - that is what this is trying to solve.

If media has # in it - allow chunk size to be configurable.
If media does not have # it's a single file, and we assume multiple machines can't simultaneously write to.

To easily support that in an abstract plug-in we may need some way to identify that a job MUST be one task or not due to that. Like "singleTaskOnly" or "forceSingleTask" or whatever.

@jrsndl
Copy link
Author

jrsndl commented Nov 8, 2024

Actually - I think what the intent is.. is that if you were to write out a video file you want the chunk size to be infinitely large because multiple machines couldn't render out to the same file. Something tells me - that is what this is trying to solve.

Correct. Of course, having confugurable chunk size for baking sequences would be great. Possibly even Deadline Frame Dependencies, so baking can start right when each frame finishes. Just taking the same chunks as the render is easy and should already help quite a bit.

I am trying to solve very slow publishing of long highres shots. Sometimes, particullarly for episodic vfx, we have shots that are one, or two minutes long. Production gets gray hair when publish is on the farm one more hour just to produce baking mov.

@BigRoy
Copy link
Contributor

BigRoy commented Nov 8, 2024

I am trying to solve very slow publishing of long highres shots. Sometimes, particullarly for episodic vfx, we have shots that are one, or two minutes long. Production gets gray hair when publish is on the farm one more hour just to produce baking mov.

Valid use case - and has come up before. I think there was an epic description about that some time ago @antirotor? But definitely quite some dev work.

@kalisp
Copy link
Member

kalisp commented Nov 11, 2024

Closing in favor of #49

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
sponsored This is directly sponsored by a client or community member type: enhancement Improvement of existing functionality or minor addition
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Nuke: baking intermediate sequence on farm with chunks
5 participants