Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Demo improvements #8137

Merged
merged 20 commits into from
Oct 16, 2023
Merged

Demo improvements #8137

merged 20 commits into from
Oct 16, 2023

Conversation

teo-milea
Copy link
Member

@teo-milea teo-milea commented Oct 9, 2023

Description

There are multiple changes meant to improve the flow of a future helm demo:

  • parallelization of file.iter_lines() and processing
  • new policy ExecuteOncePerCombination -> moved to ExecuteOncePerCombination Policy #8160
  • UX improvements for jobs
  • fixed problem with logs for subjobs

How has this been tested?

  • notebooks under the helm directory

Checklist

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@teo-milea teo-milea changed the title [WIP] Demo improvements Demo improvements Oct 13, 2023
kwargs=kwargs, context=context, code_item_id=code_item.id
)
code_item.input_policy = input_policy
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is this needed?

Copy link
Member Author

@teo-milea teo-milea Oct 16, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if you check the UserCode class, you can see that the input policy is actually a property that also has a setter method, so in order to save the state we need to do this. This is exactly the same mechanism as the one for the output policy

@koenvanderveen koenvanderveen merged commit 395e192 into helm Oct 16, 2023
1 check passed
@koenvanderveen koenvanderveen deleted the demo_improvements branch October 16, 2023 15:38
@koenvanderveen
Copy link
Collaborator

great job!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants