-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Grouping feature #133
Grouping feature #133
Conversation
… for config refactor: moved dynamic class loading to separate fnuc
…ed test for config
5493731
to
d2bb258
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added some comments, really nice job 🥩!
node(some_operation, "C", "D", name="node3", tags=["baz"]), | ||
]) | ||
``` | ||
The result will be 2 VertexAI nodes for this pipeline, first with name `nodegroup` that will run `node1` and `node2` Kedro nodes inside and provide output `C` and second VertexAI node: `node3`. Additional MLflow node can be present if `kedro-mlflow` is used. Right now it is not possible to group it. If you feel you need that functionality search for/create an issue on [github page of the plugin](https://github.com/getindata/kedro-vertexai/issues). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think that it would be awesome to show the following thing in the documentation below the description:
- Screenshot of Kedro-viz of regular spaceflights pipeline
- Screenshot of code from e2e tests with tags (groups)
- Screenshot from Vertex AI
All side-by-side with arrows from one to another. Visualization always speaks better than a wall of text and people will know at glance what to expect.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ok I'll add the pictures.
e71bc72
to
71ff26d
Compare
Description
Added grouping nodes execution to single vertexai nodes. Updated docs.
PR Checklist