Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support to use StatefulSet + Pvc to deploy the shuffle service #66

Open
Aitozi opened this issue May 8, 2022 · 2 comments
Open

Support to use StatefulSet + Pvc to deploy the shuffle service #66

Aitozi opened this issue May 8, 2022 · 2 comments

Comments

@Aitozi
Copy link
Contributor

Aitozi commented May 8, 2022 •
edited
Loading

In the current kubernetes mode, the rss use the hostPath or the emptyDir to store the shuffle data. But, In our company, the local disk resource is very rare and can not meet the storage requirements and It's not the complete storage computing separation architecture I think. I proposal to support to deploy the rss in the way of StatefulSet + PVC , So that we can leverage the cloud storage to store the shuffle data. what do you think of this ? cc @wsry
@Aitozi Aitozi changed the title Support to use StatefulSet + Pvc Support to use StatefulSet + Pvc to deploy the shuffle service May 8, 2022
@wsry
Copy link
Collaborator

wsry commented May 9, 2022

@Aitozi Thanks. I think that is a good proposal. Would you like to prepare a PR that?

@Aitozi
Copy link
Contributor Author

Aitozi commented May 9, 2022

Yes, I will prepare a PR for it ASAP and will ping you for review, thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@wsry @Aitozi