Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

adding one more zk client makes zk cxns exhausted easily #3625

Closed
vagetablechicken opened this issue Nov 24, 2023 · 1 comment · Fixed by #3642
Closed

adding one more zk client makes zk cxns exhausted easily #3625

vagetablechicken opened this issue Nov 24, 2023 · 1 comment · Fixed by #3642
Assignees
@dl239
Labels
high-priority sdk openmldb java/python sdk

Comments

@vagetablechicken
Copy link
Collaborator

vagetablechicken commented Nov 24, 2023 •
edited
Loading

OpenMLDB/java/openmldb-jdbc/src/main/java/com/_4paradigm/openmldb/sdk/impl/SqlClusterExecutor.java

Line 75 in 125483b

zkClient = new ZKClient(ZKConfig.builder()

When online load data, each task will create one sql cluster executor, and X2 zk client. It's heavy.
Ref 1b2f945
@vagetablechicken
Copy link
Collaborator Author

vagetablechicken commented Nov 27, 2023 •
edited
Loading

java client add a smaller mode for loading(no deployment manager), and in spark connector, use the small one

@aceforeverd aceforeverd added the sdk openmldb java/python sdk label Dec 4, 2023
@dl239 dl239 linked a pull request Dec 4, 2023 that will close this issue
feat: add light java sdk #3642
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dl239 dl239

Labels
high-priority sdk openmldb java/python sdk
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat: add light java sdk dl239/OpenMLDB
4 participants
@lumianph @dl239 @aceforeverd @vagetablechicken