-
Notifications
You must be signed in to change notification settings - Fork 216
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Memory leak Details #1155
Memory leak Details #1155
Conversation
Signed-off-by: Chaurasiya, Payal <[email protected]>
Signed-off-by: Ubuntu <azureuser@vm-openfl.edrucphba2zutobdsbafmzy3ya.bx.internal.cloudapp.net>
Signed-off-by: Ubuntu <azureuser@vm-openfl.edrucphba2zutobdsbafmzy3ya.bx.internal.cloudapp.net>
@@ -132,6 +132,8 @@ def modify_plan(self, new_rounds=None, num_collaborators=None, disable_client_au | |||
data = yaml.load(fp, Loader=yaml.FullLoader) | |||
|
|||
data["aggregator"]["settings"]["rounds_to_train"] = int(self.rounds_to_train) | |||
data["aggregator"]["settings"]["memleak_check"] = True |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
in my opinion, we should enable this by default.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Memory details are not needed for all runs. Basically it will be better for performance and Memory Leak related tests I think.
Please let me know if still needs to change this.
Signed-off-by: payalcha <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A couple of comments, as per our offline discussion
* deprecate python native api Signed-off-by: yes <[email protected]> * syntax issue fix Signed-off-by: yes <[email protected]> --------- Signed-off-by: yes <[email protected]>
Signed-off-by: payalcha <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks @payalcha !
@@ -171,6 +174,24 @@ def run(self): | |||
|
|||
# Cleaning tensor db | |||
self.tensor_db.clean_up(self.db_store_rounds) | |||
if self.log_memory_usage: | |||
# This is the place to check the memory usage of the collaborator | |||
self.logger.info("*****************COLLABORATOR LOGS*******************************") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
********* COLLABORATOR MEMORY USAGE *********
?
No description provided.