Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kernel has died issue #6

Open
Alea4jacta6est opened this issue Dec 8, 2023 · 4 comments
Open

Kernel has died issue #6

Alea4jacta6est opened this issue Dec 8, 2023 · 4 comments

Comments

@Alea4jacta6est
Copy link

Hi, I am trying to use your tutorials on the machine with 64RAM inside a docker container, but I get "Kernel has died" when I try to run this cell at the beginning of cell search tutorial:
from scimilarity.utils import lognorm_counts
from scimilarity import CellAnnotation, align_dataset

Do you have any idea why it happens?

@OmarSalem12
Copy link
Collaborator

OmarSalem12 commented Dec 8, 2023

Hi @Alea4jacta6est the dead Kernel is usually an indication of low memory. If you are running docker locally on your machine , it's important to make sure docker has no limit on memory usage. In docker desktop, go to settings > Resoruces, you will see how many CPUs / Memory docker is allowed to use. Make sure all 64 Gbs are usable by docker and try running SCimilarity again.

@Alea4jacta6est
Copy link
Author

Thanks for a quick response, here is my /etc/docker/daemon.json:
{
"live-restore": true,
"log-opts": {
"tag": "{{.Name}}"
},
"storage-driver": "overlay2",
"mtu": 1460,
"default-ulimits": {
"memlock": {
"Name": "memlock",
"Hard": 68719476736,
"Soft": 68719476736
}
}
}
I use a GCP instance with 64GB, do you think it makes sense to increase memory to 128GB then?

@OmarSalem12
Copy link
Collaborator

The config looks right to me. The tutorial was tested with 64Gb of memory so I don't think 128Gb is necessary. It's also strange that it fails while importing methods. Loading the model is the memory intensive step. I'll consult with my colleagues and get back to you. Any logs that can help us troubleshoot where the issue is coming from will be appreciated. Thanks

@Alea4jacta6est
Copy link
Author

It started to work on the machine with 80GB of memory, seems that 64 is just not enough

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants