Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

syft memory usage is high #1446

Open
gnmahanth opened this issue Jan 11, 2023 · 2 comments · May be fixed by anchore/stereoscope#151
Open

syft memory usage is high #1446

gnmahanth opened this issue Jan 11, 2023 · 2 comments · May be fixed by anchore/stereoscope#151
Labels
bug Something isn't working needs-research

Comments

@gnmahanth
Copy link

What happened:
when catalogers are specified, syft indexes whole file system even when its not required

What you expected to happen:
index only required files when catalogers are specified

Environment:

  • Output of syft version: latest version
  • OS (e.g: cat /etc/os-release or similar): Linux
@gnmahanth gnmahanth added the bug Something isn't working label Jan 11, 2023
This was referenced Jan 11, 2023
Open
Closed
@kzantow
Copy link
Contributor

kzantow commented Jan 11, 2023

@gnmahanth the title says memory usage is high but the description is referring to Syft scanning the whole filesystem, are both of these problems? Could you provide some more information such as how much memory Syft is using for you, what Syft command you are executing, any public containers we could use to reproduce the problem, etc?

@gnmahanth
Copy link
Author

gnmahanth commented Jan 11, 2023 •
edited
Loading

I tried it on confluent kafka image

From #1447 with commands

syft -vv packages confluentinc/cp-kafka

improvements while scanning confluentinc/cp-kafka image when all catalogers are enabled
syft memory usage: ~350MB
syft memory usage with this PR: ~125MB

syft -vv packages confluentinc/cp-kafka --catalogers java

with only java cataloger enabled
syft memory usage: ~290MB
syft memory usage with this PR: ~80MB

@kzantow kzantow added this to OSS Jan 13, 2023
@Mikcl Mikcl mentioned this issue Jan 16, 2023
Closed
@wagoodman wagoodman moved this to Backlog in OSS Jan 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working needs-research
Projects
OSS
Status: Backlog
Milestone
No milestone
3 participants
@wagoodman @kzantow @gnmahanth