@raiju We set CrashOnOutOfMemoryError so no heap dump should be produced

@ferozco The two parameters are not mutually exclusive, the crash occurs after a heap dump is written to disk. While we do not enable -XX:+HeapDumpOnOutOfMemoryError by default, it is reasonable to enable while monitoring/debugging a failing service.

Ok, I thought that they were. I'm hesitant to encourage enabling heap dumps though. Enabling heap dumps can be a foot gun since a bad release of a single service could crash multiple times taking down the box with it because the disk fills up.

@ferozco This isn't enabling heap dumps. It's only specifying where heap dumps are written if enabled so we can hook it into our metrics (alert on heap dump creation), and is in a place where there is some file rotation policy in place.

👍

@raiju can you point me to the services which are producing heap dumps that you care about?