Many errors while running test suite: "unable to open database file"

[mattyg]

The tests run fine for some time (around 30 mins). Then at some point, we get a zillion errors from holochain "unable to open database file". Tests seem to still pass even with the errors.

Here's a snippet:

1:19:48.569410Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/conductor/conductor
2025-02-26T01:19:48.569460Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/conductor/conductor
2025-02-26T01:19:48.569508Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/conductor/conductor
2025-02-26T01:19:48.569556Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/conductor/conductor
2025-02-26T01:19:48.569604Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/dht/uhC0ke0r9a6CWNRJWY3VV-0GH7CYp0jyJtu_birliLlBeL1OzZdGH
2025-02-26T01:19:48.569656Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/conductor/conductor
2025-02-26T01:19:48.569706Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/conductor/conductor
2025-02-26T01:19:48.569757Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/conductor/conductor


stdout | src/mewsfeed/mews/agent-to-notifications.test.ts > notifications include replies, quotes, mewmews to mews that I also responded to
18:19:48 [Tryorama - Local Conductor] info: 2025-02-26T01:19:48.595723Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Ef7RYQ7OWYAQxysqQsB-w/databases/conductor/conductor


stdout | src/mewsfeed/mews/agent-to-notifications.test.ts > notifications include replies, quotes, mewmews to mews that I also responded to
18:19:48 [Tryorama - Local Conductor] info: 2025-02-26T01:19:48.605158Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/dht/uhC0ke0r9a6CWNRJWY3VV-0GH7CYp0jyJtu_birliLlBeL1OzZdGH
2025-02-26T01:19:48.605244Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/conductor/conductor
2025-02-26T01:19:48.605298Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/dht/uhC0ke0r9a6CWNRJWY3VV-0GH7CYp0jyJtu_birliLlBeL1OzZdGH
2025-02-26T01:19:48.605351Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/dht/uhC0ke0r9a6CWNRJWY3VV-0GH7CYp0jyJtu_birliLlBeL1OzZdGH
2025-02-26T01:19:48.605403Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/dht/uhC0ke0r9a6CWNRJWY3VV-0GH7CYp0jyJtu_birliLlBeL1OzZdGH
2025-02-26T01:19:48.605452Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Q1MllW347sWq4kVI2AWau/databases/dht/uhC0ke0r9a6CWNRJWY3VV-0GH7CYp0jyJtu_birliLlBeL1OzZdGH


stdout | src/mewsfeed/mews/agent-to-notifications.test.ts > notifications include replies, quotes, mewmews to mews that I also responded to
18:19:48 [Tryorama - Local Conductor] info: 2025-02-26T01:19:48.653439Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Ef7RYQ7OWYAQxysqQsB-w/databases/dht/uhC0ke0r9a6CWNRJWY3VV-0GH7CYp0jyJtu_birliLlBeL1OzZdGH
2025-02-26T01:19:48.653533Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Ef7RYQ7OWYAQxysqQsB-w/databases/conductor/conductor
2025-02-26T01:19:48.653590Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Ef7RYQ7OWYAQxysqQsB-w/databases/dht/uhC0ke0r9a6CWNRJWY3VV-0GH7CYp0jyJtu_birliLlBeL1OzZdGH
2025-02-26T01:19:48.653644Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Ef7RYQ7OWYAQxysqQsB-w/databases/dht/uhC0ke0r9a6CWNRJWY3VV-0GH7CYp0jyJtu_birliLlBeL1OzZdGH
2025-02-26T01:19:48.653698Z ERROR r2d2: /nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-vendor-cargo-deps/c19b7c6f923b580ac259164a89f2577984ad5ab09ee9d583b888f934adbbe8d0/r2d2-0.8.10/src/lib.rs:121: unable to open database file: /tmp/nix-shell.1ii93Z/Ef7RYQ7OWYAQxysqQsB-w/databases/conductor/conductor