You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When running benchmark against deephaven builds, there is nothing to distinguish between two deephaven builds but deephaven version. This is problematic when running nightly or adhoc builds, because you don't know what run went with what build when they have the same version.
We can tell what benchmarks ran together in the same run with Benchmark run-id. We should be able to tell what deephaven build the benchmarks ran against. Deephaven needs a build number, but in the meantime, we can create a temporary one until that happens.
Create a "deephaven-build" property to the platform csv along side the existing deephaven.version.
This is especially important when looking at iterations, because you may have multiple runs on the same deephaven build and want to pick the median of the set
A separate ticket is to add more implementation details to the Deephaven build metadata
When running benchmark against deephaven builds, there is nothing to distinguish between two deephaven builds but deephaven version. This is problematic when running nightly or adhoc builds, because you don't know what run went with what build when they have the same version.
We can tell what benchmarks ran together in the same run with Benchmark run-id. We should be able to tell what deephaven build the benchmarks ran against. Deephaven needs a build number, but in the meantime, we can create a temporary one until that happens.
The text was updated successfully, but these errors were encountered: