Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature request: single first outlier causes mean to be useless for comparison #4

Open
nolistic opened this issue Sep 24, 2019 · 1 comment

Comments

@nolistic
Copy link
Collaborator

as a business user, I want to easily compare metrics across loadtest reports.

However, miliseconds matter in the world of response time.

Outliers cause me to need more robust reporting than is offered by loadtest when comparing platforms.

image

when separated across threads, this first outlier makes sense
image

but that doesn't mean I want it in my comparison report.

@nolistic nolistic changed the title single first outlier causes mean to be useless for comparison feature request: single first outlier causes mean to be useless for comparison Sep 24, 2019
@jnolis
Copy link
Collaborator

jnolis commented Sep 25, 2019

It's easy to change the mean response time to median (in fact that is what the chart uses for the horizontal gray line), but should we do something in the first plot to remove that outlier? It makes the rest of the chart useless, but could be important.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants