Skip to content

Rust Survey 2022: Graphs are counts, not proportions #1128

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
jtkiley opened this issue Aug 7, 2023 · 2 comments
Closed

Rust Survey 2022: Graphs are counts, not proportions #1128

jtkiley opened this issue Aug 7, 2023 · 2 comments

Comments

@jtkiley
Copy link

jtkiley commented Aug 7, 2023

In the Rust Survey 2022 post, the graph results are reported as counts, even though substantially all of the characterizations are proportions/percentages (which I think is a better comparison here).

This is more of an issue where there are two years in a bargroup, because the underlying data has different numbers of responses, so the shape of the graph will be different (even if not dramatically so given the closeness in counts).

Also, the "Rust Usage at Work" graph leaves out a now-excluded option, which makes the graph hard to interpret, and it makes the characterization about a "51.8% increase compared to the previous year" perhaps too strong for the evidence. The change in that bar is both from real change over time and from an additional option that would have drawn some of the responses had it been offered. It's still quite encouraging that removing an overlapping middle option (my interpretation anyway) had a number of respondents land in the "Yes, majority" group. As a hot take, I think removing a non-mutually-exclusive option like that is probably the right call, but you should include it on the graph (and switch to proportions).

Thanks for doing and reporting these surveys. It's really interesting to see both current responses and change over time.

@Kobzol
Copy link
Contributor

Kobzol commented Dec 13, 2023

Thank you for the report. There were definitely things that could be improved in the 2022 survey, there was a lack of time and people to work on the result analysis this year. Next year, we will try to do a better job.

@Turbo87 Turbo87 closed this as completed Jan 22, 2024
@Kobzol
Copy link
Contributor

Kobzol commented Feb 16, 2024

#1249 should improve upon this a lot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants