Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✨ wizard: create data step, improve ergonomics #3718

Draft
wants to merge 22 commits into
base: master
Choose a base branch
from

Conversation

lucasrodes
Copy link
Member

@lucasrodes lucasrodes commented Dec 12, 2024

  • New data stepI: am trying to simplify the ergonomics of creating a new data step.
    • Currently, we present the user with three different options at the top level:, Meadow, Garden, Grapher. I think it should be simpler at the high level, and just label these as "data step". Then, the user can choose how many steps they want to create (all of them, as in 'express mode', just a subset, etc.).
  • Maintenance:
    • I'm also re-viewing some bits in Wizard, to keep things updated.
    • Bumping streamlit version to 1.41
  • Integrating harmonizer into the data step creation.
  • Support customization of dependencies in data step creation.
  • Aesthetic tweaks to Fast-track.

@owidbot
Copy link
Contributor

owidbot commented Dec 12, 2024

Quick links (staging server):

Site Dev Site Preview Admin Wizard Docs

Login: ssh owid@staging-site-enhance-wizard-data

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences
= Dataset garden/cancer/2024-08-30/gco_alcohol
  = Table gco_alcohol
= Dataset garden/cardiovascular_diseases/2023-11-01/deaths_from_cardiovascular_diseases_vs_other
  = Table deaths_from_cardiovascular_diseases_vs_other
= Dataset garden/energy/2024-06-20/global_primary_energy
  = Table global_primary_energy
2024-12-15 01:31:55 [warning  ] overflow encountered in cast   category=RuntimeWarning filename=/home/owid/etl/.venv/lib/python3.10/site-packages/pandas/io/formats/format.py lineno=1458
= Dataset garden/health/2023-05-04/global_wellbeing
  = Table global_wellbeing_index
    ~ Dim country
+       + New values: 51 / 1352 (3.77%)
           year                              dimension     country
           2020 (Urban/Rural?) A small town or villAge     Austria
           2020 (Urban/Rural?) A small town or villAge     Croatia
           2020 (Urban/Rural?) A small town or villAge      Cyprus
           2020 (Urban/Rural?) A small town or villAge       Italy
           2020 (Urban/Rural?) A small town or villAge New Zealand
-       - Removed values: 51 / 1352 (3.77%)
           year                              dimension     country
           2020 (Urban/Rural?) A small town or village     Austria
           2020 (Urban/Rural?) A small town or village     Croatia
           2020 (Urban/Rural?) A small town or village      Cyprus
           2020 (Urban/Rural?) A small town or village       Italy
           2020 (Urban/Rural?) A small town or village New Zealand
    ~ Dim year
+       + New values: 51 / 1352 (3.77%)
              country                              dimension  year
              Austria (Urban/Rural?) A small town or villAge  2020
              Croatia (Urban/Rural?) A small town or villAge  2020
               Cyprus (Urban/Rural?) A small town or villAge  2020
                Italy (Urban/Rural?) A small town or villAge  2020
          New Zealand (Urban/Rural?) A small town or villAge  2020
-       - Removed values: 51 / 1352 (3.77%)
              country                              dimension  year
              Austria (Urban/Rural?) A small town or village  2020
              Croatia (Urban/Rural?) A small town or village  2020
               Cyprus (Urban/Rural?) A small town or village  2020
                Italy (Urban/Rural?) A small town or village  2020
          New Zealand (Urban/Rural?) A small town or village  2020
    ~ Dim dimension
+       + New values: 51 / 1352 (3.77%)
              country  year                              dimension
              Austria  2020 (Urban/Rural?) A small town or villAge
              Croatia  2020 (Urban/Rural?) A small town or villAge
               Cyprus  2020 (Urban/Rural?) A small town or villAge
                Italy  2020 (Urban/Rural?) A small town or villAge
          New Zealand  2020 (Urban/Rural?) A small town or villAge
-       - Removed values: 51 / 1352 (3.77%)
              country  year                              dimension
              Austria  2020 (Urban/Rural?) A small town or village
              Croatia  2020 (Urban/Rural?) A small town or village
               Cyprus  2020 (Urban/Rural?) A small town or village
                Italy  2020 (Urban/Rural?) A small town or village
          New Zealand  2020 (Urban/Rural?) A small town or village
    ~ Column struggling_index (new data, changed data)
+       + New values: 51 / 1352 (3.77%)
              country  year                              dimension  struggling_index
              Austria  2020 (Urban/Rural?) A small town or villAge         45.447666
              Croatia  2020 (Urban/Rural?) A small town or villAge         43.946171
               Cyprus  2020 (Urban/Rural?) A small town or villAge         53.873581
                Italy  2020 (Urban/Rural?) A small town or villAge         62.569302
          New Zealand  2020 (Urban/Rural?) A small town or villAge         41.286366
-       - Removed values: 51 / 1352 (3.77%)
              country  year                              dimension  struggling_index
              Austria  2020 (Urban/Rural?) A small town or village         45.447666
              Croatia  2020 (Urban/Rural?) A small town or village         43.946171
               Cyprus  2020 (Urban/Rural?) A small town or village         53.873581
                Italy  2020 (Urban/Rural?) A small town or village         62.569302
          New Zealand  2020 (Urban/Rural?) A small town or village         41.286366
    ~ Column suffering_index (new data, changed data)
+       + New values: 51 / 1352 (3.77%)
              country  year                              dimension  suffering_index
              Austria  2020 (Urban/Rural?) A small town or villAge         0.952936
              Croatia  2020 (Urban/Rural?) A small town or villAge         11.14745
               Cyprus  2020 (Urban/Rural?) A small town or villAge        10.192031
                Italy  2020 (Urban/Rural?) A small town or villAge         4.934379
          New Zealand  2020 (Urban/Rural?) A small town or villAge         3.807985
-       - Removed values: 51 / 1352 (3.77%)
              country  year                              dimension  suffering_index
              Austria  2020 (Urban/Rural?) A small town or village         0.952936
              Croatia  2020 (Urban/Rural?) A small town or village         11.14745
               Cyprus  2020 (Urban/Rural?) A small town or village        10.192031
                Italy  2020 (Urban/Rural?) A small town or village         4.934379
          New Zealand  2020 (Urban/Rural?) A small town or village         3.807985
    ~ Column thriving_index (new data, changed data)
+       + New values: 51 / 1352 (3.77%)
              country  year                              dimension  thriving_index
              Austria  2020 (Urban/Rural?) A small town or villAge         53.5994
              Croatia  2020 (Urban/Rural?) A small town or villAge        44.90638
               Cyprus  2020 (Urban/Rural?) A small town or villAge       35.934387
                Italy  2020 (Urban/Rural?) A small town or villAge       32.496323
          New Zealand  2020 (Urban/Rural?) A small town or villAge       54.905647
-       - Removed values: 51 / 1352 (3.77%)
              country  year                              dimension  thriving_index
              Austria  2020 (Urban/Rural?) A small town or village         53.5994
              Croatia  2020 (Urban/Rural?) A small town or village        44.90638
               Cyprus  2020 (Urban/Rural?) A small town or village       35.934387
                Italy  2020 (Urban/Rural?) A small town or village       32.496323
          New Zealand  2020 (Urban/Rural?) A small town or village       54.905647
  = Table global_wellbeing
    ~ Dim country
+       + New values: 816 / 21632 (3.77%)
           year                              dimension                                       answer     country
           2020 (Urban/Rural?) A small town or villAge                                           No   Australia
           2020 (Urban/Rural?) A small town or villAge                             An exciting life     Bahrain
           2020 (Urban/Rural?) A small town or villAge           Helping other people who need help     Denmark
           2020 (Urban/Rural?) A small town or villAge                                          Yes New Zealand
           2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life South Korea
-       - Removed values: 816 / 21632 (3.77%)
           year                              dimension                                       answer     country
           2020 (Urban/Rural?) A small town or village                                           No   Australia
           2020 (Urban/Rural?) A small town or village                             An exciting life     Bahrain
           2020 (Urban/Rural?) A small town or village           Helping other people who need help     Denmark
           2020 (Urban/Rural?) A small town or village                                          Yes New Zealand
           2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life South Korea
    ~ Dim year
+       + New values: 816 / 21632 (3.77%)
              country                              dimension                                       answer  year
            Australia (Urban/Rural?) A small town or villAge                                           No  2020
              Bahrain (Urban/Rural?) A small town or villAge                             An exciting life  2020
              Denmark (Urban/Rural?) A small town or villAge           Helping other people who need help  2020
          New Zealand (Urban/Rural?) A small town or villAge                                          Yes  2020
          South Korea (Urban/Rural?) A small town or villAge Being good at what you do in your daily life  2020
-       - Removed values: 816 / 21632 (3.77%)
              country                              dimension                                       answer  year
            Australia (Urban/Rural?) A small town or village                                           No  2020
              Bahrain (Urban/Rural?) A small town or village                             An exciting life  2020
              Denmark (Urban/Rural?) A small town or village           Helping other people who need help  2020
          New Zealand (Urban/Rural?) A small town or village                                          Yes  2020
          South Korea (Urban/Rural?) A small town or village Being good at what you do in your daily life  2020
    ~ Dim dimension
+       + New values: 816 / 21632 (3.77%)
              country  year                                       answer                              dimension
            Australia  2020                                           No (Urban/Rural?) A small town or villAge
              Bahrain  2020                             An exciting life (Urban/Rural?) A small town or villAge
              Denmark  2020           Helping other people who need help (Urban/Rural?) A small town or villAge
          New Zealand  2020                                          Yes (Urban/Rural?) A small town or villAge
          South Korea  2020 Being good at what you do in your daily life (Urban/Rural?) A small town or villAge
-       - Removed values: 816 / 21632 (3.77%)
              country  year                                       answer                              dimension
            Australia  2020                                           No (Urban/Rural?) A small town or village
              Bahrain  2020                             An exciting life (Urban/Rural?) A small town or village
              Denmark  2020           Helping other people who need help (Urban/Rural?) A small town or village
          New Zealand  2020                                          Yes (Urban/Rural?) A small town or village
          South Korea  2020 Being good at what you do in your daily life (Urban/Rural?) A small town or village
    ~ Dim answer
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer
            Australia  2020 (Urban/Rural?) A small town or village                                           No
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life
    ~ Column count_on_to_help (new data, changed data)
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  count_on_to_help
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No          9.515144
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life              <NA>
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help              <NA>
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes         94.002441
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life              <NA>
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  count_on_to_help
            Australia  2020 (Urban/Rural?) A small town or village                                           No          9.515144
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life              <NA>
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help              <NA>
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes         94.002441
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life              <NA>
    ~ Column enjoy_the_work_you_do_every_day (new data, changed data)
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  enjoy_the_work_you_do_every_day
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No                        21.584761
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life                             <NA>
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help                             <NA>
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes                        83.966133
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life                             <NA>
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  enjoy_the_work_you_do_every_day
            Australia  2020 (Urban/Rural?) A small town or village                                           No                        21.584761
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life                             <NA>
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help                             <NA>
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes                        83.966133
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life                             <NA>
    ~ Column exciting_life_or_calm_life (new data, changed data)
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  exciting_life_or_calm_life
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No                        <NA>
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life                   18.243595
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help                        <NA>
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes                        <NA>
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life                        <NA>
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  exciting_life_or_calm_life
            Australia  2020 (Urban/Rural?) A small town or village                                           No                        <NA>
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life                   18.243595
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help                        <NA>
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes                        <NA>
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life                        <NA>
    ~ Column experience_calmness_yesterday (new data, changed data)
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  experience_calmness_yesterday
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No                      20.294548
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life                           <NA>
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help                           <NA>
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes                      80.558983
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life                           <NA>
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  experience_calmness_yesterday
            Australia  2020 (Urban/Rural?) A small town or village                                           No                      20.294548
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life                           <NA>
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help                           <NA>
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes                      80.558983
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life                           <NA>
    ~ Column feel_at_peace_with_life (new data, changed data)
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  feel_at_peace_with_life
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No                11.713309
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life                     <NA>
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help                     <NA>
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes                88.314369
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life                     <NA>
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  feel_at_peace_with_life
            Australia  2020 (Urban/Rural?) A small town or village                                           No                11.713309
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life                     <NA>
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help                     <NA>
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes                88.314369
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life                     <NA>
    ~ Column focus_on_taking_care_of_themselves_or_taking_care_of_others (new data, changed data)
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  focus_on_taking_care_of_themselves_or_taking_care_of_others
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No                                                         <NA>
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life                                                         <NA>
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help                                                         <NA>
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes                                                         <NA>
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life                                                         <NA>
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  focus_on_taking_care_of_themselves_or_taking_care_of_others
            Australia  2020 (Urban/Rural?) A small town or village                                           No                                                         <NA>
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life                                                         <NA>
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help                                                         <NA>
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes                                                         <NA>
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life                                                         <NA>
    ~ Column health_problems (new data, changed data)
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  health_problems
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No        74.723564
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life             <NA>
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help             <NA>
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes        25.686413
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life             <NA>
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  health_problems
            Australia  2020 (Urban/Rural?) A small town or village                                           No        74.723564
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life             <NA>
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help             <NA>
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes        25.686413
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life             <NA>
    ~ Column main_purpose_in_life (new data, changed data)
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  main_purpose_in_life
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No                  <NA>
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life                  <NA>
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help              14.41984
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes                  <NA>
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life             57.775646
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  main_purpose_in_life
            Australia  2020 (Urban/Rural?) A small town or village                                           No                  <NA>
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life                  <NA>
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help              14.41984
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes                  <NA>
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life             57.775646
    ~ Column many_choices_in_type_of_work (new data, changed data)
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  many_choices_in_type_of_work
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No                     33.097359
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life                          <NA>
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help                          <NA>
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes                     79.379234
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life                          <NA>
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  many_choices_in_type_of_work
            Australia  2020 (Urban/Rural?) A small town or village                                           No                     33.097359
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life                          <NA>
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help                          <NA>
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes                     79.379234
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life                          <NA>
    ~ Column various_aspects_of_life_in_balance (new data, changed data)
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  various_aspects_of_life_in_balance
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No                           22.593025
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life                                <NA>
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help                                <NA>
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes                           79.808517
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life                                <NA>
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  various_aspects_of_life_in_balance
            Australia  2020 (Urban/Rural?) A small town or village                                           No                           22.593025
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life                                <NA>
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help                                <NA>
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes                           79.808517
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life                                <NA>
    ~ Column work_significantly_improves_the_lives_of_others_outside_of_household (new data, changed data)
+       + New values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  work_significantly_improves_the_lives_of_others_outside_of_household
            Australia  2020 (Urban/Rural?) A small town or villAge                                           No                                                              24.82954
              Bahrain  2020 (Urban/Rural?) A small town or villAge                             An exciting life                                                                  <NA>
              Denmark  2020 (Urban/Rural?) A small town or villAge           Helping other people who need help                                                                  <NA>
          New Zealand  2020 (Urban/Rural?) A small town or villAge                                          Yes                                                             77.906219
          South Korea  2020 (Urban/Rural?) A small town or villAge Being good at what you do in your daily life                                                                  <NA>
-       - Removed values: 816 / 21632 (3.77%)
              country  year                              dimension                                       answer  work_significantly_improves_the_lives_of_others_outside_of_household
            Australia  2020 (Urban/Rural?) A small town or village                                           No                                                              24.82954
              Bahrain  2020 (Urban/Rural?) A small town or village                             An exciting life                                                                  <NA>
              Denmark  2020 (Urban/Rural?) A small town or village           Helping other people who need help                                                                  <NA>
          New Zealand  2020 (Urban/Rural?) A small town or village                                          Yes                                                             77.906219
          South Korea  2020 (Urban/Rural?) A small town or village Being good at what you do in your daily life                                                                  <NA>
= Dataset garden/maternal_mortality/2024-07-08/maternal_mortality
  = Table maternal_mortality
= Dataset garden/missing_data/2024-03-26/who_neuropsychiatric_conditions
  = Table neuropsychiatric_conditions
= Dataset garden/tuberculosis/2023-11-27/outcomes_disagg
  = Table outcomes_disagg
    ~ Column tsr (changed data)
        ~ Changed values: 243 / 1929 (12.60%)
                                country  year age_group sex cohort_type      tsr -   tsr +
          Upper-middle-income countries  2015      0-14   a      newrel  82.977608 83.0000
          Upper-middle-income countries  2019      0-14   a      newrel  84.418114 84.4375
                                   Asia  2019         a   m      newrel  86.013664 86.0000
                                Oceania  2019         a   m      newrel  71.868942 71.8750
                                 Uganda  2020         a   a      newrel  85.417595 85.4375
= Dataset garden/who/2024-07-26/mortality_database
  = Table mortality_database
    ~ Column age_standardized_death_rate_per_100_000_standard_population (changed metadata)
-       - title: |-
-       -   Age-standardized deaths from << cause.lower() >> in << sex.lower() >> in those aged << age_group.lower() >> per 100,000 people
        ? ^                                                                      --------------------------------------
+       + title: Age-standardized deaths from << cause.lower() >> in << sex.lower() >> per 100,000 people
        ? ^^^^^^
-       - description_short: Reported deaths from << cause.lower() >> in << sex.lower() >> in those aged << age_group.lower() >> per
        ?                                                                                 --------------------------------------
+       + description_short: Reported deaths from << cause.lower() >> in << sex.lower() >> per 100,000 people.
        ?                                                                                     ++++++++++++++++
-       -   100,000 people.
= Dataset garden/who/2024-08-06/mortality_database_cancer
  = Table mortality_database_cancer
    ~ Column age_standardized_death_rate_per_100_000_standard_population (changed metadata)
-       - title: |-
-       -   Age-standardized deaths from << cause.lower() >> in << sex.lower() >> in those aged << age_group.lower() >> per 100,000 people
        ? ^                                                                      --------------------------------------
+       + title: Age-standardized deaths from << cause.lower() >> in << sex.lower() >> per 100,000 people
        ? ^^^^^^
-       - description_short: Reported deaths from << cause.lower() >> in << sex.lower() >> in those aged << age_group.lower() >> per
        ?                                                                                 --------------------------------------
+       + description_short: Reported deaths from << cause.lower() >> in << sex.lower() >> per 100,000 people.
        ?                                                                                     ++++++++++++++++
-       -   100,000 people.
= Dataset garden/who/2024-08-06/mortality_database_cancer_most_common
  = Table mortality_database_cancer
= Dataset garden/who/2024-09-09/flu_test
  = Table flu_test
    ~ Dim country
+       + New values: 5 / 72532 (0.01%)
                date country
          2021-02-15 Belgium
          2024-11-18  Belize
          2024-09-02  Panama
          2024-10-14  Panama
          2024-08-12  Turkey
-       - Removed values: 69 / 72532 (0.10%)
                date       country
          2024-12-02      Malaysia
          2024-12-02   Saint Lucia
          2024-11-18     Sri Lanka
          2024-12-02 United States
          2024-11-25       Vietnam
    ~ Dim date
+       + New values: 5 / 72532 (0.01%)
          country       date
          Belgium 2021-02-15
           Belize 2024-11-18
           Panama 2024-09-02
           Panama 2024-10-14
           Turkey 2024-08-12
-       - Removed values: 69 / 72532 (0.10%)
                country       date
               Malaysia 2024-12-02
            Saint Lucia 2024-12-02
              Sri Lanka 2024-11-18
          United States 2024-12-02
                Vietnam 2024-11-25
    ~ Column denomcombined (new data, changed data)
+       + New values: 5 / 72532 (0.01%)
          country       date  denomcombined
          Belgium 2021-02-15              2
           Belize 2024-11-18              5
           Panama 2024-09-02            207
           Panama 2024-10-14            133
           Turkey 2024-08-12             95
-       - Removed values: 69 / 72532 (0.10%)
                country       date  denomcombined
               Malaysia 2024-12-02            902
            Saint Lucia 2024-12-02              9
              Sri Lanka 2024-11-18             58
          United States 2024-12-02          83355
                Vietnam 2024-11-25             51
        ~ Changed values: 197 / 72532 (0.27%)
                   country       date  denomcombined -  denomcombined +
                 Argentina 2024-11-18               85               82
          Northern Ireland 2024-11-25             1802             1798
                  Paraguay 2024-04-01              256              255
              South Africa 2024-04-08              177              176
                    Turkey 2024-05-27               64              119
    ~ Column pcnt_poscombined (new data, changed data)
+       + New values: 5 / 72532 (0.01%)
          country       date  pcnt_poscombined
          Belgium 2021-02-15              50.0
           Belize 2024-11-18              20.0
           Panama 2024-09-02          0.483092
           Panama 2024-10-14           0.75188
           Turkey 2024-08-12          1.052632
-       - Removed values: 69 / 72532 (0.10%)
                country       date  pcnt_poscombined
               Malaysia 2024-12-02         17.294901
            Saint Lucia 2024-12-02         11.111111
              Sri Lanka 2024-11-18         12.068966
          United States 2024-12-02          5.724912
                Vietnam 2024-11-25         15.686275
        ~ Changed values: 208 / 72532 (0.29%)
            country       date  pcnt_poscombined -  pcnt_poscombined +
          Argentina 2024-02-05            0.846382            0.848536
          Argentina 2024-11-18           16.470589           17.073172
            Ecuador 2024-11-11                22.5           22.689075
             Norway 2024-10-07            0.785423            0.777568
             Turkey 2024-05-13            10.10101            7.096774


Legend: +New  ~Modified  -Removed  =Identical  Details
Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2024-12-15 01:32:13 UTC
Execution time: 35.31 seconds

@lucasrodes lucasrodes added enhancement New feature or request wizard Issues related to wizard tool labels Dec 15, 2024
@lucasrodes lucasrodes changed the title ✨ wizard data step ✨ wizard: create data step, improve ergonomics Dec 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request wizard Issues related to wizard tool
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants