Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add MeSH data #507

Closed
wants to merge 54 commits into from

Merge branch 'master' into add_mesh_data

3b30247
Select commit
Loading
Failed to load commit list.
Closed

Add MeSH data #507

Merge branch 'master' into add_mesh_data
3b30247
Select commit
Loading
Failed to load commit list.
Google Cloud Build / data-pull-request-py (datcom-ci) failed Mar 5, 2024 in 5m 10s

Summary

Build Information

Trigger data-pull-request-py
Build 73adba86-2f3f-4c2f-8a04-9ead5c39a3c6
Start 2024-03-05T10:04:04-08:00
Duration 4m56.074s
Status FAILURE

Steps

Step Status Duration
python_install SUCCESS 1m36.866s
python_test CANCELLED 2m52.031s
python_format_check FAILURE 2m51.273s

Details

starting build "73adba86-2f3f-4c2f-8a04-9ead5c39a3c6"

FETCHSOURCE
hint: Using 'master' as the name for the initial branch. This default branch name
hint: is subject to change. To configure the initial branch name to use in all
hint: of your new repositories, which will suppress this warning, call:
hint: 
hint: 	git config --global init.defaultBranch <name>
hint: 
hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
hint: 'development'. The just-created branch can be renamed via this command:
hint: 
hint: 	git branch -m <name>
Initialized empty Git repository in /workspace/.git/
From https://github.com/datacommonsorg/data
 * branch            3b30247db9c9c942aae52fed291a6dd723634fbe -> FETCH_HEAD
Updating files:  26% (812/3011)
Updating files:  27% (813/3011)
Updating files:  28% (844/3011)
Updating files:  28% (872/3011)
Updating files:  29% (874/3011)
Updating files:  30% (904/3011)
Updating files:  31% (934/3011)
Updating files:  32% (964/3011)
Updating files:  33% (994/3011)
Updating files:  34% (1024/3011)
Updating files:  35% (1054/3011)
Updating files:  36% (1084/3011)
Updating files:  37% (1115/3011)
Updating files:  38% (1145/3011)
Updating files:  39% (1175/3011)
Updating files:  40% (1205/3011)
Updating files:  41% (1235/3011)
Updating files:  42% (1265/3011)
Updating files:  43% (1295/3011)
Updating files:  44% (1325/3011)
Updating files:  45% (1355/3011)
Updating files:  45% (1376/3011)
Updating files:  46% (1386/3011)
Updating files:  47% (1416/3011)
Updating files:  48% (1446/3011)
Updating files:  49% (1476/3011)
Updating files:  50% (1506/3011)
Updating files:  51% (1536/3011)
Updating files:  52% (1566/3011)
Updating files:  53% (1596/3011)
Updating files:  54% (1626/3011)
Updating files:  55% (1657/3011)
Updating files:  56% (1687/3011)
Updating files:  57% (1717/3011)
Updating files:  58% (1747/3011)
Updating files:  59% (1777/3011)
Updating files:  60% (1807/3011)
Updating files:  61% (1837/3011)
Updating files:  62% (1867/3011)
Updating files:  63% (1897/3011)
Updating files:  64% (1928/3011)
Updating files:  65% (1958/3011)
Updating files:  66% (1988/3011)
Updating files:  67% (2018/3011)
Updating files:  68% (2048/3011)
Updating files:  69% (2078/3011)
Updating files:  70% (2108/3011)
Updating files:  70% (2133/3011)
Updating files:  71% (2138/3011)
Updating files:  72% (2168/3011)
Updating files:  73% (2199/3011)
Updating files:  74% (2229/3011)
Updating files:  75% (2259/3011)
Updating files:  76% (2289/3011)
Updating files:  77% (2319/3011)
Updating files:  78% (2349/3011)
Updating files:  79% (2379/3011)
Updating files:  80% (2409/3011)
Updating files:  81% (2439/3011)
Updating files:  82% (2470/3011)
Updating files:  83% (2500/3011)
Updating files:  84% (2530/3011)
Updating files:  85% (2560/3011)
Updating files:  86% (2590/3011)
Updating files:  87% (2620/3011)
Updating files:  88% (2650/3011)
Updating files:  89% (2680/3011)
Updating files:  90% (2710/3011)
Updating files:  91% (2741/3011)
Updating files:  92% (2771/3011)
Updating files:  93% (2801/3011)
Updating files:  94% (2831/3011)
Updating files:  95% (2861/3011)
Updating files:  96% (2891/3011)
Updating files:  97% (2921/3011)
Updating files:  98% (2951/3011)
Updating files:  99% (2981/3011)
Updating files: 100% (3011/3011)
Updating files: 100% (3011/3011), done.
HEAD is now at 3b30247 Merge branch 'master' into add_mesh_data
BUILD
Starting Step #0 - "python_install"
Step #0 - "python_install": Pulling image: python:3.7
Step #0 - "python_install": 3.7: Pulling from library/python
Step #0 - "python_install": 167b8a53ca45: Pulling fs layer
Step #0 - "python_install": b47a222d28fa: Pulling fs layer
Step #0 - "python_install": debce5f9f3a9: Pulling fs layer
Step #0 - "python_install": 1d7ca7cd2e06: Pulling fs layer
Step #0 - "python_install": ff3119008f58: Pulling fs layer
Step #0 - "python_install": c2423a76a32b: Pulling fs layer
Step #0 - "python_install": e1c98ca4926a: Pulling fs layer
Step #0 - "python_install": 3b62c8e1d79b: Pulling fs layer
Step #0 - "python_install": 1d7ca7cd2e06: Waiting
Step #0 - "python_install": ff3119008f58: Waiting
Step #0 - "python_install": c2423a76a32b: Waiting
Step #0 - "python_install": e1c98ca4926a: Waiting
Step #0 - "python_install": 3b62c8e1d79b: Waiting
Step #0 - "python_install": b47a222d28fa: Verifying Checksum
Step #0 - "python_install": b47a222d28fa: Download complete
Step #0 - "python_install": 167b8a53ca45: Verifying Checksum
Step #0 - "python_install": 167b8a53ca45: Download complete
Step #0 - "python_install": debce5f9f3a9: Verifying Checksum
Step #0 - "python_install": debce5f9f3a9: Download complete
Step #0 - "python_install": ff3119008f58: Verifying Checksum
Step #0 - "python_install": ff3119008f58: Download complete
Step #0 - "python_install": c2423a76a32b: Verifying Checksum
Step #0 - "python_install": c2423a76a32b: Download complete
Step #0 - "python_install": e1c98ca4926a: Verifying Checksum
Step #0 - "python_install": e1c98ca4926a: Download complete
Step #0 - "python_install": 3b62c8e1d79b: Verifying Checksum
Step #0 - "python_install": 3b62c8e1d79b: Download complete
Step #0 - "python_install": 1d7ca7cd2e06: Verifying Checksum
Step #0 - "python_install": 1d7ca7cd2e06: Download complete
Step #0 - "python_install": 167b8a53ca45: Pull complete
Step #0 - "python_install": b47a222d28fa: Pull complete
Step #0 - "python_install": debce5f9f3a9: Pull complete
Step #0 - "python_install": 1d7ca7cd2e06: Pull complete
Step #0 - "python_install": ff3119008f58: Pull complete
Step #0 - "python_install": c2423a76a32b: Pull complete
Step #0 - "python_install": e1c98ca4926a: Pull complete
Step #0 - "python_install": 3b62c8e1d79b: Pull complete
Step #0 - "python_install": Digest: sha256:eedf63967cdb57d8214db38ce21f105003ed4e4d0358f02bedc057341bcf92a0
Step #0 - "python_install": Status: Downloaded newer image for python:3.7
Step #0 - "python_install": docker.io/library/python:3.7
Step #0 - "python_install": ### Installing Python requirements
Step #0 - "python_install": Installing Python requirements
Step #0 - "python_install":   DEPRECATION: ratelimit is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
Step #0 - "python_install":   DEPRECATION: func-timeout is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
Step #0 - "python_install":   DEPRECATION: frozendict is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
Step #0 - "python_install":   DEPRECATION: rdp is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
Step #0 - "python_install": 
Step #0 - "python_install": [notice] A new release of pip is available: 23.0.1 -> 24.0
Step #0 - "python_install": [notice] To update, run: pip install --upgrade pip
Finished Step #0 - "python_install"
Starting Step #2 - "python_format_check"
Starting Step #1 - "python_test"
Step #2 - "python_format_check": Already have image (with digest): python:3.7
Step #1 - "python_test": Already have image (with digest): python:3.7
Step #2 - "python_format_check": ### Testing lint
Step #1 - "python_test": ### Running Python tests in util/
Step #1 - "python_test": Installing Python requirements
Step #2 - "python_format_check": Installing Python requirements
Step #2 - "python_format_check": 
Step #2 - "python_format_check": [notice] A new release of pip is available: 23.0.1 -> 24.0
Step #2 - "python_format_check": [notice] To update, run: pip install --upgrade pip
Step #1 - "python_test": 
Step #1 - "python_test": [notice] A new release of pip is available: 23.0.1 -> 24.0
Step #1 - "python_test": [notice] To update, run: pip install --upgrade pip
Step #2 - "python_format_check": #### Testing Python lint
Step #1 - "python_test": #### Testing Python code in util/
Step #1 - "python_test": test_aggregate_dict (aggregation_util_test.AggregationUtilTest) ... ok
Step #1 - "python_test": test_aggregate_value (aggregation_util_test.AggregationUtilTest) ... ok
Step #1 - "python_test": test_config_map_with_override (config_map_test.TestConfigMap) ... ok
Step #1 - "python_test": test_load_config_file (config_map_test.TestConfigMap)
Step #1 - "python_test": Test loading of config dictionary from a file. ... ok
Step #1 - "python_test": test_set_config (config_map_test.TestConfigMap) ... ok
Step #1 - "python_test": test_update_config (config_map_test.TestConfigMap) ... ok
Step #1 - "python_test": test_add_counter (counters_test.TestCounters)
Step #1 - "python_test": Verify increment and decrement counters. ... Counters:
Step #1 - "python_test":                                        test_inputs =         10
Step #1 - "python_test":                          test_process_elapsed_time =       0.00
Step #1 - "python_test":                                     test_processed =          0
Step #1 - "python_test":                                    test_start_time =     167.19
Step #1 - "python_test": ok
Step #1 - "python_test": test_counter_dict (counters_test.TestCounters)
Step #1 - "python_test": Verify counter dict is shared across counters. ... Counters:
Step #1 - "python_test":                               process_elapsed_time =       0.00
Step #1 - "python_test":                                          processed =          0
Step #1 - "python_test":                                         start_time =     167.19
Step #1 - "python_test":                                           test_ctr =          1
Step #1 - "python_test": ok
Step #1 - "python_test": test_debug_counters (counters_test.TestCounters)
Step #1 - "python_test": Verify counters with debug string suffixes. ... Counters:
Step #1 - "python_test":                                       test3_inputs =         10
Step #1 - "python_test":                           test3_inputs_test-case-2 =         10
Step #1 - "python_test":                         test3_process_elapsed_time =       0.00
Step #1 - "python_test":                                    test3_processed =          0
Step #1 - "python_test":                                   test3_start_time =     167.20
Step #1 - "python_test": ok
Step #1 - "python_test": test_set_counter (counters_test.TestCounters)
Step #1 - "python_test": Verify set_counter overrides current value. ... Counters:
Step #1 - "python_test":                                        test2_lines =          1
Step #1 - "python_test":                                  test2_lines_file1 =          1
Step #1 - "python_test":                         test2_process_elapsed_time =       0.00
Step #1 - "python_test":                                    test2_processed =          0
Step #1 - "python_test":                                   test2_start_time =     167.20
Step #1 - "python_test": Counters:
Step #1 - "python_test":                                        test2_lines =         11
Step #1 - "python_test":                                  test2_lines_file1 =         11
Step #1 - "python_test":                         test2_process_elapsed_time =       0.00
Step #1 - "python_test":                                    test2_processed =          0
Step #1 - "python_test":                                   test2_start_time =     167.20
Step #1 - "python_test": ok
Step #1 - "python_test": test_show_counters (counters_test.TestCounters) ... Counters:
Step #1 - "python_test":                                     test-file-rows =        100
Step #1 - "python_test":                          test-process_elapsed_time =       0.00
Step #1 - "python_test":                        test-process_remaining_time = 1000000.00
Step #1 - "python_test":                                     test-read-rows =          0
Step #1 - "python_test":                                    test-start_time =     167.20
Step #1 - "python_test": Counters:
Step #1 - "python_test":                                     test-file-rows =        100
Step #1 - "python_test":                          test-process_elapsed_time =       0.00
Step #1 - "python_test":                        test-process_remaining_time =       0.00
Step #1 - "python_test":                               test-processing_rate =   59752.86
Step #1 - "python_test":                                     test-read-rows =         10
Step #1 - "python_test":                                    test-start_time =     167.20
Step #1 - "python_test": ok
Step #1 - "python_test": test_dc_api_batched_wrapper (dc_api_wrapper_test.TestDCAPIWrapper)
Step #1 - "python_test": Test DC API wrapper for batched calls. ... ok
Step #1 - "python_test": test_dc_api_is_defined_dcid (dc_api_wrapper_test.TestDCAPIWrapper)
Step #1 - "python_test": Test API wrapper for defined DCIDs. ... ok
Step #1 - "python_test": test_dc_api_wrapper (dc_api_wrapper_test.TestDCAPIWrapper)
Step #1 - "python_test": Test the wrapper for DC API. ... ok
Step #1 - "python_test": test_dc_get_node_property_values (dc_api_wrapper_test.TestDCAPIWrapper)
Step #1 - "python_test": Test API wrapper to get all property:values for a node. ... ok
Step #1 - "python_test": test_download_file (download_util_test.TestCounters) ... ok
Step #1 - "python_test": test_prefilled_url (download_util_test.TestCounters) ... ok
Step #1 - "python_test": test_request_url (download_util_test.TestCounters) ... ok
Step #1 - "python_test": file_util_test (unittest.loader._FailedTest) ... ERROR
Step #1 - "python_test": test_aa2 (latlng2place_mapsapi_test.Latlng2PlaceMapsAPITest) ... ok
Step #1 - "python_test": test_country (latlng2place_mapsapi_test.Latlng2PlaceMapsAPITest) ... ok
Step #1 - "python_test": test_main (latlng_recon_geojson_test.LatlngReconGeojsonTest) ... ok
Step #1 - "python_test": test_basic (latlng_recon_service_test.LatlngReconServiceTest) ... /usr/local/lib/python3.7/concurrent/futures/thread.py:57: ResourceWarning: unclosed <ssl.SSLSocket fd=5, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('192.168.10.3', 48994), raddr=('35.244.133.155', 443)>
Step #1 - "python_test":   result = self.fn(*self.args, **self.kwargs)
Step #1 - "python_test": ResourceWarning: Enable tracemalloc to get the object allocation traceback
Step #1 - "python_test": ok
Step #1 - "python_test": test_filter (latlng_recon_service_test.LatlngReconServiceTest) ... /usr/local/lib/python3.7/concurrent/futures/thread.py:57: ResourceWarning: unclosed <ssl.SSLSocket fd=5, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('192.168.10.3', 49008), raddr=('35.244.133.155', 443)>
Step #1 - "python_test":   result = self.fn(*self.args, **self.kwargs)
Step #1 - "python_test": ResourceWarning: Enable tracemalloc to get the object allocation traceback
Step #1 - "python_test": ok
Step #1 - "python_test": test_dict_list_to_mcf_str (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_drop_nodes (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_get_dcid_node (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_mcf_dict_rename_namespace (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_mcf_dict_rename_prop (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_mcf_dict_rename_prop_value (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_mcf_to_dict_list (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_node_list_check_existence_dc (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_node_list_check_existence_node_list (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_example_usage (mcf_template_filler_test.MCFTemplateFillerTest) ... ok
Step #1 - "python_test": test_pop_and_2_obs_with_all_pv (mcf_template_filler_test.MCFTemplateFillerTest)
Step #1 - "python_test": Use separate templates for Pop Obs, and use Obs template repeatedly. ... ok
Step #1 - "python_test": test_pop_with_missing_req_pv (mcf_template_filler_test.MCFTemplateFillerTest) ... ok
Step #1 - "python_test": test_require_node_name (mcf_template_filler_test.MCFTemplateFillerTest) ... ok
Step #1 - "python_test": test_unified_pop_obs_with_missing_optional_pv (mcf_template_filler_test.MCFTemplateFillerTest) ... ok
Step #1 - "python_test": test_place_id_resolution_by_name (state_division_to_dcid_test.PlaceMapTest) ... ok
Step #1 - "python_test": test_boolean_naming (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_double_underscore (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_ignore_props (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_legacy_mapping (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_measured_property (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_measurement_constraint_removal (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_measurement_denominator (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_measurement_qualifier (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_naics_name_generation (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_namespace_removal (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_prepend_append_replace (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_quantity_name_generation (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_quantity_range_name_generation (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_soc_map (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_soc_name_generation (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_sorted_constraints (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_stat_type (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": 
Step #1 - "python_test": ======================================================================
Step #1 - "python_test": ERROR: file_util_test (unittest.loader._FailedTest)
Step #1 - "python_test": ----------------------------------------------------------------------
Step #1 - "python_test": ImportError: Failed to import test module: file_util_test
Step #1 - "python_test": Traceback (most recent call last):
Step #1 - "python_test":   File "/usr/local/lib/python3.7/unittest/loader.py", line 436, in _find_test_path
Step #1 - "python_test":     module = self._get_module_from_name(name)
Step #1 - "python_test":   File "/usr/local/lib/python3.7/unittest/loader.py", line 377, in _get_module_from_name
Step #1 - "python_test":     __import__(name)
Step #1 - "python_test":   File "/workspace/util/file_util_test.py", line 31, in <module>
Step #1 - "python_test":     import file_util
Step #1 - "python_test":   File "/workspace/util/file_util.py", line 22, in <module>
Step #1 - "python_test":     import gspread
Step #1 - "python_test":   File "/workspace/.env/lib/python3.7/site-packages/gspread/__init__.py", line 7, in <module>
Step #1 - "python_test":     from .auth import (
Step #1 - "python_test":   File "/workspace/.env/lib/python3.7/site-packages/gspread/auth.py", line 19, in <module>
Step #1 - "python_test":     from .client import Client
Step #1 - "python_test":   File "/workspace/.env/lib/python3.7/site-packages/gspread/client.py", line 17, in <module>
Step #1 - "python_test":     from .spreadsheet import Spreadsheet
Step #1 - "python_test":   File "/workspace/.env/lib/python3.7/site-packages/gspread/spreadsheet.py", line 15, in <module>
Step #1 - "python_test":     from .worksheet import Worksheet
Step #1 - "python_test":   File "/workspace/.env/lib/python3.7/site-packages/gspread/worksheet.py", line 11, in <module>
Step #1 - "python_test":     from typing import (
Step #1 - "python_test": ImportError: cannot import name 'Literal' from 'typing' (/usr/local/lib/python3.7/typing.py)
Step #1 - "python_test": 
Step #1 - "python_test": 
Step #1 - "python_test": ----------------------------------------------------------------------
Step #1 - "python_test": Ran 56 tests in 4.480s
Step #1 - "python_test": 
Step #1 - "python_test": FAILED (errors=1)
Step #1 - "python_test": ### Running Python tests in import-automation/executor
Step #1 - "python_test": Installing Python requirements
Step #1 - "python_test": 
Step #1 - "python_test": [notice] A new release of pip is available: 23.0.1 -> 24.0
Step #1 - "python_test": [notice] To update, run: pip install --upgrade pip
Step #1 - "python_test": #### Testing Python code in import-automation/executor
Step #1 - "python_test": test_appengine_job_request (test.cloud_scheduler_test.CloudSchedulerTest) ... ok
Step #1 - "python_test": test_http_job_request (test.cloud_scheduler_test.CloudSchedulerTest) ... ok
Step #1 - "python_test": test.file_uploader_test (unittest.loader._FailedTest) ... ERROR
Step #1 - "python_test": test.github_api_test (unittest.loader._FailedTest) ... ERROR
Step #1 - "python_test": test_clean_time (test.import_executor_test.ImportExecutorTest) ... ok
Step #1 - "python_test": test_construct_process_message (test.import_executor_test.ImportExecutorTest) ... ok
Step #1 - "python_test": test_construct_process_message_no_output (test.import_executor_test.ImportExecutorTest)
Step #1 - "python_test": Tests that _construct_process_message does not append ... ok
Step #1 - "python_test": test_create_venv (test.import_executor_test.ImportExecutorTest) ... ok
Step #1 - "python_test": test_run_and_handle_exception (test.import_executor_test.ImportExecutorTest) ... ERROR:root:An unexpected exception was thrown
Step #1 - "python_test": Traceback (most recent call last):
Step #1 - "python_test":   File "/workspace/import-automation/executor/app/executor/import_executor.py", line 456, in run_and_handle_exception
Step #1 - "python_test":     return exec_func(*args)
Step #1 - "python_test": TypeError: 'str' object is not callable
Step #1 - "python_test": FAIL
Step #1 - "python_test": test_run_with_timeout (test.import_executor_test.ImportExecutorTest) ... ERROR:root:An unexpected exception was thrown: Command '['sleep', '5']' timed out after 0.1 seconds when running ['sleep', '5']: Traceback (most recent call last):
Step #1 - "python_test":   File "/workspace/import-automation/executor/app/executor/import_executor.py", line 560, in _run_with_timeout
Step #1 - "python_test":     env=env)
Step #1 - "python_test":   File "/usr/local/lib/python3.7/subprocess.py", line 490, in run
Step #1 - "python_test":     stdout, stderr = process.communicate(input, timeout=timeout)
Step #1 - "python_test":   File "/usr/local/lib/python3.7/subprocess.py", line 964, in communicate
Step #1 - "python_test":     stdout, stderr = self._communicate(input, endtime, timeout)
Step #1 - "python_test":   File "/usr/local/lib/python3.7/subprocess.py", line 1732, in _communicate
Step #1 - "python_test":     self._check_timeout(endtime, orig_timeout, stdout, stderr)
Step #1 - "python_test":   File "/usr/local/lib/python3.7/subprocess.py", line 1011, in _check_timeout
Step #1 - "python_test":     stderr=b''.join(stderr_seq) if stderr_seq else None)
Step #1 - "python_test": subprocess.TimeoutExpired: Command '['sleep', '5']' timed out after 0.1 seconds
Step #1 - "python_test": Traceback (most recent call last):
Step #1 - "python_test":   File "/workspace/import-automation/executor/app/executor/import_executor.py", line 560, in _run_with_timeout
Step #1 - "python_test":     env=env)
Step #1 - "python_test":   File "/usr/local/lib/python3.7/subprocess.py", line 490, in run
Step #1 - "python_test":     stdout, stderr = process.communicate(input, timeout=timeout)
Step #1 - "python_test":   File "/usr/local/lib/python3.7/subprocess.py", line 964, in communicate
Step #1 - "python_test":     stdout, stderr = self._communicate(input, endtime, timeout)
Step #1 - "python_test":   File "/usr/local/lib/python3.7/subprocess.py", line 1732, in _communicate
Step #1 - "python_test":     self._check_timeout(endtime, orig_timeout, stdout, stderr)
Step #1 - "python_test":   File "/usr/local/lib/python3.7/subprocess.py", line 1011, in _check_timeout
Step #1 - "python_test":     stderr=b''.join(stderr_seq) if stderr_seq else None)
Step #1 - "python_test": subprocess.TimeoutExpired: Command '['sleep', '5']' timed out after 0.1 seconds
Step #1 - "python_test": FAIL
Step #1 - "python_test": test_are_imports_finished (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_block_on_import (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_fix_input_path (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_format_import_info (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_get_fixed_absolute_import_name (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_get_import_id (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_smart_import (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_absolute_import_name (test.import_target_test.ImportTargetTest) ... ok
Step #1 - "python_test": test_is_import_targetted_by_commit (test.import_target_test.ImportTargetTest) ... ok
Step #1 - "python_test": test_parse_commit_message_targets (test.import_target_test.ImportTargetTest) ... ok
Step #1 - "python_test": test.integration_test (unittest.loader._FailedTest) ... ERROR
Step #1 - "python_test": test_download_file (test.utils_test.AppUtilsTest)
Step #1 - "python_test": Response does not have a Content-Disposition header. ... ok
Step #1 - "python_test": test_download_file_timeout (test.utils_test.AppUtilsTest)
Step #1 - "python_test": Raises requests.Timeout exception. ... ok
Step #1 - "python_test": test_get_filename (test.utils_test.AppUtilsTest) ... ok
Step #1 - "python_test": test_get_filename_raise (test.utils_test.AppUtilsTest) ... ok
Step #1 - "python_test": test_pacific_time_to_datetime (test.utils_test.AppUtilsTest)
Step #1 - "python_test": Tests that the string returned by pacific_time can be converted to ... ok
Step #1 - "python_test": test_pacific_time_to_datetime_then_back (test.utils_test.AppUtilsTest)
Step #1 - "python_test": Tests that the string returned by pacific_time can be converted to ... ok
Step #1 - "python_test": test_compare_lines (test.utils_test.TestUtilsTest) ... ok
Step #1 - "python_test": test_import_spec_valid (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_spec_valid_fields_absent (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_spec_valid_script_not_exist (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_targets_valid_absolute_names (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_targets_valid_manifest_not_exist (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_targets_valid_name_not_exist (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_targets_valid_relative_names (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_targets_valid_relative_names_multiple_dirs (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_manifest_valid_fields_absent (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": 
Step #1 - "python_test": ======================================================================
Step #1 - "python_test": ERROR: test.file_uploader_test (unittest.loader._FailedTest)
Step #1 - "python_test": ----------------------------------------------------------------------
Step #1 - "python_test": ImportError: Failed to import test module: test.file_uploader_test
Step #1 - "python_test": Traceback (most recent call last):
Step #1 - "python_test":   File "/usr/local/lib/python3.7/unittest/loader.py", line 436, in _find_test_path
Step #1 - "python_test":     module = self._get_module_from_name(name)
Step #1 - "python_test":   File "/usr/local/lib/python3.7/unittest/loader.py", line 377, in _get_module_from_name
Step #1 - "python_test":     __import__(name)
Step #1 - "python_test":   File "/workspace/import-automation/executor/test/file_uploader_test.py", line 22, in <module>
Step #1 - "python_test":     from test import integration_test
Step #1 - "python_test":   File "/workspace/import-automation/executor/test/integration_test.py", line 30, in <module>
Step #1 - "python_test":     'github_repo_owner_username': os.environ['_GITHUB_REPO_OWNER_USERNAME'],
Step #1 - "python_test":   File "/usr/local/lib/python3.7/os.py", line 681, in __getitem__
Step #1 - "python_test":     raise KeyError(key) from None
Step #1 - "python_test": KeyError: '_GITHUB_REPO_OWNER_USERNAME'
Step #1 - "python_test": 
Step #1 - "python_test": 
Step #1 - "python_test": ======================================================================
Step #1 - "python_test": ERROR: test.github_api_test (unittest.loader._FailedTest)
Step #1 - "python_test": ----------------------------------------------------------------------
Step #1 - "python_test": ImportError: Failed to import test module: test.github_api_test
Step #1 - "python_test": Traceback (most recent call last):
Step #1 - "python_test":   File "/usr/local/lib/python3.7/unittest/loader.py", line 436, in _find_test_path
Step #1 - "python_test":     module = self._get_module_from_name(name)
Step #1 - "python_test":   File "/usr/local/lib/python3.7/unittest/loader.py", line 377, in _get_module_from_name
Step #1 - "python_test":     __import__(name)
Step #1 - "python_test":   File "/workspace/import-automation/executor/test/github_api_test.py", line 28, in <module>
Step #1 - "python_tes
...
[Logs truncated due to log size limitations. For full logs, see https://console.cloud.google.com/cloud-build/builds/73adba86-2f3f-4c2f-8a04-9ead5c39a3c6?project=879489846695.]
...
d_month,
Step #2 - "python_format_check": +            'DateEstablished-Day': d1_established_day,
Step #2 - "python_format_check": +            'ConceptID': conceptID,
Step #2 - "python_format_check": +            'ConceptName': conceptName,
Step #2 - "python_format_check": +            'TermID': termUI,
Step #2 - "python_format_check": +            'TermName': termName,
Step #2 - "python_format_check": +            'TreeNumber': tree_num
Step #2 - "python_format_check": +        })
Step #2 - "python_format_check":      df = pd.DataFrame(d)
Step #2 - "python_format_check":      return df
Step #2 - "python_format_check":  
Step #2 - "python_format_check": +
Step #2 - "python_format_check":  def check_for_illegal_charc(s):
Step #2 - "python_format_check":      """Checks for illegal characters in a string and prints an error statement if any are present
Step #2 - "python_format_check":      Args:
Step #2 - "python_format_check":          s: target string that needs to be checked
Step #2 - "python_format_check":      
Step #2 - "python_format_check":      """
Step #2 - "python_format_check": -    list_illegal = ["'", "*" ">", "<", "@", "]", "[", "|", ":", ";" " "]
Step #2 - "python_format_check": +    list_illegal = ["'", "*"
Step #2 - "python_format_check": +                    ">", "<", "@", "]", "[", "|", ":", ";"
Step #2 - "python_format_check": +                    " "]
Step #2 - "python_format_check":      if any([x in s for x in list_illegal]):
Step #2 - "python_format_check":          print('Error! dcid contains illegal characters!', s)
Step #2 - "python_format_check": +
Step #2 - "python_format_check":  
Step #2 - "python_format_check":  def check_for_dcid_qualifier_supp(row):
Step #2 - "python_format_check":      check_for_illegal_charc(str(row['Qualifier_dcid']))
Step #2 - "python_format_check":      return row
Step #2 - "python_format_check": +
Step #2 - "python_format_check":  
Step #2 - "python_format_check":  def check_for_dcid_qualifier_concept(row):
Step #2 - "python_format_check":      check_for_illegal_charc(str(row['Qualifier_dcid']))
Step #2 - "python_format_check":      check_for_illegal_charc(str(row['Concept_dcid']))
Step #2 - "python_format_check":      return row
Step #2 - "python_format_check":  
Step #2 - "python_format_check": +
Step #2 - "python_format_check":  def check_for_dcid_concept_term(row):
Step #2 - "python_format_check":      check_for_illegal_charc(str(row['Term_dcid']))
Step #2 - "python_format_check":      check_for_illegal_charc(str(row['Concept_dcid']))
Step #2 - "python_format_check":      return row
Step #2 - "python_format_check": +
Step #2 - "python_format_check":  
Step #2 - "python_format_check":  def date_modify(df1):
Step #2 - "python_format_check":      """
Step #2 - "python_format_check": @@ -158,7 +179,7 @@
Step #2 - "python_format_check":      ## adds quotes from text type columns and replaces "nan" with np.nan
Step #2 - "python_format_check":      col_names_quote = ['DateCreated', 'DateRevised', 'DateEstablished']
Step #2 - "python_format_check":      for col in col_names_quote:
Step #2 - "python_format_check": -        df1[col] = df1[col].replace(["nan-nan-nan"],np.nan)
Step #2 - "python_format_check": +        df1[col] = df1[col].replace(["nan-nan-nan"], np.nan)
Step #2 - "python_format_check":      ## drop repetitive column values
Step #2 - "python_format_check":      df1 = df1.drop(columns=[
Step #2 - "python_format_check":          'DateCreated-Year', 'DateCreated-Month', 'DateCreated-Day',
Step #2 - "python_format_check": @@ -167,6 +188,7 @@
Step #2 - "python_format_check":      ])
Step #2 - "python_format_check":      return df1
Step #2 - "python_format_check":  
Step #2 - "python_format_check": +
Step #2 - "python_format_check":  def format_qualifier_df(df):
Step #2 - "python_format_check":      """
Step #2 - "python_format_check":      Modifies the original dataframe to retain all
Step #2 - "python_format_check": @@ -178,19 +200,20 @@
Step #2 - "python_format_check":      """
Step #2 - "python_format_check":      df_1 = df
Step #2 - "python_format_check":      ## drops columns not required for the descriptor file
Step #2 - "python_format_check": -    df_1 = df_1.drop(columns=['DateCreated', 'DateRevised', 'DateEstablished',
Step #2 - "python_format_check": -        'ConceptID', 'ConceptName', 'TermID', 'TermName'
Step #2 - "python_format_check": +    df_1 = df_1.drop(columns=[
Step #2 - "python_format_check": +        'DateCreated', 'DateRevised', 'DateEstablished', 'ConceptID',
Step #2 - "python_format_check": +        'ConceptName', 'TermID', 'TermName'
Step #2 - "python_format_check":      ])
Step #2 - "python_format_check":      ## splits the descriptors with multiple tree numbers, into multiple rows
Step #2 - "python_format_check": -    df_1 = df_1.apply(lambda x: x.explode() if x.name in
Step #2 - "python_format_check": -                      ['TreeNumber'] else x)
Step #2 - "python_format_check": +    df_1 = df_1.apply(lambda x: x.explode() if x.name in ['TreeNumber'] else x)
Step #2 - "python_format_check":      df_1['TreeNumber'] = '"' + df_1.TreeNumber + '"'
Step #2 - "python_format_check":      ## creates descriptor dcid
Step #2 - "python_format_check":      df_1['Qualifier_dcid'] = 'bio/' + df_1['QualifierID'].astype(str)
Step #2 - "python_format_check":      ## drops the duplicate rows
Step #2 - "python_format_check":      df_1 = df_1.drop_duplicates()
Step #2 - "python_format_check": -    df_1 = df_1.apply(lambda x: check_for_dcid_qualifier_supp(x),axis=1)
Step #2 - "python_format_check": +    df_1 = df_1.apply(lambda x: check_for_dcid_qualifier_supp(x), axis=1)
Step #2 - "python_format_check":      return df_1
Step #2 - "python_format_check": +
Step #2 - "python_format_check":  
Step #2 - "python_format_check":  def format_concept_df(df1):
Step #2 - "python_format_check":      """
Step #2 - "python_format_check": @@ -203,8 +226,10 @@
Step #2 - "python_format_check":      """
Step #2 - "python_format_check":      df_3 = df1
Step #2 - "python_format_check":      ## drops columns not required for the concept file
Step #2 - "python_format_check": -    df_3 = df_3.drop(columns=['DateCreated', 'DateRevised', 'DateEstablished',
Step #2 - "python_format_check": -        'TermID', 'TermName', 'TreeNumber'])
Step #2 - "python_format_check": +    df_3 = df_3.drop(columns=[
Step #2 - "python_format_check": +        'DateCreated', 'DateRevised', 'DateEstablished', 'TermID', 'TermName',
Step #2 - "python_format_check": +        'TreeNumber'
Step #2 - "python_format_check": +    ])
Step #2 - "python_format_check":      ## unzips the concept name and concept IDs list
Step #2 - "python_format_check":      df_3 = df_3.apply(lambda x: x.explode()
Step #2 - "python_format_check":                        if x.name in ['ConceptID', 'ConceptName'] else x)
Step #2 - "python_format_check": @@ -216,8 +241,9 @@
Step #2 - "python_format_check":      df_3['Qualifier_dcid'] = 'bio/' + df_3['QualifierID'].astype(str)
Step #2 - "python_format_check":      ## drops the duplicate rows
Step #2 - "python_format_check":      df_3 = df_3.drop_duplicates()
Step #2 - "python_format_check": -    df_3 = df_3.apply(lambda x: check_for_dcid_qualifier_concept(x),axis=1)
Step #2 - "python_format_check": +    df_3 = df_3.apply(lambda x: check_for_dcid_qualifier_concept(x), axis=1)
Step #2 - "python_format_check":      return df_3
Step #2 - "python_format_check": +
Step #2 - "python_format_check":  
Step #2 - "python_format_check":  def format_term_df(df):
Step #2 - "python_format_check":      """
Step #2 - "python_format_check": @@ -231,7 +257,8 @@
Step #2 - "python_format_check":      df_4 = df
Step #2 - "python_format_check":      ## drops columns not required for the term file
Step #2 - "python_format_check":      df_4 = df_4.drop(columns=[
Step #2 - "python_format_check": -        'DateCreated', 'DateRevised', 'DateEstablished', 'TreeNumber', 'QualifierID'
Step #2 - "python_format_check": +        'DateCreated', 'DateRevised', 'DateEstablished', 'TreeNumber',
Step #2 - "python_format_check": +        'QualifierID'
Step #2 - "python_format_check":      ])
Step #2 - "python_format_check":      ## unzips the list of columns, namely concept and term ID and name
Step #2 - "python_format_check":      df_4 = df_4.apply(lambda x: x.explode() if x.name in
Step #2 - "python_format_check": @@ -243,13 +270,14 @@
Step #2 - "python_format_check":      ## adds quotes from text type columns and replaces "nan" with np.nan
Step #2 - "python_format_check":      for col in col_names_quote:
Step #2 - "python_format_check":          df_4.update('"' + df_4[[col]].astype(str) + '"')
Step #2 - "python_format_check": -        df_4[col] = df_4[col].replace(["\"nan\""],np.nan)
Step #2 - "python_format_check": +        df_4[col] = df_4[col].replace(["\"nan\""], np.nan)
Step #2 - "python_format_check":      ## generates term and concept dcids
Step #2 - "python_format_check":      df_4['Term_dcid'] = 'bio/' + df_4['TermID'].astype(str)
Step #2 - "python_format_check":      df_4['Concept_dcid'] = 'bio/' + df_4['ConceptID'].astype(str)
Step #2 - "python_format_check":      df_4 = df_4.drop_duplicates()
Step #2 - "python_format_check": -    df_4 = df_4.apply(lambda x: check_for_dcid_concept_term(x),axis=1)
Step #2 - "python_format_check": +    df_4 = df_4.apply(lambda x: check_for_dcid_concept_term(x), axis=1)
Step #2 - "python_format_check":      return df_4
Step #2 - "python_format_check": +
Step #2 - "python_format_check":  
Step #2 - "python_format_check":  def main():
Step #2 - "python_format_check":  
Step #2 - "python_format_check": @@ -259,8 +287,12 @@
Step #2 - "python_format_check":      df1_qual = format_qualifier_df(df1)
Step #2 - "python_format_check":      df1_concept = format_concept_df(df1)
Step #2 - "python_format_check":      df1_term = format_term_df(df1)
Step #2 - "python_format_check": -    df1_qual.to_csv('mesh_qualifier_supp.csv', doublequote=False, escapechar='\\')
Step #2 - "python_format_check": -    df1_concept.to_csv('mesh_qualifier_concept.csv', doublequote=False, escapechar='\\')
Step #2 - "python_format_check": +    df1_qual.to_csv('mesh_qualifier_supp.csv',
Step #2 - "python_format_check": +                    doublequote=False,
Step #2 - "python_format_check": +                    escapechar='\\')
Step #2 - "python_format_check": +    df1_concept.to_csv('mesh_qualifier_concept.csv',
Step #2 - "python_format_check": +                       doublequote=False,
Step #2 - "python_format_check": +                       escapechar='\\')
Step #2 - "python_format_check":      df1_term.to_csv('mesh_concept_term.csv', doublequote=False, escapechar='\\')
Step #2 - "python_format_check":  
Step #2 - "python_format_check":  
Step #1 - "python_test": test_place (nasa.cmip6_sea_level.process_test.ProcessTest) ... ok
Step #1 - "python_test": test_stat (nasa.cmip6_sea_level.process_test.ProcessTest) ... ok
Step #1 - "python_test": test_sv (nasa.cmip6_sea_level.process_test.ProcessTest) ... ok
Step #1 - "python_test": test_id_map (ocha.geodata.generate_test.GenerateTest) ... ok
Step #1 - "python_test": test_mcf (ocha.geodata.generate_test.GenerateTest) ... ok
Step #1 - "python_test": test_create_csv (ourworldindata.covid19.preprocess_csv_test.TestPreprocessCsvTest) ... ok
Step #1 - "python_test": test_create_tmcf (ourworldindata.covid19.preprocess_csv_test.TestPreprocessCsvTest) ... ok
Step #1 - "python_test": test_un_energy_process (un.energy.process_test.TestUNEnergyProcess)
Step #1 - "python_test": Test the process() function for UN energy data set. ... [ 2024-03-05 18:08:59.429385 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.431322 ]  Error:  warning_duplicate_obs_dropped Duplicate value 850- for SVO: dcid:Annual_Generation_Fuel_BioGasoline-country/ARG-2019, prev: 850-
Step #1 - "python_test": [ 2024-03-05 18:08:59.431634 ]  Error:  warning_duplicate_obs_dropped Duplicate value 842- for SVO: dcid:Annual_Consumption_Fuel_BioGasoline-country/ARG-2019, prev: 842-
Step #1 - "python_test": [ 2024-03-05 18:08:59.432426 ]  Error:  warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.434169 ]  Error:  warning_ignoring_country_code_579 Country ignored: 579, name: Norway
Step #1 - "python_test": [ 2024-03-05 18:08:59.436906 ]  Error:  warning_ignoring_country_code_757 Country ignored: 757, name: Switzerland
Step #1 - "python_test": [ 2024-03-05 18:08:59.447673 ]  Error:  warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.456167 ]  Error:  warning_duplicate_obs_dropped Duplicate value 102.14- for SVO: dcid:Annual_Consumption_Fuel_AnthraciteCoal-country/ALB-2019, prev: 102.14-
Step #1 - "python_test": [ 2024-03-05 18:08:59.460731 ]  Error:  warning_ignoring_country_code_176 Country ignored: 176, name: Mayotte
Step #1 - "python_test": [ 2024-03-05 18:08:59.462045 ]  Error:  warning_ignoring_country_code_230 Country ignored: 230, name: Ethiopia, incl. Eritrea
Step #1 - "python_test": [ 2024-03-05 18:08:59.462545 ]  Error:  warning_ignoring_country_code_255 Country ignored: 255, name: French Guiana
Step #1 - "python_test": [ 2024-03-05 18:08:59.463150 ]  Error:  warning_ignoring_country_code_280 Country ignored: 280, name: Germany, Fed. R. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.464291 ]  Error:  warning_ignoring_country_code_313 Country ignored: 313, name: Guadeloupe
Step #1 - "python_test": [ 2024-03-05 18:08:59.468458 ]  Error:  warning_ignoring_country_code_475 Country ignored: 475, name: Martinique
Step #1 - "python_test": [ 2024-03-05 18:08:59.470058 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Consumption_Fuel_AviationGasoline-country/AFG-1992, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.473735 ]  Error:  warning_ignoring_country_code_720 Country ignored: 720, name: Yemen, Dem. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.475007 ]  Error:  warning_ignoring_country_code_810 Country ignored: 810, name: USSR (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.477366 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.477416 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.477457 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.479571 ]  Error:  warning_duplicate_obs_dropped Duplicate value 1289.328- for SVO: dcid:Annual_Generation_Fuel_AnimalWaste-country/ARM-2018, prev: 1289.328-
Step #1 - "python_test": [ 2024-03-05 18:08:59.479701 ]  Error:  warning_duplicate_obs_dropped Duplicate value 1289.328- for SVO: dcid:Annual_Consumption_Fuel_AnimalWaste-country/ARM-2018, prev: 1289.328-
Step #1 - "python_test": [ 2024-03-05 18:08:59.480805 ]  Error:  warning_ignoring_country_code_891 Country ignored: 891, name: Serbia and Montenegro
Step #1 - "python_test": [ 2024-03-05 18:08:59.482422 ]  Error:  warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.482838 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.483452 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.483517 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.485023 ]  Error:  warning_ignoring_country_code_278 Country ignored: 278, name: German Dem. R. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.485269 ]  Error:  warning_ignoring_country_code_278 Country ignored: 278, name: German Dem. R. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.496058 ]  Error:  warning_duplicate_obs_dropped Duplicate value 391.27- for SVO: dcid:Annual_Consumption_Fuel_BrownCoalBriquettes-country/ALB-2014, prev: 391.27-
Step #1 - "python_test": [ 2024-03-05 18:08:59.497657 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.497727 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.497788 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.497849 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.497911 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.497970 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.498034 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.498105 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.502202 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_PatentFuel-country/AFG-1992, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.503490 ]  Error:  warning_duplicate_obs_dropped Duplicate value 1.114- for SVO: dcid:Annual_Consumption_Fuel_PatentFuel-country/ARM-2018, prev: 1.114-
Step #1 - "python_test": [ 2024-03-05 18:08:59.512325 ]  Error:  warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.519908 ]  Error:  warning_duplicate_obs_dropped Duplicate value 130- for SVO: dcid:Annual_Consumption_Fuel_BioDiesel-country/ALB-2019, prev: 130-
Step #1 - "python_test": [ 2024-03-05 18:08:59.521051 ]  Error:  warning_duplicate_obs_dropped Duplicate value 5844- for SVO: dcid:Annual_Generation_Fuel_BlastFurnaceGas-country/DZA-2018, prev: 5844-
Step #1 - "python_test": [ 2024-03-05 18:08:59.521178 ]  Error:  warning_duplicate_obs_dropped Duplicate value 1832- for SVO: dcid:Annual_Consumption_Fuel_BlastFurnaceGas-country/DZA-2018, prev: 1832-
Step #1 - "python_test": [ 2024-03-05 18:08:59.522083 ]  Error:  warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.522540 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.529233 ]  Error:  warning_duplicate_obs_dropped Duplicate value 16219- for SVO: dcid:Annual_Generation_Fuel_BioGas-country/AUS-2019, prev: 16219-
Step #1 - "python_test": [ 2024-03-05 18:08:59.529366 ]  Error:  warning_duplicate_obs_dropped Duplicate value 1470- for SVO: dcid:Annual_Consumption_Fuel_BioGas-country/AUS-2018, prev: 1470-
Step #1 - "python_test": [ 2024-03-05 18:08:59.533256 ]  Error:  warning_ignoring_country_code_579 Country ignored: 579, name: Norway
Step #1 - "python_test": [ 2024-03-05 18:08:59.533430 ]  Error:  warning_ignoring_country_code_639 Country ignored: 639, name: Reunion
Step #1 - "python_test": [ 2024-03-05 18:08:59.533489 ]  Error:  warning_ignoring_country_code_757 Country ignored: 757, name: Switzerland
Step #1 - "python_test": [ 2024-03-05 18:08:59.534514 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_BioJetKerosene-country/FIN-2015, prev: 1-
Step #1 - "python_test": [ 2024-03-05 18:08:59.538226 ]  Error:  warning_duplicate_obs_dropped Duplicate value 3725- for SVO: dcid:Annual_Generation_Fuel_OtherRecoveredGases-country/AUT-2019, prev: 3725-
Step #1 - "python_test": [ 2024-03-05 18:08:59.538495 ]  Error:  warning_duplicate_obs_dropped Duplicate value 103- for SVO: dcid:Annual_Consumption_Fuel_OtherRecoveredGases-country/AUT-2018, prev: 103-
Step #1 - "python_test": [ 2024-03-05 18:08:59.543791 ]  Error:  warning_duplicate_obs_dropped Duplicate value 766.2- for SVO: dcid:Annual_Generation_Fuel_PeatProducts-country/BLR-2019, prev: 960.2-
Step #1 - "python_test": [ 2024-03-05 18:08:59.544131 ]  Error:  warning_duplicate_obs_dropped Duplicate value 695- for SVO: dcid:Annual_Consumption_Fuel_PeatProducts-country/BLR-2019, prev: 695-
Step #1 - "python_test": [ 2024-03-05 18:08:59.549376 ]  Error:  warning_duplicate_obs_dropped Duplicate value 471.222-1 for SVO: dcid:Annual_Generation_Fuel_Bagasse-country/AGO-2018, prev: 471.222-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.549527 ]  Error:  warning_duplicate_obs_dropped Duplicate value 160.425- for SVO: dcid:Annual_Consumption_Fuel_Bagasse-country/AGO-2018, prev: 160.425-
Step #1 - "python_test": [ 2024-03-05 18:08:59.551786 ]  Error:  warning_ignoring_country_code_639 Country ignored: 639, name: Reunion
Step #1 - "python_test": [ 2024-03-05 18:08:59.561871 ]  Error:  warning_duplicate_obs_dropped Duplicate value 36.78- for SVO: dcid:Annual_Generation_Fuel_BituminousCoal-country/ALB-2019, prev: 104.58-
Step #2 - "python_format_check": ERROR: Fix lint errors by running ./run_tests.sh -f
Step #1 - "python_test": [ 2024-03-05 18:08:59.568888 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0.005- for SVO: dcid:Annual_Consumption_Fuel_CokingCoal-country/ARM-2018, prev: 0.004-
Step #1 - "python_test": [ 2024-03-05 18:08:59.579314 ]  Error:  warning_duplicate_obs_dropped Duplicate value 136.883- for SVO: dcid:Annual_Generation_Fuel_Charcoal-country/AFG-2019, prev: 136.841-
Step #1 - "python_test": [ 2024-03-05 18:08:59.579477 ]  Error:  warning_duplicate_obs_dropped Duplicate value 136.883-1 for SVO: dcid:Annual_Consumption_Fuel_Charcoal-country/AFG-2019, prev: 136.883-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.596235 ]  Error:  warning_duplicate_obs_dropped Duplicate value 1367- for SVO: dcid:Annual_Generation_Fuel_HardCoal-country/AFG-2019, prev: 2139-
Step #1 - "python_test": [ 2024-03-05 18:08:59.596496 ]  Error:  warning_duplicate_obs_dropped Duplicate value 1229-1 for SVO: dcid:Annual_Consumption_Fuel_HardCoal-country/AFG-2019, prev: 1229-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.599000 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0.0008-1 for SVO: dcid:Annual_Consumption_Fuel_CoalProducts-country/BMU-2018, prev: 0.0008-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.601312 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Consumption_Fuel_CrudeOil-country/DZA-2016, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.611569 ]  Error:  warning_ignoring_country_code_886 Country ignored: 886, name: Yemen Arab Rep. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.615703 ]  Error:  warning_duplicate_obs_dropped Duplicate value 335.274- for SVO: dcid:Annual_Generation_Fuel_CrudeOil-country/ALB-2019, prev: 1005.09-
Step #1 - "python_test": [ 2024-03-05 18:08:59.622429 ]  Error:  warning_duplicate_obs_dropped Duplicate value 154- for SVO: dcid:Annual_Generation_Fuel_CoalTar-country/AUS-2019, prev: 154-
Step #1 - "python_test": [ 2024-03-05 18:08:59.622893 ]  Error:  warning_duplicate_obs_dropped Duplicate value 161- for SVO: dcid:Annual_Consumption_Fuel_CoalTar-country/AUS-2018, prev: 161-
Step #1 - "python_test": [ 2024-03-05 18:08:59.626963 ]  Error:  warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.636893 ]  Error:  warning_duplicate_obs_dropped Duplicate value 379.9-1 for SVO: dcid:Annual_Consumption_Fuel_DieselOil-country/AFG-2019, prev: 379.9-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.650181 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_Ethane-country/DZA-2016, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.650636 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.650695 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.650788 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.650836 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.650883 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.652788 ]  Error:  warning_ignoring_country_code_579 Country ignored: 579, name: Norway
Step #1 - "python_test": [ 2024-03-05 18:08:59.652853 ]  Error:  warning_ignoring_country_code_579 Country ignored: 579, name: Norway
Step #1 - "python_test": [ 2024-03-05 18:08:59.667063 ]  Error:  warning_ignored_stat_var_duplicate_production_01 Invalid statVar {'typeOf': 'dcs:StatisticalVariable', 'measurementQualifier': 'dcs:Annual', 'populationType': 'dcs:Energy', 'statType': 'dcs:measuredValue'} for row OrderedDict([('Commodity Code', 'EL'), ('Country or Area Code', '4'), ('Country or Area', 'Afghanistan'), ('Transaction Code', '019'), ('Commodity - Transaction Code', 'EL019'), ('Commodity - Transaction', 'Electricity - net production'), ('Year', '2019'), ('Unit', 'Kilowatt-hours, million'), ('Quantity', '1230500000.0'), ('Quantity Footnotes', '1'), ('_File', '/workspace/scripts/un/energy/test_data/un_energy_input.csv'), ('_Row', 1168), ('Country_dcid', 'dcs:country/AFG'), ('Unit_dcid', 'KilowattHour'), ('Estimate', 'UNStatsEstimate')])
Step #1 - "python_test": [ 2024-03-05 18:08:59.668652 ]  Error:  warning_duplicate_obs_dropped Duplicate value 6142.5- for SVO: dcid:Annual_Generation_Electricity-country/AFG-2019, prev: 1591.5-
Step #1 - "python_test": [ 2024-03-05 18:08:59.695968 ]  Error:  warning_duplicate_obs_dropped Duplicate value 1856.608- for SVO: dcid:Annual_Generation_Fuel_Fuelwood-country/AFG-2019, prev: 1856.559-
Step #1 - "python_test": [ 2024-03-05 18:08:59.696730 ]  Error:  warning_duplicate_obs_dropped Duplicate value 1035.562-1 for SVO: dcid:Annual_Consumption_Fuel_Fuelwood-country/AFG-2019, prev: 1035.562-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.705555 ]  Error:  warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.705638 ]  Error:  warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.705766 ]  Error:  warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.705810 ]  Error:  warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.711788 ]  Error:  warning_duplicate_obs_dropped Duplicate value 38- for SVO: dcid:Annual_Consumption_Fuel_GasworksGas-country/AUS-2018, prev: 38-
Step #1 - "python_test": [ 2024-03-05 18:08:59.716070 ]  Error:  warning_duplicate_obs_dropped Duplicate value 1- for SVO: dcid:Annual_Consumption_Fuel_GasolineJetFuel-country/CAN-2016, prev: 1-
Step #1 - "python_test": [ 2024-03-05 18:08:59.717091 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_GasolineJetFuel-country/AGO-2019, prev: 20.406-
Step #1 - "python_test": [ 2024-03-05 18:08:59.717364 ]  Error:  warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.718847 ]  Error:  warning_duplicate_obs_dropped Duplicate value 202.6-1 for SVO: dcid:Annual_Consumption_Fuel_GasCoke-country/AFG-2019, prev: 202.6-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.724579 ]  Error:  warning_duplicate_obs_dropped Duplicate value 3- for SVO: dcid:Annual_Consumption_Fuel_NaturalGasLiquids-country/AUS-1995, prev: 3-
Step #1 - "python_test": [ 2024-03-05 18:08:59.726706 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_NaturalGasLiquids-country/AFG-1992, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.732501 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.732534 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.733358 ]  Error:  warning_duplicate_obs_dropped Duplicate value 4092- for SVO: dcid:Annual_Generation_Fuel_IndustrialWaste-country/AUS-2019, prev: 4092-
Step #1 - "python_test": [ 2024-03-05 18:08:59.733436 ]  Error:  warning_duplicate_obs_dropped Duplicate value 3785- for SVO: dcid:Annual_Consumption_Fuel_IndustrialWaste-country/AUS-2018, prev: 3785-
Step #1 - "python_test": [ 2024-03-05 18:08:59.736337 ]  Error:  warning_ignoring_country_code_579 Country ignored: 579, name: Norway
Step #1 - "python_test": [ 2024-03-05 18:08:59.738437 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.739267 ]  Error:  warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.740193 ]  Error:  warning_duplicate_obs_dropped Duplicate value 56.7-1 for SVO: dcid:Annual_Consumption_Fuel_KeroseneJetFuel-country/AFG-2019, prev: 56.7-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.744693 ]  Error:  warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.745759 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Consumption_Fuel_Kerosene-country/AFG-2019, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.747695 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.748359 ]  Error:  warning_ignoring_country_code_278 Country ignored: 278, name: German Dem. R. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.769925 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_BrownCoal-country/ALB-2014, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.770175 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Consumption_Fuel_BrownCoal-country/ALB-2014, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.775264 ]  Error:  warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.794781 ]  Error:  warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_LigniteCoal-country/ALB-2014, prev: 0-
Finished Step #2 - "python_format_check"
ERROR
ERROR: build step 2 "python:3.7" failed: step exited with non-zero status: 1
Step #1 - "python_test": [ 2024-03-05 18:08:59.794928 ]  Error:  warning_duplicate_obs_dropped

Build Log: https://console.cloud.google.com/cloud-build/builds/73adba86-2f3f-4c2f-8a04-9ead5c39a3c6?project=879489846695