Add MeSH data #507
+134,554
−0
Closed
Add MeSH data #507
Google Cloud Build / data-pull-request-py (datcom-ci)
failed
Mar 5, 2024 in 5m 10s
Summary
Build Information
Trigger | data-pull-request-py |
Build | 73adba86-2f3f-4c2f-8a04-9ead5c39a3c6 |
Start | 2024-03-05T10:04:04-08:00 |
Duration | 4m56.074s |
Status | FAILURE |
Steps
Step | Status | Duration |
---|---|---|
python_install | SUCCESS | 1m36.866s |
python_test | CANCELLED | 2m52.031s |
python_format_check | FAILURE | 2m51.273s |
Details
starting build "73adba86-2f3f-4c2f-8a04-9ead5c39a3c6"
FETCHSOURCE
hint: Using 'master' as the name for the initial branch. This default branch name
hint: is subject to change. To configure the initial branch name to use in all
hint: of your new repositories, which will suppress this warning, call:
hint:
hint: git config --global init.defaultBranch <name>
hint:
hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
hint: 'development'. The just-created branch can be renamed via this command:
hint:
hint: git branch -m <name>
Initialized empty Git repository in /workspace/.git/
From https://github.com/datacommonsorg/data
* branch 3b30247db9c9c942aae52fed291a6dd723634fbe -> FETCH_HEAD
Updating files: 26% (812/3011)
Updating files: 27% (813/3011)
Updating files: 28% (844/3011)
Updating files: 28% (872/3011)
Updating files: 29% (874/3011)
Updating files: 30% (904/3011)
Updating files: 31% (934/3011)
Updating files: 32% (964/3011)
Updating files: 33% (994/3011)
Updating files: 34% (1024/3011)
Updating files: 35% (1054/3011)
Updating files: 36% (1084/3011)
Updating files: 37% (1115/3011)
Updating files: 38% (1145/3011)
Updating files: 39% (1175/3011)
Updating files: 40% (1205/3011)
Updating files: 41% (1235/3011)
Updating files: 42% (1265/3011)
Updating files: 43% (1295/3011)
Updating files: 44% (1325/3011)
Updating files: 45% (1355/3011)
Updating files: 45% (1376/3011)
Updating files: 46% (1386/3011)
Updating files: 47% (1416/3011)
Updating files: 48% (1446/3011)
Updating files: 49% (1476/3011)
Updating files: 50% (1506/3011)
Updating files: 51% (1536/3011)
Updating files: 52% (1566/3011)
Updating files: 53% (1596/3011)
Updating files: 54% (1626/3011)
Updating files: 55% (1657/3011)
Updating files: 56% (1687/3011)
Updating files: 57% (1717/3011)
Updating files: 58% (1747/3011)
Updating files: 59% (1777/3011)
Updating files: 60% (1807/3011)
Updating files: 61% (1837/3011)
Updating files: 62% (1867/3011)
Updating files: 63% (1897/3011)
Updating files: 64% (1928/3011)
Updating files: 65% (1958/3011)
Updating files: 66% (1988/3011)
Updating files: 67% (2018/3011)
Updating files: 68% (2048/3011)
Updating files: 69% (2078/3011)
Updating files: 70% (2108/3011)
Updating files: 70% (2133/3011)
Updating files: 71% (2138/3011)
Updating files: 72% (2168/3011)
Updating files: 73% (2199/3011)
Updating files: 74% (2229/3011)
Updating files: 75% (2259/3011)
Updating files: 76% (2289/3011)
Updating files: 77% (2319/3011)
Updating files: 78% (2349/3011)
Updating files: 79% (2379/3011)
Updating files: 80% (2409/3011)
Updating files: 81% (2439/3011)
Updating files: 82% (2470/3011)
Updating files: 83% (2500/3011)
Updating files: 84% (2530/3011)
Updating files: 85% (2560/3011)
Updating files: 86% (2590/3011)
Updating files: 87% (2620/3011)
Updating files: 88% (2650/3011)
Updating files: 89% (2680/3011)
Updating files: 90% (2710/3011)
Updating files: 91% (2741/3011)
Updating files: 92% (2771/3011)
Updating files: 93% (2801/3011)
Updating files: 94% (2831/3011)
Updating files: 95% (2861/3011)
Updating files: 96% (2891/3011)
Updating files: 97% (2921/3011)
Updating files: 98% (2951/3011)
Updating files: 99% (2981/3011)
Updating files: 100% (3011/3011)
Updating files: 100% (3011/3011), done.
HEAD is now at 3b30247 Merge branch 'master' into add_mesh_data
BUILD
Starting Step #0 - "python_install"
Step #0 - "python_install": Pulling image: python:3.7
Step #0 - "python_install": 3.7: Pulling from library/python
Step #0 - "python_install": 167b8a53ca45: Pulling fs layer
Step #0 - "python_install": b47a222d28fa: Pulling fs layer
Step #0 - "python_install": debce5f9f3a9: Pulling fs layer
Step #0 - "python_install": 1d7ca7cd2e06: Pulling fs layer
Step #0 - "python_install": ff3119008f58: Pulling fs layer
Step #0 - "python_install": c2423a76a32b: Pulling fs layer
Step #0 - "python_install": e1c98ca4926a: Pulling fs layer
Step #0 - "python_install": 3b62c8e1d79b: Pulling fs layer
Step #0 - "python_install": 1d7ca7cd2e06: Waiting
Step #0 - "python_install": ff3119008f58: Waiting
Step #0 - "python_install": c2423a76a32b: Waiting
Step #0 - "python_install": e1c98ca4926a: Waiting
Step #0 - "python_install": 3b62c8e1d79b: Waiting
Step #0 - "python_install": b47a222d28fa: Verifying Checksum
Step #0 - "python_install": b47a222d28fa: Download complete
Step #0 - "python_install": 167b8a53ca45: Verifying Checksum
Step #0 - "python_install": 167b8a53ca45: Download complete
Step #0 - "python_install": debce5f9f3a9: Verifying Checksum
Step #0 - "python_install": debce5f9f3a9: Download complete
Step #0 - "python_install": ff3119008f58: Verifying Checksum
Step #0 - "python_install": ff3119008f58: Download complete
Step #0 - "python_install": c2423a76a32b: Verifying Checksum
Step #0 - "python_install": c2423a76a32b: Download complete
Step #0 - "python_install": e1c98ca4926a: Verifying Checksum
Step #0 - "python_install": e1c98ca4926a: Download complete
Step #0 - "python_install": 3b62c8e1d79b: Verifying Checksum
Step #0 - "python_install": 3b62c8e1d79b: Download complete
Step #0 - "python_install": 1d7ca7cd2e06: Verifying Checksum
Step #0 - "python_install": 1d7ca7cd2e06: Download complete
Step #0 - "python_install": 167b8a53ca45: Pull complete
Step #0 - "python_install": b47a222d28fa: Pull complete
Step #0 - "python_install": debce5f9f3a9: Pull complete
Step #0 - "python_install": 1d7ca7cd2e06: Pull complete
Step #0 - "python_install": ff3119008f58: Pull complete
Step #0 - "python_install": c2423a76a32b: Pull complete
Step #0 - "python_install": e1c98ca4926a: Pull complete
Step #0 - "python_install": 3b62c8e1d79b: Pull complete
Step #0 - "python_install": Digest: sha256:eedf63967cdb57d8214db38ce21f105003ed4e4d0358f02bedc057341bcf92a0
Step #0 - "python_install": Status: Downloaded newer image for python:3.7
Step #0 - "python_install": docker.io/library/python:3.7
Step #0 - "python_install": ### Installing Python requirements
Step #0 - "python_install": Installing Python requirements
Step #0 - "python_install": DEPRECATION: ratelimit is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
Step #0 - "python_install": DEPRECATION: func-timeout is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
Step #0 - "python_install": DEPRECATION: frozendict is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
Step #0 - "python_install": DEPRECATION: rdp is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
Step #0 - "python_install":
Step #0 - "python_install": [notice] A new release of pip is available: 23.0.1 -> 24.0
Step #0 - "python_install": [notice] To update, run: pip install --upgrade pip
Finished Step #0 - "python_install"
Starting Step #2 - "python_format_check"
Starting Step #1 - "python_test"
Step #2 - "python_format_check": Already have image (with digest): python:3.7
Step #1 - "python_test": Already have image (with digest): python:3.7
Step #2 - "python_format_check": ### Testing lint
Step #1 - "python_test": ### Running Python tests in util/
Step #1 - "python_test": Installing Python requirements
Step #2 - "python_format_check": Installing Python requirements
Step #2 - "python_format_check":
Step #2 - "python_format_check": [notice] A new release of pip is available: 23.0.1 -> 24.0
Step #2 - "python_format_check": [notice] To update, run: pip install --upgrade pip
Step #1 - "python_test":
Step #1 - "python_test": [notice] A new release of pip is available: 23.0.1 -> 24.0
Step #1 - "python_test": [notice] To update, run: pip install --upgrade pip
Step #2 - "python_format_check": #### Testing Python lint
Step #1 - "python_test": #### Testing Python code in util/
Step #1 - "python_test": test_aggregate_dict (aggregation_util_test.AggregationUtilTest) ... ok
Step #1 - "python_test": test_aggregate_value (aggregation_util_test.AggregationUtilTest) ... ok
Step #1 - "python_test": test_config_map_with_override (config_map_test.TestConfigMap) ... ok
Step #1 - "python_test": test_load_config_file (config_map_test.TestConfigMap)
Step #1 - "python_test": Test loading of config dictionary from a file. ... ok
Step #1 - "python_test": test_set_config (config_map_test.TestConfigMap) ... ok
Step #1 - "python_test": test_update_config (config_map_test.TestConfigMap) ... ok
Step #1 - "python_test": test_add_counter (counters_test.TestCounters)
Step #1 - "python_test": Verify increment and decrement counters. ... Counters:
Step #1 - "python_test": test_inputs = 10
Step #1 - "python_test": test_process_elapsed_time = 0.00
Step #1 - "python_test": test_processed = 0
Step #1 - "python_test": test_start_time = 167.19
Step #1 - "python_test": ok
Step #1 - "python_test": test_counter_dict (counters_test.TestCounters)
Step #1 - "python_test": Verify counter dict is shared across counters. ... Counters:
Step #1 - "python_test": process_elapsed_time = 0.00
Step #1 - "python_test": processed = 0
Step #1 - "python_test": start_time = 167.19
Step #1 - "python_test": test_ctr = 1
Step #1 - "python_test": ok
Step #1 - "python_test": test_debug_counters (counters_test.TestCounters)
Step #1 - "python_test": Verify counters with debug string suffixes. ... Counters:
Step #1 - "python_test": test3_inputs = 10
Step #1 - "python_test": test3_inputs_test-case-2 = 10
Step #1 - "python_test": test3_process_elapsed_time = 0.00
Step #1 - "python_test": test3_processed = 0
Step #1 - "python_test": test3_start_time = 167.20
Step #1 - "python_test": ok
Step #1 - "python_test": test_set_counter (counters_test.TestCounters)
Step #1 - "python_test": Verify set_counter overrides current value. ... Counters:
Step #1 - "python_test": test2_lines = 1
Step #1 - "python_test": test2_lines_file1 = 1
Step #1 - "python_test": test2_process_elapsed_time = 0.00
Step #1 - "python_test": test2_processed = 0
Step #1 - "python_test": test2_start_time = 167.20
Step #1 - "python_test": Counters:
Step #1 - "python_test": test2_lines = 11
Step #1 - "python_test": test2_lines_file1 = 11
Step #1 - "python_test": test2_process_elapsed_time = 0.00
Step #1 - "python_test": test2_processed = 0
Step #1 - "python_test": test2_start_time = 167.20
Step #1 - "python_test": ok
Step #1 - "python_test": test_show_counters (counters_test.TestCounters) ... Counters:
Step #1 - "python_test": test-file-rows = 100
Step #1 - "python_test": test-process_elapsed_time = 0.00
Step #1 - "python_test": test-process_remaining_time = 1000000.00
Step #1 - "python_test": test-read-rows = 0
Step #1 - "python_test": test-start_time = 167.20
Step #1 - "python_test": Counters:
Step #1 - "python_test": test-file-rows = 100
Step #1 - "python_test": test-process_elapsed_time = 0.00
Step #1 - "python_test": test-process_remaining_time = 0.00
Step #1 - "python_test": test-processing_rate = 59752.86
Step #1 - "python_test": test-read-rows = 10
Step #1 - "python_test": test-start_time = 167.20
Step #1 - "python_test": ok
Step #1 - "python_test": test_dc_api_batched_wrapper (dc_api_wrapper_test.TestDCAPIWrapper)
Step #1 - "python_test": Test DC API wrapper for batched calls. ... ok
Step #1 - "python_test": test_dc_api_is_defined_dcid (dc_api_wrapper_test.TestDCAPIWrapper)
Step #1 - "python_test": Test API wrapper for defined DCIDs. ... ok
Step #1 - "python_test": test_dc_api_wrapper (dc_api_wrapper_test.TestDCAPIWrapper)
Step #1 - "python_test": Test the wrapper for DC API. ... ok
Step #1 - "python_test": test_dc_get_node_property_values (dc_api_wrapper_test.TestDCAPIWrapper)
Step #1 - "python_test": Test API wrapper to get all property:values for a node. ... ok
Step #1 - "python_test": test_download_file (download_util_test.TestCounters) ... ok
Step #1 - "python_test": test_prefilled_url (download_util_test.TestCounters) ... ok
Step #1 - "python_test": test_request_url (download_util_test.TestCounters) ... ok
Step #1 - "python_test": file_util_test (unittest.loader._FailedTest) ... ERROR
Step #1 - "python_test": test_aa2 (latlng2place_mapsapi_test.Latlng2PlaceMapsAPITest) ... ok
Step #1 - "python_test": test_country (latlng2place_mapsapi_test.Latlng2PlaceMapsAPITest) ... ok
Step #1 - "python_test": test_main (latlng_recon_geojson_test.LatlngReconGeojsonTest) ... ok
Step #1 - "python_test": test_basic (latlng_recon_service_test.LatlngReconServiceTest) ... /usr/local/lib/python3.7/concurrent/futures/thread.py:57: ResourceWarning: unclosed <ssl.SSLSocket fd=5, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('192.168.10.3', 48994), raddr=('35.244.133.155', 443)>
Step #1 - "python_test": result = self.fn(*self.args, **self.kwargs)
Step #1 - "python_test": ResourceWarning: Enable tracemalloc to get the object allocation traceback
Step #1 - "python_test": ok
Step #1 - "python_test": test_filter (latlng_recon_service_test.LatlngReconServiceTest) ... /usr/local/lib/python3.7/concurrent/futures/thread.py:57: ResourceWarning: unclosed <ssl.SSLSocket fd=5, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('192.168.10.3', 49008), raddr=('35.244.133.155', 443)>
Step #1 - "python_test": result = self.fn(*self.args, **self.kwargs)
Step #1 - "python_test": ResourceWarning: Enable tracemalloc to get the object allocation traceback
Step #1 - "python_test": ok
Step #1 - "python_test": test_dict_list_to_mcf_str (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_drop_nodes (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_get_dcid_node (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_mcf_dict_rename_namespace (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_mcf_dict_rename_prop (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_mcf_dict_rename_prop_value (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_mcf_to_dict_list (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_node_list_check_existence_dc (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_node_list_check_existence_node_list (mcf_dict_util_test.TestMCFDict) ... ok
Step #1 - "python_test": test_example_usage (mcf_template_filler_test.MCFTemplateFillerTest) ... ok
Step #1 - "python_test": test_pop_and_2_obs_with_all_pv (mcf_template_filler_test.MCFTemplateFillerTest)
Step #1 - "python_test": Use separate templates for Pop Obs, and use Obs template repeatedly. ... ok
Step #1 - "python_test": test_pop_with_missing_req_pv (mcf_template_filler_test.MCFTemplateFillerTest) ... ok
Step #1 - "python_test": test_require_node_name (mcf_template_filler_test.MCFTemplateFillerTest) ... ok
Step #1 - "python_test": test_unified_pop_obs_with_missing_optional_pv (mcf_template_filler_test.MCFTemplateFillerTest) ... ok
Step #1 - "python_test": test_place_id_resolution_by_name (state_division_to_dcid_test.PlaceMapTest) ... ok
Step #1 - "python_test": test_boolean_naming (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_double_underscore (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_ignore_props (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_legacy_mapping (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_measured_property (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_measurement_constraint_removal (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_measurement_denominator (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_measurement_qualifier (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_naics_name_generation (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_namespace_removal (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_prepend_append_replace (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_quantity_name_generation (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_quantity_range_name_generation (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_soc_map (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_soc_name_generation (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_sorted_constraints (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test": test_stat_type (statvar_dcid_generator_test.TestStatVarDcidGenerator) ... ok
Step #1 - "python_test":
Step #1 - "python_test": ======================================================================
Step #1 - "python_test": ERROR: file_util_test (unittest.loader._FailedTest)
Step #1 - "python_test": ----------------------------------------------------------------------
Step #1 - "python_test": ImportError: Failed to import test module: file_util_test
Step #1 - "python_test": Traceback (most recent call last):
Step #1 - "python_test": File "/usr/local/lib/python3.7/unittest/loader.py", line 436, in _find_test_path
Step #1 - "python_test": module = self._get_module_from_name(name)
Step #1 - "python_test": File "/usr/local/lib/python3.7/unittest/loader.py", line 377, in _get_module_from_name
Step #1 - "python_test": __import__(name)
Step #1 - "python_test": File "/workspace/util/file_util_test.py", line 31, in <module>
Step #1 - "python_test": import file_util
Step #1 - "python_test": File "/workspace/util/file_util.py", line 22, in <module>
Step #1 - "python_test": import gspread
Step #1 - "python_test": File "/workspace/.env/lib/python3.7/site-packages/gspread/__init__.py", line 7, in <module>
Step #1 - "python_test": from .auth import (
Step #1 - "python_test": File "/workspace/.env/lib/python3.7/site-packages/gspread/auth.py", line 19, in <module>
Step #1 - "python_test": from .client import Client
Step #1 - "python_test": File "/workspace/.env/lib/python3.7/site-packages/gspread/client.py", line 17, in <module>
Step #1 - "python_test": from .spreadsheet import Spreadsheet
Step #1 - "python_test": File "/workspace/.env/lib/python3.7/site-packages/gspread/spreadsheet.py", line 15, in <module>
Step #1 - "python_test": from .worksheet import Worksheet
Step #1 - "python_test": File "/workspace/.env/lib/python3.7/site-packages/gspread/worksheet.py", line 11, in <module>
Step #1 - "python_test": from typing import (
Step #1 - "python_test": ImportError: cannot import name 'Literal' from 'typing' (/usr/local/lib/python3.7/typing.py)
Step #1 - "python_test":
Step #1 - "python_test":
Step #1 - "python_test": ----------------------------------------------------------------------
Step #1 - "python_test": Ran 56 tests in 4.480s
Step #1 - "python_test":
Step #1 - "python_test": FAILED (errors=1)
Step #1 - "python_test": ### Running Python tests in import-automation/executor
Step #1 - "python_test": Installing Python requirements
Step #1 - "python_test":
Step #1 - "python_test": [notice] A new release of pip is available: 23.0.1 -> 24.0
Step #1 - "python_test": [notice] To update, run: pip install --upgrade pip
Step #1 - "python_test": #### Testing Python code in import-automation/executor
Step #1 - "python_test": test_appengine_job_request (test.cloud_scheduler_test.CloudSchedulerTest) ... ok
Step #1 - "python_test": test_http_job_request (test.cloud_scheduler_test.CloudSchedulerTest) ... ok
Step #1 - "python_test": test.file_uploader_test (unittest.loader._FailedTest) ... ERROR
Step #1 - "python_test": test.github_api_test (unittest.loader._FailedTest) ... ERROR
Step #1 - "python_test": test_clean_time (test.import_executor_test.ImportExecutorTest) ... ok
Step #1 - "python_test": test_construct_process_message (test.import_executor_test.ImportExecutorTest) ... ok
Step #1 - "python_test": test_construct_process_message_no_output (test.import_executor_test.ImportExecutorTest)
Step #1 - "python_test": Tests that _construct_process_message does not append ... ok
Step #1 - "python_test": test_create_venv (test.import_executor_test.ImportExecutorTest) ... ok
Step #1 - "python_test": test_run_and_handle_exception (test.import_executor_test.ImportExecutorTest) ... ERROR:root:An unexpected exception was thrown
Step #1 - "python_test": Traceback (most recent call last):
Step #1 - "python_test": File "/workspace/import-automation/executor/app/executor/import_executor.py", line 456, in run_and_handle_exception
Step #1 - "python_test": return exec_func(*args)
Step #1 - "python_test": TypeError: 'str' object is not callable
Step #1 - "python_test": FAIL
Step #1 - "python_test": test_run_with_timeout (test.import_executor_test.ImportExecutorTest) ... ERROR:root:An unexpected exception was thrown: Command '['sleep', '5']' timed out after 0.1 seconds when running ['sleep', '5']: Traceback (most recent call last):
Step #1 - "python_test": File "/workspace/import-automation/executor/app/executor/import_executor.py", line 560, in _run_with_timeout
Step #1 - "python_test": env=env)
Step #1 - "python_test": File "/usr/local/lib/python3.7/subprocess.py", line 490, in run
Step #1 - "python_test": stdout, stderr = process.communicate(input, timeout=timeout)
Step #1 - "python_test": File "/usr/local/lib/python3.7/subprocess.py", line 964, in communicate
Step #1 - "python_test": stdout, stderr = self._communicate(input, endtime, timeout)
Step #1 - "python_test": File "/usr/local/lib/python3.7/subprocess.py", line 1732, in _communicate
Step #1 - "python_test": self._check_timeout(endtime, orig_timeout, stdout, stderr)
Step #1 - "python_test": File "/usr/local/lib/python3.7/subprocess.py", line 1011, in _check_timeout
Step #1 - "python_test": stderr=b''.join(stderr_seq) if stderr_seq else None)
Step #1 - "python_test": subprocess.TimeoutExpired: Command '['sleep', '5']' timed out after 0.1 seconds
Step #1 - "python_test": Traceback (most recent call last):
Step #1 - "python_test": File "/workspace/import-automation/executor/app/executor/import_executor.py", line 560, in _run_with_timeout
Step #1 - "python_test": env=env)
Step #1 - "python_test": File "/usr/local/lib/python3.7/subprocess.py", line 490, in run
Step #1 - "python_test": stdout, stderr = process.communicate(input, timeout=timeout)
Step #1 - "python_test": File "/usr/local/lib/python3.7/subprocess.py", line 964, in communicate
Step #1 - "python_test": stdout, stderr = self._communicate(input, endtime, timeout)
Step #1 - "python_test": File "/usr/local/lib/python3.7/subprocess.py", line 1732, in _communicate
Step #1 - "python_test": self._check_timeout(endtime, orig_timeout, stdout, stderr)
Step #1 - "python_test": File "/usr/local/lib/python3.7/subprocess.py", line 1011, in _check_timeout
Step #1 - "python_test": stderr=b''.join(stderr_seq) if stderr_seq else None)
Step #1 - "python_test": subprocess.TimeoutExpired: Command '['sleep', '5']' timed out after 0.1 seconds
Step #1 - "python_test": FAIL
Step #1 - "python_test": test_are_imports_finished (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_block_on_import (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_fix_input_path (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_format_import_info (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_get_fixed_absolute_import_name (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_get_import_id (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_smart_import (test.import_service_test.ImportServiceTest) ... ok
Step #1 - "python_test": test_absolute_import_name (test.import_target_test.ImportTargetTest) ... ok
Step #1 - "python_test": test_is_import_targetted_by_commit (test.import_target_test.ImportTargetTest) ... ok
Step #1 - "python_test": test_parse_commit_message_targets (test.import_target_test.ImportTargetTest) ... ok
Step #1 - "python_test": test.integration_test (unittest.loader._FailedTest) ... ERROR
Step #1 - "python_test": test_download_file (test.utils_test.AppUtilsTest)
Step #1 - "python_test": Response does not have a Content-Disposition header. ... ok
Step #1 - "python_test": test_download_file_timeout (test.utils_test.AppUtilsTest)
Step #1 - "python_test": Raises requests.Timeout exception. ... ok
Step #1 - "python_test": test_get_filename (test.utils_test.AppUtilsTest) ... ok
Step #1 - "python_test": test_get_filename_raise (test.utils_test.AppUtilsTest) ... ok
Step #1 - "python_test": test_pacific_time_to_datetime (test.utils_test.AppUtilsTest)
Step #1 - "python_test": Tests that the string returned by pacific_time can be converted to ... ok
Step #1 - "python_test": test_pacific_time_to_datetime_then_back (test.utils_test.AppUtilsTest)
Step #1 - "python_test": Tests that the string returned by pacific_time can be converted to ... ok
Step #1 - "python_test": test_compare_lines (test.utils_test.TestUtilsTest) ... ok
Step #1 - "python_test": test_import_spec_valid (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_spec_valid_fields_absent (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_spec_valid_script_not_exist (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_targets_valid_absolute_names (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_targets_valid_manifest_not_exist (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_targets_valid_name_not_exist (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_targets_valid_relative_names (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_import_targets_valid_relative_names_multiple_dirs (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test": test_manifest_valid_fields_absent (test.validation_test.ValidationTest) ... ok
Step #1 - "python_test":
Step #1 - "python_test": ======================================================================
Step #1 - "python_test": ERROR: test.file_uploader_test (unittest.loader._FailedTest)
Step #1 - "python_test": ----------------------------------------------------------------------
Step #1 - "python_test": ImportError: Failed to import test module: test.file_uploader_test
Step #1 - "python_test": Traceback (most recent call last):
Step #1 - "python_test": File "/usr/local/lib/python3.7/unittest/loader.py", line 436, in _find_test_path
Step #1 - "python_test": module = self._get_module_from_name(name)
Step #1 - "python_test": File "/usr/local/lib/python3.7/unittest/loader.py", line 377, in _get_module_from_name
Step #1 - "python_test": __import__(name)
Step #1 - "python_test": File "/workspace/import-automation/executor/test/file_uploader_test.py", line 22, in <module>
Step #1 - "python_test": from test import integration_test
Step #1 - "python_test": File "/workspace/import-automation/executor/test/integration_test.py", line 30, in <module>
Step #1 - "python_test": 'github_repo_owner_username': os.environ['_GITHUB_REPO_OWNER_USERNAME'],
Step #1 - "python_test": File "/usr/local/lib/python3.7/os.py", line 681, in __getitem__
Step #1 - "python_test": raise KeyError(key) from None
Step #1 - "python_test": KeyError: '_GITHUB_REPO_OWNER_USERNAME'
Step #1 - "python_test":
Step #1 - "python_test":
Step #1 - "python_test": ======================================================================
Step #1 - "python_test": ERROR: test.github_api_test (unittest.loader._FailedTest)
Step #1 - "python_test": ----------------------------------------------------------------------
Step #1 - "python_test": ImportError: Failed to import test module: test.github_api_test
Step #1 - "python_test": Traceback (most recent call last):
Step #1 - "python_test": File "/usr/local/lib/python3.7/unittest/loader.py", line 436, in _find_test_path
Step #1 - "python_test": module = self._get_module_from_name(name)
Step #1 - "python_test": File "/usr/local/lib/python3.7/unittest/loader.py", line 377, in _get_module_from_name
Step #1 - "python_test": __import__(name)
Step #1 - "python_test": File "/workspace/import-automation/executor/test/github_api_test.py", line 28, in <module>
Step #1 - "python_tes
...
[Logs truncated due to log size limitations. For full logs, see https://console.cloud.google.com/cloud-build/builds/73adba86-2f3f-4c2f-8a04-9ead5c39a3c6?project=879489846695.]
...
d_month,
Step #2 - "python_format_check": + 'DateEstablished-Day': d1_established_day,
Step #2 - "python_format_check": + 'ConceptID': conceptID,
Step #2 - "python_format_check": + 'ConceptName': conceptName,
Step #2 - "python_format_check": + 'TermID': termUI,
Step #2 - "python_format_check": + 'TermName': termName,
Step #2 - "python_format_check": + 'TreeNumber': tree_num
Step #2 - "python_format_check": + })
Step #2 - "python_format_check": df = pd.DataFrame(d)
Step #2 - "python_format_check": return df
Step #2 - "python_format_check":
Step #2 - "python_format_check": +
Step #2 - "python_format_check": def check_for_illegal_charc(s):
Step #2 - "python_format_check": """Checks for illegal characters in a string and prints an error statement if any are present
Step #2 - "python_format_check": Args:
Step #2 - "python_format_check": s: target string that needs to be checked
Step #2 - "python_format_check":
Step #2 - "python_format_check": """
Step #2 - "python_format_check": - list_illegal = ["'", "*" ">", "<", "@", "]", "[", "|", ":", ";" " "]
Step #2 - "python_format_check": + list_illegal = ["'", "*"
Step #2 - "python_format_check": + ">", "<", "@", "]", "[", "|", ":", ";"
Step #2 - "python_format_check": + " "]
Step #2 - "python_format_check": if any([x in s for x in list_illegal]):
Step #2 - "python_format_check": print('Error! dcid contains illegal characters!', s)
Step #2 - "python_format_check": +
Step #2 - "python_format_check":
Step #2 - "python_format_check": def check_for_dcid_qualifier_supp(row):
Step #2 - "python_format_check": check_for_illegal_charc(str(row['Qualifier_dcid']))
Step #2 - "python_format_check": return row
Step #2 - "python_format_check": +
Step #2 - "python_format_check":
Step #2 - "python_format_check": def check_for_dcid_qualifier_concept(row):
Step #2 - "python_format_check": check_for_illegal_charc(str(row['Qualifier_dcid']))
Step #2 - "python_format_check": check_for_illegal_charc(str(row['Concept_dcid']))
Step #2 - "python_format_check": return row
Step #2 - "python_format_check":
Step #2 - "python_format_check": +
Step #2 - "python_format_check": def check_for_dcid_concept_term(row):
Step #2 - "python_format_check": check_for_illegal_charc(str(row['Term_dcid']))
Step #2 - "python_format_check": check_for_illegal_charc(str(row['Concept_dcid']))
Step #2 - "python_format_check": return row
Step #2 - "python_format_check": +
Step #2 - "python_format_check":
Step #2 - "python_format_check": def date_modify(df1):
Step #2 - "python_format_check": """
Step #2 - "python_format_check": @@ -158,7 +179,7 @@
Step #2 - "python_format_check": ## adds quotes from text type columns and replaces "nan" with np.nan
Step #2 - "python_format_check": col_names_quote = ['DateCreated', 'DateRevised', 'DateEstablished']
Step #2 - "python_format_check": for col in col_names_quote:
Step #2 - "python_format_check": - df1[col] = df1[col].replace(["nan-nan-nan"],np.nan)
Step #2 - "python_format_check": + df1[col] = df1[col].replace(["nan-nan-nan"], np.nan)
Step #2 - "python_format_check": ## drop repetitive column values
Step #2 - "python_format_check": df1 = df1.drop(columns=[
Step #2 - "python_format_check": 'DateCreated-Year', 'DateCreated-Month', 'DateCreated-Day',
Step #2 - "python_format_check": @@ -167,6 +188,7 @@
Step #2 - "python_format_check": ])
Step #2 - "python_format_check": return df1
Step #2 - "python_format_check":
Step #2 - "python_format_check": +
Step #2 - "python_format_check": def format_qualifier_df(df):
Step #2 - "python_format_check": """
Step #2 - "python_format_check": Modifies the original dataframe to retain all
Step #2 - "python_format_check": @@ -178,19 +200,20 @@
Step #2 - "python_format_check": """
Step #2 - "python_format_check": df_1 = df
Step #2 - "python_format_check": ## drops columns not required for the descriptor file
Step #2 - "python_format_check": - df_1 = df_1.drop(columns=['DateCreated', 'DateRevised', 'DateEstablished',
Step #2 - "python_format_check": - 'ConceptID', 'ConceptName', 'TermID', 'TermName'
Step #2 - "python_format_check": + df_1 = df_1.drop(columns=[
Step #2 - "python_format_check": + 'DateCreated', 'DateRevised', 'DateEstablished', 'ConceptID',
Step #2 - "python_format_check": + 'ConceptName', 'TermID', 'TermName'
Step #2 - "python_format_check": ])
Step #2 - "python_format_check": ## splits the descriptors with multiple tree numbers, into multiple rows
Step #2 - "python_format_check": - df_1 = df_1.apply(lambda x: x.explode() if x.name in
Step #2 - "python_format_check": - ['TreeNumber'] else x)
Step #2 - "python_format_check": + df_1 = df_1.apply(lambda x: x.explode() if x.name in ['TreeNumber'] else x)
Step #2 - "python_format_check": df_1['TreeNumber'] = '"' + df_1.TreeNumber + '"'
Step #2 - "python_format_check": ## creates descriptor dcid
Step #2 - "python_format_check": df_1['Qualifier_dcid'] = 'bio/' + df_1['QualifierID'].astype(str)
Step #2 - "python_format_check": ## drops the duplicate rows
Step #2 - "python_format_check": df_1 = df_1.drop_duplicates()
Step #2 - "python_format_check": - df_1 = df_1.apply(lambda x: check_for_dcid_qualifier_supp(x),axis=1)
Step #2 - "python_format_check": + df_1 = df_1.apply(lambda x: check_for_dcid_qualifier_supp(x), axis=1)
Step #2 - "python_format_check": return df_1
Step #2 - "python_format_check": +
Step #2 - "python_format_check":
Step #2 - "python_format_check": def format_concept_df(df1):
Step #2 - "python_format_check": """
Step #2 - "python_format_check": @@ -203,8 +226,10 @@
Step #2 - "python_format_check": """
Step #2 - "python_format_check": df_3 = df1
Step #2 - "python_format_check": ## drops columns not required for the concept file
Step #2 - "python_format_check": - df_3 = df_3.drop(columns=['DateCreated', 'DateRevised', 'DateEstablished',
Step #2 - "python_format_check": - 'TermID', 'TermName', 'TreeNumber'])
Step #2 - "python_format_check": + df_3 = df_3.drop(columns=[
Step #2 - "python_format_check": + 'DateCreated', 'DateRevised', 'DateEstablished', 'TermID', 'TermName',
Step #2 - "python_format_check": + 'TreeNumber'
Step #2 - "python_format_check": + ])
Step #2 - "python_format_check": ## unzips the concept name and concept IDs list
Step #2 - "python_format_check": df_3 = df_3.apply(lambda x: x.explode()
Step #2 - "python_format_check": if x.name in ['ConceptID', 'ConceptName'] else x)
Step #2 - "python_format_check": @@ -216,8 +241,9 @@
Step #2 - "python_format_check": df_3['Qualifier_dcid'] = 'bio/' + df_3['QualifierID'].astype(str)
Step #2 - "python_format_check": ## drops the duplicate rows
Step #2 - "python_format_check": df_3 = df_3.drop_duplicates()
Step #2 - "python_format_check": - df_3 = df_3.apply(lambda x: check_for_dcid_qualifier_concept(x),axis=1)
Step #2 - "python_format_check": + df_3 = df_3.apply(lambda x: check_for_dcid_qualifier_concept(x), axis=1)
Step #2 - "python_format_check": return df_3
Step #2 - "python_format_check": +
Step #2 - "python_format_check":
Step #2 - "python_format_check": def format_term_df(df):
Step #2 - "python_format_check": """
Step #2 - "python_format_check": @@ -231,7 +257,8 @@
Step #2 - "python_format_check": df_4 = df
Step #2 - "python_format_check": ## drops columns not required for the term file
Step #2 - "python_format_check": df_4 = df_4.drop(columns=[
Step #2 - "python_format_check": - 'DateCreated', 'DateRevised', 'DateEstablished', 'TreeNumber', 'QualifierID'
Step #2 - "python_format_check": + 'DateCreated', 'DateRevised', 'DateEstablished', 'TreeNumber',
Step #2 - "python_format_check": + 'QualifierID'
Step #2 - "python_format_check": ])
Step #2 - "python_format_check": ## unzips the list of columns, namely concept and term ID and name
Step #2 - "python_format_check": df_4 = df_4.apply(lambda x: x.explode() if x.name in
Step #2 - "python_format_check": @@ -243,13 +270,14 @@
Step #2 - "python_format_check": ## adds quotes from text type columns and replaces "nan" with np.nan
Step #2 - "python_format_check": for col in col_names_quote:
Step #2 - "python_format_check": df_4.update('"' + df_4[[col]].astype(str) + '"')
Step #2 - "python_format_check": - df_4[col] = df_4[col].replace(["\"nan\""],np.nan)
Step #2 - "python_format_check": + df_4[col] = df_4[col].replace(["\"nan\""], np.nan)
Step #2 - "python_format_check": ## generates term and concept dcids
Step #2 - "python_format_check": df_4['Term_dcid'] = 'bio/' + df_4['TermID'].astype(str)
Step #2 - "python_format_check": df_4['Concept_dcid'] = 'bio/' + df_4['ConceptID'].astype(str)
Step #2 - "python_format_check": df_4 = df_4.drop_duplicates()
Step #2 - "python_format_check": - df_4 = df_4.apply(lambda x: check_for_dcid_concept_term(x),axis=1)
Step #2 - "python_format_check": + df_4 = df_4.apply(lambda x: check_for_dcid_concept_term(x), axis=1)
Step #2 - "python_format_check": return df_4
Step #2 - "python_format_check": +
Step #2 - "python_format_check":
Step #2 - "python_format_check": def main():
Step #2 - "python_format_check":
Step #2 - "python_format_check": @@ -259,8 +287,12 @@
Step #2 - "python_format_check": df1_qual = format_qualifier_df(df1)
Step #2 - "python_format_check": df1_concept = format_concept_df(df1)
Step #2 - "python_format_check": df1_term = format_term_df(df1)
Step #2 - "python_format_check": - df1_qual.to_csv('mesh_qualifier_supp.csv', doublequote=False, escapechar='\\')
Step #2 - "python_format_check": - df1_concept.to_csv('mesh_qualifier_concept.csv', doublequote=False, escapechar='\\')
Step #2 - "python_format_check": + df1_qual.to_csv('mesh_qualifier_supp.csv',
Step #2 - "python_format_check": + doublequote=False,
Step #2 - "python_format_check": + escapechar='\\')
Step #2 - "python_format_check": + df1_concept.to_csv('mesh_qualifier_concept.csv',
Step #2 - "python_format_check": + doublequote=False,
Step #2 - "python_format_check": + escapechar='\\')
Step #2 - "python_format_check": df1_term.to_csv('mesh_concept_term.csv', doublequote=False, escapechar='\\')
Step #2 - "python_format_check":
Step #2 - "python_format_check":
Step #1 - "python_test": test_place (nasa.cmip6_sea_level.process_test.ProcessTest) ... ok
Step #1 - "python_test": test_stat (nasa.cmip6_sea_level.process_test.ProcessTest) ... ok
Step #1 - "python_test": test_sv (nasa.cmip6_sea_level.process_test.ProcessTest) ... ok
Step #1 - "python_test": test_id_map (ocha.geodata.generate_test.GenerateTest) ... ok
Step #1 - "python_test": test_mcf (ocha.geodata.generate_test.GenerateTest) ... ok
Step #1 - "python_test": test_create_csv (ourworldindata.covid19.preprocess_csv_test.TestPreprocessCsvTest) ... ok
Step #1 - "python_test": test_create_tmcf (ourworldindata.covid19.preprocess_csv_test.TestPreprocessCsvTest) ... ok
Step #1 - "python_test": test_un_energy_process (un.energy.process_test.TestUNEnergyProcess)
Step #1 - "python_test": Test the process() function for UN energy data set. ... [ 2024-03-05 18:08:59.429385 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.431322 ] Error: warning_duplicate_obs_dropped Duplicate value 850- for SVO: dcid:Annual_Generation_Fuel_BioGasoline-country/ARG-2019, prev: 850-
Step #1 - "python_test": [ 2024-03-05 18:08:59.431634 ] Error: warning_duplicate_obs_dropped Duplicate value 842- for SVO: dcid:Annual_Consumption_Fuel_BioGasoline-country/ARG-2019, prev: 842-
Step #1 - "python_test": [ 2024-03-05 18:08:59.432426 ] Error: warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.434169 ] Error: warning_ignoring_country_code_579 Country ignored: 579, name: Norway
Step #1 - "python_test": [ 2024-03-05 18:08:59.436906 ] Error: warning_ignoring_country_code_757 Country ignored: 757, name: Switzerland
Step #1 - "python_test": [ 2024-03-05 18:08:59.447673 ] Error: warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.456167 ] Error: warning_duplicate_obs_dropped Duplicate value 102.14- for SVO: dcid:Annual_Consumption_Fuel_AnthraciteCoal-country/ALB-2019, prev: 102.14-
Step #1 - "python_test": [ 2024-03-05 18:08:59.460731 ] Error: warning_ignoring_country_code_176 Country ignored: 176, name: Mayotte
Step #1 - "python_test": [ 2024-03-05 18:08:59.462045 ] Error: warning_ignoring_country_code_230 Country ignored: 230, name: Ethiopia, incl. Eritrea
Step #1 - "python_test": [ 2024-03-05 18:08:59.462545 ] Error: warning_ignoring_country_code_255 Country ignored: 255, name: French Guiana
Step #1 - "python_test": [ 2024-03-05 18:08:59.463150 ] Error: warning_ignoring_country_code_280 Country ignored: 280, name: Germany, Fed. R. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.464291 ] Error: warning_ignoring_country_code_313 Country ignored: 313, name: Guadeloupe
Step #1 - "python_test": [ 2024-03-05 18:08:59.468458 ] Error: warning_ignoring_country_code_475 Country ignored: 475, name: Martinique
Step #1 - "python_test": [ 2024-03-05 18:08:59.470058 ] Error: warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Consumption_Fuel_AviationGasoline-country/AFG-1992, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.473735 ] Error: warning_ignoring_country_code_720 Country ignored: 720, name: Yemen, Dem. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.475007 ] Error: warning_ignoring_country_code_810 Country ignored: 810, name: USSR (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.477366 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.477416 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.477457 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.479571 ] Error: warning_duplicate_obs_dropped Duplicate value 1289.328- for SVO: dcid:Annual_Generation_Fuel_AnimalWaste-country/ARM-2018, prev: 1289.328-
Step #1 - "python_test": [ 2024-03-05 18:08:59.479701 ] Error: warning_duplicate_obs_dropped Duplicate value 1289.328- for SVO: dcid:Annual_Consumption_Fuel_AnimalWaste-country/ARM-2018, prev: 1289.328-
Step #1 - "python_test": [ 2024-03-05 18:08:59.480805 ] Error: warning_ignoring_country_code_891 Country ignored: 891, name: Serbia and Montenegro
Step #1 - "python_test": [ 2024-03-05 18:08:59.482422 ] Error: warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.482838 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.483452 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.483517 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.485023 ] Error: warning_ignoring_country_code_278 Country ignored: 278, name: German Dem. R. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.485269 ] Error: warning_ignoring_country_code_278 Country ignored: 278, name: German Dem. R. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.496058 ] Error: warning_duplicate_obs_dropped Duplicate value 391.27- for SVO: dcid:Annual_Consumption_Fuel_BrownCoalBriquettes-country/ALB-2014, prev: 391.27-
Step #1 - "python_test": [ 2024-03-05 18:08:59.497657 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.497727 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.497788 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.497849 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.497911 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.497970 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.498034 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.498105 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.502202 ] Error: warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_PatentFuel-country/AFG-1992, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.503490 ] Error: warning_duplicate_obs_dropped Duplicate value 1.114- for SVO: dcid:Annual_Consumption_Fuel_PatentFuel-country/ARM-2018, prev: 1.114-
Step #1 - "python_test": [ 2024-03-05 18:08:59.512325 ] Error: warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.519908 ] Error: warning_duplicate_obs_dropped Duplicate value 130- for SVO: dcid:Annual_Consumption_Fuel_BioDiesel-country/ALB-2019, prev: 130-
Step #1 - "python_test": [ 2024-03-05 18:08:59.521051 ] Error: warning_duplicate_obs_dropped Duplicate value 5844- for SVO: dcid:Annual_Generation_Fuel_BlastFurnaceGas-country/DZA-2018, prev: 5844-
Step #1 - "python_test": [ 2024-03-05 18:08:59.521178 ] Error: warning_duplicate_obs_dropped Duplicate value 1832- for SVO: dcid:Annual_Consumption_Fuel_BlastFurnaceGas-country/DZA-2018, prev: 1832-
Step #1 - "python_test": [ 2024-03-05 18:08:59.522083 ] Error: warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.522540 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.529233 ] Error: warning_duplicate_obs_dropped Duplicate value 16219- for SVO: dcid:Annual_Generation_Fuel_BioGas-country/AUS-2019, prev: 16219-
Step #1 - "python_test": [ 2024-03-05 18:08:59.529366 ] Error: warning_duplicate_obs_dropped Duplicate value 1470- for SVO: dcid:Annual_Consumption_Fuel_BioGas-country/AUS-2018, prev: 1470-
Step #1 - "python_test": [ 2024-03-05 18:08:59.533256 ] Error: warning_ignoring_country_code_579 Country ignored: 579, name: Norway
Step #1 - "python_test": [ 2024-03-05 18:08:59.533430 ] Error: warning_ignoring_country_code_639 Country ignored: 639, name: Reunion
Step #1 - "python_test": [ 2024-03-05 18:08:59.533489 ] Error: warning_ignoring_country_code_757 Country ignored: 757, name: Switzerland
Step #1 - "python_test": [ 2024-03-05 18:08:59.534514 ] Error: warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_BioJetKerosene-country/FIN-2015, prev: 1-
Step #1 - "python_test": [ 2024-03-05 18:08:59.538226 ] Error: warning_duplicate_obs_dropped Duplicate value 3725- for SVO: dcid:Annual_Generation_Fuel_OtherRecoveredGases-country/AUT-2019, prev: 3725-
Step #1 - "python_test": [ 2024-03-05 18:08:59.538495 ] Error: warning_duplicate_obs_dropped Duplicate value 103- for SVO: dcid:Annual_Consumption_Fuel_OtherRecoveredGases-country/AUT-2018, prev: 103-
Step #1 - "python_test": [ 2024-03-05 18:08:59.543791 ] Error: warning_duplicate_obs_dropped Duplicate value 766.2- for SVO: dcid:Annual_Generation_Fuel_PeatProducts-country/BLR-2019, prev: 960.2-
Step #1 - "python_test": [ 2024-03-05 18:08:59.544131 ] Error: warning_duplicate_obs_dropped Duplicate value 695- for SVO: dcid:Annual_Consumption_Fuel_PeatProducts-country/BLR-2019, prev: 695-
Step #1 - "python_test": [ 2024-03-05 18:08:59.549376 ] Error: warning_duplicate_obs_dropped Duplicate value 471.222-1 for SVO: dcid:Annual_Generation_Fuel_Bagasse-country/AGO-2018, prev: 471.222-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.549527 ] Error: warning_duplicate_obs_dropped Duplicate value 160.425- for SVO: dcid:Annual_Consumption_Fuel_Bagasse-country/AGO-2018, prev: 160.425-
Step #1 - "python_test": [ 2024-03-05 18:08:59.551786 ] Error: warning_ignoring_country_code_639 Country ignored: 639, name: Reunion
Step #1 - "python_test": [ 2024-03-05 18:08:59.561871 ] Error: warning_duplicate_obs_dropped Duplicate value 36.78- for SVO: dcid:Annual_Generation_Fuel_BituminousCoal-country/ALB-2019, prev: 104.58-
Step #2 - "python_format_check": ERROR: Fix lint errors by running ./run_tests.sh -f
Step #1 - "python_test": [ 2024-03-05 18:08:59.568888 ] Error: warning_duplicate_obs_dropped Duplicate value 0.005- for SVO: dcid:Annual_Consumption_Fuel_CokingCoal-country/ARM-2018, prev: 0.004-
Step #1 - "python_test": [ 2024-03-05 18:08:59.579314 ] Error: warning_duplicate_obs_dropped Duplicate value 136.883- for SVO: dcid:Annual_Generation_Fuel_Charcoal-country/AFG-2019, prev: 136.841-
Step #1 - "python_test": [ 2024-03-05 18:08:59.579477 ] Error: warning_duplicate_obs_dropped Duplicate value 136.883-1 for SVO: dcid:Annual_Consumption_Fuel_Charcoal-country/AFG-2019, prev: 136.883-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.596235 ] Error: warning_duplicate_obs_dropped Duplicate value 1367- for SVO: dcid:Annual_Generation_Fuel_HardCoal-country/AFG-2019, prev: 2139-
Step #1 - "python_test": [ 2024-03-05 18:08:59.596496 ] Error: warning_duplicate_obs_dropped Duplicate value 1229-1 for SVO: dcid:Annual_Consumption_Fuel_HardCoal-country/AFG-2019, prev: 1229-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.599000 ] Error: warning_duplicate_obs_dropped Duplicate value 0.0008-1 for SVO: dcid:Annual_Consumption_Fuel_CoalProducts-country/BMU-2018, prev: 0.0008-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.601312 ] Error: warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Consumption_Fuel_CrudeOil-country/DZA-2016, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.611569 ] Error: warning_ignoring_country_code_886 Country ignored: 886, name: Yemen Arab Rep. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.615703 ] Error: warning_duplicate_obs_dropped Duplicate value 335.274- for SVO: dcid:Annual_Generation_Fuel_CrudeOil-country/ALB-2019, prev: 1005.09-
Step #1 - "python_test": [ 2024-03-05 18:08:59.622429 ] Error: warning_duplicate_obs_dropped Duplicate value 154- for SVO: dcid:Annual_Generation_Fuel_CoalTar-country/AUS-2019, prev: 154-
Step #1 - "python_test": [ 2024-03-05 18:08:59.622893 ] Error: warning_duplicate_obs_dropped Duplicate value 161- for SVO: dcid:Annual_Consumption_Fuel_CoalTar-country/AUS-2018, prev: 161-
Step #1 - "python_test": [ 2024-03-05 18:08:59.626963 ] Error: warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.636893 ] Error: warning_duplicate_obs_dropped Duplicate value 379.9-1 for SVO: dcid:Annual_Consumption_Fuel_DieselOil-country/AFG-2019, prev: 379.9-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.650181 ] Error: warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_Ethane-country/DZA-2016, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.650636 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.650695 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.650788 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.650836 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.650883 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.652788 ] Error: warning_ignoring_country_code_579 Country ignored: 579, name: Norway
Step #1 - "python_test": [ 2024-03-05 18:08:59.652853 ] Error: warning_ignoring_country_code_579 Country ignored: 579, name: Norway
Step #1 - "python_test": [ 2024-03-05 18:08:59.667063 ] Error: warning_ignored_stat_var_duplicate_production_01 Invalid statVar {'typeOf': 'dcs:StatisticalVariable', 'measurementQualifier': 'dcs:Annual', 'populationType': 'dcs:Energy', 'statType': 'dcs:measuredValue'} for row OrderedDict([('Commodity Code', 'EL'), ('Country or Area Code', '4'), ('Country or Area', 'Afghanistan'), ('Transaction Code', '019'), ('Commodity - Transaction Code', 'EL019'), ('Commodity - Transaction', 'Electricity - net production'), ('Year', '2019'), ('Unit', 'Kilowatt-hours, million'), ('Quantity', '1230500000.0'), ('Quantity Footnotes', '1'), ('_File', '/workspace/scripts/un/energy/test_data/un_energy_input.csv'), ('_Row', 1168), ('Country_dcid', 'dcs:country/AFG'), ('Unit_dcid', 'KilowattHour'), ('Estimate', 'UNStatsEstimate')])
Step #1 - "python_test": [ 2024-03-05 18:08:59.668652 ] Error: warning_duplicate_obs_dropped Duplicate value 6142.5- for SVO: dcid:Annual_Generation_Electricity-country/AFG-2019, prev: 1591.5-
Step #1 - "python_test": [ 2024-03-05 18:08:59.695968 ] Error: warning_duplicate_obs_dropped Duplicate value 1856.608- for SVO: dcid:Annual_Generation_Fuel_Fuelwood-country/AFG-2019, prev: 1856.559-
Step #1 - "python_test": [ 2024-03-05 18:08:59.696730 ] Error: warning_duplicate_obs_dropped Duplicate value 1035.562-1 for SVO: dcid:Annual_Consumption_Fuel_Fuelwood-country/AFG-2019, prev: 1035.562-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.705555 ] Error: warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.705638 ] Error: warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.705766 ] Error: warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.705810 ] Error: warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.711788 ] Error: warning_duplicate_obs_dropped Duplicate value 38- for SVO: dcid:Annual_Consumption_Fuel_GasworksGas-country/AUS-2018, prev: 38-
Step #1 - "python_test": [ 2024-03-05 18:08:59.716070 ] Error: warning_duplicate_obs_dropped Duplicate value 1- for SVO: dcid:Annual_Consumption_Fuel_GasolineJetFuel-country/CAN-2016, prev: 1-
Step #1 - "python_test": [ 2024-03-05 18:08:59.717091 ] Error: warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_GasolineJetFuel-country/AGO-2019, prev: 20.406-
Step #1 - "python_test": [ 2024-03-05 18:08:59.717364 ] Error: warning_ignoring_country_code_200 Country ignored: 200, name: Czechoslovakia (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.718847 ] Error: warning_duplicate_obs_dropped Duplicate value 202.6-1 for SVO: dcid:Annual_Consumption_Fuel_GasCoke-country/AFG-2019, prev: 202.6-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.724579 ] Error: warning_duplicate_obs_dropped Duplicate value 3- for SVO: dcid:Annual_Consumption_Fuel_NaturalGasLiquids-country/AUS-1995, prev: 3-
Step #1 - "python_test": [ 2024-03-05 18:08:59.726706 ] Error: warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_NaturalGasLiquids-country/AFG-1992, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.732501 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.732534 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.733358 ] Error: warning_duplicate_obs_dropped Duplicate value 4092- for SVO: dcid:Annual_Generation_Fuel_IndustrialWaste-country/AUS-2019, prev: 4092-
Step #1 - "python_test": [ 2024-03-05 18:08:59.733436 ] Error: warning_duplicate_obs_dropped Duplicate value 3785- for SVO: dcid:Annual_Consumption_Fuel_IndustrialWaste-country/AUS-2018, prev: 3785-
Step #1 - "python_test": [ 2024-03-05 18:08:59.736337 ] Error: warning_ignoring_country_code_579 Country ignored: 579, name: Norway
Step #1 - "python_test": [ 2024-03-05 18:08:59.738437 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.739267 ] Error: warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.740193 ] Error: warning_duplicate_obs_dropped Duplicate value 56.7-1 for SVO: dcid:Annual_Consumption_Fuel_KeroseneJetFuel-country/AFG-2019, prev: 56.7-1
Step #1 - "python_test": [ 2024-03-05 18:08:59.744693 ] Error: warning_ignoring_country_code_382 Country ignored: 382, name: Italy
Step #1 - "python_test": [ 2024-03-05 18:08:59.745759 ] Error: warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Consumption_Fuel_Kerosene-country/AFG-2019, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.747695 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.748359 ] Error: warning_ignoring_country_code_278 Country ignored: 278, name: German Dem. R. (former)
Step #1 - "python_test": [ 2024-03-05 18:08:59.769925 ] Error: warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_BrownCoal-country/ALB-2014, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.770175 ] Error: warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Consumption_Fuel_BrownCoal-country/ALB-2014, prev: 0-
Step #1 - "python_test": [ 2024-03-05 18:08:59.775264 ] Error: warning_ignoring_country_code_251 Country ignored: 251, name: France
Step #1 - "python_test": [ 2024-03-05 18:08:59.794781 ] Error: warning_duplicate_obs_dropped Duplicate value 0- for SVO: dcid:Annual_Generation_Fuel_LigniteCoal-country/ALB-2014, prev: 0-
Finished Step #2 - "python_format_check"
ERROR
ERROR: build step 2 "python:3.7" failed: step exited with non-zero status: 1
Step #1 - "python_test": [ 2024-03-05 18:08:59.794928 ] Error: warning_duplicate_obs_dropped
Loading