Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure: test_running_real_migrate_groups_job #3630

Open
github-actions bot opened this issue Feb 3, 2025 · 2 comments
Open

Test failure: test_running_real_migrate_groups_job #3630

github-actions bot opened this issue Feb 3, 2025 · 2 comments
Labels
bug

Comments

@github-actions
Copy link

github-actions bot commented Feb 3, 2025

❌ test_running_real_migrate_groups_job: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task apply_permissions failed with message: Workload failed, see run output for details. (3m23.106s) 
databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task apply_permissions failed with message: Workload failed, see run output for details.
[gw0] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python
22:44 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.wswI/config.yml) doesn't exist.
22:44 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
22:44 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
22:44 INFO [databricks.labs.ucx.install] Fetching installations...
22:44 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
22:44 DEBUG [tests.integration.conftest] Waiting for clusters to start...
22:44 DEBUG [tests.integration.conftest] Waiting for clusters to start...
22:44 INFO [databricks.labs.ucx.install] Installing UCX v0.55.1+920250203224431
22:44 INFO [databricks.labs.ucx.install] Creating ucx schemas...
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
22:44 INFO [databricks.labs.ucx.install] Creating dashboards...
22:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
22:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
22:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
22:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.wswI/README for the next steps.
22:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_srqlk.tables] ignoring any existing tables inventory; refresh is forced.
22:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_srqlk.tables] crawling new set of snapshot data for tables
22:44 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_srxj6] listing tables and views
22:44 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_srxj6.dummy_tixmh] fetching table metadata
22:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_srqlk.tables] found 1 new records for tables
22:44 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups job: https://DATABRICKS_HOST#job/790139615600553
22:44 INFO [databricks.labs.ucx.installer.workflows] Started migrate-groups job: https://DATABRICKS_HOST#job/790139615600553/runs/740146774788688
22:44 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-groups workflow: https://DATABRICKS_HOST#job/790139615600553
22:44 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
22:44 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.wswI/config.yml) doesn't exist.
22:44 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
22:44 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
22:44 INFO [databricks.labs.ucx.install] Fetching installations...
22:44 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
22:44 DEBUG [tests.integration.conftest] Waiting for clusters to start...
22:44 DEBUG [tests.integration.conftest] Waiting for clusters to start...
22:44 INFO [databricks.labs.ucx.install] Installing UCX v0.55.1+920250203224431
22:44 INFO [databricks.labs.ucx.install] Creating ucx schemas...
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
22:44 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
22:44 INFO [databricks.labs.ucx.install] Creating dashboards...
22:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
22:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
22:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
22:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
22:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
22:44 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.wswI/README for the next steps.
22:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_srqlk.tables] ignoring any existing tables inventory; refresh is forced.
22:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_srqlk.tables] crawling new set of snapshot data for tables
22:44 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_srxj6] listing tables and views
22:44 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_srxj6.dummy_tixmh] fetching table metadata
22:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_srqlk.tables] found 1 new records for tables
22:44 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups job: https://DATABRICKS_HOST#job/790139615600553
22:44 INFO [databricks.labs.ucx.installer.workflows] Started migrate-groups job: https://DATABRICKS_HOST#job/790139615600553/runs/740146774788688
22:44 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-groups workflow: https://DATABRICKS_HOST#job/790139615600553
22:44 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
22:47 INFO [databricks.labs.ucx.install] Deleting UCX v0.55.1+920250203224431 from https://DATABRICKS_HOST
22:47 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_srqlk
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=141634354123579, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=273573575645223, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1763085342301, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=955089130059587, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=126645428587617, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=503783738118930, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=52995560408291, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=73229431944139, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=790139615600553, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=843821767664069, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=7129742162926, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=71669106174049, as it is no longer needed
22:47 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=896954467379625, as it is no longer needed
22:47 INFO [databricks.labs.ucx.install] Deleting cluster policy
22:47 INFO [databricks.labs.ucx.install] Deleting secret scope
22:47 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw0] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #383
@github-actions github-actions bot added the bug label Feb 3, 2025
@github-actions GitHub Actions
Copy link
Author

❌ test_running_real_migrate_groups_job: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task verify_metastore_attached failed with message: Workload failed, see run output for details. (1m55.213s) 
databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task verify_metastore_attached failed with message: Workload failed, see run output for details.
11:25 INFO [databricks.sdk] Using Databricks Metadata Service authentication
11:25 INFO [databricks.sdk] Using Databricks Metadata Service authentication
[gw5] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python
11:25 INFO [databricks.sdk] Using Databricks Metadata Service authentication
11:25 INFO [databricks.sdk] Using Databricks Metadata Service authentication
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created [email protected]: https://DATABRICKS_HOST/#settings/workspace/identity-and-access/users/351827569449332
11:25 INFO [databricks.labs.pytester.fixtures.iam] Workspace group ucx-F29m-ra78b35eb9: https://DATABRICKS_HOST#setting/accounts/groups/208323420204813
11:25 INFO [databricks.labs.pytester.fixtures.iam] Account group ucx-F29m-ra78b35eb9: https://accounts.CLOUD_ENVdatabricks.net/users/groups/665887309910226/members
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-wJqS-ra78b35eb9: https://DATABRICKS_HOST/setting/clusters/cluster-policies/view/000FFCE0F37042FD
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_s5187 schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_s5187
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_s5187.dummy_t7kcj schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_s5187/dummy_t7kcj
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_shnrm schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_shnrm
11:25 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Zi8M/config.yml) doesn't exist.
11:25 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mChoose how to map the workspace groups:�[0m
�[1m[0]�[0m �[36mMatch by Name�[0m
�[1m[1]�[0m �[36mApply a Prefix�[0m
�[1m[2]�[0m �[36mApply a Suffix�[0m
�[1m[3]�[0m �[36mMatch by External ID�[0m
�[1m[4]�[0m �[36mRegex Substitution�[0m
�[1m[5]�[0m �[36mRegex Matching�[0m
Enter a number between 0 and 5
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to skip TACL migration when migrating tables?
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to define a TEST_SCHEMA owner group for all tables and schemas? 
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 4095808988021766 block Internet access?
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
11:25 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
11:25 INFO [databricks.labs.ucx.install] Fetching installations...
11:25 INFO [databricks.labs.blueprint.parallel] finding Zi8M installations 100/103, rps: 244.974/sec
11:25 INFO [databricks.labs.blueprint.parallel] finding Zi8M installations 103/103, rps: 239.465/sec
11:25 INFO [databricks.labs.blueprint.parallel] Finished 'finding Zi8M installations' tasks: 0% results available (0/103). Took 0:00:00.431075
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on�[0m
�[1m[0]�[0m �[36m[Create new PRO SQL warehouse]�[0m
�[1m[1]�[0m �[36mDEFAULT Test Warehouse (DATABRICKS_WAREHOUSE_ID, SERVERLESS, RUNNING)�[0m
Enter a number between 0 and 1
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
11:25 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mIf hive_metastore contains managed table with external location paths (not dbfs root), please select which migration option to choose from�[0m
�[1m[0]�[0m �[36mConvert MANAGED HMS table to EXTERNAL HMS table and migrate as EXTERNAL UC table. Once the relevant HMS tables are deleted, the underlying data won't get deleted anymore, consider the impact of this change on your data workloads�[0m
�[1m[1]�[0m �[36mCopy data from MANAGED HMS to MANAGED UC table�[0m
�[1m[2]�[0m �[36mMigrate MANAGED HMS table as EXTERNAL UC table. This option would require you to convert MANAGED HMS tables to EXTERNAL HMS tables once UC migration is complete, otherwise deleting HMS MANAGED table would delete the migrated UC table�[0m
Enter a number between 0 and 2
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Zi8M/config.yml
11:25 DEBUG [tests.integration.conftest] Waiting for clusters to start...
11:25 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 64.976/sec
11:25 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.046479
11:25 DEBUG [tests.integration.conftest] Waiting for clusters to start...
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_2tUzGN04zQ0dt5mr catalog: https://DATABRICKS_HOST/#explore/data/ucx_2tUzGN04zQ0dt5mr
11:25 INFO [databricks.labs.ucx.install] Installing UCX v0.55.1+1220250211112546
11:25 INFO [databricks.labs.ucx.install] Creating ucx schemas...
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm database exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.CLOUD_ENV_service_principals table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.clusters table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.global_init_scripts table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.jobs table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.pipelines table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.external_locations table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.mounts table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.grants table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.groups table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.tables table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.table_size table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.table_failures table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.workspace_objects table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.permissions table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.submit_runs table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.policies table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.migration_status table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.workflow_problems table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.query_problems table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.udfs table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.logs table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.recon_results table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.directfs_in_paths table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.directfs_in_queries table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.used_tables_in_paths table exists
11:25 INFO [databricks.labs.blueprint.parallel] deploy tables 10/29, rps: 4.983/sec
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.used_tables_in_queries table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.inferred_grants table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.redash_dashboards table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.lakeview_dashboards table exists
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
11:25 INFO [databricks.labs.blueprint.parallel] deploy tables 20/29, rps: 6.278/sec
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
11:25 INFO [databricks.labs.blueprint.parallel] deploy tables 29/29, rps: 8.443/sec
11:25 INFO [databricks.labs.blueprint.parallel] Finished 'deploy tables' tasks: 0% results available (0/29). Took 0:00:03.435533
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.grant_detail view matches queries/views/grant_detail.sql contents
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.objects view matches queries/views/objects.sql contents
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.table_estimates view matches queries/views/table_estimates.sql contents
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.misc_patterns view matches queries/views/misc_patterns.sql contents
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.code_patterns view matches queries/views/code_patterns.sql contents
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.reconciliation_results view matches queries/views/reconciliation_results.sql contents
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.directfs view matches queries/views/directfs.sql contents
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.used_tables view matches queries/views/used_tables.sql contents
11:25 INFO [databricks.labs.ucx.install] Creating dashboards...
11:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
11:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
11:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
11:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:26 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:26 INFO [databricks.labs.blueprint.parallel] installing dashboards 7/7, rps: 2.775/sec
11:26 INFO [databricks.labs.blueprint.parallel] Finished 'installing dashboards' tasks: 0% results available (0/7). Took 0:00:02.523366
11:26 INFO [databricks.labs.blueprint.parallel] installing components 2/2, rps: 0.136/sec
11:26 INFO [databricks.labs.blueprint.parallel] Finished 'installing components' tasks: 0% results available (0/2). Took 0:00:14.746300
11:26 INFO [databricks.labs.blueprint.tui] Asking prompt: Open job overview in your browser? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Zi8M/README
11:26 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Zi8M/README for the next steps.
11:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_shnrm.tables] ignoring any existing tables inventory; refresh is forced.
11:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_shnrm.tables] crawling new set of snapshot data for tables
11:26 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_s5187] listing tables and views
11:26 INFO [databricks.labs.blueprint.parallel] listing tables 1/1, rps: 1.598/sec
11:26 INFO [databricks.labs.blueprint.parallel] Finished 'listing tables' tasks: 100% results available (1/1). Took 0:00:00.625998
11:26 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_s5187.dummy_t7kcj] fetching table metadata
11:26 INFO [databricks.labs.blueprint.parallel] describing tables in hive_metastore 1/1, rps: 1.836/sec
11:26 INFO [databricks.labs.blueprint.parallel] Finished 'describing tables in hive_metastore' tasks: 100% results available (1/1). Took 0:00:00.545163
11:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_shnrm.tables] found 1 new records for tables
11:26 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups job: https://DATABRICKS_HOST#job/718396665850206
11:26 INFO [databricks.labs.ucx.installer.workflows] Started migrate-groups job: https://DATABRICKS_HOST#job/718396665850206/runs/621978817404387
11:26 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-groups workflow: https://DATABRICKS_HOST#job/718396665850206
11:26 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
11:25 INFO [databricks.sdk] Using Databricks Metadata Service authentication
11:25 INFO [databricks.sdk] Using Databricks Metadata Service authentication
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created [email protected]: https://DATABRICKS_HOST/#settings/workspace/identity-and-access/users/351827569449332
11:25 INFO [databricks.labs.pytester.fixtures.iam] Workspace group ucx-F29m-ra78b35eb9: https://DATABRICKS_HOST#setting/accounts/groups/208323420204813
11:25 INFO [databricks.labs.pytester.fixtures.iam] Account group ucx-F29m-ra78b35eb9: https://accounts.CLOUD_ENVdatabricks.net/users/groups/665887309910226/members
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-wJqS-ra78b35eb9: https://DATABRICKS_HOST/setting/clusters/cluster-policies/view/000FFCE0F37042FD
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_s5187 schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_s5187
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_s5187.dummy_t7kcj schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_s5187/dummy_t7kcj
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_shnrm schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_shnrm
11:25 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Zi8M/config.yml) doesn't exist.
11:25 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mChoose how to map the workspace groups:�[0m
�[1m[0]�[0m �[36mMatch by Name�[0m
�[1m[1]�[0m �[36mApply a Prefix�[0m
�[1m[2]�[0m �[36mApply a Suffix�[0m
�[1m[3]�[0m �[36mMatch by External ID�[0m
�[1m[4]�[0m �[36mRegex Substitution�[0m
�[1m[5]�[0m �[36mRegex Matching�[0m
Enter a number between 0 and 5
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to skip TACL migration when migrating tables?
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to define a TEST_SCHEMA owner group for all tables and schemas? 
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 4095808988021766 block Internet access?
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
11:25 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
11:25 INFO [databricks.labs.ucx.install] Fetching installations...
11:25 INFO [databricks.labs.blueprint.parallel] finding Zi8M installations 100/103, rps: 244.974/sec
11:25 INFO [databricks.labs.blueprint.parallel] finding Zi8M installations 103/103, rps: 239.465/sec
11:25 INFO [databricks.labs.blueprint.parallel] Finished 'finding Zi8M installations' tasks: 0% results available (0/103). Took 0:00:00.431075
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on�[0m
�[1m[0]�[0m �[36m[Create new PRO SQL warehouse]�[0m
�[1m[1]�[0m �[36mDEFAULT Test Warehouse (DATABRICKS_WAREHOUSE_ID, SERVERLESS, RUNNING)�[0m
Enter a number between 0 and 1
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
11:25 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: �[1mIf hive_metastore contains managed table with external location paths (not dbfs root), please select which migration option to choose from�[0m
�[1m[0]�[0m �[36mConvert MANAGED HMS table to EXTERNAL HMS table and migrate as EXTERNAL UC table. Once the relevant HMS tables are deleted, the underlying data won't get deleted anymore, consider the impact of this change on your data workloads�[0m
�[1m[1]�[0m �[36mCopy data from MANAGED HMS to MANAGED UC table�[0m
�[1m[2]�[0m �[36mMigrate MANAGED HMS table as EXTERNAL UC table. This option would require you to convert MANAGED HMS tables to EXTERNAL HMS tables once UC migration is complete, otherwise deleting HMS MANAGED table would delete the migrated UC table�[0m
Enter a number between 0 and 2
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
11:25 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Zi8M/config.yml
11:25 DEBUG [tests.integration.conftest] Waiting for clusters to start...
11:25 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 64.976/sec
11:25 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.046479
11:25 DEBUG [tests.integration.conftest] Waiting for clusters to start...
11:25 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_2tUzGN04zQ0dt5mr catalog: https://DATABRICKS_HOST/#explore/data/ucx_2tUzGN04zQ0dt5mr
11:25 INFO [databricks.labs.ucx.install] Installing UCX v0.55.1+1220250211112546
11:25 INFO [databricks.labs.ucx.install] Creating ucx schemas...
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm database exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.CLOUD_ENV_service_principals table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.clusters table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.global_init_scripts table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.jobs table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.pipelines table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.external_locations table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.mounts table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.grants table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.groups table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.tables table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.table_size table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.table_failures table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.workspace_objects table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.permissions table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.submit_runs table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.policies table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.migration_status table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.workflow_problems table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.query_problems table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.udfs table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.logs table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.recon_results table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.directfs_in_paths table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.directfs_in_queries table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.used_tables_in_paths table exists
11:25 INFO [databricks.labs.blueprint.parallel] deploy tables 10/29, rps: 4.983/sec
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.used_tables_in_queries table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.inferred_grants table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.redash_dashboards table exists
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.lakeview_dashboards table exists
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
11:25 INFO [databricks.labs.blueprint.parallel] deploy tables 20/29, rps: 6.278/sec
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
11:25 INFO [databricks.labs.blueprint.parallel] deploy tables 29/29, rps: 8.443/sec
11:25 INFO [databricks.labs.blueprint.parallel] Finished 'deploy tables' tasks: 0% results available (0/29). Took 0:00:03.435533
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.grant_detail view matches queries/views/grant_detail.sql contents
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.objects view matches queries/views/objects.sql contents
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.table_estimates view matches queries/views/table_estimates.sql contents
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.misc_patterns view matches queries/views/misc_patterns.sql contents
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.code_patterns view matches queries/views/code_patterns.sql contents
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
11:25 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.reconciliation_results view matches queries/views/reconciliation_results.sql contents
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.directfs view matches queries/views/directfs.sql contents
11:25 INFO [databricks.labs.lsql.deployment] Ensuring hive_metastore.dummy_shnrm.used_tables view matches queries/views/used_tables.sql contents
11:25 INFO [databricks.labs.ucx.install] Creating dashboards...
11:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
11:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
11:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
11:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
11:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:26 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
11:26 INFO [databricks.labs.blueprint.parallel] installing dashboards 7/7, rps: 2.775/sec
11:26 INFO [databricks.labs.blueprint.parallel] Finished 'installing dashboards' tasks: 0% results available (0/7). Took 0:00:02.523366
11:26 INFO [databricks.labs.blueprint.parallel] installing components 2/2, rps: 0.136/sec
11:26 INFO [databricks.labs.blueprint.parallel] Finished 'installing components' tasks: 0% results available (0/2). Took 0:00:14.746300
11:26 INFO [databricks.labs.blueprint.tui] Asking prompt: Open job overview in your browser? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Zi8M/README
11:26 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Zi8M/README for the next steps.
11:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_shnrm.tables] ignoring any existing tables inventory; refresh is forced.
11:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_shnrm.tables] crawling new set of snapshot data for tables
11:26 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_s5187] listing tables and views
11:26 INFO [databricks.labs.blueprint.parallel] listing tables 1/1, rps: 1.598/sec
11:26 INFO [databricks.labs.blueprint.parallel] Finished 'listing tables' tasks: 100% results available (1/1). Took 0:00:00.625998
11:26 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_s5187.dummy_t7kcj] fetching table metadata
11:26 INFO [databricks.labs.blueprint.parallel] describing tables in hive_metastore 1/1, rps: 1.836/sec
11:26 INFO [databricks.labs.blueprint.parallel] Finished 'describing tables in hive_metastore' tasks: 100% results available (1/1). Took 0:00:00.545163
11:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_shnrm.tables] found 1 new records for tables
11:26 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups job: https://DATABRICKS_HOST#job/718396665850206
11:26 INFO [databricks.labs.ucx.installer.workflows] Started migrate-groups job: https://DATABRICKS_HOST#job/718396665850206/runs/621978817404387
11:26 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-groups workflow: https://DATABRICKS_HOST#job/718396665850206
11:26 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
11:27 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to uninstall ucx from the workspace too, this would remove ucx project folder, dashboards, queries and jobs
11:27 INFO [databricks.labs.ucx.install] Deleting UCX v0.55.1+1220250211112546 from https://DATABRICKS_HOST
11:27 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to delete the inventory database dummy_shnrm too?
11:27 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_shnrm
11:27 INFO [databricks.labs.lsql.deployment] Deleting hive_metastore.dummy_shnrm database
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=306715891416688, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=652101197325831, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=855024476031182, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=132321514909250, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=125375881972340, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=718396665850206, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=39668126944107, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=459537607112625, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=701903692364140, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=419583109655075, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=852110328691964, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=853097304050299, as it is no longer needed
11:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=945528217980954, as it is no longer needed
11:27 INFO [databricks.labs.ucx.install] Deleting cluster policy
11:27 INFO [databricks.labs.ucx.install] Deleting secret scope
11:27 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw5] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #394

@github-actions GitHub Actions
Copy link
Author

❌ test_running_real_migrate_groups_job: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task apply_permissions failed with message: Workload failed, see run output for details. (3m47.776s) 
databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task apply_permissions failed with message: Workload failed, see run output for details.
[gw8] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python
23:42 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.CvWt/config.yml) doesn't exist.
23:42 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
23:42 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
23:42 INFO [databricks.labs.ucx.install] Fetching installations...
23:42 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
23:42 DEBUG [tests.integration.conftest] Waiting for clusters to start...
23:42 DEBUG [tests.integration.conftest] Waiting for clusters to start...
23:42 INFO [databricks.labs.ucx.install] Installing UCX v0.55.1+2220250212234248
23:42 INFO [databricks.labs.ucx.install] Creating ucx schemas...
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
23:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
23:43 INFO [databricks.labs.ucx.install] Creating dashboards...
23:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
23:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
23:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
23:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.CvWt/README for the next steps.
23:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s2iy1.tables] ignoring any existing tables inventory; refresh is forced.
23:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s2iy1.tables] crawling new set of snapshot data for tables
23:43 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_s0bfx] listing tables and views
23:43 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_s0bfx.dummy_t8awv] fetching table metadata
23:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s2iy1.tables] found 1 new records for tables
23:43 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups job: https://DATABRICKS_HOST#job/1090500665332939
23:43 INFO [databricks.labs.ucx.installer.workflows] Started migrate-groups job: https://DATABRICKS_HOST#job/1090500665332939/runs/522198966471726
23:43 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-groups workflow: https://DATABRICKS_HOST#job/1090500665332939
23:43 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
23:42 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.CvWt/config.yml) doesn't exist.
23:42 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
23:42 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
23:42 INFO [databricks.labs.ucx.install] Fetching installations...
23:42 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
23:42 DEBUG [tests.integration.conftest] Waiting for clusters to start...
23:42 DEBUG [tests.integration.conftest] Waiting for clusters to start...
23:42 INFO [databricks.labs.ucx.install] Installing UCX v0.55.1+2220250212234248
23:42 INFO [databricks.labs.ucx.install] Creating ucx schemas...
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
23:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
23:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
23:43 INFO [databricks.labs.ucx.install] Creating dashboards...
23:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
23:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
23:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
23:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
23:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
23:43 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.CvWt/README for the next steps.
23:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s2iy1.tables] ignoring any existing tables inventory; refresh is forced.
23:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s2iy1.tables] crawling new set of snapshot data for tables
23:43 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_s0bfx] listing tables and views
23:43 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.dummy_s0bfx.dummy_t8awv] fetching table metadata
23:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s2iy1.tables] found 1 new records for tables
23:43 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups job: https://DATABRICKS_HOST#job/1090500665332939
23:43 INFO [databricks.labs.ucx.installer.workflows] Started migrate-groups job: https://DATABRICKS_HOST#job/1090500665332939/runs/522198966471726
23:43 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-groups workflow: https://DATABRICKS_HOST#job/1090500665332939
23:43 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
23:45 INFO [databricks.labs.ucx.install] Deleting UCX v0.55.1+2220250212234248 from https://DATABRICKS_HOST
23:45 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_s2iy1
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1090500665332939, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=693232288481101, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=970892407345198, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=980389020745910, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=643845035224084, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=843764887978041, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1033357988828382, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=133527339968767, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=869528966533327, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=722733161860116, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=712573711669848, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=984448467377485, as it is no longer needed
23:46 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=323160223359781, as it is no longer needed
23:46 INFO [databricks.labs.ucx.install] Deleting cluster policy
23:46 INFO [databricks.labs.ucx.install] Deleting secret scope
23:46 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw8] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #398

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
0 participants