Add dashboards to migration progress dashboard#3314

Merged

gueniai merged 133 commits intomainfrom feat/add-code-migration-to-migration-progress-dashboard

Jan 10, 2025

+584-70

Commits on Jan 8, 2025

Set LineageAtom.other to dict by default
JCZuurmond
committed
Add dashboard progress encoder
JCZuurmond
committed
Get table failures from historical table snapshot
JCZuurmond
committed
Allow other to be None
JCZuurmond
committed
Remove cached properties from dashboard progress encoder
JCZuurmond
committed
Add first integration test for dashboard progress encoder
JCZuurmond
committed
Test dashboard progress encoder without failures
JCZuurmond
committed
Test dashboard failure coming from query problem
JCZuurmond
committed
Test dashboard failure coming from dfsa
JCZuurmond
committed
Rewrite tests to assert on historical rows
JCZuurmond
committed
Test used table failure from hive metastore table
JCZuurmond
committed
Merge tests
JCZuurmond
committed
Test Table.from_historical
JCZuurmond
committed
Format
JCZuurmond
committed
Assert row in integration test
JCZuurmond
committed
Add default attributes to expected data
JCZuurmond
committed
Add id attributes to dashboard
JCZuurmond
committed
Add dashboard ownership to GlobalContext
JCZuurmond
committed
Add dashboard progress encoder to runtime context
JCZuurmond
committed
Force key word argument in dashboard progress encoder
JCZuurmond
committed
Update dashboard progress encoder integration test
JCZuurmond
committed
Expect DFSA message to come from query problem
JCZuurmond
committed
Add from table info to Table
JCZuurmond
committed
Isort
JCZuurmond
committed
Remove used tables crawler from TableProgressEncoder
JCZuurmond
committed
Pass failure from used table to dashboard
JCZuurmond
committed
Persist dashboard migration progress in workflow
JCZuurmond
committed
Force run integration test in CI
JCZuurmond
committed
Test Redash ownership is me
JCZuurmond
committed
Test ownership of directory
JCZuurmond
committed
Support ownership of directory
JCZuurmond
committed
Test owner of directory
JCZuurmond
committed
Test retrieving ownership for invalid path
JCZuurmond
committed
Handle invalid path
JCZuurmond
committed
Add missing type hints
JCZuurmond
committed
Test warn about unsupported object type
JCZuurmond
committed
Warn about unsupported object type
JCZuurmond
committed
Test Lakeview dashboard ownership is me
JCZuurmond
committed
Test getting user name
JCZuurmond
committed
Handle resource does not exists
JCZuurmond
committed
Handle None types
JCZuurmond
committed
Remove legacy test
JCZuurmond
committed
Update unit test
JCZuurmond
committed
Rename me to current_user
JCZuurmond
committed
The owner of an invalid path should fallback on the workspace admin
JCZuurmond
committed
Improve assert message
JCZuurmond
committed
Skip test when running in debug
JCZuurmond
committed
Copy changes from #3112
JCZuurmond
committed
Add integration test
JCZuurmond
committed
Add dashboard fixture
JCZuurmond
committed
Append dashboard inventory snapshot
JCZuurmond
committed
Revert storing UsedTable, QueryProblem and DFSA snapshots
JCZuurmond
committed
Store QueryProblem into table
JCZuurmond
committed
Add TODO
JCZuurmond
committed
Remove DFSA, QueryProblem and UsedTable queries
JCZuurmond
committed
Rename code section to Dashboards
JCZuurmond
committed
Update data asset to dashboard references
JCZuurmond
committed
Avoid redefinition
JCZuurmond
committed
Fix partition by
JCZuurmond
committed
Fix check substring
JCZuurmond
committed
Fix name for code compatability issues
JCZuurmond
committed
Create query for dashboard
JCZuurmond
committed
Link query problems with dashboard
JCZuurmond
committed
Swap arguments in contains
JCZuurmond
committed
Swap failure and dashboard_type columns
JCZuurmond
committed
Remove query problems widget
JCZuurmond
committed
Add dashboard with dfsa
JCZuurmond
committed
Add dashboard that is correct
JCZuurmond
committed
Add query problem with dfsa
JCZuurmond
committed
Add dashboard with Hive table
JCZuurmond
committed
Reuse tables in used tables
JCZuurmond
committed
Add used table for query
JCZuurmond
committed
Persist used tables in queries
JCZuurmond
committed
Fix missing comma in query problem
JCZuurmond
committed
Fix reference wrong query id
JCZuurmond
committed
Swap columns
JCZuurmond
committed
Use non-migrated table
JCZuurmond
committed
Assert None fields
JCZuurmond
committed
Shorten variable name
JCZuurmond
committed
Move workflow run into for loop
JCZuurmond
committed
Rename table migration statuses
JCZuurmond
committed
Rename table migration statuses pending migration
JCZuurmond
committed
Rename variable
JCZuurmond
committed
Verify right dashboard is chosen
JCZuurmond
committed
Improve asserts in fixtures
JCZuurmond
committed
Fix asserts
JCZuurmond
committed
Add type hint
JCZuurmond
committed
Fix reference to variable
JCZuurmond
committed
Add type hinting
JCZuurmond
committed
Make query problems dynamic using dashboards
JCZuurmond
committed
Separate dashboard with Hive table out
JCZuurmond
committed
Let dashboard reference all Hive tables
JCZuurmond
committed
Use dashboard with Hive table
JCZuurmond
committed
Handle None attributes
JCZuurmond
committed
Reuse tables migrated
JCZuurmond
committed
Move job with and without failures to separate fixtures
JCZuurmond
committed
Link job with failures to workflow problem
JCZuurmond
committed
Add docstring
JCZuurmond
committed
Reuse job wit and without failures
JCZuurmond
committed
Remove redundant UsedTable LineageAtoms
JCZuurmond
committed
Handle None
JCZuurmond
committed
Move dbfs location to separate fixture
JCZuurmond
committed
Split used tables
JCZuurmond
committed
Format
JCZuurmond
committed
Create a catalog and schema for migrated tables
JCZuurmond
committed
Create the tables
JCZuurmond
committed
Add dashboard with UC tables fixture
JCZuurmond
committed
Add dashboard with UC tables to dashboards
JCZuurmond
committed
Add used tables to dashboard
JCZuurmond
committed
Update table ownership
JCZuurmond
committed
Fix query names in test
JCZuurmond
committed
Fix number of dashboards pending migration
JCZuurmond
committed
Fix expected row for dashboard pending migration
JCZuurmond
committed
Move distinct failure per object type to the bottom
JCZuurmond
committed
Add dashboard to overall progress
JCZuurmond
committed
Add dashboard migration progress counter
JCZuurmond
committed
Move fixture rows around
JCZuurmond
committed
Sort by failure
JCZuurmond
committed
Test subset of dashboards pending migration
JCZuurmond
committed
Rename tests
JCZuurmond
committed
Format
JCZuurmond
committed
Fix total percentage
JCZuurmond
committed
Add missing field
JCZuurmond
committed
Exclude owner from Redash checks
JCZuurmond
committed
Force commit
JCZuurmond
committed
Merge branch 'main' into feat/add-code-migration-to-migration-progress-dashboard
JCZuurmond
committed

Commits on Jan 9, 2025

Commits on Jan 10, 2025

Merge branch 'main' into feat/add-code-migration-to-migration-progress-dashboard
JCZuurmond
committed
Merge branch 'main' into feat/add-code-migration-to-migration-progress-dashboard
JCZuurmond
committed
Merge branch 'main' into feat/add-code-migration-to-migration-progress-dashboard
gueniai
authored