You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Since the metastore can be used as a library, it could be useful to enumerate which tables exist.
Feature
Add a method to the metastore reader that lists all tables that are available.
Scala
Python
Proposed Solution
valtables:Seq[String] = metastore.getTables()
An idea to discuss. Usually, metastores have the concept of databases. We can simulate it by a dot prefix (db.table1). We can use this to segregate uat and prod tables, for instance.
// Fetch all tables starting with 'uat.'valtablesUat:Seq[String] = metastore.getTables("uat")
Idea. What if instead of Seq[String] the method would return Seq[Table], which would contain table name and description?
The text was updated successfully, but these errors were encountered:
The segregation by prefixes is a very nice idea. Users could even organize the tables into "hierarchies", like uat.bronze.customers and prod.gold.purchases (if using medallion architecture) etc. And then query all production gold tables for example.
Just adding this potential idea here so we don't forget.
Background
Since the metastore can be used as a library, it could be useful to enumerate which tables exist.
Feature
Add a method to the metastore reader that lists all tables that are available.
Proposed Solution
An idea to discuss. Usually, metastores have the concept of databases. We can simulate it by a dot prefix (db.table1). We can use this to segregate uat and prod tables, for instance.
The text was updated successfully, but these errors were encountered: