Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TODO] allow to pass additional mapping between table and partition keys in it that aren't defined explicitly #272

Open
nfx opened this issue Nov 4, 2024 · 0 comments

Comments

@nfx
Copy link
Collaborator

nfx commented Nov 4, 2024

See more context:

tables = spark.sql(f"show tables in `{database_name}`")
# TODO: allow to pass additional mapping between table and partition keys in it that aren't defined explicitly
partition_keys = {}
columns_mapping = {}
for tbl in tables.collect():
table_name = tbl["tableName"]

@nfx nfx added the tech debt label Nov 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant