You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
are set. This needs to be investigated further. For example if the loader file format is parquet and the user is yielding arrow tables from the resource, the file_max_bytes seems to be ignore and file_max_items only is respected if the the rowcount of the yielded arrow table is smaller than this. We can either fix this, or if this behavior is intentional for performance reasons print a warning or info to the logger so it is less confusing for the user.
The text was updated successfully, but these errors were encountered:
The normalizers behave differently for example if
are set. This needs to be investigated further. For example if the loader file format is parquet and the user is yielding arrow tables from the resource, the file_max_bytes seems to be ignore and file_max_items only is respected if the the rowcount of the yielded arrow table is smaller than this. We can either fix this, or if this behavior is intentional for performance reasons print a warning or info to the logger so it is less confusing for the user.
The text was updated successfully, but these errors were encountered: