Tempo causes collect() deprecation warning when used in DLT pipeline #408
Labels
enhancement
New feature or request
good first issue
Good for newcomers
performance
Issues with the time to execute operations or other performance issues
There are a number of collect()[0][0] instances in the Tempo code which trigger deprecation warnings if used in DLT pipelines. Perhaps replace collect()[0][0] with head()[0]. Accomplishes the same thing while avoiding the deprecation warning and might even bring a marginal performance boost since only the top row instead of the whole data frame would move to the driver node.
The text was updated successfully, but these errors were encountered: