You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, datafusion places PipelineChecker at the end of the PhysicalOptimizer rules and uses it as a final gatekeeping rule. Therefore, all custom requests should be added before it to ensure that the plans after custom optimization (like WindowedSort or RemoveDuplicate) can still meet the checks of PipelineChecker.
In datafusion, PipelineChecker is described as follow:
// The PipelineChecker rule will reject non-runnable query plans that use// pipeline-breaking operators on infinite input(s). The rule generates a// diagnostic error message when this happens. It makes no changes to the// given query plan; i.e. it only acts as a final gatekeeping rule.Arc::new(PipelineChecker::new()),
Implementation challenges
No response
The text was updated successfully, but these errors were encountered:
What type of enhancement is this?
Refactor
What does the enhancement do?
Currently, datafusion places
PipelineChecker
at the end of the PhysicalOptimizer rules and uses it as a final gatekeeping rule. Therefore, all custom requests should be added before it to ensure that the plans after custom optimization (likeWindowedSort
orRemoveDuplicate
) can still meet the checks of PipelineChecker.In datafusion,
PipelineChecker
is described as follow:Implementation challenges
No response
The text was updated successfully, but these errors were encountered: