Make migration to Signature::nullary in 44.0.0 easier / less confusing

[alamb]

Is your feature request related to a problem or challenge?

While working to reproduce the issue from @kylebarron here:

• Schema error when returning DenseUnion from ScalarUDF #13762

He had this signature for a UDF that has no arguments

impl UnionExample {
    pub fn new() -> Self {
        Self {
            signature: Signature::any(0, Volatility::Immutable),
        }
    }
}

This compiled without error / incident

However, when I ran that on latest main I got a very strange (to me) error:

called Result::unwrap() on an Err value: Plan("Error during planning: example_union does not support zero arguments. No function matches the given name and argument types 'example_union()'. You might need to add explicit type casts.\n\tCandidate functions:\n\texample_union()")

To fix it I found I had to:

-            signature: Signature::any(0, Volatility::Immutable),
+            signature: Signature::nullary(Volatility::Volatile),

I think this will make upgrading to 44 a pain

Describe the solution you'd like

I would like DataFusion to either:

1. Support the old style signature for zero args
2. Generate a clear error that tells me what I have to fix in my code (aka change to nullary

Describe alternatives you've considered

No response

Additional context

Nullary appears to have been added in this PR by @jayzhan211

• Support TypeSignature::Nullary #13354

[findepi]

Signature::any is specified as "A specified number of arguments of any type"
what's wrong with Signature::any(0)?

[alamb]

Signature::any is specified as "A specified number of arguments of any type"
what's wrong with Signature::any(0)?

I don't know. It would also be fine if that format kept working as before (maybe better).

[jayzhan211]

The reason why Signature::nullary is the preferred choice is that otherwise we can have Signature::any(0), Signature::exact(0), Signature::coercible(0) that represent the same thing -- nullary. I hope we can have a single representation for NoArg case. I think adding constraint to Signature::Any(n) that n > 0 makes sense to me, we can have it as "Non-zero number of arguments of any type"

[alamb]

In my opinion the important thing is that someone who has an existing Signature::any(0) etc is guided to how to fix the problem.

Ideas (I can make PRs for this once we agree)

Option 1: Backwards compatibility:

1. Add special cases for Signature::any(0) and Signature::exact(0) and Signature::coercible(0) that does the same as nullary (I think this would be the most user friendly and would be backwards compatible)

Option 2: Better errors

1. make the error message more specific (something like "Signature::any(0) is not supported, please use Signature::nullary`)
2. Add documentation to the enums so that if someone is lookiing for "what signature do I use for 0 argument function" they can find nullary quickly

Option 3: API w/ compile time checks

We could also take a more drastic approach and verify this at compile time by making the compiler reject non zero numbers (I think this API churn is more expensive than the value saves than worth it at the moment):

pub enum Signature {
  Exact(NonZeroUsize)
...
}

[jayzhan211]

Option2 seems like a better choice