[SPARK-45613][CORE] Expose DeterministicLevel as a DeveloperApi

### What changes were proposed in this pull request? Expose `DeterministicLevel` as a `DeveloperApi` ### Why are the changes needed? [`RDD.getOutputDeterministicLevel`](https://github.com/apache/spark/blob/b9ac7d38ea7f4f7e57c4bbb7b5e5bc836b2b1c58/core/src/main/scala/org/apache/spark/rdd/RDD.scala#L2079) is a `DeveloperApi` - unfortunately, this cannot be overridden by users as `DeterministicLevel` is `private[spark]`. Expose it as a `DeveloperApi` to allow users to override this. ### Does this PR introduce _any_ user-facing change? Yes, updates the visibility of `DeterministicLevel` ### How was this patch tested? Visibility change, no test required. ### Was this patch authored or co-authored using generative AI tooling? No Closes apache#43461 from mridulm/master. Authored-by: Mridul Muralidharan <mridulatgmail.com> Signed-off-by: Hyukjin Kwon <[email protected]>
doupache · Oct 20, 2023 · b7121e1 · b7121e1
1 parent 3c847c6
commit b7121e1
Showing 1 changed file with 2 additions and 1 deletion.
diff --git a/core/src/main/scala/org/apache/spark/rdd/RDD.scala b/core/src/main/scala/org/apache/spark/rdd/RDD.scala
@@ -2176,6 +2176,7 @@ object RDD {
  * Note that, the output of an RDD usually relies on the parent RDDs. When the parent RDD's output
  * is INDETERMINATE, it's very likely the RDD's output is also INDETERMINATE.
  */
-private[spark] object DeterministicLevel extends Enumeration {
+@DeveloperApi
+object DeterministicLevel extends Enumeration {
   val DETERMINATE, UNORDERED, INDETERMINATE = Value
 }