[spark] branch master updated: [SPARK-45613][CORE] Expose DeterministicLevel as a DeveloperApi

[gurwls223]

This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new b7121e1cfe7 [SPARK-45613][CORE] Expose DeterministicLevel as a 
DeveloperApi
b7121e1cfe7 is described below

commit b7121e1cfe75e380dd58a3160ba799bc28444c2b
Author: Mridul Muralidharan <mridulatgmail.com>
AuthorDate: Fri Oct 20 15:22:21 2023 +0900

    [SPARK-45613][CORE] Expose DeterministicLevel as a DeveloperApi
    
    ### What changes were proposed in this pull request?
    Expose `DeterministicLevel` as a `DeveloperApi`
    
    ### Why are the changes needed?
    
[`RDD.getOutputDeterministicLevel`](https://github.com/apache/spark/blob/b9ac7d38ea7f4f7e57c4bbb7b5e5bc836b2b1c58/core/src/main/scala/org/apache/spark/rdd/RDD.scala#L2079)
 is a `DeveloperApi` - unfortunately, this cannot be overridden by users as 
`DeterministicLevel` is `private[spark]`.
    Expose it as a `DeveloperApi` to allow users to override this.
    
    ### Does this PR introduce _any_ user-facing change?
    Yes, updates the visibility of `DeterministicLevel`
    
    ### How was this patch tested?
    Visibility change, no test required.
    
    ### Was this patch authored or co-authored using generative AI tooling?
    No
    
    Closes #43461 from mridulm/master.
    
    Authored-by: Mridul Muralidharan <mridulatgmail.com>
    Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
---
 core/src/main/scala/org/apache/spark/rdd/RDD.scala | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/core/src/main/scala/org/apache/spark/rdd/RDD.scala 
b/core/src/main/scala/org/apache/spark/rdd/RDD.scala
index e74e4eac1b8..c6770c77b92 100644
--- a/core/src/main/scala/org/apache/spark/rdd/RDD.scala
+++ b/core/src/main/scala/org/apache/spark/rdd/RDD.scala
@@ -2176,6 +2176,7 @@ object RDD {
  * Note that, the output of an RDD usually relies on the parent RDDs. When the 
parent RDD's output
  * is INDETERMINATE, it's very likely the RDD's output is also INDETERMINATE.
  */
-private[spark] object DeterministicLevel extends Enumeration {
+@DeveloperApi
+object DeterministicLevel extends Enumeration {
   val DETERMINATE, UNORDERED, INDETERMINATE = Value
 }


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org