This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new b7121e1cfe7 [SPARK-45613][CORE] Expose DeterministicLevel as a
DeveloperApi
b7121e1cfe7 is described below
commit b7121e1cfe75e380dd58a3160ba799bc28444c2b
Author: Mridul Muralidharan <mridulatgmail.com>
AuthorDate: Fri Oct 20 15:22:21 2023 +0900
[SPARK-45613][CORE] Expose DeterministicLevel as a DeveloperApi
### What changes were proposed in this pull request?
Expose `DeterministicLevel` as a `DeveloperApi`
### Why are the changes needed?
[`RDD.getOutputDeterministicLevel`](https://github.com/apache/spark/blob/b9ac7d38ea7f4f7e57c4bbb7b5e5bc836b2b1c58/core/src/main/scala/org/apache/spark/rdd/RDD.scala#L2079)
is a `DeveloperApi` - unfortunately, this cannot be overridden by users as
`DeterministicLevel` is `private[spark]`.
Expose it as a `DeveloperApi` to allow users to override this.
### Does this PR introduce _any_ user-facing change?
Yes, updates the visibility of `DeterministicLevel`
### How was this patch tested?
Visibility change, no test required.
### Was this patch authored or co-authored using generative AI tooling?
No
Closes #43461 from mridulm/master.
Authored-by: Mridul Muralidharan <mridulatgmail.com>
Signed-off-by: Hyukjin Kwon <[email protected]>
---
core/src/main/scala/org/apache/spark/rdd/RDD.scala | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/core/src/main/scala/org/apache/spark/rdd/RDD.scala
b/core/src/main/scala/org/apache/spark/rdd/RDD.scala
index e74e4eac1b8..c6770c77b92 100644
--- a/core/src/main/scala/org/apache/spark/rdd/RDD.scala
+++ b/core/src/main/scala/org/apache/spark/rdd/RDD.scala
@@ -2176,6 +2176,7 @@ object RDD {
* Note that, the output of an RDD usually relies on the parent RDDs. When the
parent RDD's output
* is INDETERMINATE, it's very likely the RDD's output is also INDETERMINATE.
*/
-private[spark] object DeterministicLevel extends Enumeration {
+@DeveloperApi
+object DeterministicLevel extends Enumeration {
val DETERMINATE, UNORDERED, INDETERMINATE = Value
}
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
