Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22085#discussion_r209862336
--- Diff: python/pyspark/taskcontext.py ---
@@ -95,3 +95,92 @@ def getLocalProperty(self, key):
Get a local property set upstream in the driver, or None if it is
missing.
"""
return self._localProperties.get(key, None)
+
+
+class BarrierTaskContext(TaskContext):
+
+ """
+ .. note:: Experimental
+
+ A TaskContext with extra info and tooling for a barrier stage. To
access the BarrierTaskContext
+ for a running task, use:
+ L{BarrierTaskContext.get()}.
+
+ .. versionadded:: 2.4.0
+ """
+
+ _barrierContext = None
+
+ def __init__(self):
+ """Construct a BarrierTaskContext, use get instead"""
+ pass
--- End diff --
Ah, this is called in `_getOrCreate`. Sorry, I rushed to read. In this
case, frankly I think we can remove this since that's the default constructor
injected by Python or monkey patch to disallow the initialization (like we did
for `ImageSchema`) but I guess we don't necessarily be super clever on this.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
