Github user tomasatdatabricks commented on a diff in the pull request:
https://github.com/apache/spark/pull/20168#discussion_r160304870
--- Diff: python/pyspark/ml/image.py ---
@@ -201,8 +243,9 @@ def readImages(self, path, recursive=False,
numPartitions=-1,
.. versionadded:: 2.3.0
"""
- spark = SparkSession.builder.getOrCreate()
- image_schema = spark._jvm.org.apache.spark.ml.image.ImageSchema
+ ctx = SparkContext.getOrCreate()
--- End diff --
Good catch. Looks like this was caused by auto-rebasing onto the latest
changes. My original change was only to replace _active_context with
getOrCreate() but it was clearly made obsolete in the meantime. I'll just
remove it.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
