Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20909#discussion_r177658614
--- Diff: python/pyspark/sql/tests.py ---
@@ -84,6 +85,31 @@
from pyspark.sql.utils import AnalysisException, ParseException,
IllegalArgumentException
+def found_file(pattern):
+ SPARK_HOME = os.environ["SPARK_HOME"]
+ files = glob.glob(os.path.join(SPARK_HOME, pattern))
+ return len(files) > 0
+
+
+def search_hive_assembly_jars():
--- End diff --
Quick note: I think `check_hive_assembly_jars` would make more sense.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
