Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165940636
--- Diff: pom.xml ---
@@ -185,6 +185,10 @@
2.8
1.8
1.0.0
+
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165911313
--- Diff: pom.xml ---
@@ -185,6 +185,10 @@
2.8
1.8
1.0.0
+
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165884501
--- Diff: pom.xml ---
@@ -185,6 +185,10 @@
2.8
1.8
1.0.0
+
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165884027
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1923,6 +1923,9 @@ def toPandas(self):
02 Alice
15Bob
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165883842
--- Diff: pom.xml ---
@@ -185,6 +185,10 @@
2.8
1.8
1.0.0
+
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165883676
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1923,6 +1923,9 @@ def toPandas(self):
02 Alice
15Bob
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165879157
--- Diff: pom.xml ---
@@ -185,6 +185,10 @@
2.8
1.8
1.0.0
+
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165873671
--- Diff: python/setup.py ---
@@ -100,6 +100,11 @@ def _supports_symlinks():
file=sys.stderr)
exit(-1)
+# If
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165873582
--- Diff: python/pyspark/sql/tests.py ---
@@ -2794,7 +2792,6 @@ def count_bucketed_cols(names,
table="pyspark_bucket"):
def
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165873632
--- Diff: pom.xml ---
@@ -185,6 +185,10 @@
2.8
1.8
1.0.0
+
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165865310
--- Diff: python/pyspark/sql/utils.py ---
@@ -115,18 +115,30 @@ def toJArray(gateway, jtype, arr):
def require_minimum_pandas_version():
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165865284
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1923,6 +1923,9 @@ def toPandas(self):
02 Alice
15Bob
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165855123
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1923,6 +1923,9 @@ def toPandas(self):
02 Alice
15Bob
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165855092
--- Diff: python/pyspark/sql/utils.py ---
@@ -115,18 +115,30 @@ def toJArray(gateway, jtype, arr):
def require_minimum_pandas_version():
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165795585
--- Diff: python/pyspark/sql/utils.py ---
@@ -115,18 +115,30 @@ def toJArray(gateway, jtype, arr):
def require_minimum_pandas_version():
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165795538
--- Diff: python/pyspark/sql/tests.py ---
@@ -48,19 +48,26 @@
else:
import unittest
-_have_pandas = False
-_have_old_pandas
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165795335
--- Diff: python/pyspark/sql/tests.py ---
@@ -2819,13 +2816,13 @@ def test_to_pandas(self):
self.assertEquals(types[4], 'datetime64[ns]')
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165795135
--- Diff: python/pyspark/sql/tests.py ---
@@ -2858,14 +2855,16 @@ def
test_create_dataframe_from_pandas_with_timestamp(self):
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r165714499
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1923,6 +1923,9 @@ def toPandas(self):
02 Alice
15Bob
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/20487
[SPARK-23319][TESTS] Explicitly skips PySpark tests for old Pandas and
PyArrow
## What changes were proposed in this pull request?
This PR proposes to explicitly skip the tests for
20 matches
Mail list logo
