Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/19459#discussion_r143605840
--- Diff: python/pyspark/sql/tests.py ---
@@ -3147,6 +3150,14 @@ def test_filtered_frame(self):
self.assertEqual(pdf.columns[0], "i")
self.assertTrue(pdf.empty)
+ def test_createDataFrame_toggle(self):
+ pdf = self.createPandasDataFrameFromeData()
+ self.spark.conf.set("spark.sql.execution.arrow.enable", "false")
+ df_no_arrow = self.spark.createDataFrame(pdf)
+ self.spark.conf.set("spark.sql.execution.arrow.enable", "true")
--- End diff --
done. I guess this would make the failure easier to see?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
