[GitHub] [spark] ueshin commented on a change in pull request #34509: [SPARK-34521][PYTHON][SQL] Fix spark.createDataFrame when using pandas with StringDtype

2021-12-01 Thread GitBox
ueshin commented on a change in pull request #34509: URL: https://github.com/apache/spark/pull/34509#discussion_r760657918 ## File path: python/pyspark/sql/pandas/serializers.py ## @@ -169,6 +169,8 @@ def create_array(s, t): elif is_categorical_dtype(s.dtype):

[GitHub] [spark] ueshin commented on a change in pull request #34509: [SPARK-34521][PYTHON][SQL] Fix spark.createDataFrame when using pandas with StringDtype

2021-12-01 Thread GitBox
ueshin commented on a change in pull request #34509: URL: https://github.com/apache/spark/pull/34509#discussion_r760657918 ## File path: python/pyspark/sql/pandas/serializers.py ## @@ -169,6 +169,8 @@ def create_array(s, t): elif is_categorical_dtype(s.dtype):

[GitHub] [spark] ueshin commented on a change in pull request #34509: [SPARK-34521][PYTHON][SQL] Fix spark.createDataFrame when using pandas with StringDtype

2021-12-01 Thread GitBox
ueshin commented on a change in pull request #34509: URL: https://github.com/apache/spark/pull/34509#discussion_r760657918 ## File path: python/pyspark/sql/pandas/serializers.py ## @@ -169,6 +169,8 @@ def create_array(s, t): elif is_categorical_dtype(s.dtype):

[GitHub] [spark] ueshin commented on a change in pull request #34509: [SPARK-34521][PYTHON][SQL] Fix spark.createDataFrame when using pandas with StringDtype

2021-11-29 Thread GitBox
ueshin commented on a change in pull request #34509: URL: https://github.com/apache/spark/pull/34509#discussion_r758804602 ## File path: python/pyspark/sql/pandas/serializers.py ## @@ -169,6 +169,8 @@ def create_array(s, t): elif is_categorical_dtype(s.dtype):

[GitHub] [spark] ueshin commented on a change in pull request #34509: [SPARK-34521][PYTHON][SQL] Fix spark.createDataFrame when using pandas with StringDtype

2021-11-29 Thread GitBox
ueshin commented on a change in pull request #34509: URL: https://github.com/apache/spark/pull/34509#discussion_r758804602 ## File path: python/pyspark/sql/pandas/serializers.py ## @@ -169,6 +169,8 @@ def create_array(s, t): elif is_categorical_dtype(s.dtype):

[GitHub] [spark] ueshin commented on a change in pull request #34509: [SPARK-34521][PYTHON][SQL] Fix spark.createDataFrame when using pandas with StringDtype

2021-11-29 Thread GitBox
ueshin commented on a change in pull request #34509: URL: https://github.com/apache/spark/pull/34509#discussion_r758804602 ## File path: python/pyspark/sql/pandas/serializers.py ## @@ -169,6 +169,8 @@ def create_array(s, t): elif is_categorical_dtype(s.dtype):