[GitHub] [spark] ueshin commented on pull request #40402: [SPARK-42020][CONNECT][PYTHON] Support UserDefinedType in Spark Connect

2023-03-22 Thread via GitHub
ueshin commented on PR #40402: URL: https://github.com/apache/spark/pull/40402#issuecomment-1480349942 @zhengruifeng I submitted two PRs: #40526 and #40527. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] ueshin commented on pull request #40402: [SPARK-42020][CONNECT][PYTHON] Support UserDefinedType in Spark Connect

2023-03-20 Thread via GitHub
ueshin commented on PR #40402: URL: https://github.com/apache/spark/pull/40402#issuecomment-1477260665 @zhengruifeng ah, seems like something is wrong when the schema is a column name list. Could you use `StructType` to specify the schema as a workaround? I'll take a look later. --

[GitHub] [spark] ueshin commented on pull request #40402: [SPARK-42020][CONNECT][PYTHON] Support UserDefinedType in Spark Connect

2023-03-17 Thread via GitHub
ueshin commented on PR #40402: URL: https://github.com/apache/spark/pull/40402#issuecomment-1474479783 @zhengruifeng Sorry, I missed your comment: > will there be another PR for the support of UDT in `createDataFrame`? No, this also enables UDT in `createDataFrame`. -- This