hzmsh commented on PR #59541: URL: https://github.com/apache/spark/pull/59541#issuecomment-6210282255
Hi @zhengruifeng, could you take a look when you have a moment? This widens the pivot value check you added in [#39191](https://github.com/apache/spark/pull/39191) ([SPARK-41693](https://issues.apache.org/jira/browse/SPARK-41693)), so that None, date and Decimal work in Connect as they do in classic. I kept a client-side check so that a Column or a nested list still gets a clear error before reaching the server. If you'd prefer to drop the per-value check and let `F.lit` validate, as classic leaves it to the JVM, I'm happy to change it; that would also make bytes, time, timedelta and the NumPy scalars that `F.lit` supports (for example `np.int64`, `np.bool_`, `np.float32`) work. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
