sadikovi commented on PR #40699: URL: https://github.com/apache/spark/pull/40699#issuecomment-1518270247
To be honest, I don't understand why spark-sql shell is expected to be consistent with spark-shell or pyspark shell. Can someone elaborate? I can see making spark-sql shell consistent with Presto/Trino/MySQL/Postgres, etc. but I don't understand why Scala REPL should be consistent with SQL terminal in terms of displaying results - they serve different purposes. I do support having a consistent visual behaviour for NULLs/nulls, just as long as it does not break other features like Cast or `collect.toString`. Maybe we could simply add a conversion method to display values in a DataFrame in whatever format we need when calling `.show` instead of changing Cast. In fact, we can refactor it into a separate class and reuse it in spark-sql and spark-shell. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
