srowen commented on issue #24335: [SPARK-27425] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-481745371 This is my opinion but I think it would be shared by others. Presto and BigQuery are SQL-only and UDFs are relatively hard. Hence it makes sense to bake in a lot of SQL helper functions. In Spark it's easy to mix code in, so the value of SQL-only helpers isn't nearly as big. `df.filter("...complex condition").count()` does this easily for example. It's not a great example, because I'm not even sure the current SQL equivalent is much more complex. The SQL helper functions you see today are mostly to match Hive. If Hive supports something that's a more compelling argument to add it for interop.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
