mgaido91 commented on issue #23171: [SPARK-26205][SQL] Optimize In for bytes,
shorts, ints
URL: https://github.com/apache/spark/pull/23171#issuecomment-447559881
we can keep `spark.sql.optimizer.inSetConversionThreshold` as of now, just
read it in `InSet` and behave accordingly. Then, we
mgaido91 commented on issue #23171: [SPARK-26205][SQL] Optimize In for bytes,
shorts, ints
URL: https://github.com/apache/spark/pull/23171#issuecomment-446916902
thanks @aokolnychyi. I just have a couple of comments on this:
1 - As @rxin mentioned, now we have InSet for handling
mgaido91 commented on issue #23171: [SPARK-26205][SQL] Optimize In for bytes,
shorts, ints
URL: https://github.com/apache/spark/pull/23171#issuecomment-446526465
thanks @aokolnychyi , may you please post here the result of that benchmark
after applying this patch?
Just a quick
