[GitHub] [hudi] Zhangshunyu opened a new issue, #6655: [SUPPORT] tryComposeIndexFilterExpr in dataskip util could support InSet expression of spark?

Mon, 12 Sep 2022 01:38:05 -0700 


Zhangshunyu opened a new issue, #6655:
URL: https://github.com/apache/hudi/issues/6655

   spark has a threshold spark.sql.optimizer.inSetConversionThreshold by 
default it is 10,
   when filter is IN expression for example in ('1', '2', '3' ... '100'), when 
the values of in set > 10
   IN will transform to InSet, but the filter expression transform doesnt check 
InSet, it only has In
   
![image](https://user-images.githubusercontent.com/13940237/189609655-2a23c271-a48d-485d-80ae-f8e8d657c3ea.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to