Liang-Chi Hsieh created SPARK-21717:

             Summary: Decouple the generated codes of consuming rows in 
operators under whole-stage codegen
                 Key: SPARK-21717
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.2.0
            Reporter: Liang-Chi Hsieh

It has been observed in SPARK-21603 that whole-stage codegen suffers 
performance degradtion, if generated functions are too long to be optimized by 

We basically produce a single function to incorporate generated codes from all 
physical operators in whole-stage. Thus, it is possibly to grow the size of 
generated function over a threshold that we can't have JIT optimization for it 

This ticket is trying to decouple the logic of consuming rows in physical 
operators to avoid a giant function processing rows.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to