Github user bersprockets commented on the issue:
https://github.com/apache/spark/pull/21144
@hvanhovell I couldn't find another path that had this particular issue,
except possibly in the aggregation area (where a grouping projection is created
but not initialized). But I couldn't make it fail there.
Also, I turned off as much of the code generation as I could (through
patching, etc,) and ran the SQL unit tests. I didn't get any 'requirement
failed' exceptions. However, I did get 1270 failed tests,
90% of which failed with UnsupportedOperationExceptions (SortPrefix.eval is
the one I keep seeing). Fixing those issues may allow more 'requirement failed'
exceptions to pop out.
The original unit test that got me looking at this ("SPARK-10740: handle
nondeterministic expressions correctly for set operations") is still failing,
but for a different reason: The rows in the table are processed in a different
order between interpreted and codegen mode. rand(7) is used as a filter, and
although the sequence of random numbers is the same, the row to which each
random number is being compared is different between interpreted and codegen
mode.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
