A relevant observation: there was a closed/executed jira last year to remove the option to disable the codegen flag (and unsafe flag as well): https://issues.apache.org/jira/browse/SPARK-11644
2017-12-10 13:16 GMT-08:00 Jacek Laskowski <ja...@japila.pl>: > Hi, > > I'm wondering why a physical operator like GenerateExec would > extend CodegenSupport [1], but had the supportCodegen flag turned off? > > What's the meaning of such a combination -- be a CodegenSupport with > supportCodegen off? > > [1] https://github.com/apache/spark/blob/master/sql/core/ > src/main/scala/org/apache/spark/sql/execution/GenerateExec.scala#L58-L64 > > [2] https://github.com/apache/spark/blob/master/sql/core/ > src/main/scala/org/apache/spark/sql/execution/GenerateExec.scala#L125 > > Pozdrawiam, > Jacek Laskowski > ---- > https://about.me/JacekLaskowski > Spark Structured Streaming https://bit.ly/spark-structured-streaming > Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark > Follow me at https://twitter.com/jaceklaskowski >
