[ https://issues.apache.org/jira/browse/SPARK-22251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16200345#comment-16200345 ]
Ala Luszczak commented on SPARK-22251: -------------------------------------- I checked that if you type spark.conf.set("spark.sql.codegen.wholeStage", false) in Spark shell, it does take effect immediately. > Metric "aggregate time" is incorrect when codegen is off > -------------------------------------------------------- > > Key: SPARK-22251 > URL: https://issues.apache.org/jira/browse/SPARK-22251 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.2.0 > Reporter: Ala Luszczak > Priority: Minor > > When whole-stage codegen is off, metric "aggregate time" is not set correctly. > Repro: > # spark.conf.set("spark.sql.codegen.wholeStage", false) > # > spark.range(5).crossJoin(spark.range(5)).toDF("a","b").groupBy("a").agg(sum("b")).show > # In Spark UI > SQL you can see that "aggregate time total" is 0 in > "HashAggregate" boxes -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org