Github user chenghao-intel commented on the pull request:
https://github.com/apache/spark/pull/5714#issuecomment-105081673
@marmbrus I am not sure if I understand your mean, but the root cause
should be here
https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala#L908
When `DF.cache()` called, will cause `withCachedData` is created, without
any inmemory cached logical plan found(most likely). I was trying to replace
the `lazy val` with `def` for `SQLContext.QueryExecution`, however, it leads
some `RunnableCommand` run twice in some cases.
Since this PR doesn't change any user-level API, how about merge this fix
first as bug fixing, and we can revert it back once we figure out the better
approach? Or you were suggesting the better approach?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
