[
https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14572047#comment-14572047
]
Yin Huai commented on SPARK-2973:
---------------------------------
Also, {{sqlContext.tables().select(...).collect}} triggers a job (the reason is
explained above
https://issues.apache.org/jira/browse/SPARK-2973?focusedCommentId=14326247&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14326247).
> Use LocalRelation for all ExecutedCommands, avoid job for take/collect()
> ------------------------------------------------------------------------
>
> Key: SPARK-2973
> URL: https://issues.apache.org/jira/browse/SPARK-2973
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Aaron Davidson
> Assignee: Cheng Lian
> Priority: Critical
>
> Right now, sql("show tables").collect() will start a Spark job which shows up
> in the UI. There should be a way to get these without this step.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
