[jira] [Commented] (SPARK-19557) Output parameters are not present in SQL Query Plan
[ https://issues.apache.org/jira/browse/SPARK-19557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15870664#comment-15870664 ] Apache Spark commented on SPARK-19557: -- User 'cloud-fan' has created a pull request for this issue: https://github.com/apache/spark/pull/16962 > Output parameters are not present in SQL Query Plan > --- > > Key: SPARK-19557 > URL: https://issues.apache.org/jira/browse/SPARK-19557 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 2.1.0 >Reporter: Salil Surendran > > For DataFrameWriter methods like parquet(), json(), csv() etc. output > parameters are not present in the QueryExecution object. For methods like > saveAsTable() they do. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19557) Output parameters are not present in SQL Query Plan
[ https://issues.apache.org/jira/browse/SPARK-19557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862595#comment-15862595 ] Hyukjin Kwon commented on SPARK-19557: -- Could you describe "this information", input and output here? > Output parameters are not present in SQL Query Plan > --- > > Key: SPARK-19557 > URL: https://issues.apache.org/jira/browse/SPARK-19557 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 2.1.0 >Reporter: Salil Surendran > > For DataFrameWriter methods like parquet(), json(), csv() etc. output > parameters are not present in the QueryExecution object. For methods like > saveAsTable() they do. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19557) Output parameters are not present in SQL Query Plan
[ https://issues.apache.org/jira/browse/SPARK-19557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862528#comment-15862528 ] Salil Surendran commented on SPARK-19557: - [~hyukjin.kwon] We don't have this information in the query plan as per the discussion in this PR https://github.com/apache/spark/pull/16664 . > Output parameters are not present in SQL Query Plan > --- > > Key: SPARK-19557 > URL: https://issues.apache.org/jira/browse/SPARK-19557 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 2.1.0 >Reporter: Salil Surendran > > For DataFrameWriter methods like parquet(), json(), csv() etc. output > parameters are not present in the QueryExecution object. For methods like > saveAsTable() they do. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19557) Output parameters are not present in SQL Query Plan
[ https://issues.apache.org/jira/browse/SPARK-19557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862371#comment-15862371 ] Hyukjin Kwon commented on SPARK-19557: -- I mean, up to my understanding, we do have path in the query execution, schema and other information about the plan. Do you mean extra options? > Output parameters are not present in SQL Query Plan > --- > > Key: SPARK-19557 > URL: https://issues.apache.org/jira/browse/SPARK-19557 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 2.1.0 >Reporter: Salil Surendran > > For DataFrameWriter methods like parquet(), json(), csv() etc. output > parameters are not present in the QueryExecution object. For methods like > saveAsTable() they do. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19557) Output parameters are not present in SQL Query Plan
[ https://issues.apache.org/jira/browse/SPARK-19557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862368#comment-15862368 ] Hyukjin Kwon commented on SPARK-19557: -- I am sorry that I don't follow the JIRA. Could I please ask to provide any reproducable codes or desired output? > Output parameters are not present in SQL Query Plan > --- > > Key: SPARK-19557 > URL: https://issues.apache.org/jira/browse/SPARK-19557 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 2.1.0 >Reporter: Salil Surendran > > For DataFrameWriter methods like parquet(), json(), csv() etc. output > parameters are not present in the QueryExecution object. For methods like > saveAsTable() they do. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
