Yin Huai created SPARK-13003:
--------------------------------
Summary: Provide a option to trim InputRelation metadata in
QueryPlan.toJSON
Key: SPARK-13003
URL: https://issues.apache.org/jira/browse/SPARK-13003
Project: Spark
Issue Type: Improvement
Components: SQL
Reporter: Yin Huai
Right now, {{QueryPlan.toJSON}} of a relation can contain all of input paths.
So, the text size can be very large. It will be good to provide a option to
control if we want to trim input file paths. If we use toJSON for the
serialization/deserialization purpose, we do not want to trim paths. If we want
to put the JSON representation in logs, we can trim it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
