PJ Fanning created SPARK-20539:
----------------------------------
Summary: support optional dataframe name
Key: SPARK-20539
URL: https://issues.apache.org/jira/browse/SPARK-20539
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.1.0
Reporter: PJ Fanning
In the Spark UI and some exception logging, Dataframes are described using the
schemas. This is very useful.
We use Spark SQL in an application where our customers can manipulate data.
When we need to examine logs or check the Spark REST API or UI, we would prefer
to be able to override the name of the Dataframe to be something that
identifies the origin of the Dataframe as opposed to having the column names
exposed. There is a small possibility that the column names could contain some
Personally Identifiable Information.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
