GitHub user sureshthalamati opened a pull request:
https://github.com/apache/spark/pull/10452
[SPARK-12504][SQL] Masking credentials in the sql plan explain output for
JDBC data sources.
This fix masks JDBC credentials in the explain output. URL patterns to
specify credential seems to be vary between different databases. Added a new
method to dialect to mask the credentials according to the database specific
URL pattern.
While adding tests I noticed explain output includes array variable for
partitions ([Lorg.apache.spark.Partition;@3ff74546,). Modified the code to
include the first, and last partition information.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sureshthalamati/spark
mask_jdbc_credentials_spark-12504
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10452.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10452
----
commit 22502bc8a8bfded2efa194897f6d01f0d37ba3be
Author: sureshthalamati <[email protected]>
Date: 2015-12-23T18:42:44Z
mask jdbc data source credentials in the explain plan output
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
