sunchao commented on a change in pull request #31085:
URL: https://github.com/apache/spark/pull/31085#discussion_r553657932
##########
File path: docs/sql-data-sources-hive-tables.md
##########
@@ -148,6 +148,9 @@ The following options can be used to configure the version
of Hive that is used
<li><code>maven</code></li>
Use Hive jars of specified version downloaded from Maven repositories.
This configuration
is not generally recommended for production deployments.
+ <li><code>path</code></li>
Review comment:
nit: also need to update above: "three options" -> "four options".
##########
File path: docs/sql-data-sources-hive-tables.md
##########
@@ -156,6 +159,28 @@ The following options can be used to configure the version
of Hive that is used
</td>
<td>1.4.0</td>
</tr>
+ <tr>
+ <td><code>spark.sql.hive.metastore.jars.path</code></td>
+ <td><code>(empty)</code></td>
+ <td>
+ Comma-separated paths of the jars that used to instantiate the
HiveMetastoreClient.
+ This configuration is useful only when
<code>spark.sql.hive.metastore.jars</code> is set as <code>path</code>.
+ <br/>
+ The paths can be any of the following format:
+ <ol>
+ <li><code>file://path/to/jar/foo.jar</code></li>
+ <li><code>hdfs://nameservice/path/to/jar/foo.jar</code></li>
+ <li><code>/path/to/jar/</code>(path without URI scheme follow conf
<code>fs.defaultFS</code>'s URI schema)</li>
Review comment:
I remember there were discussion about using S3 as path in the original
PR but it is not supported yet, is that correct? there could be edge cases
where ppl set `fs.defaultFS` to a S3 path.
Also is viewfs supported as well? it's common ppl set that for
`fs.defaultFS` as well.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
