Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13592#discussion_r66878387
--- Diff: docs/sql-programming-guide.md ---
@@ -1650,14 +1646,15 @@ SELECT * FROM jsonTable
## Hive Tables
Spark SQL also supports reading and writing data stored in [Apache
Hive](http://hive.apache.org/).
-However, since Hive has a large number of dependencies, it is not included
in the default Spark assembly.
-Hive support is enabled by adding the `-Phive` and `-Phive-thriftserver`
flags to Spark's build.
-This command builds a new assembly directory that includes Hive. Note that
this Hive assembly directory must also be present
-on all of the worker nodes, as they will need access to the Hive
serialization and deserialization libraries
-(SerDes) in order to access data stored in Hive.
+However, since Hive has a large number of dependencies, these dependencies
are not included in the
+default Spark distribution. If Hive dependencies can be found on the
classpath, Spark will load them
+automatically. Note that these Hive dependencies must also be present on
all of the worker nodes, as
+they will need access to the Hive serialization and deserialization
libraries (SerDes) in order to
+access data stored in Hive.
-Configuration of Hive is done by placing your `hive-site.xml`,
`core-site.xml` (for security configuration),
-`hdfs-site.xml` (for HDFS configuration) file in `conf/`.
+Configuration of Hive is done by placing your `core-site.xml` (for
security configuration),
+`hdfs-site.xml` (for HDFS configuration) file in `conf/`, and adding
configurations in your
+`hive-site.xml` into `conf/spark-defaults.conf`.
--- End diff --
it will not be true soon, users only need to put `hive-site.xml` in
classpath
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
