[
https://issues.apache.org/jira/browse/HIVE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707343#comment-15707343
]
Rui Li commented on HIVE-15302:
-------------------------------
Hi [~vanzin], the potential conflicts introduced by transitive dep have always
been there. My understanding is {{spark.yarn.archive}} gives us a chance to
exclude unneeded jars as much as possible, right?
I have two more questions,
1. How to archive the spark jars if to use {{spark.yarn.archive}}? It worked if
I put the jars in a folder, but it didn't work if I tar or zip that folder.
2. I think the recommended config is to put the archive to HDFS? But if I
provide a local path, does it require that all the NMs have the same archive in
their local FS?
> Relax the requirement that HoS needs Spark built w/o Hive
> ---------------------------------------------------------
>
> Key: HIVE-15302
> URL: https://issues.apache.org/jira/browse/HIVE-15302
> Project: Hive
> Issue Type: Improvement
> Reporter: Rui Li
> Assignee: Rui Li
>
> This requirement becomes more and more unacceptable as SparkSQL becomes
> widely adopted. Let's use this JIRA to find out how we can relax the
> limitation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
