[
https://issues.apache.org/jira/browse/HIVE-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425832#comment-15425832
]
Rui Li commented on HIVE-14554:
-------------------------------
Spark has hadoop-provided profile. Maybe we can enable that to avoid the
conflicts. And there is HIVE-14240 to get rid of a complete spark distribution.
Regarding the download time, I think that depends on the network connectivity
of the node. It can easily take over 15 min in my local environment. So I don't
think all the guys would be happy to download the file each time they want to
run some ptest. Is it possible that we only do the cleanup for pre-commit test?
> Hive ptest should delete the itests/thirdparty directory everytime it builds
> hive
> ---------------------------------------------------------------------------------
>
> Key: HIVE-14554
> URL: https://issues.apache.org/jira/browse/HIVE-14554
> Project: Hive
> Issue Type: Task
> Components: Testing Infrastructure
> Reporter: Sergio Peña
> Assignee: Sergio Peña
>
> The {{itests/thridparty}} directory is created by hive on spark when
> downloading the spark-assembly file. Hive ptest should delete this directory
> everytime it runs a new set of tests to avoid conflicts when a new spark
> tarball is submitted.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)