[
https://issues.apache.org/jira/browse/HIVE-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902967#action_12902967
]
John Sichi commented on HIVE-1487:
----------------------------------
Zheng has a private ptest shell script which takes a different approach: it
enumerates all of the .q files, partitions them modulo the degree of
parallelism, and then executes them in separate environments as separate
processes. One advantage is that there's no cross-talk from threading
(although in the long run testing with multithreading for independent tests
would be good for coverage).
I'll send you a pointer.
> parallelize test query runs
> ---------------------------
>
> Key: HIVE-1487
> URL: https://issues.apache.org/jira/browse/HIVE-1487
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: Testing Infrastructure
> Reporter: Joydeep Sen Sarma
>
> HIVE-1464 speeded up serial runs somewhat - but looks like it's still too
> slow. we should use parallel junit or some similar setup to run test queries
> in parallel. this should be really easy as well need to just use a separate
> warehouse/metadb and potentiall mapred system dir location.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.