[
https://issues.apache.org/jira/browse/TEZ-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104699#comment-14104699
]
Chen He commented on TEZ-1376:
------------------------------
It's a good question. These two tests all passed. It does not mean all parallel
DAGs can be successfully executed on current local mode. Since two dags are
exactly the same dag, it is possible that the second DAG has already rewrite
the first DAG's local information. But the first DAG can still success.
I wrote a pig test based on a pig scripts. It also succeed. In that scenario, I
think, it highly depends on how Pig on Tez translates a pig script. I mean, for
example:
script1.pig will be translate to a tezsession and run successfully on Tez Local
Mode. It has following steps:
A->B->C
If I create a script2.pig which duplicates script1's every vertex( input data
is different for vertex A and D):
A->B->C
D->E->F
It also succeed if I run it based on Pig on Tez (local mode). That is why I
think it is highly depends on how pig on tez translate a pig script
> Support independent parallel DAGs execution in Local Mode
> ---------------------------------------------------------
>
> Key: TEZ-1376
> URL: https://issues.apache.org/jira/browse/TEZ-1376
> Project: Apache Tez
> Issue Type: Sub-task
> Affects Versions: 0.4.1
> Reporter: Chen He
> Attachments: simpleTestCase.patch
>
>
> Pig on Tez allows user to submit parallel DAGs in a single pig script. Those
> DAGs could be independent and concurrent. Current LocalMode may encounter
> some problems when concurrent parallel DAGs are submitted.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
