[jira] [Updated] (TEZ-1478) TestContainerReuse.testReuseNonLocalRequest test is unstable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1478: - Description: I tried to build tez on several computers. branch master, last commit 4842c3a

[jira] [Updated] (TEZ-1478) TestContainerReuse.testReuseNonLocalRequest test is unstable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1478: - Description: I tried to build tez on several computers. branch master, last commit 4842c3a

[jira] [Updated] (TEZ-1478) TestContainerReuse.testReuseNonLocalRequest test is unstable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1478: - Summary: TestContainerReuse.testReuseNonLocalRequest test is unstable (was: TestContainerR

[jira] [Commented] (TEZ-1478) TestContainerReuse test is not stable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106511#comment-14106511 ] Alexander Pivovarov commented on TEZ-1478: -- I switched to branch-0.4.1-incubating.

[jira] [Created] (TEZ-1479) Disambiguate between ShuffleInputEventHandler and ShuffleInputEventHandlerImpl (which are not related)

2014-08-21 Thread Gopal V (JIRA)
Gopal V created TEZ-1479: Summary: Disambiguate between ShuffleInputEventHandler and ShuffleInputEventHandlerImpl (which are not related) Key: TEZ-1479 URL: https://issues.apache.org/jira/browse/TEZ-1479 Proj

[jira] [Updated] (TEZ-1478) TestContainerReuse test is not stable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1478: - Description: I tried to build tez on several computers. branch master, last commit 4842c3a

[jira] [Commented] (TEZ-1473) TEZ_RUNTIME_SHUFFLE_BUFFER is too large by default

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106468#comment-14106468 ] Siddharth Seth commented on TEZ-1473: - {code} tez.task.launch.cmd-opts -server -Xmx4096

[jira] [Updated] (TEZ-1478) TestContainerReuse test is not stable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1478: - Attachment: TEST-org.apache.tez.dag.app.rm.TestContainerReuse.xml org.apache

[jira] [Updated] (TEZ-1478) TestContainerReuse test is not stable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1478: - Description: I tried to build tez on several computers on some computers tests work but on

[jira] [Commented] (TEZ-1476) DAGClient waitForCompletion output is confusing

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106454#comment-14106454 ] Siddharth Seth commented on TEZ-1476: - [~jeagles] - thanks for changing MRRSleep, it was

[jira] [Updated] (TEZ-1478) TestContainerReuse test is not stable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1478: - Description: I tried to build tez on several computers on some computers tests work but on

[jira] [Updated] (TEZ-1478) TestContainerReuse test is not stable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1478: - Description: I tried to build tez on several computers on some computers tests work but on

[jira] [Updated] (TEZ-1478) TestContainerReuse test is not stable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1478: - Description: I tried to build tez on several computers on some computers tests work but on

[jira] [Updated] (TEZ-1478) TestContainerReuse test is not stable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1478: - Description: I tried to build tez on several computers on some computers tests work but on

[jira] [Commented] (TEZ-1473) TEZ_RUNTIME_SHUFFLE_BUFFER is too large by default

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106448#comment-14106448 ] Tsuyoshi OZAWA commented on TEZ-1473: - The workload is wordcount against 20 GB data gene

[jira] [Updated] (TEZ-1478) TestContainerReuse test is not stable

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1478: - Description: I tried to build tez on several computers on some computers tests work but on

[jira] [Created] (TEZ-1478) TestContainerReuse test is not stable

2014-08-21 Thread Alexander Pivovarov (JIRA)
Alexander Pivovarov created TEZ-1478: Summary: TestContainerReuse test is not stable Key: TEZ-1478 URL: https://issues.apache.org/jira/browse/TEZ-1478 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-1471) Additional supplement for TEZ local mode document

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106435#comment-14106435 ] Siddharth Seth commented on TEZ-1471: - [~jeagles] - looks like we need to make several m

[jira] [Created] (TEZ-1477) Add a container identifier to the context classes

2014-08-21 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-1477: --- Summary: Add a container identifier to the context classes Key: TEZ-1477 URL: https://issues.apache.org/jira/browse/TEZ-1477 Project: Apache Tez Issue Type: Im

[jira] [Commented] (TEZ-1471) Additional supplement for TEZ local mode document

2014-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106417#comment-14106417 ] Jonathan Eagles commented on TEZ-1471: -- Couple of minor thoughts * Can the Documentatio

[jira] [Commented] (TEZ-1467) Tez job "actual" status is miss-reported between RM UI and Console

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106415#comment-14106415 ] Siddharth Seth commented on TEZ-1467: - Progress is fairly vague at this point, since we

[jira] [Commented] (TEZ-1471) Additional supplement for TEZ local mode document

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106408#comment-14106408 ] Siddharth Seth commented on TEZ-1471: - {code} +* In current Local Mode, large amount

[jira] [Commented] (TEZ-1467) Tez job "actual" status is miss-reported between RM UI and Console

2014-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106377#comment-14106377 ] Jonathan Eagles commented on TEZ-1467: -- It appears the the console DAG progress (comput

[jira] [Commented] (TEZ-1363) Make use of the regular scheduler when running in LocalMode

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106157#comment-14106157 ] Siddharth Seth commented on TEZ-1363: - Also, unit tests - for the allocator, should help

[jira] [Commented] (TEZ-1363) Make use of the regular scheduler when running in LocalMode

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106151#comment-14106151 ] Siddharth Seth commented on TEZ-1363: - In TezLocalAMRMClientAsync - containerRequests -

[jira] [Updated] (TEZ-1476) DAGClient waitForCompletion output is confusing

2014-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1476: - Attachment: TEZ-1476-v1.patch > DAGClient waitForCompletion output is confusing > -

[jira] [Commented] (TEZ-1448) Make WeightedScalingMemoryDistributor as the default memory distributor

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106123#comment-14106123 ] Siddharth Seth commented on TEZ-1448: - +1. > Make WeightedScalingMemoryDistributor as t

[jira] [Commented] (TEZ-1448) Make WeightedScalingMemoryDistributor as the default memory distributor

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106122#comment-14106122 ] Siddharth Seth commented on TEZ-1448: - The reduce would also end up spilling if it doesn

[jira] [Commented] (TEZ-1476) DAGClient waitForCompletion output is confusing

2014-08-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106121#comment-14106121 ] Jeff Zhang commented on TEZ-1476: - Meet the same issue. And I remember the behavior is diffe

[jira] [Updated] (TEZ-1471) Additional supplement for TEZ local mode document

2014-08-21 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated TEZ-1471: - Issue Type: Sub-task (was: Improvement) Parent: TEZ-684 > Additional supplement for TEZ local mode documen

[jira] [Assigned] (TEZ-1476) DAGClient waitForCompletion output is confusing

2014-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles reassigned TEZ-1476: Assignee: Jonathan Eagles > DAGClient waitForCompletion output is confusing > ---

[jira] [Updated] (TEZ-1448) Make WeightedScalingMemoryDistributor as the default memory distributor

2014-08-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1448: -- Attachment: TEZ-1448.3.patch Thanks @sseth. Made equal distribution for SortedMergedInput and So

[jira] [Updated] (TEZ-1083) Enable IFile RLE for DefaultSorter

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1083: Target Version/s: 0.5.1 > Enable IFile RLE for DefaultSorter > -- > >

[jira] [Created] (TEZ-1476) DAGClient waitForCompletion output is confusing

2014-08-21 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-1476: --- Summary: DAGClient waitForCompletion output is confusing Key: TEZ-1476 URL: https://issues.apache.org/jira/browse/TEZ-1476 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-1475) Update wiki 0.5.0 to match INSTALL.txt

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1475: - Description: 1. wiki should be fixed to match INSTALL.txt from git wiki - http://tez.apach

[jira] [Updated] (TEZ-1475) Update wiki 0.5.0 to match INSTALL.txt

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1475: - Description: 1. wiki should be fixed to match INSTALL.txt from git http://tez.apache.org/i

[jira] [Created] (TEZ-1475) Update wiki 0.5.0 to match INSTALL.txt

2014-08-21 Thread Alexander Pivovarov (JIRA)
Alexander Pivovarov created TEZ-1475: Summary: Update wiki 0.5.0 to match INSTALL.txt Key: TEZ-1475 URL: https://issues.apache.org/jira/browse/TEZ-1475 Project: Apache Tez Issue Type: Tas

[jira] [Commented] (TEZ-1464) Update INSTALL.txt

2014-08-21 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105870#comment-14105870 ] Hitesh Shah commented on TEZ-1464: -- [~bikassaha] Another jira for this or has this already

[jira] [Commented] (TEZ-1464) Update INSTALL.txt

2014-08-21 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105754#comment-14105754 ] Alexander Pivovarov commented on TEZ-1464: -- 1. Should wiki be fixed as well http:/

[jira] [Commented] (TEZ-1307) FrameworkClient leaks YarnExceptions to the caller

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105692#comment-14105692 ] Siddharth Seth commented on TEZ-1307: - OK. Lets just leave it as is then - in case there

[jira] [Commented] (TEZ-1448) Make WeightedScalingMemoryDistributor as the default memory distributor

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105691#comment-14105691 ] Siddharth Seth commented on TEZ-1448: - Looks good. Last little bit; I think the default

[jira] [Commented] (TEZ-1474) detect missing native libraries for compression at the beginning of a task rather than at the end.

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105685#comment-14105685 ] Siddharth Seth commented on TEZ-1474: - +1. Looks good. Will commit once the branch is op

[jira] [Updated] (TEZ-1474) detect missing native libraries for compression at the beginning of a task rather than at the end.

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1474: Target Version/s: 0.5.1 Fix Version/s: (was: 0.5.1) > detect missing native libraries for

[jira] [Commented] (TEZ-1473) TEZ_RUNTIME_SHUFFLE_BUFFER is too large by default

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105678#comment-14105678 ] Siddharth Seth commented on TEZ-1473: - [~hozawa] - forgot to ask, could you provide more

[jira] [Updated] (TEZ-1474) detect missing native libraries for compression at the beginning of a task rather than at the end.

2014-08-21 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-1474: -- Attachment: TEZ-1474.1.patch > detect missing native libraries for compression at the beg

[jira] [Created] (TEZ-1474) detect missing native libraries for compression at the beginning of a task rather than at the end.

2014-08-21 Thread Prakash Ramachandran (JIRA)
Prakash Ramachandran created TEZ-1474: - Summary: detect missing native libraries for compression at the beginning of a task rather than at the end. Key: TEZ-1474 URL: https://issues.apache.org/jira/browse/TE

[jira] [Commented] (TEZ-1473) TEZ_RUNTIME_SHUFFLE_BUFFER is too large by default

2014-08-21 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105507#comment-14105507 ] Hitesh Shah commented on TEZ-1473: -- [~sseth] Should the weighted memory allocator have hand

[jira] [Commented] (TEZ-1446) Move the fetch code for local disk fetch from data movement event handlers to fetcher

2014-08-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105118#comment-14105118 ] Siddharth Seth commented on TEZ-1446: - Comments on the patch, mostly minor - In impl/Fet