[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095226#comment-14095226 ] Siddharth Seth commented on TEZ-1390: - Sounds good. Replace byte[] with ByteBuffer as

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095485#comment-14095485 ] Johannes Zillmann commented on TEZ-1390: Just curious, whats the benefit of using

[jira] [Created] (TEZ-1410) DAGClient#waitForCompletion() methods should not swallow interrupts

Johannes Zillmann created TEZ-1410: -- Summary: DAGClient#waitForCompletion() methods should not swallow interrupts Key: TEZ-1410 URL: https://issues.apache.org/jira/browse/TEZ-1410 Project: Apache

[jira] [Updated] (TEZ-1410) DAGClient#waitForCompletion() methods should not swallow interrupts

[ https://issues.apache.org/jira/browse/TEZ-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johannes Zillmann updated TEZ-1410: --- Attachment: TEZ-1410.1.patch DAGClient#waitForCompletion() methods should not swallow

[jira] [Commented] (TEZ-1331) Investigate : interrupts being swallowed by TezClient/DAGClient methods

[ https://issues.apache.org/jira/browse/TEZ-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095503#comment-14095503 ] Johannes Zillmann commented on TEZ-1331: Had a look at the code base. Only crucial

[jira] [Comment Edited] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095579#comment-14095579 ] Jonathan Eagles edited comment on TEZ-1390 at 8/13/14 3:24 PM: ---

[jira] [Commented] (TEZ-1400) Reducers stuck when enabling auto-reduce parallelism (MRR case)

[ https://issues.apache.org/jira/browse/TEZ-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095816#comment-14095816 ] Bikas Saha commented on TEZ-1400: - Can you confirm that ShuffleVertexManager is being

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095827#comment-14095827 ] Bikas Saha commented on TEZ-1390: - We do not have a strong case right now except that some

[jira] [Resolved] (TEZ-817) TEZ_LIB_URI are always uploaded as public Local Resource

[ https://issues.apache.org/jira/browse/TEZ-817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-817. Resolution: Fixed Fix Version/s: 0.5.0 Hadoop Flags: Reviewed Thanks for your contribution.

[jira] [Commented] (TEZ-1347) Consolidate MRHelpers

[ https://issues.apache.org/jira/browse/TEZ-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096093#comment-14096093 ] Bikas Saha commented on TEZ-1347: - TezAPIHelpers Why does it have to have API is the name.

[jira] [Updated] (TEZ-1402) MRoutput configurer should allow other committers and no committer

[ https://issues.apache.org/jira/browse/TEZ-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1402: Attachment: TEZ-1402.3.patch Thanks. Attaching commit patch. MRoutput configurer should allow other

[jira] [Commented] (TEZ-1402) MRoutput configurer should allow other committers and no committer

[ https://issues.apache.org/jira/browse/TEZ-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096148#comment-14096148 ] Siddharth Seth commented on TEZ-1402: - Looks good. MRoutput configurer should allow

[jira] [Updated] (TEZ-1402) MRoutput configurer should disable committer

[ https://issues.apache.org/jira/browse/TEZ-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1402: Summary: MRoutput configurer should disable committer (was: MRoutput configurer should allow other

[jira] [Created] (TEZ-1411) Address initial feedback on swimlanes

Bikas Saha created TEZ-1411: --- Summary: Address initial feedback on swimlanes Key: TEZ-1411 URL: https://issues.apache.org/jira/browse/TEZ-1411 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-1361) Move SimpleMRProcessor, MRInput and MROutput into runtime-library

[ https://issues.apache.org/jira/browse/TEZ-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096179#comment-14096179 ] Bikas Saha commented on TEZ-1361: - I am leaning towards leaving this in tez-mapreduce but

[jira] [Resolved] (TEZ-1361) Move SimpleMRProcessor, MRInput and MROutput into runtime-library

[ https://issues.apache.org/jira/browse/TEZ-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-1361. - Resolution: Not a Problem Move SimpleMRProcessor, MRInput and MROutput into runtime-library

[jira] [Assigned] (TEZ-1361) Move SimpleMRProcessor, MRInput and MROutput into runtime-library

[ https://issues.apache.org/jira/browse/TEZ-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha reassigned TEZ-1361: --- Assignee: Bikas Saha Move SimpleMRProcessor, MRInput and MROutput into runtime-library

[jira] [Commented] (TEZ-1055) Rename tez-mapreduce-examples to tez-examples

[ https://issues.apache.org/jira/browse/TEZ-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096187#comment-14096187 ] Bikas Saha commented on TEZ-1055: - [~rekhajoshm] Can I take up this blocker jira since we

[jira] [Updated] (TEZ-1347) Consolidate MRHelpers

[ https://issues.apache.org/jira/browse/TEZ-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1347: Attachment: TEZ-1347.2.txt Updated patch with comments addressed. Renamed TezAPIHelpers to TezUtils

[jira] [Commented] (TEZ-1132) Consistent naming of Input and Outputs

[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096248#comment-14096248 ] Bikas Saha commented on TEZ-1132: - LocalOnFileSorterOutput should probably be removed.

[jira] [Updated] (TEZ-671) Support View/Modify ACLs for DAGs

[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-671: Attachment: TEZ-671.3.patch Comments addressed. Support View/Modify ACLs for DAGs

[jira] [Updated] (TEZ-269) Fix ResourceMgrDelegate#getDelegationToken after YARN-868 is fixed

[ https://issues.apache.org/jira/browse/TEZ-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated TEZ-269: - Attachment: TEZ-269.patch Patch can be submitted once YARN-868 is committed Fix

[jira] [Created] (TEZ-1413) Fix build for TestTezClientUtils.testLocalResourceVisibility

Bikas Saha created TEZ-1413: --- Summary: Fix build for TestTezClientUtils.testLocalResourceVisibility Key: TEZ-1413 URL: https://issues.apache.org/jira/browse/TEZ-1413 Project: Apache Tez Issue

[jira] [Created] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

Bikas Saha created TEZ-1414: --- Summary: Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass. Key: TEZ-1414 URL: https://issues.apache.org/jira/browse/TEZ-1414 Project: Apache Tez

[jira] [Updated] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

[ https://issues.apache.org/jira/browse/TEZ-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1414: Attachment: TEZ-1414.1.patch Committing trivial patch. Disable

[jira] [Resolved] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

[ https://issues.apache.org/jira/browse/TEZ-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-1414. - Resolution: Fixed Fix Version/s: 0.5.0 commit e2692f7cacd56fd2e8d2734f79ecfbb447e2fc2c Author:

[jira] [Commented] (TEZ-1132) Consistent naming of Input and Outputs

[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096298#comment-14096298 ] Jeff Zhang commented on TEZ-1132: - [~bikassaha] Sure, please take this. Consistent naming

[jira] [Comment Edited] (TEZ-1132) Consistent naming of Input and Outputs

[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096298#comment-14096298 ] Jeff Zhang edited comment on TEZ-1132 at 8/13/14 11:29 PM: ---

[jira] [Updated] (TEZ-1072) Consolidate monitoring APIs in DAGClient

[ https://issues.apache.org/jira/browse/TEZ-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1072: Assignee: Jonathan Eagles Consolidate monitoring APIs in DAGClient

[jira] [Commented] (TEZ-671) Support View/Modify ACLs for DAGs

[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096328#comment-14096328 ] Hitesh Shah commented on TEZ-671: - API introductions involved. [~bikassaha] [~sseth] please

[jira] [Commented] (TEZ-1222) Add examples for uses of the API

[ https://issues.apache.org/jira/browse/TEZ-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096333#comment-14096333 ] Bikas Saha commented on TEZ-1222: - WordCount, OrderededWordCount and SimpleSessionExample

[jira] [Updated] (TEZ-1222) Add examples for uses of the API

[ https://issues.apache.org/jira/browse/TEZ-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1222: Priority: Major (was: Blocker) Add examples for uses of the API

[jira] [Commented] (TEZ-684) Uber/Local modes for Tez

[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096355#comment-14096355 ] Bikas Saha commented on TEZ-684: What happens to local resources that are part of the vertex

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096356#comment-14096356 ] Jeff Zhang commented on TEZ-1345: - Attach the patch. [~hitesh] I make the following

[jira] [Commented] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

[ https://issues.apache.org/jira/browse/TEZ-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096377#comment-14096377 ] Prakash Ramachandran commented on TEZ-1414: --- Working on this. the reason for

[jira] [Created] (TEZ-1415) Merge various Util classes in Tez

Bikas Saha created TEZ-1415: --- Summary: Merge various Util classes in Tez Key: TEZ-1415 URL: https://issues.apache.org/jira/browse/TEZ-1415 Project: Apache Tez Issue Type: Bug Reporter:

[jira] [Commented] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

[ https://issues.apache.org/jira/browse/TEZ-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096389#comment-14096389 ] Hitesh Shah commented on TEZ-1414: -- [~pramachandran] The other approach would be to use a

[jira] [Updated] (TEZ-1316) Document public interfaces/classes which are not meant to be implemented/extended

[ https://issues.apache.org/jira/browse/TEZ-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1316: Priority: Blocker (was: Critical) Document public interfaces/classes which are not meant to be

[jira] [Updated] (TEZ-1334) Annotate all non public classes in tez-api/tez-runtime-library with @private

[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1334: Priority: Blocker (was: Major) Annotate all non public classes in tez-api/tez-runtime-library with

[jira] [Created] (TEZ-1416) tez-api project javadoc/annotations review and clean up.

Bikas Saha created TEZ-1416: --- Summary: tez-api project javadoc/annotations review and clean up. Key: TEZ-1416 URL: https://issues.apache.org/jira/browse/TEZ-1416 Project: Apache Tez Issue Type:

[jira] [Updated] (TEZ-1337) Handling of local-dirs for Local Mode

[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1337: Priority: Major (was: Blocker) Handling of local-dirs for Local Mode

[jira] [Comment Edited] (TEZ-1337) Handling of local-dirs for Local Mode

[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096462#comment-14096462 ] Siddharth Seth edited comment on TEZ-1337 at 8/14/14 2:29 AM: --

[jira] [Comment Edited] (TEZ-684) Uber/Local modes for Tez

[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096467#comment-14096467 ] Siddharth Seth edited comment on TEZ-684 at 8/14/14 2:28 AM: -

[jira] [Created] (TEZ-1417) Rename *Configurer

Siddharth Seth created TEZ-1417: --- Summary: Rename *Configurer Key: TEZ-1417 URL: https://issues.apache.org/jira/browse/TEZ-1417 Project: Apache Tez Issue Type: Sub-task Reporter:

[jira] [Updated] (TEZ-1416) tez-api project javadoc/annotations review and clean up.

[ https://issues.apache.org/jira/browse/TEZ-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1416: Attachment: TEZ-1416.1.patch Attached patch cleans up the javadoc. Adds public annotation for all public

[jira] [Updated] (TEZ-1409) Change MRInputConfigurer, MROutputConfigurer to accept specific classes, isntead of a generic class

[ https://issues.apache.org/jira/browse/TEZ-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1409: Attachment: TEZ-1409.1.txt Patch makes the following changes. - InputFormat and path nullable -

[jira] [Updated] (TEZ-1072) Consolidate monitoring APIs in DAGClient

[ https://issues.apache.org/jira/browse/TEZ-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1072: - Attachment: TEZ-1072-v1.patch Consolidate monitoring APIs in DAGClient

[jira] [Commented] (TEZ-1072) Consolidate monitoring APIs in DAGClient

[ https://issues.apache.org/jira/browse/TEZ-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096511#comment-14096511 ] Jonathan Eagles commented on TEZ-1072: -- [~sseth], [~bikassaha], Incorporating the

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096513#comment-14096513 ] Tsuyoshi OZAWA commented on TEZ-1390: - ByteString#asReadOnlyByteBuffer offers the

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096516#comment-14096516 ] Tsuyoshi OZAWA commented on TEZ-1390: - Thanks for sharing, Jonathan! [~bikassaha], I

[jira] [Commented] (TEZ-1337) Handling of local-dirs for Local Mode

[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096517#comment-14096517 ] Chen He commented on TEZ-1337: -- I am confused about some comments in previous discussion: On

[jira] [Updated] (TEZ-1418) Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

[ https://issues.apache.org/jira/browse/TEZ-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subroto Sanyal updated TEZ-1418: Summary: Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH (was: Default value for