[jira] [Updated] (TEZ-1363) Make use of the regular scheduler when running in LocalMode

2014-08-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1363: - Attachment: TEZ-1363-v1.patch I assume we can use this ticket to start using regular task scheduler

[jira] [Updated] (TEZ-1395) TestSecureShuffle fails

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1395: - Attachment: TestSecureShuffle-logs.tgz [~rajesh.balamohan] attached mini cluster logs as well as test outpu

[jira] [Resolved] (TEZ-1423) Ability to pass custom properties to keySerializer for OnFileUnorderedPartitionedKVOutput

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-1423. - Resolution: Fixed Fix Version/s: 0.5.0 Hadoop Flags: Incompatible change,Reviewed commit 98875d

[jira] [Updated] (TEZ-1423) Ability to pass custom properties to keySerializer for OnFileUnorderedPartitionedKVOutput

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1423: Attachment: TEZ-1423.2.patch Attaching rebased patch for commit. > Ability to pass custom properties to keyS

[jira] [Resolved] (TEZ-1132) Consistent naming of Input and Outputs

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-1132. - Resolution: Fixed Fix Version/s: 0.5.0 Hadoop Flags: Incompatible change commit 469bf9052f7a51e

[jira] [Updated] (TEZ-1132) Consistent naming of Input and Outputs

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1132: Attachment: TEZ-1132.1.patch git.txt Attaching patch. Since this is a refactor and there was

[jira] [Resolved] (TEZ-1367) Review and clean packages in the API

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-1367. - Resolution: Done > Review and clean packages in the API > > >

[jira] [Commented] (TEZ-1367) Review and clean packages in the API

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099464#comment-14099464 ] Bikas Saha commented on TEZ-1367: - Took a pass over all packages. Looked fine. Recent refact

[jira] [Comment Edited] (TEZ-1132) Consistent naming of Input and Outputs

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099444#comment-14099444 ] Bikas Saha edited comment on TEZ-1132 at 8/16/14 1:51 AM: -- Changes

[jira] [Commented] (TEZ-1132) Consistent naming of Input and Outputs

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099444#comment-14099444 ] Bikas Saha commented on TEZ-1132: - LocalOnFileSorterOutput , LocalMergedInput moved to mapr

[jira] [Updated] (TEZ-1400) Reducers stuck when enabling auto-reduce parallelism (MRR case)

2014-08-15 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1400: -- Attachment: TEZ-1400.3.patch Thanks Bikas. Will make the tez-site related changes in this JIRA a

[jira] [Commented] (TEZ-1055) Rename tez-mapreduce-examples to tez-examples

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099430#comment-14099430 ] Bikas Saha commented on TEZ-1055: - Addendum for missed files. commit 40970e68e2aac401367ec36

[jira] [Created] (TEZ-1439) IntersectDataGen/Example/Validate should move back to tez-examples.

2014-08-15 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1439: Summary: IntersectDataGen/Example/Validate should move back to tez-examples. Key: TEZ-1439 URL: https://issues.apache.org/jira/browse/TEZ-1439 Project: Apache Tez I

[jira] [Updated] (TEZ-1438) Annotate add java doc for tez-runtime-library and tez-mapreduce

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1438: - Attachment: TEZ-1438.3.patch Rebased patch > Annotate add java doc for tez-runtime-library and tez-mapredu

[jira] [Updated] (TEZ-1438) Annotate add java doc for tez-runtime-library and tez-mapreduce

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1438: - Attachment: TEZ-1438.2.patch Addressed minor nits. > Annotate add java doc for tez-runtime-library and tez

[jira] [Commented] (TEZ-1055) Rename tez-mapreduce-examples to tez-examples

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099406#comment-14099406 ] Bikas Saha commented on TEZ-1055: - Minor comment. Should this just be Tez job instead of MRR

[jira] [Commented] (TEZ-1438) Annotate add java doc for tez-runtime-library and tez-mapreduce

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099394#comment-14099394 ] Hitesh Shah commented on TEZ-1438: -- Comments: - TezGroupedSplitsInputFormat - this suppo

[jira] [Commented] (TEZ-1055) Rename tez-mapreduce-examples to tez-examples

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099387#comment-14099387 ] Hitesh Shah commented on TEZ-1055: -- [~bikassaha] please review. > Rename tez-mapreduce-exa

[jira] [Updated] (TEZ-1055) Rename tez-mapreduce-examples to tez-examples

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1055: - Attachment: mod-list.txt TEZ-1055.1.patch mod-list.txt has a git status which you can use t

[jira] [Updated] (TEZ-1438) Annotate add java doc for tez-runtime-library and tez-mapreduce

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1438: Attachment: TEZ-1438.1.patch [~hitesh] Please review. > Annotate add java doc for tez-runtime-library and te

[jira] [Created] (TEZ-1438) Annotate add java doc for tez-runtime-library and tez-mapreduce

2014-08-15 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1438: --- Summary: Annotate add java doc for tez-runtime-library and tez-mapreduce Key: TEZ-1438 URL: https://issues.apache.org/jira/browse/TEZ-1438 Project: Apache Tez Issue T

[jira] [Commented] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

2014-08-15 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099372#comment-14099372 ] Jeff Zhang commented on TEZ-1065: - [~bikassaha] Thanks for fixing the test failure, will run

[jira] [Updated] (TEZ-1411) Address initial feedback on swimlanes

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1411: - Attachment: TEZ-1411.2.patch > Address initial feedback on swimlanes > - > >

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-15 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099354#comment-14099354 ] Tsuyoshi OZAWA commented on TEZ-1390: - OK. I also plan to rename to/fromByteArray to to/

[jira] [Updated] (TEZ-1418) Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1418: Assignee: Subroto Sanyal > Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH >

[jira] [Commented] (TEZ-1418) Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099326#comment-14099326 ] Bikas Saha commented on TEZ-1418: - commit 4897b25fe2ec0c9b0108f8a8f96b60f7b5f8ad06 Author: B

[jira] [Updated] (TEZ-1418) Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1418: Attachment: TEZ-1418.1.patch Attaching commit patch with edit suggested by [~hitesh]. > Provide Default valu

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099313#comment-14099313 ] Siddharth Seth commented on TEZ-1390: - Configurers have already been changed to use user

[jira] [Created] (TEZ-1437) Switch 0.5.0 installs instructions with current install guide as part of release

2014-08-15 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1437: Summary: Switch 0.5.0 installs instructions with current install guide as part of release Key: TEZ-1437 URL: https://issues.apache.org/jira/browse/TEZ-1437 Project: Apache Te

[jira] [Commented] (TEZ-1411) Address initial feedback on swimlanes

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099297#comment-14099297 ] Gopal V commented on TEZ-1411: -- [~jeagles]: You can produce a zoomed out view by modifing the "

[jira] [Commented] (TEZ-1335) JMX based history logging service

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099301#comment-14099301 ] Gopal V commented on TEZ-1335: -- [~rajesh.balamohan]: Can you upload a WIP to this, so that I ca

[jira] [Assigned] (TEZ-1055) Rename tez-mapreduce-examples to tez-examples

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reassigned TEZ-1055: Assignee: Hitesh Shah (was: Rekha Joshi) > Rename tez-mapreduce-examples to tez-examples > -

[jira] [Updated] (TEZ-1436) Fix javadoc warnings

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1436: - Assignee: (was: Hitesh Shah) > Fix javadoc warnings > > > Key: TEZ

[jira] [Commented] (TEZ-1331) Investigate : interrupts being swallowed by TezClient/DAGClient methods

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099241#comment-14099241 ] Hitesh Shah commented on TEZ-1331: -- Looks like all aspects have been addressed for now. Clo

[jira] [Resolved] (TEZ-1331) Investigate : interrupts being swallowed by TezClient/DAGClient methods

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1331. -- Resolution: Implemented > Investigate : interrupts being swallowed by TezClient/DAGClient methods > -

[jira] [Commented] (TEZ-1390) Replace byte[] with ByteBuffer as the type of user payload in the API

2014-08-15 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099238#comment-14099238 ] Tsuyoshi OZAWA commented on TEZ-1390: - [~sseth], thank you for review. {quote} UserPayl

[jira] [Updated] (TEZ-743) Fix MRCombiner to use correct comparator as per changes in MAPREDUCE-3310

2014-08-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-743: Assignee: (was: Jonathan Eagles) > Fix MRCombiner to use correct comparator as per changes in MAPR

[jira] [Updated] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1065: Attachment: TEZ-1065.addendum-1.patch Committing another test failure addendum. commit 5212b926c2bfd16d0f63d8

[jira] [Updated] (TEZ-625) DAG/Vertex names should be restricted to using [A-Za-z0-9_] and limited to a defined character limit

2014-08-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-625: Assignee: (was: Jonathan Eagles) > DAG/Vertex names should be restricted to using [A-Za-z0-9_] and

[jira] [Commented] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

2014-08-15 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099220#comment-14099220 ] Chen He commented on TEZ-1338: -- This is really helpful. Thanks, [~seth.siddha...@gmail.com]. Th

[jira] [Updated] (TEZ-1435) Fix unused imports

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1435: - Priority: Trivial (was: Major) > Fix unused imports > --- > > Key: TEZ-14

[jira] [Updated] (TEZ-1435) Fix unused imports

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1435: - Attachment: TEZ-1435.1.patch > Fix unused imports > --- > > Key: TEZ-1435

[jira] [Resolved] (TEZ-1435) Fix unused imports

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1435. -- Resolution: Fixed Fix Version/s: 0.5.0 Committed to master > Fix unused imports > --

[jira] [Commented] (TEZ-1423) Ability to pass custom properties to keySerializer for OnFileUnorderedPartitionedKVOutput

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099173#comment-14099173 ] Bikas Saha commented on TEZ-1423: - The patch looks like a straight-forward addition. I will

[jira] [Created] (TEZ-1435) Fix unused imports

2014-08-15 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1435: Summary: Fix unused imports Key: TEZ-1435 URL: https://issues.apache.org/jira/browse/TEZ-1435 Project: Apache Tez Issue Type: Bug Reporter: Hitesh Shah

[jira] [Created] (TEZ-1436) Fix javadoc warnings

2014-08-15 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1436: Summary: Fix javadoc warnings Key: TEZ-1436 URL: https://issues.apache.org/jira/browse/TEZ-1436 Project: Apache Tez Issue Type: Bug Reporter: Hitesh Shah

[jira] [Updated] (TEZ-1434) Make only wait apis in TezClient to throw InterruptedException

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1434: - Attachment: TEZ-1434.1.patch Same patch as .2 patch on TEZ-1331 > Make only wait apis in TezClient to thro

[jira] [Resolved] (TEZ-1434) Make only wait apis in TezClient to throw InterruptedException

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1434. -- Resolution: Fixed Fix Version/s: 0.5.0 Committed to master. Thanks for the review [~bikassaha] ( o

[jira] [Commented] (TEZ-1117) Option to make YARN application failed on dag failure

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099162#comment-14099162 ] Bikas Saha commented on TEZ-1117: - This ticket will allow users to set the final status of t

[jira] [Created] (TEZ-1434) Make only wait apis in TezClient to throw InterruptedException

2014-08-15 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1434: Summary: Make only wait apis in TezClient to throw InterruptedException Key: TEZ-1434 URL: https://issues.apache.org/jira/browse/TEZ-1434 Project: Apache Tez Issue

[jira] [Updated] (TEZ-1331) Investigate : interrupts being swallowed by TezClient/DAGClient methods

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1331: - Attachment: TEZ-1331.2.patch Comment addressed. > Investigate : interrupts being swallowed by TezClient/D

[jira] [Commented] (TEZ-1331) Investigate : interrupts being swallowed by TezClient/DAGClient methods

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099155#comment-14099155 ] Bikas Saha commented on TEZ-1331: - Please keep the waitTillReady(). Thats needed until we tr

[jira] [Commented] (TEZ-1331) Investigate : interrupts being swallowed by TezClient/DAGClient methods

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099156#comment-14099156 ] Bikas Saha commented on TEZ-1331: - +1 for the patch after the waitTillReady() deletion is re

[jira] [Commented] (TEZ-1117) Option to make YARN application failed on dag failure

2014-08-15 Thread Nick Dimiduk (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099149#comment-14099149 ] Nick Dimiduk commented on TEZ-1117: --- So then this ticket should be closed as invalid and n

[jira] [Commented] (TEZ-1117) Option to make YARN application failed on dag failure

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099135#comment-14099135 ] Hitesh Shah commented on TEZ-1117: -- [~ndimiduk] As [~bikassaha] mentioned, the issue is wit

[jira] [Updated] (TEZ-1331) Investigate : interrupts being swallowed by TezClient/DAGClient methods

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1331: - Attachment: TEZ-1331.1.patch [~bikassaha] [~sseth] [~oae] Mind taking a look? I am going with the assumptio

[jira] [Commented] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099124#comment-14099124 ] Siddharth Seth commented on TEZ-1338: - Thanks for taking a look [~bikassaha] and [~jeagl

[jira] [Commented] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

2014-08-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099099#comment-14099099 ] Jonathan Eagles commented on TEZ-1338: -- Looks good to me, [~sseth]. I think we will sti

[jira] [Updated] (TEZ-1423) Ability to pass custom properties to keySerializer for OnFileUnorderedPartitionedKVOutput

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1423: Target Version/s: 0.5.0 Assignee: Siddharth Seth > Ability to pass custom properties to k

[jira] [Updated] (TEZ-1423) Ability to pass custom properties to keySerializer for OnFileUnorderedPartitionedKVOutput

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1423: Attachment: TEZ-1423.1.txt Patch adds configuration for serializers and Compression. Keeping them se

[jira] [Commented] (TEZ-1429) Avoid sysexit in the DAGAM in case of local mode

2014-08-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099077#comment-14099077 ] Jonathan Eagles commented on TEZ-1429: -- +1. Thanks, [~sseth] > Avoid sysexit in the DA

[jira] [Commented] (TEZ-1427) Change remaining classes that are using byte[] to UserPayload

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099066#comment-14099066 ] Bikas Saha commented on TEZ-1427: - +1 > Change remaining classes that are using byte[] to U

[jira] [Updated] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1334: - Hadoop Flags: Incompatible change > Annotate all non public classes in tez-runtime-library with @private >

[jira] [Updated] (TEZ-1411) Address initial feedback on swimlanes

2014-08-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-1411: - Attachment: large.am.history.txt [~gopalv], this is the history file I've been using to evaluate.

[jira] [Commented] (TEZ-1411) Address initial feedback on swimlanes

2014-08-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099019#comment-14099019 ] Jonathan Eagles commented on TEZ-1411: -- Much easier. Now the whole box is clickable (ex

[jira] [Updated] (TEZ-1429) Avoid sysexit in the DAGAM in case of local mode

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1429: Attachment: TEZ-1429.2.txt Updated patch. [~jeagles] - do you want to take another look ? > Avoid sy

[jira] [Updated] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1338: Attachment: TEZ-1338.2.txt Updated patch. > Support submission of multiple applications with LocalRu

[jira] [Updated] (TEZ-1427) Change remaining classes that are using byte[] to UserPayload

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1427: Attachment: TEZ-1427.1.txt Trivial patch. [~bikassaha] - please review. > Change remaining classes t

[jira] [Assigned] (TEZ-1427) Change remaining classes that are using byte[] to UserPayload

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned TEZ-1427: --- Assignee: Siddharth Seth > Change remaining classes that are using byte[] to UserPayload >

[jira] [Commented] (TEZ-1117) Option to make YARN application failed on dag failure

2014-08-15 Thread Nick Dimiduk (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098983#comment-14098983 ] Nick Dimiduk commented on TEZ-1117: --- This is a simple select count(*) from foo where bar l

[jira] [Commented] (TEZ-1411) Address initial feedback on swimlanes

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098975#comment-14098975 ] Gopal V commented on TEZ-1411: -- [~jeagles]: Care to give that patch a try? I'm still working o

[jira] [Updated] (TEZ-1411) Address initial feedback on swimlanes

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1411: - Attachment: TEZ-1411.1.patch > Address initial feedback on swimlanes > - > >

[jira] [Commented] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

2014-08-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098966#comment-14098966 ] Jonathan Eagles commented on TEZ-1338: -- Still taking a look. Will post comments soon.

[jira] [Commented] (TEZ-1411) Address initial feedback on swimlanes

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098965#comment-14098965 ] Gopal V commented on TEZ-1411: -- [~jeagles]: sure, that shouldn't be a big issue. The reason to

[jira] [Commented] (TEZ-1411) Address initial feedback on swimlanes

2014-08-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098956#comment-14098956 ] Jonathan Eagles commented on TEZ-1411: -- [~gopalv], can we make the whole svn.rect a for

[jira] [Commented] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098955#comment-14098955 ] Siddharth Seth commented on TEZ-1334: - I think changing it to IO is ok given the current

[jira] [Commented] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098931#comment-14098931 ] Bikas Saha commented on TEZ-1065: - commit 2422ca7584353f69bbc3ed2c1ce22374124d68e7 Author: B

[jira] [Updated] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1334: - Attachment: TEZ-1334.4.patch Changed InputClosed to checked exception. [~sseth] please review. > Annotate

[jira] [Commented] (TEZ-1320) Remove getApplicationId from DAGClient

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098924#comment-14098924 ] Siddharth Seth commented on TEZ-1320: - Please commit. I'll need to rebase TEZ-1338 after

[jira] [Commented] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098917#comment-14098917 ] Siddharth Seth commented on TEZ-1338: - Alright, I'll add a comment in the close() method

[jira] [Commented] (TEZ-1429) Avoid sysexit in the DAGAM in case of local mode

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098920#comment-14098920 ] Siddharth Seth commented on TEZ-1429: - Thanks for the review. Making the first 2 changes

[jira] [Updated] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1065: Attachment: TEZ-1065.addendum.patch Attaching addendum patch that fixes unit test broken by this patch. Unti

[jira] [Commented] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098912#comment-14098912 ] Bikas Saha commented on TEZ-1338: - My comment was primarily not about sharing them. That was

[jira] [Updated] (TEZ-1429) Avoid sysexit in the DAGAM in case of local mode

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1429: Priority: Blocker (was: Critical) > Avoid sysexit in the DAGAM in case of local mode > -

[jira] [Updated] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1338: Priority: Blocker (was: Critical) > Support submission of multiple applications with LocalRunner fro

[jira] [Resolved] (TEZ-1431) Fix use of synchronized for certain functions in TezClient

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1431. -- Resolution: Fixed Fix Version/s: 0.5.0 Committed to master > Fix use of synchronized for certain

[jira] [Commented] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

2014-08-15 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098896#comment-14098896 ] Siddharth Seth commented on TEZ-1338: - I haven't targeted sharing the FrameworkClient be

[jira] [Commented] (TEZ-1431) Fix use of synchronized for certain functions in TezClient

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098890#comment-14098890 ] Hitesh Shah commented on TEZ-1431: -- [~bikassaha] preWarm() calls submitDAG() which also thr

[jira] [Updated] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1334: - Attachment: TEZ-1334.3.patch Addressed most comments except for the handling of the exception. It is being

[jira] [Commented] (TEZ-1429) Avoid sysexit in the DAGAM in case of local mode

2014-08-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098878#comment-14098878 ] Jonathan Eagles commented on TEZ-1429: -- Looks good in general. # simplify this logic {

[jira] [Updated] (TEZ-1320) Remove getApplicationId from DAGClient

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1320: Attachment: TEZ-1320.4.patch Attaching final commit patch. > Remove getApplicationId from DAGClient > --

[jira] [Commented] (TEZ-1431) Fix use of synchronized for certain functions in TezClient

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098830#comment-14098830 ] Bikas Saha commented on TEZ-1431: - lgtm. Unless this is being addressed in another jira we

[jira] [Resolved] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved TEZ-1065. - Resolution: Fixed Fix Version/s: 0.5.0 Hadoop Flags: Reviewed commit 8515a0fbab8eb9c08d695b4ff4

[jira] [Commented] (TEZ-1338) Support submission of multiple applications with LocalRunner from within the same JVM

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098802#comment-14098802 ] Bikas Saha commented on TEZ-1338: - FrameworkClient should probably have a refcounter to ensu

[jira] [Commented] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098789#comment-14098789 ] Bikas Saha commented on TEZ-1065: - Looks good. Committing. Thanks for your contribution! >

[jira] [Commented] (TEZ-1117) Option to make YARN application failed on dag failure

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098790#comment-14098790 ] Hitesh Shah commented on TEZ-1117: -- [~ndimiduk] When running Tez in session mode, the appli

[jira] [Commented] (TEZ-1117) Option to make YARN application failed on dag failure

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098783#comment-14098783 ] Bikas Saha commented on TEZ-1117: - This may be because users are submitting a bunch of jobs

[jira] [Commented] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098773#comment-14098773 ] Bikas Saha commented on TEZ-1334: - bq. Looks like the previous comment was referring to Inp

[jira] [Commented] (TEZ-1117) Option to make YARN application failed on dag failure

2014-08-15 Thread Nick Dimiduk (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098736#comment-14098736 ] Nick Dimiduk commented on TEZ-1117: --- I'm seeing a similar thing with Tez-based Hive jobs.

[jira] [Updated] (TEZ-1418) Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

2014-08-15 Thread Subroto Sanyal (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subroto Sanyal updated TEZ-1418: Attachment: TEZ-1418.patch hi [~bikassaha], Please have a look at the patch. > Provide Default valu

  1   2   >