[jira] [Updated] (TEZ-1309) Use hflush instead of hsync in recovery log

2014-07-24 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1309: - Attachment: TEZ-1309.1.patch Use hflush instead of hsync in recovery log

[jira] [Resolved] (TEZ-1309) Use hflush instead of hsync in recovery log

2014-07-24 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1309. -- Resolution: Fixed Fix Version/s: 0.5.0 Use hflush instead of hsync in recovery log

[jira] [Commented] (TEZ-1309) Use hflush instead of hsync in recovery log

2014-07-24 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073587#comment-14073587 ] Hitesh Shah commented on TEZ-1309: -- Trivial patch. Committed to master. Use hflush

[jira] [Updated] (TEZ-792) Default staging path should have user name

2014-07-24 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-792: Priority: Critical (was: Major) Default staging path should have user name

[jira] [Resolved] (TEZ-1063) ObjectRegistry should only be accessible through the Input/Output/Processor context objects

2014-07-24 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1063. -- Resolution: Duplicate ObjectRegistry should only be accessible through the Input/Output/Processor

[jira] [Commented] (TEZ-1136) Refactor OrderedWordCount to use best practices for Tez API

2014-07-24 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073742#comment-14073742 ] Hitesh Shah commented on TEZ-1136: -- Marking this as a blocker for 0.5.0 as this is a useful

[jira] [Updated] (TEZ-1216) Clean up the staging directory when the application completes

2014-07-24 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1216: - Priority: Critical (was: Major) Clean up the staging directory when the application completes

[jira] [Updated] (TEZ-1216) Clean up the staging directory when the application completes

2014-07-24 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1216: - Target Version/s: 0.5.0 Clean up the staging directory when the application completes

[jira] [Commented] (TEZ-1311) get sharedobjectregistry from the context instead of a static

2014-07-24 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073984#comment-14073984 ] Hitesh Shah commented on TEZ-1311: -- Looks fine. Should bubble this up to the hive and pig

[jira] [Commented] (TEZ-1300) Change default tez classpath to not include hadoop jars from the cluster

2014-07-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076566#comment-14076566 ] Hitesh Shah commented on TEZ-1300: -- Looks good. Only nit - additional instructions should

[jira] [Commented] (TEZ-1305) Log job tracking url

2014-07-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077405#comment-14077405 ] Hitesh Shah commented on TEZ-1305: -- Looks good except for a minor nit. Could you change the

[jira] [Commented] (TEZ-1064) Restore dagName Set for duplicate detection in recovered AMs.

2014-07-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080048#comment-14080048 ] Hitesh Shah commented on TEZ-1064: -- Mostly looks good. Some minor comments: -

[jira] [Commented] (TEZ-1326) AMStartedEvent should not be recovery event

2014-07-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080049#comment-14080049 ] Hitesh Shah commented on TEZ-1326: -- +1. Committing shortly. AMStartedEvent should not be

[jira] [Commented] (TEZ-1238) Display more clear diagnostics info on client side if missing jar in LocalResource or Exception happen in Processor

2014-07-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080052#comment-14080052 ] Hitesh Shah commented on TEZ-1238: -- [~zjffdu] Sorry for the delay in reviewing the patch.

[jira] [Commented] (TEZ-1238) Display more clear diagnostics info on client side if missing jar in LocalResource or Exception happen in Processor

2014-07-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080092#comment-14080092 ] Hitesh Shah commented on TEZ-1238: -- Looks good. Will commit this once TEZ-1303 goes in.

[jira] [Updated] (TEZ-1024) Fix determination of failed attempts

2014-07-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1024: - Assignee: Jeff Zhang Fix determination of failed attempts

[jira] [Assigned] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-07-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reassigned TEZ-1345: Assignee: Hitesh Shah Add checks to guarantee all init events are written to recovery to consider

[jira] [Commented] (TEZ-1064) Restore dagName Set for duplicate detection in recovered AMs.

2014-07-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080318#comment-14080318 ] Hitesh Shah commented on TEZ-1064: -- Minor nit: - DAGSubmittedProto should not need to

[jira] [Issue Comment Deleted] (TEZ-1350) Create a framework specific config to enable timeline server

2014-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1350: - Comment: was deleted (was: [~jeagles] Does this belong in YARN? ) Create a framework specific config to

[jira] [Commented] (TEZ-1350) Create a framework specific config to enable timeline server

2014-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081266#comment-14081266 ] Hitesh Shah commented on TEZ-1350: -- [~jeagles] could you clarify what this jira implies? Do

[jira] [Updated] (TEZ-1238) Display more clear diagnostics info on client side on task failures

2014-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1238: - Summary: Display more clear diagnostics info on client side on task failures (was: Display more clear

[jira] [Commented] (TEZ-978) Enhance auto parallelism tuning for queries having empty outputs or data skewness

2014-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081648#comment-14081648 ] Hitesh Shah commented on TEZ-978: - [~bikassaha], mind taking a look? Enhance auto

[jira] [Created] (TEZ-1356) Display better diagnostics when local resources fail to localize

2014-07-31 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1356: Summary: Display better diagnostics when local resources fail to localize Key: TEZ-1356 URL: https://issues.apache.org/jira/browse/TEZ-1356 Project: Apache Tez

[jira] [Created] (TEZ-1358) Display better diagnostics when tasks fail due to classpath issues.

2014-07-31 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1358: Summary: Display better diagnostics when tasks fail due to classpath issues. Key: TEZ-1358 URL: https://issues.apache.org/jira/browse/TEZ-1358 Project: Apache Tez

[jira] [Created] (TEZ-1357) Display better diagnostics when AM fails to launch

2014-07-31 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1357: Summary: Display better diagnostics when AM fails to launch Key: TEZ-1357 URL: https://issues.apache.org/jira/browse/TEZ-1357 Project: Apache Tez Issue Type:

[jira] [Resolved] (TEZ-1239) Tez does not propagate exception from processor

2014-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1239. -- Resolution: Duplicate Tez does not propagate exception from processor

[jira] [Commented] (TEZ-1352) HADOOP_CONF_DIR should be in the classpath for containers

2014-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081662#comment-14081662 ] Hitesh Shah commented on TEZ-1352: -- Shouldn't tez libs be before hadoop jars on classpath?

[jira] [Reopened] (TEZ-1358) Display better diagnostics when tasks fail due to classpath issues.

2014-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reopened TEZ-1358: -- Display better diagnostics when tasks fail due to classpath issues.

[jira] [Updated] (TEZ-1358) Display better diagnostics when tasks fail to launch

2014-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1358: - Summary: Display better diagnostics when tasks fail to launch (was: Display better diagnostics when

[jira] [Commented] (TEZ-1352) HADOOP_CONF_DIR should be in the classpath for containers

2014-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081723#comment-14081723 ] Hitesh Shah commented on TEZ-1352: -- Does HADOOP_CONF_DIR need to be before or after the tez

[jira] [Commented] (TEZ-1352) HADOOP_CONF_DIR should be in the classpath for containers

2014-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081729#comment-14081729 ] Hitesh Shah commented on TEZ-1352: -- I think just switching the patch to append

[jira] [Commented] (TEZ-290) TezClientUtils::ensureStagingDirExists() needs cleaning up

2014-08-04 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085025#comment-14085025 ] Hitesh Shah commented on TEZ-290: - [~jeagles] We noticed that hive uses a scratch dir with

[jira] [Updated] (TEZ-14) Support for speculation of slow tasks

2014-08-04 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-14: --- Labels: (was: TEZ-1) Support for speculation of slow tasks -

[jira] [Created] (TEZ-1377) Disable TestSecureShuffle until TEZ-1368 is fixed.

2014-08-04 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1377: Summary: Disable TestSecureShuffle until TEZ-1368 is fixed. Key: TEZ-1377 URL: https://issues.apache.org/jira/browse/TEZ-1377 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-1368) TestSecureShuffle failing

2014-08-04 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1368: - Priority: Blocker (was: Major) TestSecureShuffle failing -

[jira] [Commented] (TEZ-1368) TestSecureShuffle failing

2014-08-04 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085299#comment-14085299 ] Hitesh Shah commented on TEZ-1368: -- [~rajesh.balamohan] Mind taking a look?

[jira] [Commented] (TEZ-1368) TestSecureShuffle failing

2014-08-04 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085616#comment-14085616 ] Hitesh Shah commented on TEZ-1368: -- [~rajesh.balamohan], what about the second edge?

[jira] [Assigned] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-05 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reassigned TEZ-671: --- Assignee: Hitesh Shah Support View/Modify ACLs for DAGs -

[jira] [Commented] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-05 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087029#comment-14087029 ] Hitesh Shah commented on TEZ-671: - [~sseth] Do you see a need to have both AM level ACLs as

[jira] [Commented] (TEZ-1381) Set EditLogFileOutputStream.setShouldSkipFsyncForTesting(true) for MiniTezCluster

2014-08-05 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087051#comment-14087051 ] Hitesh Shah commented on TEZ-1381: -- [~bikassaha] Any feedback from the Hive or Pig folks on

[jira] [Commented] (TEZ-1360) Provide vertex parallelism to each vertex task

2014-08-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087819#comment-14087819 ] Hitesh Shah commented on TEZ-1360: -- [~gopalv] The simpler fix might be to make the api

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

2014-08-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087823#comment-14087823 ] Hitesh Shah commented on TEZ-1345: -- Sort of. In some cases, the vertex initialized event

[jira] [Updated] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-671: Attachment: TEZ-671.1.patch [~sseth] [~jeagles] Mind taking a look? Support View/Modify ACLs for DAGs

[jira] [Commented] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088532#comment-14088532 ] Hitesh Shah commented on TEZ-671: - Nevermind - forgot to add more docs. Will upload a new

[jira] [Updated] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-671: Attachment: (was: TEZ-671.1.patch) Support View/Modify ACLs for DAGs -

[jira] [Updated] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-671: Attachment: TEZ-671.2.patch Updated doc attached. [~sseth] [~jeagles] please review. Support View/Modify

[jira] [Commented] (TEZ-1383) Move recovery related code into inner class

2014-08-07 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089530#comment-14089530 ] Hitesh Shah commented on TEZ-1383: -- Is this a dup of TEZ-1384? Move recovery related code

[jira] [Commented] (TEZ-672) Tez specific examples do not work on secure clusters

2014-08-07 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089595#comment-14089595 ] Hitesh Shah commented on TEZ-672: - Wrong jira used by mistake. Tez specific examples do

[jira] [Resolved] (TEZ-733) Add OrderedWordCount to the test suite

2014-08-07 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-733. - Resolution: Duplicate Add OrderedWordCount to the test suite --

[jira] [Commented] (TEZ-1216) Clean up the staging directory when the application completes

2014-08-07 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089843#comment-14089843 ] Hitesh Shah commented on TEZ-1216: -- Taking this over as [~kamrul] is on vacation. Clean

[jira] [Assigned] (TEZ-1216) Clean up the staging directory when the application completes

2014-08-07 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reassigned TEZ-1216: Assignee: Hitesh Shah (was: Mohammad Kamrul Islam) Clean up the staging directory when the

[jira] [Commented] (TEZ-1394) Create example code for OrderedWordCount

2014-08-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091086#comment-14091086 ] Hitesh Shah commented on TEZ-1394: -- Also, INSTALL.txt and install guide in the docs needs

[jira] [Commented] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091373#comment-14091373 ] Hitesh Shah commented on TEZ-671: - bq. getACLManager should make use of getDAG - instead of

[jira] [Commented] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091385#comment-14091385 ] Hitesh Shah commented on TEZ-671: - File HADOOP-10951 for Groups in hadoop to be made public.

[jira] [Commented] (TEZ-1216) Clean up the staging directory when the application completes

2014-08-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091387#comment-14091387 ] Hitesh Shah commented on TEZ-1216: -- bq. can you please explain the change in isLastAMRetry

[jira] [Commented] (TEZ-1216) Clean up the staging directory when the application completes

2014-08-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091589#comment-14091589 ] Hitesh Shah commented on TEZ-1216: -- [~bikassaha] Updated the patch. Please take a look.

[jira] [Commented] (TEZ-1395) TestSecureShuffle fails

2014-08-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091662#comment-14091662 ] Hitesh Shah commented on TEZ-1395: -- [~rajesh.balamohan] Mind taking a look?

[jira] [Commented] (TEZ-1358) Display better diagnostics when tasks fail to launch

2014-08-10 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092414#comment-14092414 ] Hitesh Shah commented on TEZ-1358: -- [~zjffdu] Are the errors being caught by Tez or are the

[jira] [Commented] (TEZ-1237) Consolidate naming of EdgeManager / VertexManager

2014-08-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093053#comment-14093053 ] Hitesh Shah commented on TEZ-1237: -- +1 for the changes. For InputInitializer and

[jira] [Commented] (TEZ-1393) user.dir should not be reset in LocalMode

2014-08-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093067#comment-14093067 ] Hitesh Shah commented on TEZ-1393: -- Comments: - use the NM's defined env value for PWD

[jira] [Commented] (TEZ-1216) Clean up the staging directory when the application completes

2014-08-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093112#comment-14093112 ] Hitesh Shah commented on TEZ-1216: -- [~bikassaha] Latest patch should be visible at

[jira] [Commented] (TEZ-1408) SLF4J related warnings when using full tarball

2014-08-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094439#comment-14094439 ] Hitesh Shah commented on TEZ-1408: -- [~sseth] This shows up when HADOOP_CLASSPATH has tez

[jira] [Created] (TEZ-1408) SLF4J related warnings when using full tarball

2014-08-12 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1408: Summary: SLF4J related warnings when using full tarball Key: TEZ-1408 URL: https://issues.apache.org/jira/browse/TEZ-1408 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-1216) Clean up the staging directory when the application completes

2014-08-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1216: - Attachment: TEZ-1216.3.patch [~sseth] [~bikassaha] Patch attached - same as

[jira] [Updated] (TEZ-1216) Clean up the staging directory when the application completes

2014-08-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1216: - Attachment: TEZ-1216.4.patch Clean up the staging directory when the application completes

[jira] [Commented] (TEZ-1393) user.dir should not be reset in LocalMode

2014-08-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094876#comment-14094876 ] Hitesh Shah commented on TEZ-1393: -- Looks fine as an initial step. We will probably need

[jira] [Commented] (TEZ-1399) Add an example to show session usage

2014-08-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094916#comment-14094916 ] Hitesh Shah commented on TEZ-1399: -- Comments: bq. So the prewarm vertex must be setup

[jira] [Commented] (TEZ-1384) Move recovery related code into inner class

2014-08-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095079#comment-14095079 ] Hitesh Shah commented on TEZ-1384: -- Makes sense [~zjffdu]. Will start reviewing it in the

[jira] [Commented] (TEZ-850) Recovery unit tests

2014-08-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095078#comment-14095078 ] Hitesh Shah commented on TEZ-850: - There may be other cases that may require running jobs

[jira] [Updated] (TEZ-1024) Fix determination of failed attempts in recovery

2014-08-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1024: - Summary: Fix determination of failed attempts in recovery (was: Fix determination of failed attempts)

[jira] [Commented] (TEZ-1404) groupCommitInProgress in RecoveryTransition of DAGImpl is not set correctly

2014-08-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095088#comment-14095088 ] Hitesh Shah commented on TEZ-1404: -- Thanks [~zjffdu] groupCommitInProgress in

[jira] [Commented] (TEZ-1384) Move recovery related code into inner class

2014-08-12 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095090#comment-14095090 ] Hitesh Shah commented on TEZ-1384: -- One of the comments that Bikas had earlier was that

[jira] [Updated] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-671: Attachment: TEZ-671.3.patch Comments addressed. Support View/Modify ACLs for DAGs

[jira] [Commented] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096328#comment-14096328 ] Hitesh Shah commented on TEZ-671: - API introductions involved. [~bikassaha] [~sseth] please

[jira] [Commented] (TEZ-1414) Disable TestTezClientUtils.testLocalResourceVisibility to make builds pass.

2014-08-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096389#comment-14096389 ] Hitesh Shah commented on TEZ-1414: -- [~pramachandran] The other approach would be to use a

[jira] [Commented] (TEZ-1416) tez-api project javadoc/annotations review and clean up.

2014-08-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096574#comment-14096574 ] Hitesh Shah commented on TEZ-1416: -- Mostly looks good. Should likely wait for [~sseth] to

[jira] [Commented] (TEZ-1419) Release link broken on website

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097071#comment-14097071 ] Hitesh Shah commented on TEZ-1419: -- Might be my fault. I cleaned up the dist area in

[jira] [Updated] (TEZ-1419) Release link broken on website

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1419: - Attachment: TEZ-1419.1.patch Release link broken on website --

[jira] [Updated] (TEZ-1418) Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1418: - Fix Version/s: (was: 0.5.0) Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

[jira] [Updated] (TEZ-1419) Release link broken on website for 0.4.1 release

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1419: - Summary: Release link broken on website for 0.4.1 release (was: Release link broken on website) Release

[jira] [Updated] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-671: Attachment: TEZ-671.4.patch Some comments addressed: - conf null check removed - add helper constructor

[jira] [Commented] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097654#comment-14097654 ] Hitesh Shah commented on TEZ-671: - [~sseth] review please Support View/Modify ACLs for DAGs

[jira] [Assigned] (TEZ-1418) Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reassigned TEZ-1418: Assignee: Hitesh Shah Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

[jira] [Updated] (TEZ-1418) Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1418: - Assignee: (was: Hitesh Shah) Provide Default value for TEZ_AM_LAUNCH_ENV and TEZ_TASK_LAUNCH

[jira] [Commented] (TEZ-1388) mvn site is slow and generates errors

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097805#comment-14097805 ] Hitesh Shah commented on TEZ-1388: -- Forgot to mention, docs/pom.xml has a reporting section

[jira] [Assigned] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reassigned TEZ-1334: Assignee: Hitesh Shah Annotate all non public classes in tez-runtime-library with @private

[jira] [Updated] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1334: - Attachment: TEZ-1334.1.patch First cut at this. [~sseth] [~bikassaha] please review. Annotate all non

[jira] [Resolved] (TEZ-671) Support View/Modify ACLs for DAGs

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-671. - Resolution: Fixed Fix Version/s: 0.5.0 Committed to master. Thanks for the review [~sseth]

[jira] [Commented] (TEZ-1425) Move constants to TezConstants

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098021#comment-14098021 ] Hitesh Shah commented on TEZ-1425: -- Comments: - Maybe let TEZ_AM_PLAN_REMOTE_PATH be

[jira] [Created] (TEZ-1431) Fix use of synchronized for certain functions in TezClient

2014-08-14 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1431: Summary: Fix use of synchronized for certain functions in TezClient Key: TEZ-1431 URL: https://issues.apache.org/jira/browse/TEZ-1431 Project: Apache Tez Issue

[jira] [Updated] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1334: - Attachment: TEZ-1334.2.patch Addressed some comments. Annotate all non public classes in

[jira] [Commented] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098164#comment-14098164 ] Hitesh Shah commented on TEZ-1334: -- Looks like the previous comment was referring to

[jira] [Comment Edited] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098164#comment-14098164 ] Hitesh Shah edited comment on TEZ-1334 at 8/15/14 5:06 AM: --- Looks

[jira] [Assigned] (TEZ-1431) Fix use of synchronized for certain functions in TezClient

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reassigned TEZ-1431: Assignee: Hitesh Shah Fix use of synchronized for certain functions in TezClient

[jira] [Comment Edited] (TEZ-1431) Fix use of synchronized for certain functions in TezClient

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098177#comment-14098177 ] Hitesh Shah edited comment on TEZ-1431 at 8/15/14 5:13 AM: ---

[jira] [Commented] (TEZ-1431) Fix use of synchronized for certain functions in TezClient

2014-08-14 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098177#comment-14098177 ] Hitesh Shah commented on TEZ-1431: -- [~sseth] Some functions were not synchronized and some

[jira] [Commented] (TEZ-1117) Option to make YARN application failed on dag failure

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098790#comment-14098790 ] Hitesh Shah commented on TEZ-1117: -- [~ndimiduk] When running Tez in session mode, the

[jira] [Updated] (TEZ-1334) Annotate all non public classes in tez-runtime-library with @private

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1334: - Attachment: TEZ-1334.3.patch Addressed most comments except for the handling of the exception. It is being

[jira] [Commented] (TEZ-1431) Fix use of synchronized for certain functions in TezClient

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098890#comment-14098890 ] Hitesh Shah commented on TEZ-1431: -- [~bikassaha] preWarm() calls submitDAG() which also

[jira] [Resolved] (TEZ-1431) Fix use of synchronized for certain functions in TezClient

2014-08-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-1431. -- Resolution: Fixed Fix Version/s: 0.5.0 Committed to master Fix use of synchronized for certain

  1   2   3   4   5   6   7   8   9   10   >