[jira] [Commented] (TEZ-394) Better scheduling for uneven DAGs

[ https://issues.apache.org/jira/browse/TEZ-394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734580#comment-16734580 ] Jason Lowe commented on TEZ-394: Attaching a new patch that makes this behavior configurable and disabled by

[jira] [Updated] (TEZ-394) Better scheduling for uneven DAGs

[ https://issues.apache.org/jira/browse/TEZ-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-394: --- Attachment: TEZ-394.004.patch > Better scheduling for uneven DAGs > - > >

[jira] [Commented] (TEZ-4027) DagAwareYarnTaskScheduler can miscompute blocked vertices and cause a hang

[ https://issues.apache.org/jira/browse/TEZ-4027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16724150#comment-16724150 ] Jason Lowe commented on TEZ-4027: - Thanks for the patch! +1 lgtm. Committing this. >

[jira] [Commented] (TEZ-4021) API incompatibility wro4j-maven-plugin

[ https://issues.apache.org/jira/browse/TEZ-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701050#comment-16701050 ] Jason Lowe commented on TEZ-4021: - +1 lgtm. Committing this. > API incompatibility wro4j-maven-plugin >

[jira] [Commented] (TEZ-4022) Upgrade Maven Surefire plugin to 3.0.0-M1

[ https://issues.apache.org/jira/browse/TEZ-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699598#comment-16699598 ] Jason Lowe commented on TEZ-4022: - Thanks for the patch! +1 lgtm pending Jenkins. > Upgrade Maven

[jira] [Commented] (TEZ-3996) Reorder input failed events before data movement events

[ https://issues.apache.org/jira/browse/TEZ-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634175#comment-16634175 ] Jason Lowe commented on TEZ-3996: - bq. we launch an external process in the processor and for various

[jira] [Commented] (TEZ-3996) Reorder input failed events before data movement events

[ https://issues.apache.org/jira/browse/TEZ-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632502#comment-16632502 ] Jason Lowe commented on TEZ-3996: - bq. Arguably a better fix is to simply not send DMEs to tasks where we

[jira] [Commented] (TEZ-3994) Upgrade maven-surefire-plugin to 0.21.0 to support yetus

[ https://issues.apache.org/jira/browse/TEZ-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631994#comment-16631994 ] Jason Lowe commented on TEZ-3994: - Thanks for the patch! +1 lgtm. Committing this. > Upgrade

[jira] [Commented] (TEZ-3891) Migrate patch submisssion scripts and hooks to Yetus 0.8.0

[ https://issues.apache.org/jira/browse/TEZ-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631988#comment-16631988 ] Jason Lowe commented on TEZ-3891: - Ah, nevermind my comment. I didn't see the subtasks at first, looks

[jira] [Commented] (TEZ-3891) Migrate patch submisssion scripts and hooks to Yetus 0.8.0

[ https://issues.apache.org/jira/browse/TEZ-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631948#comment-16631948 ] Jason Lowe commented on TEZ-3891: - Thanks for driving this, [~jeagles]! I'm curious about some of the code

[jira] [Commented] (TEZ-3996) Reorder input failed events before data movement events

[ https://issues.apache.org/jira/browse/TEZ-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631901#comment-16631901 ] Jason Lowe commented on TEZ-3996: - I believe every input failed event arrives _after_ the corresponding

[jira] [Updated] (TEZ-3975) Please add OWASP Dependency Check to the build (pom.xml)

[ https://issues.apache.org/jira/browse/TEZ-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3975: Fix Version/s: 0.10.1 0.9.2 Thanks, [~jeagles]! I committed this to master and

[jira] [Commented] (TEZ-3975) Please add OWASP Dependency Check to the build (pom.xml)

[ https://issues.apache.org/jira/browse/TEZ-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629378#comment-16629378 ] Jason Lowe commented on TEZ-3975: - Thanks for the patch! +1 lgtm. Committing this. > Please add OWASP

[jira] [Commented] (TEZ-3982) DAGAppMaster and tasks should not report negative or invalid progress

[ https://issues.apache.org/jira/browse/TEZ-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623693#comment-16623693 ] Jason Lowe commented on TEZ-3982: - +1 lgtm. I verified this patch is identical to the master version with

[jira] [Resolved] (TEZ-3982) DAGAppMaster and tasks should not report negative or invalid progress

[ https://issues.apache.org/jira/browse/TEZ-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved TEZ-3982. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.9.2 Thanks, [~kshukla]! I committed

[jira] [Updated] (TEZ-3982) DAGAppMaster and tasks should not report negative or invalid progress

[ https://issues.apache.org/jira/browse/TEZ-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3982: Fix Version/s: (was: 0.9.2) > DAGAppMaster and tasks should not report negative or invalid progress >

[jira] [Reopened] (TEZ-3982) DAGAppMaster and tasks should not report negative or invalid progress

[ https://issues.apache.org/jira/browse/TEZ-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened TEZ-3982: - This broke the branch-0.9 build. Looks like MonotonicClock isn't in the version of Hadoop branch-0.9 depends

[jira] [Commented] (TEZ-3989) Fix by-laws related to emeritus clause

[ https://issues.apache.org/jira/browse/TEZ-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619104#comment-16619104 ] Jason Lowe commented on TEZ-3989: - Apparently not. I updated the site manually following the instructions

[jira] [Commented] (TEZ-3989) Fix by-laws related to emeritus clause

[ https://issues.apache.org/jira/browse/TEZ-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614044#comment-16614044 ] Jason Lowe commented on TEZ-3989: - Does the Apache Tez site update on a Jenkins job or is it done manually?

[jira] [Resolved] (TEZ-3989) Fix by-laws related to emeritus clause

[ https://issues.apache.org/jira/browse/TEZ-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved TEZ-3989. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.10.1 Thanks, [~hitesh]! I committed

[jira] [Commented] (TEZ-3989) Fix by-laws related to emeritus clause

[ https://issues.apache.org/jira/browse/TEZ-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614040#comment-16614040 ] Jason Lowe commented on TEZ-3989: - +1 lgtm. This matches what was proposed on the dev list. > Fix by-laws

[jira] [Commented] (TEZ-3987) Schedule giving priorities based on topological order

[ https://issues.apache.org/jira/browse/TEZ-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605846#comment-16605846 ] Jason Lowe commented on TEZ-3987: - If vertex 5 is an ancestor of vertex 3 in the graph then I would not

[jira] [Commented] (TEZ-3987) Schedule giving priorities based on topological order

[ https://issues.apache.org/jira/browse/TEZ-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604969#comment-16604969 ] Jason Lowe commented on TEZ-3987: - Is this related to TEZ-394? > Schedule giving priorities based on

[jira] [Updated] (TEZ-3980) ShuffleRunner: the wake loop needs to check for shutdown

[ https://issues.apache.org/jira/browse/TEZ-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3980: Fix Version/s: 0.9.2 Thanks, [~gopalv]! I committed this to branch-0.9 as well. > ShuffleRunner: the wake

[jira] [Commented] (TEZ-3978) DAGClientServer Socket exception when localhost name lookup failures

[ https://issues.apache.org/jira/browse/TEZ-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582880#comment-16582880 ] Jason Lowe commented on TEZ-3978: - I did a quick test and it turns out InetSocketAddress(0).getHostString()

[jira] [Commented] (TEZ-3978) DAGClientServer Socket exception when localhost name lookup failures

[ https://issues.apache.org/jira/browse/TEZ-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580411#comment-16580411 ] Jason Lowe commented on TEZ-3978: - Thanks for the patch! I'm a little concerned that we are changing the

[jira] [Updated] (TEZ-3974) Tez: Correctness regression of TEZ-955 in TEZ-2937

[ https://issues.apache.org/jira/browse/TEZ-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3974: Hadoop Flags: Reviewed Fix Version/s: 0.9.2 Thanks, [~jmarhuen]! I committed this to branch-0.9 as

[jira] [Commented] (TEZ-3976) ShuffleManager reporting too many errors

[ https://issues.apache.org/jira/browse/TEZ-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571755#comment-16571755 ] Jason Lowe commented on TEZ-3976: - bq. Each of those translate into an event in the AM which finally

[jira] [Commented] (TEZ-3942) RPC getTask writable optimization invalid in hadoop 2.8+

[ https://issues.apache.org/jira/browse/TEZ-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16554381#comment-16554381 ] Jason Lowe commented on TEZ-3942: - Thanks for the performance details! Committing the 003 patch. > RPC

[jira] [Commented] (TEZ-3942) RPC getTask writable optimization invalid in hadoop 2.8+

[ https://issues.apache.org/jira/browse/TEZ-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16549887#comment-16549887 ] Jason Lowe commented on TEZ-3942: - Thanks for the patch! +1 lgtm. [~nishantdash] do you have any

[jira] [Commented] (TEZ-3971) Incorrect query result in hive when hive.convert.join.bucket.mapjoin.tez=true

[ https://issues.apache.org/jira/browse/TEZ-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545328#comment-16545328 ] Jason Lowe commented on TEZ-3971: - This problem report seems more appropriate for the HIVE project. Hive

[jira] [Commented] (TEZ-3964) Inflater not closed in some places

[ https://issues.apache.org/jira/browse/TEZ-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541837#comment-16541837 ] Jason Lowe commented on TEZ-3964: - Thanks for updating the patch! +1 lgtm. Committing this. > Inflater

[jira] [Commented] (TEZ-3942) RPC getTask writable optimization invalid in hadoop 2.8+

[ https://issues.apache.org/jira/browse/TEZ-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541751#comment-16541751 ] Jason Lowe commented on TEZ-3942: - Is it appropriate to target this to 0.9.2? Tez 0.9.x currently works

[jira] [Commented] (TEZ-3955) Upgrade hadoop dependency to 3.0.3

[ https://issues.apache.org/jira/browse/TEZ-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540293#comment-16540293 ] Jason Lowe commented on TEZ-3955: - +1 lgtm. Committing this. > Upgrade hadoop dependency to 3.0.3 >

[jira] [Commented] (TEZ-3963) Possible InflaterInputStream leaked in TezCommonUtils and related classes

[ https://issues.apache.org/jira/browse/TEZ-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535394#comment-16535394 ] Jason Lowe commented on TEZ-3963: - +1 lgtm. Committing this. > Possible InflaterInputStream leaked in

[jira] [Updated] (TEZ-3953) Restore ABI-compat for DAGClient for TEZ-3951

[ https://issues.apache.org/jira/browse/TEZ-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3953: Fix Version/s: 0.9.2 Description: I committed this to branch-0.9. > Restore ABI-compat for DAGClient

[jira] [Updated] (TEZ-3963) Possible InflaterInputStream leaked in TezCommonUtils and related classes

[ https://issues.apache.org/jira/browse/TEZ-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3963: Attachment: TEZ-3963.001.patch > Possible InflaterInputStream leaked in TezCommonUtils and related classes

[jira] [Commented] (TEZ-3963) Possible InflaterInputStream leaked in TezCommonUtils and related classes

[ https://issues.apache.org/jira/browse/TEZ-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534158#comment-16534158 ] Jason Lowe commented on TEZ-3963: - Not sure the QA bot supports pull requests, so uploading the patch that

[jira] [Assigned] (TEZ-3964) Inflater not closed in some places

[ https://issues.apache.org/jira/browse/TEZ-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned TEZ-3964: --- Assignee: Jaume M Thanks for the report and patch! Looks good overall. I think it would be prudent

[jira] [Updated] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3951: Fix Version/s: (was: 0.9.next) 0.9.2 > TezClient wait too long for the DAGClient for

[jira] [Commented] (TEZ-3953) Restore ABI-compat for DAGClient for TEZ-3951

[ https://issues.apache.org/jira/browse/TEZ-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16534109#comment-16534109 ] Jason Lowe commented on TEZ-3953: - Does this need to be committed to branch-0.9 since TEZ-3951 went to

[jira] [Commented] (TEZ-3962) Configuration decode leaks an Inflater object

[ https://issues.apache.org/jira/browse/TEZ-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526781#comment-16526781 ] Jason Lowe commented on TEZ-3962: - Thanks for updating the patch! The unit test failures are unrelated and

[jira] [Commented] (TEZ-3962) Configuration decode leaks an Inflater object

[ https://issues.apache.org/jira/browse/TEZ-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526319#comment-16526319 ] Jason Lowe commented on TEZ-3962: - Thanks for the patch! Why does this patch change the semantics to

[jira] [Commented] (TEZ-3943) TezClient leaks DAGClient for prewarm

[ https://issues.apache.org/jira/browse/TEZ-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494101#comment-16494101 ] Jason Lowe commented on TEZ-3943: - +1 lgtm. The unit test failures are expected due to the recent update

[jira] [Commented] (TEZ-3939) Remove performance hit of precondition check in AM for register running task attempt

[ https://issues.apache.org/jira/browse/TEZ-3939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489069#comment-16489069 ] Jason Lowe commented on TEZ-3939: - Thanks for updating the patch! +1 lgtm. Committing this. > Remove

[jira] [Commented] (TEZ-3940) Reduce time to convert TaskFinishedEvent to string

[ https://issues.apache.org/jira/browse/TEZ-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489007#comment-16489007 ] Jason Lowe commented on TEZ-3940: - Thanks for updating the patch! +1 lgtm. Committing this. > Reduce time

[jira] [Commented] (TEZ-3940) Reduce time to convert TaskFinishedEvent to string

[ https://issues.apache.org/jira/browse/TEZ-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487812#comment-16487812 ] Jason Lowe commented on TEZ-3940: - Thanks for updating the patch! The patch doesn't apply to master for me.

[jira] [Commented] (TEZ-3940) Reduce time to convert TaskFinishedEvent to string

[ https://issues.apache.org/jira/browse/TEZ-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487431#comment-16487431 ] Jason Lowe commented on TEZ-3940: - Thanks for the report and patch! Nit: The ternary operator can be

[jira] [Commented] (TEZ-3939) Remove performance hit of precondition check in AM for register running task attempt

[ https://issues.apache.org/jira/browse/TEZ-3939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487385#comment-16487385 ] Jason Lowe commented on TEZ-3939: - +1 looks OK to me. Note that I think we can get the benefit of the

[jira] [Commented] (TEZ-3935) DAG aware scheduler should release unassigned new containers rather than hold them

[ https://issues.apache.org/jira/browse/TEZ-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483935#comment-16483935 ] Jason Lowe commented on TEZ-3935: - I'm not that familiar with the pre-warm feature, but I don't see any

[jira] [Commented] (TEZ-3902) Upgrade to netty-3.10.5.Final.jar

[ https://issues.apache.org/jira/browse/TEZ-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482960#comment-16482960 ] Jason Lowe commented on TEZ-3902: - Attached a new patch that updates netty to 3.10.5 across all the Tez

[jira] [Updated] (TEZ-3902) Upgrade to netty-3.10.5.Final.jar

[ https://issues.apache.org/jira/browse/TEZ-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3902: Attachment: TEZ-3902.002.patch > Upgrade to netty-3.10.5.Final.jar > - > >

[jira] [Commented] (TEZ-3937) Empty partition BitSet to byte[] conversion creates one extra byte in rounding error

[ https://issues.apache.org/jira/browse/TEZ-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482555#comment-16482555 ] Jason Lowe commented on TEZ-3937: - Thanks for updating the patch! I think this is a safer change. The unit

[jira] [Commented] (TEZ-3937) Empty partition BitSet to byte[] conversion creates one extra byte in rounding error

[ https://issues.apache.org/jira/browse/TEZ-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479252#comment-16479252 ] Jason Lowe commented on TEZ-3937: - Thanks for the patch! I love how this drastically simplifies the code

[jira] [Commented] (TEZ-3824) MRCombiner creates new JobConf copy per spill

[ https://issues.apache.org/jira/browse/TEZ-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474573#comment-16474573 ] Jason Lowe commented on TEZ-3824: - Thanks for updating the patch! The unit test failure does not appear to

[jira] [Commented] (TEZ-3935) DAG aware scheduler should release unassigned new containers rather than hold them

[ https://issues.apache.org/jira/browse/TEZ-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474437#comment-16474437 ] Jason Lowe commented on TEZ-3935: - Attaching a patch that by default will release new containers if they are

[jira] [Updated] (TEZ-3935) DAG aware scheduler should release unassigned new containers rather than hold them

[ https://issues.apache.org/jira/browse/TEZ-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3935: Attachment: TEZ-3935.001.patch > DAG aware scheduler should release unassigned new containers rather than

[jira] [Created] (TEZ-3935) DAG aware scheduler should release unassigned new containers rather than hold them

Jason Lowe created TEZ-3935: --- Summary: DAG aware scheduler should release unassigned new containers rather than hold them Key: TEZ-3935 URL: https://issues.apache.org/jira/browse/TEZ-3935 Project: Apache

[jira] [Commented] (TEZ-3824) MRCombiner creates new JobConf copy per spill

[ https://issues.apache.org/jira/browse/TEZ-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470476#comment-16470476 ] Jason Lowe commented on TEZ-3824: - bq. As is, the patch will send in a null for the config in case the old

[jira] [Commented] (TEZ-3932) TaskSchedulerManager can throw NullPointerException during DAGAppMaster container cleanup race

[ https://issues.apache.org/jira/browse/TEZ-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468960#comment-16468960 ] Jason Lowe commented on TEZ-3932: - Thanks for the patch! +1 lgtm. Committing this. > TaskSchedulerManager

[jira] [Updated] (TEZ-3930) TestDagAwareYarnTaskScheduler fails on Hadoop 3

[ https://issues.apache.org/jira/browse/TEZ-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3930: Attachment: TEZ-3930.001.patch > TestDagAwareYarnTaskScheduler fails on Hadoop 3 >

[jira] [Assigned] (TEZ-3930) TestDagAwareYarnTaskScheduler fails on Hadoop 3

[ https://issues.apache.org/jira/browse/TEZ-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned TEZ-3930: --- Assignee: Jason Lowe > TestDagAwareYarnTaskScheduler fails on Hadoop 3 >

[jira] [Commented] (TEZ-3926) Changes to master for 0.10.x line and 0.9 release branch

[ https://issues.apache.org/jira/browse/TEZ-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461378#comment-16461378 ] Jason Lowe commented on TEZ-3926: - +1 lgtm. > Changes to master for 0.10.x line and 0.9 release branch >

[jira] [Updated] (TEZ-3923) Move master to Hadoop 3+ and create separate 0.9.x line

[ https://issues.apache.org/jira/browse/TEZ-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3923: Target Version/s: 0.10.0 Fix Version/s: (was: 0.10.0) > Move master to Hadoop 3+ and create

[jira] [Commented] (TEZ-3914) Recovering a large DAG fails to size limit exceeded

[ https://issues.apache.org/jira/browse/TEZ-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456697#comment-16456697 ] Jason Lowe commented on TEZ-3914: - Thanks for updating the patch! +1 lgtm. Committing this. > Recovering

[jira] [Commented] (TEZ-3817) DAGs can hang after more than one uncaught Exception during doTransition.

[ https://issues.apache.org/jira/browse/TEZ-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448840#comment-16448840 ] Jason Lowe commented on TEZ-3817: - +1 lgtm. > DAGs can hang after more than one uncaught Exception during

[jira] [Created] (TEZ-3922) Tez session should use a final status of SUCCEEDED if all DAGs succeeded

Jason Lowe created TEZ-3922: --- Summary: Tez session should use a final status of SUCCEEDED if all DAGs succeeded Key: TEZ-3922 URL: https://issues.apache.org/jira/browse/TEZ-3922 Project: Apache Tez

[jira] [Commented] (TEZ-3914) Recovering a large DAG fails to size limit exceeded

[ https://issues.apache.org/jira/browse/TEZ-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442949#comment-16442949 ] Jason Lowe commented on TEZ-3914: - Thanks for updating the patch and providing an overview of the approach!

[jira] [Commented] (TEZ-3914) Recovering a large DAG hang job

[ https://issues.apache.org/jira/browse/TEZ-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437400#comment-16437400 ] Jason Lowe commented on TEZ-3914: - Thanks for the report and patch! Many of the unit test failures are

[jira] [Updated] (TEZ-3913) Precommit build fails to post to JIRA

[ https://issues.apache.org/jira/browse/TEZ-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3913: Attachment: TEZ-3913.002.patch > Precommit build fails to post to JIRA >

[jira] [Commented] (TEZ-3913) Precommit build fails to post to JIRA

[ https://issues.apache.org/jira/browse/TEZ-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431326#comment-16431326 ] Jason Lowe commented on TEZ-3913: - The precommit script is failing because SED is not defined. Posting an

[jira] [Updated] (TEZ-3913) Precommit build fails to post to JIRA

[ https://issues.apache.org/jira/browse/TEZ-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3913: Attachment: TEZ-3913.001.patch > Precommit build fails to post to JIRA >

[jira] [Created] (TEZ-3913) Precommit build fails to post to JIRA

Jason Lowe created TEZ-3913: --- Summary: Precommit build fails to post to JIRA Key: TEZ-3913 URL: https://issues.apache.org/jira/browse/TEZ-3913 Project: Apache Tez Issue Type: Bug

[jira] [Created] (TEZ-3912) Fetchers should be more robust to corrupted inputs

Jason Lowe created TEZ-3912: --- Summary: Fetchers should be more robust to corrupted inputs Key: TEZ-3912 URL: https://issues.apache.org/jira/browse/TEZ-3912 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-2686) TestFaultTolerance fails frequently

[ https://issues.apache.org/jira/browse/TEZ-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427594#comment-16427594 ] Jason Lowe commented on TEZ-2686: - There's been a lot of changes since this ticket was filed. I'm OK with

[jira] [Updated] (TEZ-3909) DAG can hang if vertex with no tasks is killed

[ https://issues.apache.org/jira/browse/TEZ-3909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3909: Attachment: TEZ-3909.001.patch > DAG can hang if vertex with no tasks is killed >

[jira] [Created] (TEZ-3909) DAG can hang if vertex with no tasks is killed

Jason Lowe created TEZ-3909: --- Summary: DAG can hang if vertex with no tasks is killed Key: TEZ-3909 URL: https://issues.apache.org/jira/browse/TEZ-3909 Project: Apache Tez Issue Type: Bug

[jira] [Assigned] (TEZ-3902) Upgrade to netty-3.10.5.Final.jar

[ https://issues.apache.org/jira/browse/TEZ-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned TEZ-3902: --- Assignee: Jason Lowe (was: Jonathan Eagles) > Upgrade to netty-3.10.5.Final.jar >

[jira] [Commented] (TEZ-3902) Upgrade to netty-3.10.5.Final.jar

[ https://issues.apache.org/jira/browse/TEZ-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414475#comment-16414475 ] Jason Lowe commented on TEZ-3902: - Here's a patch that updates the netty version per my discussion above.

[jira] [Updated] (TEZ-3902) Upgrade to netty-3.10.5.Final.jar

[ https://issues.apache.org/jira/browse/TEZ-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3902: Attachment: TEZ-3902.001.patch > Upgrade to netty-3.10.5.Final.jar > - > >

[jira] [Commented] (TEZ-3902) Upgrade to netty-3.10.5.Final.jar

[ https://issues.apache.org/jira/browse/TEZ-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414459#comment-16414459 ] Jason Lowe commented on TEZ-3902: - bq. Should we file a separate ticket for async-http-client or investigate

[jira] [Commented] (TEZ-3907) Improve log message to include the location the writers decide to spill output

[ https://issues.apache.org/jira/browse/TEZ-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414439#comment-16414439 ] Jason Lowe commented on TEZ-3907: - QA bot said: - {color:red}-1 overall{color}. Here are the results

[jira] [Commented] (TEZ-3892) getClient API for TezClient

[ https://issues.apache.org/jira/browse/TEZ-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414289#comment-16414289 ] Jason Lowe commented on TEZ-3892: - [~ewohlstadter] what more do you need for this? If anything it should be

[jira] [Commented] (TEZ-3902) Upgrade to netty-3.10.5.Final.jar

[ https://issues.apache.org/jira/browse/TEZ-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414051#comment-16414051 ] Jason Lowe commented on TEZ-3902: - After poking around a bit, it looks like the netty jar being included in

[jira] [Commented] (TEZ-3907) Improve log message to include the location the writers decide to spill output

[ https://issues.apache.org/jira/browse/TEZ-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413961#comment-16413961 ] Jason Lowe commented on TEZ-3907: - Thanks for the patch! Nit: " at :" s/b " at : " so the colon doesn't

[jira] [Commented] (TEZ-3901) Add hadoop3 profile for upgrade to Jersey 1.19

[ https://issues.apache.org/jira/browse/TEZ-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400465#comment-16400465 ] Jason Lowe commented on TEZ-3901: - My main concern with this patch is that it adds another dimension that

[jira] [Commented] (TEZ-3874) NPE in TezClientUtils when "yarn.resourcemanager.zk-address" is present in Configuration

[ https://issues.apache.org/jira/browse/TEZ-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393049#comment-16393049 ] Jason Lowe commented on TEZ-3874: - >From precommit build: {color:green}+1 overall{color}. Here are the

[jira] [Commented] (TEZ-3874) NPE in TezClientUtils when "yarn.resourcemanager.zk-address" is present in Configuration

[ https://issues.apache.org/jira/browse/TEZ-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389712#comment-16389712 ] Jason Lowe commented on TEZ-3874: - Thanks for updating the patch! Looks much better overall, just one nit

[jira] [Commented] (TEZ-3897) Tez Local Mode hang for vertices with broadcast input

[ https://issues.apache.org/jira/browse/TEZ-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386244#comment-16386244 ] Jason Lowe commented on TEZ-3897: - Thanks for updating the patch! +1 lgtm. Committing this. > Tez Local

[jira] [Commented] (TEZ-3874) NPE in TezClientUtils when "yarn.resourcemanager.zk-address" is present in Configuration

[ https://issues.apache.org/jira/browse/TEZ-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383816#comment-16383816 ] Jason Lowe commented on TEZ-3874: - Thanks for updating the patch! Here's the QA report:

[jira] [Commented] (TEZ-3897) Tez Local Mode hang for vertices with broadcast input

[ https://issues.apache.org/jira/browse/TEZ-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379151#comment-16379151 ] Jason Lowe commented on TEZ-3897: - Thanks for the patch! Do we need to worry about task deallocations

[jira] [Updated] (TEZ-3898) TestTezCommonUtils fails when compiled against hadoop version >= 2.8

[ https://issues.apache.org/jira/browse/TEZ-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3898: Attachment: TEZ-3898.001.patch > TestTezCommonUtils fails when compiled against hadoop version >= 2.8 >

[jira] [Created] (TEZ-3898) TestTezCommonUtils fails when compiled against hadoop version >= 2.8

Jason Lowe created TEZ-3898: --- Summary: TestTezCommonUtils fails when compiled against hadoop version >= 2.8 Key: TEZ-3898 URL: https://issues.apache.org/jira/browse/TEZ-3898 Project: Apache Tez

[jira] [Updated] (TEZ-3896) TestATSV15HistoryLoggingService#testNonSessionDomains is failing

[ https://issues.apache.org/jira/browse/TEZ-3896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3896: Attachment: TEZ-3896.001.patch > TestATSV15HistoryLoggingService#testNonSessionDomains is failing >

[jira] [Created] (TEZ-3896) TestATSV15HistoryLoggingService#testNonSessionDomains is failing

Jason Lowe created TEZ-3896: --- Summary: TestATSV15HistoryLoggingService#testNonSessionDomains is failing Key: TEZ-3896 URL: https://issues.apache.org/jira/browse/TEZ-3896 Project: Apache Tez Issue

[jira] [Commented] (TEZ-3893) Tez Local Mode can hang for cases

[ https://issues.apache.org/jira/browse/TEZ-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364346#comment-16364346 ] Jason Lowe commented on TEZ-3893: - Thanks for updating the patch! +1 lgtm. Committing this. > Tez Local

[jira] [Commented] (TEZ-3893) Tez Local Mode can hang for cases

[ https://issues.apache.org/jira/browse/TEZ-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363239#comment-16363239 ] Jason Lowe commented on TEZ-3893: - Thanks for updating the patch! Looks good overall, only a few nits: An

[jira] [Commented] (TEZ-3893) Tez Local Mode can hang for cases

[ https://issues.apache.org/jira/browse/TEZ-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361609#comment-16361609 ] Jason Lowe commented on TEZ-3893: - Thanks for the patch! A lot of the fragility in this code stems from the

[jira] [Updated] (TEZ-3894) Tez intermediate outputs implicitly rely on permissive umask for shuffle

[ https://issues.apache.org/jira/browse/TEZ-3894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3894: Attachment: TEZ-3894.001.patch > Tez intermediate outputs implicitly rely on permissive umask for shuffle >

[jira] [Commented] (TEZ-3894) Tez intermediate outputs implicitly rely on permissive umask for shuffle

[ https://issues.apache.org/jira/browse/TEZ-3894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347600#comment-16347600 ] Jason Lowe commented on TEZ-3894: - This is the Tez equivalent of MAPREDUCE-7033. This will become more of

  1   2   3   4   5   >