[jira] [Commented] (TEZ-4156) Fix Tez to reuse IPC connections

2020-04-27 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094111#comment-17094111 ] Siddharth Seth commented on TEZ-4156: - +1 for the .4 patch. It avoids adding tokens to the original

[jira] [Commented] (TEZ-4156) Fix Tez to reuse IPC connections

2020-04-27 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093817#comment-17093817 ] Siddharth Seth commented on TEZ-4156: - [~rajesh.balamohan] - where is this encountered? A connection

[jira] [Commented] (TEZ-4086) Some Tez examples cannot work with outputPaths on a FS other than the default FS

2019-10-06 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16945412#comment-16945412 ] Siddharth Seth commented on TEZ-4086: - Thanks for the review (on the PR). Committed. > Some Tez

[jira] [Updated] (TEZ-4075) Tez: Reimplement tez.runtime.transfer.data-via-events.enabled

2019-10-04 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-4075: Issue Type: Improvement (was: Bug) > Tez: Reimplement tez.runtime.transfer.data-via-events.enabled

[jira] [Commented] (TEZ-4075) Tez: Reimplement tez.runtime.transfer.data-via-events.enabled

2019-10-04 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944957#comment-16944957 ] Siddharth Seth commented on TEZ-4075: - bq. Instead of using compressed stream, tried using uncompressed

[jira] [Updated] (TEZ-4086) Some Tez examples cannot work with outputPaths on a FS other than the default FS

2019-10-02 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-4086: Attachment: TEZ-4086.02.patch > Some Tez examples cannot work with outputPaths on a FS other than

[jira] [Commented] (TEZ-4086) Some Tez examples cannot work with outputPaths on a FS other than the default FS

2019-10-01 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942020#comment-16942020 ] Siddharth Seth commented on TEZ-4086: - Attaching patch here to see if a precommit job starts properly.

[jira] [Updated] (TEZ-4086) Some Tez examples cannot work with outputPaths on a FS other than the default FS

2019-10-01 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-4086: Attachment: TEZ-4086.01.txt > Some Tez examples cannot work with outputPaths on a FS other than the

[jira] [Created] (TEZ-4086) Some Tez examples cannot work with outputPaths on a FS other than the default FS

2019-09-30 Thread Siddharth Seth (Jira)
Siddharth Seth created TEZ-4086: --- Summary: Some Tez examples cannot work with outputPaths on a FS other than the default FS Key: TEZ-4086 URL: https://issues.apache.org/jira/browse/TEZ-4086 Project:

[jira] [Commented] (TEZ-4075) Tez: Reimplement tez.runtime.transfer.data-via-events.enabled

2019-09-30 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941155#comment-16941155 ] Siddharth Seth commented on TEZ-4075: - A few more comments. Please evaluate on value of the changes. *

[jira] [Commented] (TEZ-4075) Tez: Reimplement tez.runtime.transfer.data-via-events.enabled

2019-09-29 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940640#comment-16940640 ] Siddharth Seth commented on TEZ-4075: - Some comments from a quick look at the patch, will look in more

[jira] [Commented] (TEZ-1348) Allow Tez local mode to run against filesystems other than local FS

2019-05-06 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834061#comment-16834061 ] Siddharth Seth commented on TEZ-1348: - Fixed. > Allow Tez local mode to run against filesystems other

[jira] [Updated] (TEZ-1348) Allow Tez local mode to run against filesystems other than local FS

2019-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1348: Environment: Committed to branch-0.9. Fix Version/s: 0.9.2 > Allow Tez local mode to run

[jira] [Commented] (TEZ-1348) Allow Tez local mode to run against filesystems other than local FS

2019-04-26 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827241#comment-16827241 ] Siddharth Seth commented on TEZ-1348: - [~jeagles] - should this be pulled into branch-0.10.0 as well,

[jira] [Updated] (TEZ-1348) Allow Tez local mode to run against filesystems other than local FS

2019-04-26 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1348: Fix Version/s: 0.10.0 > Allow Tez local mode to run against filesystems other than local FS >

[jira] [Updated] (TEZ-1348) Allow Tez local mode to run against filesystems other than local FS

2019-04-26 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1348: Fix Version/s: (was: 0.10.0) 0.10.1 > Allow Tez local mode to run against

[jira] [Updated] (TEZ-1348) Allow Tez local mode to run against filesystems other than local FS

2019-04-26 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1348: Summary: Allow Tez local mode to run against filesystems other than local FS (was: Setup configs

[jira] [Commented] (TEZ-1348) Setup configs required for local mode automatically, instead of relying on changes to tez-site

2019-04-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824387#comment-16824387 ] Siddharth Seth commented on TEZ-1348: - [~tlipcon] - could you please upload a patch with the

[jira] [Commented] (TEZ-1348) Setup configs required for local mode automatically, instead of relying on changes to tez-site

2019-04-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811408#comment-16811408 ] Siddharth Seth commented on TEZ-1348: - Took a while to refresh my memory about Local mode etc. Local

[jira] [Assigned] (TEZ-1348) Setup configs required for local mode automatically, instead of relying on changes to tez-site

2019-04-03 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned TEZ-1348: --- Assignee: Todd Lipcon > Setup configs required for local mode automatically, instead of

[jira] [Commented] (TEZ-4044) Zookeeper: exclude jline from Zookeeper client from tez dist

2019-03-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789866#comment-16789866 ] Siddharth Seth commented on TEZ-4044: - +1. Assuming this is causing some kind of a conflict somewhere.

[jira] [Commented] (TEZ-3920) Setting tez.am.log.level does not take full effect if more than one clause is present

2018-04-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448658#comment-16448658 ] Siddharth Seth commented on TEZ-3920: - [~rajesh.balamohan] - the specific case reported in the

[jira] [Commented] (TEZ-3920) Setting tez.am.log.level does not take full effect if more than one clause is present

2018-04-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444979#comment-16444979 ] Siddharth Seth commented on TEZ-3920: - This used to work, when setting via the config file. Not sure if

[jira] [Commented] (TEZ-3892) getClient API for TezClient

2018-03-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397431#comment-16397431 ] Siddharth Seth commented on TEZ-3892: - One thing to keep in mind when using this is the number of

[jira] [Assigned] (TEZ-3888) Update Jetty to org.eclipse.jetty 9.x

2018-02-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned TEZ-3888: --- Assignee: Eric Wohlstadter > Update Jetty to org.eclipse.jetty 9.x >

[jira] [Commented] (TEZ-3770) DAG-aware YARN task scheduler

2018-01-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336203#comment-16336203 ] Siddharth Seth commented on TEZ-3770: - +1. Looks good. Thanks [~jlowe] > DAG-aware YARN task scheduler

[jira] [Commented] (TEZ-3880) do not count rejected tasks as killed in vertex progress

2018-01-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316909#comment-16316909 ] Siddharth Seth commented on TEZ-3880: - Is the test failure related? Otherwise, the patch looks good to

[jira] [Commented] (TEZ-3868) Update website to factor in the TEZ trademark registration

2017-12-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275016#comment-16275016 ] Siddharth Seth commented on TEZ-3868: - Thanks for the review. Committing and updating the website. >

[jira] [Updated] (TEZ-3868) Update website to factor in the TEZ trademark registration

2017-11-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3868: Attachment: TEZ-3868.02.patch Oops. Yes, it should've been . Fixed in the new patch. > Update

[jira] [Commented] (TEZ-3868) Update website to factor in the TEZ trademark registration

2017-11-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267800#comment-16267800 ] Siddharth Seth commented on TEZ-3868: - Ping [~jeagles], [~gopalv], [~aplusplus] > Update website to

[jira] [Commented] (TEZ-3868) Update website to factor in the TEZ trademark registration

2017-11-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263423#comment-16263423 ] Siddharth Seth commented on TEZ-3868: - Test failures are not related... no code changed. > Update

[jira] [Updated] (TEZ-3868) Update website to factor in the TEZ trademark registration

2017-11-21 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3868: Attachment: TEZ-3868.01.patch [~jeagles], [~aplusplus], [~gopalv] - could you please take a look.

[jira] [Created] (TEZ-3868) Update website to factor in the TEZ trademark registration

2017-11-21 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-3868: --- Summary: Update website to factor in the TEZ trademark registration Key: TEZ-3868 URL: https://issues.apache.org/jira/browse/TEZ-3868 Project: Apache Tez

[jira] [Commented] (TEZ-3861) PipelineSorter setting negative progess

2017-11-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234780#comment-16234780 ] Siddharth Seth commented on TEZ-3861: - +1 > PipelineSorter setting negative progess >

[jira] [Commented] (TEZ-3363) Delete intermediate data at the vertex level for Shuffle Handler

2017-10-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219468#comment-16219468 ] Siddharth Seth commented on TEZ-3363: - Couple of comments. 1. When the data for a vertex is deleted, I

[jira] [Comment Edited] (TEZ-3824) MRCombiner creates new JobConf copy per spill

2017-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149492#comment-16149492 ] Siddharth Seth edited comment on TEZ-3824 at 8/31/17 7:47 PM: -- [~jeagles] - I

[jira] [Commented] (TEZ-3824) MRCombiner creates new JobConf copy per spill

2017-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149492#comment-16149492 ] Siddharth Seth commented on TEZ-3824: - [~jeagles] - I think the change is fine as long as it is within

[jira] [Commented] (TEZ-3823) expose AM location and application ID from TezClient

2017-08-28 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144460#comment-16144460 ] Siddharth Seth commented on TEZ-3823: - [~sershe] - this is prone to errors, especially in case of AM

[jira] [Commented] (TEZ-3816) Ability to automatically speculate single-task vertices

2017-08-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126168#comment-16126168 ] Siddharth Seth commented on TEZ-3816: - +1. Thanks [~samkhan]. Will commit once jenkins gets back. >

[jira] [Commented] (TEZ-3816) Ability to automatically speculate single-task vertices

2017-08-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122452#comment-16122452 ] Siddharth Seth commented on TEZ-3816: - I believe a max of 2 attempts (for a single task) running is

[jira] [Comment Edited] (TEZ-3816) Ability to automatically speculate single-task vertices

2017-08-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16122452#comment-16122452 ] Siddharth Seth edited comment on TEZ-3816 at 8/10/17 10:29 PM: --- I believe a

[jira] [Commented] (TEZ-3803) Tasks can get killed due to insufficient progress while waiting for shuffle inputs to complete

2017-07-26 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102296#comment-16102296 ] Siddharth Seth commented on TEZ-3803: - (If a new config is being added, it will need to be added to the

[jira] [Commented] (TEZ-1259) Vertex should move to RUNNING state without generating an extra VERTEX_START event

2017-07-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094063#comment-16094063 ] Siddharth Seth commented on TEZ-1259: - [~hitesh] - is this case handled currently in recovery? >From the

[jira] [Commented] (TEZ-3770) DAG-aware YARN task scheduler

2017-07-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093956#comment-16093956 ] Siddharth Seth commented on TEZ-3770: - bq. It tries to schedule new containers for tasks that match its

[jira] [Updated] (TEZ-3252) [Umbrella] Enable support for Hadoop-3.x

2017-07-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3252: Fix Version/s: (was: 0.9.0) > [Umbrella] Enable support for Hadoop-3.x >

[jira] [Updated] (TEZ-3252) [Umbrella] Enable support for Hadoop-3.x

2017-07-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3252: Fix Version/s: 0.9.0 > [Umbrella] Enable support for Hadoop-3.x >

[jira] [Commented] (TEZ-3718) Better handling of 'bad' nodes

2017-07-17 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090848#comment-16090848 ] Siddharth Seth commented on TEZ-3718: - Patch mostly looks good to me. More at the end though on

[jira] [Created] (TEZ-3799) Change failure handling on blacklisting to be the same as unhealthy node handling

2017-07-17 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-3799: --- Summary: Change failure handling on blacklisting to be the same as unhealthy node handling Key: TEZ-3799 URL: https://issues.apache.org/jira/browse/TEZ-3799 Project:

[jira] [Commented] (TEZ-3694) Adopt YARN-5007 in MiniTezCluster

2017-07-17 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090603#comment-16090603 ] Siddharth Seth commented on TEZ-3694: - [~aplusplus] - did this get committed? Does it need to be

[jira] [Commented] (TEZ-3798) Remove duplicate package-info.java

2017-07-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088260#comment-16088260 ] Siddharth Seth commented on TEZ-3798: - +1 for the .2 patch. > Remove duplicate package-info.java >

[jira] [Updated] (TEZ-3798) Remove duplicate package-info.java

2017-07-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3798: Affects Version/s: (was: 0.9.0) Target Version/s: 0.9.0 > Remove duplicate package-info.java

[jira] [Updated] (TEZ-3797) Add tez debug tool for comparing counters of 2 DAGs

2017-07-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3797: Affects Version/s: (was: 0.9.next) > Add tez debug tool for comparing counters of 2 DAGs >

[jira] [Commented] (TEZ-3792) RootInputVertexManager doesn't drain queued source task completed events

2017-07-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084826#comment-16084826 ] Siddharth Seth commented on TEZ-3792: - Looking at the code again, the default case looks ok - i.e. slow

[jira] [Comment Edited] (TEZ-3792) RootInputVertexManager doesn't drain queued source task completed events

2017-07-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084826#comment-16084826 ] Siddharth Seth edited comment on TEZ-3792 at 7/12/17 10:18 PM: --- Looking at the

[jira] [Commented] (TEZ-3796) Vertex state machine can throw InvalidStateTransitionException in SUCCEEDED state

2017-07-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084814#comment-16084814 ] Siddharth Seth commented on TEZ-3796: - [~kshukla] - what caused this error to occur? > Vertex state

[jira] [Commented] (TEZ-3573) Allow user to cap number of task in cartesian product (unpartitioned case)

2017-07-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083114#comment-16083114 ] Siddharth Seth commented on TEZ-3573: - [~aplusplus] - is this still relevant after recent changes to

[jira] [Commented] (TEZ-3754) With large ordered fetches, stalling shuffle could lead to slowdown of job

2017-07-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083027#comment-16083027 ] Siddharth Seth commented on TEZ-3754: - [~rajesh.balamohan] - what is the corner case in which this is

[jira] [Commented] (TEZ-3792) RootInputVertexManager doesn't drain queued source task completed events

2017-07-11 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083002#comment-16083002 ] Siddharth Seth commented on TEZ-3792: - Assuming this is a blocker for 0.9? (RootInputVertexManager

[jira] [Commented] (TEZ-3772) Allow slowstart for small vertices to be treated differently

2017-07-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081131#comment-16081131 ] Siddharth Seth commented on TEZ-3772: - The case of 1 downstream reducer should have already been

[jira] [Commented] (TEZ-3780) Fix ADDITIONAL_SPILLS_BYTES_WRITTEN counter in unordered case

2017-07-10 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081110#comment-16081110 ] Siddharth Seth commented on TEZ-3780: - What needs to be changed with the counter? > Fix

[jira] [Commented] (TEZ-3718) Better handling of 'bad' nodes

2017-06-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065786#comment-16065786 ] Siddharth Seth commented on TEZ-3718: - I'm not sure why AMNodeIMpl treats NodeUnhealthy and

[jira] [Commented] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

2017-06-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065331#comment-16065331 ] Siddharth Seth commented on TEZ-3274: - Line 173: log should include the value for the source vertex

[jira] [Commented] (TEZ-3605) Detect and prune empty partitions for the Ordered case

2017-06-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065275#comment-16065275 ] Siddharth Seth commented on TEZ-3605: - Thanks for the updated patch. Fixes large records as well. +1,

[jira] [Commented] (TEZ-3767) Shuffle should not report error to AM during inputContext.killSelf()

2017-06-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065257#comment-16065257 ] Siddharth Seth commented on TEZ-3767: - +1. Not sure if the test failure is related. > Shuffle should

[jira] [Resolved] (TEZ-3779) Tez query failed with OutOfMemoryError: Java heap space

2017-06-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved TEZ-3779. - Resolution: Not A Bug Please send a mail to the hive-user list for issues like this. > Tez query

[jira] [Commented] (TEZ-3767) Shuffle should not report error to AM during inputContext.killSelf()

2017-06-27 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064602#comment-16064602 ] Siddharth Seth commented on TEZ-3767: - Should this also have the checks for isShutdown / previously

[jira] [Commented] (TEZ-3767) Shuffle should not report error to AM during inputContext.killSelf()

2017-06-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060182#comment-16060182 ] Siddharth Seth commented on TEZ-3767: - Exceptions from ShuffleCallable are supposed to be handled by the

[jira] [Commented] (TEZ-3772) Allow slowstart for small vertices to be treated differently

2017-06-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060096#comment-16060096 ] Siddharth Seth commented on TEZ-3772: - [~samirkhan] - is there a specific observation which leads to

[jira] [Commented] (TEZ-3771) Tez UI: WASB/ADLS counters should be listed on the Tez UI

2017-06-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060092#comment-16060092 ] Siddharth Seth commented on TEZ-3771: - Actually, Is there a way where a site deployment can add specific

[jira] [Commented] (TEZ-3771) Tez UI: WASB/ADLS counters should be listed on the Tez UI

2017-06-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060090#comment-16060090 ] Siddharth Seth commented on TEZ-3771: - +1. > Tez UI: WASB/ADLS counters should be listed on the Tez UI

[jira] [Commented] (TEZ-3693) ControlledClock is not used

2017-06-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054866#comment-16054866 ] Siddharth Seth commented on TEZ-3693: - I don't see any issues with removing this class. >

[jira] [Updated] (TEZ-3762) When final merge is disabled in unordered case, it should create index file instead of relying on cache

2017-06-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3762: Affects Version/s: 0.9.0 > When final merge is disabled in unordered case, it should create index

[jira] [Updated] (TEZ-3762) When final merge is disabled in unordered case, it should create index file instead of relying on cache

2017-06-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3762: Target Version/s: 0.9.0 > When final merge is disabled in unordered case, it should create index file

[jira] [Commented] (TEZ-3764) Tez UI: DAG failed but status shows error

2017-06-19 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054862#comment-16054862 ] Siddharth Seth commented on TEZ-3764: - How did we find out that the dag is complete? The "ERROR" state

[jira] [Commented] (TEZ-3698) UnorderedKV writer should be able to honor tez.runtime.enable.final-merge.in.output without pipelinedshuffle

2017-06-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047017#comment-16047017 ] Siddharth Seth commented on TEZ-3698: - +1. Thanks [~rajesh.balamohan] > UnorderedKV writer should be

[jira] [Commented] (TEZ-3718) Better handling of 'bad' nodes

2017-06-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047013#comment-16047013 ] Siddharth Seth commented on TEZ-3718: - bq. it. For not accessing nodeTracker from TaskAttempt, are you

[jira] [Commented] (TEZ-3758) Vertex can hang in RUNNING state when two task attempts finish very closely and have retroactive failures

2017-06-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047011#comment-16047011 ] Siddharth Seth commented on TEZ-3758: - cc [~aplusplus], [~harishjp] > Vertex can hang in RUNNING state

[jira] [Commented] (TEZ-3757) Integer overflow in PipelinedSorter

2017-06-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047000#comment-16047000 ] Siddharth Seth commented on TEZ-3757: - cc [~gopalv], [~rajesh.balamohan] > Integer overflow in

[jira] [Commented] (TEZ-3617) TestHistoryParser#testParserWithSuccessfulJob fails intermittently

2017-06-12 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046998#comment-16046998 ] Siddharth Seth commented on TEZ-3617: - [~jeagles], is there a way to do this without the upgrade to

[jira] [Commented] (TEZ-3605) Detect and prune empty partitions for the Ordered case

2017-06-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045101#comment-16045101 ] Siddharth Seth commented on TEZ-3605: - In PipelinedSorter - the final merge does not necessarily skip a

[jira] [Commented] (TEZ-3718) Better handling of 'bad' nodes

2017-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035239#comment-16035239 ] Siddharth Seth commented on TEZ-3718: - Can we do this a little differently. Typically Entities send out

[jira] [Comment Edited] (TEZ-3745) Change master to required java 8

2017-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035080#comment-16035080 ] Siddharth Seth edited comment on TEZ-3745 at 6/2/17 5:26 PM: - [~jeagles] -

[jira] [Updated] (TEZ-3745) Change master to required java 8

2017-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3745: Hadoop Flags: Incompatible change > Change master to required java 8 >

[jira] [Commented] (TEZ-3745) Change master to required java 8

2017-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035080#comment-16035080 ] Siddharth Seth commented on TEZ-3745: - [~jeagles] - thanks for taking a look and committing this. The

[jira] [Updated] (TEZ-3745) Change master to required java 8

2017-06-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3745: Attachment: TEZ-3745.03.patch Updated patch with doclint suppression working. > Change master to

[jira] [Commented] (TEZ-3701) UnorderedPartitionedKVWriter - issues with parallel Deflater usage, synchronousqueue in threadpool

2017-06-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033745#comment-16033745 ] Siddharth Seth commented on TEZ-3701: - The last failure is a result of moving the build to Java8 for

[jira] [Commented] (TEZ-3750) Add TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWRITER_BUFFER_MERGE_PERCENT to UnorderedKVInput.

2017-06-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033708#comment-16033708 ] Siddharth Seth commented on TEZ-3750: - +1 > Add

[jira] [Commented] (TEZ-3749) MRRSleep does not start in hadoop 3.

2017-06-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033406#comment-16033406 ] Siddharth Seth commented on TEZ-3749: - +1 > MRRSleep does not start in hadoop 3. >

[jira] [Updated] (TEZ-3748) TaskAttemptImpl State Machine Invalid event: TA_SUBMITTED at KILL_IN_PROGRESS

2017-06-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3748: Affects Version/s: 0.9.0 > TaskAttemptImpl State Machine Invalid event: TA_SUBMITTED at

[jira] [Commented] (TEZ-3745) Change master to required java 8

2017-06-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033372#comment-16033372 ] Siddharth Seth commented on TEZ-3745: - Thanks for taking a look [~jeagles]. I suspect this may not run

[jira] [Updated] (TEZ-2164) Shade the guava version used by Tez and move to guava-18

2017-05-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-2164: Priority: Blocker (was: Critical) > Shade the guava version used by Tez and move to guava-18 >

[jira] [Updated] (TEZ-2222) Investigate moving to log4j2 for logging

2017-05-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-: Priority: Blocker (was: Major) > Investigate moving to log4j2 for logging >

[jira] [Updated] (TEZ-2222) Investigate moving to log4j2 for logging

2017-05-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-: Target Version/s: 0.9.next (was: 0.8.6) > Investigate moving to log4j2 for logging >

[jira] [Updated] (TEZ-3745) Change master to required java 8

2017-05-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3745: Attachment: TEZ-3745.01.patch > Change master to required java 8 > >

[jira] [Assigned] (TEZ-3745) Change master to required java 8

2017-05-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned TEZ-3745: --- Assignee: Siddharth Seth > Change master to required java 8 >

[jira] [Commented] (TEZ-3748) TaskAttemptImpl State Machine Invalid event: TA_SUBMITTED at KILL_IN_PROGRESS

2017-05-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032200#comment-16032200 ] Siddharth Seth commented on TEZ-3748: - Oops. Sorry for the confusion. Commit as is. > TaskAttemptImpl

[jira] [Commented] (TEZ-3748) TaskAttemptImpl State Machine Invalid event: TA_SUBMITTED at KILL_IN_PROGRESS

2017-05-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032159#comment-16032159 ] Siddharth Seth commented on TEZ-3748: - +1. The SCHEDULE transitions won't actually be hit, since there's

[jira] [Updated] (TEZ-3746) TestExceptionPropagation#testExceptionPropagationSession fails intermittently

2017-05-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3746: Attachment: TEZ-3746.01.patch This should fix the issue. Missed adding the ignored transitions in the

[jira] [Assigned] (TEZ-3746) TestExceptionPropagation#testExceptionPropagationSession fails intermittently

2017-05-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned TEZ-3746: --- Assignee: Siddharth Seth > TestExceptionPropagation#testExceptionPropagationSession fails

[jira] [Updated] (TEZ-3746) TestExceptionPropagation#testExceptionPropagationSession fails intermittently

2017-05-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3746: Target Version/s: 0.9.0 > TestExceptionPropagation#testExceptionPropagationSession fails

  1   2   3   4   5   6   7   8   9   10   >