[jira] [Commented] (TEZ-4187) Shuffle hangs occasionally after fetch failure with multiple input vertices

2020-05-22 Thread Prasanth Jayachandran (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114147#comment-17114147 ] Prasanth Jayachandran commented on TEZ-4187: Is this related to TEZ-4087 ? cc/

[jira] [Commented] (TEZ-4183) Time- and threshold-batched FetchFailure event propagation to AM

2020-05-18 Thread Prasanth Jayachandran (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110709#comment-17110709 ] Prasanth Jayachandran commented on TEZ-4183: Th patch looks good in general. +1 (non-binding).

[jira] [Commented] (TEZ-4179) [Kubernetes] Extend NodeId in tez to support unique worker identity

2020-05-14 Thread Prasanth Jayachandran (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107697#comment-17107697 ] Prasanth Jayachandran commented on TEZ-4179: [~jeagles]  But this is an additional optional

[jira] [Commented] (TEZ-4179) [Kubernetes] Extend NodeId in tez to support unique worker identity

2020-05-14 Thread Prasanth Jayachandran (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107080#comment-17107080 ] Prasanth Jayachandran commented on TEZ-4179: [~rajesh.balamohan] could you please help review

[jira] [Updated] (TEZ-4179) [Kubernetes] Extend NodeId in tez to support unique worker identity

2020-05-14 Thread Prasanth Jayachandran (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-4179: --- Attachment: TEZ-4179.1.patch > [Kubernetes] Extend NodeId in tez to support unique

[jira] [Created] (TEZ-4179) [Kubernetes] Extend NodeId in tez to support unique worker identity

2020-05-13 Thread Prasanth Jayachandran (Jira)
Prasanth Jayachandran created TEZ-4179: -- Summary: [Kubernetes] Extend NodeId in tez to support unique worker identity Key: TEZ-4179 URL: https://issues.apache.org/jira/browse/TEZ-4179 Project:

[jira] [Commented] (TEZ-4174) [Kubernetes] Fetcher should connection failure on SocketException

2020-05-08 Thread Prasanth Jayachandran (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103060#comment-17103060 ] Prasanth Jayachandran commented on TEZ-4174: [~rajesh.balamohan]/[~gopalv] could you please

[jira] [Updated] (TEZ-4174) [Kubernetes] Fetcher should connection failure on SocketException

2020-05-08 Thread Prasanth Jayachandran (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-4174: --- Attachment: TEZ-4174.1.patch > [Kubernetes] Fetcher should connection failure on

[jira] [Commented] (TEZ-4174) [Kubernetes] Fetcher should connection failure on SocketException

2020-05-08 Thread Prasanth Jayachandran (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103055#comment-17103055 ] Prasanth Jayachandran commented on TEZ-4174: cc/ [~rajesh.balamohan] [~gopalv] > [Kubernetes]

[jira] [Commented] (TEZ-4087) Shuffle: Fix shuffle cleanup to prevent thread leaks

2020-01-06 Thread Prasanth Jayachandran (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009156#comment-17009156 ] Prasanth Jayachandran commented on TEZ-4087: +1 (non-binding) > Shuffle: Fix shuffle cleanup

[jira] [Commented] (TEZ-4039) Tez should inject dag id, query id into MDC

2019-03-05 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784727#comment-16784727 ] Prasanth Jayachandran commented on TEZ-4039: [~jeagles] queryId is hive construct which could

[jira] [Commented] (TEZ-4051) Proto history events should selectively drop events

2019-02-28 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780247#comment-16780247 ] Prasanth Jayachandran commented on TEZ-4051: [~gopalv] can you please review? > Proto history

[jira] [Assigned] (TEZ-4051) Proto history events should selectively drop events

2019-02-28 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned TEZ-4051: -- Assignee: Prasanth Jayachandran > Proto history events should selectively drop

[jira] [Updated] (TEZ-4051) Proto history events should selectively drop events

2019-02-28 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-4051: --- Attachment: TEZ-4051.1.patch > Proto history events should selectively drop events >

[jira] [Created] (TEZ-4051) Proto history events should selectively drop events

2019-02-27 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-4051: -- Summary: Proto history events should selectively drop events Key: TEZ-4051 URL: https://issues.apache.org/jira/browse/TEZ-4051 Project: Apache Tez

[jira] [Updated] (TEZ-4048) Make proto history logger queue size configurable

2019-02-27 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-4048: --- Attachment: TEZ-4048.1.patch > Make proto history logger queue size configurable >

[jira] [Created] (TEZ-4048) Make proto history logger queue size configurable

2019-02-27 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-4048: -- Summary: Make proto history logger queue size configurable Key: TEZ-4048 URL: https://issues.apache.org/jira/browse/TEZ-4048 Project: Apache Tez

[jira] [Commented] (TEZ-4039) Tez should inject dag id, query id into MDC

2019-02-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765619#comment-16765619 ] Prasanth Jayachandran commented on TEZ-4039: cc/ [~gopalv] [~ewohlstadter] > Tez should inject

[jira] [Created] (TEZ-4039) Tez should inject dag id, query id into MDC

2019-02-11 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-4039: -- Summary: Tez should inject dag id, query id into MDC Key: TEZ-4039 URL: https://issues.apache.org/jira/browse/TEZ-4039 Project: Apache Tez Issue

[jira] [Created] (TEZ-3991) Unmanaged tez sessions

2018-09-13 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3991: -- Summary: Unmanaged tez sessions Key: TEZ-3991 URL: https://issues.apache.org/jira/browse/TEZ-3991 Project: Apache Tez Issue Type: New Feature

[jira] [Commented] (TEZ-3991) Unmanaged tez sessions

2018-09-13 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613999#comment-16613999 ] Prasanth Jayachandran commented on TEZ-3991: cc/ [~ewohlstadter] [~sershe] > Unmanaged tez

[jira] [Commented] (TEZ-3800) Format Hive queries in Tez UI

2018-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540565#comment-16540565 ] Prasanth Jayachandran commented on TEZ-3800: Sure. > Format Hive queries in Tez UI >

[jira] [Commented] (TEZ-3962) Configuration decode leaks an Inflater object

2018-06-27 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525714#comment-16525714 ] Prasanth Jayachandran commented on TEZ-3962: +1 (non-binding) > Configuration decode leaks an

[jira] [Commented] (TEZ-3331) Add operation specific HDFS counters for Tez UI

2018-06-06 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503701#comment-16503701 ] Prasanth Jayachandran commented on TEZ-3331: TestTaskScheduler seems to be crashing in master

[jira] [Updated] (TEZ-3331) Add operation specific HDFS counters for Tez UI

2018-06-06 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3331: --- Attachment: TEZ-3331.8.patch > Add operation specific HDFS counters for Tez UI >

[jira] [Commented] (TEZ-3331) Add operation specific HDFS counters for Tez UI

2018-06-06 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502933#comment-16502933 ] Prasanth Jayachandran commented on TEZ-3331: Fixed failing test TestTaskExecution2. 

[jira] [Updated] (TEZ-3331) Add operation specific HDFS counters for Tez UI

2018-06-06 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3331: --- Attachment: TEZ-3331.7.patch > Add operation specific HDFS counters for Tez UI >

[jira] [Commented] (TEZ-3331) Add operation specific HDFS counters for Tez UI

2018-06-05 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502663#comment-16502663 ] Prasanth Jayachandran commented on TEZ-3331: Rebased patch. Just removed the changes to root

[jira] [Updated] (TEZ-3331) Add operation specific HDFS counters for Tez UI

2018-06-05 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3331: --- Attachment: TEZ-3331.6.patch > Add operation specific HDFS counters for Tez UI >

[jira] [Commented] (TEZ-3892) getClient API for TezClient

2018-03-06 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388367#comment-16388367 ] Prasanth Jayachandran commented on TEZ-3892: changes look good to me.. would be good to have

[jira] [Commented] (TEZ-3861) PipelineSorter setting negative progess

2017-10-31 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16232716#comment-16232716 ] Prasanth Jayachandran commented on TEZ-3861: +1 (non-binding). Tested this patch and it worked

[jira] [Commented] (TEZ-2914) Ability to limit vertex concurrency

2017-10-30 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226063#comment-16226063 ] Prasanth Jayachandran commented on TEZ-2914: [~aplusplus] Thanks for the pointer! This will

[jira] [Updated] (TEZ-3861) PipelineSorter setting negative progess

2017-10-30 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3861: --- Attachment: TezTR-545720_1_1_2_0_0.log Attached the full logs from the specific task

[jira] [Commented] (TEZ-3861) PipelineSorter setting negative progess

2017-10-30 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225453#comment-16225453 ] Prasanth Jayachandran commented on TEZ-3861: [~rajesh.balamohan] please find the relevant log

[jira] [Commented] (TEZ-3861) PipelineSorter setting negative progess

2017-10-30 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224504#comment-16224504 ] Prasanth Jayachandran commented on TEZ-3861: cc/ [~rajesh.balamohan] > PipelineSorter setting

[jira] [Created] (TEZ-3861) PipelineSorter setting negative progess

2017-10-30 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3861: -- Summary: PipelineSorter setting negative progess Key: TEZ-3861 URL: https://issues.apache.org/jira/browse/TEZ-3861 Project: Apache Tez Issue

[jira] [Updated] (TEZ-3856) API to access counters in InputInitializerContext

2017-10-25 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3856: --- Attachment: TEZ-3856.3.patch I updated the patch to add counters instead of getting

[jira] [Updated] (TEZ-3856) API to access counters in InputInitializerContext

2017-10-20 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3856: --- Attachment: TEZ-3856.2.patch > API to access counters in InputInitializerContext >

[jira] [Commented] (TEZ-3856) API to access counters in InputInitializerContext

2017-10-20 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213739#comment-16213739 ] Prasanth Jayachandran commented on TEZ-3856: These 3 tests passed for me locally. Not sure why

[jira] [Updated] (TEZ-3856) API to access counters in InputInitializerContext

2017-10-20 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3856: --- Attachment: TEZ-3856.2.patch > API to access counters in InputInitializerContext >

[jira] [Commented] (TEZ-3856) API to access counters in InputInitializerContext

2017-10-20 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213568#comment-16213568 ] Prasanth Jayachandran commented on TEZ-3856: I can call it just getCounters(). TaskImpl seems to

[jira] [Commented] (TEZ-3856) API to access counters in InputInitializerContext

2017-10-20 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213559#comment-16213559 ] Prasanth Jayachandran commented on TEZ-3856: The problem with the Vertex counters is, it always

[jira] [Commented] (TEZ-3856) API to access counters in InputInitializerContext

2017-10-18 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210284#comment-16210284 ] Prasanth Jayachandran commented on TEZ-3856: [~aplusplus] What is the next unrelease major

[jira] [Updated] (TEZ-3856) API to access counters in InputInitializerContext

2017-10-18 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3856: --- Attachment: TEZ-3856.1.patch > API to access counters in InputInitializerContext >

[jira] [Created] (TEZ-3856) API to access counters in InputInitializerContext

2017-10-18 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3856: -- Summary: API to access counters in InputInitializerContext Key: TEZ-3856 URL: https://issues.apache.org/jira/browse/TEZ-3856 Project: Apache Tez

[jira] [Commented] (TEZ-3763) Tez UI: Filter DAG by status does not work

2017-09-14 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167346#comment-16167346 ] Prasanth Jayachandran commented on TEZ-3763: [~jeagles] I haven't tested TEZ-3825 yet. But from

[jira] [Created] (TEZ-3811) Tez UI: Add timezone to all timestamp columns

2017-08-03 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3811: -- Summary: Tez UI: Add timezone to all timestamp columns Key: TEZ-3811 URL: https://issues.apache.org/jira/browse/TEZ-3811 Project: Apache Tez

[jira] [Commented] (TEZ-3800) Format Hive queries in Tez UI

2017-07-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096013#comment-16096013 ] Prasanth Jayachandran commented on TEZ-3800: Looks good! nit: would prefer to have comma at the

[jira] [Created] (TEZ-3800) Format Hive queries in Tez UI

2017-07-18 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3800: -- Summary: Format Hive queries in Tez UI Key: TEZ-3800 URL: https://issues.apache.org/jira/browse/TEZ-3800 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-3797) Add tez debug tool for comparing counters of 2 DAGs

2017-07-14 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088343#comment-16088343 ] Prasanth Jayachandran commented on TEZ-3797: [~gopalv]/[~sseth] can someone please review the

[jira] [Updated] (TEZ-3797) Add tez debug tool for comparing counters of 2 DAGs

2017-07-14 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3797: --- Attachment: TEZ-3797.1.patch > Add tez debug tool for comparing counters of 2 DAGs >

[jira] [Updated] (TEZ-3797) Add tez debug tool for comparing counters of 2 DAGs

2017-07-14 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3797: --- Attachment: counter-diff.png > Add tez debug tool for comparing counters of 2 DAGs >

[jira] [Created] (TEZ-3797) Add tez debug tool for comparing counters of 2 DAGs

2017-07-14 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3797: -- Summary: Add tez debug tool for comparing counters of 2 DAGs Key: TEZ-3797 URL: https://issues.apache.org/jira/browse/TEZ-3797 Project: Apache Tez

[jira] [Commented] (TEZ-3754) With large ordered fetches, stalling shuffle could lead to slowdown of job

2017-07-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083137#comment-16083137 ] Prasanth Jayachandran commented on TEZ-3754: Can we have a counter for shuffle

[jira] [Created] (TEZ-3765) Tez UI: Add query.name/dag.name to the all queries page

2017-06-15 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3765: -- Summary: Tez UI: Add query.name/dag.name to the all queries page Key: TEZ-3765 URL: https://issues.apache.org/jira/browse/TEZ-3765 Project: Apache Tez

[jira] [Updated] (TEZ-3764) Tez UI: DAG failed but status shows error

2017-06-15 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3764: --- Attachment: Screen Shot 2017-06-09 at 12.04.00 PM.png > Tez UI: DAG failed but status

[jira] [Created] (TEZ-3764) Tez UI: DAG failed but status shows error

2017-06-15 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3764: -- Summary: Tez UI: DAG failed but status shows error Key: TEZ-3764 URL: https://issues.apache.org/jira/browse/TEZ-3764 Project: Apache Tez Issue

[jira] [Created] (TEZ-3763) Tez UI: Filter DAG by status does not work

2017-06-15 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3763: -- Summary: Tez UI: Filter DAG by status does not work Key: TEZ-3763 URL: https://issues.apache.org/jira/browse/TEZ-3763 Project: Apache Tez Issue

[jira] [Commented] (TEZ-3730) Lower logging level in UnorderedPartitionedKVWriter

2017-05-15 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011363#comment-16011363 ] Prasanth Jayachandran commented on TEZ-3730: [~sseth] could you please take a look? > Lower

[jira] [Assigned] (TEZ-3730) Lower logging level in UnorderedPartitionedKVWriter

2017-05-15 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned TEZ-3730: -- Assignee: Prasanth Jayachandran > Lower logging level in

[jira] [Updated] (TEZ-3730) Lower logging level in UnorderedPartitionedKVWriter

2017-05-15 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3730: --- Attachment: TEZ-3730.1.patch > Lower logging level in UnorderedPartitionedKVWriter >

[jira] [Created] (TEZ-3730) Lower logging level in UnorderedPartitionedKVWriter

2017-05-15 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3730: -- Summary: Lower logging level in UnorderedPartitionedKVWriter Key: TEZ-3730 URL: https://issues.apache.org/jira/browse/TEZ-3730 Project: Apache Tez

[jira] [Commented] (TEZ-3721) Extend CallableWithNdc to also clone MDC

2017-05-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007340#comment-16007340 ] Prasanth Jayachandran commented on TEZ-3721: Yes. the approach is same. We could either provide

[jira] [Updated] (TEZ-3721) Extend CallableWithNdc to also clone MDC

2017-05-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3721: --- Attachment: TEZ-3721.1.patch I am still figuring out if "isThreadContextMapInheritable"

[jira] [Created] (TEZ-3721) Extend CallableWithNdc to also clone MDC

2017-05-10 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3721: -- Summary: Extend CallableWithNdc to also clone MDC Key: TEZ-3721 URL: https://issues.apache.org/jira/browse/TEZ-3721 Project: Apache Tez Issue

[jira] [Commented] (TEZ-3562) Attempt completion gets printed to STDOUT and STDERR

2017-01-22 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833700#comment-15833700 ] Prasanth Jayachandran commented on TEZ-3562: [~sseth] slf4j errors atleast I have seen it go to

[jira] [Commented] (TEZ-3562) Attempt completion gets printed to STDOUT and STDERR

2016-12-20 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765572#comment-15765572 ] Prasanth Jayachandran commented on TEZ-3562: The problem is in hive, results are printed to

[jira] [Commented] (TEZ-3562) Attempt completion gets printed to STDOUT and STDERR

2016-12-15 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753614#comment-15753614 ] Prasanth Jayachandran commented on TEZ-3562: I see. Does it have to be STDOUT and STDERR? >

[jira] [Updated] (TEZ-3562) Attempt completion gets printed to STDOUT and STDERR

2016-12-15 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3562: --- Attachment: TEZ-3562.1.patch [~rajesh.balamohan]/[~sseth] can someone please take a

[jira] [Created] (TEZ-3562) Attempt completion gets printed to STDOUT and STDERR

2016-12-15 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3562: -- Summary: Attempt completion gets printed to STDOUT and STDERR Key: TEZ-3562 URL: https://issues.apache.org/jira/browse/TEZ-3562 Project: Apache Tez

[jira] [Commented] (TEZ-3545) Don't log tez user payload at any level

2016-11-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685473#comment-15685473 ] Prasanth Jayachandran commented on TEZ-3545: I was using it to see if a JVM option that that I

[jira] [Commented] (TEZ-3545) Don't log tez user payload at any level

2016-11-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685332#comment-15685332 ] Prasanth Jayachandran commented on TEZ-3545: Yeah the later. Even when

[jira] [Commented] (TEZ-3545) Don't log tez user payload at any level

2016-11-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685243#comment-15685243 ] Prasanth Jayachandran commented on TEZ-3545: Agreed that the config knob will aid in debugging.

[jira] [Updated] (TEZ-3545) Don't log tez user payload at any level

2016-11-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3545: --- Priority: Critical (was: Blocker) > Don't log tez user payload at any level >

[jira] [Commented] (TEZ-3545) Don't log tez user payload at any level

2016-11-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685201#comment-15685201 ] Prasanth Jayachandran commented on TEZ-3545: Yes. tez.generate.debug.artifacts is set to true.

[jira] [Commented] (TEZ-3545) Don't log tez user payload at any level

2016-11-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685156#comment-15685156 ] Prasanth Jayachandran commented on TEZ-3545: cc\ [~hitesh] > Don't log tez user payload at any

[jira] [Created] (TEZ-3545) Don't log tez user payload at any level

2016-11-21 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3545: -- Summary: Don't log tez user payload at any level Key: TEZ-3545 URL: https://issues.apache.org/jira/browse/TEZ-3545 Project: Apache Tez Issue

[jira] [Commented] (TEZ-3352) MRInputHelpers getStringProperty() should not fail if property value is null

2016-08-14 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420551#comment-15420551 ] Prasanth Jayachandran commented on TEZ-3352: ping [~sseth] > MRInputHelpers getStringProperty()

[jira] [Updated] (TEZ-3352) MRInputHelpers getStringProperty() should not fail if property value is null

2016-07-14 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3352: --- Attachment: TEZ-3352.1.patch [~sseth] Could you take a look plz? > MRInputHelpers

[jira] [Created] (TEZ-3352) MRInputHelpers getStringProperty() should not fail if property value is null

2016-07-14 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3352: -- Summary: MRInputHelpers getStringProperty() should not fail if property value is null Key: TEZ-3352 URL: https://issues.apache.org/jira/browse/TEZ-3352

[jira] [Comment Edited] (TEZ-3290) Set full task attempt id string in configuration object

2016-06-03 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315238#comment-15315238 ] Prasanth Jayachandran edited comment on TEZ-3290 at 6/4/16 1:46 AM:

[jira] [Commented] (TEZ-3290) Set full task attempt id string in configuration object

2016-06-03 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315238#comment-15315238 ] Prasanth Jayachandran commented on TEZ-3290: [~sseth]/[~hitesh] In this patch I added all the

[jira] [Updated] (TEZ-3290) Set full task attempt id string in configuration object

2016-06-03 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3290: --- Attachment: TEZ-3290.1.patch > Set full task attempt id string in configuration object

[jira] [Commented] (TEZ-3290) Set full task attempt id string in configuration object

2016-06-03 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314972#comment-15314972 ] Prasanth Jayachandran commented on TEZ-3290: Sure. Yeah. I will put up patch shortly. > Set

[jira] [Commented] (TEZ-3290) Set full task attempt id string in configuration object

2016-06-03 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314922#comment-15314922 ] Prasanth Jayachandran commented on TEZ-3290: I don't really need to ApplicationId if tez sets

[jira] [Created] (TEZ-3290) Set full application id string in configuration object

2016-06-03 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3290: -- Summary: Set full application id string in configuration object Key: TEZ-3290 URL: https://issues.apache.org/jira/browse/TEZ-3290 Project: Apache Tez

[jira] [Commented] (TEZ-3251) Allow ability to add custom counters to TaskRunner2Callable

2016-05-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279518#comment-15279518 ] Prasanth Jayachandran commented on TEZ-3251: The primary use case is to provide thread level

[jira] [Updated] (TEZ-3251) Allow ability to add custom counters to TaskRunner2Callable

2016-05-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3251: --- Attachment: TEZ-3151.1.patch [~rajesh.balamohan] As discussed, this patch adds an API

[jira] [Created] (TEZ-3251) Allow ability to add custom counters to TaskRunner2Callable

2016-05-10 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3251: -- Summary: Allow ability to add custom counters to TaskRunner2Callable Key: TEZ-3251 URL: https://issues.apache.org/jira/browse/TEZ-3251 Project: Apache

[jira] [Updated] (TEZ-3250) TezTaskRunner2 should not accept ListeningExecutorService

2016-05-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3250: --- Attachment: TEZ-3250.1.patch > TezTaskRunner2 should not accept

[jira] [Updated] (TEZ-3250) TezTaskRunner2 should not accept ListeningExecutorService

2016-05-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3250: --- Attachment: (was: TEZ-3250.1.patch) > TezTaskRunner2 should not accept

[jira] [Updated] (TEZ-3250) TezTaskRunner2 should not accept ListeningExecutorService

2016-05-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3250: --- Attachment: TEZ-3250.1.patch > TezTaskRunner2 should not accept

[jira] [Updated] (TEZ-3250) TezTaskRunner2 should not accept ListeningExecutorService

2016-05-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3250: --- Attachment: (was: TEZ-3250.1.patch) > TezTaskRunner2 should not accept

[jira] [Updated] (TEZ-3250) TezTaskRunner2 should not accept ListeningExecutorService

2016-05-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated TEZ-3250: --- Attachment: TEZ-3250.1.patch [~rajesh.balamohan]/[~hitesh] Since [~sseth] is out, can

[jira] [Created] (TEZ-3250) TezTaskRunner2 should not accept ListeningExecutorService

2016-05-10 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3250: -- Summary: TezTaskRunner2 should not accept ListeningExecutorService Key: TEZ-3250 URL: https://issues.apache.org/jira/browse/TEZ-3250 Project: Apache Tez

[jira] [Commented] (TEZ-3090) MRInput should make dagIdentifier, vertexIdentifier, etc available to the InputFormat jobConf

2016-02-01 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127462#comment-15127462 ] Prasanth Jayachandran commented on TEZ-3090: Would be useful to have a helper to get full

[jira] [Created] (TEZ-3078) Provide a mechanism for AM to let Client know about the reason for failure

2016-01-28 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-3078: -- Summary: Provide a mechanism for AM to let Client know about the reason for failure Key: TEZ-3078 URL: https://issues.apache.org/jira/browse/TEZ-3078

[jira] [Commented] (TEZ-3078) Provide a mechanism for AM to let Client know about the reason for failure

2016-01-28 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122449#comment-15122449 ] Prasanth Jayachandran commented on TEZ-3078: [~sseth] fyi.. > Provide a mechanism for AM to let

[jira] [Commented] (TEZ-2931) Running DistCp job in Tez with DEBUG logging fails

2015-11-06 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994881#comment-14994881 ] Prasanth Jayachandran commented on TEZ-2931: [~sseth] fyi.. > Running DistCp job in Tez with

[jira] [Created] (TEZ-2931) Running DistCp job in Tez with DEBUG logging fails

2015-11-06 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created TEZ-2931: -- Summary: Running DistCp job in Tez with DEBUG logging fails Key: TEZ-2931 URL: https://issues.apache.org/jira/browse/TEZ-2931 Project: Apache Tez

  1   2   >