[jira] [Commented] (TEZ-4051) Proto history events should selectively drop events

2019-02-28 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780295#comment-16780295 ] Harish Jaiprakash commented on TEZ-4051: [~prasanth_j], please take a look at: TEZ-

[jira] [Commented] (TEZ-4042) Speculative attempts should avoid running on the same node

2019-02-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772082#comment-16772082 ] Harish Jaiprakash commented on TEZ-4042: Sorry, should have read better. This affec

[jira] [Commented] (TEZ-4042) Speculative attempts should avoid running on the same node

2019-02-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772077#comment-16772077 ] Harish Jaiprakash commented on TEZ-4042: Not sure if this is the best strategy. Wha

[jira] [Commented] (TEZ-4028) Events not visible from proto history logging for s3a filesystem until dag completes.

2019-01-09 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16739114#comment-16739114 ] Harish Jaiprakash commented on TEZ-4028: Thanks [~ewohlstadter]. Adding a new const

[jira] [Updated] (TEZ-4028) Events not visible from proto history logging for s3a filesystem until dag completes.

2019-01-09 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-4028: --- Attachment: TEZ-4028.02.patch > Events not visible from proto history logging for s3a filesyste

[jira] [Updated] (TEZ-4028) Events not visible from proto history logging for s3a filesystem until dag completes.

2018-12-18 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-4028: --- Attachment: TEZ-4028.01.patch > Events not visible from proto history logging for s3a filesyste

[jira] [Created] (TEZ-4028) Events not visible from proto history logging for s3a filesystem until dag completes.

2018-12-18 Thread Harish Jaiprakash (JIRA)
Harish Jaiprakash created TEZ-4028: -- Summary: Events not visible from proto history logging for s3a filesystem until dag completes. Key: TEZ-4028 URL: https://issues.apache.org/jira/browse/TEZ-4028 P

[jira] [Commented] (TEZ-3979) Redact configuration when it's being logged, sent to the timeline server or displayed in some way

2018-10-16 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653071#comment-16653071 ] Harish Jaiprakash commented on TEZ-3979: +1, change looks fine. Just one question,

[jira] [Commented] (TEZ-3960) Better error handling in proto history logger and add doAs support.

2018-06-29 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527945#comment-16527945 ] Harish Jaiprakash commented on TEZ-3960: Thanks [~hagleitn], committing patch. > B

[jira] [Commented] (TEZ-3960) Better error handling in proto history logger and add doAs support.

2018-06-27 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16525258#comment-16525258 ] Harish Jaiprakash commented on TEZ-3960: The test case runs fine on my local machin

[jira] [Updated] (TEZ-3960) Better error handling in proto history logger and add doAs support.

2018-06-27 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3960: --- Attachment: TEZ-3960.02.patch > Better error handling in proto history logger and add doAs supp

[jira] [Commented] (TEZ-3959) HTTP 502 for bower install

2018-06-26 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524071#comment-16524071 ] Harish Jaiprakash commented on TEZ-3959: [~kshukla], do you know why the build does

[jira] [Updated] (TEZ-3960) Better error handling in proto history logger and add doAs support.

2018-06-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3960: --- Attachment: TEZ-3960.01.patch > Better error handling in proto history logger and add doAs supp

[jira] [Created] (TEZ-3960) Better error handling in proto history logger and add doAs support.

2018-06-25 Thread Harish Jaiprakash (JIRA)
Harish Jaiprakash created TEZ-3960: -- Summary: Better error handling in proto history logger and add doAs support. Key: TEZ-3960 URL: https://issues.apache.org/jira/browse/TEZ-3960 Project: Apache Tez

[jira] [Commented] (TEZ-3959) HTTP 502 for bower install

2018-06-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522328#comment-16522328 ] Harish Jaiprakash commented on TEZ-3959: [~sseth], Please help us fix this. There i

[jira] [Commented] (TEZ-3959) HTTP 502 for bower install

2018-06-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521960#comment-16521960 ] Harish Jaiprakash commented on TEZ-3959: The older patch failed, do not know why. C

[jira] [Updated] (TEZ-3959) HTTP 502 for bower install

2018-06-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3959: --- Attachment: TEZ-3959.02.patch > HTTP 502 for bower install > -- > >

[jira] [Updated] (TEZ-3959) HTTP 502 for bower install

2018-06-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3959: --- Target Version/s: 0.9.next, 0.10.0 (was: 0.10.0) > HTTP 502 for bower install > --

[jira] [Updated] (TEZ-3959) HTTP 502 for bower install

2018-06-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3959: --- Fix Version/s: (was: 0.10.0) (was: 0.9.next) > HTTP 502 for bower in

[jira] [Comment Edited] (TEZ-3959) HTTP 502 for bower install

2018-06-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521930#comment-16521930 ] Harish Jaiprakash edited comment on TEZ-3959 at 6/25/18 6:59 AM:

[jira] [Commented] (TEZ-3959) HTTP 502 for bower install

2018-06-24 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521930#comment-16521930 ] Harish Jaiprakash commented on TEZ-3959: Fixed this by setting registry url, the te

[jira] [Assigned] (TEZ-3959) HTTP 502 for bower install

2018-06-24 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash reassigned TEZ-3959: -- Assignee: Harish Jaiprakash > HTTP 502 for bower install > -- >

[jira] [Updated] (TEZ-3959) HTTP 502 for bower install

2018-06-24 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3959: --- Attachment: TEZ-3959.01.patch > HTTP 502 for bower install > -- > >

[jira] [Commented] (TEZ-3951) TezClient wait too long for the DAGClient for prewarm; tries to shut down the wrong DAG

2018-06-11 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16508051#comment-16508051 ] Harish Jaiprakash commented on TEZ-3951: Thanks [~sershe]. Committed to master and

[jira] [Comment Edited] (TEZ-3920) Setting tez.am.log.level does not take full effect if more than one clause is present

2018-04-23 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16448908#comment-16448908 ] Harish Jaiprakash edited comment on TEZ-3920 at 4/23/18 9:52 PM: -

[jira] [Commented] (TEZ-3920) Setting tez.am.log.level does not take full effect if more than one clause is present

2018-04-23 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16448908#comment-16448908 ] Harish Jaiprakash commented on TEZ-3920: [~kshukla] Use ';' as the separator, not co

[jira] [Commented] (TEZ-3915) Create protobuf based history event logger.

2018-04-20 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16446517#comment-16446517 ] Harish Jaiprakash commented on TEZ-3915: [~jeagles], sorry for committing it early.

[jira] [Updated] (TEZ-3915) Create protobuf based history event logger.

2018-04-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3915: --- Attachment: TEZ-3915.07.patch > Create protobuf based history event logger. > --

[jira] [Commented] (TEZ-3915) Create protobuf based history event logger.

2018-04-18 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16443399#comment-16443399 ] Harish Jaiprakash commented on TEZ-3915: [~jeagles], the files are sequence file log

[jira] [Updated] (TEZ-3915) Create protobuf based history event logger.

2018-04-18 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3915: --- Attachment: TEZ-3915.06.patch > Create protobuf based history event logger. > --

[jira] [Updated] (TEZ-3915) Create protobuf based history event logger.

2018-04-17 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3915: --- Attachment: TEZ-3915.05.patch > Create protobuf based history event logger. > --

[jira] [Updated] (TEZ-3915) Create protobuf based history event logger.

2018-04-17 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3915: --- Attachment: TEZ-3915.04.patch > Create protobuf based history event logger. > --

[jira] [Commented] (TEZ-3915) Create protobuf based history event logger.

2018-04-16 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16440484#comment-16440484 ] Harish Jaiprakash commented on TEZ-3915: Adding support to load am_launched event to

[jira] [Updated] (TEZ-3915) Create protobuf based history event logger.

2018-04-16 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3915: --- Attachment: TEZ-3915.03.patch > Create protobuf based history event logger. > --

[jira] [Commented] (TEZ-3915) Create protobuf based history event logger.

2018-04-16 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439093#comment-16439093 ] Harish Jaiprakash commented on TEZ-3915: Fixed findbugs and release audit failures.

[jira] [Updated] (TEZ-3915) Create protobuf based history event logger.

2018-04-16 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3915: --- Attachment: TEZ-3915.02.patch > Create protobuf based history event logger. > --

[jira] [Commented] (TEZ-3915) Create protobuf based history event logger.

2018-04-15 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439011#comment-16439011 ] Harish Jaiprakash commented on TEZ-3915: [~sseth]/[~ewohlstadter] Please review. >

[jira] [Updated] (TEZ-3915) Create protobuf based history event logger.

2018-04-15 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3915: --- Issue Type: Improvement (was: Bug) > Create protobuf based history event logger. >

[jira] [Updated] (TEZ-3915) Create protobuf based history event logger.

2018-04-15 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3915: --- Fix Version/s: 0.9.next > Create protobuf based history event logger. >

[jira] [Updated] (TEZ-3915) Create protobuf based history event logger.

2018-04-15 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3915: --- Attachment: TEZ-3915.01.patch > Create protobuf based history event logger. > --

[jira] [Created] (TEZ-3915) Create protobuf based history event logger.

2018-04-15 Thread Harish Jaiprakash (JIRA)
Harish Jaiprakash created TEZ-3915: -- Summary: Create protobuf based history event logger. Key: TEZ-3915 URL: https://issues.apache.org/jira/browse/TEZ-3915 Project: Apache Tez Issue Type: Bu

[jira] [Commented] (TEZ-3901) Add hadoop3 profile for upgrade to Jersey 1.19

2018-03-07 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390759#comment-16390759 ] Harish Jaiprakash commented on TEZ-3901: Sorry [~ewohlstadter]. I did not see the se

[jira] [Commented] (TEZ-3901) Add hadoop3 profile for upgrade to Jersey 1.19

2018-03-07 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390745#comment-16390745 ] Harish Jaiprakash commented on TEZ-3901: {code:java} $ mvn clean install[INFO] Scann

[jira] [Commented] (TEZ-3901) Add hadoop3 profile for upgrade to Jersey 1.19

2018-03-07 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390511#comment-16390511 ] Harish Jaiprakash commented on TEZ-3901: This might explain: https://issues.apache.o

[jira] [Comment Edited] (TEZ-3901) Add hadoop3 profile for upgrade to Jersey 1.19

2018-03-07 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390472#comment-16390472 ] Harish Jaiprakash edited comment on TEZ-3901 at 3/8/18 12:05 AM: -

[jira] [Commented] (TEZ-3901) Add hadoop3 profile for upgrade to Jersey 1.19

2018-03-07 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390472#comment-16390472 ] Harish Jaiprakash commented on TEZ-3901: mvn clean install fails for me. Not sure wh

[jira] [Commented] (TEZ-3884) Hadoop3-beta1 fixes for Tez tests

2018-01-17 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16330124#comment-16330124 ] Harish Jaiprakash commented on TEZ-3884: Sorry about it. DAGAppMaster fails to star

[jira] [Commented] (TEZ-3884) Hadoop3-beta1 fixes for Tez tests

2018-01-17 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16330019#comment-16330019 ] Harish Jaiprakash commented on TEZ-3884: Thanks [~ewohlstadter]. I was trying to bui

[jira] [Commented] (TEZ-3851) I could see there is a missmatch in the bank name, The one i added to Tez is andhra bank(xx2496) but i got a message from Axis bank may be configuration issue in Data bas

2017-10-09 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16197968#comment-16197968 ] Harish Jaiprakash commented on TEZ-3851: You are looking for this: https://support.g

[jira] [Commented] (TEZ-3828) Allow relaxing locality when retried task's priority is kept same

2017-09-11 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162487#comment-16162487 ] Harish Jaiprakash commented on TEZ-3828: Thanks [~aplusplus]. +1 for the change. >

[jira] [Commented] (TEZ-3775) Tez UI: Show DAG context in document title

2017-06-27 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065962#comment-16065962 ] Harish Jaiprakash commented on TEZ-3775: {code}var titleText = typeof title == 'func

[jira] [Updated] (TEZ-3750) Add TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWRITER_BUFFER_MERGE_PERCENT to UnorderedPartitionedKVOutput.

2017-06-01 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3750: --- Summary: Add TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWRITER_BUFFER_MERGE_PERCENT to UnorderedPartit

[jira] [Updated] (TEZ-3749) Get map and reduce task memory from JobConf.

2017-06-01 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3749: --- Summary: Get map and reduce task memory from JobConf. (was: MRRSleep does not start in hadoop 3

[jira] [Commented] (TEZ-3749) Get map and reduce task memory from JobConf.

2017-06-01 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16034007#comment-16034007 ] Harish Jaiprakash commented on TEZ-3749: Thanks [~sseth]. Committed to master: 1250e

[jira] [Commented] (TEZ-3714) Tez UI: Hive Queries page: Use Dag ID and App ID if they are published form Hive side.

2017-05-30 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030704#comment-16030704 ] Harish Jaiprakash commented on TEZ-3714: Thanks [~Sreenath]. +1 for the patch. > Te

[jira] [Updated] (TEZ-3750) Add TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWRITER_BUFFER_MERGE_PERCENT to UnorderedKVInput.

2017-05-30 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3750: --- Attachment: TEZ-3750.01.patch Add to UnorderedPartitionedKVOutput. Please do advise if this is r

[jira] [Created] (TEZ-3750) Add TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWRITER_BUFFER_MERGE_PERCENT to UnorderedKVInput.

2017-05-30 Thread Harish Jaiprakash (JIRA)
Harish Jaiprakash created TEZ-3750: -- Summary: Add TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWRITER_BUFFER_MERGE_PERCENT to UnorderedKVInput. Key: TEZ-3750 URL: https://issues.apache.org/jira/browse/TEZ-3750

[jira] [Updated] (TEZ-3734) Remove config checks in Input/Output.

2017-05-30 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3734: --- Issue Type: Improvement (was: Bug) > Remove config checks in Input/Output. > --

[jira] [Updated] (TEZ-3749) MRRSleep does not start in hadoop 3.

2017-05-30 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3749: --- Attachment: TEZ-3749.01.patch Using JobConf to get the memory instead of reading config directly

[jira] [Created] (TEZ-3749) MRRSleep does not start in hadoop 3.

2017-05-30 Thread Harish Jaiprakash (JIRA)
Harish Jaiprakash created TEZ-3749: -- Summary: MRRSleep does not start in hadoop 3. Key: TEZ-3749 URL: https://issues.apache.org/jira/browse/TEZ-3749 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-3734) Remove config checks in Input/Output.

2017-05-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025804#comment-16025804 ] Harish Jaiprakash commented on TEZ-3734: Making sure all configs are used correctly

[jira] [Updated] (TEZ-3734) Remove config checks in Input/Output.

2017-05-24 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3734: --- Attachment: TEZ-3734.01.patch Removed all the config whitelisting from the Input and Output clas

[jira] [Updated] (TEZ-3734) Remove config checks in Input/Output.

2017-05-23 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3734: --- Description: The configs in TezRuntimeConfiguration are not propagated if its not in Input/Outpu

[jira] [Updated] (TEZ-3734) Remove config checks in Input/Output.

2017-05-23 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3734: --- Summary: Remove config checks in Input/Output. (was: Add TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWR

[jira] [Created] (TEZ-3734) Add TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWRITER_BUFFER_MERGE_PERCENT to UnorderedKVInput.

2017-05-22 Thread Harish Jaiprakash (JIRA)
Harish Jaiprakash created TEZ-3734: -- Summary: Add TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWRITER_BUFFER_MERGE_PERCENT to UnorderedKVInput. Key: TEZ-3734 URL: https://issues.apache.org/jira/browse/TEZ-3734

[jira] [Commented] (TEZ-3007) Use AppFinalState.ENDED when unregistering with the RM in session mode

2017-05-22 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019661#comment-16019661 ] Harish Jaiprakash commented on TEZ-3007: Test case failure is unrelated. > Use AppF

[jira] [Updated] (TEZ-3691) Setup fetchers to use shared executor.

2017-05-22 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Attachment: TEZ-3691.08.patch Adding config to Ordered and Unordered GroupedKVInput whitelists.

[jira] [Commented] (TEZ-3617) TestHistoryParser#testParserWithSuccessfulJob fails intermittently

2017-05-21 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019201#comment-16019201 ] Harish Jaiprakash commented on TEZ-3617: Hi [~skanekar], tried looking at this issue

[jira] [Commented] (TEZ-3701) UnorderedPartitionedKVWriter - issues with parallel Deflater usage, synchronousqueue in threadpool

2017-05-17 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16015210#comment-16015210 ] Harish Jaiprakash commented on TEZ-3701: Thanks [~rajesh.balamohan]. +1 for the chan

[jira] [Commented] (TEZ-3701) UnorderedPartitionedKVWriter - issues with parallel Deflater usage, synchronousqueue in threadpool

2017-05-17 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013767#comment-16013767 ] Harish Jaiprakash commented on TEZ-3701: Thanks [~rajesh.balamohan]. There is a rac

[jira] [Updated] (TEZ-3007) Use AppFinalState.ENDED when unregistering with the RM in session mode

2017-05-16 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3007: --- Attachment: TEZ-3007.03.patch Adding copyright to the new test file. > Use AppFinalState.ENDED

[jira] [Updated] (TEZ-3691) Setup fetchers to use shared executor.

2017-05-15 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Attachment: TEZ-3691.07.patch Fixed test case failure. > Setup fetchers to use shared executor.

[jira] [Updated] (TEZ-3007) Use AppFinalState.ENDED when unregistering with the RM in session mode

2017-05-15 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3007: --- Attachment: TEZ-3007.02.patch Thanks [~sseth] * Addressed comments. * Adding a test case. > Use

[jira] [Commented] (TEZ-3714) Tez UI: Hive Queries page: Use Dag ID and App ID if they are published form Hive side.

2017-05-12 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007849#comment-16007849 ] Harish Jaiprakash commented on TEZ-3714: +1, Thanks [~Sreenath]. > Tez UI: Hive Qu

[jira] [Updated] (TEZ-3717) tez-yarn-timeline-history-with-fs does not build with hadoop-2.8.

2017-05-09 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3717: --- Summary: tez-yarn-timeline-history-with-fs does not build with hadoop-2.8. (was: Master does no

[jira] [Commented] (TEZ-3717) Master does not compile with -Phadoop28.

2017-05-09 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003895#comment-16003895 ] Harish Jaiprakash commented on TEZ-3717: Thanks [~sseth]. Sorry for the duplicate bu

[jira] [Updated] (TEZ-3691) Setup fetchers to use shared executor.

2017-05-09 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Attachment: TEZ-3691.06.patch Created a config enable and disable shared thread pools for fetche

[jira] [Updated] (TEZ-3007) Use AppFinalState.ENDED when unregistering with the RM in session mode

2017-05-09 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3007: --- Attachment: TEZ-3007.01.patch Adding a new method in hadoop shim to fix the computed state. > U

[jira] [Updated] (TEZ-3717) Master does not compile with -Phadoop28.

2017-05-09 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3717: --- Attachment: TEZ-3717.01.patch Adding hdfs-client as explicit test dependency for tez-yarn-timel

[jira] [Created] (TEZ-3717) Master does not compile with -Phadoop28.

2017-05-09 Thread Harish Jaiprakash (JIRA)
Harish Jaiprakash created TEZ-3717: -- Summary: Master does not compile with -Phadoop28. Key: TEZ-3717 URL: https://issues.apache.org/jira/browse/TEZ-3717 Project: Apache Tez Issue Type: Bug

[jira] [Resolved] (TEZ-3247) Tez does not compile against hadoop-trunk

2017-05-05 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash resolved TEZ-3247. Resolution: Duplicate All hadoop-3.0 migration issues are tracked by jira: TEZ-3252. > Tez do

[jira] [Commented] (TEZ-3691) Setup fetchers to use shared executor.

2017-05-04 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997703#comment-15997703 ] Harish Jaiprakash commented on TEZ-3691: I did realize that, but I thought we'll hav

[jira] [Commented] (TEZ-3007) Use AppFinalState.ENDED when unregistering with the RM in session mode

2017-05-04 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996461#comment-15996461 ] Harish Jaiprakash commented on TEZ-3007: The state ENDED is not available in hadoop

[jira] [Assigned] (TEZ-3007) Use AppFinalState.ENDED when unregistering with the RM in session mode

2017-05-04 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash reassigned TEZ-3007: -- Assignee: Harish Jaiprakash > Use AppFinalState.ENDED when unregistering with the RM in s

[jira] [Updated] (TEZ-3691) Setup fetchers to use shared executor.

2017-05-04 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Attachment: TEZ-3691.05.patch Fixed test case failure. > Setup fetchers to use shared executor.

[jira] [Updated] (TEZ-3673) Allocate smaller buffers in UnorderedPartitionedKVWriter

2017-05-03 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3673: --- Attachment: TEZ-3673.05.patch Using remaining memory as last buffer when leftover size > 50% of

[jira] [Updated] (TEZ-3691) Setup fetchers to use shared executor.

2017-05-03 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Attachment: TEZ-3691.04.patch Fixed merge conflicts - rebased to master. > Setup fetchers to us

[jira] [Updated] (TEZ-3691) Setup fetchers to use shared executor.

2017-05-03 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Attachment: TEZ-3691.03.patch * Adding configuration to enable use of shared executor service. *

[jira] [Updated] (TEZ-3691) Setup fetchers to use shared executor.

2017-05-03 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Summary: Setup fetchers to use shared executor. (was: Move ShuffleScheduler to use the framewor

[jira] [Updated] (TEZ-3691) Setup fetchers to use shared executor.

2017-05-03 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Description: Change fetchers in ShuffleScheduler & ShuffleManger to use the shared executor serv

[jira] [Commented] (TEZ-3673) Allocate smaller buffers in UnorderedPartitionedKVWriter

2017-05-03 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996124#comment-15996124 ] Harish Jaiprakash commented on TEZ-3673: I did this because if we are going to use r

[jira] [Commented] (TEZ-3707) TezSharedExecutor race condition in awaitTermination vs isTerminated.

2017-05-02 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992574#comment-15992574 ] Harish Jaiprakash commented on TEZ-3707: Test case failures unrelated to this patch.

[jira] [Updated] (TEZ-3691) Move ShuffleScheduler to use the framework ExecutorService.

2017-05-02 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Attachment: TEZ-3691.02.patch Fixed test case failures. > Move ShuffleScheduler to use the fram

[jira] [Assigned] (TEZ-3691) Move ShuffleScheduler to use the framework ExecutorService.

2017-05-01 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash reassigned TEZ-3691: -- Assignee: Harish Jaiprakash > Move ShuffleScheduler to use the framework ExecutorService.

[jira] [Updated] (TEZ-3691) Move ShuffleScheduler to use the framework ExecutorService.

2017-05-01 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Attachment: TEZ-3691.01.patch Moved ShuffleScheduler to use shared executor service. > Move Shu

[jira] [Updated] (TEZ-3691) Move ShuffleScheduler to use the framework ExecutorService.

2017-05-01 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Description: Change ShuffleScheduler to use the shard executor service, so that threads can be s

[jira] [Updated] (TEZ-3691) Move ShuffleScheduler to use the framework ExecutorService.

2017-05-01 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3691: --- Summary: Move ShuffleScheduler to use the framework ExecutorService. (was: Move pipelined sorte

[jira] [Comment Edited] (TEZ-3673) Allocate smaller buffers in UnorderedPartitionedKVWriter

2017-05-01 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991949#comment-15991949 ] Harish Jaiprakash edited comment on TEZ-3673 at 5/2/17 6:41 AM: --

[jira] [Commented] (TEZ-3700) Consumer attempt should kill itself instead of failing during validation checks with final merge avoidance

2017-05-01 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992369#comment-15992369 ] Harish Jaiprakash commented on TEZ-3700: Thanks [~rajesh.balamohan]. +1 for the patc

[jira] [Updated] (TEZ-3707) TezSharedExecutor race condition in awaitTermination vs isTerminated.

2017-05-01 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3707: --- Attachment: TEZ-3707.01.patch Fixed isTerminated to check if pending futures are already done. N

  1   2   3   4   >