[jira] [Comment Edited] (TEZ-1909) Remove need to copy over all events from attempt 1 to attempt 2 dir

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366825#comment-14366825 ] Jeff Zhang edited comment on TEZ-1909 at 3/18/15 8:37 AM: -- Attach

[jira] [Updated] (TEZ-1909) Remove need to copy over all events from attempt 1 to attempt 2 dir

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1909: Attachment: TEZ-1909-3.patch Remove need to copy over all events from attempt 1 to attempt 2 dir

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366878#comment-14366878 ] Jeff Zhang commented on TEZ-714: [~bikassaha] I think the biggest issue in my patch is the

[jira] [Commented] (TEZ-1909) Remove need to copy over all events from attempt 1 to attempt 2 dir

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366825#comment-14366825 ] Jeff Zhang commented on TEZ-1909: - Attach the new patch to address the review comment. Apart

[jira] [Updated] (TEZ-2137) Add task counter to understand sorter final merge time

2015-03-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2137: -- Attachment: TEZ-2137.2.patch Revising the patch post TEZ-2001. Added the following counters

[jira] [Resolved] (TEZ-1529) ATS and TezClient integration in secure kerberos enabled cluster

2015-03-18 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran resolved TEZ-1529. --- Resolution: Not a Problem Closing as this has been tested. ATS and TezClient

[jira] [Comment Edited] (TEZ-1923) FetcherOrderedGrouped gets into infinite loop due to memory pressure

2015-03-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367428#comment-14367428 ] Hitesh Shah edited comment on TEZ-1923 at 3/18/15 4:42 PM: --- Is

[jira] [Commented] (TEZ-1923) FetcherOrderedGrouped gets into infinite loop due to memory pressure

2015-03-18 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367463#comment-14367463 ] Jonathan Eagles commented on TEZ-1923: -- This will be a good fix for 0.6.1

[jira] [Commented] (TEZ-2159) Tez UI: download timeline data for offline use.

2015-03-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367312#comment-14367312 ] Rajesh Balamohan commented on TEZ-2159: --- Thanks [~pramachandran]. Tried out the patch

[jira] [Commented] (TEZ-1923) FetcherOrderedGrouped gets into infinite loop due to memory pressure

2015-03-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367428#comment-14367428 ] Hitesh Shah commented on TEZ-1923: -- Is this something that needs to be backported to 0.5

[jira] [Issue Comment Deleted] (TEZ-1175) Support Kafka Input and Output in Tez

2015-03-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1175: Comment: was deleted (was: Any updates on this?) Support Kafka Input and Output in Tez

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367542#comment-14367542 ] Bikas Saha commented on TEZ-714: I understand that. What I expected was code changes around

[jira] [Comment Edited] (TEZ-1175) Support Kafka Input and Output in Tez

2015-03-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052774#comment-14052774 ] Bikas Saha edited comment on TEZ-1175 at 3/18/15 5:46 PM: -- Any

[jira] [Updated] (TEZ-1175) Support Kafka Input and Output in Tez

2015-03-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1175: Labels: gsoc gsoc2015 hadoop java tez (was: gsoc gsoc2015) Support Kafka Input and Output in Tez

[jira] [Updated] (TEZ-1175) Support Kafka Input and Output in Tez

2015-03-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1175: Labels: gsoc gsoc2015 (was: ) Support Kafka Input and Output in Tez -

[jira] [Commented] (TEZ-2205) Tez still tries to post to ATS when yarn.timeline-service.enabled=false

2015-03-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367561#comment-14367561 ] Hitesh Shah commented on TEZ-2205: -- Added a comment on YARN-2375. Let us see what happens

[jira] [Updated] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-18 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-145: --- Attachment: TEZ-145.2.patch Fix warnings by findbugs. Support a combiner processor that can run

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367849#comment-14367849 ] Bikas Saha commented on TEZ-145: I know what you are talking about but let me restate to

Success: TEZ-145 PreCommit Build #310

2015-03-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-145 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/310/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Created] (TEZ-2208) Counter of REDUCE_INPUT_GROUPS is incorrect

2015-03-18 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2208: --- Summary: Counter of REDUCE_INPUT_GROUPS is incorrect Key: TEZ-2208 URL: https://issues.apache.org/jira/browse/TEZ-2208 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-2208) Counter of REDUCE_INPUT_GROUPS is incorrect

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2208: Attachment: Counter of REDUCE_INPUT_GROUPS.png Counter of REDUCE_INPUT_GROUPS is incorrect

[jira] [Comment Edited] (TEZ-2204) TestAMRecovery increasingly flaky on jenkins builds.

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14368377#comment-14368377 ] Jeff Zhang edited comment on TEZ-2204 at 3/19/15 2:23 AM: --

[jira] [Comment Edited] (TEZ-2204) TestAMRecovery increasingly flaky on jenkins builds.

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14368377#comment-14368377 ] Jeff Zhang edited comment on TEZ-2204 at 3/19/15 2:23 AM: --

[jira] [Commented] (TEZ-2204) TestAMRecovery increasingly flaky on jenkins builds.

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14368377#comment-14368377 ] Jeff Zhang commented on TEZ-2204: - It is may be an issue related to YARN-2917. Because tez

[jira] [Commented] (TEZ-2196) Consider reusing UnorderedPartitionedKVWriter with single output in UnorderedKVOutput

2015-03-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14368455#comment-14368455 ] Rajesh Balamohan commented on TEZ-2196: --- [~sseth] - Removed

[jira] [Commented] (TEZ-2205) Tez still tries to post to ATS when yarn.timeline-service.enabled=false

2015-03-18 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367518#comment-14367518 ] Chang Li commented on TEZ-2205: --- Thanks for clarification [~jeagles]. [~hitesh] which way

[jira] [Updated] (TEZ-1175) Support Kafka Input and Output in Tez

2015-03-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1175: Description: Tez has an interface to integrate various input and output types into Tez. This makes jobs

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367685#comment-14367685 ] Hadoop QA commented on TEZ-145: --- {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (TEZ-2137) Add task counter to understand sorter final merge time

2015-03-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367764#comment-14367764 ] Hitesh Shah commented on TEZ-2137: -- At this point, these counters are only useful at a task

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367813#comment-14367813 ] Gopal V commented on TEZ-145: - This is a question for [~bikassaha]. There is an combiner edge

[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

2015-03-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367762#comment-14367762 ] Gopal V commented on TEZ-145: - [~ozawa]: the CombineProcessor patch looks good. This will help

[jira] [Commented] (TEZ-160) Remove 5 second sleep at the end of AM completion.

2015-03-18 Thread JIRA
[ https://issues.apache.org/jira/browse/TEZ-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367980#comment-14367980 ] André Kelpe commented on TEZ-160: - They are independent apps, so the shutdown happens after

[jira] [Updated] (TEZ-2207) TEZ-UI Highlight the selected row in Counter view

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2207: Summary: TEZ-UI Highlight the selected row in Counter view (was: TEZ-Ui Highlight the selected row in

[jira] [Updated] (TEZ-2207) TEZ-Ui Highlight the selected row in Counter view

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2207: Issue Type: Improvement (was: Bug) TEZ-Ui Highlight the selected row in Counter view

[jira] [Created] (TEZ-2207) TEZ-Ui Highlight the selected row in Counter view

2015-03-18 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2207: --- Summary: TEZ-Ui Highlight the selected row in Counter view Key: TEZ-2207 URL: https://issues.apache.org/jira/browse/TEZ-2207 Project: Apache Tez Issue Type: Bug