[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565360#comment-14565360 ] Zhijie Shen commented on YARN-1462: --- Sigh, sorry for raising one more issue after saying

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565368#comment-14565368 ] Zhijie Shen commented on YARN-1462: --- RM publishes the tags information to the timeline se

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14566095#comment-14566095 ] Zhijie Shen commented on YARN-1462: --- If there's no more concern, I'll commit the patch to

[jira] [Created] (YARN-3751) TestAHSWebServices fails after YARN-3467

Zhijie Shen created YARN-3751: - Summary: TestAHSWebServices fails after YARN-3467 Key: YARN-3751 URL: https://issues.apache.org/jira/browse/YARN-3751 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-3751) TestAHSWebServices fails after YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14566383#comment-14566383 ] Zhijie Shen commented on YARN-3751: --- Link YARN-3467 /cc [~adhoot] > TestAHSWebServices f

[jira] [Updated] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2900: -- Attachment: YARN-2900-branch-2.7.20150530.patch YARN-2900.20150530.patch [~xgong], I just

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568433#comment-14568433 ] Zhijie Shen commented on YARN-1462: --- bq. This commit changes newInstance API, breaking Te

[jira] [Created] (YARN-3761) Set delegation token service address at the server side

Zhijie Shen created YARN-3761: - Summary: Set delegation token service address at the server side Key: YARN-3761 URL: https://issues.apache.org/jira/browse/YARN-3761 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-3725) App submission via REST API is broken in secure mode due to Timeline DT service address is empty

[ https://issues.apache.org/jira/browse/YARN-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570007#comment-14570007 ] Zhijie Shen commented on YARN-3725: --- bq. is there a JIRA for the longer term fix? Yeah,

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570171#comment-14570171 ] Zhijie Shen commented on YARN-3044: --- [~Naganarasimha], I'm fine with the last patch. Will

[jira] [Commented] (YARN-3751) TestAHSWebServices fails after YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571481#comment-14571481 ] Zhijie Shen commented on YARN-3751: --- +1 LGTM No more test case is required, while the ex

[jira] [Updated] (YARN-3276) Refactor and fix null casting in some map cast for TimelineEntity (old and new) and fix findbug warnings

[ https://issues.apache.org/jira/browse/YARN-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3276: -- Attachment: YARN-3276-YARN-2928.v6.patch +1 for the last patch. Rebase it against the latest branch. Will

[jira] [Reopened] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reopened YARN-1462: --- Per discussion offline with Sid, my proposal is: 1.Revert the current commit, create and commit a new patc

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571623#comment-14571623 ] Zhijie Shen commented on YARN-1942: --- It seems that we have more than ConverterUtils that

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571669#comment-14571669 ] Zhijie Shen commented on YARN-1462: --- Reverted. > AHS API and other AHS changes to handle

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571732#comment-14571732 ] Zhijie Shen commented on YARN-3044: --- [~Naganarasimha], thanks for updating the patch. It

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571755#comment-14571755 ] Zhijie Shen commented on YARN-1942: --- [~sershe], would you please comment? > Many of Conv

[jira] [Updated] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1462: -- Target Version/s: 2.8.0 (was: 2.7.1) > AHS API and other AHS changes to handle tags for completed MR job

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14572116#comment-14572116 ] Zhijie Shen commented on YARN-1462: --- +1 for the last patch. The change in ApplicationRepo

[jira] [Updated] (YARN-2513) Host framework UIs in YARN for use with the ATS

[ https://issues.apache.org/jira/browse/YARN-2513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2513: -- Target Version/s: 2.8.0 > Host framework UIs in YARN for use with the ATS > -

[jira] [Commented] (YARN-2513) Host framework UIs in YARN for use with the ATS

[ https://issues.apache.org/jira/browse/YARN-2513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14573288#comment-14573288 ] Zhijie Shen commented on YARN-2513: --- As it's valuable to some existing ATS use case, let'

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14573515#comment-14573515 ] Zhijie Shen commented on YARN-3044: --- I'm not sure because as far as I can tell, NM's impl

[jira] [Commented] (YARN-3766) ATS Web UI breaks because of YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14573633#comment-14573633 ] Zhijie Shen commented on YARN-3766: --- Patch looks good. Tried it locally and the web UI ha

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14573830#comment-14573830 ] Zhijie Shen commented on YARN-3051: --- [~varun_saxena], thanks for working on the new patch

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14577527#comment-14577527 ] Zhijie Shen commented on YARN-3779: --- So the problem is after refreshing, the deletion tas

[jira] [Commented] (YARN-3787) loading applications by filtering appstartedTime period for ATS Web UI

[ https://issues.apache.org/jira/browse/YARN-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14577624#comment-14577624 ] Zhijie Shen commented on YARN-3787: --- The patch looks good to me overall. Some comments:

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14577709#comment-14577709 ] Zhijie Shen commented on YARN-3779: --- No, I didn't simulate the problem. Just have a quick

[jira] [Commented] (YARN-3787) loading applications by filtering appstartedTime period for ATS Web UI

[ https://issues.apache.org/jira/browse/YARN-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14578385#comment-14578385 ] Zhijie Shen commented on YARN-3787: --- +1, will commit the patch > loading applications b

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584034#comment-14584034 ] Zhijie Shen commented on YARN-3044: --- [~Naganarasimha], thanks for fixing the race, but T

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584148#comment-14584148 ] Zhijie Shen commented on YARN-3051: --- bq. APIs' for querying individual entity/flow/flow r

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584189#comment-14584189 ] Zhijie Shen commented on YARN-3044: --- Interesting. Is it an intermittent test failure? I c

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584763#comment-14584763 ] Zhijie Shen commented on YARN-3044: --- Thanks, will commit the patch. bq. Probably you a

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587165#comment-14587165 ] Zhijie Shen commented on YARN-3779: --- [~varun_saxena], do you know why ugi is still the sa

[jira] [Commented] (YARN-3801) [JDK-8][YARN-2928] Exclude jdk.tools from hbase-client and hbase-testing-util

[ https://issues.apache.org/jira/browse/YARN-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587424#comment-14587424 ] Zhijie Shen commented on YARN-3801: --- +1, we'd better fix Java 8 issues before merging bra

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589287#comment-14589287 ] Zhijie Shen commented on YARN-3706: --- I didn't check the patch details, but according to t

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14590133#comment-14590133 ] Zhijie Shen commented on YARN-3051: --- [~sjlee0], thanks for your chiming in. Varun, Li and

[jira] [Created] (YARN-3822) Scalability validation of RM writing app/attempt/container lifecycle events

Zhijie Shen created YARN-3822: - Summary: Scalability validation of RM writing app/attempt/container lifecycle events Key: YARN-3822 URL: https://issues.apache.org/jira/browse/YARN-3822 Project: Hadoop YAR

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592536#comment-14592536 ] Zhijie Shen commented on YARN-3051: --- bq. Agreed with the approach. I would go so far as f

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API.patch > [Storage abstraction] Create backing storage read interface for

[jira] [Commented] (YARN-3828) Add a flag in container to indicate whether it's an AM container or not

[ https://issues.apache.org/jira/browse/YARN-3828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592596#comment-14592596 ] Zhijie Shen commented on YARN-3828: --- It seems to be duplicate with YARN-3116 > Add a fla

[jira] [Comment Edited] (YARN-3828) Add a flag in container to indicate whether it's an AM container or not

[ https://issues.apache.org/jira/browse/YARN-3828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592596#comment-14592596 ] Zhijie Shen edited comment on YARN-3828 at 6/18/15 9:48 PM: It

[jira] [Commented] (YARN-3828) Add a flag in container to indicate whether it's an AM container or not

[ https://issues.apache.org/jira/browse/YARN-3828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592622#comment-14592622 ] Zhijie Shen commented on YARN-3828: --- Sure, please go ahead. I can help to review the patc

[jira] [Resolved] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-3116. --- Resolution: Duplicate Close this jira as the duplicate of YARN-3828, whether the contributor has alrea

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592737#comment-14592737 ] Zhijie Shen commented on YARN-3779: --- Thanks for helping the issue, Vinod! It sounds the r

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_1.patch > [Storage abstraction] Create backing storage read interface fo

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593627#comment-14593627 ] Zhijie Shen commented on YARN-3051: --- First of all, I'd like to say it's not the finalized

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593944#comment-14593944 ] Zhijie Shen commented on YARN-3116: --- [~giovanni.fumarola], thanks for the patch. Two quic

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594029#comment-14594029 ] Zhijie Shen commented on YARN-3051: --- Thanks for chiming in, Jeop! Here's my reply: bq. I

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_2.patch > [Storage abstraction] Create backing storage read interface fo

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594098#comment-14594098 ] Zhijie Shen commented on YARN-3051: --- Yeah, I meant to be AND logic for these parameters.

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_3.patch Add more explanation according Joep's comment. Will do some inve

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594209#comment-14594209 ] Zhijie Shen commented on YARN-3051: --- Good catch! I reverted it back to map. Set is the le

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3051: -- Attachment: YARN-3051.Reader_API_4.patch > [Storage abstraction] Create backing storage read interface fo

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594249#comment-14594249 ] Zhijie Shen commented on YARN-3051: --- And if we process a bulk configs such as loading a c

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594410#comment-14594410 ] Zhijie Shen commented on YARN-3051: --- [~varun_saxena], would you please take over the read

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606392#comment-14606392 ] Zhijie Shen commented on YARN-3116: --- Sounds good to me. Would you mind taking care of the

[jira] [Updated] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3116: -- Target Version/s: 2.8.0 > [Collector wireup] We need an assured way to determine if a container is an >

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606542#comment-14606542 ] Zhijie Shen commented on YARN-3051: --- Varun, thanks for take over the reader interface pat

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606611#comment-14606611 ] Zhijie Shen commented on YARN-3047: --- 1. We should be able to reuse "TimelineAbout". 2. I

[jira] [Comment Edited] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606611#comment-14606611 ] Zhijie Shen edited comment on YARN-3047 at 6/29/15 11:01 PM: - 1

[jira] [Commented] (YARN-3841) [Storage implementation] Create HDFS backing storage implementation for ATS writes

[ https://issues.apache.org/jira/browse/YARN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606645#comment-14606645 ] Zhijie Shen commented on YARN-3841: --- We have FS implementation, but it uses java File api

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14608744#comment-14608744 ] Zhijie Shen commented on YARN-3116: --- [~subru] and [~giovanni.fumarola], in yesterdays off

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14608774#comment-14608774 ] Zhijie Shen commented on YARN-3051: --- bq. One more thing I have changed is limit of entiti

[jira] [Commented] (YARN-3823) Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores property

[ https://issues.apache.org/jira/browse/YARN-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14608811#comment-14608811 ] Zhijie Shen commented on YARN-3823: --- Hm... I think we forgot changing the default in the

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609377#comment-14609377 ] Zhijie Shen commented on YARN-3116: --- In fact jenkins complains much fewer checkstyle issu

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611081#comment-14611081 ] Zhijie Shen commented on YARN-3116: --- Looks good to me overall. Two nits: 1. I thought it

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611156#comment-14611156 ] Zhijie Shen commented on YARN-3051: --- [~varun_saxena], thanks for being patient about the

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14611445#comment-14611445 ] Zhijie Shen commented on YARN-3116: --- 1. I think normal execution won't have null attempt,

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612113#comment-14612113 ] Zhijie Shen commented on YARN-3051: --- 2. I meant we store in a CSV file. Thoughts? 3. I

[jira] [Created] (YARN-3880) Writing more RM side app-level metrics

Zhijie Shen created YARN-3880: - Summary: Writing more RM side app-level metrics Key: YARN-3880 URL: https://issues.apache.org/jira/browse/YARN-3880 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-3881) Writing RM cluster-level metrics

Zhijie Shen created YARN-3881: - Summary: Writing RM cluster-level metrics Key: YARN-3881 URL: https://issues.apache.org/jira/browse/YARN-3881 Project: Hadoop YARN Issue Type: Sub-task C

[jira] [Updated] (YARN-3881) Writing RM cluster-level metrics

[ https://issues.apache.org/jira/browse/YARN-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3881: -- Attachment: metrics.json > Writing RM cluster-level metrics > > >

[jira] [Commented] (YARN-3881) Writing RM cluster-level metrics

[ https://issues.apache.org/jira/browse/YARN-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612429#comment-14612429 ] Zhijie Shen commented on YARN-3881: --- IMHO, we need to add an addition API to direct write

[jira] [Commented] (YARN-3881) Writing RM cluster-level metrics

[ https://issues.apache.org/jira/browse/YARN-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612638#comment-14612638 ] Zhijie Shen commented on YARN-3881: --- Once the metrics are ready, we can build YARN/timeli

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615387#comment-14615387 ] Zhijie Shen commented on YARN-3051: --- How about we using common csv lib to handle the look

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615747#comment-14615747 ] Zhijie Shen commented on YARN-3051: --- Hi Varun, thanks for updating the patch. I have only

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615792#comment-14615792 ] Zhijie Shen commented on YARN-3051: --- bq. The current FS implementation had cluster as par

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615839#comment-14615839 ] Zhijie Shen commented on YARN-3051: --- Okay, then it seems to be fine. I didn't notice it's

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615930#comment-14615930 ] Zhijie Shen commented on YARN-3051: --- Will commit the patch late today if no more comments

[jira] [Updated] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3047: -- Labels: (was: BB2015-05-TBR) > [Data Serving] Set up ATS reader with basic request serving structure an

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616031#comment-14616031 ] Zhijie Shen commented on YARN-3047: --- YARN-3051 has been committed. Would you please updat

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14617307#comment-14617307 ] Zhijie Shen commented on YARN-3047: --- Would you please hold a while? I plan to take a look

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14617553#comment-14617553 ] Zhijie Shen commented on YARN-3047: --- It looks good to me overall, exception the config. P

[jira] [Updated] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3116: -- Attachment: YARN-3116.v6.patch Fixed the test failure in the new patch. Otherwise, the previous patch loo

[jira] [Updated] (YARN-3049) [Storage Implementation] Implement the storage reader interface to fetch raw data

[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3049: -- Summary: [Storage Implementation] Implement the storage reader interface to fetch raw data (was: [Compat

[jira] [Updated] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3049: -- Summary: [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619347#comment-14619347 ] Zhijie Shen commented on YARN-3049: --- Updated the title accordingly to describe the scope

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619440#comment-14619440 ] Zhijie Shen commented on YARN-3047: --- Thanks for kicking another jenkins build. IAC, the p

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619518#comment-14619518 ] Zhijie Shen commented on YARN-3116: --- Is TestAppRunnability failure related to this patch?

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619564#comment-14619564 ] Zhijie Shen commented on YARN-3116: --- Xuan, thanks for your comment. I think this is a goo

[jira] [Updated] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3116: -- Attachment: YARN-3116.v8.patch Fixed TestAppRunnability as well in the new patch. > [Collector wireup] W

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619729#comment-14619729 ] Zhijie Shen commented on YARN-3836: --- bq. I see that we're implementing the Comparable int

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619759#comment-14619759 ] Zhijie Shen commented on YARN-3901: --- [~vrushalic], just want to confirm with you that the

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621034#comment-14621034 ] Zhijie Shen commented on YARN-3116: --- [~kkaranasos], thanks for notifying us of YARN-2882.

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621051#comment-14621051 ] Zhijie Shen commented on YARN-3901: --- Yeah, I have dependency on this table for reader. If

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621209#comment-14621209 ] Zhijie Shen commented on YARN-3836: --- bq. l.550: It sounds like now the type takes precede

[jira] [Created] (YARN-3908) Bugs in HBaseTimelineWriterImpl

Zhijie Shen created YARN-3908: - Summary: Bugs in HBaseTimelineWriterImpl Key: YARN-3908 URL: https://issues.apache.org/jira/browse/YARN-3908 Project: Hadoop YARN Issue Type: Bug Compone

[jira] [Updated] (YARN-3908) Bugs in HBaseTimelineWriterImpl

[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3908: -- Issue Type: Sub-task (was: Bug) Parent: YARN-2928 > Bugs in HBaseTimelineWriterImpl > --

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621480#comment-14621480 ] Zhijie Shen commented on YARN-3908: --- Assign it to [~vrushalic] by default. Please feel fr

[jira] [Comment Edited] (YARN-3908) Bugs in HBaseTimelineWriterImpl

[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621480#comment-14621480 ] Zhijie Shen edited comment on YARN-3908 at 7/10/15 12:23 AM: - I

<    1   2   3   4   5   6   7   8   9   10   >