[jira] [Commented] (YARN-451) Add more metrics to RM page

[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709420#comment-13709420 ] Joep Rottinghuis commented on YARN-451: --- It would certainly be very useful to be able

[jira] [Updated] (YARN-1190) enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

[ https://issues.apache.org/jira/browse/YARN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-1190: --- Affects Version/s: 2.1.1-beta enabling uber mde with 0 reducer still requires

[jira] [Updated] (YARN-1190) enabling uber mode with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

[ https://issues.apache.org/jira/browse/YARN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-1190: --- Summary: enabling uber mode with 0 reducer still requires mapreduce.reduce.memory.mb to be

[jira] [Commented] (YARN-1190) enabling uber mode with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

[ https://issues.apache.org/jira/browse/YARN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13769046#comment-13769046 ] Joep Rottinghuis commented on YARN-1190: This may have to be moved to the MAPREDUCE

[jira] [Updated] (YARN-451) Add more metrics to RM page

[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-451: -- Priority: Blocker (was: Minor) Add more metrics to RM page ---

[jira] [Commented] (YARN-451) Add more metrics to RM page

[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13770060#comment-13770060 ] Joep Rottinghuis commented on YARN-451: --- Marking as blocker. W/o a sense of size

[jira] [Updated] (YARN-305) Too many 'Node offerred to app:... messages in RM

[ https://issues.apache.org/jira/browse/YARN-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-305: -- Priority: Critical (was: Minor) Too many 'Node offerred to app:... messages in RM

[jira] [Commented] (YARN-305) Too many 'Node offerred to app:... messages in RM

[ https://issues.apache.org/jira/browse/YARN-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13770065#comment-13770065 ] Joep Rottinghuis commented on YARN-305: --- Marking as critical. W/o this patch the RM

[jira] [Commented] (YARN-290) Wrong cluster metrics on RM page with FairScheduler

[ https://issues.apache.org/jira/browse/YARN-290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13770070#comment-13770070 ] Joep Rottinghuis commented on YARN-290: --- [~vinodkv] yes, we'll resolve as dup of

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13770049#comment-13770049 ] Joep Rottinghuis commented on YARN-1044: Marking critical. W/o this fix, the

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-1044: --- Priority: Critical (was: Minor) used/min/max resources do not display info in the

[jira] [Commented] (YARN-1130) Improve the log flushing for tasks when mapred.userlog.limit.kb is set

[ https://issues.apache.org/jira/browse/YARN-1130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13770099#comment-13770099 ] Joep Rottinghuis commented on YARN-1130: Could anybody else review this please ?

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13772015#comment-13772015 ] Joep Rottinghuis commented on YARN-1221: Sandy, we're seeing the same. At some

[jira] [Commented] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

[ https://issues.apache.org/jira/browse/YARN-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155638#comment-14155638 ] Joep Rottinghuis commented on YARN-1414: @sandyr could we get some love on this

[jira] [Commented] (YARN-451) Add more metrics to RM page

[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13794737#comment-13794737 ] Joep Rottinghuis commented on YARN-451: --- [~jlowe] current allocation can be seen from

[jira] [Commented] (YARN-1336) Work-preserving nodemanager restart

[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804820#comment-13804820 ] Joep Rottinghuis commented on YARN-1336: We're finding the same during our cluster

[jira] [Commented] (YARN-546) mapred.fairscheduler.eventlog.enabled removed from Hadoop 2.0

[ https://issues.apache.org/jira/browse/YARN-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13810565#comment-13810565 ] Joep Rottinghuis commented on YARN-546: --- [~sandyr] didn't you mention that you fixed

[jira] [Commented] (YARN-3041) [Data Model] create overall data objects of TS next gen

[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326178#comment-14326178 ] Joep Rottinghuis commented on YARN-3041: Agreed with [~sjlee0] that we should use

[jira] [Commented] (YARN-3041) [Data Model] create overall data objects of TS next gen

[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326183#comment-14326183 ] Joep Rottinghuis commented on YARN-3041: Some additional throughs: If we have the

[jira] [Commented] (YARN-3041) [Data Model] create overall data objects of TS next gen

[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326185#comment-14326185 ] Joep Rottinghuis commented on YARN-3041: I think version may have to be something

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544692#comment-14544692 ] Joep Rottinghuis commented on YARN-3411: Ok, admitted that I have not yet read

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391554#comment-14391554 ] Joep Rottinghuis commented on YARN-3391: Whether the app_id needs to be part of the

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3726-YARN-2928.004.patch YARN-3726-YARN-2928.004.patch : - fixed bug in

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3726-YARN-2928.005.patch Uploading YARN-3726-YARN-2928.005.patch Added

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3706-YARN-2928.011.patch YARN-3706-YARN-2928.011.patch : Fixed a few of the

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3706-YARN-2928.010.patch Thanks for your feedback [~sjlee0] Latest patch

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575025#comment-14575025 ] Joep Rottinghuis commented on YARN-3706: Oops, I introduced an infinite loop:

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3726-YARN-2928.006.patch Added YARN-3726-YARN-2928.006.patch Thanks for

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3726-YARN-2928.007.patch YARN-3726-YARN-2928.007.patch : Renamed ColumnImpl

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572000#comment-14572000 ] Joep Rottinghuis commented on YARN-3706: It turns out that the

[jira] [Commented] (YARN-3699) Decide if flow version should be part of row key or column

[ https://issues.apache.org/jira/browse/YARN-3699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576126#comment-14576126 ] Joep Rottinghuis commented on YARN-3699: +1 Decide if flow version should be

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3726-YARN-2928.009.patch YARN-3726-YARN-2928.009.patch Attempt to fix

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3726-YARN-2928.008.patch YARN-3726-YARN-2928.008.patch : Fixed spaces,

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575858#comment-14575858 ] Joep Rottinghuis commented on YARN-3706: I'll fix the JavaDoc warnings later today.

[jira] [Commented] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593890#comment-14593890 ] Joep Rottinghuis commented on YARN-3815: For flow-level aggregates I'll separately

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594080#comment-14594080 ] Joep Rottinghuis commented on YARN-3051: The same question goes for the items in

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594067#comment-14594067 ] Joep Rottinghuis commented on YARN-3051: Thanks [~zjshen] those additional comments

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594170#comment-14594170 ] Joep Rottinghuis commented on YARN-3051: When discussing with [~sjlee0] we noticed

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594241#comment-14594241 ] Joep Rottinghuis commented on YARN-3051: Can somebody please remind me why

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594413#comment-14594413 ] Joep Rottinghuis commented on YARN-3836: [~vrushalic] when you're tackling

[jira] [Commented] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593867#comment-14593867 ] Joep Rottinghuis commented on YARN-3815: Very much agree with separation into 2

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593826#comment-14593826 ] Joep Rottinghuis commented on YARN-3051: Not all arguments are equally selective.

[jira] [Commented] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598759#comment-14598759 ] Joep Rottinghuis commented on YARN-3815: Thanks [~ted_yu] for that link. I did find

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3706-YARN-2928.014.patch YARN-3706-YARN-2928.014.patch fixes the one FindBugs

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589305#comment-14589305 ] Joep Rottinghuis commented on YARN-3706: Yeah, we can create an entity sub-package

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3706-YARN-2928.015.patch YARN-3706-YARN-2928.015.patch local runs in pseudo

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589255#comment-14589255 ] Joep Rottinghuis commented on YARN-3706: Good call on the testing. Interesting

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589354#comment-14589354 ] Joep Rottinghuis commented on YARN-3706: Fixed code, now have successful run:

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3706-YARN-2928.013.patch Thanks for the review [~sjlee0], all your comments

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586363#comment-14586363 ] Joep Rottinghuis commented on YARN-3706: This patch is ready for review.

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563824#comment-14563824 ] Joep Rottinghuis commented on YARN-3706: Just realized an additional problem. If we

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3726-YARN-2928.002.patch Attaching updated patch. Less hackery in this patch.

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14561391#comment-14561391 ] Joep Rottinghuis commented on YARN-3706: Initially I was stuck on YARN-3721, but I

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3726-YARN-2928.003.patch Moved common classes into common package to separate

[jira] [Commented] (YARN-3726) Fix TestHBaseTimelineWriterImpl unit test failure by fixing it's test data

[ https://issues.apache.org/jira/browse/YARN-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562115#comment-14562115 ] Joep Rottinghuis commented on YARN-3726: +1 applying the patch resolves the unit

[jira] [Commented] (YARN-3726) Fix TestHBaseTimelineWriterImpl unit test failure by fixing it's test data

[ https://issues.apache.org/jira/browse/YARN-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563222#comment-14563222 ] Joep Rottinghuis commented on YARN-3726: Aside from the immediate fix for the unit

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3706-YARN-2928.012.patch YARN-3706-YARN-2928.012.patch : Eliminated FindBugs

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557149#comment-14557149 ] Joep Rottinghuis commented on YARN-3706: [~vrushalic] if we convert column names to

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3706-YARN-2928.001.patch Initial version of patch

[jira] [Commented] (YARN-3699) Decide if flow version should be part of row key or column

[ https://issues.apache.org/jira/browse/YARN-3699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555104#comment-14555104 ] Joep Rottinghuis commented on YARN-3699: The question really seems to be whether

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556277#comment-14556277 ] Joep Rottinghuis commented on YARN-3706: [~sjlee0] I've created this jira and will

[jira] [Created] (YARN-3706) Generalize native HBase writer for additional tables

Joep Rottinghuis created YARN-3706: -- Summary: Generalize native HBase writer for additional tables Key: YARN-3706 URL: https://issues.apache.org/jira/browse/YARN-3706 Project: Hadoop YARN

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556308#comment-14556308 ] Joep Rottinghuis commented on YARN-3706: I've noticed that in

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554595#comment-14554595 ] Joep Rottinghuis commented on YARN-3411: I think it is reasonable that two

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554606#comment-14554606 ] Joep Rottinghuis commented on YARN-3411: With respect to discussion on

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699937#comment-14699937 ] Joep Rottinghuis commented on YARN-3901: It seems that in general in order to get

[jira] [Commented] (YARN-4063) Populate the flow activity table

[ https://issues.apache.org/jira/browse/YARN-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707256#comment-14707256 ] Joep Rottinghuis commented on YARN-4063: Min max should work well. Wondering how

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699804#comment-14699804 ] Joep Rottinghuis commented on YARN-3901: Presumably the storeWithTag method is just

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699795#comment-14699795 ] Joep Rottinghuis commented on YARN-3901: Starting to go through. Just as a note

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700255#comment-14700255 ] Joep Rottinghuis commented on YARN-3901: After discussing with [~vrushalic] we

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700264#comment-14700264 ] Joep Rottinghuis commented on YARN-3901: peekNext also has to deal with limit

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658671#comment-14658671 ] Joep Rottinghuis commented on YARN-3045: Yeah, the discussion thread here seems to

[jira] [Commented] (YARN-3863) Enhance filters in TimelineReader

[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696163#comment-14696163 ] Joep Rottinghuis commented on YARN-3863: [~varun_saxena] in YARN-3862 you refer to

[jira] [Commented] (YARN-3949) ensure timely flush of timeline writes

[ https://issues.apache.org/jira/browse/YARN-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640059#comment-14640059 ] Joep Rottinghuis commented on YARN-3949: I think a simple write and separate flush

[jira] [Commented] (YARN-451) Add more metrics to RM page

[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636358#comment-14636358 ] Joep Rottinghuis commented on YARN-451: --- Just for the record, at Twitter we've been

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636399#comment-14636399 ] Joep Rottinghuis commented on YARN-3908: What does this mean for the

[jira] [Commented] (YARN-445) Ability to signal containers

[ https://issues.apache.org/jira/browse/YARN-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636221#comment-14636221 ] Joep Rottinghuis commented on YARN-445: --- Can we rekindle this discussion? We've had

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636244#comment-14636244 ] Joep Rottinghuis commented on YARN-3176: For the record, we're running with this

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641114#comment-14641114 ] Joep Rottinghuis commented on YARN-3908: It would be good to get the patch for

[jira] [Commented] (YARN-3949) ensure timely flush of timeline writes

[ https://issues.apache.org/jira/browse/YARN-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640959#comment-14640959 ] Joep Rottinghuis commented on YARN-3949: bq. On top of the current patch, how about

[jira] [Commented] (YARN-3949) ensure timely flush of timeline writes

[ https://issues.apache.org/jira/browse/YARN-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641380#comment-14641380 ] Joep Rottinghuis commented on YARN-3949: LGTM. Joep ensure timely flush of

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630275#comment-14630275 ] Joep Rottinghuis commented on YARN-3908: bq. In fact, I'm wondering if we should

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630289#comment-14630289 ] Joep Rottinghuis commented on YARN-3908: Patch looks good with one comment. I

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004550#comment-15004550 ] Joep Rottinghuis commented on YARN-4053: Patch looks good. The converter approach looks nice and

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004842#comment-15004842 ] Joep Rottinghuis commented on YARN-4053: Now that I'm looking at it again in detail with

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004887#comment-15004887 ] Joep Rottinghuis commented on YARN-4053: In further discussion with [~sjlee0] it may actually be

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008041#comment-15008041 ] Joep Rottinghuis commented on YARN-4053: Looks good [~varun_saxena] this is a nice separation of

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009162#comment-15009162 ] Joep Rottinghuis commented on YARN-4053: Either throw exception, or document in javadoc that null

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011789#comment-15011789 ] Joep Rottinghuis commented on YARN-4053: Thanks [~varun_saxena] patch looks good to me. Thanks for

[jira] [Commented] (YARN-4102) Add a "skip existing table" mode for timeline schema creator

[ https://issues.apache.org/jira/browse/YARN-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729390#comment-14729390 ] Joep Rottinghuis commented on YARN-4102: Yup that looks good. I noticed one more thing, you decide

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run & flow activity tables

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735887#comment-14735887 ] Joep Rottinghuis commented on YARN-3901: Thanks [~vrushalic]. I'm going to dig through the details

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run & flow activity tables

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735900#comment-14735900 ] Joep Rottinghuis commented on YARN-3901: The one remaining issue we have to tackle is when there

[jira] [Commented] (YARN-4102) Add an "incremental" mode for timeline schema creator

[ https://issues.apache.org/jira/browse/YARN-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727775#comment-14727775 ] Joep Rottinghuis commented on YARN-4102: Looks good to me. One caveat is in the naming. The

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727816#comment-14727816 ] Joep Rottinghuis commented on YARN-4053: Part of the issue is that there are many moving components

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run & flow activity tables

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729910#comment-14729910 ] Joep Rottinghuis commented on YARN-3901: Not sure if [~gtCarrera9] is asking what happens if we

[jira] [Commented] (YARN-4102) Add a "skip existing table" mode for timeline schema creator

[ https://issues.apache.org/jira/browse/YARN-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14730086#comment-14730086 ] Joep Rottinghuis commented on YARN-4102: s/in/it > Add a "skip existing table" mode for timeline

[jira] [Commented] (YARN-4102) Add a "skip existing table" mode for timeline schema creator

[ https://issues.apache.org/jira/browse/YARN-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14730085#comment-14730085 ] Joep Rottinghuis commented on YARN-4102: Ship in on YARN-4102-YARN-2928.003.patch > Add a "skip

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run & flow activity tables

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744320#comment-14744320 ] Joep Rottinghuis commented on YARN-3901: [~sjlee0] bq. I remember Joep Rottinghuis mentioning

[jira] [Commented] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14790987#comment-14790987 ] Joep Rottinghuis commented on YARN-4062: While discussing flush and compaction with [~vrushalic] I

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run & flow activity tables

[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791446#comment-14791446 ] Joep Rottinghuis commented on YARN-3901: Thanks for patiently making updates as we figured out the

  1   2   3   4   5   >