[jira] [Commented] (GIRAPH-842) option to dump histogram of memory usage when heap is low on memory
[ https://issues.apache.org/jira/browse/GIRAPH-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026848#comment-14026848 ] Sergey Edunov commented on GIRAPH-842: -- +1 option to dump histogram of memory usage when heap is low on memory --- Key: GIRAPH-842 URL: https://issues.apache.org/jira/browse/GIRAPH-842 Project: Giraph Issue Type: Bug Reporter: Pavan Kumar Assignee: Pavan Kumar Priority: Minor Attachments: GIRAPH-842.patch, GIRAPH-842_1.patch, master-stderr, worker-stderr Currently we are left in blind for jobs that OOM, it would be helpful if we can do a jmap -histo dump when heap has very little free space left. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (GIRAPH-842) option to dump histogram of memory usage when heap is low on memory
[ https://issues.apache.org/jira/browse/GIRAPH-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14027014#comment-14027014 ] Hudson commented on GIRAPH-842: --- ABORTED: Integrated in Giraph-trunk-Commit #1451 (See [https://builds.apache.org/job/Giraph-trunk-Commit/1451/]) GIRAPH-842: option to dump histogram of memory usage when heap is low on memory (pavanka) (pavanka: http://git-wip-us.apache.org/repos/asf?p=giraph.gita=commith=372c35ebccedf64266a38a35e365d3810642fef2) * CHANGELOG * giraph-core/src/main/java/org/apache/giraph/conf/GiraphConfiguration.java * giraph-core/src/main/java/org/apache/giraph/utils/ReactiveJMapHistoDumper.java * giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java * giraph-core/src/main/java/org/apache/giraph/conf/GiraphConstants.java * giraph-core/src/main/java/org/apache/giraph/master/BspServiceMaster.java option to dump histogram of memory usage when heap is low on memory --- Key: GIRAPH-842 URL: https://issues.apache.org/jira/browse/GIRAPH-842 Project: Giraph Issue Type: Bug Reporter: Pavan Kumar Assignee: Pavan Kumar Priority: Minor Attachments: GIRAPH-842.patch, GIRAPH-842_1.patch, master-stderr, worker-stderr Currently we are left in blind for jobs that OOM, it would be helpful if we can do a jmap -histo dump when heap has very little free space left. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (GIRAPH-842) option to dump histogram of memory usage when heap is low on memory
[ https://issues.apache.org/jira/browse/GIRAPH-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025989#comment-14025989 ] Sergey Edunov commented on GIRAPH-842: -- Hey Pavan, this is great feature, here are some comments on implementation: 1) Please assign your thread some meaningful name, it can be helpful in debugging stack traces. 2) Stop flag has to be volatile, otherwise your thread may never see the change 3) I would let the thread die if you get InterruptedException. 4) runtime.freeMemory() might give you false alarms if you run job with different values of Xmx and Xms. This is because freeMemory only counts free bytes currently allocated to JVM. If your Xmx setting is bigger than Xms you can go low on freeMemory before JVM allocates another chunk. To get more accurate results you can do (maxMemory - totalMemory + freeMemory) option to dump histogram of memory usage when heap is low on memory --- Key: GIRAPH-842 URL: https://issues.apache.org/jira/browse/GIRAPH-842 Project: Giraph Issue Type: Bug Reporter: Pavan Kumar Assignee: Pavan Kumar Priority: Minor Attachments: GIRAPH-842.patch, master-stderr, worker-stderr Currently we are left in blind for jobs that OOM, it would be helpful if we can do a jmap -histo dump when heap has very little free space left. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (GIRAPH-842) option to dump histogram of memory usage when heap is low on memory
[ https://issues.apache.org/jira/browse/GIRAPH-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13889829#comment-13889829 ] Pavan Kumar commented on GIRAPH-842: pulled latest trunk (after prev 2 commits) and ran mvn clean verify. it succeeds. option to dump histogram of memory usage when heap is low on memory --- Key: GIRAPH-842 URL: https://issues.apache.org/jira/browse/GIRAPH-842 Project: Giraph Issue Type: Bug Reporter: Pavan Kumar Assignee: Pavan Kumar Priority: Minor Attachments: GIRAPH-842.patch, master-stderr, worker-stderr Currently we are left in blind for jobs that OOM, it would be helpful if we can do a jmap -histo dump when heap has very little free space left. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
