[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-29 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
   Resolution: Fixed
Fix Version/s: 2.8.0
   Status: Resolved  (was: Patch Available)

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
  Labels: BB2015-05-TBR
 Fix For: 2.8.0

 Attachments: HDFS-7390-003.patch, HDFS-7390-004.patch, 
 HDFS-7390-005.patch, HDFS-7390-006.patch, HDFS-7390-007.patch, 
 HDFS-7390-008.patch, HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Auto-Re: [jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-29 Thread wsb 
您的邮件已收到！谢谢！

Auto-Re: [jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-26 Thread wsb 
您的邮件已收到！谢谢！

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-26 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Attachment: HDFS-7390-008.patch

Attaching the patch which addresses [~arpitagarwal]'s comments.

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
  Labels: BB2015-05-TBR
 Attachments: HDFS-7390-003.patch, HDFS-7390-004.patch, 
 HDFS-7390-005.patch, HDFS-7390-006.patch, HDFS-7390-007.patch, 
 HDFS-7390-008.patch, HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-25 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Attachment: HDFS-7390-007.patch

Attaching a patch after fixing the compilation issues.

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
  Labels: BB2015-05-TBR
 Attachments: HDFS-7390-003.patch, HDFS-7390-004.patch, 
 HDFS-7390-005.patch, HDFS-7390-006.patch, HDFS-7390-007.patch, 
 HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Auto-Re: [jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-25 Thread wsb 
您的邮件已收到！谢谢！

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-24 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Attachment: HDFS-7390-006.patch

Thanks for the review [~arpitagarwal]
Attaching a patch which addresses the comments.

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
  Labels: BB2015-05-TBR
 Attachments: HDFS-7390-003.patch, HDFS-7390-004.patch, 
 HDFS-7390-005.patch, HDFS-7390-006.patch, HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Auto-Re: [jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-24 Thread wsb 
您的邮件已收到！谢谢！

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-22 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Attachment: HDFS-7390-005.patch

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
  Labels: BB2015-05-TBR
 Attachments: HDFS-7390-003.patch, HDFS-7390-004.patch, 
 HDFS-7390-005.patch, HDFS-7390-005.patch, HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-22 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Attachment: (was: HDFS-7390-005.patch)

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
  Labels: BB2015-05-TBR
 Attachments: HDFS-7390-003.patch, HDFS-7390-004.patch, 
 HDFS-7390-005.patch, HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-18 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Attachment: HDFS-7390-005.patch

fixing checkstyle warning

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
  Labels: BB2015-05-TBR
 Attachments: HDFS-7390-003.patch, HDFS-7390-004.patch, 
 HDFS-7390-005.patch, HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-17 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Attachment: HDFS-7390-004.patch

Attaching a patch after fixing checkstyle warnings.

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
  Labels: BB2015-05-TBR
 Attachments: HDFS-7390-003.patch, HDFS-7390-004.patch, 
 HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-16 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Attachment: HDFS-7390-003.patch

Updated the patch. A new MXBean _BlockStats_ is defined and is implemented by 
_BlockManager_.
Used standard MXBean approach (based on CompositeDataSupport) to output Json.
Testcases are added.
Dependency on HADOOP-11308 is no longer needed and it is closed.
The sample Json output is as below:
{code}
{
name : Hadoop:service=NameNode,name=BlockStats,
modelerType : 
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager,
TieredStorageStats : [ {
  key : RAM_DISK,
  value : {
blockPoolUsed : 24576,
capacityRemaining : 1634963226624,
capacityTotal : 2994494914560,
capacityUsed : 24576,
nodesInService : 6
  }
}, {
  key : ARCHIVE,
  value : {
blockPoolUsed : 12288,
capacityRemaining : 817481576448,
capacityTotal : 1497247457280,
capacityUsed : 12288,
nodesInService : 3
  }
}, {
  key : DISK,
  value : {
blockPoolUsed : 12288,
capacityRemaining : 817481650176,
capacityTotal : 1497247457280,
capacityUsed : 12288,
nodesInService : 3
  }
} ]
  }
{code}

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
  Labels: BB2015-05-TBR
 Attachments: HDFS-7390-003.patch, HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-05-05 Thread Allen Wittenauer (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HDFS-7390:
---
Labels: BB2015-05-TBR  (was: )

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
  Labels: BB2015-05-TBR
 Attachments: HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2014-12-05 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Issue Type: Sub-task  (was: Improvement)
Parent: HDFS-7197

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Sub-task
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
 Attachments: HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2014-11-15 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Attachment: HDFS-7390.patch

Attached patch takes care of the previous comment.

{code:title=Sample JMX output}
name : Hadoop:service=NameNode,name=FSNamesystemState,
modelerType : org.apache.hadoop.hdfs.server.namenode.FSNamesystem,
CapacityTotal : 2996508205056,
CapacityUsed : 61440,
CapacityRemaining : 1965115490304,
TotalLoad : 6,
SnapshotStats : {\SnapshottableDirectories\:0,\Snapshots\:0},
TieredStorageStats : 
{ARCHIVE:{capacityTotal:1498254102528,capacityUsed:12288,capacityRemaining:982557745152,blockPoolUsed:12288,nodesInService:3},DISK:{capacityTotal:1498254102528,capacityUsed:49152,capacityRemaining:982557745152,blockPoolUsed:49152,nodesInService:3}},
{code}

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Improvement
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
 Attachments: HDFS-7390.patch, HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2014-11-11 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Attachment: HDFS-7390.patch

The attached patch provide JMX metrics per storage type. 
The following information is provided for each storage type in the cluster  
{capacityTotal, capacityUsed, capacityRemaining, blockPoolUsed, nodesInService, 
numBlocks}.

{code}
TieredStorageStats : 
{\ARCHIVE\:{\capacityTotal\:1498254102528,\capacityUsed\:12288,\capacityRemaining\:981672161280,\blockPoolUsed\:12288,\nodesInService\:3,\numBlocks\:0},\DISK\:{\capacityTotal\:1498254102528,\capacityUsed\:12288,\capacityRemaining\:981672161280,\blockPoolUsed\:12288,\nodesInService\:3,\numBlocks\:0}}
{code}


 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Improvement
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
 Attachments: HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2014-11-11 Thread Benoy Antony (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benoy Antony updated HDFS-7390:
---
Status: Patch Available  (was: Open)

 Provide JMX metrics per storage type
 

 Key: HDFS-7390
 URL: https://issues.apache.org/jira/browse/HDFS-7390
 Project: Hadoop HDFS
  Issue Type: Improvement
Affects Versions: 2.5.2
Reporter: Benoy Antony
Assignee: Benoy Antony
 Attachments: HDFS-7390.patch


 HDFS-2832  added heterogeneous support. In a cluster with different storage 
 types, it is useful to have metrics per storage type. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)