[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-04-26 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455410#comment-16455410
 ] 

Hudson commented on HDFS-13320:
---

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14070 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/14070/])
HDFS-13320. Ozone: Support for MicrobenchMarking Tool. Contributed by (omalley: 
rev 6cc765fbb677623fa192832a064e7d3d447781bf)
* (add) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/freon/TestDataValidate.java
* (delete) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/tools/Freon.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/package-info.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/Freon.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/package-info.java
* (edit) 
hadoop-ozone/tools/src/test/java/org/apache/hadoop/test/OzoneTestDriver.java
* (add) 
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/freon/package-info.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/Genesis.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkDatanodeDispatcher.java
* (delete) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/tools/TestFreon.java
* (add) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/freon/package-info.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkMetadataStoreWrites.java
* (edit) hadoop-ozone/common/src/main/bin/oz
* (delete) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/tools/TestDataValidate.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkRocksDbStore.java
* (add) 
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/freon/OzoneGetConf.java
* (delete) 
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/tools/package-info.java
* (add) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/freon/TestFreon.java
* (delete) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/tools/package-info.java
* (edit) hadoop-ozone/tools/pom.xml
* (delete) 
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/tools/OzoneGetConf.java
* (edit) hadoop-project/pom.xml
* (delete) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/tools/package-info.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkContainerStateMap.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/GenesisUtil.java
* (edit) 
hadoop-hdsl/server-scm/src/main/java/org/apache/hadoop/ozone/scm/container/ContainerStates/ContainerStateMap.java
* (delete) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/scm/container/ContainerStates/TestContainerStateMap.java
* (delete) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/scm/container/ContainerStates/BenchmarkContainerStateMap.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkMetadataStoreReads.java


> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch, HDFS-13320-HDFS-7240.003.patch, 
> HDFS-13320-HDFS-7240.004.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-04-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451196#comment-16451196
 ] 

Hudson commented on HDFS-13320:
---

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14057 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/14057/])
HDFS-13320. Ozone: Support for MicrobenchMarking Tool. Contributed by (nanda: 
rev d34288ae34142670f2b8569f63926b86ccc0ff2b)
* (edit) hadoop-ozone/common/src/main/bin/oz
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/Genesis.java
* (delete) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/tools/Freon.java
* (add) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/freon/TestDataValidate.java
* (edit) hadoop-project/pom.xml
* (delete) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/scm/container/ContainerStates/BenchmarkContainerStateMap.java
* (delete) 
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/tools/OzoneGetConf.java
* (add) 
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/freon/package-info.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkMetadataStoreWrites.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/package-info.java
* (add) 
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/freon/OzoneGetConf.java
* (delete) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/tools/package-info.java
* (edit) 
hadoop-hdsl/server-scm/src/main/java/org/apache/hadoop/ozone/scm/container/ContainerStates/ContainerStateMap.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkDatanodeDispatcher.java
* (add) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/freon/TestFreon.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkMetadataStoreReads.java
* (edit) hadoop-ozone/tools/pom.xml
* (delete) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/tools/TestDataValidate.java
* (delete) 
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/tools/package-info.java
* (add) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/freon/package-info.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/GenesisUtil.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/package-info.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/Freon.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkRocksDbStore.java
* (delete) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/tools/package-info.java
* (delete) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/scm/container/ContainerStates/TestContainerStateMap.java
* (delete) 
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/tools/TestFreon.java
* (edit) 
hadoop-ozone/tools/src/test/java/org/apache/hadoop/test/OzoneTestDriver.java
* (add) 
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkContainerStateMap.java


> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch, HDFS-13320-HDFS-7240.003.patch, 
> HDFS-13320-HDFS-7240.004.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-04-04 Thread Nanda kumar (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425577#comment-16425577
 ] 

Nanda kumar commented on HDFS-13320:


Thanks [~shashikant] for the contribution. I have committed this to the feature 
branch.

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch, HDFS-13320-HDFS-7240.003.patch, 
> HDFS-13320-HDFS-7240.004.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-04-04 Thread Nanda kumar (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425574#comment-16425574
 ] 

Nanda kumar commented on HDFS-13320:


+1, LGTM. Built and tested it locally.

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch, HDFS-13320-HDFS-7240.003.patch, 
> HDFS-13320-HDFS-7240.004.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-04-04 Thread genericqa (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425496#comment-16425496
 ] 

genericqa commented on HDFS-13320:
--

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
23s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 9 new or modified test 
files. {color} |
|| || || || {color:brown} HDFS-7240 Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  1m 
58s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 30m 
34s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 38m 
55s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  3m 
15s{color} | {color:green} HDFS-7240 passed {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
38s{color} | {color:red} server-scm in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
33s{color} | {color:red} common in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
33s{color} | {color:red} integration-test in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
30s{color} | {color:red} tools in HDFS-7240 failed. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
11m  4s{color} | {color:green} branch has no errors when building and testing 
our client artifacts. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue}  0m  
0s{color} | {color:blue} Skipped patched modules with no Java source: 
hadoop-project hadoop-ozone/integration-test {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 
31s{color} | {color:red} server-scm in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 
30s{color} | {color:red} common in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 
31s{color} | {color:red} tools in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
31s{color} | {color:red} server-scm in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
31s{color} | {color:red} common in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
31s{color} | {color:red} integration-test in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
30s{color} | {color:red} tools in HDFS-7240 failed. {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
24s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
13s{color} | {color:red} server-scm in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
12s{color} | {color:red} common in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
13s{color} | {color:red} integration-test in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
12s{color} | {color:red} tools in the patch failed. {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 27m 
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 27m 
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  3m 
17s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
30s{color} | {color:red} server-scm in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
31s{color} | {color:red} common in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
30s{color} | {color:red} integration-test in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | 

[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-04-04 Thread Shashikant Banerjee (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425313#comment-16425313
 ] 

Shashikant Banerjee commented on HDFS-13320:


Thanks [~nandakumar131], for the review. Patch v4 addresses your review 
comments.

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch, HDFS-13320-HDFS-7240.003.patch, 
> HDFS-13320-HDFS-7240.004.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-04-04 Thread Nanda kumar (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425253#comment-16425253
 ] 

Nanda kumar commented on HDFS-13320:


Thanks [~shashikant] for working on this, please find my review comments below

*BenchMarkContainerStateMap.java*
L:22 & 41 Unused imports.
L:129 CreateLocalAddress is never used, we can remove this method.
L:134 - 137 Multiple blank lines.
L:164 Add space after {{ReplicationType.STAND_ALONE,}} and remove the space 
after {{ReplicationFactor.ONE}}.
 {{getMatchingContainerBenchMark}}: use {{Blackhole}} to consume the result.

*BenchMarkDatanodeDispatcher.java*
L:48 - 53 Multiple blank lines.
L:37 - 39 Static variable naming convention.

*Genesis.java*
L:26 Unused import

*GenesisUtil.java*
javadoc missing for the class

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch, HDFS-13320-HDFS-7240.003.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-04-02 Thread Shashikant Banerjee (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423470#comment-16423470
 ] 

Shashikant Banerjee commented on HDFS-13320:


Thanks [~anu], for having a look at it. The issue does not seem to be relate 
with the patch. The hadoop_classpath is not getting properly set. I am not able 
to run KSM , SCM etc.

HW15685:hadoop sbanerjee$ ./hadoop-dist/target/hadoop-3.2.0-SNAPSHOT/bin/oz ksm
WARNING: /Users/sbanerjee/hadoop/hadoop-dist/target/hadoop-3.2.0-SNAPSHOT/logs 
does not exist. Creating.
Error: Could not find or load main class 
org.apache.hadoop.ozone.ksm.KeySpaceManager
HW15685:hadoop sbanerjee$ ./hadoop-dist/target/hadoop-3.2.0-SNAPSHOT/bin/oz scm
Error: Could not find or load main class 
org.apache.hadoop.ozone.scm.StorageContainerManager

This is related to HDFS-13383.

 

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch, HDFS-13320-HDFS-7240.003.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-04-02 Thread Anu Engineer (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423454#comment-16423454
 ] 

Anu Engineer commented on HDFS-13320:
-

[~shashikant] I am getting the following error when I try to execute this code. 
Can you please check? 
{noformat}
./hadoop-3.2.0-SNAPSHOT/bin/oz genesis -h
Error: Could not find or load main class org.apache.hadoop.ozone.genesis.Genesis
{noformat}

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch, HDFS-13320-HDFS-7240.003.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-03-29 Thread genericqa (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418906#comment-16418906
 ] 

genericqa commented on HDFS-13320:
--

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
18s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 9 new or modified test 
files. {color} |
|| || || || {color:brown} HDFS-7240 Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  1m 
28s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 17m 
17s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 15m 
45s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  3m 
16s{color} | {color:green} HDFS-7240 passed {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
42s{color} | {color:red} server-scm in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
44s{color} | {color:red} integration-test in HDFS-7240 failed. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
11m  3s{color} | {color:green} branch has no errors when building and testing 
our client artifacts. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue}  0m  
0s{color} | {color:blue} Skipped patched modules with no Java source: 
hadoop-project hadoop-ozone/integration-test {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 
38s{color} | {color:red} server-scm in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  1m  
0s{color} | {color:red} hadoop-ozone/common in HDFS-7240 has 2 extant Findbugs 
warnings. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 
43s{color} | {color:red} hadoop-ozone/tools in HDFS-7240 has 2 extant Findbugs 
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  2m 
48s{color} | {color:green} HDFS-7240 passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
22s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
21s{color} | {color:red} server-scm in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
20s{color} | {color:red} integration-test in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
20s{color} | {color:red} tools in the patch failed. {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 13m 
51s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 13m 
51s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  3m 
16s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
36s{color} | {color:red} server-scm in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
37s{color} | {color:red} integration-test in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
38s{color} | {color:red} tools in the patch failed. {color} |
| {color:green}+1{color} | {color:green} shellcheck {color} | {color:green}  0m 
24s{color} | {color:green} There were no new shellcheck issues. {color} |
| {color:green}+1{color} | {color:green} shelldocs {color} | {color:green}  0m 
34s{color} | {color:green} There were no new shelldocs issues. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green}  0m  
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 
10m 40s{color} | {color:green} patch has no errors when building and testing 
our client artifacts. {color} |
| 

[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-03-29 Thread Shashikant Banerjee (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418738#comment-16418738
 ] 

Shashikant Banerjee commented on HDFS-13320:


Thanks [~elek], for reviewing this. Patch v3 fixes the compilation issues. 
Please have a look.

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch, HDFS-13320-HDFS-7240.003.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-03-29 Thread Elek, Marton (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418652#comment-16418652
 ] 

Elek, Marton commented on HDFS-13320:
-

Sorry, I used the wrong word. It's not conflict as a git conflict but a 
copilation error.

{code}
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on 
project hadoop-ozone-tools: Compilation failure: Compilation failure: 
[ERROR] 
/home/elek/projects/hadoop/hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkContainerStateMap.java:[177,31]
 incompatible types: org.apache.hadoop.hdfs.protocol.DatanodeID cannot be 
converted to org.apache.hadoop.hdsl.protocol.DatanodeDetails
[ERROR] 
/home/elek/projects/hadoop/hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkContainerStateMap.java:[179,39]
 incompatible types: org.apache.hadoop.hdfs.protocol.DatanodeID cannot be 
converted to org.apache.hadoop.hdsl.protocol.DatanodeDetails
[ERROR] 
/home/elek/projects/hadoop/hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkDatanodeDispatcher.java:[91,45]
 incompatible types: org.apache.hadoop.hdfs.protocol.DatanodeID cannot be 
converted to org.apache.hadoop.hdsl.protocol.DatanodeDetails
[ERROR] 
/home/elek/projects/hadoop/hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkDatanodeDispatcher.java:[138,12]
 cannot find symbol
[ERROR]   symbol:   method setDatanodeID(java.lang.String)
[ERROR]   location: variable request of type 
org.apache.hadoop.hdsl.protocol.proto.ContainerProtos.ContainerCommandRequestProto.Builder
[ERROR] 
/home/elek/projects/hadoop/hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkDatanodeDispatcher.java:[158,9]
 cannot find symbol
[ERROR]   symbol:   method setDatanodeID(java.lang.String)
[ERROR]   location: class 
org.apache.hadoop.hdsl.protocol.proto.ContainerProtos.ContainerCommandRequestProto.Builder
[ERROR] 
/home/elek/projects/hadoop/hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkDatanodeDispatcher.java:[175,9]
 cannot find symbol
[ERROR]   symbol:   method setDatanodeID(java.lang.String)
[ERROR]   location: class 
org.apache.hadoop.hdsl.protocol.proto.ContainerProtos.ContainerCommandRequestProto.Builder
[ERROR] 
/home/elek/projects/hadoop/hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkDatanodeDispatcher.java:[202,9]
 cannot find symbol
[ERROR]   symbol:   method setDatanodeID(java.lang.String)
[ERROR]   location: class 
org.apache.hadoop.hdsl.protocol.proto.ContainerProtos.ContainerCommandRequestProto.Builder
[ERROR] 
/home/elek/projects/hadoop/hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/genesis/BenchMarkDatanodeDispatcher.java:[217,9]
 cannot find symbol
[ERROR]   symbol:   method setDatanodeID(java.lang.String)
[ERROR]   location: class 
org.apache.hadoop.hdsl.protocol.proto.ContainerProtos.ContainerCommandRequestProto.Builder
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-ozone-tools
{code}

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-03-29 Thread Shashikant Banerjee (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418647#comment-16418647
 ] 

Shashikant Banerjee commented on HDFS-13320:


Thanks [~elek], for having a look at this. Strangely, it shows no conflict for 
me.
{code:java}
HW15685:hadoop sbanerjee$ git status
On branch HDFS-7240
Your branch is up-to-date with 'origin/HDFS-7240'.
nothing to commit, working tree clean
HW15685:hadoop sbanerjee$ git apply ~/Desktop/HDFS-13320-HDFS-7240.002.patch
HW15685:hadoop sbanerjee${code}
 

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-03-29 Thread Elek, Marton (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418635#comment-16418635
 ] 

Elek, Marton commented on HDFS-13320:
-

Unfortunately it's conflicting now because HDFS-13300. Could you please rebase 
it to the latest HDFS-7240. 

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-03-23 Thread genericqa (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411359#comment-16411359
 ] 

genericqa commented on HDFS-13320:
--

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
37s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 9 new or modified test 
files. {color} |
|| || || || {color:brown} HDFS-7240 Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  5m 
17s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 15m 
34s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 13m  
6s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  2m 
39s{color} | {color:green} HDFS-7240 passed {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
25s{color} | {color:red} server-scm in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
20s{color} | {color:red} common in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
23s{color} | {color:red} integration-test in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
21s{color} | {color:red} tools in HDFS-7240 failed. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}  
8m 58s{color} | {color:green} branch has no errors when building and testing 
our client artifacts. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue}  0m  
0s{color} | {color:blue} Skipped patched modules with no Java source: 
hadoop-project hadoop-ozone/integration-test {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 
18s{color} | {color:red} server-scm in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 
19s{color} | {color:red} common in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 
22s{color} | {color:red} tools in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
22s{color} | {color:red} server-scm in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
19s{color} | {color:red} common in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
20s{color} | {color:red} integration-test in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
19s{color} | {color:red} tools in HDFS-7240 failed. {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
20s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m  
9s{color} | {color:red} server-scm in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m  
9s{color} | {color:red} common in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
11s{color} | {color:red} integration-test in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
10s{color} | {color:red} tools in the patch failed. {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 11m 
50s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 11m 
50s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  2m 
39s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
22s{color} | {color:red} server-scm in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
21s{color} | {color:red} common in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
24s{color} | {color:red} integration-test in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | 

[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-03-23 Thread Shashikant Banerjee (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1648#comment-1648
 ] 

Shashikant Banerjee commented on HDFS-13320:


Thanks [~anu], for the review comments. The 
org.openjdk.jmh:jmh-generator-annprocess was missing in the classpath while 
executing the genesis tool and hence the error.  Addressed this in the v2 patch.

W15685:hadoop sbanerjee$ ./hadoop-dist/target/hadoop-3.2.0-SNAPSHOT/bin/oz 
genesis -h
# JMH version: 1.19
# VM version: JDK 1.8.0_144, VM 25.144-b01
# VM invoker: 
/Library/Java/JavaVirtualMachines/jdk1.8.0_144.jdk/Contents/Home/jre/bin/java
# VM options: -Dproc_genesis -Djava.net.preferIPv4Stack=true 
-Djava.security.krb5.realm= -Djava.security.krb5.kdc= 
-Djava.security.krb5.conf= 
-Dyarn.log.dir=/Users/sbanerjee/hadoop/hadoop-dist/target/hadoop-3.2.0-SNAPSHOT/logs
 -Dyarn.log.file=hadoop.log 
-Dyarn.home.dir=/Users/sbanerjee/hadoop/hadoop-dist/target/hadoop-3.2.0-SNAPSHOT
 -Dyarn.root.logger=INFO,console 
-Dhadoop.log.dir=/Users/sbanerjee/hadoop/hadoop-dist/target/hadoop-3.2.0-SNAPSHOT/logs
 -Dhadoop.log.file=hadoop.log 
-Dhadoop.home.dir=/Users/sbanerjee/hadoop/hadoop-dist/target/hadoop-3.2.0-SNAPSHOT
 -Dhadoop.id.str=sbanerjee -Dhadoop.root.logger=INFO,console 
-Dhadoop.policy.file=hadoop-policy.xml 
-Dhadoop.security.logger=INFO,NullAppender
# Warmup: 5 iterations, 1 s each
# Measurement: 20 iterations, 1 s each
# Timeout: 10 min per iteration
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Throughput, ops/time
# Benchmark: 
org.apache.hadoop.ozone.genesis.BenchMarkContainerStateMap.createContainerBenchMark

# Run progress: 0.00% complete, ETA 00:06:15
# Fork: 1 of 1
# Warmup Iteration 1: 10821.298 ops/s
# Warmup Iteration 2: 12306.852 ops/s
# Warmup Iteration 3: 11333.630 ops/s

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch, 
> HDFS-13320-HDFS-7240.002.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-03-21 Thread Anu Engineer (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16408983#comment-16408983
 ] 

Anu Engineer commented on HDFS-13320:
-

[~shashikant] Thank you for the patch. When I build and try to run this tool, I 
get this following error. Can you please investigate?


{noformat}
 ./hadoop-3.2.0-SNAPSHOT/bin/oz genesis -h
Exception in thread "main" java.lang.RuntimeException: ERROR: Unable to find 
the resource: /META-INF/BenchmarkList
at 
org.openjdk.jmh.runner.AbstractResourceReader.getReaders(AbstractResourceReader.java:98)
at org.openjdk.jmh.runner.BenchmarkList.find(BenchmarkList.java:122)
at org.openjdk.jmh.runner.Runner.internalRun(Runner.java:256)
at org.openjdk.jmh.runner.Runner.run(Runner.java:206)
at org.apache.hadoop.ozone.genesis.Genesis.main(Genesis.java:50)
{noformat}

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-03-21 Thread genericqa (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407819#comment-16407819
 ] 

genericqa commented on HDFS-13320:
--

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
49s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m 
 0s{color} | {color:green} The patch appears to include 7 new or modified test 
files. {color} |
|| || || || {color:brown} HDFS-7240 Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  5m 
24s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 16m 
 1s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 15m 
53s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  3m 
11s{color} | {color:green} HDFS-7240 passed {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
32s{color} | {color:red} server-scm in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
24s{color} | {color:red} common in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
30s{color} | {color:red} integration-test in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
22s{color} | {color:red} tools in HDFS-7240 failed. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}  
9m 57s{color} | {color:green} branch has no errors when building and testing 
our client artifacts. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue}  0m  
0s{color} | {color:blue} Skipped patched modules with no Java source: 
hadoop-project hadoop-ozone/integration-test {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 
23s{color} | {color:red} server-scm in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 
18s{color} | {color:red} common in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 
17s{color} | {color:red} tools in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
21s{color} | {color:red} server-scm in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
22s{color} | {color:red} common in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
21s{color} | {color:red} integration-test in HDFS-7240 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 
25s{color} | {color:red} tools in HDFS-7240 failed. {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
18s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
10s{color} | {color:red} server-scm in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
12s{color} | {color:red} common in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
11s{color} | {color:red} integration-test in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 
12s{color} | {color:red} tools in the patch failed. {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 12m  
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 12m  
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  2m 
34s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
18s{color} | {color:red} server-scm in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
18s{color} | {color:red} common in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 
20s{color} | {color:red} integration-test in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | 

[jira] [Commented] (HDFS-13320) Ozone:Support for MicrobenchMarking Tool

2018-03-21 Thread Shashikant Banerjee (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-13320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407713#comment-16407713
 ] 

Shashikant Banerjee commented on HDFS-13320:


Patch v1 implements benchmarking for Rocks DB, Container State Maps and 
MetadatStore Reads/Writes.

> Ozone:Support for MicrobenchMarking Tool
> 
>
> Key: HDFS-13320
> URL: https://issues.apache.org/jira/browse/HDFS-13320
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
> Attachments: HDFS-13320-HDFS-7240.001.patch
>
>
> This Jira proposes to add a micro benchmarking tool called Genesis which 
> executes a set of HDSL/Ozone benchmarks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org