[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()
[
https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Shvachko updated HDFS-14502:
---
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.1.3
3.2.1
3.3.0
3.0.4
2.10.0
Status: Resolved (was: Patch Available)
I just committed this to trunk and all branches down to branch-2.
> keepResults option in NNThroughputBenchmark should call saveNamespace()
> ---
>
> Key: HDFS-14502
> URL: https://issues.apache.org/jira/browse/HDFS-14502
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: benchmarks, hdfs
>Affects Versions: 2.7.6
>Reporter: Konstantin Shvachko
>Assignee: Konstantin Shvachko
>Priority: Major
> Fix For: 2.10.0, 3.0.4, 3.3.0, 3.2.1, 3.1.3
>
> Attachments: HDFS-14502.001.patch
>
>
> {{-keepResults}} option is usually used to make it possible to rerun
> NNThroughputBenchmark with existing namespace state {{-useExisting}}. E.g.
> first generate files with {{create}} command and then run {{fileStatus}}
> command on generated files.
> NNThroughputBenchmark should call {{saveNamespace()}} when {{-keepResults}}
> option is specified. Otherwise NN startup takes a while since it needs to
> digest large edits file starting from the empty image.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()
[
https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Shvachko updated HDFS-14502:
---
Target Version/s: 2.10.0
Description:
{{-keepResults}} option is usually used to make it possible to rerun
NNThroughputBenchmark with existing namespace state {{-useExisting}}. E.g.
first generate files with {{create}} command and then run {{fileStatus}}
command on generated files.
NNThroughputBenchmark should call {{saveNamespace()}} when {{-keepResults}}
option is specified. Otherwise NN startup takes a while since it needs to
digest large edits file starting from the empty image.
was:
{{-keepResults}} option is usually used to make it possible to rerun
NNThroughputBenchmark with existing namespace state. E.g. first generate files
with {{create}} command and then run {{fileStatus}} command on generated files.
NNThroughputBenchmark should call {{saveNamespace()}} when {{-keepResults}}
option is specified. Otherwise NN startup takes a while since it needs to
digest large edits file starting from the empty image.
Ran the two tests locally. Everything is passing. I see many Jenkins failures
with these tests in the jira.
> keepResults option in NNThroughputBenchmark should call saveNamespace()
> ---
>
> Key: HDFS-14502
> URL: https://issues.apache.org/jira/browse/HDFS-14502
> Project: Hadoop HDFS
> Issue Type: Improvement
>Affects Versions: 2.7.6
>Reporter: Konstantin Shvachko
>Assignee: Konstantin Shvachko
>Priority: Major
> Attachments: HDFS-14502.001.patch
>
>
> {{-keepResults}} option is usually used to make it possible to rerun
> NNThroughputBenchmark with existing namespace state {{-useExisting}}. E.g.
> first generate files with {{create}} command and then run {{fileStatus}}
> command on generated files.
> NNThroughputBenchmark should call {{saveNamespace()}} when {{-keepResults}}
> option is specified. Otherwise NN startup takes a while since it needs to
> digest large edits file starting from the empty image.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()
[
https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Shvachko updated HDFS-14502:
---
Component/s: hdfs
benchmarks
> keepResults option in NNThroughputBenchmark should call saveNamespace()
> ---
>
> Key: HDFS-14502
> URL: https://issues.apache.org/jira/browse/HDFS-14502
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: benchmarks, hdfs
>Affects Versions: 2.7.6
>Reporter: Konstantin Shvachko
>Assignee: Konstantin Shvachko
>Priority: Major
> Attachments: HDFS-14502.001.patch
>
>
> {{-keepResults}} option is usually used to make it possible to rerun
> NNThroughputBenchmark with existing namespace state {{-useExisting}}. E.g.
> first generate files with {{create}} command and then run {{fileStatus}}
> command on generated files.
> NNThroughputBenchmark should call {{saveNamespace()}} when {{-keepResults}}
> option is specified. Otherwise NN startup takes a while since it needs to
> digest large edits file starting from the empty image.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()
[
https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Shvachko updated HDFS-14502:
---
Status: Patch Available (was: Open)
Simple patch adding {{saveNamespace()}}
> keepResults option in NNThroughputBenchmark should call saveNamespace()
> ---
>
> Key: HDFS-14502
> URL: https://issues.apache.org/jira/browse/HDFS-14502
> Project: Hadoop HDFS
> Issue Type: Improvement
>Affects Versions: 2.7.6
>Reporter: Konstantin Shvachko
>Assignee: Konstantin Shvachko
>Priority: Major
> Attachments: HDFS-14502.001.patch
>
>
> {{-keepResults}} option is usually used to make it possible to rerun
> NNThroughputBenchmark with existing namespace state. E.g. first generate
> files with {{create}} command and then run {{fileStatus}} command on
> generated files.
> NNThroughputBenchmark should call {{saveNamespace()}} when {{-keepResults}}
> option is specified. Otherwise NN startup takes a while since it needs to
> digest large edits file starting from the empty image.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()
[
https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Shvachko updated HDFS-14502:
---
Attachment: HDFS-14502.001.patch
> keepResults option in NNThroughputBenchmark should call saveNamespace()
> ---
>
> Key: HDFS-14502
> URL: https://issues.apache.org/jira/browse/HDFS-14502
> Project: Hadoop HDFS
> Issue Type: Improvement
>Affects Versions: 2.7.6
>Reporter: Konstantin Shvachko
>Assignee: Konstantin Shvachko
>Priority: Major
> Attachments: HDFS-14502.001.patch
>
>
> {{-keepResults}} option is usually used to make it possible to rerun
> NNThroughputBenchmark with existing namespace state. E.g. first generate
> files with {{create}} command and then run {{fileStatus}} command on
> generated files.
> NNThroughputBenchmark should call {{saveNamespace()}} when {{-keepResults}}
> option is specified. Otherwise NN startup takes a while since it needs to
> digest large edits file starting from the empty image.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
