[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-25 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872732#comment-16872732 ] Siyao Meng commented on HDFS-12345: --- Excited to see this committed. Thanks [~xkrogen]! > Scale testing

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-25 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872433#comment-16872433 ] Erik Krogen commented on HDFS-12345: I just committed this to trunk. Huge thank you to [~jojochuang]

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872429#comment-16872429 ] Hudson commented on HDFS-12345: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16821 (See

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871931#comment-16871931 ] Yiqun Lin commented on HDFS-12345: -- Thanks for cleaning up the patches, [~xkrogen]! I am also +1 for

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871433#comment-16871433 ] Wei-Chiu Chuang commented on HDFS-12345: Agreed. +1 > Scale testing HDFS NameNode with real

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871256#comment-16871256 ] Erik Krogen commented on HDFS-12345: I think this is ready to be committed, for follow-up tasks to be

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870101#comment-16870101 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-21 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869951#comment-16869951 ] Erik Krogen commented on HDFS-12345: Attached v009 fixing a few of the last remaining checkstyle /

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869947#comment-16869947 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-21 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869780#comment-16869780 ] Erik Krogen commented on HDFS-12345: Thanks [~jojochuang], that's a great catch. I changed it to the

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869253#comment-16869253 ] Wei-Chiu Chuang commented on HDFS-12345: I think it's good. I've taken part of the code to

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869026#comment-16869026 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-20 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868718#comment-16868718 ] Erik Krogen commented on HDFS-12345: Attached v007 patch which: * Adds assumptions about not running

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868120#comment-16868120 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855361#comment-16855361 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855164#comment-16855164 ] Íñigo Goiri commented on HDFS-12345: For a particular test, I the typical way is

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-06-03 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855156#comment-16855156 ] Erik Krogen commented on HDFS-12345: Dropped this for a while, but would really like to push it

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-04-04 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809763#comment-16809763 ] Siyao Meng commented on HDFS-12345: --- Thanks for the updated patch! [~xkrogen] There is a [Tar for

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809448#comment-16809448 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-04-03 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809299#comment-16809299 ] Erik Krogen commented on HDFS-12345: I'm attaching a v006 patch which clears up the remaining javac

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-27 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803428#comment-16803428 ] Erik Krogen commented on HDFS-12345: Hey [~daryn], thanks for raising some valid concerns. Regarding

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-26 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802095#comment-16802095 ] Siyao Meng commented on HDFS-12345: --- [~daryn] IMHO one solution would be not compiling and packaging

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797750#comment-16797750 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797591#comment-16797591 ] Daryn Sharp commented on HDFS-12345: I like the concept of Dynamometer but I don't have cycles to

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-20 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797577#comment-16797577 ] Erik Krogen commented on HDFS-12345: Thanks for the additional help, [~linyiqun]! Please make sure

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792553#comment-16792553 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792296#comment-16792296 ] Yiqun Lin commented on HDFS-12345: -- ASF warnings was caused by some test resources files. Excluded these

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791684#comment-16791684 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-13 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791392#comment-16791392 ] Yiqun Lin commented on HDFS-12345: -- I'd like to help some checkstyle warnings to let codes follow the

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791245#comment-16791245 ] Wei-Chiu Chuang commented on HDFS-12345: I don't really feel having multiple submodules is an

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-07 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787267#comment-16787267 ] Erik Krogen commented on HDFS-12345: [~jojochuang], I think I agree with you except for two things:

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786421#comment-16786421 ] Wei-Chiu Chuang commented on HDFS-12345: I skimmed through the various warnings from the last

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786356#comment-16786356 ] Yiqun Lin commented on HDFS-12345: -- Thanks for initial work of this, [~smeng] and [~xkrogen], seems a

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785181#comment-16785181 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-05 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784597#comment-16784597 ] Erik Krogen commented on HDFS-12345: Hey [~smeng], as you're pursuing this more actively than I am at

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-04 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783915#comment-16783915 ] Siyao Meng commented on HDFS-12345: --- Hi [~xkrogen], I changed the status of this jira from PATCH

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-04 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783895#comment-16783895 ] Siyao Meng commented on HDFS-12345: --- Uploaded rev 002 to integrate my additions from the above comment

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-02-28 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781181#comment-16781181 ] Siyao Meng commented on HDFS-12345: --- I've just managed to place junit jar at

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-02-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780994#comment-16780994 ] Erik Krogen commented on HDFS-12345: Hm. I wonder if it even makes sense for MiniDFSCluster to depend

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-02-28 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780957#comment-16780957 ] Siyao Meng commented on HDFS-12345: --- We might have a little dependency issue here on JUnit. I noticed

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-02-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767849#comment-16767849 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-02-13 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767673#comment-16767673 ] Siyao Meng commented on HDFS-12345: --- [~xkrogen] Excited to see Dynamometer merging to upstream! I

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-01-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743440#comment-16743440 ] Hadoop QA commented on HDFS-12345: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||