[jira] [Created] (HDFS-14128) .Trash location

George Huang created HDFS-14128: --- Summary: .Trash location Key: HDFS-14128 URL: https://issues.apache.org/jira/browse/HDFS-14128 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145945#comment-16145945 ] George Huang commented on HDFS-11912: - Thank you so much [~manojg] and [~andrew.wang] for all the

[jira] [Commented] (HDFS-11398) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure still fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144225#comment-16144225 ] George Huang commented on HDFS-11398: - We recently see this in house, seems related?

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142397#comment-16142397 ] George Huang commented on HDFS-11912: - Thanks Manoj for the review. Change was made and patch

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.007.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: (was: HDFS-11912.007.patch) > Add a snapshot unit test with randomized file IO

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.007.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: (was: HDFS-11912.007.patch) > Add a snapshot unit test with randomized file IO

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.007.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139485#comment-16139485 ] George Huang commented on HDFS-11912: - Fixing java.util.* in previous patch. > Add a snapshot unit

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.006.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131579#comment-16131579 ] George Huang commented on HDFS-11912: - Reducing the number of test files to be created, ran test

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.005.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Comment Edited] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16130850#comment-16130850 ] George Huang edited comment on HDFS-11912 at 8/17/17 5:42 PM: -- Test was

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16130850#comment-16130850 ] George Huang commented on HDFS-11912: - Test was having a 10 min timeout. However, setup related

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.004.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Comment Edited] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129736#comment-16129736 ] George Huang edited comment on HDFS-11912 at 8/17/17 1:29 AM: -- Hi Manoj,

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129736#comment-16129736 ] George Huang commented on HDFS-11912: - Test randomly generated number of iterations for the current

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.003.patch Addressing code review comments. > Add a snapshot unit test with

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077305#comment-16077305 ] George Huang commented on HDFS-11912: - Hi Manoj, Thank you for the code review and great feedback!

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Labels: TestGap (was: ) > Add a snapshot unit test with randomized file IO operations >

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.002.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037913#comment-16037913 ] George Huang commented on HDFS-11912: - 1. Shouldn't the check be just (randomNum < (currentWeightSum +

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037867#comment-16037867 ] George Huang commented on HDFS-11912: - 3. FileSystemOperations and SnapshotOperations are very similar

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037862#comment-16037862 ] George Huang commented on HDFS-11912: - 11. Can you please print the aggregated stats at the end of the

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035663#comment-16035663 ] George Huang commented on HDFS-11912: - 10. /** Delete an existing test directory */ private void

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035598#comment-16035598 ] George Huang commented on HDFS-11912: - 9. There is only one entry in snapshottableDirectories list,

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035593#comment-16035593 ] George Huang commented on HDFS-11912: - 8. // Get list of snapshottable directories

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035580#comment-16035580 ] George Huang commented on HDFS-11912: - 7. private String GetNewPathString(String originalString,

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035572#comment-16035572 ] George Huang commented on HDFS-11912: - 6. // Create files in a directory with random depth,

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035547#comment-16035547 ] George Huang commented on HDFS-11912: - 4. // Set Random RANDOM = new Random(); long seed =

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035540#comment-16035540 ] George Huang commented on HDFS-11912: - 5. int fileLen = new Random().nextInt(MAX_NUM_FILE_LENGTH);

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035535#comment-16035535 ] George Huang commented on HDFS-11912: - 2. private static MiniDFSCluster cluster; => Fixed private

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Status: Patch Available (was: Open) > Add a snapshot unit test with randomized file IO operations

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.001.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Created] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

George Huang created HDFS-11912: --- Summary: Add a snapshot unit test with randomized file IO operations Key: HDFS-11912 URL: https://issues.apache.org/jira/browse/HDFS-11912 Project: Hadoop HDFS