[jira] [Commented] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

2016-08-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435620#comment-15435620 ] Kuhu Shukla commented on HDFS-10788: [~jfield]. This is fixed in 2.7.3 through HDFS-9958. I am

[jira] [Assigned] (HDFS-10776) Revisit Hdfs Audit Logging

2016-08-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned HDFS-10776: -- Assignee: Kuhu Shukla > Revisit Hdfs Audit Logging > -- > >

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

2016-08-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426866#comment-15426866 ] Kuhu Shukla commented on HDFS-9395: --- [~vinodkv], This bug fix was originally requested by our grid

[jira] [Updated] (HDFS-10776) Revisit Hdfs Audit Logging

2016-08-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10776: --- Description: HDFS audit logging is considered critical in many scenarios, but it hasn't been always

[jira] [Created] (HDFS-10776) Revisit Hdfs Audit Logging

2016-08-18 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-10776: -- Summary: Revisit Hdfs Audit Logging Key: HDFS-10776 URL: https://issues.apache.org/jira/browse/HDFS-10776 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Commented] (HDFS-10743) MiniDFSCluster test runtimes can be drastically reduce

2016-08-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15423141#comment-15423141 ] Kuhu Shukla commented on HDFS-10743: [~linyiqun]. Since I am actively working on this JIRA as the

[jira] [Updated] (HDFS-10743) MiniDFSCluster test runtimes can be drastically reduce

2016-08-14 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10743: --- Attachment: HDFS-10743.002.patch Attaching my patch so far. Will post runtime stats as soon as

[jira] [Commented] (HDFS-10743) MiniDFSCluster test runtimes can be drastically reduce

2016-08-14 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420595#comment-15420595 ] Kuhu Shukla commented on HDFS-10743: [~linyiqun], Thanks for the patch! I have been testing this

[jira] [Assigned] (HDFS-10743) MiniDFSCluster test runtimes can be drastically reduce

2016-08-10 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned HDFS-10743: -- Assignee: Kuhu Shukla > MiniDFSCluster test runtimes can be drastically reduce >

[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-08-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412417#comment-15412417 ] Kuhu Shukla commented on HDFS-10342: TestTracing, TestRefreshUserMappings fail with or without the

[jira] [Updated] (HDFS-10601) Improve log message to include hostname when the NameNode is in safemode

2016-08-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10601: --- Attachment: HDFS-10601.003.patch > Improve log message to include hostname when the NameNode is in

[jira] [Updated] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-08-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10342: --- Attachment: HDFS-10342.003.patch > BlockManager#createLocatedBlocks should not check corrupt replicas

[jira] [Updated] (HDFS-10601) Improve log message to include hostname when the NameNode is in safemode

2016-07-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10601: --- Attachment: HDFS-10601.002.patch Updated patch to pick up the hostname from NameNode static method.

[jira] [Updated] (HDFS-10601) Improve log message to include hostname when the NameNode is in safemode

2016-07-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10601: --- Status: Patch Available (was: Open) > Improve log message to include hostname when the NameNode is

[jira] [Updated] (HDFS-10601) Improve log message to include hostname when the NameNode is in safemode

2016-07-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10601: --- Attachment: HDFS-10601.001.patch Attaching initial patch. > Improve log message to include hostname

[jira] [Created] (HDFS-10601) Improve log message to include hostname when the NameNode is in safemode

2016-07-07 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-10601: -- Summary: Improve log message to include hostname when the NameNode is in safemode Key: HDFS-10601 URL: https://issues.apache.org/jira/browse/HDFS-10601 Project: Hadoop

[jira] [Updated] (HDFS-10343) BlockManager#createLocatedBlocks may return blocks on failed storages

2016-07-06 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10343: --- Attachment: HDFS-10343.002.patch Fixing checkstyles. > BlockManager#createLocatedBlocks may return

[jira] [Updated] (HDFS-10343) BlockManager#createLocatedBlocks may return blocks on failed storages

2016-06-27 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10343: --- Status: Patch Available (was: Open) > BlockManager#createLocatedBlocks may return blocks on failed

[jira] [Updated] (HDFS-10343) BlockManager#createLocatedBlocks may return blocks on failed storages

2016-06-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10343: --- Attachment: HDFS-10343.001.patch Attaching initial patch that removes failed storages and adjusts the

[jira] [Commented] (HDFS-10328) Add per-cache-pool default replication num configuration

2016-06-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345320#comment-15345320 ] Kuhu Shukla commented on HDFS-10328: [~xupeng], [~cmccabe], it seems that {{TestRetryCacheWithHA ,

[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-06-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344366#comment-15344366 ] Kuhu Shukla commented on HDFS-10342: Test failures are seen in previous builds as well. I am now

[jira] [Updated] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-06-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10342: --- Attachment: HDFS-10342.002.patch Updated patch for checkstyle issues. Test failures except

[jira] [Updated] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-06-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10342: --- Status: Patch Available (was: Open) > BlockManager#createLocatedBlocks should not check corrupt

[jira] [Updated] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-06-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10342: --- Attachment: HDFS-10342.001.patch The patch adds a check to ensure that {{isReplicaCorrupt}} is

[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-05-31 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15308913#comment-15308913 ] Kuhu Shukla commented on HDFS-10342: Thank you [~xiaobingo] . Sorry about the delay, I have been

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-28 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Attachment: HDFS-9958-branch-2.7.001.patch HDFS-9958-branch-2.001.patch Attaching

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-28 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15262709#comment-15262709 ] Kuhu Shukla commented on HDFS-9958: --- [~brahmareddy] I am apprehensive of using an ArrayList instead of

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-28 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Status: Open (was: Patch Available) > BlockManager#createLocatedBlocks can throw NPE for corruptBlocks

[jira] [Assigned] (HDFS-10343) BlockManager#createLocatedBlocks may return blocks on failed storages

2016-04-28 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned HDFS-10343: -- Assignee: Kuhu Shukla > BlockManager#createLocatedBlocks may return blocks on failed storages

[jira] [Assigned] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-04-28 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned HDFS-10342: -- Assignee: Kuhu Shukla > BlockManager#createLocatedBlocks should not check corrupt replicas if

[jira] [Commented] (HDFS-10330) Add Corrupt Blocks Information in Metasave Output

2016-04-27 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15260215#comment-15260215 ] Kuhu Shukla commented on HDFS-10330: Thanks a lot Kihwal! > Add Corrupt Blocks Information in

[jira] [Updated] (HDFS-10330) Add Corrupt Blocks Information in Metasave Output

2016-04-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10330: --- Attachment: HDFS-10330.002.patch Updated patch for testMetasave failure. Also fixes the nit from

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258225#comment-15258225 ] Kuhu Shukla commented on HDFS-9958: --- Requesting [~walter.k.su], [~daryn], [~kihwal] for review/comments.

[jira] [Updated] (HDFS-10330) Add Corrupt Blocks Information in Metasave Output

2016-04-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10330: --- Attachment: HDFS-10330.001.patch Adding v1 patch for comments. > Add Corrupt Blocks Information in

[jira] [Updated] (HDFS-10330) Add Corrupt Blocks Information in Metasave Output

2016-04-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10330: --- Status: Patch Available (was: Open) > Add Corrupt Blocks Information in Metasave Output >

[jira] [Created] (HDFS-10330) Add Corrupt Blocks Information in Metasave Output

2016-04-26 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-10330: -- Summary: Add Corrupt Blocks Information in Metasave Output Key: HDFS-10330 URL: https://issues.apache.org/jira/browse/HDFS-10330 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Attachment: HDFS-9958.005.patch This patch addresses the issue introduced in the previous patch of null

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Attachment: HDFS-9958.004.patch Updating patch to address the case where we try and mark a block corrupt

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Attachment: HDFS-9958.003.patch Thanks a lot for the helpful comments [~walter.k.su]. bq. btw, which is

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-19 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247743#comment-15247743 ] Kuhu Shukla commented on HDFS-9958: --- Thanks [~walter.k.su]. I looked at the test failure. I think the use

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Attachment: HDFS-9958.002.patch Updating patch per comments. Added test is now reliable. >

[jira] [Commented] (HDFS-10239) Fsshell mv fails if port usage doesn't match in src and destination paths

2016-04-05 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15226586#comment-15226586 ] Kuhu Shukla commented on HDFS-10239: Many thanks [~kihwal] for the review and commit! > Fsshell mv

[jira] [Updated] (HDFS-10239) Fsshell mv fails if port usage doesn't match in src and destination paths

2016-04-01 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10239: --- Attachment: HDFS-10239.002.patch Updating patch with minor checkstyle fix. Test failures locally pass

[jira] [Updated] (HDFS-10239) Fsshell mv fails if port usage doesn't match in src and destination paths

2016-03-30 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10239: --- Status: Patch Available (was: In Progress) > Fsshell mv fails if port usage doesn't match in src and

[jira] [Work started] (HDFS-10239) Fsshell mv fails if port usage doesn't match in src and destination paths

2016-03-30 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10239 started by Kuhu Shukla. -- > Fsshell mv fails if port usage doesn't match in src and destination paths >

[jira] [Updated] (HDFS-10239) Fsshell mv fails if port usage doesn't match in src and destination paths

2016-03-30 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10239: --- Attachment: HDFS-10239.001.patch Attaching initial patch. > Fsshell mv fails if port usage doesn't

[jira] [Created] (HDFS-10239) Fsshell mv fails if port usage doesn't match in src and destination paths

2016-03-30 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-10239: -- Summary: Fsshell mv fails if port usage doesn't match in src and destination paths Key: HDFS-10239 URL: https://issues.apache.org/jira/browse/HDFS-10239 Project: Hadoop

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-03-19 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201926#comment-15201926 ] Kuhu Shukla commented on HDFS-9958: --- Adding [~walter.k.su] for comments on the initial proposal patch,

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-03-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Status: Patch Available (was: Open) > BlockManager#createLocatedBlocks can throw NPE for corruptBlocks

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-03-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Attachment: HDFS-9958.001.patch Attaching v1 of the patch which as per a simpler approach, truncates the

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-03-14 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193948#comment-15193948 ] Kuhu Shukla commented on HDFS-9958: --- The patch applies to branch-2.7 only. >

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-03-14 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9958: -- Attachment: HDFS-9958-Test-v1.txt Attaching a sample test that recreates the issue. Please note the test

[jira] [Created] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-03-14 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-9958: - Summary: BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. Key: HDFS-9958 URL: https://issues.apache.org/jira/browse/HDFS-9958 Project:

[jira] [Commented] (HDFS-9880) TestDatanodeRegistration fails occasionally

2016-03-01 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174354#comment-15174354 ] Kuhu Shukla commented on HDFS-9880: --- +1 (non-binding). Lgtm. > TestDatanodeRegistration fails

[jira] [Commented] (HDFS-9855) TestAuditLoggerWithCommand#testSetQuota fails with an unexpected AccessCOntrolException

2016-02-26 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169168#comment-15169168 ] Kuhu Shukla commented on HDFS-9855: --- Requesting [~kihwal] for review/comments. Thanks a lot! >

[jira] [Updated] (HDFS-9855) TestAuditLoggerWithCommand#testSetQuota fails with an unexpected AccessCOntrolException

2016-02-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9855: -- Status: Patch Available (was: Open) > TestAuditLoggerWithCommand#testSetQuota fails with an unexpected

[jira] [Updated] (HDFS-9855) TestAuditLoggerWithCommand#testSetQuota fails with an unexpected AccessCOntrolException

2016-02-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9855: -- Attachment: HDFS-9855-branch-2.001.patch Attaching patch with work around for HDFS-8332. >

[jira] [Updated] (HDFS-9395) Make HDFS audit logging consistant

2016-02-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Status: Patch Available (was: Reopened) > Make HDFS audit logging consistant >

[jira] [Reopened] (HDFS-9395) Make HDFS audit logging consistant

2016-02-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reopened HDFS-9395: --- Re-opening to submit 2.7 patch. > Make HDFS audit logging consistant > --

[jira] [Updated] (HDFS-9395) Make HDFS audit logging consistant

2016-02-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Attachment: HDFS-9395-branch-2.7.002.patch Adding v2 of the branch-2.7 patch with the modified test

[jira] [Commented] (HDFS-9855) TestAuditLoggerWithCommand#testSetQuota fails with an unexpected AccessCOntrolException

2016-02-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167391#comment-15167391 ] Kuhu Shukla commented on HDFS-9855: --- Related to the fix for HDFS-8332 not being there in branch-2 and

[jira] [Updated] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2016-02-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-5040: -- Status: In Progress (was: Patch Available) > Audit log for admin commands/ logging output of all DFS

[jira] [Assigned] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2016-02-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned HDFS-5040: - Assignee: Kuhu Shukla > Audit log for admin commands/ logging output of all DFS admin commands >

[jira] [Updated] (HDFS-9395) Make HDFS audit logging consistant

2016-02-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Attachment: HDFS-9395-branch-2.7.001.patch Adding patch for branch-2.7, I have added @Ignore to

[jira] [Updated] (HDFS-9855) TestAuditLoggerWithCommand#testSetQuota fails with an unexpected AccessCOntrolException

2016-02-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9855: -- Affects Version/s: 2.7.2 > TestAuditLoggerWithCommand#testSetQuota fails with an unexpected >

[jira] [Created] (HDFS-9855) TestAuditLoggerWithCommand#testSetQuota fails with an unexpected AccessCOntrolException

2016-02-24 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-9855: - Summary: TestAuditLoggerWithCommand#testSetQuota fails with an unexpected AccessCOntrolException Key: HDFS-9855 URL: https://issues.apache.org/jira/browse/HDFS-9855

[jira] [Commented] (HDFS-9258) NN should indicate which nodes are stale

2016-02-23 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158997#comment-15158997 ] Kuhu Shukla commented on HDFS-9258: --- Requesting [~daryn] for review/comments. Thanks a lot! > NN should

[jira] [Commented] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2016-02-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157106#comment-15157106 ] Kuhu Shukla commented on HDFS-5040: --- [~sinchii], If you are not currently working on this, may I assign

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

2016-02-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157103#comment-15157103 ] Kuhu Shukla commented on HDFS-9395: --- Thanks Vinayakumar. I will go ahead and assign HDFS-5040 to myself.

[jira] [Updated] (HDFS-9395) Make HDFS audit logging consistant

2016-02-19 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Attachment: HDFS-9395.007.patch I have updated the patch per comments from Vinayakumar which fixes the

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

2016-02-19 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154288#comment-15154288 ] Kuhu Shukla commented on HDFS-9395: --- Thanks [~vinayrpet] for the comments. {{setErasureCodingPolicy}}

[jira] [Updated] (HDFS-9395) Make HDFS audit logging consistant

2016-02-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Attachment: HDFS-9395.006.patch Updating patch based on latest comments. Removed the null check for

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

2016-02-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153517#comment-15153517 ] Kuhu Shukla commented on HDFS-9395: --- Thanks [~cnauroth]! One follow up question, Currently

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

2016-02-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148769#comment-15148769 ] Kuhu Shukla commented on HDFS-9395: --- [~kihwal], [~cnauroth], [~vinayrpet], Requesting for comments on

[jira] [Commented] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-09 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139027#comment-15139027 ] Kuhu Shukla commented on HDFS-9395: --- Thank you Vinayakumar. While making this change I also noticed the

[jira] [Commented] (HDFS-9779) TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value

2016-02-09 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140221#comment-15140221 ] Kuhu Shukla commented on HDFS-9779: --- Thank you Uma! > TestReplicationPolicyWithNodeGroup NODE variable

[jira] [Updated] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Attachment: HDFS-9395.005.patch I have updated the patch. The patch does not change audit logging for :

[jira] [Commented] (HDFS-9258) NN should indicate which nodes are stale

2016-02-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137430#comment-15137430 ] Kuhu Shukla commented on HDFS-9258: --- Since DM is the one aware of staleInterval through

[jira] [Created] (HDFS-9779) TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value

2016-02-08 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-9779: - Summary: TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value Key: HDFS-9779 URL: https://issues.apache.org/jira/browse/HDFS-9779 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9779) TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value

2016-02-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9779: -- Attachment: HDFS-9779.001.patch Attaching patch. No test included since the only change is the test

[jira] [Updated] (HDFS-9779) TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value

2016-02-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9779: -- Affects Version/s: 2.7.2 > TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value >

[jira] [Updated] (HDFS-9779) TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value

2016-02-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9779: -- Status: Patch Available (was: Open) > TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack

[jira] [Commented] (HDFS-9779) TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value

2016-02-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137833#comment-15137833 ] Kuhu Shukla commented on HDFS-9779: --- Test failures are unrelated. Request for comments, [~kihwal],

[jira] [Updated] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Attachment: HDFS-9395.004.patch Updating patch with corrected checkstyle warnings. > HDFS operations

[jira] [Commented] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136623#comment-15136623 ] Kuhu Shukla commented on HDFS-9395: --- Failing tests from last pre-commit were mostly due to timeouts and

[jira] [Commented] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136626#comment-15136626 ] Kuhu Shukla commented on HDFS-9395: --- Thank you [~vinayrpet] for the detailed comments. Will update patch

[jira] [Commented] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136614#comment-15136614 ] Kuhu Shukla commented on HDFS-9395: --- Thank Chris! I have followed up on HDFS-5730 and will also update

[jira] [Commented] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-05 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134380#comment-15134380 ] Kuhu Shukla commented on HDFS-9395: --- I will update the patch shortly to also cover cachePool operations.

[jira] [Updated] (HDFS-9762) NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values

2016-02-05 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9762: -- Attachment: HDFS-9762.003.patch Attaching revised patch that takes out the temporary change to

[jira] [Updated] (HDFS-9762) NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values

2016-02-05 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9762: -- Attachment: HDFS-9762.002.patch Fixing the checkstyle and the if condition in

[jira] [Updated] (HDFS-9395) HDFS operations vary widely in which failures they put in the audit log and which they leave out

2016-02-05 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Attachment: HDFS-9395.003.patch Updated patch with changes to cachepool and other methods that need to

[jira] [Commented] (HDFS-5730) Inconsistent Audit logging for HDFS APIs

2016-02-05 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135362#comment-15135362 ] Kuhu Shukla commented on HDFS-5730: --- [~vinayrpet], May we close this JIRA and continue the proposed work

[jira] [Work started] (HDFS-9762) NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values

2016-02-04 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9762 started by Kuhu Shukla. - > NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid > 'loc'

[jira] [Created] (HDFS-9762) NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values

2016-02-04 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-9762: - Summary: NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values Key: HDFS-9762 URL: https://issues.apache.org/jira/browse/HDFS-9762

[jira] [Updated] (HDFS-9762) NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values

2016-02-04 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9762: -- Attachment: HDFS-9762.001.patch Adding a preliminary patch to get review comments and thoughts on a

[jira] [Updated] (HDFS-9762) NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values

2016-02-04 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9762: -- Status: Patch Available (was: In Progress) > NetworkTopologyWithNodeGroup.getNodeGroup() can loop

[jira] [Updated] (HDFS-9258) NN should indicate which nodes are stale

2016-02-03 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9258: -- Attachment: HDFS-9258-v2.patch Rebasing patch. > NN should indicate which nodes are stale >

[jira] [Updated] (HDFS-9395) getContentSummary and other FS operations are audit logged as success even if failed

2016-02-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Attachment: HDFS-9395.002.patch Updated patch that addresses findbugs and checkstyle issues. The test

[jira] [Updated] (HDFS-9258) NN should indicate which nodes are stale

2016-02-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9258: -- Status: Patch Available (was: In Progress) > NN should indicate which nodes are stale >

[jira] [Updated] (HDFS-9258) NN should indicate which nodes are stale

2016-02-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9258: -- Status: In Progress (was: Patch Available) > NN should indicate which nodes are stale >

<    1   2   3   >