[jira] [Commented] (HDFS-12969) DfsAdmin listOpenFiles should report files by type

2020-07-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156508#comment-17156508 ] hemanthboyina commented on HDFS-12969: -- test failures are not related , please review > DfsAdmin

[jira] [Updated] (HDFS-12969) DfsAdmin listOpenFiles should report files by type

2020-07-12 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-12969: - Attachment: HDFS-12969.002.patch > DfsAdmin listOpenFiles should report files by type >

[jira] [Commented] (HDFS-12969) DfsAdmin listOpenFiles should report files by type

2020-07-11 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156118#comment-17156118 ] hemanthboyina commented on HDFS-12969: -- discussed with manoj offline , thanks [~manojg] for letting

[jira] [Updated] (HDFS-12969) DfsAdmin listOpenFiles should report files by type

2020-07-11 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-12969: - Attachment: HDFS-12969.001.patch Status: Patch Available (was: Open) > DfsAdmin

[jira] [Commented] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-07-03 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151150#comment-17151150 ] hemanthboyina commented on HDFS-15446: -- [~ayushtkn] we can go ahead  > CreateSnapshotOp fails

[jira] [Commented] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-07-01 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149591#comment-17149591 ] hemanthboyina commented on HDFS-15446: -- thanks [~sodonnell] for your work , i  had a small question

[jira] [Commented] (HDFS-15420) approx scheduled blocks not reseting over time

2020-06-27 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146956#comment-17146956 ] hemanthboyina commented on HDFS-15420: -- you can check timeoutReReplications ( Number of timed out

[jira] [Commented] (HDFS-15434) RBF: MountTableResolver#getDestinationForPath failing with AssertionError from localCache

2020-06-24 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143851#comment-17143851 ] hemanthboyina commented on HDFS-15434: -- Though we couldn't reproduce the issue , we doubt this issue

[jira] [Created] (HDFS-15434) RBF: MountTableResolver#getDestinationForPath failing with AssertionError from localCache

2020-06-24 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15434: Summary: RBF: MountTableResolver#getDestinationForPath failing with AssertionError from localCache Key: HDFS-15434 URL: https://issues.apache.org/jira/browse/HDFS-15434

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-06-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140699#comment-17140699 ] hemanthboyina commented on HDFS-15415: -- thanks [~sodonnell] for your analysis  after taking the

[jira] [Commented] (HDFS-15420) approx scheduled blocks not reseting over time

2020-06-18 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139468#comment-17139468 ] hemanthboyina commented on HDFS-15420: -- thanks [~maxmzkr] for providing the report , a quick

[jira] [Commented] (HDFS-15416) The addStorageLocations() method in the DataStorage class is not perfect.

2020-06-17 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138634#comment-17138634 ] hemanthboyina commented on HDFS-15416: -- thanks for filing the issue [~jianghuazhu] successLocations

[jira] [Commented] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-17 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138627#comment-17138627 ] hemanthboyina commented on HDFS-15406: -- thanks [~sodonnell] , the test failure was related to this

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-17 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15406: - Attachment: HDFS-15406.002.patch > Improve the speed of Datanode Block Scan >

[jira] [Commented] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-17 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138275#comment-17138275 ] hemanthboyina commented on HDFS-15406: -- thanks [~sodonnell] for the comment {quote}If you don't want

[jira] [Commented] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-16 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136730#comment-17136730 ] hemanthboyina commented on HDFS-15406: -- thanks [~sodonnell] for the comment  {quote} # After you

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-15 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15406: - Attachment: HDFS-15406.001.patch Status: Patch Available (was: Open) > Improve the

[jira] [Commented] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-15 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135767#comment-17135767 ] hemanthboyina commented on HDFS-15406: -- thanks [~brahmareddy] for the comment {quote}Not sure,

[jira] [Commented] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-15 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135756#comment-17135756 ] hemanthboyina commented on HDFS-15406: -- discussed with [~pilchard] offline  , the major drawback in

[jira] [Commented] (HDFS-15403) NPE in FileIoProvider#transferToSocketFully

2020-06-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134907#comment-17134907 ] hemanthboyina commented on HDFS-15403: -- {quote}Shouldn't we call onFailure() when e.getMessage() is

[jira] [Updated] (HDFS-15403) NPE in FileIoProvider#transferToSocketFully

2020-06-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15403: - Attachment: HDFS-15403.002.patch > NPE in FileIoProvider#transferToSocketFully >

[jira] [Commented] (HDFS-15403) NPE in FileIoProvider#transferToSocketFully

2020-06-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134700#comment-17134700 ] hemanthboyina commented on HDFS-15403: -- thanks [~tasanuma] for the review  {quote} we should call

[jira] [Commented] (HDFS-15403) NPE in FileIoProvider#transferToSocketFully

2020-06-12 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134177#comment-17134177 ] hemanthboyina commented on HDFS-15403: -- thanks for the comment [~elgoiri]  , it was a rare scenario

[jira] [Commented] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-11 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133296#comment-17133296 ] hemanthboyina commented on HDFS-15391: -- {quote}The block size should be 108764672 in the first

[jira] [Commented] (HDFS-15408) Failed execution caused by SocketTimeoutException

2020-06-11 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133225#comment-17133225 ] hemanthboyina commented on HDFS-15408: -- thanks for the filing the issue [~echohlne] at present we

[jira] [Commented] (HDFS-12969) DfsAdmin listOpenFiles should report files by type

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130934#comment-17130934 ] hemanthboyina commented on HDFS-12969: -- any suggestions for this   [~liuml07]  [~elgoiri] >

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130927#comment-17130927 ] hemanthboyina commented on HDFS-15351: -- yes  [~elgoiri]  , i think we can go ahead > Blocks

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130923#comment-17130923 ] hemanthboyina commented on HDFS-15372: -- thanks for the patch [~sodonnell] , the changes looks good

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130521#comment-17130521 ] hemanthboyina commented on HDFS-15160: -- though the scanner takes more time to scan all the blocks ,

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15406: - Description: In our customer cluster we have approx 10M blocks in one datanode  the Datanode to

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15406: - Description: In our customer cluster we have approx 10M blocks in one datanode  When Datanode

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15406: - Description: In our customer cluster we have approx 10M blocks in one datanode  When Datanode

[jira] [Created] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-10 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15406: Summary: Improve the speed of Datanode Block Scan Key: HDFS-15406 URL: https://issues.apache.org/jira/browse/HDFS-15406 Project: Hadoop HDFS Issue Type:

[jira] [Comment Edited] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130497#comment-17130497 ] hemanthboyina edited comment on HDFS-15160 at 6/10/20, 10:48 AM: - thanks

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130497#comment-17130497 ] hemanthboyina commented on HDFS-15160: -- thanks [~pilchard] for the report ,  HDFS-15150 has

[jira] [Updated] (HDFS-15403) NPE in FileIoProvider#transferToSocketFully

2020-06-09 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15403: - Attachment: HDFS-15403.001.patch Status: Patch Available (was: Open) > NPE in

[jira] [Created] (HDFS-15403) NPE in FileIoProvider#transferToSocketFully

2020-06-09 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15403: Summary: NPE in FileIoProvider#transferToSocketFully Key: HDFS-15403 URL: https://issues.apache.org/jira/browse/HDFS-15403 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-15403) NPE in FileIoProvider#transferToSocketFully

2020-06-09 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15403: - Description: {code:java} [DataXceiver for client  at /127.0.0.1:41904 [Sending block

[jira] [Commented] (HDFS-12969) DfsAdmin listOpenFiles should report files by type

2020-06-09 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129660#comment-17129660 ] hemanthboyina commented on HDFS-12969: -- now in the present code , we can list all open files or can

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

2020-06-08 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128566#comment-17128566 ] hemanthboyina commented on HDFS-15372: -- thanks for the work [~sodonnell]  , overall the  code looks

[jira] [Commented] (HDFS-15390) client fails forever when namenode ipaddr changed

2020-06-08 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128243#comment-17128243 ] hemanthboyina commented on HDFS-15390: -- [~seanlook] you can click on the More option specified under

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

2020-06-07 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127661#comment-17127661 ] hemanthboyina commented on HDFS-15372: -- thanks for the very clear explanation [~sodonnell] > Files

[jira] [Commented] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

2020-06-07 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127656#comment-17127656 ] hemanthboyina commented on HDFS-15378: -- thanks for the comment [~elgoiri] i just had taken some

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-06-06 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127413#comment-17127413 ] hemanthboyina commented on HDFS-15351: -- thanks [~belugabehr] for the review  > Blocks Scheduled

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

2020-06-06 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127412#comment-17127412 ] hemanthboyina commented on HDFS-15372: -- thanks for good analysis [~sodonnell] {quote}With the 001

[jira] [Commented] (HDFS-15246) ArrayIndexOfboundsException in BlockManager CreateLocatedBlock

2020-06-03 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125141#comment-17125141 ] hemanthboyina commented on HDFS-15246: -- thanks for the review ![~elgoiri] test failures are not

[jira] [Commented] (HDFS-15375) Reconstruction Work should not happen for Corrupt Block

2020-06-03 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124998#comment-17124998 ] hemanthboyina commented on HDFS-15375: -- test failures were not related {quote}We can't remove 

[jira] [Commented] (HDFS-15246) ArrayIndexOfboundsException in BlockManager CreateLocatedBlock

2020-05-31 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120463#comment-17120463 ] hemanthboyina commented on HDFS-15246: -- thanks for the review [~elgoiri] have updated the patch ,

[jira] [Updated] (HDFS-15246) ArrayIndexOfboundsException in BlockManager CreateLocatedBlock

2020-05-31 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15246: - Attachment: HDFS-15246.003.patch > ArrayIndexOfboundsException in BlockManager

[jira] [Commented] (HDFS-15375) Reconstruction Work should not happen for Corrupt Block

2020-05-29 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119811#comment-17119811 ] hemanthboyina commented on HDFS-15375: -- thanks [~surendrasingh] for the comment we have a

[jira] [Commented] (HDFS-14901) RBF: Add Encryption Zone related ClientProtocol APIs

2020-05-29 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119660#comment-17119660 ] hemanthboyina commented on HDFS-14901: -- we have hit this issue again {quote}Should we do the

[jira] [Commented] (HDFS-15246) ArrayIndexOfboundsException in BlockManager CreateLocatedBlock

2020-05-28 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119220#comment-17119220 ] hemanthboyina commented on HDFS-15246: -- thanks [~elgoiri] for review  i have updated the patch ,

[jira] [Updated] (HDFS-15246) ArrayIndexOfboundsException in BlockManager CreateLocatedBlock

2020-05-28 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15246: - Attachment: HDFS-15246.002.patch > ArrayIndexOfboundsException in BlockManager

[jira] [Updated] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

2020-05-28 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15378: - Attachment: HDFS-15378.001.patch Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

2020-05-28 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118963#comment-17118963 ] hemanthboyina commented on HDFS-15378: -- there was a slight delay in the test case run , if we wait

[jira] [Created] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

2020-05-28 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15378: Summary: TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk Key: HDFS-15378 URL: https://issues.apache.org/jira/browse/HDFS-15378

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-27 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117993#comment-17117993 ] hemanthboyina commented on HDFS-15351: -- {quote} I've always hated this list to array interface...

[jira] [Updated] (HDFS-15246) ArrayIndexOfboundsException in BlockManager CreateLocatedBlock

2020-05-27 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15246: - Attachment: HDFS-15246.001.patch Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-15375) Reconstruction Work should not happen for Corrupt Block

2020-05-27 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117980#comment-17117980 ] hemanthboyina commented on HDFS-15375: -- ran test failures in local , seems not related  

[jira] [Commented] (HDFS-15376) Update the error about command line POST in httpfs documentation

2020-05-26 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116921#comment-17116921 ] hemanthboyina commented on HDFS-15376: -- No , this is fine [~elgoiri] > Update the error about

[jira] [Updated] (HDFS-15375) Reconstruction Work should not happen for Corrupt Block

2020-05-26 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15375: - Attachment: HDFS-15375.001.patch Status: Patch Available (was: Open) > Reconstruction

[jira] [Commented] (HDFS-14984) HDFS setQuota: Error message should be added for invalid input max range value to hdfs dfsadmin -setQuota command

2020-05-26 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116475#comment-17116475 ] hemanthboyina commented on HDFS-14984: -- thanks for the interest [~zhaoyim]  you can work on this

[jira] [Updated] (HDFS-15375) Reconstruction Work should not happen for Corrupt Block

2020-05-25 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15375: - Description: In BlockManager#updateNeededReconstructions , while updating the

[jira] [Updated] (HDFS-15375) Reconstruction Work should not happen for Corrupt Block

2020-05-25 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15375: - Attachment: HDFS-15375-testrepro.patch > Reconstruction Work should not happen for Corrupt Block

[jira] [Created] (HDFS-15375) Reconstruction Work should not happen for Corrupt Block

2020-05-25 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15375: Summary: Reconstruction Work should not happen for Corrupt Block Key: HDFS-15375 URL: https://issues.apache.org/jira/browse/HDFS-15375 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-24 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115122#comment-17115122 ] hemanthboyina edited comment on HDFS-15288 at 5/24/20, 11:07 AM: - Good

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-24 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115122#comment-17115122 ] hemanthboyina commented on HDFS-15288: -- Good work [~ayushtkn] , just a small doubt  > Add Available

[jira] [Commented] (HDFS-15362) FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks

2020-05-21 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113450#comment-17113450 ] hemanthboyina commented on HDFS-15362: -- thanks [~elgoiri] for the review i have updated the patch ,

[jira] [Updated] (HDFS-15362) FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks

2020-05-21 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15362: - Attachment: HDFS-15362.002.patch > FileWithSnapshotFeature#updateQuotaAndCollectBlocks should

[jira] [Commented] (HDFS-15362) FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111421#comment-17111421 ] hemanthboyina commented on HDFS-15362: -- thanks [~elgoiri] for the review we call

[jira] [Updated] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15363: - Attachment: HDFS-15363.001.patch Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15363: - Attachment: HDFS-15363-testrepro.patch > BlockPlacementPolicyWithNodeGroup should validate

[jira] [Updated] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15363: - Description: BlockPlacementPolicyWithNodeGroup  type casts the initialized  clusterMap 

[jira] [Created] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15363: Summary: BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology Key: HDFS-15363 URL: https://issues.apache.org/jira/browse/HDFS-15363

[jira] [Updated] (HDFS-15362) FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks

2020-05-18 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15362: - Description: FileWithSnapshotFeature#updateQuotaAndCollectBlocks uses list to collect blocks 

[jira] [Updated] (HDFS-15362) FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks

2020-05-18 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15362: - Attachment: HDFS-15362.001.patch Status: Patch Available (was: Open) >

[jira] [Created] (HDFS-15362) FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks

2020-05-18 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15362: Summary: FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks Key: HDFS-15362 URL: https://issues.apache.org/jira/browse/HDFS-15362

[jira] [Commented] (HDFS-14762) "Path(Path/String parent, String child)" will fail when "child" contains ":"

2020-05-18 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109947#comment-17109947 ] hemanthboyina commented on HDFS-14762: -- i think this issue also relates to IPV6  >

[jira] [Updated] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15351: - Attachment: HDFS-15351.003.patch > Blocks Scheduled Count was wrong on Truncate >

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106503#comment-17106503 ] hemanthboyina commented on HDFS-15351: -- thanks for the review [~elgoiri] have updated the patch ,

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106486#comment-17106486 ] hemanthboyina commented on HDFS-15351: -- thanks for the review [~elgoiri] i have updated the patch ,

[jira] [Updated] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-13 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15351: - Attachment: HDFS-15351.002.patch > Blocks Scheduled Count was wrong on Truncate >

[jira] [Comment Edited] (HDFS-15308) TestReconstructStripedFile.testNNSendsErasureCodingTasks is flaky

2020-05-11 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104747#comment-17104747 ] hemanthboyina edited comment on HDFS-15308 at 5/11/20, 6:47 PM: thanks

[jira] [Commented] (HDFS-15308) TestReconstructStripedFile.testNNSendsErasureCodingTasks is flaky

2020-05-11 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104747#comment-17104747 ] hemanthboyina commented on HDFS-15308: -- thanks for the work here i think 

[jira] [Updated] (HDFS-15308) TestReconstructStripedFile.testNNSendsErasureCodingTasks is flaky

2020-05-11 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15308: - Attachment: HDFS-15308.001.patch Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-11 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15351: - Attachment: HDFS-15351.001.patch Status: Patch Available (was: Open) > Blocks Scheduled

[jira] [Updated] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-11 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15351: - Description: On truncate and append we remove the blocks from Reconstruction Queue  On removing

[jira] [Created] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-05-11 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15351: Summary: Blocks Scheduled Count was wrong on Truncate Key: HDFS-15351 URL: https://issues.apache.org/jira/browse/HDFS-15351 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15335) Report top N metrics for files in get listing ops

2020-05-05 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100399#comment-17100399 ] hemanthboyina commented on HDFS-15335: -- Hi [~csun] it's a good improvement  Are you started working

[jira] [Updated] (HDFS-15332) Quota Space consumed was wrong in truncate with Snapshots

2020-05-04 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15332: - Description: On calculating space quota usage {code:java} if (file.getBlocks() != null) {

[jira] [Updated] (HDFS-15332) Quota Space consumed was wrong in truncate with Snapshots

2020-05-04 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15332: - Attachment: HDFS-15332.001.patch Status: Patch Available (was: Open) > Quota Space

[jira] [Created] (HDFS-15332) Quota Space consumed was wrong in truncate with Snapshots

2020-05-04 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15332: Summary: Quota Space consumed was wrong in truncate with Snapshots Key: HDFS-15332 URL: https://issues.apache.org/jira/browse/HDFS-15332 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15316) Deletion failure should not remove directory from snapshottables

2020-05-01 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097474#comment-17097474 ] hemanthboyina commented on HDFS-15316: -- thanks [~ayushtkn] for review updated the patch , please

[jira] [Updated] (HDFS-15316) Deletion failure should not remove directory from snapshottables

2020-05-01 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15316: - Attachment: HDFS-15316.002.patch > Deletion failure should not remove directory from

[jira] [Updated] (HDFS-15316) Deletion failure should not remove directory from snapshottables

2020-04-30 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15316: - Attachment: HDFS-15316.001.patch Status: Patch Available (was: Open) > Deletion failure

[jira] [Updated] (HDFS-15316) Deletion failure should not remove directory from snapshottables

2020-04-30 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15316: - Description: If deleting a directory doesn't succeeds , still we are removing directory from

[jira] [Commented] (HDFS-15302) Backport HDFS-15286 to branch-2.x

2020-04-30 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096878#comment-17096878 ] hemanthboyina commented on HDFS-15302: -- thanks [~aajisaka] for the review updated the patch ,

[jira] [Created] (HDFS-15316) Deletion failure should not remove directory from snapshottables

2020-04-30 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15316: Summary: Deletion failure should not remove directory from snapshottables Key: HDFS-15316 URL: https://issues.apache.org/jira/browse/HDFS-15316 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15302) Backport HDFS-15286 to branch-2.x

2020-04-30 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15302: - Attachment: HDFS-15302-branch-2.10-02.patch > Backport HDFS-15286 to branch-2.x >

[jira] [Commented] (HDFS-15265) HttpFS: validate content-type in HttpFSUtils

2020-04-29 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095734#comment-17095734 ] hemanthboyina commented on HDFS-15265: -- updated the patch , please review [~elgoiri] > HttpFS:

  1   2   3   4   5   6   7   8   9   >