[jira] [Updated] (HDFS-15151) Use TransmitFile for file to socket data transfer

2020-01-30 Thread Lukas Majercak (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-15151: -- Status: Patch Available (was: In Progress) > Use TransmitFile for file to socket data

[jira] [Comment Edited] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-30 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027046#comment-17027046 ] Ctest edited comment on HDFS-15124 at 1/30/20 10:22 PM: Hi, [~elgoiri]  I have

[jira] [Comment Edited] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-30 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027046#comment-17027046 ] Ctest edited comment on HDFS-15124 at 1/30/20 10:22 PM: Hi, [~elgoiri]  I have

[jira] [Assigned] (HDFS-15111) start / stopStandbyServices() should log which service it is transitioning to/from.

2020-01-30 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li reassigned HDFS-15111: - Assignee: Xieming Li > start / stopStandbyServices() should log which service it is

[jira] [Commented] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-30 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027147#comment-17027147 ] Ahmed Hussein commented on HDFS-13179: -- Yes please [~inigoiri]. I appreciate your time committing to

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-30 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027055#comment-17027055 ] Íñigo Goiri commented on HDFS-15124: The tests look reasonable. We may want to fix the checkstyle.

[jira] [Commented] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-30 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027142#comment-17027142 ] Íñigo Goiri commented on HDFS-13179: [~ahussein] you attached a branch-2.10 patch, do you want to

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-30 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027144#comment-17027144 ] Íñigo Goiri commented on HDFS-15124: Let's split the line to fix the checkstyle. > Crashing bugs in

[jira] [Commented] (HDFS-15147) LazyPersistTestCase wait logic is error pruned

2020-01-30 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027051#comment-17027051 ] Ahmed Hussein commented on HDFS-15147: -- Thanks [~inigoiri] for the comments! I will work on the

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-30 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027070#comment-17027070 ] Ctest commented on HDFS-15124: -- [~elgoiri] Thank you for pointing this out. I have already uploaded a new

[jira] [Commented] (HDFS-15147) LazyPersistTestCase wait logic is error pruned

2020-01-30 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027057#comment-17027057 ] Íñigo Goiri commented on HDFS-15147: I think getting rid of guava dependencies is in general a good

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-30 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027046#comment-17027046 ] Ctest commented on HDFS-15124: -- [~elgoiri]  I have already run the 4 failed test classes with my patch in

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-30 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Attachment: HDFS-15124.003.patch > Crashing bugs in NameNode when using a valid configuration for >

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027140#comment-17027140 ] Hadoop QA commented on HDFS-15124: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15151) Use TransmitFile for file to socket data transfer

2020-01-30 Thread Lukas Majercak (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-15151: -- Description: Proposing to give an option to use TransmitFile Windows function for file to

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027151#comment-17027151 ] Hadoop QA commented on HDFS-15124: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-30 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Attachment: (was: HDFS-15124.004.patch) > Crashing bugs in NameNode when using a valid configuration for >

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027262#comment-17027262 ] Ayush Saxena commented on HDFS-15115: - Thanx Everyone for the work here? Well there are two

[jira] [Commented] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027263#comment-17027263 ] Ayush Saxena commented on HDFS-15127: - [~elgoiri] plans updating? just removing the directory part of

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-30 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Attachment: HDFS-15124.004.patch > Crashing bugs in NameNode when using a valid configuration for >

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

2020-01-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15150: - Description: HDFS-9668 pointed out the issues around the DN lock being a point of

[jira] [Updated] (HDFS-15151) Use TransmitFile for file to socket data transfer

2020-01-30 Thread Lukas Majercak (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-15151: -- Component/s: datanode > Use TransmitFile for file to socket data transfer >

[jira] [Commented] (HDFS-15140) Replace FoldedTreeSet in Datanode with SortedSet or TreeMap

2020-01-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026925#comment-17026925 ] Stephen O'Donnell commented on HDFS-15140: -- All failing tests pass locally so I think they are

[jira] [Updated] (HDFS-15151) Use TransmitFile for file to socket data transfer

2020-01-30 Thread Lukas Majercak (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-15151: -- Labels: NIO Windows datanode (was: ) > Use TransmitFile for file to socket data transfer >

[jira] [Updated] (HDFS-15151) Use TransmitFile for file to socket data transfer

2020-01-30 Thread Lukas Majercak (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-15151: -- Affects Version/s: 3.4.0 3.3.1 3.2.2

[jira] [Work started] (HDFS-15151) Use TransmitFile for file to socket data transfer

2020-01-30 Thread Lukas Majercak (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15151 started by Lukas Majercak. - > Use TransmitFile for file to socket data transfer >

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2020-01-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026854#comment-17026854 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-15151) Use TransmitFile for file to socket data transfer

2020-01-30 Thread Lukas Majercak (Jira)
Lukas Majercak created HDFS-15151: - Summary: Use TransmitFile for file to socket data transfer Key: HDFS-15151 URL: https://issues.apache.org/jira/browse/HDFS-15151 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15151) Use TransmitFile for file to socket data transfer

2020-01-30 Thread Lukas Majercak (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-15151: -- Description: Proposing to give an option to use TransmitFile > Use TransmitFile for file to

[jira] [Updated] (HDFS-15151) Use TransmitFile for file to socket data transfer

2020-01-30 Thread Lukas Majercak (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-15151: -- Description: Proposing to give an option to use TransmitFile Windows function for file to

[jira] [Commented] (HDFS-15147) LazyPersistTestCase wait logic is error pruned

2020-01-30 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026958#comment-17026958 ] Íñigo Goiri commented on HDFS-15147: This looks very good. A few minor comments: * Avoid the blank

[jira] [Commented] (HDFS-15119) Allow expiration of cached locations in DFSInputStream

2020-01-30 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026774#comment-17026774 ] Ahmed Hussein commented on HDFS-15119: -- Thanks [~ayushtkn]. I agree with you. I will try to

[jira] [Commented] (HDFS-15147) LazyPersistTestCase wait logic is error pruned

2020-01-30 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026775#comment-17026775 ] Hadoop QA commented on HDFS-15147: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15147) LazyPersistTestCase wait logic is error pruned

2020-01-30 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15147: - Attachment: HDFS-15147-branch-2.10.001.patch > LazyPersistTestCase wait logic is error pruned >

[jira] [Created] (HDFS-15149) TestDeadNodeDetection test cases time-out

2020-01-30 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15149: Summary: TestDeadNodeDetection test cases time-out Key: HDFS-15149 URL: https://issues.apache.org/jira/browse/HDFS-15149 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-15150) Introduce read write lock to Datanode

2020-01-30 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-15150: Summary: Introduce read write lock to Datanode Key: HDFS-15150 URL: https://issues.apache.org/jira/browse/HDFS-15150 Project: Hadoop HDFS Issue