[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814535#comment-17814535 ] ASF GitHub Bot commented on HDFS-17299: --- shahrs87 commented on code in PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813900#comment-17813900 ] ASF GitHub Bot commented on HDFS-17299: --- hadoop-yetus commented on PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813866#comment-17813866 ] ASF GitHub Bot commented on HDFS-17299: --- ritegarg commented on PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813865#comment-17813865 ] ASF GitHub Bot commented on HDFS-17299: --- ritegarg commented on PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813864#comment-17813864 ] ASF GitHub Bot commented on HDFS-17299: --- ritegarg commented on code in PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813851#comment-17813851 ] ASF GitHub Bot commented on HDFS-17299: --- shahrs87 commented on PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813829#comment-17813829 ] ASF GitHub Bot commented on HDFS-17299: --- shahrs87 commented on PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813828#comment-17813828 ] ASF GitHub Bot commented on HDFS-17299: --- shahrs87 commented on code in PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813477#comment-17813477 ] ASF GitHub Bot commented on HDFS-17299: --- hadoop-yetus commented on PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813476#comment-17813476 ] ASF GitHub Bot commented on HDFS-17299: --- hadoop-yetus commented on PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813447#comment-17813447 ] ASF GitHub Bot commented on HDFS-17299: --- hadoop-yetus commented on PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-02-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813188#comment-17813188 ] ASF GitHub Bot commented on HDFS-17299: --- hadoop-yetus commented on PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813033#comment-17813033 ] ASF GitHub Bot commented on HDFS-17299: --- ritegarg commented on PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-01-31 Thread Ritesh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812843#comment-17812843 ] Ritesh commented on HDFS-17299: --- Update: Checking these test failures, will update here once ready to

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-01-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812656#comment-17812656 ] ASF GitHub Bot commented on HDFS-17299: --- hadoop-yetus commented on PR #6513: URL:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-01-30 Thread Ritesh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812531#comment-17812531 ] Ritesh commented on HDFS-17299: --- [~ayushtkn] [~shahrs87]  Please review

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-01-02 Thread Rushabh Shah (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801889#comment-17801889 ] Rushabh Shah commented on HDFS-17299: - Thank you [~ayushtkn]  > HDFS is not rack failure tolerant

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-01-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801881#comment-17801881 ] Ayush Saxena commented on HDFS-17299: - Done!!! > HDFS is not rack failure tolerant while creating a

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-01-02 Thread Rushabh Shah (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801867#comment-17801867 ] Rushabh Shah commented on HDFS-17299: - [~gargrite] is interested to work on this jira. [~ayushtkn]  

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-27 Thread Rushabh Shah (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800840#comment-17800840 ] Rushabh Shah commented on HDFS-17299: - Thank you [~ayushtkn]  [~hexiaoqiao]  [~tasanuma]  for the

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800322#comment-17800322 ] Takanobu Asanuma commented on HDFS-17299: - I also agree with the implementation of a bestEffort

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800309#comment-17800309 ] Xiaoqiao He commented on HDFS-17299: {quote}Maybe we should consider dropping the datanode from the

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800248#comment-17800248 ] Ayush Saxena commented on HDFS-17299: - Yeps,  Excluding a rack in the streamer is quite tricky, we

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800243#comment-17800243 ] Xiaoqiao He commented on HDFS-17299: Connection meet some issues? Seems we both have this same

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800241#comment-17800241 ] Xiaoqiao He commented on HDFS-17299: [~shahrs87] Please reference here:

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800240#comment-17800240 ] Ayush Saxena commented on HDFS-17299: - [~shahrs87] that config kicks in for post pipeline setup, not

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-24 Thread Rushabh Shah (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800217#comment-17800217 ] Rushabh Shah commented on HDFS-17299: - > Maybe if you would have put >

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800046#comment-17800046 ] Xiaoqiao He commented on HDFS-17299: Thanks involve me here. This is one corner case indeed.

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799897#comment-17799897 ] Ayush Saxena commented on HDFS-17299: - The stale node thing was added for a HBase use case only as

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Rushabh Shah (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799891#comment-17799891 ] Rushabh Shah commented on HDFS-17299: - >From the file creation (at 2023-12-16 17:17:43,818) to the

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Rushabh Shah (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799871#comment-17799871 ] Rushabh Shah commented on HDFS-17299: - bq.  You should find the reason why the nodes were chosen in 1

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799702#comment-17799702 ] Ayush Saxena commented on HDFS-17299: - {quote}So it will take 123 ms (20.5mins) to detect that

<    1   2