[GitHub] [hadoop] hadoop-yetus commented on pull request #5193: YARN-11374. [Federation] Support refreshSuperUserGroupsConfiguration、refreshUserToGroupsMappings API's for Federation.

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5193: URL: https://github.com/apache/hadoop/pull/5193#issuecomment-1345059388 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5185: YARN-11225. [Federation] Add postDelegationToken postDelegationTokenExpiration cancelDelegationToken REST APIs for Router.

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5185: URL: https://github.com/apache/hadoop/pull/5185#issuecomment-1344986128 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5158: YARN-11382 ClientRMService forget to record some audit logs after accessCheck

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5158: URL: https://github.com/apache/hadoop/pull/5158#issuecomment-1344934632 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5203: HDFS-16867. Exiting Mover due to an exception in MoverMetrics.create

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5203: URL: https://github.com/apache/hadoop/pull/5203#issuecomment-1344895880 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18329) Add support for IBM Semeru OE JRE 11.0.15.0 and greater

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645514#comment-17645514 ] ASF GitHub Bot commented on HADOOP-18329: - hadoop-yetus commented on PR #4537: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4537: HADOOP-18329 - Support for IBM Semeru JVM v>11.0.15.0 Vendor Name Changes

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #4537: URL: https://github.com/apache/hadoop/pull/4537#issuecomment-1344888606 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18329) Add support for IBM Semeru OE JRE 11.0.15.0 and greater

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645513#comment-17645513 ] ASF GitHub Bot commented on HADOOP-18329: - hadoop-yetus commented on PR #4537: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4537: HADOOP-18329 - Support for IBM Semeru JVM v>11.0.15.0 Vendor Name Changes

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #4537: URL: https://github.com/apache/hadoop/pull/4537#issuecomment-1344888018 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5204: HDFS-16864. Drop cache behind entire block on close

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5204: URL: https://github.com/apache/hadoop/pull/5204#issuecomment-1344866721 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5185: YARN-11225. [Federation] Add postDelegationToken postDelegationTokenExpiration cancelDelegationToken REST APIs for Router.

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5185: URL: https://github.com/apache/hadoop/pull/5185#issuecomment-1344734860 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5200: HDFS-16865. The source path is always / after RBF proxied the complete, addBlock and getAdditionalDatanode RPC.

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5200: URL: https://github.com/apache/hadoop/pull/5200#issuecomment-1344725662 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5202: HDFS-16866. Fix a typo in Dispatcher

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5202: URL: https://github.com/apache/hadoop/pull/5202#issuecomment-1344724690 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18329) Add support for IBM Semeru OE JRE 11.0.15.0 and greater

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645462#comment-17645462 ] ASF GitHub Bot commented on HADOOP-18329: - JackBuggins commented on code in PR #4537: URL:

[GitHub] [hadoop] JackBuggins commented on a diff in pull request #4537: HADOOP-18329 - Support for IBM Semeru JVM v>11.0.15.0 Vendor Name Changes

2022-12-09 Thread GitBox
JackBuggins commented on code in PR #4537: URL: https://github.com/apache/hadoop/pull/4537#discussion_r1044756952 ## hadoop-common-project/hadoop-auth/src/main/java/org/apache/hadoop/util/PlatformName.java: ## @@ -33,21 +37,71 @@ public class PlatformName { * per the

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645461#comment-17645461 ] ASF GitHub Bot commented on HADOOP-18546: - hadoop-yetus commented on PR #5205: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5205: HADOOP-18546. log/probes of HADOOP-18546 presence.

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5205: URL: https://github.com/apache/hadoop/pull/5205#issuecomment-1344664692 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18329) Add support for IBM Semeru OE JRE 11.0.15.0 and greater

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645460#comment-17645460 ] ASF GitHub Bot commented on HADOOP-18329: - JackBuggins commented on code in PR #4537: URL:

[GitHub] [hadoop] JackBuggins commented on a diff in pull request #4537: HADOOP-18329 - Support for IBM Semeru JVM v>11.0.15.0 Vendor Name Changes

2022-12-09 Thread GitBox
JackBuggins commented on code in PR #4537: URL: https://github.com/apache/hadoop/pull/4537#discussion_r1044753951 ## hadoop-common-project/hadoop-auth/src/main/java/org/apache/hadoop/util/PlatformName.java: ## @@ -33,21 +37,72 @@ public class PlatformName { * per the

[jira] [Commented] (HADOOP-18329) Add support for IBM Semeru OE JRE 11.0.15.0 and greater

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645455#comment-17645455 ] ASF GitHub Bot commented on HADOOP-18329: - JackBuggins commented on code in PR #4537: URL:

[GitHub] [hadoop] JackBuggins commented on a diff in pull request #4537: HADOOP-18329 - Support for IBM Semeru JVM v>11.0.15.0 Vendor Name Changes

2022-12-09 Thread GitBox
JackBuggins commented on code in PR #4537: URL: https://github.com/apache/hadoop/pull/4537#discussion_r1044749307 ## hadoop-common-project/hadoop-minikdc/src/test/java/org/apache/hadoop/minikdc/TestMiniKdc.java: ## @@ -38,8 +38,35 @@ import java.util.Arrays; public class

[jira] [Commented] (HADOOP-18521) ABFS ReadBufferManager buffer sharing across concurrent HTTP requests

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645451#comment-17645451 ] ASF GitHub Bot commented on HADOOP-18521: - hadoop-yetus commented on PR #5117: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5117: HADOOP-18521. ABFS ReadBufferManager must not reuse in-progress buffers

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5117: URL: https://github.com/apache/hadoop/pull/5117#issuecomment-1344656088 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18329) Add support for IBM Semeru OE JRE 11.0.15.0 and greater

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645448#comment-17645448 ] ASF GitHub Bot commented on HADOOP-18329: - JackBuggins commented on code in PR #4537: URL:

[GitHub] [hadoop] JackBuggins commented on a diff in pull request #4537: HADOOP-18329 - Support for IBM Semeru JVM v>11.0.15.0 Vendor Name Changes

2022-12-09 Thread GitBox
JackBuggins commented on code in PR #4537: URL: https://github.com/apache/hadoop/pull/4537#discussion_r1044746318 ## hadoop-common-project/hadoop-auth/src/main/java/org/apache/hadoop/util/PlatformName.java: ## @@ -33,16 +39,33 @@ public class PlatformName { * per the

[GitHub] [hadoop] hadoop-yetus commented on pull request #5205: HADOOP-18546. log/probes of HADOOP-18546 presence.

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5205: URL: https://github.com/apache/hadoop/pull/5205#issuecomment-1344620354 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645435#comment-17645435 ] ASF GitHub Bot commented on HADOOP-18546: - hadoop-yetus commented on PR #5205: URL:

[GitHub] [hadoop] brahmareddybattula commented on pull request #5192: YARN-11389. Upgrade spring-core to 5.3.20 in wro4j-maven-plugin

2022-12-09 Thread GitBox
brahmareddybattula commented on PR #5192: URL: https://github.com/apache/hadoop/pull/5192#issuecomment-1344585442 HI @steveloughran As @dmmkr mentioned updated maven plugin doesn't fixed this and as handle on #421 this change should be ok. Approach looks good to me now. Please

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645381#comment-17645381 ] ASF GitHub Bot commented on HADOOP-18546: - steveloughran commented on PR #5176: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5176: HADOOP-18546. ABFS:disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread GitBox
steveloughran commented on PR #5176: URL: https://github.com/apache/hadoop/pull/5176#issuecomment-1344513110 #5205 is another followup with the logging and a probe through path capabilities; this allows me to verify that backports are in. an abfs instance is vulnerable if ```java

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645379#comment-17645379 ] ASF GitHub Bot commented on HADOOP-18546: - steveloughran commented on PR #5205: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5205: HADOOP-18546. log/probes of HADOOP-18546 presence.

2022-12-09 Thread GitBox
steveloughran commented on PR #5205: URL: https://github.com/apache/hadoop/pull/5205#issuecomment-1344508771 how to use this ```scala // // probe a FS for the bug using path

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645375#comment-17645375 ] ASF GitHub Bot commented on HADOOP-18546: - steveloughran opened a new pull request, #5205: URL:

[GitHub] [hadoop] steveloughran opened a new pull request, #5205: HADOOP-18546. log/probes of HADOOP-18546 presence.

2022-12-09 Thread GitBox
steveloughran opened a new pull request, #5205: URL: https://github.com/apache/hadoop/pull/5205 One more followup JIRA based on the experience of trying to work out if a patched JAR was being picked up through spark builds. * ReadBufferManager logs at trace. *

[jira] [Commented] (HADOOP-18329) Add support for IBM Semeru OE JRE 11.0.15.0 and greater

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645369#comment-17645369 ] ASF GitHub Bot commented on HADOOP-18329: - steveloughran commented on code in PR #4537: URL:

[GitHub] [hadoop] steveloughran commented on a diff in pull request #4537: HADOOP-18329 - Support for IBM Semeru JVM v>11.0.15.0 Vendor Name Changes

2022-12-09 Thread GitBox
steveloughran commented on code in PR #4537: URL: https://github.com/apache/hadoop/pull/4537#discussion_r1044590462 ## hadoop-common-project/hadoop-auth/src/main/java/org/apache/hadoop/util/PlatformName.java: ## @@ -33,16 +39,33 @@ public class PlatformName { * per the

[GitHub] [hadoop] slfan1989 commented on pull request #5175: YARN-11226. [Federation] Add createNewReservation, submitReservation, updateReservation, deleteReservation REST APIs for Router.

2022-12-09 Thread GitBox
slfan1989 commented on PR #5175: URL: https://github.com/apache/hadoop/pull/5175#issuecomment-1344474374 @goiri Can you help to review this PR again? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] slfan1989 commented on pull request #5182: YARN-11385. Fix hadoop-yarn-server-common module Java Doc Errors.

2022-12-09 Thread GitBox
slfan1989 commented on PR #5182: URL: https://github.com/apache/hadoop/pull/5182#issuecomment-1344470242 @goiri Can you help to merge this pr into the trunk branch? Thank you very much! I have modified the Java doc as suggested by cnauroth. After this pr is finished, I will recompile

[jira] [Commented] (HADOOP-18329) Add support for IBM Semeru OE JRE 11.0.15.0 and greater

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645357#comment-17645357 ] ASF GitHub Bot commented on HADOOP-18329: - steveloughran commented on PR #4537: URL:

[GitHub] [hadoop] steveloughran commented on pull request #4537: HADOOP-18329 - Support for IBM Semeru JVM v>11.0.15.0 Vendor Name Changes

2022-12-09 Thread GitBox
steveloughran commented on PR #4537: URL: https://github.com/apache/hadoop/pull/4537#issuecomment-1344466958 a big everything failure is the container runtime playing up; CI tooling rather than the source treee -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] slfan1989 commented on pull request #5185: YARN-11225. [Federation] Add postDelegationToken postDelegationTokenExpiration cancelDelegationToken REST APIs for Router.

2022-12-09 Thread GitBox
slfan1989 commented on PR #5185: URL: https://github.com/apache/hadoop/pull/5185#issuecomment-1344465544 @goiri Can you help review this PR? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645352#comment-17645352 ] ASF GitHub Bot commented on HADOOP-18546: - steveloughran commented on PR #5176: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5176: HADOOP-18546. ABFS:disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread GitBox
steveloughran commented on PR #5176: URL: https://github.com/apache/hadoop/pull/5176#issuecomment-1344461171 (oh, and on my personal backport I have added a TRACE log in the buffer manager to record its state; abfsInputStream.toString does it too. ``` private ReadBufferManager() {

[jira] [Comment Edited] (HADOOP-18073) Upgrade AWS SDK to v2

2022-12-09 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645348#comment-17645348 ] Ahmar Suhail edited comment on HADOOP-18073 at 12/9/22 3:37 PM:

[jira] [Comment Edited] (HADOOP-18073) Upgrade AWS SDK to v2

2022-12-09 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645348#comment-17645348 ] Ahmar Suhail edited comment on HADOOP-18073 at 12/9/22 3:36 PM:

[jira] [Created] (HADOOP-18565) Add in support of custom signers

2022-12-09 Thread Ahmar Suhail (Jira)
Ahmar Suhail created HADOOP-18565: - Summary: Add in support of custom signers Key: HADOOP-18565 URL: https://issues.apache.org/jira/browse/HADOOP-18565 Project: Hadoop Common Issue Type:

[jira] [Commented] (HADOOP-18073) Upgrade AWS SDK to v2

2022-12-09 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645348#comment-17645348 ] Ahmar Suhail commented on HADOOP-18073: --- [~ste...@apache.org] I've rebased our branch,

[GitHub] [hadoop] dlmarion opened a new pull request, #5204: HDFS-16864. Drop cache behind entire block on close

2022-12-09 Thread GitBox
dlmarion opened a new pull request, #5204: URL: https://github.com/apache/hadoop/pull/5204 As blocks are written posix_fadvise is called when dropCacheBehindWrites is true, but the range supplied does not include the most recent 8MB written. This change modifies BlockReceiver.close such

[jira] [Commented] (HADOOP-18073) Upgrade AWS SDK to v2

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645336#comment-17645336 ] ASF GitHub Bot commented on HADOOP-18073: - hadoop-yetus commented on PR #5163: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5163: HADOOP-18073. Upgrade AWS SDK to v2 in S3A [work in progress]

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5163: URL: https://github.com/apache/hadoop/pull/5163#issuecomment-1344422010 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5201: Fs2cs could be extended to set ULF to -1 upon conversion

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5201: URL: https://github.com/apache/hadoop/pull/5201#issuecomment-1344390502 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] Happy-shi opened a new pull request, #5203: HDFS-16867. Exiting Mover due to an exception in MoverMetrics.create

2022-12-09 Thread GitBox
Happy-shi opened a new pull request, #5203: URL: https://github.com/apache/hadoop/pull/5203 JIRA: HDFS-16867 Exiting Mover due to an exception in MoverMetrics.create -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Commented] (HADOOP-18073) Upgrade AWS SDK to v2

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645312#comment-17645312 ] ASF GitHub Bot commented on HADOOP-18073: - hadoop-yetus commented on PR #5163: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5163: HADOOP-18073. Upgrade AWS SDK to v2 in S3A [work in progress]

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5163: URL: https://github.com/apache/hadoop/pull/5163#issuecomment-1344355626 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18521) ABFS ReadBufferManager buffer sharing across concurrent HTTP requests

2022-12-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645309#comment-17645309 ] Steve Loughran commented on HADOOP-18521: - We have a nice and minimal fix which can be easily

[jira] [Resolved] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18546. - Fix Version/s: 3.4.0 3.3.5 Resolution: Fixed > disable

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645300#comment-17645300 ] ASF GitHub Bot commented on HADOOP-18546: - steveloughran merged PR #5198: URL:

[GitHub] [hadoop] steveloughran merged pull request #5198: HADOOP-18546. Followup: ITestReadBufferManager fix

2022-12-09 Thread GitBox
steveloughran merged PR #5198: URL: https://github.com/apache/hadoop/pull/5198 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645299#comment-17645299 ] ASF GitHub Bot commented on HADOOP-18546: - steveloughran commented on PR #5198: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5198: HADOOP-18546. Followup: ITestReadBufferManager fix

2022-12-09 Thread GitBox
steveloughran commented on PR #5198: URL: https://github.com/apache/hadoop/pull/5198#issuecomment-1344327283 not happy about javadoc failures, but looks unrelated (annotation issues? javadoc changes?). going to approve this myself because it's only a test change, and the change is

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645297#comment-17645297 ] ASF GitHub Bot commented on HADOOP-18546: - steveloughran commented on PR #5176: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5176: HADOOP-18546. ABFS:disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread GitBox
steveloughran commented on PR #5176: URL: https://github.com/apache/hadoop/pull/5176#issuecomment-1344325189 update: full e2e tests through spark shell are happy! i was trying to do scalatest tests for this but not been able to replicate the test failure through my test suite (which

[GitHub] [hadoop] steveloughran commented on pull request #5199: Temp change Refactor tests to resolve race conditions; inProgress assertions to be removed.

2022-12-09 Thread GitBox
steveloughran commented on PR #5199: URL: https://github.com/apache/hadoop/pull/5199#issuecomment-1344320130 ok, i see you closed this. no problem; we are trying to do a fix-by-cut back change to the buffer reader and with your review of my pr then i think we are good to go once yetus is

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645286#comment-17645286 ] ASF GitHub Bot commented on HADOOP-18546: - hadoop-yetus commented on PR #5198: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5198: HADOOP-18546. Followup: ITestReadBufferManager fix

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5198: URL: https://github.com/apache/hadoop/pull/5198#issuecomment-1344271351 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18329) Add support for IBM Semeru OE JRE 11.0.15.0 and greater

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645274#comment-17645274 ] ASF GitHub Bot commented on HADOOP-18329: - JackBuggins commented on PR #4537: URL:

[GitHub] [hadoop] JackBuggins commented on pull request #4537: HADOOP-18329 - Support for IBM Semeru JVM v>11.0.15.0 Vendor Name Changes

2022-12-09 Thread GitBox
JackBuggins commented on PR #4537: URL: https://github.com/apache/hadoop/pull/4537#issuecomment-1344249638 @steveloughran is there a recommended way to kick CI different from pushing empty commits? I'm fairly confident the failures I'm observing here have been pulled from upstream based on

[jira] [Commented] (HADOOP-18564) Use file-level checksum by default when copying between two different file systems

2022-12-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645253#comment-17645253 ] Steve Loughran commented on HADOOP-18564: - FWIW there's an etag source api which abfs and s3a

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645246#comment-17645246 ] ASF GitHub Bot commented on HADOOP-18546: - steveloughran commented on PR #5198: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5198: HADOOP-18546. Followup: ITestReadBufferManager fix

2022-12-09 Thread GitBox
steveloughran commented on PR #5198: URL: https://github.com/apache/hadoop/pull/5198#issuecomment-1344177793 ok, updated this one, which i'm using in my internal cherrypick which I need for e2e testing though spark. will review your #5199 change which does more than just comment out

[GitHub] [hadoop] Happy-shi opened a new pull request, #5202: HDFS-16866. Fix a typo in Dispatcher

2022-12-09 Thread GitBox
Happy-shi opened a new pull request, #5202: URL: https://github.com/apache/hadoop/pull/5202 JIRA: HDFS-16866. Fix a typo in Dispatcher. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] susheel-gupta opened a new pull request, #5201: Fs2cs could be extended to set ULF to -1 upon conversion

2022-12-09 Thread GitBox
susheel-gupta opened a new pull request, #5201: URL: https://github.com/apache/hadoop/pull/5201 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645231#comment-17645231 ] ASF GitHub Bot commented on HADOOP-18546: - steveloughran commented on code in PR #5198: URL:

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5198: HADOOP-18546. Followup: ITestReadBufferManager fix

2022-12-09 Thread GitBox
steveloughran commented on code in PR #5198: URL: https://github.com/apache/hadoop/pull/5198#discussion_r1044307694 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/ITestReadBufferManager.java: ## @@ -77,14 +77,7 @@ public void

[GitHub] [hadoop] hadoop-yetus commented on pull request #5061: [YARN-11353] : Change debug logs in FSDownload.java to info logs for better escalations debugging

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5061: URL: https://github.com/apache/hadoop/pull/5061#issuecomment-1344118255 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] ZanderXu opened a new pull request, #5200: HDFS-16865. The source path is always / after RBF proxied the complete, addBlock and getAdditionalDatanode RPC.

2022-12-09 Thread GitBox
ZanderXu opened a new pull request, #5200: URL: https://github.com/apache/hadoop/pull/5200 ### Description of PR Jira: [HDFS-16865](https://issues.apache.org/jira/browse/HDFS-16865) I found the source path of the complete rpc in NameNode is / when this RPC is proxied by RBF.

[GitHub] [hadoop] curie71 commented on pull request #5158: YARN-11382 ClientRMService forget to record some audit logs after accessCheck

2022-12-09 Thread GitBox
curie71 commented on PR #5158: URL: https://github.com/apache/hadoop/pull/5158#issuecomment-1344036291 > Thanks for your reply, I found some other auditlog missing problems in the method of ClientRMService, you can view it through

[jira] [Commented] (HADOOP-18546) disable purging list of in progress reads in abfs stream closed

2022-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645151#comment-17645151 ] ASF GitHub Bot commented on HADOOP-18546: - pranavsaxena-microsoft commented on code in PR

[GitHub] [hadoop] pranavsaxena-microsoft commented on a diff in pull request #5198: HADOOP-18546. Followup: ITestReadBufferManager fix

2022-12-09 Thread GitBox
pranavsaxena-microsoft commented on code in PR #5198: URL: https://github.com/apache/hadoop/pull/5198#discussion_r1044187725 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/ITestReadBufferManager.java: ## @@ -77,14 +77,7 @@ public void

[GitHub] [hadoop] hadoop-yetus commented on pull request #5199: Temp change Refactor tests to resolve race conditions; inProgress assertions to be removed.

2022-12-09 Thread GitBox
hadoop-yetus commented on PR #5199: URL: https://github.com/apache/hadoop/pull/5199#issuecomment-1343975925 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |