[jira] [Updated] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17056: --- Attachment: 2040.03.patch > shelldoc fails in hadoop-common >

[jira] [Resolved] (HADOOP-17018) Intermittent failing of ITestAbfsStreamStatistics in ABFS

2020-06-01 Thread Mehakmeet Singh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehakmeet Singh resolved HADOOP-17018. -- Resolution: Fixed > Intermittent failing of ITestAbfsStreamStatistics in ABFS >

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-01 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121512#comment-17121512 ] Masatake Iwasaki commented on HADOOP-17056: --- [~aajisaka] As you reported, I can't reproduce

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121469#comment-17121469 ] Akira Ajisaka commented on HADOOP-17056: The detailed error message: {noformat} [INFO] ---

[GitHub] [hadoop] hadoop-yetus commented on pull request #2044: YARN-10302. Make FairScheduler node comparator configurable

2020-06-01 Thread GitBox
hadoop-yetus commented on pull request #2044: URL: https://github.com/apache/hadoop/pull/2044#issuecomment-637203943 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[GitHub] [hadoop] billonahill opened a new pull request #2044: YARN-10302. make node comparator configurable

2020-06-01 Thread GitBox
billonahill opened a new pull request #2044: URL: https://github.com/apache/hadoop/pull/2044 Add `yarn.scheduler.fair.node.comparator.class` config to control the `FairScheduler` node comparator. This is an automated

[GitHub] [hadoop] hadoop-yetus commented on pull request #2043: HADOOP-17050 S3A to support multiple DTs

2020-06-01 Thread GitBox
hadoop-yetus commented on pull request #2043: URL: https://github.com/apache/hadoop/pull/2043#issuecomment-637094546 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 22m

[GitHub] [hadoop] steveloughran commented on pull request #2043: HADOOP-17050 S3A to support multiple DTs

2020-06-01 Thread GitBox
steveloughran commented on pull request #2043: URL: https://github.com/apache/hadoop/pull/2043#issuecomment-637058889 not yet tested. @bgaborg -will this do? the APIs only allow each DT issuer to issue zero or one token, but you can return a list of other implementations of the DT

[GitHub] [hadoop] steveloughran opened a new pull request #2043: HADOOP-17050 S3A to support multiple DTs

2020-06-01 Thread GitBox
steveloughran opened a new pull request #2043: URL: https://github.com/apache/hadoop/pull/2043 Contributed by Steve Loughran. DT plugins will be asked for any additional token issuers, an array can be returned, each one will be asked for tokens.

[jira] [Commented] (HADOOP-17050) Add support for multiple delegation tokens in S3AFilesystem

2020-06-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121259#comment-17121259 ] Steve Loughran commented on HADOOP-17050: - gabor. this is about allowing the single DT plugin

[GitHub] [hadoop] steveloughran commented on pull request #1747: HDFS-15042 Add more tests for ByteBufferPositionedReadable.

2020-06-01 Thread GitBox
steveloughran commented on pull request #1747: URL: https://github.com/apache/hadoop/pull/1747#issuecomment-637042915 ``` ./hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FSExceptionMessages.java:42: "Cannot read from a negative position";: '"Cannot read from

[jira] [Updated] (HADOOP-17052) NetUtils.connect() throws unchecked exception (UnresolvedAddressException) causing clients to abort

2020-06-01 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-17052: --- Component/s: (was: hdfs-client) net > NetUtils.connect() throws

[jira] [Resolved] (HADOOP-17052) NetUtils.connect() throws unchecked exception (UnresolvedAddressException) causing clients to abort

2020-06-01 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-17052. Fix Version/s: 3.4.0 3.3.1 2.10.1

[jira] [Commented] (HADOOP-17052) NetUtils.connect() throws unchecked exception (UnresolvedAddressException) causing clients to abort

2020-06-01 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121215#comment-17121215 ] Hudson commented on HADOOP-17052: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18312 (See

[GitHub] [hadoop] liuml07 merged pull request #2036: HADOOP-17052. NetUtils.connect() throws unchecked exception (UnresolvedAddressException) causing clients to abort

2020-06-01 Thread GitBox
liuml07 merged pull request #2036: URL: https://github.com/apache/hadoop/pull/2036 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Assigned] (HADOOP-17057) ABFS driver enhancement - Allow customizable translation from AAD SPNs and security groups to Linux user and group

2020-06-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-17057: --- Assignee: Karthik Amarnath > ABFS driver enhancement - Allow customizable

[jira] [Assigned] (HADOOP-17057) ABFS driver enhancement - Allow customizable translation from AAD SPNs and security groups to Linux user and group

2020-06-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-17057: --- Component/s: (was: fs/azure) fs/azure Key:

[jira] [Commented] (HADOOP-16830) Add public IOStatistics API; S3A to support

2020-06-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121005#comment-17121005 ] Steve Loughran commented on HADOOP-16830: - Interesting thought. We don't actually care what

[jira] [Work started] (HADOOP-17050) Add support for multiple delegation tokens in S3AFilesystem

2020-06-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17050 started by Steve Loughran. --- > Add support for multiple delegation tokens in S3AFilesystem >

[jira] [Commented] (HADOOP-16133) S3A statistic collection underrecords bytes written in helper threads

2020-06-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120888#comment-17120888 ] Steve Loughran commented on HADOOP-16133: - to fix in HADOOP-16830 by only updating the counters

[jira] [Commented] (HADOOP-16828) Zookeeper Delegation Token Manager fetch sequence number by batch

2020-06-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120815#comment-17120815 ] Xiaoqiao He commented on HADOOP-16828: -- Thanks [~fengnanli] for your contribution. v002 LGTM. Any

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120810#comment-17120810 ] Hadoop QA commented on HADOOP-17056: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] hadoop-yetus commented on pull request #2040: [DEBUG] HADOOP-17056. shelldocs fails in hadoop-common.

2020-06-01 Thread GitBox
hadoop-yetus commented on pull request #2040: URL: https://github.com/apache/hadoop/pull/2040#issuecomment-636648147 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 26m