[jira] [Commented] (HADOOP-16931) Reduce the execution time of the TestRolloverSignerSecretProvider

2020-06-10 Thread Isa Hekmatizadeh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130306#comment-17130306 ] Isa Hekmatizadeh commented on HADOOP-16931: --- I think status should be changed to Pull Request

[jira] [Commented] (HADOOP-17059) ArrayIndexOfboundsException in ViewFileSystem#listStatus

2020-06-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130296#comment-17130296 ] Hadoop QA commented on HADOOP-17059: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] mukund-thakur commented on pull request #2038: HADOOP-17022 Tune S3AFileSystem.listFiles() api.

2020-06-10 Thread GitBox

[GitHub] [hadoop] iwasakims opened a new pull request #2065: MAPREDUCE-7280. MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable.

2020-06-10 Thread GitBox
iwasakims opened a new pull request #2065: URL: https://github.com/apache/hadoop/pull/2065 Adding MiniMRYarnCluster configuration to * make JHS optional * set timeout duration to launch JHS This is an automated

[GitHub] [hadoop] steveloughran commented on a change in pull request #2038: HADOOP-17022 Tune S3AFileSystem.listFiles() api.

2020-06-10 Thread GitBox
steveloughran commented on a change in pull request #2038: URL: https://github.com/apache/hadoop/pull/2038#discussion_r438125493 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java ## @@ -4181,79 +4181,114 @@ public

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #2038: HADOOP-17022 Tune S3AFileSystem.listFiles() api.

2020-06-10 Thread GitBox
mukund-thakur commented on a change in pull request #2038: URL: https://github.com/apache/hadoop/pull/2038#discussion_r438192115 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java ## @@ -4181,79 +4181,114 @@ public

[jira] [Assigned] (HADOOP-17071) MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable

2020-06-10 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HADOOP-17071: - Assignee: Masatake Iwasaki > MiniMRYarnCluster has hard-coded timeout waiting

[jira] [Commented] (HADOOP-17071) MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable

2020-06-10 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130673#comment-17130673 ] Masatake Iwasaki commented on HADOOP-17071: --- Thanks for reporting this, [~ndimiduk]. I'm

[jira] [Updated] (HADOOP-16931) Reduce the execution time of the TestRolloverSignerSecretProvider

2020-06-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-16931: -- Status: Patch Available (was: Open) > Reduce the execution time of the

[GitHub] [hadoop] hadoop-yetus commented on pull request #2061: HADOOP-17060. listStatus and getFileStatus behave inconsistent in the case of ViewFs implementation for isDirectory

2020-06-10 Thread GitBox
hadoop-yetus commented on pull request #2061: URL: https://github.com/apache/hadoop/pull/2061#issuecomment-641836494 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2061: HADOOP-17060. listStatus and getFileStatus behave inconsistent in the case of ViewFs implementation for isDirectory

2020-06-10 Thread GitBox
hadoop-yetus commented on pull request #2061: URL: https://github.com/apache/hadoop/pull/2061#issuecomment-641914737 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Commented] (HADOOP-17059) ArrayIndexOfboundsException in ViewFileSystem#listStatus

2020-06-10 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130382#comment-17130382 ] Akira Ajisaka commented on HADOOP-17059: It seems that the Java7 environment is not using

[GitHub] [hadoop] hadoop-yetus commented on pull request #2061: HADOOP-17060. listStatus and getFileStatus behave inconsistent in the case of ViewFs implementation for isDirectory

2020-06-10 Thread GitBox
hadoop-yetus commented on pull request #2061: URL: https://github.com/apache/hadoop/pull/2061#issuecomment-641849600 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 21m

[GitHub] [hadoop] umamaheswararao commented on pull request #2061: HADOOP-17060. listStatus and getFileStatus behave inconsistent in the case of ViewFs implementation for isDirectory

2020-06-10 Thread GitBox
umamaheswararao commented on pull request #2061: URL: https://github.com/apache/hadoop/pull/2061#issuecomment-641833897 I had a discussion with Sanjay about this behaviors. He certainly agreed that, we should update the docs instead of changing them now. GetFileStatus implemented to work

[jira] [Commented] (HADOOP-17059) ArrayIndexOfboundsException in ViewFileSystem#listStatus

2020-06-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130443#comment-17130443 ] Hadoop QA commented on HADOOP-17059: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] Cosss7 commented on pull request #1974: HADOOP-17009: Embrace Immutability of Java Collections

2020-06-10 Thread GitBox
Cosss7 commented on pull request #1974: URL: https://github.com/apache/hadoop/pull/1974#issuecomment-641879709 Hi~ @goiri It looks like you have approved the PR. Why don't you merge it ? This is an automated message from

[jira] [Updated] (HADOOP-17059) ArrayIndexOfboundsException in ViewFileSystem#listStatus

2020-06-10 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-17059: --- Fix Version/s: 2.10.1 2.9.3 Resolution: Fixed Status:

[jira] [Commented] (HADOOP-16830) Add public IOStatistics API; S3A to support

2020-06-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130954#comment-17130954 ] Steve Loughran commented on HADOOP-16830: - [~lucacanali] I've done an iteration on a variant

[GitHub] [hadoop] mukund-thakur commented on pull request #2038: HADOOP-17022 Tune S3AFileSystem.listFiles() api.

2020-06-10 Thread GitBox
mukund-thakur commented on pull request #2038: URL: https://github.com/apache/hadoop/pull/2038#issuecomment-642125722 The reason for failure of `ITestMagicCommitProtocol>AbstractITCommitProtocol.testCommitterWithDuplicatedCommit:806->AbstractITCommitProtocol.expectFNFEonTaskCommit:876

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132571#comment-17132571 ] Steve Loughran commented on HADOOP-17063: - thanks for the stack. regarding the test

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132574#comment-17132574 ] Steve Loughran commented on HADOOP-17063: - jstack 74, delete objects is blocking. maybe

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132581#comment-17132581 ] Steve Loughran commented on HADOOP-17063: - stack 40 is the same; stack 34 is the one blocking

[GitHub] [hadoop] saintstack commented on a change in pull request #2065: MAPREDUCE-7280. MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable.

2020-06-10 Thread GitBox
saintstack commented on a change in pull request #2065: URL: https://github.com/apache/hadoop/pull/2065#discussion_r438319331 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml ## @@ -1945,6

[GitHub] [hadoop] ndimiduk commented on a change in pull request #2065: MAPREDUCE-7280. MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable.

2020-06-10 Thread GitBox
ndimiduk commented on a change in pull request #2065: URL: https://github.com/apache/hadoop/pull/2065#discussion_r438322822 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml ## @@ -1945,6 +1945,18

[GitHub] [hadoop] ndimiduk commented on a change in pull request #2065: MAPREDUCE-7280. MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable.

2020-06-10 Thread GitBox
ndimiduk commented on a change in pull request #2065: URL: https://github.com/apache/hadoop/pull/2065#discussion_r438320637 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on pull request #2065: MAPREDUCE-7280. MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable.

2020-06-10 Thread GitBox
hadoop-yetus commented on pull request #2065: URL: https://github.com/apache/hadoop/pull/2065#issuecomment-642180042 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2026: HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes

2020-06-10 Thread GitBox
hadoop-yetus commented on pull request #2026: URL: https://github.com/apache/hadoop/pull/2026#issuecomment-642272089 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-10 Thread Dyno (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132746#comment-17132746 ] Dyno commented on HADOOP-17063: --- > important: you are using the classic FileOutputCommitter; this is slow

[GitHub] [hadoop] iwasakims commented on a change in pull request #2065: MAPREDUCE-7280. MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable.

2020-06-10 Thread GitBox
iwasakims commented on a change in pull request #2065: URL: https://github.com/apache/hadoop/pull/2065#discussion_r43852 ## File path:

[GitHub] [hadoop] iwasakims commented on a change in pull request #2065: MAPREDUCE-7280. MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable.

2020-06-10 Thread GitBox
iwasakims commented on a change in pull request #2065: URL: https://github.com/apache/hadoop/pull/2065#discussion_r438523858 ## File path:

[GitHub] [hadoop] iwasakims commented on a change in pull request #2065: MAPREDUCE-7280. MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable.

2020-06-10 Thread GitBox
iwasakims commented on a change in pull request #2065: URL: https://github.com/apache/hadoop/pull/2065#discussion_r438521302 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml ## @@ -1945,6

[jira] [Commented] (HADOOP-17059) ArrayIndexOfboundsException in ViewFileSystem#listStatus

2020-06-10 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132904#comment-17132904 ] Akira Ajisaka commented on HADOOP-17059: Now I cannot figure out the root cause, so we need to

[jira] [Commented] (HADOOP-17059) ArrayIndexOfboundsException in ViewFileSystem#listStatus

2020-06-10 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132911#comment-17132911 ] Mingliang Liu commented on HADOOP-17059: {quote} dropping Java 7 support in Hadoop 2.x is the

[GitHub] [hadoop] umamaheswararao merged pull request #2061: HADOOP-17060. listStatus and getFileStatus behave inconsistent in the case of ViewFs implementation for isDirectory

2020-06-10 Thread GitBox
umamaheswararao merged pull request #2061: URL: https://github.com/apache/hadoop/pull/2061 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HADOOP-17060) listStatus and getFileStatus behave inconsistent in the case of ViewFs implementation for isDirectory

2020-06-10 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HADOOP-17060: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HADOOP-17060) listStatus and getFileStatus behave inconsistent in the case of ViewFs implementation for isDirectory

2020-06-10 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132761#comment-17132761 ] Hudson commented on HADOOP-17060: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18345 (See

[GitHub] [hadoop] zhouyuan commented on pull request #1947: HDFS-14950. fix missing libhdfspp lib in dist-package

2020-06-10 Thread GitBox
zhouyuan commented on pull request #1947: URL: https://github.com/apache/hadoop/pull/1947#issuecomment-642314930 @jojochuang thanks for the review! is there any work needed before merging? This is an automated message from

[GitHub] [hadoop] steveloughran commented on pull request #1982: HADOOP-16830. IOStatistics API.

2020-06-10 Thread GitBox
steveloughran commented on pull request #1982: URL: https://github.com/apache/hadoop/pull/1982#issuecomment-642142997 aah, i need to rebase. @mehakmeet -this is going to complicate your life. sorry. I'll do a whole new PR. having written the new extensible design, I've decided I