[GitHub] [hadoop] hadoop-yetus commented on issue #1408: HADOOP-13363. Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1408: HADOOP-13363. Upgrade protobuf from 2.5.0 to something newer URL: https://github.com/apache/hadoop/pull/1408#issuecomment-530704890 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform

[jira] [Created] (HADOOP-16556) Fix some LGTM alerts

2019-09-12 Thread Malcolm Taylor (Jira)
Malcolm Taylor created HADOOP-16556: --- Summary: Fix some LGTM alerts Key: HADOOP-16556 URL: https://issues.apache.org/jira/browse/HADOOP-16556 Project: Hadoop Common Issue Type: Improvement

[GitHub] [hadoop] ChenSammi commented on issue #1194: HDDS-1879. Support multiple excluded scopes when choosing datanodes in NetworkTopology

2019-09-12 Thread GitBox
ChenSammi commented on issue #1194: HDDS-1879. Support multiple excluded scopes when choosing datanodes in NetworkTopology URL: https://github.com/apache/hadoop/pull/1194#issuecomment-530706555 Is the build system wrong? I don't think changed the code which cause the compile failure.

[jira] [Commented] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928288#comment-16928288 ] Vinayakumar B commented on HADOOP-13363: bq. Release process: can it be issued by the ASF?

[jira] [Created] (HADOOP-16557) Upgrade protobuf.version to 3.7.1

2019-09-12 Thread Vinayakumar B (Jira)
Vinayakumar B created HADOOP-16557: -- Summary: Upgrade protobuf.version to 3.7.1 Key: HADOOP-16557 URL: https://issues.apache.org/jira/browse/HADOOP-16557 Project: Hadoop Common Issue Type:

[GitHub] [hadoop] 1m2c3t4 opened a new pull request #1428: HADOOP-16556. Fix some alerts raised by LGTM

2019-09-12 Thread GitBox
1m2c3t4 opened a new pull request #1428: HADOOP-16556. Fix some alerts raised by LGTM URL: https://github.com/apache/hadoop/pull/1428 Fix the following alerts: - `Array index out of bounds` in KerberosName.java - `Contradictory type checks` in GenericExceptionHandler -

[jira] [Updated] (HADOOP-16562) [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16562: --- Summary: [pb-upgrade] Update docker image to have 3.7.1 protoc executable (was: Update

[GitHub] [hadoop] steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)

2019-09-12 Thread GitBox
steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log) URL: https://github.com/apache/hadoop/pull/1208#issuecomment-530748126 # +1 As well as all the automated tests, did some manual command line operations.

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3 URL: https://github.com/apache/hadoop/pull/1160#issuecomment-527286087 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3 URL: https://github.com/apache/hadoop/pull/1160#issuecomment-525951689 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[jira] [Commented] (HADOOP-16562) [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928453#comment-16928453 ] Hudson commented on HADOOP-16562: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17284 (See

[GitHub] [hadoop] smengcl commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-12 Thread GitBox
smengcl commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-530794042 As for the unit test failures for the latest commit, I tested that:

[jira] [Created] (HADOOP-16561) [MAPREDUCE] use protobuf-maven-plugin to generate protobuf classes

2019-09-12 Thread Vinayakumar B (Jira)
Vinayakumar B created HADOOP-16561: -- Summary: [MAPREDUCE] use protobuf-maven-plugin to generate protobuf classes Key: HADOOP-16561 URL: https://issues.apache.org/jira/browse/HADOOP-16561 Project:

[jira] [Created] (HADOOP-16560) [YARN] use protobuf-maven-plugin to generate protobuf classes

2019-09-12 Thread Vinayakumar B (Jira)
Vinayakumar B created HADOOP-16560: -- Summary: [YARN] use protobuf-maven-plugin to generate protobuf classes Key: HADOOP-16560 URL: https://issues.apache.org/jira/browse/HADOOP-16560 Project: Hadoop

[GitHub] [hadoop] hadoop-yetus commented on issue #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable URL: https://github.com/apache/hadoop/pull/1429#issuecomment-530735086 (!) A patch to the testing environment has been detected. Re-executing against the patched

[jira] [Assigned] (HADOOP-16562) [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B reassigned HADOOP-16562: -- Assignee: Vinayakumar B > [pb-upgrade] Update docker image to have 3.7.1 protoc

[jira] [Updated] (HADOOP-16562) [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16562: --- Status: Patch Available (was: Open) > [pb-upgrade] Update docker image to have 3.7.1

[GitHub] [hadoop] steveloughran commented on issue #1407: HADOOP-16490. Avoid/handle cached 404s during S3A file creation

2019-09-12 Thread GitBox
steveloughran commented on issue #1407: HADOOP-16490. Avoid/handle cached 404s during S3A file creation URL: https://github.com/apache/hadoop/pull/1407#issuecomment-530749745 this is now committed -Thanks for the reviews!

[GitHub] [hadoop] steveloughran closed pull request #1407: HADOOP-16490. Avoid/handle cached 404s during S3A file creation

2019-09-12 Thread GitBox
steveloughran closed pull request #1407: HADOOP-16490. Avoid/handle cached 404s during S3A file creation URL: https://github.com/apache/hadoop/pull/1407 This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] mukund-thakur edited a comment on issue #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-12 Thread GitBox
mukund-thakur edited a comment on issue #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#issuecomment-530764029 > yes. It's a change in behaviour, but probably a good one. A test will verify that things fail the way we

[jira] [Created] (HADOOP-16563) S3Guard fsck: Detect if a directory if authoritative and highlight errors if detected in it

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16563: --- Summary: S3Guard fsck: Detect if a directory if authoritative and highlight errors if detected in it Key: HADOOP-16563 URL: https://issues.apache.org/jira/browse/HADOOP-16563

[GitHub] [hadoop] 1m2c3t4 commented on issue #474: fix some alerts raised by LGTM

2019-09-12 Thread GitBox
1m2c3t4 commented on issue #474: fix some alerts raised by LGTM URL: https://github.com/apache/hadoop/pull/474#issuecomment-530711827 @aajisaka I have now created HADOOP-16556. I'll close this PR and replace it with #1428

[GitHub] [hadoop] 1m2c3t4 closed pull request #474: fix some alerts raised by LGTM

2019-09-12 Thread GitBox
1m2c3t4 closed pull request #474: fix some alerts raised by LGTM URL: https://github.com/apache/hadoop/pull/474 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] timmylicheng edited a comment on issue #1418: HDDS-2089: Add createPipeline CLI.

2019-09-12 Thread GitBox
timmylicheng edited a comment on issue #1418: HDDS-2089: Add createPipeline CLI. URL: https://github.com/apache/hadoop/pull/1418#issuecomment-530719904 > LGTM, can you add an acceptance test for the new command? I've created a new JIRA for adding acceptance test for all Pipeline

[GitHub] [hadoop] timmylicheng commented on issue #1418: HDDS-2089: Add createPipeline CLI.

2019-09-12 Thread GitBox
timmylicheng commented on issue #1418: HDDS-2089: Add createPipeline CLI. URL: https://github.com/apache/hadoop/pull/1418#issuecomment-530719904 > LGTM, can you add an acceptance test for the new command? I've created a new JIRA for adding acceptance test for all Pipeline related

[jira] [Created] (HADOOP-16562) Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread Vinayakumar B (Jira)
Vinayakumar B created HADOOP-16562: -- Summary: Update docker image to have 3.7.1 protoc executable Key: HADOOP-16562 URL: https://issues.apache.org/jira/browse/HADOOP-16562 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-528125833 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-529876473 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] timmylicheng opened a new pull request #1431: HDDS-1569 Support creating multiple pipelines with same datanode

2019-09-12 Thread GitBox
timmylicheng opened a new pull request #1431: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop/pull/1431 #HDDS-1569 Use PipelinePlacementPolicy to support creating multiple pipelines with same datanode

[GitHub] [hadoop] hadoop-yetus commented on issue #1428: HADOOP-16556. Fix some alerts raised by LGTM

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1428: HADOOP-16556. Fix some alerts raised by LGTM URL: https://github.com/apache/hadoop/pull/1428#issuecomment-530755828 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-12 Thread GitBox
mukund-thakur commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#discussion_r323663047 ## File path:

[GitHub] [hadoop] mukund-thakur commented on issue #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-12 Thread GitBox
mukund-thakur commented on issue #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#issuecomment-530764029 > yes. It's a change in behaviour, but probably a good one. A test will verify that things fail the way we expect

[GitHub] [hadoop] hadoop-yetus commented on issue #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#issuecomment-530767466 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] smengcl edited a comment on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-12 Thread GitBox
smengcl edited a comment on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-530794042 As for the unit test failures for the latest commit, I tested that: ```

[jira] [Created] (HADOOP-16559) [HDFS] use protobuf-maven-plugin to generate protobuf classes

2019-09-12 Thread Vinayakumar B (Jira)
Vinayakumar B created HADOOP-16559: -- Summary: [HDFS] use protobuf-maven-plugin to generate protobuf classes Key: HADOOP-16559 URL: https://issues.apache.org/jira/browse/HADOOP-16559 Project: Hadoop

[GitHub] [hadoop] timmylicheng commented on a change in pull request #1418: HDDS-2089: Add createPipeline CLI.

2019-09-12 Thread GitBox
timmylicheng commented on a change in pull request #1418: HDDS-2089: Add createPipeline CLI. URL: https://github.com/apache/hadoop/pull/1418#discussion_r323611731 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/server/SCMClientProtocolServer.java

[GitHub] [hadoop] brahmareddybattula commented on issue #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread GitBox
brahmareddybattula commented on issue #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable URL: https://github.com/apache/hadoop/pull/1429#issuecomment-530769758 +1 This is an automated

[jira] [Commented] (HADOOP-16423) S3Guarld fsck: Check metadata consistency from S3 to metadatastore (log)

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928449#comment-16928449 ] Gabor Bota commented on HADOOP-16423: - +1 from [~ste...@apache.org] on PR #1208. Committing.

[GitHub] [hadoop] hadoop-yetus commented on issue #1418: HDDS-2089: Add createPipeline CLI.

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1418: HDDS-2089: Add createPipeline CLI. URL: https://github.com/apache/hadoop/pull/1418#issuecomment-530781902 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| |

[jira] [Updated] (HADOOP-16557) [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16557: --- Assignee: Vinayakumar B Status: Patch Available (was: Open) > [pb-upgrade] Upgrade

[GitHub] [hadoop] vinayakumarb opened a new pull request #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread GitBox
vinayakumarb opened a new pull request #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 URL: https://github.com/apache/hadoop/pull/1432 This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] bshashikant opened a new pull request #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out.

2019-09-12 Thread GitBox
bshashikant opened a new pull request #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out. URL: https://github.com/apache/hadoop/pull/1430 This is an automated message from the Apache Git Service. To

[jira] [Created] (HADOOP-16564) S3Guarld fsck: Add docs to the first iteration (S3->ddbMS, -verify)

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16564: --- Summary: S3Guarld fsck: Add docs to the first iteration (S3->ddbMS, -verify) Key: HADOOP-16564 URL: https://issues.apache.org/jira/browse/HADOOP-16564 Project: Hadoop

[GitHub] [hadoop] bgaborg merged pull request #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)

2019-09-12 Thread GitBox
bgaborg merged pull request #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log) URL: https://github.com/apache/hadoop/pull/1208 This is an automated message from the Apache Git

[jira] [Commented] (HADOOP-16069) Support configure ZK_DTSM_ZK_KERBEROS_PRINCIPAL in ZKDelegationTokenSecretManager using principal with Schema /_HOST

2019-09-12 Thread luhuachao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928386#comment-16928386 ] luhuachao commented on HADOOP-16069: [~tasanuma] thanks for reply one line code for substitute

[GitHub] [hadoop] hadoop-yetus commented on issue #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable URL: https://github.com/apache/hadoop/pull/1429#issuecomment-530746447 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16423) S3Guarld fsck: Check metadata consistency from S3 to metadatastore (log)

2019-09-12 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928447#comment-16928447 ] Hudson commented on HADOOP-16423: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17283 (See

[jira] [Created] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16565: --- Summary: Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain." Key: HADOOP-16565 URL: https://issues.apache.org/jira/browse/HADOOP-16565

[jira] [Created] (HADOOP-16558) [COMMON] use protobuf-maven-plugin to generate protobuf classes

2019-09-12 Thread Vinayakumar B (Jira)
Vinayakumar B created HADOOP-16558: -- Summary: [COMMON] use protobuf-maven-plugin to generate protobuf classes Key: HADOOP-16558 URL: https://issues.apache.org/jira/browse/HADOOP-16558 Project:

[GitHub] [hadoop] vinayakumarb opened a new pull request #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread GitBox
vinayakumarb opened a new pull request #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable URL: https://github.com/apache/hadoop/pull/1429 This is an automated message from the Apache Git

[GitHub] [hadoop] hadoop-yetus commented on issue #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out.

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out. URL: https://github.com/apache/hadoop/pull/1430#issuecomment-530754957 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] bgaborg commented on issue #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)

2019-09-12 Thread GitBox
bgaborg commented on issue #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log) URL: https://github.com/apache/hadoop/pull/1208#issuecomment-530776300 Created followup: https://issues.apache.org/jira/browse/HADOOP-16563 Committing.

[GitHub] [hadoop] hadoop-yetus commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-530779279 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] vinayakumarb merged pull request #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread GitBox
vinayakumarb merged pull request #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable URL: https://github.com/apache/hadoop/pull/1429 This is an automated message from the Apache Git

[jira] [Updated] (HADOOP-16557) [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16557: --- Summary: [pb-upgrade] Upgrade protobuf.version to 3.7.1 (was: Upgrade protobuf.version to

[GitHub] [hadoop] hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 URL: https://github.com/apache/hadoop/pull/1432#issuecomment-530788673 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform

[GitHub] [hadoop] hadoop-yetus commented on issue #1431: HDDS-1569 Support creating multiple pipelines with same datanode

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1431: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop/pull/1431#issuecomment-530799657 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-530821490 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16566: Affects Version/s: 3.3.0 > S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of >

[jira] [Created] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16566: --- Summary: S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch Key: HADOOP-16566 URL: https://issues.apache.org/jira/browse/HADOOP-16566

[jira] [Updated] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16566: Component/s: fs/s3 > S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of >

[GitHub] [hadoop] hadoop-yetus commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-530840432 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16562) [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16562: --- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed

[GitHub] [hadoop] smengcl commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-12 Thread GitBox
smengcl commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-530800476 @arp7 @bharatviswa504 Some acceptance tests are failing because the initialization of an `OzoneConfiguration`

[GitHub] [hadoop] hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 URL: https://github.com/apache/hadoop/pull/1432#issuecomment-530813915 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] bgaborg opened a new pull request #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
bgaborg opened a new pull request #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433 Change-Id: Ied43ef1522dfc6a1210d6fc58c38d8208824931b

[jira] [Created] (HADOOP-16567) S3A Secret access to fall back to XML if credential provider raises IOE.

2019-09-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-16567: --- Summary: S3A Secret access to fall back to XML if credential provider raises IOE. Key: HADOOP-16567 URL: https://issues.apache.org/jira/browse/HADOOP-16567

[GitHub] [hadoop] steveloughran commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
steveloughran commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433#issuecomment-530888108 tested?

[GitHub] [hadoop] bgaborg commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
bgaborg commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433#issuecomment-530905783 tested against ireland. No new errors, but I'm still getting

[GitHub] [hadoop] hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 URL: https://github.com/apache/hadoop/pull/1432#issuecomment-530930833 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform

[jira] [Commented] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread stack (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928784#comment-16928784 ] stack commented on HADOOP-13363: On your #1 and #2 choices above, #1 works for us. Cost is negligible

[jira] [Commented] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928679#comment-16928679 ] Steve Loughran commented on HADOOP-16566: - is there any way for us to tweak checkstyle/findbugs

[jira] [Work started] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16566 started by Gabor Bota. --- > S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of >

[GitHub] [hadoop] hadoop-yetus commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433#issuecomment-530899366 :broken_heart: **-1 overall** | Vote |

[GitHub] [hadoop] steveloughran commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
steveloughran commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433#issuecomment-530916390 +1, with the note that DurationInfo exists to do all this timing and

[GitHub] [hadoop] bgaborg merged pull request #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
bgaborg merged pull request #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433 This is an automated message

[jira] [Updated] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-13363: --- Status: Open (was: Patch Available) > Upgrade protobuf from 2.5.0 to something newer >

[GitHub] [hadoop] hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 URL: https://github.com/apache/hadoop/pull/1432#issuecomment-530952381 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] nandakumar131 closed pull request #1410: HDDS-2076. Read fails because the block cannot be located in the container

2019-09-12 Thread GitBox
nandakumar131 closed pull request #1410: HDDS-2076. Read fails because the block cannot be located in the container URL: https://github.com/apache/hadoop/pull/1410 This is an automated message from the Apache Git Service.

[jira] [Commented] (HADOOP-16568) S3A FullCredentialsTokenBinding fails if local credentials are unset

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928715#comment-16928715 ] Steve Loughran commented on HADOOP-16568: - {code} 2019-09-12 17:31:39,678 [main] DEBUG

[jira] [Resolved] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16566. - Resolution: Fixed > S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of >

[jira] [Commented] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread stack (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928795#comment-16928795 ] stack commented on HADOOP-13363: One thought, just use the hbase-thirdparty jar? Shaded protobuf,

[GitHub] [hadoop] elek opened a new pull request #1434: HDDS-2120. Remove hadoop classes from ozonefs-current jar

2019-09-12 Thread GitBox
elek opened a new pull request #1434: HDDS-2120. Remove hadoop classes from ozonefs-current jar URL: https://github.com/apache/hadoop/pull/1434 We have two kind of ozone file system jars: current and legacy. current is designed to work only with exactly the same hadoop version which is

[GitHub] [hadoop] hadoop-yetus commented on issue #1434: HDDS-2120. Remove hadoop classes from ozonefs-current jar

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1434: HDDS-2120. Remove hadoop classes from ozonefs-current jar URL: https://github.com/apache/hadoop/pull/1434#issuecomment-530956782 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928693#comment-16928693 ] Gabor Bota commented on HADOOP-16566: - maybe, but it would be better to update guava everywhere. >

[jira] [Resolved] (HADOOP-16423) S3Guarld fsck: Check metadata consistency from S3 to metadatastore (log)

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16423. - Resolution: Fixed > S3Guarld fsck: Check metadata consistency from S3 to metadatastore (log) >

[jira] [Commented] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928706#comment-16928706 ] Steve Loughran commented on HADOOP-16565: - looks like I deliberately choose london for STS''

[jira] [Commented] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928722#comment-16928722 ] Steve Loughran commented on HADOOP-16547: - latest patch will seem to do the load, but need to

[jira] [Commented] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928734#comment-16928734 ] Gabor Bota commented on HADOOP-16566: - +1 by [~ste...@apache.org] on #1433 PR. Committing. >

[jira] [Commented] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928735#comment-16928735 ] Hudson commented on HADOOP-16566: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17288 (See

[GitHub] [hadoop] hadoop-yetus commented on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3 URL: https://github.com/apache/hadoop/pull/1160#issuecomment-530923330 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime |

[jira] [Commented] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928767#comment-16928767 ] Steve Loughran commented on HADOOP-16547: - to recreate the problem you also need to set the

[jira] [Updated] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16565: Component/s: fs/s3 > Fix "com.amazonaws.SdkClientException: Unable to find a region via

[jira] [Commented] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928709#comment-16928709 ] Steve Loughran commented on HADOOP-16565: - Once you have identified the cause, add a new entry

[jira] [Updated] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16565: Affects Version/s: 3.3.0 > Fix "com.amazonaws.SdkClientException: Unable to find a

[jira] [Created] (HADOOP-16568) S3A FullCredentialsTokenBinding fails if local credentials are unset

2019-09-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-16568: --- Summary: S3A FullCredentialsTokenBinding fails if local credentials are unset Key: HADOOP-16568 URL: https://issues.apache.org/jira/browse/HADOOP-16568

[jira] [Commented] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928726#comment-16928726 ] Steve Loughran commented on HADOOP-16547: - actually, there's a simpler way to verify the move;

[jira] [Commented] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928746#comment-16928746 ] Vinayakumar B commented on HADOOP-13363: I have created subtasks to proceed step-by-step. Kept

[jira] [Commented] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928778#comment-16928778 ] Allen Wittenauer commented on HADOOP-13363: --- Since I'm the originator of this JIRA issue, I

[GitHub] [hadoop] nandakumar131 opened a new pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation.

2019-09-12 Thread GitBox
nandakumar131 opened a new pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation. URL: https://github.com/apache/hadoop/pull/1435 After #1423 hdds/ozone no more relies on hadoop parent pom, so we have to use separate

  1   2   >