[jira] [Comment Edited] (HADOOP-15427) hadoop shell complains needlessly about "ERROR: Tools helper .. not found"

[ https://issues.apache.org/jira/browse/HADOOP-15427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458977#comment-16458977 ] Allen Wittenauer edited comment on HADOOP-15427 at 4/30/18 8:07 PM:

[jira] [Commented] (HADOOP-15428) s3guard bucket-info -unguarded will guard bucket if FS is set to do this automatically

[ https://issues.apache.org/jira/browse/HADOOP-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459191#comment-16459191 ] Steve Loughran commented on HADOOP-15428: - Actually I'm confused now. If the bucket has s3guard

[jira] [Commented] (HADOOP-15427) hadoop shell complains needlessly about "ERROR: Tools helper .. not found"

[ https://issues.apache.org/jira/browse/HADOOP-15427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458977#comment-16458977 ] Allen Wittenauer commented on HADOOP-15427: --- Did you try turning it off and on? :) I just

[jira] [Updated] (HADOOP-15430) hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

[ https://issues.apache.org/jira/browse/HADOOP-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15430: Status: Patch Available (was: Open) > hadoop fs -mkdir -p path-ending-with-slash/ fails

[jira] [Updated] (HADOOP-15430) hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

[ https://issues.apache.org/jira/browse/HADOOP-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15430: Attachment: HADOOP-15430-001.patch > hadoop fs -mkdir -p path-ending-with-slash/ fails

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459107#comment-16459107 ] Xiao Chen commented on HADOOP-15408: I was saying this because in patch 1, TestKMS was changed to

[jira] [Commented] (HADOOP-15430) hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

[ https://issues.apache.org/jira/browse/HADOOP-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459177#comment-16459177 ] Steve Loughran commented on HADOOP-15430: - Patch submitted test run: nowhere this patch

[jira] [Commented] (HADOOP-15430) hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

[ https://issues.apache.org/jira/browse/HADOOP-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459095#comment-16459095 ] Steve Loughran commented on HADOOP-15430: - yeah, that test shows we've been close to this. I'm

[jira] [Commented] (HADOOP-15395) DefaultImpersonationProvider fails to parse proxy user config if username has . in it

[ https://issues.apache.org/jira/browse/HADOOP-15395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459018#comment-16459018 ] Ajay Kumar commented on HADOOP-15395: - [~msingh] thanks for review, fixed checkstyle issues in patch

[jira] [Updated] (HADOOP-15395) DefaultImpersonationProvider fails to parse proxy user config if username has . in it

[ https://issues.apache.org/jira/browse/HADOOP-15395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15395: Attachment: HADOOP-15395.01.patch > DefaultImpersonationProvider fails to parse proxy user config

[jira] [Commented] (HADOOP-15250) Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong

[ https://issues.apache.org/jira/browse/HADOOP-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459056#comment-16459056 ] Greg Senia commented on HADOOP-15250: - [~ajayydv] Feel free to run with it!!! > Split-DNS

[jira] [Commented] (HADOOP-15250) Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong

[ https://issues.apache.org/jira/browse/HADOOP-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459127#comment-16459127 ] genericqa commented on HADOOP-15250: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15239) S3ABlockOutputStream.flush() be no-op when stream closed

[ https://issues.apache.org/jira/browse/HADOOP-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-15239: -- Resolution: Fixed Fix Version/s: 3.2.0 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-15430) hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

[ https://issues.apache.org/jira/browse/HADOOP-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459354#comment-16459354 ] genericqa commented on HADOOP-15430: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15239) S3ABlockOutputStream.flush() be no-op when stream closed

[ https://issues.apache.org/jira/browse/HADOOP-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459259#comment-16459259 ] Hudson commented on HADOOP-15239: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14094 (See

[jira] [Commented] (HADOOP-10783) apache-commons-lang.jar 2.6 does not support FreeBSD -upgrade to 3.x needed

[ https://issues.apache.org/jira/browse/HADOOP-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459450#comment-16459450 ] Takanobu Asanuma commented on HADOOP-10783: --- Thanks for working on this, all. I'd like to

[jira] [Assigned] (HADOOP-10783) apache-commons-lang.jar 2.6 does not support FreeBSD -upgrade to 3.x needed

[ https://issues.apache.org/jira/browse/HADOOP-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HADOOP-10783: - Assignee: Takanobu Asanuma > apache-commons-lang.jar 2.6 does not support

[jira] [Commented] (HADOOP-15395) DefaultImpersonationProvider fails to parse proxy user config if username has . in it

[ https://issues.apache.org/jira/browse/HADOOP-15395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459250#comment-16459250 ] genericqa commented on HADOOP-15395: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14178) Move Mockito up to version 2.x

[ https://issues.apache.org/jira/browse/HADOOP-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459454#comment-16459454 ] Akira Ajisaka commented on HADOOP-14178: 013 patch: rebased > Move Mockito up to version 2.x >

[jira] [Updated] (HADOOP-14178) Move Mockito up to version 2.x

[ https://issues.apache.org/jira/browse/HADOOP-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14178: --- Attachment: HADOOP-14178.013.patch > Move Mockito up to version 2.x >

[jira] [Commented] (HADOOP-15398) StagingTestBase uses methods not available in Mockito 1.8.5

[ https://issues.apache.org/jira/browse/HADOOP-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459462#comment-16459462 ] Akira Ajisaka commented on HADOOP-15398: LGTM, would you update LICENSE.txt as well?

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458635#comment-16458635 ] Lukas Waldmann commented on HADOOP-1: - 3.1+: I understand but we are still on 2.7 baseline

[jira] [Comment Edited] (HADOOP-14444) New implementation of ftp and sftp filesystems

[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458635#comment-16458635 ] Lukas Waldmann edited comment on HADOOP-1 at 4/30/18 2:55 PM: --

[jira] [Commented] (HADOOP-15428) s3guard bucket-info -unguarded will guard bucket if FS is set to do this automatically

[ https://issues.apache.org/jira/browse/HADOOP-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458670#comment-16458670 ] ASF GitHub Bot commented on HADOOP-15428: - GitHub user lqjack opened a pull request:

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458634#comment-16458634 ] Steve Loughran commented on HADOOP-1: - FWIW, I'd focus on Hadoop 3.1+; it's unlikely we'd be

[jira] [Commented] (HADOOP-15428) s3guard bucket-info -unguarded will guard bucket if FS is set to do this automatically

[ https://issues.apache.org/jira/browse/HADOOP-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458671#comment-16458671 ] lqjack commented on HADOOP-15428: - https://github.com/apache/hadoop/pull/373 > s3guard bucket-info

[jira] [Commented] (HADOOP-15421) Stabilise/formalise the JSON _SUCCESS format used in the S3A committers

[ https://issues.apache.org/jira/browse/HADOOP-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458794#comment-16458794 ] Ryan Blue commented on HADOOP-15421: I think this makes sense. As long as there is a _SUCCESS file,

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458803#comment-16458803 ] Rushabh S Shah commented on HADOOP-15408: - bq. so I assumed that was the st you saw... Yes. bq.

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458679#comment-16458679 ] Íñigo Goiri commented on HADOOP-1: -- I took a quick look at [^HADOOP-1.14.patch] and I have

[jira] [Commented] (HADOOP-15356) Make HTTP timeout configurable in ADLS Connector

[ https://issues.apache.org/jira/browse/HADOOP-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458683#comment-16458683 ] Sean Mackrory commented on HADOOP-15356: {quote}I think there are some existing update ADL

[jira] [Created] (HADOOP-15430) hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

Steve Loughran created HADOOP-15430: --- Summary: hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard Key: HADOOP-15430 URL: https://issues.apache.org/jira/browse/HADOOP-15430 Project:

[jira] [Commented] (HADOOP-15430) hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

[ https://issues.apache.org/jira/browse/HADOOP-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458834#comment-16458834 ] Steve Loughran commented on HADOOP-15430: - log (but not full stack). We have some tests for this

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458842#comment-16458842 ] Xiao Chen commented on HADOOP-15408: Thanks for the explanation, that feels better. :) But as patch

[jira] [Commented] (HADOOP-15429) unsynchronized index causes DataInputByteBuffer$Buffer.read hangs

[ https://issues.apache.org/jira/browse/HADOOP-15429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458852#comment-16458852 ] Chris Douglas commented on HADOOP-15429: {{DataInputByteBuffer}} is not threadsafe. What is the

[jira] [Commented] (HADOOP-15356) Make HTTP timeout configurable in ADLS Connector

[ https://issues.apache.org/jira/browse/HADOOP-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458732#comment-16458732 ] Steve Loughran commented on HADOOP-15356: - oh, see you did the one I was thinking of,

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458731#comment-16458731 ] Rushabh S Shah commented on HADOOP-15408: - {quote}What exception did you see with this case?

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458737#comment-16458737 ] Xiao Chen commented on HADOOP-15408: bq. I was asking that where did you see this stack trace ? That

[jira] [Created] (HADOOP-15429) unsynchronized index causes DataInputByteBuffer$Buffer.read hangs

John Doe created HADOOP-15429: - Summary: unsynchronized index causes DataInputByteBuffer$Buffer.read hangs Key: HADOOP-15429 URL: https://issues.apache.org/jira/browse/HADOOP-15429 Project: Hadoop Common

[jira] [Updated] (HADOOP-15429) unsynchronized index causes DataInputByteBuffer$Buffer.read hangs

[ https://issues.apache.org/jira/browse/HADOOP-15429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Doe updated HADOOP-15429: -- Description: In DataInputByteBuffer$Buffer class, the fields bidx and buffers, etc are

[jira] [Commented] (HADOOP-15430) hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

[ https://issues.apache.org/jira/browse/HADOOP-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458861#comment-16458861 ] Steve Loughran commented on HADOOP-15430: - And with a patch to fs.shell to log stack traces, you

[jira] [Commented] (HADOOP-15421) Stabilise/formalise the JSON _SUCCESS format used in the S3A committers

[ https://issues.apache.org/jira/browse/HADOOP-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458869#comment-16458869 ] Steve Loughran commented on HADOOP-15421: - Currently {code} { "name" :

[jira] [Commented] (HADOOP-15408) HADOOP-14445 broke Spark.

[ https://issues.apache.org/jira/browse/HADOOP-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458911#comment-16458911 ] Rushabh S Shah commented on HADOOP-15408: - bq. In other words, even though the bytes are the

[jira] [Comment Edited] (HADOOP-15421) Stabilise/formalise the JSON _SUCCESS format used in the S3A committers

[ https://issues.apache.org/jira/browse/HADOOP-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458869#comment-16458869 ] Steve Loughran edited comment on HADOOP-15421 at 4/30/18 6:48 PM: --

[jira] [Commented] (HADOOP-15427) hadoop shell complains needlessly about "ERROR: Tools helper .. not found"

[ https://issues.apache.org/jira/browse/HADOOP-15427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458529#comment-16458529 ] Steve Loughran commented on HADOOP-15427: - we see it when you type the 'hadoop s3guard' command.

[jira] [Commented] (HADOOP-15428) s3guard bucket-info -unguarded will guard bucket if FS is set to do this automatically

[ https://issues.apache.org/jira/browse/HADOOP-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458532#comment-16458532 ] Steve Loughran commented on HADOOP-15428: - Here's why: I would expect the command to return "0",

[jira] [Commented] (HADOOP-15422) s3guard doesn't init when the secrets are in the s3a URI

[ https://issues.apache.org/jira/browse/HADOOP-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458535#comment-16458535 ] Steve Loughran commented on HADOOP-15422: - bq. This is your punishment for putting secrets in

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458536#comment-16458536 ] Steve Loughran commented on HADOOP-1: - [~luky] I haven't forgotten about this, it is one of

[jira] [Commented] (HADOOP-15430) hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

[ https://issues.apache.org/jira/browse/HADOOP-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458951#comment-16458951 ] Steve Loughran commented on HADOOP-15430: - And with some checking of the query before it is

[jira] [Updated] (HADOOP-15250) Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong

[ https://issues.apache.org/jira/browse/HADOOP-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15250: Attachment: HADOOP-15250.00.patch > Split-DNS MultiHomed Server Network Cluster Network IPC

[jira] [Commented] (HADOOP-15414) Job submit not work well on HDFS Federation with Transparent Encryption feature

[ https://issues.apache.org/jira/browse/HADOOP-15414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458962#comment-16458962 ] Daryn Sharp commented on HADOOP-15414: -- I'm chasing KMS load issues, will check this out soon. I

[jira] [Commented] (HADOOP-15250) Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong

[ https://issues.apache.org/jira/browse/HADOOP-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458963#comment-16458963 ] Ajay Kumar commented on HADOOP-15250: - [~gss2002], If you don't mind I would like to continue this

[jira] [Commented] (HADOOP-15430) hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

[ https://issues.apache.org/jira/browse/HADOOP-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458970#comment-16458970 ] Aaron Fabbri commented on HADOOP-15430: --- I guess we need a test case for the CLI mkdir, as a

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458557#comment-16458557 ] Lukas Waldmann commented on HADOOP-1: - Thank you Steve, I certainly try to test it as much