[
https://issues.apache.org/jira/browse/HADOOP-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16768366#comment-16768366
]
Steve Loughran commented on HADOOP-16068:
-----------------------------------------
Tested: azure amsterdam. All hadoop-azure unit tests worked.
I am seeing failures on the command line, but I'm not sure that this problem
hasn't existed before, it's just I've not used the abfs:// codepath on "hadoop
fs"
{code}
2019-02-14 14:32:08,991 [main] INFO diag.StoreDiag
(DurationInfo.java:<init>(53)) - Starting: Creating filesystem
abfs://[email protected]/
2019-02-14 14:32:09,075 [main] DEBUG azurebfs.AzureBlobFileSystem
(AzureBlobFileSystem.java:initialize(101)) - Initializing AzureBlobFileSystem
for abfs://[email protected]/
2019-02-14 14:32:09,300 [main] DEBUG azurebfs.AzureBlobFileSystem
(AzureBlobFileSystem.java:fileSystemExists(856)) -
AzureBlobFileSystem.fileSystemExists uri:
abfs://[email protected]
2019-02-14 14:32:09,301 [main] DEBUG azurebfs.AzureBlobFileSystemStore
(AzureBlobFileSystemStore.java:getFilesystemProperties(254)) -
getFilesystemProperties for filesystem: stevel-testing2
2019-02-14 14:32:09,540 [main] DEBUG services.AbfsHttpOperation
(AbfsHttpOperation.java:processResponse(277)) - =HTTP/1.1 403 Server failed to
authenticate the request. Make sure the value of Authorization header is formed
correctly including the signature.
2019-02-14 14:32:09,540 [main] DEBUG services.AbfsHttpOperation
(AbfsHttpOperation.java:processResponse(277)) - x-ms-version=2018-11-09
2019-02-14 14:32:09,540 [main] DEBUG services.AbfsHttpOperation
(AbfsHttpOperation.java:processResponse(277)) - Server=Windows-Azure-HDFS/1.0
Microsoft-HTTPAPI/2.0
2019-02-14 14:32:09,541 [main] DEBUG services.AbfsHttpOperation
(AbfsHttpOperation.java:processResponse(277)) -
x-ms-error-code=AuthenticationFailed
2019-02-14 14:32:09,541 [main] DEBUG services.AbfsHttpOperation
(AbfsHttpOperation.java:processResponse(277)) -
x-ms-request-id=c1260275-e01f-009e-7272-c4fef8000000
2019-02-14 14:32:09,541 [main] DEBUG services.AbfsHttpOperation
(AbfsHttpOperation.java:processResponse(277)) - Date=Thu, 14 Feb 2019 14:32:09
GMT
2019-02-14 14:32:09,541 [main] DEBUG services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(198)) - HttpRequest:
403,,cid=a63bd35f-9afd-44ae-be41-268b16045013,rid=c1260275-e01f-009e-7272-c4fef8000000,connMs=23,sendMs=0,recvMs=208,sent=0,recv=0,HEAD,https://account.dfs.core.windows.net/stevel-testing2?resource=filesystem&timeout=90
2019-02-14 14:32:09,547 [main] INFO diag.StoreDiag
(DurationInfo.java:close(100)) - Creating filesystem
abfs://[email protected]/: duration 0:00:558
Operation failed: "Server failed to authenticate the request. Make sure the
value of Authorization header is formed correctly including the signature.",
403, HEAD,
https://account.dfs.core.windows.net/stevel-testing2?resource=filesystem&timeout=90
at
org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.execute(AbfsRestOperation.java:135)
at
org.apache.hadoop.fs.azurebfs.services.AbfsClient.getFilesystemProperties(AbfsClient.java:209)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore.getFilesystemProperties(AzureBlobFileSystemStore.java:259)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.fileSystemExists(AzureBlobFileSystem.java:859)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.initialize(AzureBlobFileSystem.java:110)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3324)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:136)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3373)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3341)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:491)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361)
at
org.apache.hadoop.fs.store.diag.StoreDiag.executeFileSystemOperations(StoreDiag.java:832)
at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:420)
at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:360)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
at org.apache.hadoop.fs.store.diag.StoreDiag.exec(StoreDiag.java:1127)
at org.apache.hadoop.fs.store.diag.StoreDiag.main(StoreDiag.java:1136)
at storediag.main(storediag.java:24)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
2019-02-14 14:32:09,549 [main] INFO util.ExitUtil
(ExitUtil.java:terminate(210)) - Exiting with status -1: Operation failed:
"Server failed to authenticate the request. Make sure the value of
Authorization header is formed correctly including the signature.", 403, HEAD,
https://account.dfs.core.windows.net/stevel-testing2?resource=filesystem&timeout=90
{code}
I have no idea what is up here. Searches for the message usually hint that the
caller is using SAS auth and their clock is wrong, but as I'm not using SAS, I
can't say that's the direct blame. And hadoop-azure tests with the same bucket
are working. The difference is that this is the CLI entry point.
I also don't see how much else can be added in the client here. I'll do another
iteration which tries to log the signing info
> ABFS Auth and DT plugins to be bound to specific URI of the FS
> --------------------------------------------------------------
>
> Key: HADOOP-16068
> URL: https://issues.apache.org/jira/browse/HADOOP-16068
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 3.2.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Attachments: HADOOP-16068-001.patch, HADOOP-16068-002.patch,
> HADOOP-16068-003.patch, HADOOP-16068-004.patch, HADOOP-16068-005.patch,
> HADOOP-16068-006.patch
>
>
> followup from HADOOP-15692: pass in the URI & conf of the owner FS to bind
> the plugins to the specific FS instance. Without that you can't have per FS
> auth
> +add a stub DT plugin for testing, verify that DTs are collected.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
