[jira] [Updated] (HADOOP-15070) add test to verify FileSystem and paths differentiate on user info
[
https://issues.apache.org/jira/browse/HADOOP-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-15070:
Status: Open (was: Patch Available)
only just noticed this was +1'd updating patch ASAP.
Doesn't apply right now. TestFileSystemCaching is gone
> add test to verify FileSystem and paths differentiate on user info
> --
>
> Key: HADOOP-15070
> URL: https://issues.apache.org/jira/browse/HADOOP-15070
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, test
>Affects Versions: 2.8.2
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Minor
> Attachments: HADOOP-15070-001.patch
>
>
> Add a test to verify that userinfo data is (correctly) used to differentiate
> the entries in the FS cache, so are treated as different filesystems.
> * This is criticalk for wasb, which uses the username to identify the
> container, in a path like {{wasb:contain...@stevel.azure.net}}. This works in
> Hadoop, but SPARK-22587 shows that it may not be followed everywhere (and
> given there's no documentation, who can fault them?)
> * AbstractFileSystem.checkPath looks suspiciously like it's path validation
> just checks host, not authority. That needs a test too.
> * And we should cut the @LimitedPrivate(HDFS, Mapreduce) from
> Path.makeQualified. If MR needs it, it should be considered open to all apps
> using the Hadoop APIs. Until I looked at the code I thought it was...
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15070) add test to verify FileSystem and paths differentiate on user info
[
https://issues.apache.org/jira/browse/HADOOP-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-15070:
Attachment: HADOOP-15070-001.patch
patch 001: add new comparision test that keys include userInfo. Also: update
TestFileSystemCaching to Java7/8, factor out common operations
> add test to verify FileSystem and paths differentiate on user info
> --
>
> Key: HADOOP-15070
> URL: https://issues.apache.org/jira/browse/HADOOP-15070
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, test
>Affects Versions: 2.8.2
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Minor
> Attachments: HADOOP-15070-001.patch
>
>
> Add a test to verify that userinfo data is (correctly) used to differentiate
> the entries in the FS cache, so are treated as different filesystems.
> * This is criticalk for wasb, which uses the username to identify the
> container, in a path like {{wasb:contain...@stevel.azure.net}}. This works in
> Hadoop, but SPARK-22587 shows that it may not be followed everywhere (and
> given there's no documentation, who can fault them?)
> * AbstractFileSystem.checkPath looks suspiciously like it's path validation
> just checks host, not authority. That needs a test too.
> * And we should cut the @LimitedPrivate(HDFS, Mapreduce) from
> Path.makeQualified. If MR needs it, it should be considered open to all apps
> using the Hadoop APIs. Until I looked at the code I thought it was...
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15070) add test to verify FileSystem and paths differentiate on user info
[
https://issues.apache.org/jira/browse/HADOOP-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-15070:
Status: Patch Available (was: Open)
> add test to verify FileSystem and paths differentiate on user info
> --
>
> Key: HADOOP-15070
> URL: https://issues.apache.org/jira/browse/HADOOP-15070
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, test
>Affects Versions: 2.8.2
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Minor
> Attachments: HADOOP-15070-001.patch
>
>
> Add a test to verify that userinfo data is (correctly) used to differentiate
> the entries in the FS cache, so are treated as different filesystems.
> * This is criticalk for wasb, which uses the username to identify the
> container, in a path like {{wasb:contain...@stevel.azure.net}}. This works in
> Hadoop, but SPARK-22587 shows that it may not be followed everywhere (and
> given there's no documentation, who can fault them?)
> * AbstractFileSystem.checkPath looks suspiciously like it's path validation
> just checks host, not authority. That needs a test too.
> * And we should cut the @LimitedPrivate(HDFS, Mapreduce) from
> Path.makeQualified. If MR needs it, it should be considered open to all apps
> using the Hadoop APIs. Until I looked at the code I thought it was...
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
