[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-14 Thread Arpit Agarwal (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Agarwal updated HDDS-819:
---
Component/s: Ozone Filesystem

> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>  Components: Ozone Filesystem
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
> Fix For: 0.4.0
>
> Attachments: HDDS-819.001.patch, HDDS-819.002.patch, 
> HDDS-819.003.patch
>
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
>  # When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
>  # {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
>  # {{ListStatus}} on a directory should list fake sub-directories also along 
> with files.
>  # {\{ListStatus}} on a directory should also files and sub-directories with 
> the same name.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-14 Thread Arpit Agarwal (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Agarwal updated HDDS-819:
---
  Resolution: Fixed
   Fix Version/s: 0.4.0
Target Version/s:   (was: 0.4.0)
  Status: Resolved  (was: Patch Available)

Committed after confirming with Hanisha that contract tests pass.

> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
> Fix For: 0.4.0
>
> Attachments: HDDS-819.001.patch, HDDS-819.002.patch, 
> HDDS-819.003.patch
>
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
>  # When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
>  # {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
>  # {{ListStatus}} on a directory should list fake sub-directories also along 
> with files.
>  # {\{ListStatus}} on a directory should also files and sub-directories with 
> the same name.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-12 Thread Hanisha Koneru (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hanisha Koneru updated HDDS-819:

Attachment: HDDS-819.003.patch

> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
> Attachments: HDDS-819.001.patch, HDDS-819.002.patch, 
> HDDS-819.003.patch
>
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
>  # When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
>  # {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
>  # {{ListStatus}} on a directory should list fake sub-directories also along 
> with files.
>  # {\{ListStatus}} on a directory should also files and sub-directories with 
> the same name.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-12 Thread Hanisha Koneru (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hanisha Koneru updated HDDS-819:

Attachment: HDDS-819.003.patch

> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
> Attachments: HDDS-819.001.patch, HDDS-819.002.patch, 
> HDDS-819.003.patch
>
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
>  # When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
>  # {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
>  # {{ListStatus}} on a directory should list fake sub-directories also along 
> with files.
>  # {\{ListStatus}} on a directory should also files and sub-directories with 
> the same name.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-12 Thread Hanisha Koneru (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hanisha Koneru updated HDDS-819:

Attachment: (was: HDDS-819.003.patch)

> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
> Attachments: HDDS-819.001.patch, HDDS-819.002.patch
>
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
>  # When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
>  # {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
>  # {{ListStatus}} on a directory should list fake sub-directories also along 
> with files.
>  # {\{ListStatus}} on a directory should also files and sub-directories with 
> the same name.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-09 Thread Hanisha Koneru (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hanisha Koneru updated HDDS-819:

Description: 
To match the behavior of o3fs with that of the S3AFileSystem, following changes 
need to be made to OzoneFileSystem.
 # When creating files, we should add only 1 key. Keys corresponding to the 
parent directories should not be created.
 # {{GetFileStatus}} should return the status for fake directories (directories 
which do not actually exist as a key but there exists a key which is a child of 
this directory). For example, if there exists a key _/dir1/dir2/file2_, 
{{GetFileStatus("/dir1/")}} should return _/dir1/_ as a directory.
 # {{ListStatus}} on a directory should list fake sub-directories also along 
with files.
 # {\{ListStatus}} on a directory should also files and sub-directories with 
the same name.

  was:
To match the behavior of o3fs with that of the S3AFileSystem, following changes 
need to be made to OzoneFileSystem.
 # When creating files, we should add only 1 key. Keys corresponding to the 
parent directories should not be created.
 # {{GetFileStatus}} should return the status for fake directories (directories 
which do not actually exist as a key but there exists a key which is a child of 
this directory). For example, if there exists a key _/dir1/dir2/file2_, 
{{GetFileStatus("/dir1/")}} should return _/dir1/_ as a directory.
 # {{ListStatus}} on a directory should list fake sub-directories also along 
with files.


> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
> Attachments: HDDS-819.001.patch, HDDS-819.002.patch
>
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
>  # When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
>  # {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
>  # {{ListStatus}} on a directory should list fake sub-directories also along 
> with files.
>  # {\{ListStatus}} on a directory should also files and sub-directories with 
> the same name.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-09 Thread Hanisha Koneru (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hanisha Koneru updated HDDS-819:

Attachment: HDDS-819.002.patch

> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
> Attachments: HDDS-819.001.patch, HDDS-819.002.patch
>
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
>  # When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
>  # {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
>  # {{ListStatus}} on a directory should list fake sub-directories also along 
> with files.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-08 Thread Hanisha Koneru (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hanisha Koneru updated HDDS-819:

Description: 
To match the behavior of o3fs with that of the S3AFileSystem, following changes 
need to be made to OzoneFileSystem.
 # When creating files, we should add only 1 key. Keys corresponding to the 
parent directories should not be created.
 # {{GetFileStatus}} should return the status for fake directories (directories 
which do not actually exist as a key but there exists a key which is a child of 
this directory). For example, if there exists a key _/dir1/dir2/file2_, 
{{GetFileStatus("/dir1/")}} should return _/dir1/_ as a directory.
 # {{ListStatus}} on a directory should list fake sub-directories also along 
with files.

  was:
To match the behavior of o3fs with that of the S3AFileSystem, following changes 
need to be made to OzoneFileSystem.
# When creating files, we should add only 1 key. Keys corresponding to the 
parent directories should not be created.
# {{GetFileStatus}} should return the status for fake directories (directories 
which do not actually exist as a key but there exists a key which is a child of 
this directory). For example, if there exists a key _/dir1/dir2/file2_, 
{{GetFileStatus("/dir1/")}} should return _/dir1/_ as a directory.
# {{ListStatus}} on a directory should list fake sub-directories.


> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
> Attachments: HDDS-819.001.patch
>
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
>  # When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
>  # {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
>  # {{ListStatus}} on a directory should list fake sub-directories also along 
> with files.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-08 Thread Arpit Agarwal (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arpit Agarwal updated HDDS-819:
---
Description: 
To match the behavior of o3fs with that of the S3AFileSystem, following changes 
need to be made to OzoneFileSystem.
# When creating files, we should add only 1 key. Keys corresponding to the 
parent directories should not be created.
# {{GetFileStatus}} should return the status for fake directories (directories 
which do not actually exist as a key but there exists a key which is a child of 
this directory). For example, if there exists a key _/dir1/dir2/file2_, 
{{GetFileStatus("/dir1/")}} should return _/dir1/_ as a directory.
# {{ListStatus}} on a directory should list fake sub-directories.

  was:
To match the behavior of o3fs with that of the S3AFileSystem, following changes 
need to be made to OzoneFileSystem.
 1. When creating files, we should add only 1 key. Keys corresponding to the 
parent directories should not be created.
 2. {{GetFileStatus}} should return the status for fake directories 
(directories which do not actually exist as a key but there exists a key which 
is a child of this directory). For example, if there exists a key 
_/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
directory.
3. {{ListStatus}} on a directory should list fake sub-directories.


> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
> Attachments: HDDS-819.001.patch
>
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
> # When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
> # {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
> # {{ListStatus}} on a directory should list fake sub-directories.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-08 Thread Hanisha Koneru (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hanisha Koneru updated HDDS-819:

Target Version/s: 0.4.0

> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
>  1. When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
>  2. {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
> 3. {{ListStatus}} on a directory should list fake sub-directories.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-08 Thread Hanisha Koneru (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hanisha Koneru updated HDDS-819:

Status: Patch Available  (was: Open)

> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
> Attachments: HDDS-819.001.patch
>
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
>  1. When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
>  2. {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
> 3. {{ListStatus}} on a directory should list fake sub-directories.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-819) Match OzoneFileSystem behavior with S3AFileSystem

2018-11-08 Thread Hanisha Koneru (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDDS-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hanisha Koneru updated HDDS-819:

Attachment: HDDS-819.001.patch

> Match OzoneFileSystem behavior with S3AFileSystem
> -
>
> Key: HDDS-819
> URL: https://issues.apache.org/jira/browse/HDDS-819
> Project: Hadoop Distributed Data Store
>  Issue Type: Bug
>Reporter: Hanisha Koneru
>Assignee: Hanisha Koneru
>Priority: Major
> Attachments: HDDS-819.001.patch
>
>
> To match the behavior of o3fs with that of the S3AFileSystem, following 
> changes need to be made to OzoneFileSystem.
>  1. When creating files, we should add only 1 key. Keys corresponding to the 
> parent directories should not be created.
>  2. {{GetFileStatus}} should return the status for fake directories 
> (directories which do not actually exist as a key but there exists a key 
> which is a child of this directory). For example, if there exists a key 
> _/dir1/dir2/file2_, {{GetFileStatus("/dir1/")}} should return _/dir1/_ as a 
> directory.
> 3. {{ListStatus}} on a directory should list fake sub-directories.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org