[jira] [Commented] (HDDS-1830) OzoneManagerDoubleBuffer#stop should wait for daemon thread to die

2019-07-22 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890515#comment-16890515 ] Siyao Meng commented on HDDS-1830: -- I tested that if I call join() right after interrupt(

[jira] [Commented] (HDFS-14595) HDFS-11848 breaks API compatibility

2019-07-23 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891368#comment-16891368 ] Siyao Meng commented on HDFS-14595: --- [~ayushtkn] Makes sense. I'll post a new patch soo

[jira] [Commented] (HDFS-14663) HTTPFS ListStatus_Batch does not return batches as expected

2019-07-23 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891398#comment-16891398 ] Siyao Meng commented on HDFS-14663: --- I've just tested on my side. It does seem that Htt

[jira] [Commented] (HDFS-13879) FileSystem: Add allowSnapshot, disallowSnapshot, getSnapshotDiffReport and getSnapshottableDirListing

2019-07-23 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891533#comment-16891533 ] Siyao Meng commented on HDFS-13879: --- Hi [~hemanthboyina], no I haven't done any coding

[jira] [Created] (HDFS-14665) HttpFS: LISTSTATUS result is missing some fields for each entry

2019-07-23 Thread Siyao Meng (JIRA)
Siyao Meng created HDFS-14665: - Summary: HttpFS: LISTSTATUS result is missing some fields for each entry Key: HDFS-14665 URL: https://issues.apache.org/jira/browse/HDFS-14665 Project: Hadoop HDFS

[jira] [Commented] (HDDS-1830) OzoneManagerDoubleBuffer#stop should wait for daemon thread to die

2019-07-24 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892225#comment-16892225 ] Siyao Meng commented on HDDS-1830: -- ThanksĀ [~bharatviswa]. In a short discussion with [~a

[jira] [Updated] (HDDS-1829) On OM reload/restart OmMetrics#numKeys should be updated

2019-07-25 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1829: - Summary: On OM reload/restart OmMetrics#numKeys should be updated (was: On OM reload/ restart OmMetrics#n

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2019-07-30 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13916: -- Issue Type: New Feature (was: Improvement) > Distcp SnapshotDiff not completely implemented for suppor

[jira] [Assigned] (HDFS-14663) HTTPFS ListStatus_Batch does not return batches as expected

2019-07-30 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng reassigned HDFS-14663: - Assignee: Siyao Meng > HTTPFS ListStatus_Batch does not return batches as expected > ---

[jira] [Created] (HDFS-14683) WebHDFS: Add erasureCodingPolicy field to GETCONTENTSUMMARY result

2019-07-30 Thread Siyao Meng (JIRA)
Siyao Meng created HDFS-14683: - Summary: WebHDFS: Add erasureCodingPolicy field to GETCONTENTSUMMARY result Key: HDFS-14683 URL: https://issues.apache.org/jira/browse/HDFS-14683 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14683) WebHDFS: Add erasureCodingPolicy field to GETCONTENTSUMMARY response

2019-07-30 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14683: -- Summary: WebHDFS: Add erasureCodingPolicy field to GETCONTENTSUMMARY response (was: WebHDFS: Add erasu

[jira] [Commented] (HDFS-14034) Support getQuotaUsage API in WebHDFS

2019-07-30 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896699#comment-16896699 ] Siyao Meng commented on HDFS-14034: --- [~jojochuang] Filed HDFS-14683 to add erasureCodin

[jira] [Updated] (HDFS-14683) WebHDFS: Add erasureCodingPolicy field to GETCONTENTSUMMARY response

2019-07-30 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14683: -- Description: Quote [~jojochuang]'s [comment|https://issues.apache.org/jira/browse/HDFS-14034?focusedCo

[jira] [Updated] (HDFS-14683) WebHDFS: Add erasureCodingPolicy field to GETCONTENTSUMMARY response

2019-07-30 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14683: -- Description: Quote [~jojochuang]'s [comment|https://issues.apache.org/jira/browse/HDFS-14034?focusedCo

[jira] [Updated] (HDFS-14683) WebHDFS: Add erasureCodingPolicy field to GETCONTENTSUMMARY response

2019-07-31 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14683: -- Description: Quote [~jojochuang]'s [comment|https://issues.apache.org/jira/browse/HDFS-14034?focusedCo

[jira] [Updated] (HDFS-14683) WebHDFS: Add erasureCodingPolicy field to GETCONTENTSUMMARY response

2019-07-31 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14683: -- Description: Quote [~jojochuang]'s [comment|https://issues.apache.org/jira/browse/HDFS-14034?focusedCo

[jira] [Updated] (HDFS-14683) WebHDFS: Add erasureCodingPolicy field to GETCONTENTSUMMARY response

2019-07-31 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14683: -- Description: Quote [~jojochuang]'s [comment|https://issues.apache.org/jira/browse/HDFS-14034?focusedCo

[jira] [Created] (HDFS-14686) HttpFS: HttpFSFileSystem.getErasureCodingPolicy always returns null

2019-07-31 Thread Siyao Meng (JIRA)
Siyao Meng created HDFS-14686: - Summary: HttpFS: HttpFSFileSystem.getErasureCodingPolicy always returns null Key: HDFS-14686 URL: https://issues.apache.org/jira/browse/HDFS-14686 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14686) HttpFS: HttpFSFileSystem.getErasureCodingPolicy always returns null

2019-07-31 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14686: -- Description: The root cause is that FSOperations#contentSummaryToJSON doesn't parse ContentSummary.era

[jira] [Updated] (HDFS-14686) HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null

2019-07-31 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14686: -- Summary: HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null (was: HttpFS: HttpFSFileS

[jira] [Updated] (HDFS-14686) HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null

2019-07-31 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14686: -- Description: The root cause is that FSOperations#contentSummaryToJSON doesn't parse ContentSummary.era

[jira] [Updated] (HDFS-14686) HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null

2019-07-31 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14686: -- Description: The root cause is that FSOperations#contentSummaryToJSON doesn't parse ContentSummary.era

[jira] [Updated] (HDFS-14686) HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null

2019-07-31 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14686: -- Description: The root cause is that *FSOperations#contentSummaryToJSON* doesn't parse *ContentSummary.

[jira] [Updated] (HDFS-13505) Turn on HDFS ACLs by default.

2019-07-31 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13505: -- Assignee: Siyao Meng (was: Ajay Kumar) Status: In Progress (was: Patch Available) I'll continue

[jira] [Updated] (HDFS-13505) Turn on HDFS ACLs by default.

2019-07-31 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13505: -- Attachment: HDFS-13505.001.patch Status: Patch Available (was: In Progress) Posted patch rev 0

[jira] [Updated] (HDFS-13505) Turn on HDFS ACLs by default.

2019-08-01 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13505: -- Release Note: By default, dfs.namenode.acls.enabled is now set to true. If you haven't set dfs.namenod

[jira] [Updated] (HDFS-13505) Turn on HDFS ACLs by default.

2019-08-01 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13505: -- Release Note: By default, dfs.namenode.acls.enabled is now set to true. If you haven't set dfs.namenod

[jira] [Created] (HDDS-1891) Ozone fs shell command should work with default port when port number is not specified

2019-08-01 Thread Siyao Meng (JIRA)
Siyao Meng created HDDS-1891: Summary: Ozone fs shell command should work with default port when port number is not specified Key: HDDS-1891 URL: https://issues.apache.org/jira/browse/HDDS-1891 Project: H

[jira] [Updated] (HDDS-1891) Ozone fs shell command should work with default port when port number is not specified

2019-08-01 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1891: - Description: {code:bash|title=Without port number -> Error} $ ozone fs -ls o3fs://bucket.volume.localhost/

[jira] [Updated] (HDDS-1891) Ozone fs shell command should work with default port when port number is not specified

2019-08-01 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1891: - Description: {code:title=Without port number -> Error} $ ozone fs -ls o3fs://bucket.volume.localhost/ -ls:

[jira] [Updated] (HDDS-1892) HA failover attempt log level should be set to DEBUG

2019-08-01 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1892: - Summary: HA failover attempt log level should be set to DEBUG (was: HA failover log level should be set t

[jira] [Created] (HDDS-1892) HA failover log level should be set to DEBUG

2019-08-01 Thread Siyao Meng (JIRA)
Siyao Meng created HDDS-1892: Summary: HA failover log level should be set to DEBUG Key: HDDS-1892 URL: https://issues.apache.org/jira/browse/HDDS-1892 Project: Hadoop Distributed Data Store Issu

[jira] [Updated] (HDDS-1892) HA failover attempt log level should be set to DEBUG

2019-08-01 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1892: - Description: Current HA failover log level is INFO: {code:bash} $ ozone sh volume create /volume 2019-08-0

[jira] [Updated] (HDFS-14687) Standby Namenode never come out of safemode when EC files are being written.

2019-08-01 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14687: -- Description: When huge number of EC files are being written and SBN is restarted then it will never co

[jira] [Updated] (HDFS-14687) Standby Namenode never come out of safemode when EC files are being written.

2019-08-01 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14687: -- Summary: Standby Namenode never come out of safemode when EC files are being written. (was: Standby Na

[jira] [Updated] (HDDS-1892) HA failover attempt log level should be set to DEBUG

2019-08-01 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1892: - Description: Current HA failover log level is INFO: {code:bash} $ ozone sh volume create /volume 2019-08-0

[jira] [Commented] (HDFS-14686) HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898862#comment-16898862 ] Siyao Meng commented on HDFS-14686: --- [~jojochuang] No. WebHDFS is fine. Thanks for rev

[jira] [Commented] (HDFS-12125) Document the missing -removePolicy command of ec

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898871#comment-16898871 ] Siyao Meng commented on HDFS-12125: --- [~vincent he] Are you planning to wrap up this jir

[jira] [Commented] (HDFS-14665) HttpFS: LISTSTATUS result is missing some fields for each entry

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898889#comment-16898889 ] Siyao Meng commented on HDFS-14665: --- [~jojochuang] Yeah. I haven't yet started on this

[jira] [Assigned] (HDFS-14665) HttpFS: LISTSTATUS result is missing some fields for each entry

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng reassigned HDFS-14665: - Assignee: Siyao Meng > HttpFS: LISTSTATUS result is missing some fields for each entry > ---

[jira] [Updated] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-11273: -- Attachment: HDFS-11273-branch-2.003.patch > Move TransferFsImage#doGetUrl function to a Util class > --

[jira] [Updated] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-11273: -- Status: In Progress (was: Patch Available) > Move TransferFsImage#doGetUrl function to a Util class >

[jira] [Commented] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898911#comment-16898911 ] Siyao Meng commented on HDFS-11273: --- [~jojochuang] Sure. Just uploaded branch-2 patch r

[jira] [Commented] (HDFS-13101) Yet another fsimage corruption related to snapshot

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899234#comment-16899234 ] Siyao Meng commented on HDFS-13101: --- Awesome work [~szetszwo] [~shashikant] [~jojochuan

[jira] [Updated] (HDFS-13101) Yet another fsimage corruption related to snapshot

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13101: -- Attachment: HDFS-13101.002.patch > Yet another fsimage corruption related to snapshot > ---

[jira] [Commented] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899284#comment-16899284 ] Siyao Meng commented on HDFS-11273: --- [~jojochuang] Sure. Filed HDFS-14696 > Move Trans

[jira] [Created] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-02 Thread Siyao Meng (JIRA)
Siyao Meng created HDFS-14696: - Summary: Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class) Key: HDFS-14696 URL: https://issues.apache.org/jira/browse/HDFS-14696 Proj

[jira] [Updated] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14696: -- Description: Backporting HDFS-11273 Move TransferFsImage#doGetUrl function to a Util class to branch-2

[jira] [Updated] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14696: -- Attachment: HDFS-14696-branch-2.003.patch Target Version/s: 2.10.0 Status: Patch

[jira] [Updated] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-02 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14696: -- Description: Backporting HDFS-11273 Move TransferFsImage#doGetUrl function to a Util class to branch-2

[jira] [Created] (HDDS-1920) Place ozone.om.address config key default value in ozone-site.xml

2019-08-06 Thread Siyao Meng (JIRA)
Siyao Meng created HDDS-1920: Summary: Place ozone.om.address config key default value in ozone-site.xml Key: HDDS-1920 URL: https://issues.apache.org/jira/browse/HDDS-1920 Project: Hadoop Distributed Dat

[jira] [Updated] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-07 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14696: -- Status: In Progress (was: Patch Available) > Backport HDFS-11273 to branch-2 (Move TransferFsImage#doG

[jira] [Commented] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-07 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902516#comment-16902516 ] Siyao Meng commented on HDFS-14696: --- [~jojochuang] Using PR instead for better diff. Se

[jira] [Commented] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-07 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902524#comment-16902524 ] Siyao Meng commented on HDFS-14696: --- [~jojochuang] Verified that both unit tests passed

[jira] [Work stopped] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-07 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-14696 stopped by Siyao Meng. - > Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a > Util

[jira] [Updated] (HDDS-1891) Ozone fs shell command should work with default port when port number is not specified

2019-08-08 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1891: - Target Version/s: 0.4.1 > Ozone fs shell command should work with default port when port number is not >

[jira] [Updated] (HDDS-1938) Change omPort parameter type from String to int in BasicOzoneFileSystem#createAdapter

2019-08-08 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1938: - Attachment: HDDS-1938.001.patch > Change omPort parameter type from String to int in > BasicOzoneFileSyst

[jira] [Created] (HDDS-1938) Change omPort parameter type from String to int in BasicOzoneFileSystem#createAdapter

2019-08-08 Thread Siyao Meng (JIRA)
Siyao Meng created HDDS-1938: Summary: Change omPort parameter type from String to int in BasicOzoneFileSystem#createAdapter Key: HDDS-1938 URL: https://issues.apache.org/jira/browse/HDDS-1938 Project: Ha

[jira] [Updated] (HDDS-1938) Change omPort parameter type from String to int in BasicOzoneFileSystem#createAdapter

2019-08-08 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1938: - Description: The diff will be based on HDDS-1891. Goal: 1. Change omPort type to int because it is eventu

[jira] [Updated] (HDDS-1938) Change omPort parameter type from String to int in BasicOzoneFileSystem#createAdapter

2019-08-08 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1938: - Description: The diff will be based on HDDS-1891. Goal: 1. Change omPort type to int because it is eventu

[jira] [Commented] (HDFS-14696) Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

2019-08-08 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903553#comment-16903553 ] Siyao Meng commented on HDFS-14696: --- Thanks [~jojochuang] for reviewing/committing! >

[jira] [Updated] (HDFS-12125) Document the missing EC removePolicy command

2019-08-08 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-12125: -- Description: Document the missing command -removePolicy in HDFSErasureCoding.md and HDFSCommands.md. (

[jira] [Commented] (HDFS-12125) Document the missing EC removePolicy command

2019-08-08 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903578#comment-16903578 ] Siyao Meng commented on HDFS-12125: --- It's a bit confusing with both patch and PR withou

[jira] [Updated] (HDFS-12125) Document the missing EC removePolicy command

2019-08-08 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-12125: -- Summary: Document the missing EC removePolicy command (was: Document the missing -removePolicy command

[jira] [Commented] (HDFS-14687) Standby Namenode never come out of safemode when EC files are being written.

2019-08-08 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903607#comment-16903607 ] Siyao Meng commented on HDFS-14687: --- [~surendrasingh] Great work. Thanks for the patch.

[jira] [Updated] (HDFS-14663) HttpFS: LISTSTATUS_BATCH does not return batches

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14663: -- Summary: HttpFS: LISTSTATUS_BATCH does not return batches (was: HTTPFS ListStatus_Batch does not retur

[jira] [Updated] (HDFS-14595) HDFS-11848 breaks API compatibility

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14595: -- Status: In Progress (was: Patch Available) > HDFS-11848 breaks API compatibility > ---

[jira] [Updated] (HDFS-14595) HDFS-11848 breaks API compatibility

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14595: -- Attachment: HDFS-14595.003.patch Status: Patch Available (was: In Progress) > HDFS-11848 break

[jira] [Commented] (HDFS-14663) HttpFS: LISTSTATUS_BATCH does not return batches

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903839#comment-16903839 ] Siyao Meng commented on HDFS-14663: --- I spent a few hours on this, attached a debugger a

[jira] [Comment Edited] (HDFS-14663) HttpFS: LISTSTATUS_BATCH does not return batches

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903839#comment-16903839 ] Siyao Meng edited comment on HDFS-14663 at 8/9/19 12:06 PM: I

[jira] [Comment Edited] (HDFS-14663) HttpFS: LISTSTATUS_BATCH does not return batches

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903839#comment-16903839 ] Siyao Meng edited comment on HDFS-14663 at 8/9/19 12:07 PM: I

[jira] [Commented] (HDFS-14663) HttpFS: LISTSTATUS_BATCH does not return batches

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903880#comment-16903880 ] Siyao Meng commented on HDFS-14663: --- I went back to the extra commit when HDFS-10823 wa

[jira] [Comment Edited] (HDFS-14663) HttpFS: LISTSTATUS_BATCH does not return batches

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903880#comment-16903880 ] Siyao Meng edited comment on HDFS-14663 at 8/9/19 1:26 PM: --- I w

[jira] [Commented] (HDFS-12125) Document the missing EC removePolicy command

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904246#comment-16904246 ] Siyao Meng commented on HDFS-12125: --- Thanks for the review [~ayushtkn] [~jojochuang].

[jira] [Commented] (HDFS-14717) Junit not found in hadoop-dynamometer-infra

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904310#comment-16904310 ] Siyao Meng commented on HDFS-14717: --- [~jojochuang] [~pingsutw] Yes I encountered this b

[jira] [Commented] (HDFS-14595) HDFS-11848 breaks API compatibility

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904332#comment-16904332 ] Siyao Meng commented on HDFS-14595: --- [~ayushtkn] I believe adding UT for new methods sh

[jira] [Updated] (HDFS-14595) HDFS-11848 breaks API compatibility

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14595: -- Status: In Progress (was: Patch Available) > HDFS-11848 breaks API compatibility > ---

[jira] [Updated] (HDFS-14595) HDFS-11848 breaks API compatibility

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14595: -- Attachment: HDFS-14595.004.patch Status: Patch Available (was: In Progress) [~ayushtkn] Done.

[jira] [Updated] (HDFS-14595) HDFS-11848 breaks API compatibility

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14595: -- Attachment: HDFS-14595.005.patch Status: Patch Available (was: In Progress) > HDFS-11848 break

[jira] [Updated] (HDFS-14595) HDFS-11848 breaks API compatibility

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14595: -- Status: In Progress (was: Patch Available) [~ayushtkn] Good idea. Uploading patch rev 005 > HDFS-1184

[jira] [Updated] (HDDS-1891) Ozone fs shell command should work with default port when port number is not specified

2019-08-09 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-1891: - Issue Type: Improvement (was: Bug) > Ozone fs shell command should work with default port when port numbe

[jira] [Updated] (HDFS-14665) HttpFS: LISTSTATUS result is missing some fields for each entry

2019-08-10 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14665: -- Description: WebHDFS: {code:java} GET /webhdfs/v1/tmp/?op=LISTSTATUS&user.name=hdfs HTTP/1.1 {code} {co

[jira] [Updated] (HDFS-14665) HttpFS: LISTSTATUS result is missing some fields for each entry

2019-08-10 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14665: -- Description: WebHDFS: {code:java} GET /webhdfs/v1/tmp/?op=LISTSTATUS&user.name=hdfs HTTP/1.1 {code} {co

[jira] [Updated] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-04 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-12345: -- Status: In Progress (was: Patch Available) > Scale testing HDFS NameNode with real metadata and worklo

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-04 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783895#comment-16783895 ] Siyao Meng commented on HDFS-12345: --- Uploaded rev 002 to integrate my additions from th

[jira] [Updated] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-04 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-12345: -- Attachment: HDFS-12345.002.patch > Scale testing HDFS NameNode with real metadata and workloads (Dynamo

[jira] [Commented] (HDFS-14261) Kerberize JournalNodeSyncer unit test

2019-03-04 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783912#comment-16783912 ] Siyao Meng commented on HDFS-14261: --- [~ayushtkn] Yeah I also noted a lot of time outs d

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-04 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783915#comment-16783915 ] Siyao Meng commented on HDFS-12345: --- Hi [~xkrogen], I changed the status of this jira f

[jira] [Updated] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-05 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-12345: -- Attachment: (was: HDFS-12345.002.patch) > Scale testing HDFS NameNode with real metadata and worklo

[jira] [Updated] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-05 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-12345: -- Attachment: HDFS-12345.002.patch Status: Patch Available (was: In Progress) Thanks [~xkrogen]!

[jira] [Commented] (HDFS-14371) Improve Logging in FSNamesystem by adding parameterized logging

2019-03-14 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793134#comment-16793134 ] Siyao Meng commented on HDFS-14371: --- In case of parameters being variables, that should

[jira] [Updated] (HDFS-12161) Distcp does not preserve ownership in destination parent folder

2019-03-26 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-12161: -- Description: After running distcp as user 'usertest' which is a hdfs superuser, the destination folder

[jira] [Updated] (HDFS-12161) Distcp does not preserve ownership in destination parent folder

2019-03-26 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-12161: -- Description: After running distcp as user 'usertest' which is a hdfs superuser, the destination folder

[jira] [Resolved] (HDFS-12161) Distcp does not preserve ownership in destination parent folder

2019-03-26 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng resolved HDFS-12161. --- Resolution: Cannot Reproduce > Distcp does not preserve ownership in destination parent folder > ---

[jira] [Commented] (HDFS-12161) Distcp does not preserve ownership in destination parent folder

2019-03-26 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801862#comment-16801862 ] Siyao Meng commented on HDFS-12161: --- I've just tested this on my local machine with sin

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

2019-03-26 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16802095#comment-16802095 ] Siyao Meng commented on HDFS-12345: --- [~daryn] IMHO one solution would be not compiling

[jira] [Updated] (HDFS-13838) WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status

2018-08-23 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13838: -- Attachment: HDFS-13838.001.patch Status: Patch Available (was: In Progress) > WebHdfsFileSyste

[jira] [Commented] (HDFS-13838) WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status

2018-08-23 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590788#comment-16590788 ] Siyao Meng commented on HDFS-13838: --- [^HDFS-13838.001.patch] 1.Added "snapshot enabled

[jira] [Updated] (HDFS-13830) Backport HDFS-13141 to branch-3.0: WebHDFS: Add support for getting snasphottable directory list

2018-08-23 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13830: -- Status: In Progress (was: Patch Available) > Backport HDFS-13141 to branch-3.0: WebHDFS: Add support f

[jira] [Updated] (HDFS-13830) Backport HDFS-13141 to branch-3.0: WebHDFS: Add support for getting snasphottable directory list

2018-08-23 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13830: -- Attachment: HDFS-13830.branch-3.0.003.patch Status: Patch Available (was: In Progress) rev 003

  1   2   3   4   5   6   7   8   >