[jira] [Commented] (HDFS-13052) WebHDFS: Add support for snasphot diff

2018-10-01 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634559#comment-16634559 ] Xun REN commented on HDFS-13052: Hi [~jojochuang], Thanks for this comment. So If I understand well,

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-19 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621128#comment-16621128 ] Xun REN commented on HDFS-13916: Hi [~jojochuang],   I tried to add the method getSnapshotDiffReport in

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-20 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622521#comment-16622521 ] Xun REN commented on HDFS-13916: Hi [~jojochuang], No problem for me to separate this feature into two

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-22 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun REN updated HDFS-13916: --- Attachment: HDFS-13916.003.patch > Distcp SnapshotDiff not completely implemented for supporting WebHdfs >

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-22 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624829#comment-16624829 ] Xun REN commented on HDFS-13916: I added more unit tests for cross file system Distcp test with diff

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-26 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629422#comment-16629422 ] Xun REN commented on HDFS-13916: Hi [~jojochuang]  Could you or another committer can help to review the

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-26 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun REN updated HDFS-13916: --- Attachment: HDFS-13916.005.patch > Distcp SnapshotDiff not completely implemented for supporting WebHdfs >

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-22 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun REN updated HDFS-13916: --- Attachment: HDFS-13916.004.patch > Distcp SnapshotDiff not completely implemented for supporting WebHdfs >

[jira] [Created] (HDFS-13922) Provide support for "hdfs snapshotDiff webhdfs://my_path"

2018-09-17 Thread Xun REN (JIRA)
Xun REN created HDFS-13922: -- Summary: Provide support for "hdfs snapshotDiff webhdfs://my_path" Key: HDFS-13922 URL: https://issues.apache.org/jira/browse/HDFS-13922 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-17 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun REN updated HDFS-13916: --- Attachment: HDFS-13916.002.patch > Distcp SnapshotDiff not completely implemented for supporting WebHdfs >

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-16 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun REN updated HDFS-13916: --- Status: Patch Available (was: Open) > Distcp SnapshotDiff not completely implemented for supporting WebHdfs

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-16 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616922#comment-16616922 ] Xun REN commented on HDFS-13916: Hi [~jojochuang], I've provided the patch. As it is my first

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-16 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun REN updated HDFS-13916: --- Attachment: HDFS-13916.patch > Distcp SnapshotDiff not completely implemented for supporting WebHdfs >

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-16 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun REN updated HDFS-13916: --- Attachment: HADOOP-13916.patch > Distcp SnapshotDiff not completely implemented for supporting WebHdfs >

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-16 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun REN updated HDFS-13916: --- Attachment: (was: HADOOP-13916.patch) > Distcp SnapshotDiff not completely implemented for supporting

[jira] [Commented] (HDFS-13916) SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-13 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613947#comment-16613947 ] Xun REN commented on HDFS-13916: I have done the modification on my local machine. I will take this task

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-13 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614078#comment-16614078 ] Xun REN commented on HDFS-13916: Thanks. I will provide a patch soon. > Distcp SnapshotDiff not

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-13 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun REN updated HDFS-13916: --- Summary: Distcp SnapshotDiff not completely implemented for supporting WebHdfs (was: SnapshotDiff not

[jira] [Commented] (HDFS-13052) WebHDFS: Add support for snasphot diff

2018-09-12 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612146#comment-16612146 ] Xun REN commented on HDFS-13052: Hi [~xyao], [~ljain]   I see in the source code:

***UNCHECKED*** [jira] [Commented] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-19 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620266#comment-16620266 ] Xun REN commented on HDFS-13916: Meanwhile, I will add more unit tests in order to test cross file

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-19 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620265#comment-16620265 ] Xun REN commented on HDFS-13916: Hi [~jojochuang],   Yes, I am agree. I have thought about that also :) 

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-17 Thread Xun REN (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617457#comment-16617457 ] Xun REN commented on HDFS-13916: I will improve the "checkstyle" one. Most of them are due to long lines.

[jira] [Created] (HDFS-13916) SnapshotDiff not completely implemented for supporting WebHdfs

2018-09-13 Thread Xun REN (JIRA)
Xun REN created HDFS-13916: -- Summary: SnapshotDiff not completely implemented for supporting WebHdfs Key: HDFS-13916 URL: https://issues.apache.org/jira/browse/HDFS-13916 Project: Hadoop HDFS

[jira] [Created] (HDFS-14764) HDFS count doesn't include snapshot files correctly

2019-08-22 Thread Xun REN (Jira)
Xun REN created HDFS-14764: -- Summary: HDFS count doesn't include snapshot files correctly Key: HDFS-14764 URL: https://issues.apache.org/jira/browse/HDFS-14764 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-13916) Distcp SnapshotDiff to support WebHDFS

2019-08-22 Thread Xun REN (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913134#comment-16913134 ] Xun REN commented on HDFS-13916: Hi [~xyao] [~jojochuang],   Thanks for your comments and suggestions. 

[jira] [Commented] (HDFS-14764) HDFS count doesn't include snapshot files correctly

2019-08-22 Thread Xun REN (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913126#comment-16913126 ] Xun REN commented on HDFS-14764: {code:java} [myuser@myserver ~]$ hdfs dfs -mkdir /tmp/test1

[jira] [Updated] (HDFS-14764) HDFS count doesn't include snapshot files correctly

2019-08-22 Thread Xun REN (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun REN updated HDFS-14764: --- Attachment: hdfs_count_withsnapshot.txt > HDFS count doesn't include snapshot files correctly >