[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-15323: - Fix Version/s: 2.9.3 > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Affects Versions: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0 >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Fix For: 2.10.0, 3.0.4, 3.3.0, 3.1.2, 3.2.1, 2.9.3 > > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch, > HADOOP-15323.003.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-15323: - Fix Version/s: 2.10.0 > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Affects Versions: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0 >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Fix For: 2.10.0, 3.0.4, 3.3.0, 3.1.2, 3.2.1 > > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch, > HADOOP-15323.003.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-15323: - Fix Version/s: 3.0.4 > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Affects Versions: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0 >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Fix For: 3.0.4, 3.3.0, 3.1.2, 3.2.1 > > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch, > HADOOP-15323.003.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-15323: - Fix Version/s: 3.1.2 > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Affects Versions: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0 >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Fix For: 3.3.0, 3.1.2, 3.2.1 > > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch, > HADOOP-15323.003.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-15323: - Fix Version/s: 3.2.1 > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Affects Versions: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0 >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Fix For: 3.3.0, 3.2.1 > > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch, > HADOOP-15323.003.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-15323: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Affects Versions: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0 >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Fix For: 3.3.0 > > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch, > HADOOP-15323.003.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Attachment: HADOOP-15323.003.patch > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Affects Versions: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0 >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch, > HADOOP-15323.003.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Description: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. We will try to use copyObject api, and check result. If shallow copy disabled for this object, then we will use multipart copy. So, I will remove fs.oss.multipart.upload.threshold configuration. was: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object & bucket(object's size greater than 5GB) is uploaded by Put / Multipart upload api. We will try to use copyObject api, and check result. If shallow copy disabled for this object, then we will use multipart copy. So, I will remove fs.oss.multipart.upload.threshold configuration. > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Affects Versions: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0 >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Description: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object & bucket(object's size greater than 5GB) is uploaded by Put / Multipart upload api. We will try to use copyObject api, and check result. If shallow copy disabled for this object, then we will use multipart copy. So, I will remove fs.oss.multipart.upload.threshold configuration. was: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object & bcuket(object's size greater than 5GB) is uploaded by Put / Multipart upload api. We will try to use copyObject api, and check result. If shallow copy disabled for this object, then we will use multipart copy. So, I will remove fs.oss.multipart.upload.threshold configuration. > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Affects Versions: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0 >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object & > bucket(object's size greater than 5GB) is uploaded by Put / Multipart upload > api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Description: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object & bcuket(object's size greater than 5GB) is uploaded by Put / Multipart upload api. We will try to use copyObject api, and check result. If shallow copy disabled for this object, then we will use multipart copy. So, I will remove fs.oss.multipart.upload.threshold configuration. was: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. We will try to use copyObject api, and check result. If shallow copy disabled for this object, then we will use multipart copy. So, I will remove fs.oss.multipart.upload.threshold configuration. > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Affects Versions: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0 >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object & > bcuket(object's size greater than 5GB) is uploaded by Put / Multipart upload > api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Attachment: HADOOP-15323.002.patch > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Affects Version/s: 3.3.0 3.2.0 2.10.0 3.1.1 2.9.2 3.0.3 > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Affects Versions: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0 >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Attachments: HADOOP-15323.001.patch, HADOOP-15323.002.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Description: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. We will try to use copyObject api, and check result. If shallow copy disabled for this object, then we will use multipart copy. So, I will remove fs.oss.multipart.upload.threshold configuration. was: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Attachments: HADOOP-15323.001.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > We will try to use copyObject api, and check result. If shallow copy disabled > for this object, then we will use multipart copy. So, I will remove > fs.oss.multipart.upload.threshold configuration. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Description: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. was: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. So, we will add a flag to indicate whether support shallow copy or not, default value is true. > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Attachments: HADOOP-15323.001.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Status: Patch Available (was: Open) > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Attachments: HADOOP-15323.001.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > So, we will add a flag to indicate whether support shallow copy or not, > default value is true. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Attachment: HADOOP-15323.001.patch > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > Attachments: HADOOP-15323.001.patch > > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > So, we will add a flag to indicate whether support shallow copy or not, > default value is true. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Description: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. So, we will add a flag to indicate whether support shallow copy or not, default value is true. was: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can simple use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. So, we will add a flag to indicate whether support shallow copy or not, default value is true. > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can use copyObject api instead of multi-part copy api > if we do not change object storage type & encryption type & source object is > uploaded by Put / Multipart upload api. > So, we will add a flag to indicate whether support shallow copy or not, > default value is true. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Description: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can simple use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. So, we will add a flag to indicate whether support shallow copy or not, default value is true. was: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can simple use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. So, we will add a flag to indicate whether support shallow copy or not, default by true. > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can simple use copyObject api instead of multi-part > copy api if we do not change object storage type & encryption type & source > object is uploaded by Put / Multipart upload api. > So, we will add a flag to indicate whether support shallow copy or not, > default value is true. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Description: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can simple use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. So, we will add a flag to indicate whether support shallow copy or not, default by true. was: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can simple use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can simple use copyObject api instead of multi-part > copy api if we do not change object storage type & encryption type & source > object is uploaded by Put / Multipart upload api. > So, we will add a flag to indicate whether support shallow copy or not, > default by true. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Description: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow copy, we can simple use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. was: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow-copy, we can simple use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow copy, we can simple use copyObject api instead of multi-part > copy api if we do not change object storage type & encryption type & source > object is uploaded by Put / Multipart upload api. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Description: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. With shallow-copy, we can simple use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object is uploaded by Put / Multipart upload api. was:Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. So, we will improve copy file for AliyunOSSFileSystemStore. > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. > With shallow-copy, we can simple use copyObject api instead of multi-part > copy api if we do not change object storage type & encryption type & source > object is uploaded by Put / Multipart upload api. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15323: --- Issue Type: Sub-task (was: Task) Parent: HADOOP-13377 > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. So, we will improve copy file > for AliyunOSSFileSystemStore. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15323: --- Issue Type: Task (was: Improvement) > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Task > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. So, we will improve copy file > for AliyunOSSFileSystemStore. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Description: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. So, we will improve copy file for AliyunOSSFileSystemStore. (was: Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. So, we will improve multiCopy for AliyunOSSFileSystemStore at that time. ) > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. So, we will improve copy file > for AliyunOSSFileSystemStore. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-15323) AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore
[ https://issues.apache.org/jira/browse/HADOOP-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15323: - Summary: AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore (was: AliyunOSS: Improve copyFile for AliyunOSSFileSystemStore) > AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore > - > > Key: HADOOP-15323 > URL: https://issues.apache.org/jira/browse/HADOOP-15323 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/oss >Reporter: wujinhu >Assignee: wujinhu >Priority: Major > > Aliyun OSS will support shallow copy which means server will only copy > metadata when copy object operation occurs. So, we will improve multiCopy for > AliyunOSSFileSystemStore at that time. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
