[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Attachment: HDDS-1530.002.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize"

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an int

[jira] [Commented] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840936#comment-16840936 ] xudongcao commented on HDDS-1530: - [~anu]  [~arpitagarwal] I revert the UUID issue in HDDS-1530.002.patch, 

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and improve concurrent operations.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and improve concurrent operations. (was:

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and improve concurrent operations.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and improve concurrent framework.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and improve concurrent framework. (was: Ozone:

[jira] [Commented] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839946#comment-16839946 ] xudongcao commented on HDFS-14484: -- In fact, my initial change was to keep this, but I found this would

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Attachment: HDFS-14484.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize"

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Attachment: (was: HDFS-14484.patch) > Ozone: Freon: Support big files larger than 2GB and add

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Attachment: HDFS-14484v0.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize"

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Attachment: (was: HDFS-14484v0.patch) > Ozone: Freon: Support big files larger than 2GB and add

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Attachment: HDDS-1530v0.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Attachment: (was: HDFS-14484v0.patch) > Ozone: Freon: Support big files larger than 2GB and add

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites"

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Attachment: HDDS-1530.001.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize"

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Attachment: (was: HDDS-1530v0.patch) > Ozone: Freon: Support big files larger than 2GB and add

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and introduce "--bufferSize" and

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Attachment: HDFS-14484v0.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize"

[jira] [Updated] (HDDS-1532) Freon: Improve the concurrency testing framework.

[ https://issues.apache.org/jira/browse/HDDS-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1532: Summary: Freon: Improve the concurrency testing framework. (was: Freon: Improve the concurrency

[jira] [Updated] (HDDS-1532) Freon: Improve the concurrency framework.

[ https://issues.apache.org/jira/browse/HDDS-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1532: Summary: Freon: Improve the concurrency framework. (was: Improve the concurrency framework) > Freon:

[jira] [Updated] (HDDS-1532) Improve the concurrency framework

[ https://issues.apache.org/jira/browse/HDDS-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1532: Component/s: test > Improve the concurrency framework > - > >

[jira] [Updated] (HDDS-1532) Improve the concurrency framework

[ https://issues.apache.org/jira/browse/HDDS-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1532: Environment: (was: Improve the concurrency framework. Now the volume creation task, bucket creation

[jira] [Assigned] (HDDS-1532) Freon: Improve the concurrency framework.

[ https://issues.apache.org/jira/browse/HDDS-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao reassigned HDDS-1532: --- Assignee: xudongcao > Freon: Improve the concurrency framework. >

[jira] [Updated] (HDDS-1532) Improve the concurrency framework

[ https://issues.apache.org/jira/browse/HDDS-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1532: Description: Currently, Freon's concurrency framework is just on volume-level, but in actual testing,

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Attachment: (was: HDDS-1530.001.patch) > Ozone: Freon: Support big files larger than 2GB and add

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Attachment: HDDS-1530.001.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize"

[jira] [Created] (HDDS-1532) Improve the concurrency framework

xudongcao created HDDS-1532: --- Summary: Improve the concurrency framework Key: HDDS-1532 URL: https://issues.apache.org/jira/browse/HDDS-1532 Project: Hadoop Distributed Data Store Issue Type: Bug

[jira] [Updated] (HDDS-1532) Freon: Improve the concurrency testing framework.

[ https://issues.apache.org/jira/browse/HDDS-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1532: Description: Currently, Freon's concurrency framework is just on volume-level, but in actual testing,

[jira] [Updated] (HDDS-1532) Freon: Improve the concurrency testing framework.

[ https://issues.apache.org/jira/browse/HDDS-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1532: Description: Currently, Freon's concurrency framework is just on volume-level, but in actual testing,

[jira] [Created] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and fix OOM.

xudongcao created HDFS-14484: Summary: Ozone: Freon: Support big files larger than 2GB and fix OOM. Key: HDFS-14484 URL: https://issues.apache.org/jira/browse/HDFS-14484 Project: Hadoop HDFS

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Attachment: HDDS-1530.001.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize"

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Attachment: (was: HDDS-1530.001.patch) > Ozone: Freon: Support big files larger than 2GB and add