[jira] [Updated] (FLINK-28552) GenerateUtils#generateCompare supports MULTISET and MAP

2022-07-27 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28552: -- Description: Currently, changelog mode cannot support map and multiset as the field type. More

[jira] [Updated] (FLINK-28704) Document change-log mode cannot support map and multiset data type

2022-07-27 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28704: -- Description: Blocked by GenerateUtils#generateCompare > Document change-log mode cannot support map

[jira] [Updated] (FLINK-28704) Document change-log mode cannot support map and multiset data type

2022-07-27 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28704: -- Summary: Document change-log mode cannot support map and multiset data type (was: Document should

[jira] [Updated] (FLINK-28552) GenerateUtils#generateCompare supports MULTISET and MAP

2022-07-27 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28552: -- Issue Type: Improvement (was: New Feature) > GenerateUtils#generateCompare supports MULTISET and MAP

[jira] [Updated] (FLINK-28690) UpdateSchema#fromCatalogTable lost column comment

2022-07-27 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28690: -- Priority: Not a Priority (was: Blocker) > UpdateSchema#fromCatalogTable lost column comment >

[jira] [Created] (FLINK-28704) Document should add a description that change-log mode cannot support map and multiset data type

2022-07-27 Thread Jane Chan (Jira)
Jane Chan created FLINK-28704: - Summary: Document should add a description that change-log mode cannot support map and multiset data type Key: FLINK-28704 URL: https://issues.apache.org/jira/browse/FLINK-28704

[jira] [Updated] (FLINK-28703) Describe partitioned spark table lost partition info

2022-07-27 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28703: -- Description: SparkTable should override #partitioning

[jira] [Updated] (FLINK-28703) Describe partitioned spark table lost partition info

2022-07-27 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28703: -- Attachment: image-2022-07-27-16-17-14-240.png > Describe partitioned spark table lost partition info

[jira] [Updated] (FLINK-28703) Describe partitioned spark table lost partition info

2022-07-27 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28703: -- Description: SparkTable should override #partitioning > Describe partitioned spark table lost

[jira] [Created] (FLINK-28703) Describe partitioned spark table lost partition info

2022-07-27 Thread Jane Chan (Jira)
Jane Chan created FLINK-28703: - Summary: Describe partitioned spark table lost partition info Key: FLINK-28703 URL: https://issues.apache.org/jira/browse/FLINK-28703 Project: Flink Issue Type:

[jira] [Created] (FLINK-28690) UpdateSchema#fromCatalogTable lost column comment

2022-07-26 Thread Jane Chan (Jira)
Jane Chan created FLINK-28690: - Summary: UpdateSchema#fromCatalogTable lost column comment Key: FLINK-28690 URL: https://issues.apache.org/jira/browse/FLINK-28690 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-28690) UpdateSchema#fromCatalogTable lost column comment

2022-07-26 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28690: -- Description: The reason is that org.apache.flink.table.api.TableSchema#toPhysicalRowDataType lost

[jira] [Updated] (FLINK-28686) Spark table with column comment cannot be read/write by Flink

2022-07-26 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28686: -- Description: The reason is that org.apache.flink.table.api.TableSchema#toPhysicalRowDataType lost

[jira] [Updated] (FLINK-28686) Spark table with column comment cannot be read/write by Flink

2022-07-26 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28686: -- Attachment: screenshot-1.png > Spark table with column comment cannot be read/write by Flink >

[jira] [Created] (FLINK-28686) Spark table with column comment cannot be read/write by Flink

2022-07-26 Thread Jane Chan (Jira)
Jane Chan created FLINK-28686: - Summary: Spark table with column comment cannot be read/write by Flink Key: FLINK-28686 URL: https://issues.apache.org/jira/browse/FLINK-28686 Project: Flink

[jira] [Created] (FLINK-28677) Primary key should not be null when creating Spark table

2022-07-25 Thread Jane Chan (Jira)
Jane Chan created FLINK-28677: - Summary: Primary key should not be null when creating Spark table Key: FLINK-28677 URL: https://issues.apache.org/jira/browse/FLINK-28677 Project: Flink Issue

[jira] [Updated] (FLINK-28668) Fail to create Spark table without primary key

2022-07-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28668: -- Summary: Fail to create Spark table without primary key (was: Fail to create partitioned table

[jira] [Updated] (FLINK-28668) Fail to create partitioned table without primary key for Spark

2022-07-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28668: -- Description: The primary key list should be empty when pk is not specified. (was: Failed under both

[jira] [Created] (FLINK-28668) Fail to create partitioned table without primary key for Spark

2022-07-25 Thread Jane Chan (Jira)
Jane Chan created FLINK-28668: - Summary: Fail to create partitioned table without primary key for Spark Key: FLINK-28668 URL: https://issues.apache.org/jira/browse/FLINK-28668 Project: Flink

[jira] [Created] (FLINK-28666) Alter spark table's primary key should throw exception

2022-07-25 Thread Jane Chan (Jira)
Jane Chan created FLINK-28666: - Summary: Alter spark table's primary key should throw exception Key: FLINK-28666 URL: https://issues.apache.org/jira/browse/FLINK-28666 Project: Flink Issue Type:

[jira] [Created] (FLINK-28638) Restrict ALTER TABLE from setting write-mode

2022-07-21 Thread Jane Chan (Jira)
Jane Chan created FLINK-28638: - Summary: Restrict ALTER TABLE from setting write-mode Key: FLINK-28638 URL: https://issues.apache.org/jira/browse/FLINK-28638 Project: Flink Issue Type:

[jira] [Updated] (FLINK-28638) Restrict ALTER TABLE from setting write-mode

2022-07-21 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28638: -- Description: Restrict conversion between changelog table and append-only table (was: Restrict to

[jira] [Created] (FLINK-28573) Nested type will lose nullability when converting from TableSchema

2022-07-15 Thread Jane Chan (Jira)
Jane Chan created FLINK-28573: - Summary: Nested type will lose nullability when converting from TableSchema Key: FLINK-28573 URL: https://issues.apache.org/jira/browse/FLINK-28573 Project: Flink

[jira] [Updated] (FLINK-28552) GenerateUtils#generateCompare supports MULTISET and MAP

2022-07-14 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28552: -- Description: Currently, changelog mode cannot support map and multiset as the field type. More

[jira] [Created] (FLINK-28552) GenerateUtils#generateCompare supports MULTISET and MAP

2022-07-14 Thread Jane Chan (Jira)
Jane Chan created FLINK-28552: - Summary: GenerateUtils#generateCompare supports MULTISET and MAP Key: FLINK-28552 URL: https://issues.apache.org/jira/browse/FLINK-28552 Project: Flink Issue

[jira] [Commented] (FLINK-26051) one sql has row_number =1 and the subsequent SQL has "case when" and "where" statement result Exception : The window can only be ordered in ASCENDING mode

2022-07-14 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1759#comment-1759 ] Jane Chan commented on FLINK-26051: --- Sorry for being late. I will open PR asap. > one sql has

[jira] [Commented] (FLINK-28535) Support create database/table for SparkCatalog

2022-07-13 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566233#comment-17566233 ] Jane Chan commented on FLINK-28535: --- Please assign the ticket to me, thanks:) cc [~lzljs3620320]  >

[jira] [Created] (FLINK-28535) Support create database/table for SparkCatalog

2022-07-13 Thread Jane Chan (Jira)
Jane Chan created FLINK-28535: - Summary: Support create database/table for SparkCatalog Key: FLINK-28535 URL: https://issues.apache.org/jira/browse/FLINK-28535 Project: Flink Issue Type: New

[jira] [Updated] (FLINK-28155) Add documentation for "ALTER TABLE ... COMPACT"

2022-07-13 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28155: -- Description: It is notable that this feature is only supported for Flink's ManagedTable since version

[jira] [Updated] (FLINK-28155) Add documentation for "ALTER TABLE ... COMPACT"

2022-07-13 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28155: -- Description: It is notable that this syntax is only worked for Flink's ManagedTable since 1.15 > Add

[jira] [Updated] (FLINK-27515) Support 'ALTER TABLE ... COMPACT' in TableStore

2022-07-13 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27515: -- Description: Implement 'ALTER TABLE ... COMPACT'[1] in TableStore.  [1]

[jira] [Commented] (FLINK-28533) SchemaChange supports updateColumnNullability and updateColumnComment

2022-07-13 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566210#comment-17566210 ] Jane Chan commented on FLINK-28533: --- [~lzljs3620320] please assign the ticket to me, thanks :) >

[jira] [Updated] (FLINK-28533) SchemaChange supports updateColumnNullability and updateColumnComment

2022-07-13 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28533: -- Description: * Already supported ** update / remove table options ** add column / change column

[jira] [Created] (FLINK-28533) SchemaChange supports updateColumnNullability and updateColumnComment

2022-07-13 Thread Jane Chan (Jira)
Jane Chan created FLINK-28533: - Summary: SchemaChange supports updateColumnNullability and updateColumnComment Key: FLINK-28533 URL: https://issues.apache.org/jira/browse/FLINK-28533 Project: Flink

[jira] [Commented] (FLINK-28465) commit.force-compact should always be true under batch mode

2022-07-08 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564207#comment-17564207 ] Jane Chan commented on FLINK-28465: --- [~lzljs3620320] please assign the ticket to me >

[jira] [Created] (FLINK-28465) commit.force-compact should always be true under batch mode

2022-07-08 Thread Jane Chan (Jira)
Jane Chan created FLINK-28465: - Summary: commit.force-compact should always be true under batch mode Key: FLINK-28465 URL: https://issues.apache.org/jira/browse/FLINK-28465 Project: Flink Issue

[jira] [Commented] (FLINK-26051) one sql has row_number =1 and the subsequent SQL has "case when" and "where" statement result Exception : The window can only be ordered in ASCENDING mode

2022-06-29 Thread Jane Chan (Jira)
Title: Message Title Jane Chan commented

[jira] [Commented] (FLINK-28192) RescaleBucketITCase is not stable

2022-06-22 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557292#comment-17557292 ] Jane Chan commented on FLINK-28192: --- Maybe we don't need this assertion, let me remove it. cc

[jira] [Created] (FLINK-28192) RescaleBucketITCase is not stable

2022-06-22 Thread Jane Chan (Jira)
Jane Chan created FLINK-28192: - Summary: RescaleBucketITCase is not stable Key: FLINK-28192 URL: https://issues.apache.org/jira/browse/FLINK-28192 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-28184) LogStoreE2eTest is not stable

2022-06-21 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28184: -- Component/s: (was: Tests) > LogStoreE2eTest is not stable > - > >

[jira] [Updated] (FLINK-28184) LogStoreE2eTest is not stable

2022-06-21 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28184: -- Description: [https://github.com/apache/flink-table-store/runs/6984608843?check_suite_focus=true]

[jira] [Updated] (FLINK-28184) LogStoreE2eTest is not stable

2022-06-21 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28184: -- Attachment: image-2022-06-21-21-23-16-325.png > LogStoreE2eTest is not stable >

[jira] [Created] (FLINK-28184) LogStoreE2eTest is not stable

2022-06-21 Thread Jane Chan (Jira)
Jane Chan created FLINK-28184: - Summary: LogStoreE2eTest is not stable Key: FLINK-28184 URL: https://issues.apache.org/jira/browse/FLINK-28184 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-27708) Add background compaction task for append-only table when ingesting.

2022-06-21 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556682#comment-17556682 ] Jane Chan commented on FLINK-27708: --- * Why ** Checkpoints will interfere with the writer, which

[jira] [Updated] (FLINK-27708) Add background compaction task for append-only table when ingesting.

2022-06-21 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27708: -- Attachment: image-2022-06-21-14-59-59-593.png > Add background compaction task for append-only table

[jira] [Created] (FLINK-28155) Add documentation for "ALTER TABLE ... COMPACT"

2022-06-20 Thread Jane Chan (Jira)
Jane Chan created FLINK-28155: - Summary: Add documentation for "ALTER TABLE ... COMPACT" Key: FLINK-28155 URL: https://issues.apache.org/jira/browse/FLINK-28155 Project: Flink Issue Type:

[jira] [Commented] (FLINK-28129) Add documentation for rewrite data layout after scaling bucket number

2022-06-20 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556620#comment-17556620 ] Jane Chan commented on FLINK-28129: --- Hi [~lzljs3620320] please assign it to me > Add documentation

[jira] [Updated] (FLINK-28129) Add documentation for rewrite data layout after scaling bucket number

2022-06-20 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28129: -- Description: We should add a thorough doc on * How to rescale data layout after changing bucket

[jira] [Updated] (FLINK-28129) Add documentation for rewrite data layout after scaling bucket number

2022-06-20 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28129: -- Description: We should add a thorough doc on * How to rescale data layout after the bucket changes. 

[jira] [Updated] (FLINK-28129) Add documentation for rewrite data layout after scaling bucket number

2022-06-20 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28129: -- Summary: Add documentation for rewrite data layout after scaling bucket number (was: Add

[jira] [Commented] (FLINK-27708) Add background compaction task for append-only table when ingesting.

2022-06-20 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556616#comment-17556616 ] Jane Chan commented on FLINK-27708: --- Hi, [~complone] thanks for your interest in this ticket. However,

[jira] [Created] (FLINK-28129) Add documentation for rescale

2022-06-20 Thread Jane Chan (Jira)
Jane Chan created FLINK-28129: - Summary: Add documentation for rescale Key: FLINK-28129 URL: https://issues.apache.org/jira/browse/FLINK-28129 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-27526) Support scaling bucket number for FileStore

2022-06-20 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27526: -- Description: Currently, TableStore does not support changing the number of the bucket (denoted by

[jira] [Comment Edited] (FLINK-26051) one sql has row_number =1 and the subsequent SQL has "case when" and "where" statement result Exception : The window can only be ordered in ASCENDING mode

2022-06-17 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555610#comment-17555610 ] Jane Chan edited comment on FLINK-26051 at 6/17/22 1:30 PM: Sorry for

[jira] [Commented] (FLINK-26051) one sql has row_number =1 and the subsequent SQL has "case when" and "where" statement result Exception : The window can only be ordered in ASCENDING mode

2022-06-17 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555610#comment-17555610 ] Jane Chan commented on FLINK-26051: --- Sorry for joining this discussion late. I reproduced the example

[jira] [Updated] (FLINK-26051) one sql has row_number =1 and the subsequent SQL has "case when" and "where" statement result Exception : The window can only be ordered in ASCENDING mode

2022-06-17 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-26051: -- Attachment: image-2022-06-17-21-28-54-886.png > one sql has row_number =1 and the subsequent SQL has

[jira] [Created] (FLINK-28108) Support compaction for append-only table

2022-06-17 Thread Jane Chan (Jira)
Jane Chan created FLINK-28108: - Summary: Support compaction for append-only table Key: FLINK-28108 URL: https://issues.apache.org/jira/browse/FLINK-28108 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-28035) Support rescale overwrite

2022-06-17 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28035: -- Description: For an ordinary read-write job, the scan will check the numBuckets read from manifests

[jira] [Updated] (FLINK-28035) Support rescale overwrite

2022-06-17 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28035: -- Description: For an ordinary read-write job, the scan will check the numBuckets read from manifests

[jira] [Updated] (FLINK-28035) Support rescale overwrite

2022-06-17 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28035: -- Summary: Support rescale overwrite (was: Don't check num of buckets for rescale bucket condition) >

[jira] [Commented] (FLINK-27832) SplitAggregateITCase tests failed with Could not acquire the minimum required resources

2022-06-14 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553983#comment-17553983 ] Jane Chan commented on FLINK-27832: --- I've also encountered this.

[jira] [Updated] (FLINK-28035) Don't check num of buckets for rescale bucket condition

2022-06-14 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28035: -- Description: For an ordinary read-write job, the scan will check the numBuckets read from manifests

[jira] [Updated] (FLINK-28035) Don't check num of buckets for rescale bucket condition

2022-06-13 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-28035: -- Summary: Don't check num of buckets for rescale bucket condition (was: Enable scan reading different

[jira] [Created] (FLINK-28035) Enable scan reading different bucket num for rescale bucket

2022-06-13 Thread Jane Chan (Jira)
Jane Chan created FLINK-28035: - Summary: Enable scan reading different bucket num for rescale bucket Key: FLINK-28035 URL: https://issues.apache.org/jira/browse/FLINK-28035 Project: Flink Issue

[jira] [Updated] (FLINK-27526) Support scaling bucket number for FileStore

2022-06-13 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27526: -- Description: Currently, TableStore does not support changing the number of the bucket (denoted by

[jira] [Updated] (FLINK-27965) EXPLAIN PLAN produces wrong query schema for insert clause with static partition

2022-06-12 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27965: -- Summary: EXPLAIN PLAN produces wrong query schema for insert clause with static partition (was:

[jira] [Commented] (FLINK-27965) EXPLAIN PLAN FOR does not work for insert clause with static partition

2022-06-11 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553119#comment-17553119 ] Jane Chan commented on FLINK-27965: --- Another case Add "explain plan for" under TableSinkJsonPlanTest

[jira] [Updated] (FLINK-27965) EXPLAIN PLAN FOR does not work for insert clause with static partition

2022-06-11 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27965: -- Summary: EXPLAIN PLAN FOR does not work for insert clause with static partition (was: Query schema

[jira] [Updated] (FLINK-27557) Submit compaction when prepareCommit is triggered

2022-06-10 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Parent: (was: FLINK-27515) Issue Type: New Feature (was: Sub-task) > Submit compaction

[jira] [Closed] (FLINK-27557) Submit compaction when prepareCommit is triggered

2022-06-10 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan closed FLINK-27557. - Resolution: Won't Do The impl has been refactored. > Submit compaction when prepareCommit is triggered

[jira] [Updated] (FLINK-27707) Implement ManagedTableFactory#onCompactTable

2022-06-10 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27707: -- Description: As discussed offline, the new implementation has been modified. * Don't perform a scan

[jira] [Created] (FLINK-27965) Query schema is not correct for insert overwrite clause when source and target table are same

2022-06-08 Thread Jane Chan (Jira)
Jane Chan created FLINK-27965: - Summary: Query schema is not correct for insert overwrite clause when source and target table are same Key: FLINK-27965 URL: https://issues.apache.org/jira/browse/FLINK-27965

[jira] [Updated] (FLINK-27707) Implement ManagedTableFactory#onCompactTable

2022-06-08 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27707: -- Description: As discussed offline, the new implementation has been modified. * Don't perform a scan

[jira] [Updated] (FLINK-27652) CompactManager.Rewriter cannot handle different partition keys invoked compaction

2022-05-29 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27652: -- Description: h3. Issue Description When enabling {{commit.force-compact}} for the partitioned

[jira] [Updated] (FLINK-27557) Trigger compaction when prepareCommit is triggered

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Summary: Trigger compaction when prepareCommit is triggered (was: Let FileStoreWrite accept

[jira] [Updated] (FLINK-27557) Submit compaction when prepareCommit is triggered

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Summary: Submit compaction when prepareCommit is triggered (was: Trigger compaction when

[jira] [Updated] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries and let MergeTreeWriter trigger compaction when commit

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Description: Currently, FileStoreWrite will scan and plan files when creating a non-empty writer. We

[jira] [Updated] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries and let MergeTreeWriter trigger compaction when commit

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Summary: Let FileStoreWrite accept pre-planned manifest entries and let MergeTreeWriter trigger

[jira] [Updated] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries and trigger compaction when commit

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Summary: Let FileStoreWrite accept pre-planned manifest entries and trigger compaction when commit

[jira] [Updated] (FLINK-27707) Implement ManagedTableFactory#onCompactTable

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27707: -- Summary: Implement ManagedTableFactory#onCompactTable (was: Implement

[jira] [Updated] (FLINK-27707) Implement TableStoreFactory#onCompactTable

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27707: -- Description: Perform the scan on the latest snapshot and pick data files to compact and serialize to

[jira] [Updated] (FLINK-27707) Implement TableStoreFactory#onCompactTable

2022-05-21 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27707: -- Description: Perform the scan on the latest snapshot and pick data files to compact. (was: Perform

[jira] [Updated] (FLINK-27707) Implement TableStoreFactory#onCompactTable

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27707: -- Description: Perform the latest scan and pick data files to compact. (was: Perform scan and pick

[jira] [Created] (FLINK-27707) Implement TableStoreFactory#onCompactTable

2022-05-19 Thread Jane Chan (Jira)
Jane Chan created FLINK-27707: - Summary: Implement TableStoreFactory#onCompactTable Key: FLINK-27707 URL: https://issues.apache.org/jira/browse/FLINK-27707 Project: Flink Issue Type: Sub-task

[jira] [Comment Edited] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539352#comment-17539352 ] Jane Chan edited comment on FLINK-27557 at 5/20/22 3:18 AM: {quote}Can we

[jira] [Updated] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Description: Currently, FileStoreWrite will scan and plan files when creating a non-empty writer. We

[jira] [Updated] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Description: Currently, FileStoreWrite will scan and plan files when creating a non-empty writer. We

[jira] [Updated] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Description: Currently, FileStoreWrite will scan and plan files when creating a non-empty writer. For

[jira] [Updated] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Description: Currently, FileStoreWrite will scan and plan files when creating a non-empty writer. For

[jira] [Updated] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Summary: Let FileStoreWrite accept pre-planned manifest entries (was: Create the empty writer for

[jira] [Comment Edited] (FLINK-27557) Create the empty writer for 'ALTER TABLE ... COMPACT'

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539352#comment-17539352 ] Jane Chan edited comment on FLINK-27557 at 5/20/22 2:59 AM: {quote}Can we

[jira] [Commented] (FLINK-27705) num-sorted-run.compaction-trigger should not interfere the num-levels

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539887#comment-17539887 ] Jane Chan commented on FLINK-27705: --- The reason is that the previous write job had triggered

[jira] [Commented] (FLINK-27705) num-sorted-run.compaction-trigger should not interfere the num-levels

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539885#comment-17539885 ] Jane Chan commented on FLINK-27705: --- Stacktrace {code:java} java.util.concurrent.ExecutionException:

[jira] [Created] (FLINK-27705) num-sorted-run.compaction-trigger should not interfere the num-levels

2022-05-19 Thread Jane Chan (Jira)
Jane Chan created FLINK-27705: - Summary: num-sorted-run.compaction-trigger should not interfere the num-levels Key: FLINK-27705 URL: https://issues.apache.org/jira/browse/FLINK-27705 Project: Flink

[jira] [Commented] (FLINK-27557) Create the empty writer for 'ALTER TABLE ... COMPACT'

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539352#comment-17539352 ] Jane Chan commented on FLINK-27557: --- {quote}Can we just use overwrite? * overwrite specific manifest

[jira] [Updated] (FLINK-27557) Create the empty writer for 'ALTER TABLE ... COMPACT'

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Attachment: optimized-normal-compaction.png > Create the empty writer for 'ALTER TABLE ... COMPACT' >

[jira] [Updated] (FLINK-27557) Create the empty writer for 'ALTER TABLE ... COMPACT'

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Attachment: rescale-bucket-compaction.png > Create the empty writer for 'ALTER TABLE ... COMPACT' >

[jira] [Updated] (FLINK-27557) Create the empty writer for 'ALTER TABLE ... COMPACT'

2022-05-19 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Attachment: normal-compaction.png > Create the empty writer for 'ALTER TABLE ... COMPACT' >

[jira] [Updated] (FLINK-27652) CompactManager.Rewriter cannot handle different partition keys invoked compaction

2022-05-16 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27652: -- Description: h3. Issue Description When enabling {{commit.force-compact}} for the partitioned managed

[jira] [Updated] (FLINK-27652) CompactManager.Rewriter cannot handle different partition keys invoked compaction

2022-05-16 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27652: -- Description: h3. Issue Description When enabling {{commit.force-compact}} for the partitioned managed

<    1   2   3   4   5   6   7   8   >