[GitHub] [flink] xintongsong commented on a diff in pull request #21508: [FLINK-30128] Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2023-01-08 Thread GitBox
xintongsong commented on code in PR #21508: URL: https://github.com/apache/flink/pull/21508#discussion_r1064353993 ## flink-filesystems/flink-azure-fs-hadoop/src/main/java/org/apache/flink/fs/azurefs/AzureBlobFsRecoverableDataOutputStream.java: ## @@ -0,0 +1,303 @@ +/* + *

[jira] [Comment Edited] (FLINK-30489) flink-sql-connector-pulsar doesn't shade all dependencies

2023-01-08 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652982#comment-17652982 ] Yufan Sheng edited comment on FLINK-30489 at 1/9/23 7:56 AM: - We didn't

[jira] [Commented] (FLINK-30508) CliClientITCase.testSqlStatements failed with output not matched with expected

2023-01-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655957#comment-17655957 ] Matthias Pohl commented on FLINK-30508: ---

[jira] [Updated] (FLINK-30508) CliClientITCase.testSqlStatements failed with output not matched with expected

2023-01-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-30508: -- Labels: test-stability (was: ) > CliClientITCase.testSqlStatements failed with output not

[jira] [Commented] (FLINK-30525) Cannot open jobmanager configuration web page

2023-01-08 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655952#comment-17655952 ] Weihua Hu commented on FLINK-30525: --- [~renqs] Can you take a look at this? This will affect the

[jira] [Commented] (FLINK-28424) JdbcExactlyOnceSinkE2eTest hangs on Azure

2023-01-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655951#comment-17655951 ] Matthias Pohl commented on FLINK-28424: ---

[jira] [Commented] (FLINK-29405) InputFormatCacheLoaderTest is unstable

2023-01-08 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655950#comment-17655950 ] Matthias Pohl commented on FLINK-29405: ---

[GitHub] [flink] flinkbot commented on pull request #21622: [FLINK-30570] Fix error inferred partition condition

2023-01-08 Thread GitBox
flinkbot commented on PR #21622: URL: https://github.com/apache/flink/pull/21622#issuecomment-1375214257 ## CI report: * fbfa489271fd7ede903d76682fb09565466bf082 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-30570) RexNodeExtractor#isSupportedPartitionPredicate generates unexpected partition predicates

2023-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30570: --- Labels: pull-request-available (was: ) > RexNodeExtractor#isSupportedPartitionPredicate

[GitHub] [flink] Aitozi opened a new pull request, #21622: [FLINK-30570] Fix error inferred partition condition

2023-01-08 Thread GitBox
Aitozi opened a new pull request, #21622: URL: https://github.com/apache/flink/pull/21622 ## What is the purpose of the change This PR is meant to fix the unexpected partition pruning. It fix in two parts: - The partition condition should contains the InputRef of the partition

[jira] [Commented] (FLINK-30603) CompactActionITCase in table store is unstable

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655945#comment-17655945 ] Jingsong Lee commented on FLINK-30603: -- [~TsReaper] CC > CompactActionITCase in table store is

[GitHub] [flink] xintongsong commented on a diff in pull request #21347: [FLINK-29640][Client/Job Submission]Enhance the function configured by execution.shutdown-on-attached-exi…

2023-01-08 Thread GitBox
xintongsong commented on code in PR #21347: URL: https://github.com/apache/flink/pull/21347#discussion_r1064320554 ## flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java: ## @@ -1756,6 +1756,9 @@ public final class ConfigConstants { /** The user

[jira] [Updated] (FLINK-30561) ChangelogStreamHandleReaderWithCache cause FileNotFoundException

2023-01-08 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feifan Wang updated FLINK-30561: Description: When a job with state changelog enabled continues to restart, the following

[jira] [Updated] (FLINK-30471) Optimize the enriching network memory process in SsgNetworkMemoryCalculationUtils

2023-01-08 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-30471: -- Description: In SsgNetworkMemoryCalculationUtils#enrichNetworkMemory, getting PartitionTypes is run

[jira] [Updated] (FLINK-30561) ChangelogStreamHandleReaderWithCache cause FileNotFoundException

2023-01-08 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feifan Wang updated FLINK-30561: Description: When a job with state changelog enabled continues to restart, the following

[jira] [Closed] (FLINK-30602) Remove FileStoreTableITCase in table store

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30602. Fix Version/s: table-store-0.4.0 Assignee: Shammon Resolution: Fixed master:

[GitHub] [flink-table-store] JingsongLi merged pull request #470: [FLINK-30602] Remove FileStoreTableITCase in table store

2023-01-08 Thread GitBox
JingsongLi merged PR #470: URL: https://github.com/apache/flink-table-store/pull/470 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-24989) Upgrade shade-plugin to 3.2.4

2023-01-08 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655934#comment-17655934 ] Dian Fu commented on FLINK-24989: - [~chesnay]  It seems that Maven shade plugin supports JDK17 since

[GitHub] [flink] flinkbot commented on pull request #21621: [FLINK-30601][runtime] Omit "setKeyContextElement" call for non-keyed stream/operators to improve performance

2023-01-08 Thread GitBox
flinkbot commented on PR #21621: URL: https://github.com/apache/flink/pull/21621#issuecomment-1375167857 ## CI report: * 3e738de71ae44af8940e8e170f71a82c473d012b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-30601) Omit "setKeyContextElement" call for non-keyed stream/operators to improve performance

2023-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30601: --- Labels: pull-request-available (was: ) > Omit "setKeyContextElement" call for non-keyed

[GitHub] [flink] wanglijie95 opened a new pull request, #21621: [FLINK-30601][runtime] Omit "setKeyContextElement" call for non-keyed stream/operators to improve performance

2023-01-08 Thread GitBox
wanglijie95 opened a new pull request, #21621: URL: https://github.com/apache/flink/pull/21621 ## What is the purpose of the change Currently, flink will set the correct key context(by call

[GitHub] [flink] xintongsong commented on a diff in pull request #21565: [FLINK-18229][ResourceManager] Support cancel pending workers if no longer needed.

2023-01-08 Thread GitBox
xintongsong commented on code in PR #21565: URL: https://github.com/apache/flink/pull/21565#discussion_r1064310906 ## flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/FineGrainedSlotManager.java: ## @@ -284,7 +284,7 @@ public void close() throws

[GitHub] [flink] TanYuxin-tyx commented on pull request #21618: [FLINK-30472][network] Modify the default value of the max network memory config option

2023-01-08 Thread GitBox
TanYuxin-tyx commented on PR #21618: URL: https://github.com/apache/flink/pull/21618#issuecomment-1375163838 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [flink] 1996fanrui commented on pull request #21614: [FLINK-30584][docs] Document flame graph at the subtask level

2023-01-08 Thread GitBox
1996fanrui commented on PR #21614: URL: https://github.com/apache/flink/pull/21614#issuecomment-1375162700 Hi @xintongsong , please help take a look in your free time, thanks~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Created] (FLINK-30603) CompactActionITCase in table store is unstable

2023-01-08 Thread Shammon (Jira)
Shammon created FLINK-30603: --- Summary: CompactActionITCase in table store is unstable Key: FLINK-30603 URL: https://issues.apache.org/jira/browse/FLINK-30603 Project: Flink Issue Type: Bug

[GitHub] [flink] lsyldliu commented on pull request #21556: [FLINK-30491][hive] Hive table partition supports deserializing later during runtime

2023-01-08 Thread GitBox
lsyldliu commented on PR #21556: URL: https://github.com/apache/flink/pull/21556#issuecomment-1375139834 @godfreyhe Thanks for reviewing, I've address the comments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Closed] (FLINK-30600) Merge flink-table-store-kafka to flink-table-store-connector

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30600. Resolution: Fixed master: dd95fc47da7dad818c13bb178a7671db326088d9 > Merge

[GitHub] [flink-table-store] JingsongLi merged pull request #469: [FLINK-30600] Merge flink-table-store-kafka to flink-table-store-connector

2023-01-08 Thread GitBox
JingsongLi merged PR #469: URL: https://github.com/apache/flink-table-store/pull/469 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink-table-store] zjureel commented on pull request #469: [FLINK-30600] Merge flink-table-store-kafka to flink-table-store-connector

2023-01-08 Thread GitBox
zjureel commented on PR #469: URL: https://github.com/apache/flink-table-store/pull/469#issuecomment-1375132561 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [flink] laughingman7743 commented on pull request #21613: [FLINK-30093][formats] Fix compile errors for google.protobuf.Timestamp type

2023-01-08 Thread GitBox
laughingman7743 commented on PR #21613: URL: https://github.com/apache/flink/pull/21613#issuecomment-1375132192 @maosuhan I have added a description of data mapping of type google.protobuf.Timestamp to the documentation.

[jira] [Updated] (FLINK-30602) Remove FileStoreTableITCase in table store

2023-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30602: --- Labels: pull-request-available (was: ) > Remove FileStoreTableITCase in table store >

[GitHub] [flink-table-store] zjureel opened a new pull request, #470: [FLINK-30602] Remove FileStoreTableITCase in table store

2023-01-08 Thread GitBox
zjureel opened a new pull request, #470: URL: https://github.com/apache/flink-table-store/pull/470 Remove `FileStoreTableITCase` and fix related test case -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [flink] flinkbot commented on pull request #21620: [FLINK-30473][network] Optimize the InputGate network memory management for TaskManager

2023-01-08 Thread GitBox
flinkbot commented on PR #21620: URL: https://github.com/apache/flink/pull/21620#issuecomment-1375130869 ## CI report: * a92b74f449522a5ccf1c9cb05e3079c2fdfa7581 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] KarlManong commented on pull request #18059: [FLINK-25224][filesystem] Bump Hadoop version to 2.8.4

2023-01-08 Thread GitBox
KarlManong commented on PR #18059: URL: https://github.com/apache/flink/pull/18059#issuecomment-1375128934 @liufangqi could you please fix the title? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (FLINK-30473) Optimize the InputGate network memory management for TaskManager

2023-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30473: --- Labels: pull-request-available (was: ) > Optimize the InputGate network memory management

[GitHub] [flink] TanYuxin-tyx opened a new pull request, #21620: [FLINK-30473][network] Optimize the InputGate network memory management for TaskManager

2023-01-08 Thread GitBox
TanYuxin-tyx opened a new pull request, #21620: URL: https://github.com/apache/flink/pull/21620 ## What is the purpose of the change *This change proposes a method to control the maximum required memory buffers in an inputGate according to parallelism size and data partition

[GitHub] [flink] ramkrish86 commented on pull request #21512: [FLINK-30375][hotfix]sql-client leaks flink-table-planner jar in /tmp

2023-01-08 Thread GitBox
ramkrish86 commented on PR #21512: URL: https://github.com/apache/flink/pull/21512#issuecomment-1375123666 +1 (non binding). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Created] (FLINK-30602) Remove FileStoreTableITCase in table store

2023-01-08 Thread Shammon (Jira)
Shammon created FLINK-30602: --- Summary: Remove FileStoreTableITCase in table store Key: FLINK-30602 URL: https://issues.apache.org/jira/browse/FLINK-30602 Project: Flink Issue Type: Sub-task

[GitHub] [flink] flinkbot commented on pull request #21619: [FLINK-30308][python] Fix ClassLeakCleaner to work with Java 11.0.16+ and 17.0.4+

2023-01-08 Thread GitBox
flinkbot commented on PR #21619: URL: https://github.com/apache/flink/pull/21619#issuecomment-1375105572 ## CI report: * a3ec6a28e6443ec364e8a578bfba0f18ef845cd4 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-30308) ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map is showing in the logging when the job shutdown

2023-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30308: --- Labels: pull-request-available (was: ) > ClassCastException: class

[GitHub] [flink] dianfu opened a new pull request, #21619: [FLINK-30308][python] Fix ClassLeakCleaner to work with Java 11.0.16+ and 17.0.4+

2023-01-08 Thread GitBox
dianfu opened a new pull request, #21619: URL: https://github.com/apache/flink/pull/21619 ## What is the purpose of the change *This pull request fixes ClassLeakCleaner to work with Java 11.0.16+ and 17.0.4+.* ## Verifying this change This change is a trivial

[jira] [Commented] (FLINK-30561) ChangelogStreamHandleReaderWithCache cause FileNotFoundException

2023-01-08 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655905#comment-17655905 ] Yanfei Lei commented on FLINK-30561: [~Feifan Wang] Thanks for the clarification. I think this makes

[jira] [Updated] (FLINK-30542) Support adaptive local hash aggregate in runtime

2023-01-08 Thread Godfrey He (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Godfrey He updated FLINK-30542: --- Summary: Support adaptive local hash aggregate in runtime (was: Support adaptive hash aggregate in

[jira] [Assigned] (FLINK-30491) Hive table partition supports to deserialize later during runtime

2023-01-08 Thread Godfrey He (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Godfrey He reassigned FLINK-30491: -- Assignee: dalongliu > Hive table partition supports to deserialize later during runtime >

[jira] [Assigned] (FLINK-30542) Support adaptive local hash aggregate in runtime

2023-01-08 Thread Godfrey He (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Godfrey He reassigned FLINK-30542: -- Assignee: Yunhong Zheng > Support adaptive local hash aggregate in runtime >

[jira] [Closed] (FLINK-30365) New dynamic partition pruning strategy to support more dpp patterns

2023-01-08 Thread Godfrey He (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Godfrey He closed FLINK-30365. -- Resolution: Fixed Fixed in 1.17.0: d9f9b55f82dfbc1676572cc36b718a99001497f8 > New dynamic partition

[jira] [Assigned] (FLINK-30365) New dynamic partition pruning strategy to support more dpp patterns

2023-01-08 Thread Godfrey He (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Godfrey He reassigned FLINK-30365: -- Assignee: Yunhong Zheng > New dynamic partition pruning strategy to support more dpp

[GitHub] [flink] godfreyhe closed pull request #21489: [FLINK-30365][table-planner] New dynamic partition pruning strategy to support more dpp patterns

2023-01-08 Thread GitBox
godfreyhe closed pull request #21489: [FLINK-30365][table-planner] New dynamic partition pruning strategy to support more dpp patterns URL: https://github.com/apache/flink/pull/21489 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [flink] fsk119 commented on pull request #21597: [FLINK-30554][sql-client] Remove useless sessionId in the Executor

2023-01-08 Thread GitBox
fsk119 commented on PR #21597: URL: https://github.com/apache/flink/pull/21597#issuecomment-1375092445 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-30601) Omit "setKeyContextElement" call for non-keyed stream/operators to improve performance

2023-01-08 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-30601: --- Description: Currently, flink will set the correct key context(by call

[jira] [Updated] (FLINK-30601) Omit "setKeyContextElement" call for non-keyed stream/operators to improve performance

2023-01-08 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-30601: --- Description: Currently, flink will set the correct key context(by call

[jira] [Updated] (FLINK-30601) Omit "setKeyContextElement" call for non-keyed stream/operators to improve performance

2023-01-08 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-30601: --- Description: Currently, flink will set the correct key context(by call

[jira] [Created] (FLINK-30601) Omit "setKeyContextElement" call for non-keyed stream/operators to improve performance

2023-01-08 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-30601: -- Summary: Omit "setKeyContextElement" call for non-keyed stream/operators to improve performance Key: FLINK-30601 URL: https://issues.apache.org/jira/browse/FLINK-30601

[jira] [Closed] (FLINK-28796) Add Statement Completement API for sql gateway rest endpoint

2023-01-08 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang closed FLINK-28796. - Fix Version/s: 1.17.0 Resolution: Implemented Merged into master:

[GitHub] [flink] fsk119 merged pull request #21526: [FLINK-28796] Add completeStatement REST API in the SQL Gateway

2023-01-08 Thread GitBox
fsk119 merged PR #21526: URL: https://github.com/apache/flink/pull/21526 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-22320) Add documentation for new introduced ALTER TABLE statements

2023-01-08 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655896#comment-17655896 ] Jane Chan commented on FLINK-22320: --- Hi, I would like to take on this task. cc [~fsk119]  > Add

[GitHub] [flink] chrismartin823 commented on pull request #21611: [FLINK-30592][doc] remove unsupported hive version in hive overview document

2023-01-08 Thread GitBox
chrismartin823 commented on PR #21611: URL: https://github.com/apache/flink/pull/21611#issuecomment-1375070781 > @chrismartin823 Could you please create a backport for release 1.16. Thanks. ok,I will create a backport for release 1.16. -- This is an automated message from the

[GitHub] [flink-connector-hive] chenqin closed pull request #2: Move Flink Hive Connector

2023-01-08 Thread GitBox
chenqin closed pull request #2: Move Flink Hive Connector URL: https://github.com/apache/flink-connector-hive/pull/2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (FLINK-19883) Support "IF EXISTS" in DDL for ALTER TABLE

2023-01-08 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655894#comment-17655894 ] Jane Chan commented on FLINK-19883: --- Hi [~nicholasjiang], I would like to continue working on this

[GitHub] [flink] flinkbot commented on pull request #21618: [FLINK-30472][network] Modify the default value of the max network memory config option

2023-01-08 Thread GitBox
flinkbot commented on PR #21618: URL: https://github.com/apache/flink/pull/21618#issuecomment-1375067510 ## CI report: * 82022cdf0c82952340b60648ff258c63228ac8ba UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] godfreyhe commented on a diff in pull request #21556: [FLINK-30491][hive] Hive table partition supports deserializing later during runtime

2023-01-08 Thread GitBox
godfreyhe commented on code in PR #21556: URL: https://github.com/apache/flink/pull/21556#discussion_r1064264590 ## flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/connectors/hive/util/HivePartitionUtils.java: ## @@ -290,4 +291,33 @@ private static void

[jira] [Updated] (FLINK-30472) Modify the default value of the max network memory config option

2023-01-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30472: --- Labels: pull-request-available (was: ) > Modify the default value of the max network

[GitHub] [flink] TanYuxin-tyx opened a new pull request, #21618: [FLINK-30472][network] Modify the default value of the max network memory config option

2023-01-08 Thread GitBox
TanYuxin-tyx opened a new pull request, #21618: URL: https://github.com/apache/flink/pull/21618 ## What is the purpose of the change *This issue mainly focuses on the second issue in

[GitHub] [flink] lsyldliu commented on a diff in pull request #21556: [FLINK-30491][hive] Hive table partition supports deserializing later during runtime

2023-01-08 Thread GitBox
lsyldliu commented on code in PR #21556: URL: https://github.com/apache/flink/pull/21556#discussion_r1064259672 ## flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/connectors/hive/HiveSourceFileEnumerator.java: ## @@ -222,19 +225,24 @@ private static int

[GitHub] [flink] swuferhong commented on pull request #21489: [FLINK-30365][table-planner] New dynamic partition pruning strategy to support more dpp patterns

2023-01-08 Thread GitBox
swuferhong commented on PR #21489: URL: https://github.com/apache/flink/pull/21489#issuecomment-1375056765 > It's better we can add this optimization in flink-tpcds-test module, we can do it in another pr. Ok. I will make a jira issue to track this work. -- This is an automated

[GitHub] [flink] lsyldliu commented on pull request #21556: [FLINK-30491][hive] Hive table partition supports deserializing later during runtime

2023-01-08 Thread GitBox
lsyldliu commented on PR #21556: URL: https://github.com/apache/flink/pull/21556#issuecomment-1375056600 @luoyuxia Thanks for review, I have addressed your comments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Updated] (FLINK-28690) UpdateSchema#fromCatalogTable lost column comment

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-28690: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) >

[jira] [Updated] (FLINK-27845) Introduce Column Type Schema evolution

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-27845: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Introduce

[GitHub] [flink] swuferhong commented on a diff in pull request #21489: [FLINK-30365][table-planner] New dynamic partition pruning strategy to support more dpp patterns

2023-01-08 Thread GitBox
swuferhong commented on code in PR #21489: URL: https://github.com/apache/flink/pull/21489#discussion_r1064259324 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/utils/DynamicPartitionPruningUtils.java: ## @@ -60,318 +69,470 @@ public class

[GitHub] [flink] lsyldliu commented on a diff in pull request #21556: [FLINK-30491][hive] Hive table partition supports deserializing later during runtime

2023-01-08 Thread GitBox
lsyldliu commented on code in PR #21556: URL: https://github.com/apache/flink/pull/21556#discussion_r1064259298 ## flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/connectors/hive/HiveSourceDynamicFileEnumerator.java: ## @@ -187,31 +187,36 @@ public static

[jira] [Updated] (FLINK-29735) Introduce Metadata tables for table store

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-29735: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Introduce

[jira] [Updated] (FLINK-30276) [umbrella] Flink free for table store core

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-30276: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > [umbrella]

[jira] [Updated] (FLINK-30394) [umbrella] Refactor filesystem support in table store

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-30394: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > [umbrella]

[jira] [Updated] (FLINK-30390) Ensure that no compaction is in progress before closing the writer

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-30390: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Ensure that

[jira] [Closed] (FLINK-28026) Add benchmark module for flink table store

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-28026. Resolution: Invalid > Add benchmark module for flink table store >

[jira] [Updated] (FLINK-30000) Introduce FileSystemFactory to create FileSystem from custom configuration

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-3: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Introduce

[jira] [Updated] (FLINK-29953) Get rid of flink-connector-hive dependency in flink-table-store-hive

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-29953: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Get rid of

[jira] [Closed] (FLINK-29963) Flink Table Store supports pluggable filesystem

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-29963. Assignee: Jane Chan Resolution: Fixed > Flink Table Store supports pluggable filesystem >

[jira] [Updated] (FLINK-29080) Migrate all tests from managed table to catalog-based tests

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-29080: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Migrate all

[jira] [Closed] (FLINK-29965) Support Spark/Hive with S3

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-29965. Resolution: Invalid > Support Spark/Hive with S3 > -- > >

[jira] [Updated] (FLINK-29756) Support materialized column to improve query performance for complex types

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-29756: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Support

[jira] [Closed] (FLINK-26900) Introduce Best Practices document for table store

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-26900. Resolution: Invalid > Introduce Best Practices document for table store >

[jira] [Updated] (FLINK-29882) LargeDataITCase is not stable

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-29882: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) >

[jira] [Commented] (FLINK-28690) UpdateSchema#fromCatalogTable lost column comment

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655884#comment-17655884 ] Jingsong Lee commented on FLINK-28690: -- wait for Flink 1.17 > UpdateSchema#fromCatalogTable lost

[jira] [Closed] (FLINK-27166) Introduce file structure document for table store

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-27166. Resolution: Invalid > Introduce file structure document for table store >

[jira] [Closed] (FLINK-26902) Introduce performence tune and benchmark document for table store

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-26902. Fix Version/s: table-store-0.3.0 (was: table-store-0.4.0)

[jira] [Updated] (FLINK-27103) Don't store redundant primary key fields

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-27103: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Don't store

[jira] [Updated] (FLINK-26902) Introduce performence tune and benchmark document for table store

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-26902: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Introduce

[jira] [Updated] (FLINK-26937) Introduce Leveled compression for LSM

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-26937: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Introduce

[jira] [Updated] (FLINK-28718) SinkSavepointITCase.testRecoverFromSavepoint is unstable

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-28718: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) >

[jira] [Updated] (FLINK-27548) Improve quick-start of table store

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-27548: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Improve

[jira] [Updated] (FLINK-26465) Optimize SortMergeReader: use loser tree to reduce comparisons

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-26465: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Optimize

[jira] [Updated] (FLINK-28086) Table Store Catalog supports partition methods

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-28086: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Table Store

[jira] [Closed] (FLINK-27679) Add tests for append-only table with log store

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-27679. Resolution: Invalid > Add tests for append-only table with log store >

[jira] [Updated] (FLINK-27365) [umbrella] Schema evolution on table store

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-27365: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > [umbrella]

[jira] [Updated] (FLINK-30248) Spark writer supports insert overwrite

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-30248: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Spark writer

[GitHub] [flink] luoyuxia commented on pull request #21611: [FLINK-30592][doc] remove unsupported hive version in hive overview document

2023-01-08 Thread GitBox
luoyuxia commented on PR #21611: URL: https://github.com/apache/flink/pull/21611#issuecomment-1375051560 @chrismartin823 Could you please create a backport for release 1.16. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Updated] (FLINK-27002) Optimize batch multiple partitions inserting

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-27002: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Optimize

[jira] [Updated] (FLINK-29630) Junit 5.8.1 run unit test with temporary directory will occur Failed to delete temp directory.

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-29630: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) > Junit 5.8.1

[jira] [Updated] (FLINK-29331) pre-aggregated merge supports changelog inputs

2023-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-29331: - Fix Version/s: table-store-0.4.0 (was: table-store-0.3.0) >

  1   2   >