[jira] [Updated] (FLINK-25696) Introduce metadataConsumer to InitContext in Sink

2022-01-24 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-25696: - Summary: Introduce metadataConsumer to InitContext in Sink (was: Introduce MetadataPublisher

[GitHub] [flink] zjureel commented on pull request #18490: [FLINK-25794][sql-runtime] Clean cache after memory segments in it after they are released to MemoryManager

2022-01-24 Thread GitBox
zjureel commented on pull request #18490: URL: https://github.com/apache/flink/pull/18490#issuecomment-1020749306 Hello @KarmaGYZ @JingsongLi , could you help to review this issue when you're free? -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (FLINK-25794) Memory pages in LazyMemorySegmentPool should be clear after they are released to MemoryManager

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-25794: --- Labels: pull-request-available (was: ) > Memory pages in LazyMemorySegmentPool should be

[GitHub] [flink] xintongsong commented on a change in pull request #18489: [FLINK-25790][flink-gs-fs-hadoop] Support authentication via core-site.xml in GCS FileSystem plugin

2022-01-24 Thread GitBox
xintongsong commented on a change in pull request #18489: URL: https://github.com/apache/flink/pull/18489#discussion_r791304149 ## File path: flink-filesystems/flink-gs-fs-hadoop/src/main/java/org/apache/flink/fs/gs/GSFileSystem.java ## @@ -39,17 +45,67 @@

[GitHub] [flink] flinkbot edited a comment on pull request #18432: [FLINK-25739][dist] Include Changelog to flink-dist jar

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18432: URL: https://github.com/apache/flink/pull/18432#issuecomment-1017970404 ## CI report: * eed34f330aff2dae3d4ea3429cbec0fa83fa4a34 Azure:

[GitHub] [flink] zjureel opened a new pull request #18490: [FLINK-25794][sql-runtime] Clean cache after memory segments in it after they are released to MemoryManager

2022-01-24 Thread GitBox
zjureel opened a new pull request #18490: URL: https://github.com/apache/flink/pull/18490 ## What is the purpose of the change This pr aims to clean cache in `LazyMemorySegmentPool` after memory segments in it are released to `MemoryManager` ## Verifying this change This

[jira] [Closed] (FLINK-24947) Support host network for native K8s integration

2022-01-24 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang closed FLINK-24947. - Resolution: Fixed > Support host network for native K8s integration >

[GitHub] [flink] paul8263 commented on pull request #18460: [FLINK-25767][doc] Totally translated state.md into Chinese

2022-01-24 Thread GitBox
paul8263 commented on pull request #18460: URL: https://github.com/apache/flink/pull/18460#issuecomment-1020748254 Hi @Myasuka , Thank you for valuable suggestion. I've corrected some translations and please perform an another review. -- This is an automated message from the Apache

[jira] [Commented] (FLINK-24947) Support host network for native K8s integration

2022-01-24 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481502#comment-17481502 ] Yang Wang commented on FLINK-24947: --- Thanks [~spoon-lz] for working on this ticket and make it happen

[jira] [Commented] (FLINK-24947) Support host network for native K8s integration

2022-01-24 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481501#comment-17481501 ] Yang Wang commented on FLINK-24947: --- Fixed via: master: c7219f8827016d1067f008e2324c0194dad65cb1

[GitHub] [flink] wangyang0918 merged pull request #18119: [FLINK-24947] Support hostNetwork for native K8s integration on session mode

2022-01-24 Thread GitBox
wangyang0918 merged pull request #18119: URL: https://github.com/apache/flink/pull/18119 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] wangyang0918 commented on pull request #18119: [FLINK-24947] Support hostNetwork for native K8s integration on session mode

2022-01-24 Thread GitBox
wangyang0918 commented on pull request #18119: URL: https://github.com/apache/flink/pull/18119#issuecomment-1020746626 Merging this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (FLINK-25795) Support Pulsar sink connector in Python DataStream API.

2022-01-24 Thread Ada Wong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ada Wong updated FLINK-25795: - Description: https://issues.apache.org/jira/browse/FLINK-20732 the PR of this ticket is reviewd, we

[jira] [Commented] (FLINK-25795) Support Pulsar sink connector in Python DataStream API.

2022-01-24 Thread Ada Wong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481499#comment-17481499 ] Ada Wong commented on FLINK-25795: -- [~dianfu]  When the PR

[GitHub] [flink] flinkbot edited a comment on pull request #18333: [FLINK-25220][test] Write an architectural rule for all IT cases w.r.t. the MiniCluster

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18333: URL: https://github.com/apache/flink/pull/18333#issuecomment-1010381163 ## CI report: * 454378c5d0aecc36ae88a99f1e1d936405226a22 UNKNOWN * cc0ef7b3c9f391a389117dc33107cd9f3d77d708 UNKNOWN *

[jira] [Updated] (FLINK-25795) Support Pulsar sink connector in Python DataStream API.

2022-01-24 Thread Ada Wong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ada Wong updated FLINK-25795: - External issue ID: (was: 20726) > Support Pulsar sink connector in Python DataStream API. >

[jira] [Created] (FLINK-25795) Support Pulsar sink connector in Python DataStream API.

2022-01-24 Thread Ada Wong (Jira)
Ada Wong created FLINK-25795: Summary: Support Pulsar sink connector in Python DataStream API. Key: FLINK-25795 URL: https://issues.apache.org/jira/browse/FLINK-25795 Project: Flink Issue Type:

[GitHub] [flink] JingsongLi edited a comment on pull request #18412: [FLINK-25696][datastream] Introduce MetadataPublisher interface to SinkWriter

2022-01-24 Thread GitBox
JingsongLi edited a comment on pull request #18412: URL: https://github.com/apache/flink/pull/18412#issuecomment-1020739383 > From a Kafka connector side, the subscriber is not updated on every record, and just when the KafkaProducer is flushed it is only updated for a bulk of records

[GitHub] [flink] JingsongLi commented on pull request #18412: [FLINK-25696][datastream] Introduce MetadataPublisher interface to SinkWriter

2022-01-24 Thread GitBox
JingsongLi commented on pull request #18412: URL: https://github.com/apache/flink/pull/18412#issuecomment-1020739383 > From a Kafka connector side, the subscriber is not updated on every record, and just when the KafkaProducer is flushed it is only updated for a bulk of records (either

[GitHub] [flink] flinkbot edited a comment on pull request #18460: [FLINK-25767][doc] Totally translated state.md into Chinese

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18460: URL: https://github.com/apache/flink/pull/18460#issuecomment-1019844798 ## CI report: * 6385885a06a970cc31f450251e9f6b0d4150a0dd Azure:

[jira] [Commented] (FLINK-25530) Support Pulsar source connector in Python DataStream API.

2022-01-24 Thread Ada Wong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481493#comment-17481493 ] Ada Wong commented on FLINK-25530: -- [~syhily]  Thanks, I create a pulsar python sink ticket. > Support

[GitHub] [flink] flinkbot edited a comment on pull request #18460: [FLINK-25767][doc] Totally translated state.md into Chinese

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18460: URL: https://github.com/apache/flink/pull/18460#issuecomment-1019844798 ## CI report: * 6385885a06a970cc31f450251e9f6b0d4150a0dd Azure:

[jira] [Created] (FLINK-25794) Memory pages in LazyMemorySegmentPool should be clear after they are released to MemoryManager

2022-01-24 Thread Shammon (Jira)
Shammon created FLINK-25794: --- Summary: Memory pages in LazyMemorySegmentPool should be clear after they are released to MemoryManager Key: FLINK-25794 URL: https://issues.apache.org/jira/browse/FLINK-25794

[GitHub] [flink] deadwind4 commented on a change in pull request #18388: [FLINK-25530][python][connector/pulsar] Support Pulsar source connector in Python DataStream API.

2022-01-24 Thread GitBox
deadwind4 commented on a change in pull request #18388: URL: https://github.com/apache/flink/pull/18388#discussion_r791298184 ## File path: tools/ci/java-ci-tools/src/main/java/org/apache/flink/tools/ci/licensecheck/JarFileChecker.java ## @@ -210,6 +210,11 @@ private static

[GitHub] [flink] flinkbot edited a comment on pull request #18483: [FLINK-24041][connectors] Removed public setter for elementConverter in As…

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18483: URL: https://github.com/apache/flink/pull/18483#issuecomment-1020286441 ## CI report: * eec2f51db2ed6c4862959336f6edf6bdfc16b251 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18482: [FLINK-25744] Support native savepoints

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18482: URL: https://github.com/apache/flink/pull/18482#issuecomment-1020278176 ## CI report: * 91675405ae82d0e945f46caaa685d65763b296c3 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18360: [FLINK-25329][runtime] Support memory execution graph store in session cluster

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18360: URL: https://github.com/apache/flink/pull/18360#issuecomment-1012981724 ## CI report: * de880af98f24b8a8195f65bca492883ce4c05846 Azure:

[jira] [Closed] (FLINK-25770) Delete file is not correct in MergeTreeWriter

2022-01-24 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-25770. Resolution: Fixed master: eb9fdfb05cf68ed641124c6b5fe5164d7fcf927f > Delete file is not correct

[GitHub] [flink-table-store] JingsongLi merged pull request #13: [FLINK-25770] Delete file is not correct in MergeTreeWriter

2022-01-24 Thread GitBox
JingsongLi merged pull request #13: URL: https://github.com/apache/flink-table-store/pull/13 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] flinkbot edited a comment on pull request #18360: [FLINK-25329][runtime] Support memory execution graph store in session cluster

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18360: URL: https://github.com/apache/flink/pull/18360#issuecomment-1012981724 ## CI report: * de880af98f24b8a8195f65bca492883ce4c05846 Azure:

[GitHub] [flink] deadwind4 commented on a change in pull request #18388: [FLINK-25530][python][connector/pulsar] Support Pulsar source connector in Python DataStream API.

2022-01-24 Thread GitBox
deadwind4 commented on a change in pull request #18388: URL: https://github.com/apache/flink/pull/18388#discussion_r791295394 ## File path: flink-connectors/pom.xml ## @@ -105,6 +105,7 @@ under the License. flink-sql-connector-hive-3.1.2

[GitHub] [flink] flinkbot edited a comment on pull request #18468: [FLINK-24905][connector/kinesis]Adding Kinesis data streams sql uber-jar and end to end test.

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18468: URL: https://github.com/apache/flink/pull/18468#issuecomment-1019969068 ## CI report: * 6ac66f07be10e8c320e77b89e41fc6ba17b1571e Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18397: [FLINK-25702][Kafka] Use the configure feature provided by the kafka Serializer/Deserializer.

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18397: URL: https://github.com/apache/flink/pull/18397#issuecomment-1015848205 ## CI report: * 3e1198a17fea03035bc621268a39ea3b386809a4 Azure:

[GitHub] [flink] lindong28 commented on pull request #18397: [FLINK-25702][Kafka] Use the configure feature provided by the kafka Serializer/Deserializer.

2022-01-24 Thread GitBox
lindong28 commented on pull request #18397: URL: https://github.com/apache/flink/pull/18397#issuecomment-1020716213 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Assigned] (FLINK-25790) Support authentication via core-site.xml in GCS FileSystem plugin

2022-01-24 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song reassigned FLINK-25790: Assignee: Galen Warren > Support authentication via core-site.xml in GCS FileSystem

[GitHub] [flink] flinkbot edited a comment on pull request #18479: [FLINK-25387] Introduce ExecNodeMetadata

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18479: URL: https://github.com/apache/flink/pull/18479#issuecomment-1020172062 ## CI report: * 26c2d84f06d6605f38a20311466137b07152dac5 Azure:

[GitHub] [flink] lindong28 commented on a change in pull request #18397: [FLINK-25702][Kafka] Use the configure feature provided by the kafka Serializer/Deserializer.

2022-01-24 Thread GitBox
lindong28 commented on a change in pull request #18397: URL: https://github.com/apache/flink/pull/18397#discussion_r791272806 ## File path:

[GitHub] [flink] lindong28 commented on a change in pull request #18397: [FLINK-25702][Kafka] Use the configure feature provided by the kafka Serializer/Deserializer.

2022-01-24 Thread GitBox
lindong28 commented on a change in pull request #18397: URL: https://github.com/apache/flink/pull/18397#discussion_r791270225 ## File path: flink-connectors/flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/sink/KafkaRecordSerializationSchemaBuilderTest.java

[GitHub] [flink] flinkbot edited a comment on pull request #18481: [FLINK-25307][test] Change e2e nodename used to 127.0.0.1 and add debug information

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18481: URL: https://github.com/apache/flink/pull/18481#issuecomment-1020251442 ## CI report: * ce4954e2d80790b2bcbf2259cf994a5faeed50ff Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18394: [FLINK-25520][Table SQL/API] Implement "ALTER TABLE ... COMPACT" SQL

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18394: URL: https://github.com/apache/flink/pull/18394#issuecomment-1015323011 ## CI report: * 496911178b06d4b404ba74cfac0c90b4ca121dd6 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18382: [FLINK-25524] Fix ChangelogStateBackend.notifyCheckpointComplete

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18382: URL: https://github.com/apache/flink/pull/18382#issuecomment-1014709963 ## CI report: * dee3a8cf9a282bc17924ccb9393d0592e4cd2011 Azure:

[jira] [Commented] (FLINK-25577) Update GCS documentation

2022-01-24 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481473#comment-17481473 ] Galen Warren commented on FLINK-25577: -- Here's a second try at a release note: The

[GitHub] [flink] flinkbot edited a comment on pull request #18430: [FLINK-25577][docs] Update GCS documentation

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18430: URL: https://github.com/apache/flink/pull/18430#issuecomment-1017872223 ## CI report: * 4e165800625c7265f2ddc075e70ce1aec445ad14 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18430: [FLINK-25577][docs] Update GCS documentation

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18430: URL: https://github.com/apache/flink/pull/18430#issuecomment-1017872223 ## CI report: * 4e165800625c7265f2ddc075e70ce1aec445ad14 Azure:

[GitHub] [flink] galenwarren commented on pull request #18430: [FLINK-25577][docs] Update GCS documentation

2022-01-24 Thread GitBox
galenwarren commented on pull request #18430: URL: https://github.com/apache/flink/pull/18430#issuecomment-1020682450 @xintongsong @MartijnVisser I also added back in the documentation of how to use `core-site.xml` config properties; the code for this is in the in-progress PR:

[GitHub] [flink] galenwarren commented on a change in pull request #18430: [FLINK-25577][docs] Update GCS documentation

2022-01-24 Thread GitBox
galenwarren commented on a change in pull request #18430: URL: https://github.com/apache/flink/pull/18430#discussion_r791256263 ## File path: docs/content/docs/deployment/filesystems/gcs.md ## @@ -50,57 +48,40 @@ env.getCheckpointConfig().setCheckpointStorage("gs:///");

[GitHub] [flink] galenwarren commented on a change in pull request #18430: [FLINK-25577][docs] Update GCS documentation

2022-01-24 Thread GitBox
galenwarren commented on a change in pull request #18430: URL: https://github.com/apache/flink/pull/18430#discussion_r791256107 ## File path: docs/content/docs/deployment/filesystems/gcs.md ## @@ -50,57 +48,40 @@ env.getCheckpointConfig().setCheckpointStorage("gs:///");

[GitHub] [flink] flinkbot edited a comment on pull request #18478: [FLINK-25787][flink-connector-gcp-pubsub] Adding endpoint support in Pubsub Source / Sink

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18478: URL: https://github.com/apache/flink/pull/18478#issuecomment-1020156897 ## CI report: * 7d269e64204469eb03c1b102f44a5930ceb45d62 Azure:

[jira] [Commented] (FLINK-18356) Exit code 137 returned from process

2022-01-24 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481468#comment-17481468 ] Yun Gao commented on FLINK-18356: - With some more observation, it seems (sorry I still have not got the

[GitHub] [flink] flinkbot edited a comment on pull request #18368: [FLINK-18356][Azure] Enforce memory limits for docker containers

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18368: URL: https://github.com/apache/flink/pull/18368#issuecomment-1013194055 ## CI report: * 74a00fd69ea3321fded40d1b6bafae149523ed75 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18324: [FLINK-25557][checkpoint] Introduce incremental/full checkpoint size stats

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18324: URL: https://github.com/apache/flink/pull/18324#issuecomment-1009752905 ## CI report: * 1fc3707aa5f06fdf332a6da162927edc8a86ac6a Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18480: [FLINK-25789][docs-zh] Translate the formats/hadoop page into Chinese.

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18480: URL: https://github.com/apache/flink/pull/18480#issuecomment-1020209467 ## CI report: * f7553fcadb4a768cbfb9742704714280961d0569 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18475: [FLINK-25728] Protential memory leaks in StreamMultipleInputProcessor

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18475: URL: https://github.com/apache/flink/pull/18475#issuecomment-1020104543 ## CI report: * 3ade9719b565beeacf7761ab71d5abb7ba62e62a Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18472: [FLINK-25783][docs-zh] Translate azure_table_storage.md page into Chinese.

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18472: URL: https://github.com/apache/flink/pull/18472#issuecomment-1020057651 ## CI report: * f2a102b8715567da4c779398863dc3ee9531fd92 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18306: [FLINK-25445] No need to create local recovery dirs when disabled loc…

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18306: URL: https://github.com/apache/flink/pull/18306#issuecomment-1008234006 ## CI report: * f8c4b9cfcf8dd3fc85472dac9b8165c7c2c846dc Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18479: [FLINK-25387] Introduce ExecNodeMetadata

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18479: URL: https://github.com/apache/flink/pull/18479#issuecomment-1020172062 ## CI report: * d2b8689dd7de1135b312bdc9cf99a57945c07ace Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18489: [FLINK-25790][flink-gs-fs-hadoop] Support authentication via core-site.xml in GCS FileSystem plugin

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18489: URL: https://github.com/apache/flink/pull/18489#issuecomment-1020643947 ## CI report: * 6d23f67c6515ebfeef972314b5c19bb02fc3d2ed Azure:

[GitHub] [flink] dmvk commented on a change in pull request #18189: [FLINK-25430] Replace RunningJobRegistry by JobResultStore

2022-01-24 Thread GitBox
dmvk commented on a change in pull request #18189: URL: https://github.com/apache/flink/pull/18189#discussion_r791168425 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/MiniDispatcher.java ## @@ -55,14 +57,16 @@ public MiniDispatcher(

[GitHub] [flink] flinkbot commented on pull request #18489: [FLINK-25790][flink-gs-fs-hadoop] Support authentication via core-site.xml in GCS FileSystem plugin

2022-01-24 Thread GitBox
flinkbot commented on pull request #18489: URL: https://github.com/apache/flink/pull/18489#issuecomment-1020643947 ## CI report: * 6d23f67c6515ebfeef972314b5c19bb02fc3d2ed UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] flinkbot commented on pull request #18489: [FLINK-25790][flink-gs-fs-hadoop] Support authentication via core-site.xml in GCS FileSystem plugin

2022-01-24 Thread GitBox
flinkbot commented on pull request #18489: URL: https://github.com/apache/flink/pull/18489#issuecomment-1020643017 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[jira] [Commented] (FLINK-25290) Add table source and sink test suite in connector testing framework

2022-01-24 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481454#comment-17481454 ] Yufan Sheng commented on FLINK-25290: - I'm working on the sink test. When would this feature be

[GitHub] [flink] galenwarren commented on pull request #15599: [FLINK-11838][flink-gs-fs-hadoop] Create Google Storage file system with recoverable writer support

2022-01-24 Thread GitBox
galenwarren commented on pull request #15599: URL: https://github.com/apache/flink/pull/15599#issuecomment-1020640696 PR created: https://github.com/apache/flink/pull/18489 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Commented] (FLINK-25790) Support authentication via core-site.xml in GCS FileSystem plugin

2022-01-24 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481453#comment-17481453 ] Galen Warren commented on FLINK-25790: -- Created PR: https://github.com/apache/flink/pull/18489 >

[jira] [Updated] (FLINK-25790) Support authentication via core-site.xml in GCS FileSystem plugin

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-25790: --- Labels: pull-request-available (was: ) > Support authentication via core-site.xml in GCS

[GitHub] [flink] galenwarren opened a new pull request #18489: [FLINK-25790][flink-gs-fs-hadoop] Support authentication via core-site.xml in GCS FileSystem plugin

2022-01-24 Thread GitBox
galenwarren opened a new pull request #18489: URL: https://github.com/apache/flink/pull/18489 ## What is the purpose of the change For the GCS FileSystem plugin, use the same authentication options for the RecoverableWriter portion as is done for the normal FileSystem portion. This

[GitHub] [flink] flinkbot edited a comment on pull request #18476: [FLINK-25726][streaming] Add Global Committer as post commit topology

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18476: URL: https://github.com/apache/flink/pull/18476#issuecomment-1020132926 ## CI report: * 9c24ac788a7b5c48ce690a43212bcd25d68cf667 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18431: [FLINK-25024][docs] Add Changelog backend docs

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18431: URL: https://github.com/apache/flink/pull/18431#issuecomment-1017952324 ## CI report: * 939c7760b4809ef0e2d1ea897aa8d1217913669d Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18473: [FLINK-25781][network] Adjust the maximum number of buffers can be used per result partition for data read of sort-shuffle

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18473: URL: https://github.com/apache/flink/pull/18473#issuecomment-1020072553 ## CI report: * 4011a25da659ed1cfa258705a683ca83e1957c28 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18432: [FLINK-25739][dist] Include Changelog to flink-dist jar

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18432: URL: https://github.com/apache/flink/pull/18432#issuecomment-1017970404 ## CI report: * b14ababb8a5d1433710d69f2184b475c335dac2d Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #17452: [FLINK-20732][connector/pulsar] Introduction of Pulsar Sink

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #17452: URL: https://github.com/apache/flink/pull/17452#issuecomment-940136217 ## CI report: * c8820e335d23677ffb548b0d1fa8771fa7c1bce1 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18392: [FLINK-25590][metrics] Introduce RequestedMemoryUsage and log warnings if usage exceeds 100%

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18392: URL: https://github.com/apache/flink/pull/18392#issuecomment-1015285195 ## CI report: * 8fcd75bc3466edd79726a95f62aa923c31796b2e Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #17452: [FLINK-20732][connector/pulsar] Introduction of Pulsar Sink

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #17452: URL: https://github.com/apache/flink/pull/17452#issuecomment-940136217 ## CI report: * c8820e335d23677ffb548b0d1fa8771fa7c1bce1 Azure:

[jira] [Commented] (FLINK-25277) Introduce explicit shutdown signalling between TaskManager and JobManager

2022-01-24 Thread Niklas Semmler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481432#comment-17481432 ] Niklas Semmler commented on FLINK-25277: [~chesnay] Yes, you are right. [~trohrmann] needed the

[GitHub] [flink] syhily commented on a change in pull request #18388: [FLINK-25530][python][connector/pulsar] Support Pulsar source connector in Python DataStream API.

2022-01-24 Thread GitBox
syhily commented on a change in pull request #18388: URL: https://github.com/apache/flink/pull/18388#discussion_r791185396 ## File path: tools/ci/java-ci-tools/src/main/java/org/apache/flink/tools/ci/licensecheck/JarFileChecker.java ## @@ -210,6 +210,11 @@ private static int

[GitHub] [flink] syhily commented on a change in pull request #18388: [FLINK-25530][python][connector/pulsar] Support Pulsar source connector in Python DataStream API.

2022-01-24 Thread GitBox
syhily commented on a change in pull request #18388: URL: https://github.com/apache/flink/pull/18388#discussion_r791184358 ## File path: flink-connectors/pom.xml ## @@ -105,6 +105,7 @@ under the License. flink-sql-connector-hive-3.1.2

[GitHub] [flink] flinkbot edited a comment on pull request #18382: [FLINK-25524] Fix ChangelogStateBackend.notifyCheckpointComplete

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18382: URL: https://github.com/apache/flink/pull/18382#issuecomment-1014709963 ## CI report: * 06969c07178c598b4bd39fbf88385b1b0638e3a6 Azure:

[jira] [Commented] (FLINK-25530) Support Pulsar source connector in Python DataStream API.

2022-01-24 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481422#comment-17481422 ] Yufan Sheng commented on FLINK-25530: - https://github.com/apache/flink/pull/17452 The code for

[GitHub] [flink] flinkbot edited a comment on pull request #18471: [FLINK-25780][network] Reduce the maximum size of data output buffers per result partition for sort-shuffle

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18471: URL: https://github.com/apache/flink/pull/18471#issuecomment-1020052968 ## CI report: * 65c779eea512e90b8ec20eec4bbe56716f1b373e Azure:

[jira] [Updated] (FLINK-24246) Bump Pulsar to 2.9.1

2022-01-24 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-24246: Summary: Bump Pulsar to 2.9.1 (was: Bump Pulsar to 2.9.0) > Bump Pulsar to 2.9.1 >

[jira] [Commented] (FLINK-24246) Bump Pulsar to 2.9.0

2022-01-24 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481413#comment-17481413 ] Yufan Sheng commented on FLINK-24246: - Yeah, Pulsar 2.9.1 has been released. I would cherry-pick

[jira] [Commented] (FLINK-25530) Support Pulsar source connector in Python DataStream API.

2022-01-24 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481412#comment-17481412 ] Yufan Sheng commented on FLINK-25530: - [~ana4] I'm quite glad to see this issue. If you have any

[GitHub] [flink] flinkbot edited a comment on pull request #17498: [FLINK-14954][rest] Add OpenAPI spec generator

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #17498: URL: https://github.com/apache/flink/pull/17498#issuecomment-944209637 ## CI report: * 1d7656b27b98700dc8ed4bad5a7bf4bed00680a6 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #17452: [FLINK-20732][connector/pulsar] Introduction of Pulsar Sink

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #17452: URL: https://github.com/apache/flink/pull/17452#issuecomment-940136217 ## CI report: * c8820e335d23677ffb548b0d1fa8771fa7c1bce1 Azure:

[jira] [Commented] (FLINK-25753) KafkaTableITCase.testStartFromGroupOffsetsLatest fails on AZP

2022-01-24 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481394#comment-17481394 ] Roman Khachatryan commented on FLINK-25753: ---

[GitHub] [flink] flinkbot edited a comment on pull request #17452: [FLINK-20732][connector/pulsar] Introduction of Pulsar Sink

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #17452: URL: https://github.com/apache/flink/pull/17452#issuecomment-940136217 ## CI report: * c8820e335d23677ffb548b0d1fa8771fa7c1bce1 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18474: [FLINK-25786][network] Adjust the generation of subpartition data storage order for sort-shuffle from random shuffle to random shift

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18474: URL: https://github.com/apache/flink/pull/18474#issuecomment-1020097932 ## CI report: * 0b92227b39fabde5919ab161e12a6f7e272e70f7 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18473: [FLINK-25781][network] Adjust the maximum number of buffers can be used per result partition for data read of sort-shuffle

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18473: URL: https://github.com/apache/flink/pull/18473#issuecomment-1020072553 ## CI report: * d2d1c3c17d01e1a98e29568cfaba43460726092a Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18376: [FLINK-25668][runtime] Support calcuate network memory for dynamic graph

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18376: URL: https://github.com/apache/flink/pull/18376#issuecomment-1014266348 ## CI report: * 320757eaf30cae2a2b95c06e559c37e068120ef4 Azure:

[jira] [Commented] (FLINK-24229) [FLIP-171] DynamoDB implementation of Async Sink

2022-01-24 Thread Yuri Gusev (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481375#comment-17481375 ] Yuri Gusev commented on FLINK-24229: Hi [~MartijnVisser] [~CrynetLogistics] , I'm sorry for the

[GitHub] [flink] flinkbot edited a comment on pull request #18470: [FLINK-25774][network] Restrict the maximum number of buffers can be used per result partition for sort-shuffle

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18470: URL: https://github.com/apache/flink/pull/18470#issuecomment-1020036276 ## CI report: * decf33d57cf16564786d77240287fb1aeb034b39 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18314: [FLINK-24228][connectors/firehose] - Unified Async Sink for Kinesis Firehose

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18314: URL: https://github.com/apache/flink/pull/18314#issuecomment-1008761781 ## CI report: * 826fd84d3f61953a127829be78708c6d54de3244 UNKNOWN * 26aa7ccebd039dfa7f890d9d927e93c22ca58a0f Azure:

[jira] [Updated] (FLINK-25775) Document JavaScript SDK

2022-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-25775: --- Labels: pull-request-available (was: ) > Document JavaScript SDK > ---

[GitHub] [flink-statefun] igalshilman opened a new pull request #284: [FLINK-25775] Add Javascript SDK documentation

2022-01-24 Thread GitBox
igalshilman opened a new pull request #284: URL: https://github.com/apache/flink-statefun/pull/284 This PR adds the JavaScript API to the docs: index: https://user-images.githubusercontent.com/546103/150853862-a48a5747-3951-4d54-8f3e-037013547a09.png;> js:

[GitHub] [flink] flinkbot edited a comment on pull request #18472: [FLINK-25783][docs-zh] Translate azure_table_storage.md page into Chinese.

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18472: URL: https://github.com/apache/flink/pull/18472#issuecomment-1020057651 ## CI report: * 7021a6893c943ab0a6ba24705b606884bfebbe2c Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18314: [FLINK-24228][connectors/firehose] - Unified Async Sink for Kinesis Firehose

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18314: URL: https://github.com/apache/flink/pull/18314#issuecomment-1008761781 ## CI report: * 826fd84d3f61953a127829be78708c6d54de3244 UNKNOWN * 26aa7ccebd039dfa7f890d9d927e93c22ca58a0f Azure:

[jira] [Assigned] (FLINK-25775) Document JavaScript SDK

2022-01-24 Thread Igal Shilman (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igal Shilman reassigned FLINK-25775: Assignee: Igal Shilman > Document JavaScript SDK > --- > >

[GitHub] [flink] flinkbot edited a comment on pull request #18471: [FLINK-25780][network] Reduce the maximum size of data output buffers per result partition for sort-shuffle

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18471: URL: https://github.com/apache/flink/pull/18471#issuecomment-1020052968 ## CI report: * 6e793e2a37fbaf6618913fbf03887fc889c880ab Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18314: [FLINK-24228][connectors/firehose] - Unified Async Sink for Kinesis Firehose

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18314: URL: https://github.com/apache/flink/pull/18314#issuecomment-1008761781 ## CI report: * 826fd84d3f61953a127829be78708c6d54de3244 UNKNOWN * 26aa7ccebd039dfa7f890d9d927e93c22ca58a0f Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18314: [FLINK-24228][connectors/firehose] - Unified Async Sink for Kinesis Firehose

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18314: URL: https://github.com/apache/flink/pull/18314#issuecomment-1008761781 ## CI report: * 826fd84d3f61953a127829be78708c6d54de3244 UNKNOWN * 26aa7ccebd039dfa7f890d9d927e93c22ca58a0f Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #18314: [FLINK-24228][connectors/firehose] - Unified Async Sink for Kinesis Firehose

2022-01-24 Thread GitBox
flinkbot edited a comment on pull request #18314: URL: https://github.com/apache/flink/pull/18314#issuecomment-1008761781 ## CI report: * 826fd84d3f61953a127829be78708c6d54de3244 UNKNOWN * 26aa7ccebd039dfa7f890d9d927e93c22ca58a0f Azure:

<    1   2   3   4   5   6   7   8   9   10   >