[jira] [Closed] (FLINK-17517) Add failure recovery / exactly-once E2E for Stateful Functions

2020-05-15 Thread Tzu-Li (Gordon) Tai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai closed FLINK-17517. --- Resolution: Fixed statefun-master: bd30ec034ca0b09c5e888d0eb0c119c5e8799d32

[GitHub] [flink] Myasuka edited a comment on pull request #8693: [FLINK-8871] Support to cancel checkpoing via notification

2020-05-15 Thread GitBox
Myasuka edited a comment on pull request #8693: URL: https://github.com/apache/flink/pull/8693#issuecomment-629180857 I think current IT cases do not target to verify the cancel notification, I'll create one to target to verify this.

[GitHub] [flink] Myasuka commented on pull request #8693: [FLINK-8871] Support to cancel checkpoing via notification

2020-05-15 Thread GitBox
Myasuka commented on pull request #8693: URL: https://github.com/apache/flink/pull/8693#issuecomment-629180857 I think current IT cases do not target to verify the cancel notification, I'll create one to target to veriy this.

[GitHub] [flink] libenchao commented on pull request #12133: [FLINK-17526][avro] Support AVRO serialization and deseriazation sche…

2020-05-15 Thread GitBox
libenchao commented on pull request #12133: URL: https://github.com/apache/flink/pull/12133#issuecomment-629187429 @wuchong Thanks for your review, I've addressed your comments. This is an automated message from the Apache

[jira] [Updated] (FLINK-17715) Supports function DDLs in SQL-CLI

2020-05-15 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated FLINK-17715: --- Summary: Supports function DDLs in SQL-CLI (was: Supports create function in SQL-CLI) > Supports

[GitHub] [flink] flinkbot commented on pull request #12170: [FLINK-17729] Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

2020-05-15 Thread GitBox
flinkbot commented on pull request #12170: URL: https://github.com/apache/flink/pull/12170#issuecomment-629201539 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[jira] [Assigned] (FLINK-17543) Rerunning failed azure jobs fails when uploading logs

2020-05-15 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reassigned FLINK-17543: -- Assignee: Robert Metzger > Rerunning failed azure jobs fails when uploading logs >

[GitHub] [flink] kl0u commented on a change in pull request #12170: [FLINK-17729] Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

2020-05-15 Thread GitBox
kl0u commented on a change in pull request #12170: URL: https://github.com/apache/flink/pull/12170#discussion_r425777590 ## File path: flink-yarn/src/main/java/org/apache/flink/yarn/YarnApplicationFileUploader.java ## @@ -300,19 +310,22 @@ public FileVisitResult

[jira] [Created] (FLINK-17733) Add documentation for real-time hive

2020-05-15 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17733: Summary: Add documentation for real-time hive Key: FLINK-17733 URL: https://issues.apache.org/jira/browse/FLINK-17733 Project: Flink Issue Type: Sub-task

[GitHub] [flink-statefun] igalshilman opened a new pull request #113: [Flink-17644] Add state expiration to the Java SDK

2020-05-15 Thread GitBox
igalshilman opened a new pull request #113: URL: https://github.com/apache/flink-statefun/pull/113 This PR adds state expiration (state TTL in Flink land) to the persisted states in the Java SDK. follow up PR would expose that to the model.yaml. There are two types of expirations:

[GitHub] [flink] azagrebin commented on a change in pull request #12131: [FLINK-17161][docs][docker] Document the official docker hub image and examples of how to use it

2020-05-15 Thread GitBox
azagrebin commented on a change in pull request #12131: URL: https://github.com/apache/flink/pull/12131#discussion_r425765241 ## File path: docs/ops/deployment/kubernetes.md ## @@ -76,57 +74,92 @@ You can then access the Flink UI via different ways: {% highlight bash

[GitHub] [flink] azagrebin commented on a change in pull request #12131: [FLINK-17161][docs][docker] Document the official docker hub image and examples of how to use it

2020-05-15 Thread GitBox
azagrebin commented on a change in pull request #12131: URL: https://github.com/apache/flink/pull/12131#discussion_r425765241 ## File path: docs/ops/deployment/kubernetes.md ## @@ -76,57 +74,92 @@ You can then access the Flink UI via different ways: {% highlight bash

[GitHub] [flink] flinkbot edited a comment on pull request #12157: [FLINK-17691][Connectors/Kafka] fix the bug FlinkKafkaProducer011 transactional.id too long when use Semantic.EXACTLY_ONCE mode

2020-05-15 Thread GitBox
flinkbot edited a comment on pull request #12157: URL: https://github.com/apache/flink/pull/12157#issuecomment-628732224 ## CI report: * c72006072a887727d7ac814ef85576ae3c9a6bd7 UNKNOWN * 9fa966f648aa7d97e6000938970039e83b8e73f2 Travis:

[jira] [Created] (FLINK-17736) Add flink CEP examples

2020-05-15 Thread dengziming (Jira)
dengziming created FLINK-17736: -- Summary: Add flink CEP examples Key: FLINK-17736 URL: https://issues.apache.org/jira/browse/FLINK-17736 Project: Flink Issue Type: Improvement

[GitHub] [flink] flinkbot commented on pull request #12173: [FLINK-17727][task] don't create output stream with no channel state (unaligned checkpoints)

2020-05-15 Thread GitBox
flinkbot commented on pull request #12173: URL: https://github.com/apache/flink/pull/12173#issuecomment-629230337 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[GitHub] [flink] flinkbot edited a comment on pull request #12171: [FLINK-17715][sql client] Supports function DDLs in SQL-CLI

2020-05-15 Thread GitBox
flinkbot edited a comment on pull request #12171: URL: https://github.com/apache/flink/pull/12171#issuecomment-629218919 ## CI report: * 2d508f776da68adffc61555a5bea2fe6a1b4d3e9 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #12161: [FLINK-17450][sql-parser][hive] Implement function & catalog DDLs for Hive dialect

2020-05-15 Thread GitBox
flinkbot edited a comment on pull request #12161: URL: https://github.com/apache/flink/pull/12161#issuecomment-629011624 ## CI report: * ad540bb42ee21e8bd8ffb0adf4f01968f2f3cacb Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #12131: [FLINK-17161][docs][docker] Document the official docker hub image and examples of how to use it

2020-05-15 Thread GitBox
flinkbot edited a comment on pull request #12131: URL: https://github.com/apache/flink/pull/12131#issuecomment-628151351 ## CI report: * 5edc50664f4e51a37c67bdc24b92015851bd876b UNKNOWN * 1b1f9614a3314b816b14b7f41414e0cf41b1438e UNKNOWN *

[jira] [Commented] (FLINK-17736) Add flink CEP examples

2020-05-15 Thread dengziming (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108271#comment-17108271 ] dengziming commented on FLINK-17736: I will do this. > Add flink CEP examples >

[jira] [Commented] (FLINK-17073) Slow checkpoint cleanup causing OOMs

2020-05-15 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108270#comment-17108270 ] Etienne Chauchot commented on FLINK-17073: -- Hi, I just started contributing to Flink. I'd like

[GitHub] [flink] flinkbot commented on pull request #12172: [FLINK-17656][tests] Migrate docker e2e tests to flink-docker

2020-05-15 Thread GitBox
flinkbot commented on pull request #12172: URL: https://github.com/apache/flink/pull/12172#issuecomment-629230668 ## CI report: * ff37e0c1c648d9b80bb7d009f6b559d12ad3aeb7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] flinkbot edited a comment on pull request #12170: [FLINK-17729] Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

2020-05-15 Thread GitBox
flinkbot edited a comment on pull request #12170: URL: https://github.com/apache/flink/pull/12170#issuecomment-629218834 ## CI report: * b774a5652648e7bd23cdc02356237809dd6931e7 UNKNOWN * 4419cf15c0320b96afcb3d767322721007a7268f UNKNOWN Bot commands The

[jira] [Closed] (FLINK-16117) Avoid register source in TableTestBase#addTableSource

2020-05-15 Thread Zhenghua Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenghua Gao closed FLINK-16117. Resolution: Won't Fix > Avoid register source in TableTestBase#addTableSource >

[GitHub] [flink] flinkbot commented on pull request #12175: [FLINK-17692] Keep yarn.classpath in target folder to not pollute local builds

2020-05-15 Thread GitBox
flinkbot commented on pull request #12175: URL: https://github.com/apache/flink/pull/12175#issuecomment-629242592 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[jira] [Commented] (FLINK-17493) Possible direct memory leak in cassandra sink

2020-05-15 Thread nobleyd (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108317#comment-17108317 ] nobleyd commented on FLINK-17493: - [~xintongsong] Yes, it comes to direct memory OOM. > Possible direct

[GitHub] [flink-statefun] igalshilman commented on a change in pull request #110: [FLINK-17611] Unix domain socket connection between worker and function

2020-05-15 Thread GitBox
igalshilman commented on a change in pull request #110: URL: https://github.com/apache/flink-statefun/pull/110#discussion_r425833012 ## File path: statefun-flink/statefun-flink-core/src/main/java/org/apache/flink/statefun/flink/core/httpfn/HttpFunctionProvider.java ## @@

[GitHub] [flink] zentol commented on a change in pull request #12172: [FLINK-17656][tests] Migrate docker e2e tests to flink-docker

2020-05-15 Thread GitBox
zentol commented on a change in pull request #12172: URL: https://github.com/apache/flink/pull/12172#discussion_r425832746 ## File path: flink-end-to-end-tests/test-scripts/container-scripts/docker-compose.test.yml ## @@ -16,15 +16,31 @@ # limitations under the License.

[GitHub] [flink] flinkbot commented on pull request #12177: [FLINK-17435] [hive] Hive non-partitioned source supports streaming read

2020-05-15 Thread GitBox
flinkbot commented on pull request #12177: URL: https://github.com/apache/flink/pull/12177#issuecomment-629261051 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[GitHub] [flink-statefun] igalshilman commented on a change in pull request #110: [FLINK-17611] Unix domain socket connection between worker and function

2020-05-15 Thread GitBox
igalshilman commented on a change in pull request #110: URL: https://github.com/apache/flink-statefun/pull/110#discussion_r425833012 ## File path: statefun-flink/statefun-flink-core/src/main/java/org/apache/flink/statefun/flink/core/httpfn/HttpFunctionProvider.java ## @@

[GitHub] [flink] kl0u commented on pull request #12170: [FLINK-17729] Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

2020-05-15 Thread GitBox
kl0u commented on pull request #12170: URL: https://github.com/apache/flink/pull/12170#issuecomment-629266502 Thanks a lot @wangyang0918 for the testing! Much appreciated! I will wait for Azure and then merge. This is an

[GitHub] [flink] libenchao commented on a change in pull request #12133: [FLINK-17526][avro] Support AVRO serialization and deseriazation sche…

2020-05-15 Thread GitBox
libenchao commented on a change in pull request #12133: URL: https://github.com/apache/flink/pull/12133#discussion_r425840046 ## File path: flink-formats/flink-avro/src/test/java/org/apache/flink/formats/avro/AvroRowDataDeSerializationSchemaTest.java ## @@ -0,0 +1,146 @@ +/*

[GitHub] [flink] libenchao commented on pull request #12133: [FLINK-17526][avro] Support AVRO serialization and deseriazation sche…

2020-05-15 Thread GitBox
libenchao commented on pull request #12133: URL: https://github.com/apache/flink/pull/12133#issuecomment-629266652 @danny0405 Thanks for your review, I've addressed your comments. This is an automated message from the Apache

[GitHub] [flink] dawidwys commented on a change in pull request #12147: [FLINK-17653] FLIP-126: Unify (and separate) Watermark Assigners

2020-05-15 Thread GitBox
dawidwys commented on a change in pull request #12147: URL: https://github.com/apache/flink/pull/12147#discussion_r425840701 ## File path: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/AbstractFetcher.java ##

[GitHub] [flink] dawidwys commented on a change in pull request #12147: [FLINK-17653] FLIP-126: Unify (and separate) Watermark Assigners

2020-05-15 Thread GitBox
dawidwys commented on a change in pull request #12147: URL: https://github.com/apache/flink/pull/12147#discussion_r425840831 ## File path: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/AbstractFetcher.java ##

[GitHub] [flink] rmetzger commented on pull request #12167: [FLINK-17724][python] Set working directory before running the Python helper scripts.

2020-05-15 Thread GitBox
rmetzger commented on pull request #12167: URL: https://github.com/apache/flink/pull/12167#issuecomment-629272218 Since this change is basically a fix to the currently broken master, I pushed it to my personal Azure to get a result sooner than Flink's CI:

[GitHub] [flink] dawidwys commented on pull request #12147: [FLINK-17653] FLIP-126: Unify (and separate) Watermark Assigners

2020-05-15 Thread GitBox
dawidwys commented on pull request #12147: URL: https://github.com/apache/flink/pull/12147#issuecomment-629276097 Thank you @aljoscha for the update. In most of the parts it looks good from my side. This is an automated

[GitHub] [flink] rmetzger commented on a change in pull request #12172: [FLINK-17656][tests] Migrate docker e2e tests to flink-docker

2020-05-15 Thread GitBox
rmetzger commented on a change in pull request #12172: URL: https://github.com/apache/flink/pull/12172#discussion_r425853551 ## File path: flink-end-to-end-tests/test-scripts/container-scripts/docker-compose.test.yml ## @@ -16,15 +16,31 @@ # limitations under the License.

[GitHub] [flink] rmetzger commented on a change in pull request #12172: [FLINK-17656][tests] Migrate docker e2e tests to flink-docker

2020-05-15 Thread GitBox
rmetzger commented on a change in pull request #12172: URL: https://github.com/apache/flink/pull/12172#discussion_r425853356 ## File path: flink-end-to-end-tests/test-scripts/common_docker.sh ## @@ -33,8 +33,25 @@ function containers_health_check() { done } -function

[GitHub] [flink] KurtYoung commented on a change in pull request #12069: [FLINK-17734][streaming] Add specialized collecting sink function

2020-05-15 Thread GitBox
KurtYoung commented on a change in pull request #12069: URL: https://github.com/apache/flink/pull/12069#discussion_r425848753 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/collect/CollectSinkOperatorCoordinator.java ## @@ -0,0

[GitHub] [flink] zhijiangW commented on pull request #12163: [FLINK-17719][task][checkpointing] Provide ChannelStateReader#hasStates for hints of reading channel states

2020-05-15 Thread GitBox
zhijiangW commented on pull request #12163: URL: https://github.com/apache/flink/pull/12163#issuecomment-629279669 @flinkbot run azure This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Closed] (FLINK-17591) TableEnvironmentITCase.testExecuteSqlAndToDataStream failed

2020-05-15 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-17591. --- Resolution: Fixed Close it since it is not reproduced these days. >

[jira] [Comment Edited] (FLINK-17493) Possible direct memory leak in cassandra sink

2020-05-15 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-17493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108200#comment-17108200 ] Oisín Mac Fhearaí edited comment on FLINK-17493 at 5/15/20, 11:47 AM:

[jira] [Commented] (FLINK-17493) Possible direct memory leak in cassandra sink

2020-05-15 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-17493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108200#comment-17108200 ] Oisín Mac Fhearaí commented on FLINK-17493: --- [~xintongsong] you might be right that it's an

[jira] [Comment Edited] (FLINK-17493) Possible direct memory leak in cassandra sink

2020-05-15 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-17493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108200#comment-17108200 ] Oisín Mac Fhearaí edited comment on FLINK-17493 at 5/15/20, 11:47 AM:

[GitHub] [flink] wangyang0918 commented on a change in pull request #11839: [FLINK-17166][dist] Modify the log4j-console.properties to also output logs into the files for WebUI

2020-05-15 Thread GitBox
wangyang0918 commented on a change in pull request #11839: URL: https://github.com/apache/flink/pull/11839#discussion_r425754483 ## File path: flink-dist/src/main/flink-bin/bin/flink-console.sh ## @@ -70,4 +97,10 @@ if [[ ${JAVA_VERSION} =~ ${IS_NUMBER} ]]; then fi echo

[jira] [Commented] (FLINK-17545) Resource leak JDBCUpsertOutputFormat

2020-05-15 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108214#comment-17108214 ] Roman Khachatryan commented on FLINK-17545: --- This issue is still present in the current master

[GitHub] [flink] wangyang0918 commented on a change in pull request #11839: [FLINK-17166][dist] Modify the log4j-console.properties to also output logs into the files for WebUI

2020-05-15 Thread GitBox
wangyang0918 commented on a change in pull request #11839: URL: https://github.com/apache/flink/pull/11839#discussion_r425754067 ## File path: flink-dist/src/main/flink-bin/bin/flink-console.sh ## @@ -58,7 +58,34 @@ esac FLINK_TM_CLASSPATH=`constructFlinkClassPath`

[GitHub] [flink-statefun] slinkydeveloper commented on a change in pull request #110: [FLINK-17611] Unix domain socket connection between worker and function

2020-05-15 Thread GitBox
slinkydeveloper commented on a change in pull request #110: URL: https://github.com/apache/flink-statefun/pull/110#discussion_r425760968 ## File path: statefun-flink/statefun-flink-core/src/test/java/org/apache/flink/statefun/flink/core/jsonmodule/JsonModuleTest.java ## @@

[jira] [Commented] (FLINK-17730) HadoopS3RecoverableWriterITCase.testRecoverAfterMultiplePersistsStateWithMultiPart times out

2020-05-15 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108224#comment-17108224 ] Robert Metzger commented on FLINK-17730: I'm 99% sure that we can resolve this issue by

[jira] [Created] (FLINK-17730) HadoopS3RecoverableWriterITCase.testRecoverAfterMultiplePersistsStateWithMultiPart times out

2020-05-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17730: -- Summary: HadoopS3RecoverableWriterITCase.testRecoverAfterMultiplePersistsStateWithMultiPart times out Key: FLINK-17730 URL: https://issues.apache.org/jira/browse/FLINK-17730

[jira] [Assigned] (FLINK-17730) HadoopS3RecoverableWriterITCase.testRecoverAfterMultiplePersistsStateWithMultiPart times out

2020-05-15 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reassigned FLINK-17730: -- Assignee: Robert Metzger >

[GitHub] [flink] flinkbot commented on pull request #12171: [FLINK-17715][sql client] Supports function DDLs in SQL-CLI

2020-05-15 Thread GitBox
flinkbot commented on pull request #12171: URL: https://github.com/apache/flink/pull/12171#issuecomment-629202923 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[GitHub] [flink-statefun] slinkydeveloper commented on a change in pull request #110: [FLINK-17611] Unix domain socket connection between worker and function

2020-05-15 Thread GitBox
slinkydeveloper commented on a change in pull request #110: URL: https://github.com/apache/flink-statefun/pull/110#discussion_r425760773 ## File path: statefun-flink/statefun-flink-core/src/test/java/org/apache/flink/statefun/flink/core/jsonmodule/JsonModuleTest.java ## @@

[GitHub] [flink-statefun] igalshilman commented on a change in pull request #110: [FLINK-17611] Unix domain socket connection between worker and function

2020-05-15 Thread GitBox
igalshilman commented on a change in pull request #110: URL: https://github.com/apache/flink-statefun/pull/110#discussion_r425772632 ## File path: statefun-flink/statefun-flink-core/src/test/java/org/apache/flink/statefun/flink/core/jsonmodule/JsonModuleTest.java ## @@ -95,6

[GitHub] [flink] JingsongLi merged pull request #11385: [FLINK-11395][formats] Support for Avro StreamingFileSink

2020-05-15 Thread GitBox
JingsongLi merged pull request #11385: URL: https://github.com/apache/flink/pull/11385 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [flink] azagrebin commented on a change in pull request #12131: [FLINK-17161][docs][docker] Document the official docker hub image and examples of how to use it

2020-05-15 Thread GitBox
azagrebin commented on a change in pull request #12131: URL: https://github.com/apache/flink/pull/12131#discussion_r425773202 ## File path: docs/ops/deployment/kubernetes.md ## @@ -274,44 +341,121 @@ spec: path: flink-conf.yaml - key: log4j.properties

[GitHub] [flink] azagrebin commented on a change in pull request #12131: [FLINK-17161][docs][docker] Document the official docker hub image and examples of how to use it

2020-05-15 Thread GitBox
azagrebin commented on a change in pull request #12131: URL: https://github.com/apache/flink/pull/12131#discussion_r425772745 ## File path: docs/ops/deployment/kubernetes.md ## @@ -274,44 +341,121 @@ spec: path: flink-conf.yaml - key: log4j.properties

[GitHub] [flink] rmetzger commented on pull request #12025: [FLINK-17435] [hive] Hive non-partitioned source supports streaming read

2020-05-15 Thread GitBox
rmetzger commented on pull request #12025: URL: https://github.com/apache/flink/pull/12025#issuecomment-629232771 Note: This change broke master:

[jira] [Reopened] (FLINK-17435) Hive non-partitioned source support streaming read

2020-05-15 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reopened FLINK-17435: Note: this change broke master:

[GitHub] [flink] kl0u commented on pull request #12170: [FLINK-17729] Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

2020-05-15 Thread GitBox
kl0u commented on pull request #12170: URL: https://github.com/apache/flink/pull/12170#issuecomment-629238529 Thanks a lot @wangyang0918 ! Let me know about the results of your test and if Azure and you report positive results, then I will merge!

[GitHub] [flink] Myasuka commented on a change in pull request #8693: [FLINK-8871] Support to cancel checkpoing via notification

2020-05-15 Thread GitBox
Myasuka commented on a change in pull request #8693: URL: https://github.com/apache/flink/pull/8693#discussion_r425713504 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/SubtaskCheckpointCoordinatorImpl.java ## @@ -183,6 +235,42 @@

[GitHub] [flink] rmetzger commented on a change in pull request #12172: [FLINK-17656][tests] Migrate docker e2e tests to flink-docker

2020-05-15 Thread GitBox
rmetzger commented on a change in pull request #12172: URL: https://github.com/apache/flink/pull/12172#discussion_r425818508 ## File path: flink-end-to-end-tests/test-scripts/common_docker.sh ## @@ -33,8 +33,25 @@ function containers_health_check() { done } -function

[GitHub] [flink] godfreyhe commented on pull request #12177: [FLINK-17435] [hive] Hive non-partitioned source supports streaming read

2020-05-15 Thread GitBox
godfreyhe commented on pull request #12177: URL: https://github.com/apache/flink/pull/12177#issuecomment-629258889 related pr https://github.com/apache/flink/pull/12025 This is an automated message from the Apache Git

[GitHub] [flink] wtog opened a new pull request #12179: get client.timeout for the client, with a fallback to the akka.client…

2020-05-15 Thread GitBox
wtog opened a new pull request #12179: URL: https://github.com/apache/flink/pull/12179 ## What is the purpose of the change Add client.timeout setting and use that for CLI operations ## Brief change log Currently, the Cli uses the akka.client.timeout setting.

[GitHub] [flink] dianfu commented on pull request #12167: [FLINK-17724][python] Set working directory before running the Python helper scripts.

2020-05-15 Thread GitBox
dianfu commented on pull request #12167: URL: https://github.com/apache/flink/pull/12167#issuecomment-629269589 @flinkbot run azure This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [flink] wuchong commented on pull request #12152: [FLINK-17149][debezium][canal] Introduce Debezium and Canal changelog format

2020-05-15 Thread GitBox
wuchong commented on pull request #12152: URL: https://github.com/apache/flink/pull/12152#issuecomment-629269766 Thanks for the reviewing @danny0405 . Merging... This is an automated message from the Apache Git

[GitHub] [flink] Myasuka commented on a change in pull request #11957: [FLINK-17248] Introduce configuration for pool size of io-executor for ClusterEntrypoint and MiniCluster

2020-05-15 Thread GitBox
Myasuka commented on a change in pull request #11957: URL: https://github.com/apache/flink/pull/11957#discussion_r425844514 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/JobManagerSharedServices.java ## @@ -157,8 +159,12 @@ public static

[jira] [Commented] (FLINK-16383) KafkaProducerExactlyOnceITCase. testExactlyOnceRegularSink fails with "The producer has already been closed"

2020-05-15 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108344#comment-17108344 ] Jark Wu commented on FLINK-16383: -

[jira] [Closed] (FLINK-17712) Upgrade Flink version to 1.10.1 in Stateful Functions

2020-05-15 Thread Tzu-Li (Gordon) Tai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai closed FLINK-17712. --- Resolution: Fixed statefun-master: ea14e2cc76dd777b460795357f16d431c53827b8

[GitHub] [flink] zhijiangW commented on a change in pull request #11814: [FLINK-17218][tests] Adding recoverable failures and correctness chec…

2020-05-15 Thread GitBox
zhijiangW commented on a change in pull request #11814: URL: https://github.com/apache/flink/pull/11814#discussion_r425734079 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/channel/ChannelStateWriterImpl.java ## @@ -91,6 +91,7 @@ public

[GitHub] [flink] flinkbot commented on pull request #12168: [WIP][FLINK-14255][hive] Integrate hive to streaming file sink

2020-05-15 Thread GitBox
flinkbot commented on pull request #12168: URL: https://github.com/apache/flink/pull/12168#issuecomment-629179735 ## CI report: * 2c97f52f8d206393ab06a555d3510392b2638015 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] flinkbot commented on pull request #12166: [FLINK-17700][python] The callback client of JavaGatewayServer should…

2020-05-15 Thread GitBox
flinkbot commented on pull request #12166: URL: https://github.com/apache/flink/pull/12166#issuecomment-629179562 ## CI report: * 83ca51c37fb15c03208963c741118933600a4348 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] zentol commented on a change in pull request #11839: [FLINK-17166][dist] Modify the log4j-console.properties to also output logs into the files for WebUI

2020-05-15 Thread GitBox
zentol commented on a change in pull request #11839: URL: https://github.com/apache/flink/pull/11839#discussion_r425726762 ## File path: flink-dist/src/main/flink-bin/bin/flink-console.sh ## @@ -70,4 +97,10 @@ if [[ ${JAVA_VERSION} =~ ${IS_NUMBER} ]]; then fi echo

[jira] [Closed] (FLINK-16928) Switch back to new scheduler in Stateful Functions

2020-05-15 Thread Tzu-Li (Gordon) Tai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai closed FLINK-16928. --- Fix Version/s: statefun-2.1.0 Assignee: Tzu-Li (Gordon) Tai

[GitHub] [flink-statefun] igalshilman commented on a change in pull request #108: [FLINK-17516] [e2e] Exactly-once verification E2E

2020-05-15 Thread GitBox
igalshilman commented on a change in pull request #108: URL: https://github.com/apache/flink-statefun/pull/108#discussion_r425733775 ## File path: statefun-e2e-tests/statefun-e2e-tests-common/src/main/java/org/apache/flink/statefun/e2e/common/StatefulFunctionsAppContainers.java

[GitHub] [flink] flinkbot commented on pull request #12167: [FLINK-17724][python] Set working directory before running the Python helper scripts.

2020-05-15 Thread GitBox
flinkbot commented on pull request #12167: URL: https://github.com/apache/flink/pull/12167#issuecomment-629179648 ## CI report: * 7e53be826522296276198784cad533977138ce21 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] azagrebin commented on a change in pull request #12131: [FLINK-17161][docs][docker] Document the official docker hub image and examples of how to use it

2020-05-15 Thread GitBox
azagrebin commented on a change in pull request #12131: URL: https://github.com/apache/flink/pull/12131#discussion_r425740724 ## File path: docs/ops/deployment/kubernetes.md ## @@ -76,57 +74,92 @@ You can then access the Flink UI via different ways: {% highlight bash

[GitHub] [flink] docete commented on a change in pull request #12076: [FLINK-15950][table] Remove registration of TableSource/TableSink in Table Env

2020-05-15 Thread GitBox
docete commented on a change in pull request #12076: URL: https://github.com/apache/flink/pull/12076#discussion_r425758661 ## File path: flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/utils/TableEnvUtils.java ## @@ -0,0 +1,135 @@ +/* + * Licensed to the

[jira] [Updated] (FLINK-17729) Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

2020-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-17729: --- Labels: pull-request-available (was: ) > Make mandatory to have lib/, plugin/ and dist in

[GitHub] [flink] kl0u opened a new pull request #12170: [FLINK-17729] Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

2020-05-15 Thread GitBox
kl0u opened a new pull request #12170: URL: https://github.com/apache/flink/pull/12170 This PR builds on top of https://github.com/apache/flink/pull/12143 and adds the functionality described in the JIRA. It makes mandatory for users of the `yarn.provided.lib.dirs` option to also include

[GitHub] [flink-statefun] slinkydeveloper commented on pull request #110: [FLINK-17611] Unix domain socket connection between worker and function

2020-05-15 Thread GitBox
slinkydeveloper commented on pull request #110: URL: https://github.com/apache/flink-statefun/pull/110#issuecomment-629199585 @igalshilman if you're looking for an async io transport, i suggest to go with https://vertx.io/docs/vertx-core/java/ . It's a little layer on top of netty that

[GitHub] [flink] wangyang0918 commented on a change in pull request #12170: [FLINK-17729] Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

2020-05-15 Thread GitBox
wangyang0918 commented on a change in pull request #12170: URL: https://github.com/apache/flink/pull/12170#discussion_r425763495 ## File path: flink-yarn/src/main/java/org/apache/flink/yarn/YarnApplicationFileUploader.java ## @@ -300,19 +310,22 @@ public FileVisitResult

[GitHub] [flink] flinkbot edited a comment on pull request #11839: [FLINK-17166][dist] Modify the log4j-console.properties to also output logs into the files for WebUI

2020-05-15 Thread GitBox
flinkbot edited a comment on pull request #11839: URL: https://github.com/apache/flink/pull/11839#issuecomment-617042256 ## CI report: * ab5e8324f0ace63d1e5b3f292dd6d517b056fd21 UNKNOWN * d716b1ff179f5b4248a1133641b6f0a4733a9e19 Azure:

[GitHub] [flink-statefun] igalshilman commented on pull request #110: [FLINK-17611] Unix domain socket connection between worker and function

2020-05-15 Thread GitBox
igalshilman commented on pull request #110: URL: https://github.com/apache/flink-statefun/pull/110#issuecomment-629206827 @slinkydeveloper You can use the already published Python SDK in PyPI (`pip install apache-flink-statefun`) it should be able to handle requests from your branch,

[GitHub] [flink] kl0u commented on a change in pull request #12170: [FLINK-17729] Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

2020-05-15 Thread GitBox
kl0u commented on a change in pull request #12170: URL: https://github.com/apache/flink/pull/12170#discussion_r425777590 ## File path: flink-yarn/src/main/java/org/apache/flink/yarn/YarnApplicationFileUploader.java ## @@ -300,19 +310,22 @@ public FileVisitResult

[GitHub] [flink] azagrebin commented on a change in pull request #12131: [FLINK-17161][docs][docker] Document the official docker hub image and examples of how to use it

2020-05-15 Thread GitBox
azagrebin commented on a change in pull request #12131: URL: https://github.com/apache/flink/pull/12131#discussion_r425777675 ## File path: docs/ops/deployment/docker.md ## @@ -24,119 +24,490 @@ under the License. --> [Docker](https://www.docker.com) is a popular container

[GitHub] [flink] azagrebin commented on a change in pull request #12131: [FLINK-17161][docs][docker] Document the official docker hub image and examples of how to use it

2020-05-15 Thread GitBox
azagrebin commented on a change in pull request #12131: URL: https://github.com/apache/flink/pull/12131#discussion_r425777456 ## File path: docs/ops/deployment/docker.md ## @@ -24,119 +24,490 @@ under the License. --> [Docker](https://www.docker.com) is a popular container

[jira] [Closed] (FLINK-17435) Hive non-partitioned source support streaming read

2020-05-15 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-17435. Resolution: Implemented master: 32bd0944d0519093c0a4d5d809c6636eb3a7fc31 > Hive non-partitioned

[GitHub] [flink] JingsongLi merged pull request #12025: [FLINK-17435] [hive] Hive non-partitioned source supports streaming read

2020-05-15 Thread GitBox
JingsongLi merged pull request #12025: URL: https://github.com/apache/flink/pull/12025 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [flink] azagrebin commented on pull request #12131: [FLINK-17161][docs][docker] Document the official docker hub image and examples of how to use it

2020-05-15 Thread GitBox
azagrebin commented on pull request #12131: URL: https://github.com/apache/flink/pull/12131#issuecomment-629226993 Why to do it now and not later with the whole module? > Shall we remove flink-container/kubernetes/README.me? it is quite self-containing

[GitHub] [flink] KurtYoung commented on a change in pull request #12161: [FLINK-17450][sql-parser][hive] Implement function & catalog DDLs for Hive dialect

2020-05-15 Thread GitBox
KurtYoung commented on a change in pull request #12161: URL: https://github.com/apache/flink/pull/12161#discussion_r425810399 ## File path: flink-connectors/flink-connector-hive/src/test/java/org/apache/flink/connectors/hive/HiveDialectTest.java ## @@ -222,6 +225,26 @@

[GitHub] [flink] leonardBang opened a new pull request #12176: [FLINK-17029][jdbc]Introduce a new JDBC connector with new property keys

2020-05-15 Thread GitBox
leonardBang opened a new pull request #12176: URL: https://github.com/apache/flink/pull/12176 ## What is the purpose of the change *This pull request introduce a new JDBC connector with new property keys which follows

[jira] [Commented] (FLINK-17073) Slow checkpoint cleanup causing OOMs

2020-05-15 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108315#comment-17108315 ] Etienne Chauchot commented on FLINK-17073: -- ok, fair enough, I'll pick another one. > Slow

[jira] [Updated] (FLINK-17029) Introduce a new JDBC connector with new property keys

2020-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-17029: --- Labels: pull-request-available (was: ) > Introduce a new JDBC connector with new property

[GitHub] [flink] JingsongLi commented on a change in pull request #12062: [FLINK-17587][filesystem] Filesystem streaming sink support commit success file

2020-05-15 Thread GitBox
JingsongLi commented on a change in pull request #12062: URL: https://github.com/apache/flink/pull/12062#discussion_r425835856 ## File path: flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/filesystem/FileSystemOptions.java ## @@ -88,4 +88,48 @@

[GitHub] [flink] JingsongLi commented on a change in pull request #12062: [FLINK-17587][filesystem] Filesystem streaming sink support commit success file

2020-05-15 Thread GitBox
JingsongLi commented on a change in pull request #12062: URL: https://github.com/apache/flink/pull/12062#discussion_r425835856 ## File path: flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/filesystem/FileSystemOptions.java ## @@ -88,4 +88,48 @@

[GitHub] [flink] JingsongLi commented on a change in pull request #12062: [FLINK-17587][filesystem] Filesystem streaming sink support commit success file

2020-05-15 Thread GitBox
JingsongLi commented on a change in pull request #12062: URL: https://github.com/apache/flink/pull/12062#discussion_r425834906 ## File path: flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/filesystem/FileSystemOptions.java ## @@ -88,4 +88,48 @@

[GitHub] [flink] dawidwys commented on a change in pull request #12147: [FLINK-17653] FLIP-126: Unify (and separate) Watermark Assigners

2020-05-15 Thread GitBox
dawidwys commented on a change in pull request #12147: URL: https://github.com/apache/flink/pull/12147#discussion_r425835304 ## File path: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/AbstractFetcher.java ##

[jira] [Created] (FLINK-17737) KeyedStateCheckpointingITCase fails in UC mode

2020-05-15 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-17737: - Summary: KeyedStateCheckpointingITCase fails in UC mode Key: FLINK-17737 URL: https://issues.apache.org/jira/browse/FLINK-17737 Project: Flink

[GitHub] [flink] dawidwys commented on a change in pull request #12147: [FLINK-17653] FLIP-126: Unify (and separate) Watermark Assigners

2020-05-15 Thread GitBox
dawidwys commented on a change in pull request #12147: URL: https://github.com/apache/flink/pull/12147#discussion_r425848001 ## File path: flink-core/src/main/java/org/apache/flink/api/common/eventtime/WatermarkStrategies.java ## @@ -0,0 +1,251 @@ +/* + * Licensed to the

  1   2   3   4   5   6   7   8   9   10   >