[GitHub] [flink] flinkbot edited a comment on pull request #16743: [FLINK-23645][Table SQL / Client] Fix SqlClient doesn't response correctly to Signal.INT
flinkbot edited a comment on pull request #16743: URL: https://github.com/apache/flink/pull/16743#issuecomment-894206516 ## CI report: * 00ba755b7a2f3da9b0cc8008bba352ba078a6d77 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21714) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16590: [FLINK-19554][connector/testing-framework] Connector Testing Framework
flinkbot edited a comment on pull request #16590: URL: https://github.com/apache/flink/pull/16590#issuecomment-886445550 ## CI report: * 93776a6d6881dc65de98a7c7337ebd6189b61414 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21717) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16590: [FLINK-19554][connector/testing-framework] Connector Testing Framework
flinkbot edited a comment on pull request #16590: URL: https://github.com/apache/flink/pull/16590#issuecomment-886445550 ## CI report: * 8ba223523eb708232b5fe86eb162fb1f36e85ffc Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21709) * 93776a6d6881dc65de98a7c7337ebd6189b61414 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16744: [FLINK-23208] let late processing timers fired immediately
flinkbot edited a comment on pull request #16744: URL: https://github.com/apache/flink/pull/16744#issuecomment-894596520 ## CI report: * bc72b6c84cda124717e6ef7be423da187fafaaed Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21716) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16644: [FLINK-23551][Connectors/ORC] Bump ORC to 1.6.9
flinkbot edited a comment on pull request #16644: URL: https://github.com/apache/flink/pull/16644#issuecomment-889635734 ## CI report: * b7eb3a91a8753e777ff86152bc4238b376f2ae51 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21715) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Comment Edited] (FLINK-22246) when use HiveCatalog create table , can't set Table owner property correctly
[
https://issues.apache.org/jira/browse/FLINK-22246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395045#comment-17395045
]
Bo Cui edited comment on FLINK-22246 at 8/7/21, 3:43 AM:
-
[~lirui] yes, No need to get the real user in case of a proxy
was (Author: bo cui):
[~lirui] Why dont you need real user? authentication requires real user.
> when use HiveCatalog create table , can't set Table owner property correctly
> -
>
> Key: FLINK-22246
> URL: https://issues.apache.org/jira/browse/FLINK-22246
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive
>Affects Versions: 1.11.1, 1.12.0
>Reporter: xiangtao
>Priority: Minor
> Labels: auto-deprioritized-major
>
> when i use HiveCatalog create table in sql-client , i found it can't set
> Hive Table `owner` property correctly. i debug code , i found in
> `HiveCatalog.createTable` method
> {code:java}
> Table hiveTable =
> org.apache.hadoop.hive.ql.metadata.Table.getEmptyTable(
> tablePath.getDatabaseName(), tablePath.getObjectName());
> {code}
>
> this get hiveTable obj , owner field is null . beacuse it set owner through
> {code:java}
> t.setOwner(SessionState.getUserFromAuthenticator());
> {code}
>
> but SessionState is null .
> Fix this bug , we can add one code in HiveCatalog.open method .
> {code:java}
> SessionState.setCurrentSessionState(new SessionState(hiveConf));
> {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [flink] cshuo commented on a change in pull request #16669: [FLINK-23544][table-planner]Window TVF Supports session window
cshuo commented on a change in pull request #16669:
URL: https://github.com/apache/flink/pull/16669#discussion_r684576306
##
File path:
flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/plan/nodes/physical/stream/StreamPhysicalWindowAggregate.scala
##
@@ -104,14 +105,50 @@ class StreamPhysicalWindowAggregate(
override def translateToExecNode(): ExecNode[_] = {
checkEmitConfiguration(FlinkRelOptUtil.getTableConfigFromContext(this))
-new StreamExecWindowAggregate(
- grouping,
- aggCalls.toArray,
- windowing,
- namedWindowProperties.toArray,
- InputProperty.DEFAULT,
- FlinkTypeFactory.toLogicalRowType(getRowType),
- getRelDetailedDescription
-)
+windowing.getWindow match {
+ case windowSpec: SessionWindowSpec =>
+windowing match {
+ case timeWindowStrategy: TimeAttributeWindowingStrategy =>
+val (timeAttributeFieldName, timeAttributeIdx) = if
(timeWindowStrategy.isRowtime) {
Review comment:
branch here is not necessary, proctime case will be processed properly
inside window op
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #16744: [FLINK-23208] let late processing timers fired immediately
flinkbot commented on pull request #16744: URL: https://github.com/apache/flink/pull/16744#issuecomment-894596520 ## CI report: * bc72b6c84cda124717e6ef7be423da187fafaaed UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16644: [FLINK-23551][Connectors/ORC] Bump ORC to 1.6.9
flinkbot edited a comment on pull request #16644: URL: https://github.com/apache/flink/pull/16644#issuecomment-889635734 ## CI report: * f56ffc320e54c38b26f2d9d3d62e7bf5888f3024 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21546) * b7eb3a91a8753e777ff86152bc4238b376f2ae51 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16743: [FLINK-23645][Table SQL / Client] Fix SqlClient doesn't response correctly to Signal.INT
flinkbot edited a comment on pull request #16743: URL: https://github.com/apache/flink/pull/16743#issuecomment-894206516 ## CI report: * f83e553ed323cbea684fb3b727ba10bb1c4c806e Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21694) * 00ba755b7a2f3da9b0cc8008bba352ba078a6d77 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21714) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #16744: [FLINK-23208] let late processing timers fired immediately
flinkbot commented on pull request #16744: URL: https://github.com/apache/flink/pull/16744#issuecomment-894593957 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the progress of the review. ## Automated Checks Last check on commit bc72b6c84cda124717e6ef7be423da187fafaaed (Sat Aug 07 02:42:51 UTC 2021) **Warnings:** * No documentation files were touched! Remember to keep the Flink docs up to date! Mention the bot in a comment to re-run the automated checks. ## Review Progress * ❓ 1. The [description] looks good. * ❓ 2. There is [consensus] that the contribution should go into to Flink. * ❓ 3. Needs [attention] from. * ❓ 4. The change fits into the overall [architecture]. * ❓ 5. Overall code [quality] is good. Please see the [Pull Request Review Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commands The @flinkbot bot supports the following commands: - `@flinkbot approve description` to approve one or more aspects (aspects: `description`, `consensus`, `architecture` and `quality`) - `@flinkbot approve all` to approve all aspects - `@flinkbot approve-until architecture` to approve everything until `architecture` - `@flinkbot attention @username1 [@username2 ..]` to require somebody's attention - `@flinkbot disapprove architecture` to remove an approval you gave earlier -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] Jiayi-Liao edited a comment on pull request #16744: [FLINK-23208] let late processing timers fired immediately
Jiayi-Liao edited a comment on pull request #16744: URL: https://github.com/apache/flink/pull/16744#issuecomment-894593088 @pnowojski To make the change pass the CI, I have to modify `TestProcessingTimeService.setCurrentTime(long)` which may affect a lot of tests. (Try `InternalTimerServiceImplTest.testSnapshotAndRestorePreVersioned()` with this PR) And I tried to correct the related tests (see [commit](https://github.com/Jiayi-Liao/flink/commit/28021a31a832c977af76ac6fc97956d41ed90e53)), but failed because the influence seems to be too huge, especially there's also a parent class `AbstractStreamOperatorTestHarness` using the `TestProcessingTimeService.setCurrentTime(long)`. Do you have any better solution for the problem? If there's no better way, I would prefer the original solution I mentioned in [FLINK-23208](https://issues.apache.org/jira/browse/FLINK-23208) with a simple change in `ProcessingTimeServiceUtil.getProcessingTimeDelay()`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] Jiayi-Liao commented on pull request #16744: [FLINK-23208] let late processing timers fired immediately
Jiayi-Liao commented on pull request #16744: URL: https://github.com/apache/flink/pull/16744#issuecomment-894593088 @pnowojski To make the change pass the CI, I have to modify `TestProcessingTimeService.setCurrentTime(long)` which may affect a lot of unit tests. I tried to correct the related tests (see [commit](https://github.com/Jiayi-Liao/flink/commit/28021a31a832c977af76ac6fc97956d41ed90e53)), but failed because the influence seems to be too huge, especially there's also a parent class `AbstractStreamOperatorTestHarness` using the `TestProcessingTimeService.setCurrentTime(long)`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] Jiayi-Liao opened a new pull request #16744: [FLINK-23208] let late processing timers fired immediately
Jiayi-Liao opened a new pull request #16744: URL: https://github.com/apache/flink/pull/16744 ## What is the purpose of the change Currently late timers need to wait 1ms at least to be fired which may decrease the whole job's throughput. (see benchmarks in https://github.com/apache/flink-benchmarks/pull/25) ## Brief change log * In `InternalTimerServiceImpl.onProcessingTime(long)`, we fire all late timers(timer's timestamp < now() - 1ms) directly. ## Verifying this change ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): no - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: no - The serializers: no - The runtime per-record code paths (performance sensitive): yes - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no - The S3 file system connector: no ## Documentation - Does this pull request introduce a new feature? no - If yes, how is the feature documented? not applicable -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] syhily commented on a change in pull request #15304: [FLINK-20731][connector] Introduce Pulsar Source
syhily commented on a change in pull request #15304:
URL: https://github.com/apache/flink/pull/15304#discussion_r684570817
##
File path: flink-connectors/flink-connector-pulsar/pom.xml
##
@@ -0,0 +1,162 @@
+
+
+http://maven.apache.org/POM/4.0.0;
+xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;
+xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
http://maven.apache.org/xsd/maven-4.0.0.xsd;>
+
+ 4.0.0
+
+
+ flink-connectors
+ org.apache.flink
+ 1.14-SNAPSHOT
+ ..
+
+
+ flink-connector-pulsar_${scala.binary.version}
+ Flink : Connectors : Pulsar
+
+ jar
+
+
+ 2.8.0
+
+
+
+
+ org.apache.flink
+
flink-streaming-java_${scala.binary.version}
+ ${project.version}
+ provided
+
+
+
+
+ org.apache.pulsar
+ pulsar-client-all
+ ${pulsar.version}
+
+
+
+ org.apache.flink
+ flink-connector-base
+ ${project.version}
+
+
+
+
+ org.apache.flink
+ flink-avro
+ ${project.version}
+ provided
+
+
+ org.apache.flink
+ flink-json
+ ${project.version}
+ provided
+
Review comment:
These two dependencies would be used for pulsar table. So I would drop
it here since it was a source connector merge request.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Assigned] (FLINK-23672) Add smoke-e2e-java for Java SDK smoke test
[ https://issues.apache.org/jira/browse/FLINK-23672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-23672: --- Assignee: Evans Ye > Add smoke-e2e-java for Java SDK smoke test > -- > > Key: FLINK-23672 > URL: https://issues.apache.org/jira/browse/FLINK-23672 > Project: Flink > Issue Type: Sub-task > Components: Stateful Functions, Tests >Reporter: Evans Ye >Assignee: Evans Ye >Priority: Major > Labels: pull-request-available > Fix For: statefun-3.1.0 > > > This JIRA adds a module smoke-e2e-java which leverages the smoke-e2e-common > testing framework to test against the Java remote function SDK. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-22246) when use HiveCatalog create table , can't set Table owner property correctly
[
https://issues.apache.org/jira/browse/FLINK-22246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395045#comment-17395045
]
Bo Cui commented on FLINK-22246:
[~lirui] Why dont you need real user? authentication requires real user.
> when use HiveCatalog create table , can't set Table owner property correctly
> -
>
> Key: FLINK-22246
> URL: https://issues.apache.org/jira/browse/FLINK-22246
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive
>Affects Versions: 1.11.1, 1.12.0
>Reporter: xiangtao
>Priority: Minor
> Labels: auto-deprioritized-major
>
> when i use HiveCatalog create table in sql-client , i found it can't set
> Hive Table `owner` property correctly. i debug code , i found in
> `HiveCatalog.createTable` method
> {code:java}
> Table hiveTable =
> org.apache.hadoop.hive.ql.metadata.Table.getEmptyTable(
> tablePath.getDatabaseName(), tablePath.getObjectName());
> {code}
>
> this get hiveTable obj , owner field is null . beacuse it set owner through
> {code:java}
> t.setOwner(SessionState.getUserFromAuthenticator());
> {code}
>
> but SessionState is null .
> Fix this bug , we can add one code in HiveCatalog.open method .
> {code:java}
> SessionState.setCurrentSessionState(new SessionState(hiveConf));
> {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [flink] flinkbot edited a comment on pull request #16743: [FLINK-23645][Table SQL / Client] Fix SqlClient doesn't response correctly to Signal.INT
flinkbot edited a comment on pull request #16743: URL: https://github.com/apache/flink/pull/16743#issuecomment-894206516 ## CI report: * f83e553ed323cbea684fb3b727ba10bb1c4c806e Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21694) * 00ba755b7a2f3da9b0cc8008bba352ba078a6d77 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-22246) when use HiveCatalog create table , can't set Table owner property correctly
[
https://issues.apache.org/jira/browse/FLINK-22246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395044#comment-17395044
]
Bo Cui commented on FLINK-22246:
yes, we can use sessionstate. but i wouldn't recommend using it, it's too
heavy.
we just need user information, and I read the Hive code, and the user
information comes from UGIs or parameters in HiveAuthenticationProvider
so i think we can just use UGI or specified parameter. [~luoyuxia]
> when use HiveCatalog create table , can't set Table owner property correctly
> -
>
> Key: FLINK-22246
> URL: https://issues.apache.org/jira/browse/FLINK-22246
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive
>Affects Versions: 1.11.1, 1.12.0
>Reporter: xiangtao
>Priority: Minor
> Labels: auto-deprioritized-major
>
> when i use HiveCatalog create table in sql-client , i found it can't set
> Hive Table `owner` property correctly. i debug code , i found in
> `HiveCatalog.createTable` method
> {code:java}
> Table hiveTable =
> org.apache.hadoop.hive.ql.metadata.Table.getEmptyTable(
> tablePath.getDatabaseName(), tablePath.getObjectName());
> {code}
>
> this get hiveTable obj , owner field is null . beacuse it set owner through
> {code:java}
> t.setOwner(SessionState.getUserFromAuthenticator());
> {code}
>
> but SessionState is null .
> Fix this bug , we can add one code in HiveCatalog.open method .
> {code:java}
> SessionState.setCurrentSessionState(new SessionState(hiveConf));
> {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-13203) [proper fix] Deadlock occurs when requiring exclusive buffer for RemoteInputChannel
[
https://issues.apache.org/jira/browse/FLINK-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-13203:
---
Labels: auto-deprioritized-critical stale-major (was:
auto-deprioritized-critical)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Major but is unassigned and neither itself nor its Sub-Tasks have been updated
for 60 days. I have gone ahead and added a "stale-major" to the issue". If this
ticket is a Major, please either assign yourself or give an update. Afterwards,
please remove the label or in 7 days the issue will be deprioritized.
> [proper fix] Deadlock occurs when requiring exclusive buffer for
> RemoteInputChannel
> ---
>
> Key: FLINK-13203
> URL: https://issues.apache.org/jira/browse/FLINK-13203
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Network
>Affects Versions: 1.9.0
>Reporter: Piotr Nowojski
>Priority: Major
> Labels: auto-deprioritized-critical, stale-major
>
> The issue is during requesting exclusive buffers with a timeout. Since
> currently the number of maximum buffers and the number of required buffers
> are not the same for local buffer pools, there may be cases that the local
> buffer pools of the upstream tasks occupy all the buffers while the
> downstream tasks fail to acquire exclusive buffers to make progress. As for
> 1.9 in https://issues.apache.org/jira/browse/FLINK-12852 deadlock was avoided
> by adding a timeout to try to failover the current execution when the timeout
> occurs and tips users to increase the number of buffers in the exception
> message.
> In the discussion under the https://issues.apache.org/jira/browse/FLINK-12852
> there were numerous proper solutions discussed and as for now there is no
> consensus how to fix it:
> 1. Only allocate the minimum per producer, which is one buffer per channel.
> This would be needed to keep the requirement similar to what we have at the
> moment, but it is much less than we recommend for the credit-based network
> data exchange (2* channels + floating)
> 2a. Coordinate the deployment sink-to-source such that receivers always have
> their buffers first. This will be complex to implement and coordinate and
> break with many assumptions about tasks being independent (coordination wise)
> on the TaskManagers. Giving that assumption up will be a pretty big step and
> cause lot's of complexity in the future.
> {quote}
> It will also increase deployment delays. Low deployment delays should be a
> design goal in my opinion, as it will enable other features more easily, like
> low-disruption upgrades, etc.
> {quote}
> 2b. Assign extra buffers only once all of the tasks are RUNNING. This is a
> simplified version of 2a, without tracking the tasks sink-to-source.
> 3. Make buffers always revokable, by spilling.
> This is tricky to implement very efficiently, especially because there is the
> logic that slices buffers for early sends for the low-latency streaming stuff
> the spilling request will come from an asynchronous call. That will probably
> stay like that even with the mailbox, because the main thread will be
> frequently blocked on buffer allocation when this request comes.
> 4. We allocate the recommended number for good throughput (2*numChannels +
> floating) per consumer and per producer.
> No dynamic rebalancing any more. This would increase the number of required
> network buffers in certain high-parallelism scenarios quite a bit with the
> default config. Users can down-configure this by setting the per-channel
> buffers lower. But it would break user setups and require them to adjust the
> config when upgrading.
> 5. We make the network resource per slot and ask the scheduler to attach
> information about how many producers and how many consumers will be in the
> slot, worst case. We use that to pre-compute how many excess buffers the
> producers may take.
> This will also break with some assumptions and lead us to the point that we
> have to pre-compute network buffers in the same way as managed memory. Seeing
> how much pain it is with the managed memory, this seems not so great.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-22059) add a new option is rocksdb statebackend to enable job threads setting
[ https://issues.apache.org/jira/browse/FLINK-22059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-22059: --- Labels: auto-deprioritized-major auto-unassigned stale-assigned (was: auto-deprioritized-major auto-unassigned) I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see this issue is assigned but has not received an update in 30 days, so it has been labeled "stale-assigned". If you are still working on the issue, please remove the label and add a comment updating the community on your progress. If this issue is waiting on feedback, please consider this a reminder to the committer/reviewer. Flink is a very active project, and so we appreciate your patience. If you are no longer working on the issue, please unassign yourself so someone else may work on it. > add a new option is rocksdb statebackend to enable job threads setting > -- > > Key: FLINK-22059 > URL: https://issues.apache.org/jira/browse/FLINK-22059 > Project: Flink > Issue Type: Improvement > Components: Runtime / State Backends >Affects Versions: 1.12.2 >Reporter: xiaogang zhou >Assignee: xiaogang zhou >Priority: Minor > Labels: auto-deprioritized-major, auto-unassigned, stale-assigned > Fix For: 1.14.0 > > > As discussed in FLINK-21688 , now we are using the setIncreaseParallelism > function to set the number of rocksdb's working threads. > > can we enable another setting key to set the rocksdb's max backgroud jobs > which will set a large flush thread number. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-9925) ClientTest.testSimpleRequests fails on Travis
[
https://issues.apache.org/jira/browse/FLINK-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-9925:
--
Labels: stale-critical test-stability (was: test-stability)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help
the community manage its development. I see this issues has been marked as
Critical but is unassigned and neither itself nor its Sub-Tasks have been
updated for 14 days. I have gone ahead and marked it "stale-critical". If this
ticket is critical, please either assign yourself or give an update.
Afterwards, please remove the label or in 7 days the issue will be
deprioritized.
> ClientTest.testSimpleRequests fails on Travis
> -
>
> Key: FLINK-9925
> URL: https://issues.apache.org/jira/browse/FLINK-9925
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Queryable State, Tests
>Affects Versions: 1.7.0
>Reporter: Till Rohrmann
>Priority: Critical
> Labels: stale-critical, test-stability
>
> {{ClientTest.testSimpleRequests}} fails on Travis with an {{AssertionError}}:
> https://api.travis-ci.org/v3/job/405690023/log.txt
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [flink] AHeise commented on a change in pull request #15304: [FLINK-20731][connector] Introduce Pulsar Source
AHeise commented on a change in pull request #15304:
URL: https://github.com/apache/flink/pull/15304#discussion_r684403885
##
File path:
flink-connectors/flink-connector-pulsar/src/main/java/org/apache/flink/connector/pulsar/source/enumerator/topic/TopicMetadata.java
##
@@ -0,0 +1,55 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.connector.pulsar.source.enumerator.topic;
+
+import static
org.apache.pulsar.common.partition.PartitionedTopicMetadata.NON_PARTITIONED;
+
+/** The pojo class for pulsar topic metadata information. */
+public final class TopicMetadata {
+
+/**
+ * The name of the topic, it would be a {@link
TopicNameUtils#topicName(String)} which don't
+ * contains partition information.
+ */
+private final String name;
+
+/** If this topic is a partitioned topic. */
+private final boolean partitioned;
+
+/** The size for a partitioned topic. It would be zero for non-partitioned
topic. */
+private final int partitionSize;
+
+public TopicMetadata(String name, int partitionSize) {
+this.name = name;
+this.partitioned = partitionSize != NON_PARTITIONED;
Review comment:
I'd keep this POJO dumb and pass all 3 field values as ctor parameters.
Then you only need the logic part `partitionSize != NON_PARTITIONED` in
`createTopicPartitions`. Remember that this is public API and users want to
test their custom `RangeGenerator` by creating instances of this class.
##
File path:
flink-connectors/flink-connector-pulsar/src/main/java/org/apache/flink/connector/pulsar/source/enumerator/topic/TopicMetadata.java
##
@@ -0,0 +1,55 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.connector.pulsar.source.enumerator.topic;
+
+import static
org.apache.pulsar.common.partition.PartitionedTopicMetadata.NON_PARTITIONED;
+
+/** The pojo class for pulsar topic metadata information. */
+public final class TopicMetadata {
Review comment:
Add `@PublicEvolving` as its part of the `RangeGenerator`.
##
File path:
flink-connectors/flink-connector-pulsar/src/main/java/org/apache/flink/connector/pulsar/common/utils/PulsarClosingUtils.java
##
@@ -0,0 +1,92 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.connector.pulsar.common.utils;
+
+import
org.apache.flink.connector.pulsar.common.exception.PulsarClosingException;
+import org.apache.flink.util.function.ThrowingRunnable;
+
+import java.util.Optional;
+import java.util.concurrent.TimeoutException;
+import java.util.concurrent.atomic.AtomicReference;
+
+/** A util class to help
[GitHub] [flink] flinkbot edited a comment on pull request #16620: [FLINK-23246][table-planner] Refactor the time indicator materialization
flinkbot edited a comment on pull request #16620: URL: https://github.com/apache/flink/pull/16620#issuecomment-888120908 ## CI report: * 12c0dbb7a1359053f4804910f58f06434e542dad UNKNOWN * 9855605eb69ba78b8fc5b7bb02f0529221c9521e Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21706) Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21592) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] pnowojski commented on a change in pull request #16726: FLINK-23454 The upstream sends the buffer of the right size for unicast case
pnowojski commented on a change in pull request #16726:
URL: https://github.com/apache/flink/pull/16726#discussion_r684452732
##
File path:
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartition.java
##
@@ -450,6 +454,16 @@ public int getNumberOfQueuedBuffers() {
}
}
+@Override
+public void bufferSize(int desirableNewBufferSize) {
+if (desirableNewBufferSize < 0) {
+return;
+}
Review comment:
Why ignore negative numbers? Should we throw `IllegalArgumentException`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16669: [FLINK-23544][table-planner]Window TVF Supports session window
flinkbot edited a comment on pull request #16669: URL: https://github.com/apache/flink/pull/16669#issuecomment-890847741 ## CI report: * 889dfbb1b28097728eea054580fa4e0e6bb61c22 UNKNOWN * 26a9f1ad70ba1a7f1231bdc8cd8b62fef6510472 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21707) Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21689) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-23672) Add smoke-e2e-java for Java SDK smoke test
[ https://issues.apache.org/jira/browse/FLINK-23672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-23672: --- Labels: pull-request-available (was: ) > Add smoke-e2e-java for Java SDK smoke test > -- > > Key: FLINK-23672 > URL: https://issues.apache.org/jira/browse/FLINK-23672 > Project: Flink > Issue Type: Sub-task > Components: Stateful Functions, Tests >Reporter: Evans Ye >Priority: Major > Labels: pull-request-available > Fix For: statefun-3.1.0 > > > This JIRA adds a module smoke-e2e-java which leverages the smoke-e2e-common > testing framework to test against the Java remote function SDK. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink-statefun] evans-ye opened a new pull request #248: [FLINK-23672] Add smoke-e2e-java for Java SDK smoke test
evans-ye opened a new pull request #248: URL: https://github.com/apache/flink-statefun/pull/248 WIP. I'll add more description here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Issue Comment Deleted] (FLINK-22902) Port KafkaSink to FLIP-143
[ https://issues.apache.org/jira/browse/FLINK-22902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-22902: Comment: was deleted (was: Merged into master as 801dd688789921277b0a03d76b7cc707dc1010f0..8719481c3b44dd72504874a9d595aa03656704c7) > Port KafkaSink to FLIP-143 > -- > > Key: FLINK-22902 > URL: https://issues.apache.org/jira/browse/FLINK-22902 > Project: Flink > Issue Type: Improvement > Components: Connectors / Kafka >Affects Versions: 1.14.0 >Reporter: Arvid Heise >Assignee: Fabian Paul >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0 > > > As one of the most commonly connectors, Kafka sink should be ported to the > new interfaces as quickly as possible such that Flink would support batch > queries on Kafka. > The implementation should probably follow the current implementation as close > as possible. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-23124) Implement exactly-once Kafka Sink
[ https://issues.apache.org/jira/browse/FLINK-23124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394937#comment-17394937 ] Arvid Heise commented on FLINK-23124: - Merged into master as 801dd688789921277b0a03d76b7cc707dc1010f0..8719481c3b44dd72504874a9d595aa03656704c7 > Implement exactly-once Kafka Sink > - > > Key: FLINK-23124 > URL: https://issues.apache.org/jira/browse/FLINK-23124 > Project: Flink > Issue Type: Sub-task > Components: Connectors / Kafka >Reporter: Fabian Paul >Assignee: Fabian Paul >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (FLINK-23124) Implement exactly-once Kafka Sink
[ https://issues.apache.org/jira/browse/FLINK-23124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-23124. - Fix Version/s: 1.14.0 Resolution: Fixed > Implement exactly-once Kafka Sink > - > > Key: FLINK-23124 > URL: https://issues.apache.org/jira/browse/FLINK-23124 > Project: Flink > Issue Type: Sub-task > Components: Connectors / Kafka >Reporter: Fabian Paul >Assignee: Fabian Paul >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (FLINK-23123) Implement at-least-once Kafka Sink
[ https://issues.apache.org/jira/browse/FLINK-23123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-23123. - Fix Version/s: 1.14.0 Resolution: Fixed > Implement at-least-once Kafka Sink > -- > > Key: FLINK-23123 > URL: https://issues.apache.org/jira/browse/FLINK-23123 > Project: Flink > Issue Type: Sub-task > Components: Connectors / Kafka >Reporter: Fabian Paul >Assignee: Fabian Paul >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Reopened] (FLINK-22902) Port KafkaSink to FLIP-143
[ https://issues.apache.org/jira/browse/FLINK-22902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reopened FLINK-22902: - > Port KafkaSink to FLIP-143 > -- > > Key: FLINK-22902 > URL: https://issues.apache.org/jira/browse/FLINK-22902 > Project: Flink > Issue Type: Improvement > Components: Connectors / Kafka >Affects Versions: 1.14.0 >Reporter: Arvid Heise >Assignee: Fabian Paul >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0 > > > As one of the most commonly connectors, Kafka sink should be ported to the > new interfaces as quickly as possible such that Flink would support batch > queries on Kafka. > The implementation should probably follow the current implementation as close > as possible. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-22902) Port KafkaSink to FLIP-143
[ https://issues.apache.org/jira/browse/FLINK-22902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-22902: Release Note: KafkaSink supersedes FlinkKafkaProducer and provides efficient exactly-once and at-least-once writing with the new unified sink interface supporting both batch and streaming mode of DataStream API. > Port KafkaSink to FLIP-143 > -- > > Key: FLINK-22902 > URL: https://issues.apache.org/jira/browse/FLINK-22902 > Project: Flink > Issue Type: Improvement > Components: Connectors / Kafka >Affects Versions: 1.14.0 >Reporter: Arvid Heise >Assignee: Fabian Paul >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0 > > > As one of the most commonly connectors, Kafka sink should be ported to the > new interfaces as quickly as possible such that Flink would support batch > queries on Kafka. > The implementation should probably follow the current implementation as close > as possible. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-22902) Port KafkaSink to FLIP-143
[ https://issues.apache.org/jira/browse/FLINK-22902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-22902: Affects Version/s: 1.14.0 > Port KafkaSink to FLIP-143 > -- > > Key: FLINK-22902 > URL: https://issues.apache.org/jira/browse/FLINK-22902 > Project: Flink > Issue Type: Improvement > Components: Connectors / Kafka >Affects Versions: 1.14.0 >Reporter: Arvid Heise >Assignee: Fabian Paul >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0 > > > As one of the most commonly connectors, Kafka sink should be ported to the > new interfaces as quickly as possible such that Flink would support batch > queries on Kafka. > The implementation should probably follow the current implementation as close > as possible. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (FLINK-22902) Port KafkaSink to FLIP-143
[ https://issues.apache.org/jira/browse/FLINK-22902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-22902. - Resolution: Fixed Merged into master as 801dd688789921277b0a03d76b7cc707dc1010f0..8719481c3b44dd72504874a9d595aa03656704c7 > Port KafkaSink to FLIP-143 > -- > > Key: FLINK-22902 > URL: https://issues.apache.org/jira/browse/FLINK-22902 > Project: Flink > Issue Type: Improvement > Components: Connectors / Kafka >Reporter: Arvid Heise >Assignee: Fabian Paul >Priority: Major > Labels: pull-request-available > Fix For: 1.14.0 > > > As one of the most commonly connectors, Kafka sink should be ported to the > new interfaces as quickly as possible such that Flink would support batch > queries on Kafka. > The implementation should probably follow the current implementation as close > as possible. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] AHeise merged pull request #16676: [FLINK-22902] Port KafkaSink to FLIP-143
AHeise merged pull request #16676: URL: https://github.com/apache/flink/pull/16676 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16742: [FLINK-23626] [Runtime / Metrics] Migrate all TaskMG instantiations to factory method
flinkbot edited a comment on pull request #16742: URL: https://github.com/apache/flink/pull/16742#issuecomment-894189043 ## CI report: * ed944abc48852ceb98a1dffee986692654b7b0df Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21704) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16720: [FLINK-23507] Use IP address of a kubernetes node when constructing node port connection string for the REST gateway.
flinkbot edited a comment on pull request #16720: URL: https://github.com/apache/flink/pull/16720#issuecomment-893298023 ## CI report: * 6637de3fb6b7ef24959c396d6db5dfed8ebb8551 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21703) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16637: [FLINK-23189][checkpoint]Count and fail the task when the disk is error on JobManager
flinkbot edited a comment on pull request #16637: URL: https://github.com/apache/flink/pull/16637#issuecomment-889099584 ## CI report: * eb8c1b59b1fe328cfefc51c1204ced5202ad4448 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21702) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16590: [FLINK-19554][connector/testing-framework] Connector Testing Framework
flinkbot edited a comment on pull request #16590: URL: https://github.com/apache/flink/pull/16590#issuecomment-886445550 ## CI report: * 8ba223523eb708232b5fe86eb162fb1f36e85ffc Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21709) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (FLINK-23672) Add smoke-e2e-java for Java SDK smoke test
Evans Ye created FLINK-23672: Summary: Add smoke-e2e-java for Java SDK smoke test Key: FLINK-23672 URL: https://issues.apache.org/jira/browse/FLINK-23672 Project: Flink Issue Type: Sub-task Components: Stateful Functions, Tests Reporter: Evans Ye Fix For: statefun-3.1.0 This JIRA adds a module smoke-e2e-java which leverages the smoke-e2e-common testing framework to test against the Java remote function SDK. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] flinkbot edited a comment on pull request #16700: [FLINK-22606][hive] Simplify the usage of SessionState
flinkbot edited a comment on pull request #16700: URL: https://github.com/apache/flink/pull/16700#issuecomment-892453171 ## CI report: * a7302fab5aa4ec1eae859d9e4542516799d05b6a Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21693) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16676: [FLINK-22902] Port KafkaSink to FLIP-143
flinkbot edited a comment on pull request #16676: URL: https://github.com/apache/flink/pull/16676#issuecomment-890987522 ## CI report: * 0fd6c57783b7dee619945551d94490442b77af0a UNKNOWN * 5f636910791eb5ddaa6b9b210c3a4b3230fc60bd UNKNOWN * 96995fe1f26d7a08e91308409d2c66ec32ec8819 UNKNOWN * 483a1a6e982e43b538f13152d41b71144143e444 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21701) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16590: [FLINK-19554][connector/testing-framework] Connector Testing Framework
flinkbot edited a comment on pull request #16590: URL: https://github.com/apache/flink/pull/16590#issuecomment-886445550 ## CI report: * 027d4ab260b3914c6847704641229f13686e7ffe Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=20948) * 8ba223523eb708232b5fe86eb162fb1f36e85ffc UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-23451) FLIP-183: Dynamic buffer size adjustment (Buffer debloat)
[ https://issues.apache.org/jira/browse/FLINK-23451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-23451: --- Component/s: Runtime / Network > FLIP-183: Dynamic buffer size adjustment (Buffer debloat) > - > > Key: FLINK-23451 > URL: https://issues.apache.org/jira/browse/FLINK-23451 > Project: Flink > Issue Type: New Feature > Components: Runtime / Network >Reporter: Anton Kalashnikov >Priority: Major > > Umbrella ticket for > https://cwiki.apache.org/confluence/display/FLINK/FLIP-183%3A+Dynamic+buffer+size+adjustment -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] flinkbot edited a comment on pull request #16368: ignore
flinkbot edited a comment on pull request #16368: URL: https://github.com/apache/flink/pull/16368#issuecomment-873854539 ## CI report: * d79db15ab05c86dcd82fe88dc7247fd413f5c0bf UNKNOWN * adf2f29416eaf6f819cbb2a7944ecec4c1be0eb2 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21698) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16599: [FLINK-23479][table-planner] Fix the unstable test cases about json plan
flinkbot edited a comment on pull request #16599: URL: https://github.com/apache/flink/pull/16599#issuecomment-886750468 ## CI report: * b3e7026169e39a12c7fe8629a358cd3bf66a7153 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21700) Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21565) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-23459) New metrics for dynamic buffer size
[ https://issues.apache.org/jira/browse/FLINK-23459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-23459: --- Component/s: Runtime / Network Runtime / Metrics > New metrics for dynamic buffer size > --- > > Key: FLINK-23459 > URL: https://issues.apache.org/jira/browse/FLINK-23459 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Metrics, Runtime / Network >Reporter: Anton Kalashnikov >Assignee: Piotr Nowojski >Priority: Major > Fix For: 1.14.0 > > > The following metrics can be added: > * The total size of buffered in-flight data (both detailed per gate + sum > per subtask) > * Total estimated time to process the data (both detailed per gate + max per > subtask) > * Actual value of the calculated dynamic buffer size (only detailed per gate) > All of those metrics should be exposed only on the input side, taking into > account only input in-flight data. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-23451) FLIP-183: Dynamic buffer size adjustment (Buffer debloat)
[ https://issues.apache.org/jira/browse/FLINK-23451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-23451: --- Fix Version/s: 1.14.0 > FLIP-183: Dynamic buffer size adjustment (Buffer debloat) > - > > Key: FLINK-23451 > URL: https://issues.apache.org/jira/browse/FLINK-23451 > Project: Flink > Issue Type: New Feature > Components: Runtime / Network >Reporter: Anton Kalashnikov >Priority: Major > Fix For: 1.14.0 > > > Umbrella ticket for > https://cwiki.apache.org/confluence/display/FLINK/FLIP-183%3A+Dynamic+buffer+size+adjustment -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (FLINK-23459) New metrics for dynamic buffer size
[ https://issues.apache.org/jira/browse/FLINK-23459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-23459. -- Fix Version/s: 1.14.0 Resolution: Fixed Scoped was narrowed down to not present detailed per gate metrics, as currently debloating works on the task level, not input gate level. merged to master as 128eb92d43f > New metrics for dynamic buffer size > --- > > Key: FLINK-23459 > URL: https://issues.apache.org/jira/browse/FLINK-23459 > Project: Flink > Issue Type: Sub-task >Reporter: Anton Kalashnikov >Assignee: Piotr Nowojski >Priority: Major > Fix For: 1.14.0 > > > The following metrics can be added: > * The total size of buffered in-flight data (both detailed per gate + sum > per subtask) > * Total estimated time to process the data (both detailed per gate + max per > subtask) > * Actual value of the calculated dynamic buffer size (only detailed per gate) > All of those metrics should be exposed only on the input side, taking into > account only input in-flight data. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-23556) SQLClientSchemaRegistryITCase fails with " Subject ... not found"
[
https://issues.apache.org/jira/browse/FLINK-23556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394886#comment-17394886
]
Piotr Nowojski commented on FLINK-23556:
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=21671=logs=c88eea3b-64a0-564d-0031-9fdcd7b8abee=070ff179-953e-5bda-71fa-d6599415701c
> SQLClientSchemaRegistryITCase fails with " Subject ... not found"
> -
>
> Key: FLINK-23556
> URL: https://issues.apache.org/jira/browse/FLINK-23556
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Ecosystem
>Affects Versions: 1.14.0
>Reporter: Dawid Wysakowicz
>Priority: Blocker
> Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=21129=logs=91bf6583-3fb2-592f-e4d4-d79d79c3230a=cc5499f8-bdde-5157-0d76-b6528ecd808e=25337
> {code}
> Jul 28 23:37:48 [ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0,
> Time elapsed: 209.44 s <<< FAILURE! - in
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase
> Jul 28 23:37:48 [ERROR]
> testWriting(org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase)
> Time elapsed: 81.146 s <<< ERROR!
> Jul 28 23:37:48
> io.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException:
> Subject 'test-user-behavior-d18d4af2-3830-4620-9993-340c13f50cc2-value' not
> found.; error code: 40401
> Jul 28 23:37:48 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.sendHttpRequest(RestService.java:292)
> Jul 28 23:37:48 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.httpRequest(RestService.java:352)
> Jul 28 23:37:48 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.getAllVersions(RestService.java:769)
> Jul 28 23:37:48 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.getAllVersions(RestService.java:760)
> Jul 28 23:37:48 at
> io.confluent.kafka.schemaregistry.client.CachedSchemaRegistryClient.getAllVersions(CachedSchemaRegistryClient.java:364)
> Jul 28 23:37:48 at
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase.getAllVersions(SQLClientSchemaRegistryITCase.java:230)
> Jul 28 23:37:48 at
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase.testWriting(SQLClientSchemaRegistryITCase.java:195)
> Jul 28 23:37:48 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> Jul 28 23:37:48 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Jul 28 23:37:48 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Jul 28 23:37:48 at java.lang.reflect.Method.invoke(Method.java:498)
> Jul 28 23:37:48 at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> Jul 28 23:37:48 at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Jul 28 23:37:48 at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> Jul 28 23:37:48 at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Jul 28 23:37:48 at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
> Jul 28 23:37:48 at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
> Jul 28 23:37:48 at
> java.util.concurrent.FutureTask.run(FutureTask.java:266)
> Jul 28 23:37:48 at java.lang.Thread.run(Thread.java:748)
> Jul 28 23:37:48
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (FLINK-21004) test_process_mode_boot.py test hangs
[
https://issues.apache.org/jira/browse/FLINK-21004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Piotr Nowojski updated FLINK-21004:
---
Priority: Critical (was: Minor)
> test_process_mode_boot.py test hangs
>
>
> Key: FLINK-21004
> URL: https://issues.apache.org/jira/browse/FLINK-21004
> Project: Flink
> Issue Type: Bug
> Components: API / Python
>Affects Versions: 1.13.0
>Reporter: Huang Xingbo
>Priority: Critical
> Labels: auto-deprioritized-major, test-stability
> Fix For: 1.14.0
>
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=12159=logs=821b528f-1eed-5598-a3b4-7f748b13f261=4fad9527-b9a5-5015-1b70-8356e5c91490]
> {code:java}
> 2021-01-18T00:55:48.3027307Z
> pyflink/fn_execution/tests/test_process_mode_boot.py
> ==
> 2021-01-18T00:55:48.3028351Z Process produced no output for 900 seconds.
> 2021-01-18T00:55:48.3033084Z
> ==
> 2021-01-18T00:55:48.3033633Z
> ==
> 2021-01-18T00:55:48.3034073Z The following Java processes are running (JPS)
> 2021-01-18T00:55:48.3037261Z
> ==
> 2021-01-18T00:55:48.3180991Z Picked up JAVA_TOOL_OPTIONS:
> -XX:+HeapDumpOnOutOfMemoryError
> 2021-01-18T00:55:48.4930672Z 18493 Jps
> 2021-01-18T00:55:48.4931189Z 12477 PythonGatewayServer
> 2021-01-18T00:55:48.4979543Z
> ==
> 2021-01-18T00:55:48.4984759Z Printing stack trace of Java process 18493
> 2021-01-18T00:55:48.4987182Z
> ==
> 2021-01-18T00:55:48.5025804Z Picked up JAVA_TOOL_OPTIONS:
> -XX:+HeapDumpOnOutOfMemoryError
> 2021-01-18T00:55:48.5943552Z 18493: No such process
> 2021-01-18T00:55:48.6089460Z
> ==
> 2021-01-18T00:55:48.6089977Z Printing stack trace of Java process 12477
> 2021-01-18T00:55:48.6094322Z
> ==
> 2021-01-18T00:55:48.6140780Z Picked up JAVA_TOOL_OPTIONS:
> -XX:+HeapDumpOnOutOfMemoryError
> 2021-01-18T00:55:48.9394259Z 2021-01-18 00:55:48
> 2021-01-18T00:55:48.9401959Z Full thread dump OpenJDK 64-Bit Server VM
> (25.275-b01 mixed mode):
> 2021-01-18T00:55:48.9402608Z
> 2021-01-18T00:55:48.9403205Z "Attach Listener" #3327 daemon prio=9 os_prio=0
> tid=0x7f4d9c02c800 nid=0x4864 waiting on condition [0x]
> 2021-01-18T00:55:48.9403817Zjava.lang.Thread.State: RUNNABLE
> 2021-01-18T00:55:48.9404137Z
> 2021-01-18T00:55:48.9404634Z "process reaper" #2273 daemon prio=10 os_prio=0
> tid=0x7f4db809c000 nid=0x3ff9 runnable [0x7f4d7b07]
> 2021-01-18T00:55:48.9405191Zjava.lang.Thread.State: RUNNABLE
> 2021-01-18T00:55:48.9405785Z at
> java.lang.UNIXProcess.waitForProcessExit(Native Method)
> 2021-01-18T00:55:48.9425226Z at
> java.lang.UNIXProcess.lambda$initStreams$3(UNIXProcess.java:289)
> 2021-01-18T00:55:48.9431982Z at
> java.lang.UNIXProcess$$Lambda$1358/33063055.run(Unknown Source)
> 2021-01-18T00:55:48.9432532Z at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 2021-01-18T00:55:48.9439963Z at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 2021-01-18T00:55:48.9444803Z at java.lang.Thread.run(Thread.java:748)
> 2021-01-18T00:55:48.9445051Z
> 2021-01-18T00:55:48.9452857Z "process reaper" #2033 daemon prio=10 os_prio=0
> tid=0x7f4db8086800 nid=0x3e2a runnable [0x7f4d7b0e2000]
> 2021-01-18T00:55:48.9453377Zjava.lang.Thread.State: RUNNABLE
> 2021-01-18T00:55:48.9453743Z at
> java.lang.UNIXProcess.waitForProcessExit(Native Method)
> 2021-01-18T00:55:48.9454188Z at
> java.lang.UNIXProcess.lambda$initStreams$3(UNIXProcess.java:289)
> 2021-01-18T00:55:48.9454645Z at
> java.lang.UNIXProcess$$Lambda$1358/33063055.run(Unknown Source)
> 2021-01-18T00:55:48.9455136Z at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 2021-01-18T00:55:48.9455669Z at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 2021-01-18T00:55:48.9456119Z at java.lang.Thread.run(Thread.java:748)
> 2021-01-18T00:55:48.9456355Z
> 2021-01-18T00:55:48.9456708Z "process reaper" #1923 daemon prio=10 os_prio=0
> tid=0x7f4d9c005800 nid=0x3cef runnable [0x7f4d7808b000]
> 2021-01-18T00:55:48.9457148Zjava.lang.Thread.State: RUNNABLE
> 2021-01-18T00:55:48.9457484Z at
>
[GitHub] [flink] flinkbot edited a comment on pull request #16708: [FLINK-23192][table] Move connector & format options to consistent packages
flinkbot edited a comment on pull request #16708: URL: https://github.com/apache/flink/pull/16708#issuecomment-892598184 ## CI report: * ce9cb108ffd9e3c16051d24b19a6241dd71cd4b1 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21699) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-23666) Flaky test: SQLClientSchemaRegistryITCase.testWriting
[
https://issues.apache.org/jira/browse/FLINK-23666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Piotr Nowojski updated FLINK-23666:
---
Priority: Critical (was: Major)
> Flaky test: SQLClientSchemaRegistryITCase.testWriting
> -
>
> Key: FLINK-23666
> URL: https://issues.apache.org/jira/browse/FLINK-23666
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Gabor Somogyi
>Priority: Critical
> Fix For: 1.14.0, 1.15.0
>
>
> The test has failed with the following output:
> {code:java}
> 2021-08-05T17:43:36.5582200Z Aug 05 17:43:36
> io.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException:
> Subject 'test-user-behavior-e5e56be2-40cf-421f-b90d-ad988efa0846-value' not
> found.; error code: 40401
> 2021-08-05T17:43:36.5583099Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.sendHttpRequest(RestService.java:292)
> 2021-08-05T17:43:36.5583794Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.httpRequest(RestService.java:352)
> 2021-08-05T17:43:36.5584525Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.getAllVersions(RestService.java:769)
> 2021-08-05T17:43:36.5585227Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.getAllVersions(RestService.java:760)
> 2021-08-05T17:43:36.5585975Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.CachedSchemaRegistryClient.getAllVersions(CachedSchemaRegistryClient.java:364)
> 2021-08-05T17:43:36.5586762Z Aug 05 17:43:36 at
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase.getAllVersions(SQLClientSchemaRegistryITCase.java:230)
> 2021-08-05T17:43:36.5587527Z Aug 05 17:43:36 at
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase.testWriting(SQLClientSchemaRegistryITCase.java:195)
> 2021-08-05T17:43:36.5588182Z Aug 05 17:43:36 at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-08-05T17:43:36.5588781Z Aug 05 17:43:36 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-08-05T17:43:36.5589446Z Aug 05 17:43:36 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-08-05T17:43:36.5590061Z Aug 05 17:43:36 at
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-08-05T17:43:36.5590666Z Aug 05 17:43:36 at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> 2021-08-05T17:43:36.5591520Z Aug 05 17:43:36 at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-08-05T17:43:36.5592192Z Aug 05 17:43:36 at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> 2021-08-05T17:43:36.5592854Z Aug 05 17:43:36 at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-08-05T17:43:36.5593522Z Aug 05 17:43:36 at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
> 2021-08-05T17:43:36.5594231Z Aug 05 17:43:36 at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
> 2021-08-05T17:43:36.5594883Z Aug 05 17:43:36 at
> java.util.concurrent.FutureTask.run(FutureTask.java:266)
> 2021-08-05T17:43:36.5595439Z Aug 05 17:43:36 at
> java.lang.Thread.run(Thread.java:748)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [flink] pnowojski merged pull request #16713: [FLINK-23408][task] Add metrics for buffer debloating
pnowojski merged pull request #16713: URL: https://github.com/apache/flink/pull/16713 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-21004) test_process_mode_boot.py test hangs
[
https://issues.apache.org/jira/browse/FLINK-21004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394892#comment-17394892
]
Piotr Nowojski commented on FLINK-21004:
maybe related as well
https://dev.azure.com/pnowojski/Flink/_build/results?buildId=430=logs=fba17979-6d2e-591d-72f1-97cf42797c11=727942b6-6137-54f7-1ef9-e66e706ea068
> test_process_mode_boot.py test hangs
>
>
> Key: FLINK-21004
> URL: https://issues.apache.org/jira/browse/FLINK-21004
> Project: Flink
> Issue Type: Bug
> Components: API / Python
>Affects Versions: 1.13.0
>Reporter: Huang Xingbo
>Priority: Minor
> Labels: auto-deprioritized-major, test-stability
> Fix For: 1.14.0
>
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=12159=logs=821b528f-1eed-5598-a3b4-7f748b13f261=4fad9527-b9a5-5015-1b70-8356e5c91490]
> {code:java}
> 2021-01-18T00:55:48.3027307Z
> pyflink/fn_execution/tests/test_process_mode_boot.py
> ==
> 2021-01-18T00:55:48.3028351Z Process produced no output for 900 seconds.
> 2021-01-18T00:55:48.3033084Z
> ==
> 2021-01-18T00:55:48.3033633Z
> ==
> 2021-01-18T00:55:48.3034073Z The following Java processes are running (JPS)
> 2021-01-18T00:55:48.3037261Z
> ==
> 2021-01-18T00:55:48.3180991Z Picked up JAVA_TOOL_OPTIONS:
> -XX:+HeapDumpOnOutOfMemoryError
> 2021-01-18T00:55:48.4930672Z 18493 Jps
> 2021-01-18T00:55:48.4931189Z 12477 PythonGatewayServer
> 2021-01-18T00:55:48.4979543Z
> ==
> 2021-01-18T00:55:48.4984759Z Printing stack trace of Java process 18493
> 2021-01-18T00:55:48.4987182Z
> ==
> 2021-01-18T00:55:48.5025804Z Picked up JAVA_TOOL_OPTIONS:
> -XX:+HeapDumpOnOutOfMemoryError
> 2021-01-18T00:55:48.5943552Z 18493: No such process
> 2021-01-18T00:55:48.6089460Z
> ==
> 2021-01-18T00:55:48.6089977Z Printing stack trace of Java process 12477
> 2021-01-18T00:55:48.6094322Z
> ==
> 2021-01-18T00:55:48.6140780Z Picked up JAVA_TOOL_OPTIONS:
> -XX:+HeapDumpOnOutOfMemoryError
> 2021-01-18T00:55:48.9394259Z 2021-01-18 00:55:48
> 2021-01-18T00:55:48.9401959Z Full thread dump OpenJDK 64-Bit Server VM
> (25.275-b01 mixed mode):
> 2021-01-18T00:55:48.9402608Z
> 2021-01-18T00:55:48.9403205Z "Attach Listener" #3327 daemon prio=9 os_prio=0
> tid=0x7f4d9c02c800 nid=0x4864 waiting on condition [0x]
> 2021-01-18T00:55:48.9403817Zjava.lang.Thread.State: RUNNABLE
> 2021-01-18T00:55:48.9404137Z
> 2021-01-18T00:55:48.9404634Z "process reaper" #2273 daemon prio=10 os_prio=0
> tid=0x7f4db809c000 nid=0x3ff9 runnable [0x7f4d7b07]
> 2021-01-18T00:55:48.9405191Zjava.lang.Thread.State: RUNNABLE
> 2021-01-18T00:55:48.9405785Z at
> java.lang.UNIXProcess.waitForProcessExit(Native Method)
> 2021-01-18T00:55:48.9425226Z at
> java.lang.UNIXProcess.lambda$initStreams$3(UNIXProcess.java:289)
> 2021-01-18T00:55:48.9431982Z at
> java.lang.UNIXProcess$$Lambda$1358/33063055.run(Unknown Source)
> 2021-01-18T00:55:48.9432532Z at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 2021-01-18T00:55:48.9439963Z at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 2021-01-18T00:55:48.9444803Z at java.lang.Thread.run(Thread.java:748)
> 2021-01-18T00:55:48.9445051Z
> 2021-01-18T00:55:48.9452857Z "process reaper" #2033 daemon prio=10 os_prio=0
> tid=0x7f4db8086800 nid=0x3e2a runnable [0x7f4d7b0e2000]
> 2021-01-18T00:55:48.9453377Zjava.lang.Thread.State: RUNNABLE
> 2021-01-18T00:55:48.9453743Z at
> java.lang.UNIXProcess.waitForProcessExit(Native Method)
> 2021-01-18T00:55:48.9454188Z at
> java.lang.UNIXProcess.lambda$initStreams$3(UNIXProcess.java:289)
> 2021-01-18T00:55:48.9454645Z at
> java.lang.UNIXProcess$$Lambda$1358/33063055.run(Unknown Source)
> 2021-01-18T00:55:48.9455136Z at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 2021-01-18T00:55:48.9455669Z at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 2021-01-18T00:55:48.9456119Z at java.lang.Thread.run(Thread.java:748)
> 2021-01-18T00:55:48.9456355Z
> 2021-01-18T00:55:48.9456708Z "process reaper" #1923 daemon prio=10 os_prio=0
>
[jira] [Commented] (FLINK-23666) Flaky test: SQLClientSchemaRegistryITCase.testWriting
[
https://issues.apache.org/jira/browse/FLINK-23666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394885#comment-17394885
]
Piotr Nowojski commented on FLINK-23666:
another instance
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=21671=logs=c88eea3b-64a0-564d-0031-9fdcd7b8abee=070ff179-953e-5bda-71fa-d6599415701c
> Flaky test: SQLClientSchemaRegistryITCase.testWriting
> -
>
> Key: FLINK-23666
> URL: https://issues.apache.org/jira/browse/FLINK-23666
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Gabor Somogyi
>Priority: Major
> Fix For: 1.14.0, 1.15.0
>
>
> The test has failed with the following output:
> {code:java}
> 2021-08-05T17:43:36.5582200Z Aug 05 17:43:36
> io.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException:
> Subject 'test-user-behavior-e5e56be2-40cf-421f-b90d-ad988efa0846-value' not
> found.; error code: 40401
> 2021-08-05T17:43:36.5583099Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.sendHttpRequest(RestService.java:292)
> 2021-08-05T17:43:36.5583794Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.httpRequest(RestService.java:352)
> 2021-08-05T17:43:36.5584525Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.getAllVersions(RestService.java:769)
> 2021-08-05T17:43:36.5585227Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.getAllVersions(RestService.java:760)
> 2021-08-05T17:43:36.5585975Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.CachedSchemaRegistryClient.getAllVersions(CachedSchemaRegistryClient.java:364)
> 2021-08-05T17:43:36.5586762Z Aug 05 17:43:36 at
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase.getAllVersions(SQLClientSchemaRegistryITCase.java:230)
> 2021-08-05T17:43:36.5587527Z Aug 05 17:43:36 at
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase.testWriting(SQLClientSchemaRegistryITCase.java:195)
> 2021-08-05T17:43:36.5588182Z Aug 05 17:43:36 at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-08-05T17:43:36.5588781Z Aug 05 17:43:36 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-08-05T17:43:36.5589446Z Aug 05 17:43:36 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-08-05T17:43:36.5590061Z Aug 05 17:43:36 at
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-08-05T17:43:36.5590666Z Aug 05 17:43:36 at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> 2021-08-05T17:43:36.5591520Z Aug 05 17:43:36 at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-08-05T17:43:36.5592192Z Aug 05 17:43:36 at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> 2021-08-05T17:43:36.5592854Z Aug 05 17:43:36 at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-08-05T17:43:36.5593522Z Aug 05 17:43:36 at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
> 2021-08-05T17:43:36.5594231Z Aug 05 17:43:36 at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
> 2021-08-05T17:43:36.5594883Z Aug 05 17:43:36 at
> java.util.concurrent.FutureTask.run(FutureTask.java:266)
> 2021-08-05T17:43:36.5595439Z Aug 05 17:43:36 at
> java.lang.Thread.run(Thread.java:748)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Closed] (FLINK-23666) Flaky test: SQLClientSchemaRegistryITCase.testWriting
[
https://issues.apache.org/jira/browse/FLINK-23666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Piotr Nowojski closed FLINK-23666.
--
Resolution: Duplicate
> Flaky test: SQLClientSchemaRegistryITCase.testWriting
> -
>
> Key: FLINK-23666
> URL: https://issues.apache.org/jira/browse/FLINK-23666
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Gabor Somogyi
>Priority: Critical
> Fix For: 1.14.0, 1.15.0
>
>
> The test has failed with the following output:
> {code:java}
> 2021-08-05T17:43:36.5582200Z Aug 05 17:43:36
> io.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException:
> Subject 'test-user-behavior-e5e56be2-40cf-421f-b90d-ad988efa0846-value' not
> found.; error code: 40401
> 2021-08-05T17:43:36.5583099Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.sendHttpRequest(RestService.java:292)
> 2021-08-05T17:43:36.5583794Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.httpRequest(RestService.java:352)
> 2021-08-05T17:43:36.5584525Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.getAllVersions(RestService.java:769)
> 2021-08-05T17:43:36.5585227Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.rest.RestService.getAllVersions(RestService.java:760)
> 2021-08-05T17:43:36.5585975Z Aug 05 17:43:36 at
> io.confluent.kafka.schemaregistry.client.CachedSchemaRegistryClient.getAllVersions(CachedSchemaRegistryClient.java:364)
> 2021-08-05T17:43:36.5586762Z Aug 05 17:43:36 at
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase.getAllVersions(SQLClientSchemaRegistryITCase.java:230)
> 2021-08-05T17:43:36.5587527Z Aug 05 17:43:36 at
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase.testWriting(SQLClientSchemaRegistryITCase.java:195)
> 2021-08-05T17:43:36.5588182Z Aug 05 17:43:36 at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-08-05T17:43:36.5588781Z Aug 05 17:43:36 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-08-05T17:43:36.5589446Z Aug 05 17:43:36 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-08-05T17:43:36.5590061Z Aug 05 17:43:36 at
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-08-05T17:43:36.5590666Z Aug 05 17:43:36 at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> 2021-08-05T17:43:36.5591520Z Aug 05 17:43:36 at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-08-05T17:43:36.5592192Z Aug 05 17:43:36 at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> 2021-08-05T17:43:36.5592854Z Aug 05 17:43:36 at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-08-05T17:43:36.5593522Z Aug 05 17:43:36 at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
> 2021-08-05T17:43:36.5594231Z Aug 05 17:43:36 at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
> 2021-08-05T17:43:36.5594883Z Aug 05 17:43:36 at
> java.util.concurrent.FutureTask.run(FutureTask.java:266)
> 2021-08-05T17:43:36.5595439Z Aug 05 17:43:36 at
> java.lang.Thread.run(Thread.java:748)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (FLINK-23560) Performance regression on 29.07.2021
[ https://issues.apache.org/jira/browse/FLINK-23560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-23560: -- Assignee: Anton Kalashnikov (was: Piotr Nowojski) > Performance regression on 29.07.2021 > > > Key: FLINK-23560 > URL: https://issues.apache.org/jira/browse/FLINK-23560 > Project: Flink > Issue Type: Bug > Components: Benchmarks >Affects Versions: 1.14.0 >Reporter: Piotr Nowojski >Assignee: Anton Kalashnikov >Priority: Blocker > Labels: pull-request-available > Fix For: 1.14.0 > > Attachments: Screenshot 2021-07-30 at 15.46.54.png > > > http://codespeed.dak8s.net:8000/timeline/?ben=remoteFilePartition=2 > http://codespeed.dak8s.net:8000/timeline/?ben=uncompressedMmapPartition=2 > http://codespeed.dak8s.net:8000/timeline/?ben=compressedFilePartition=2 > http://codespeed.dak8s.net:8000/timeline/?ben=tupleKeyBy=2 > http://codespeed.dak8s.net:8000/timeline/?ben=arrayKeyBy=2 > http://codespeed.dak8s.net:8000/timeline/?ben=uncompressedFilePartition=2 > http://codespeed.dak8s.net:8000/timeline/?ben=sortedTwoInput=2 > http://codespeed.dak8s.net:8000/timeline/?ben=sortedMultiInput=2 > http://codespeed.dak8s.net:8000/timeline/?ben=globalWindow=2 > (And potentially other benchmarks) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] flinkbot edited a comment on pull request #16620: [FLINK-23246][table-planner] Refactor the time indicator materialization
flinkbot edited a comment on pull request #16620: URL: https://github.com/apache/flink/pull/16620#issuecomment-888120908 ## CI report: * 12c0dbb7a1359053f4804910f58f06434e542dad UNKNOWN * 9855605eb69ba78b8fc5b7bb02f0529221c9521e Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21706) Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21592) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16669: [FLINK-23544][table-planner]Window TVF Supports session window
flinkbot edited a comment on pull request #16669: URL: https://github.com/apache/flink/pull/16669#issuecomment-890847741 ## CI report: * 889dfbb1b28097728eea054580fa4e0e6bb61c22 UNKNOWN * 26a9f1ad70ba1a7f1231bdc8cd8b62fef6510472 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21707) Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21689) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16743: [FLINK-23645][Table SQL / Client] Fix SqlClient doesn't response correctly to Signal.INT
flinkbot edited a comment on pull request #16743: URL: https://github.com/apache/flink/pull/16743#issuecomment-894206516 ## CI report: * f83e553ed323cbea684fb3b727ba10bb1c4c806e Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21694) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16740: [FLINK-23614][table-planner] The resulting scale of TRUNCATE(DECIMAL,…
flinkbot edited a comment on pull request #16740: URL: https://github.com/apache/flink/pull/16740#issuecomment-894176423 ## CI report: * aceb2a25e00797b20ed5e3356f168ea12df0a8de Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21687) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16676: [FLINK-22902] Port KafkaSink to FLIP-143
flinkbot edited a comment on pull request #16676: URL: https://github.com/apache/flink/pull/16676#issuecomment-890987522 ## CI report: * 0fd6c57783b7dee619945551d94490442b77af0a UNKNOWN * 5f636910791eb5ddaa6b9b210c3a4b3230fc60bd UNKNOWN * 96995fe1f26d7a08e91308409d2c66ec32ec8819 UNKNOWN * 2d1d736dc15e4b96b13a917ecfdd9716d8d48be4 Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21692) * 483a1a6e982e43b538f13152d41b71144143e444 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21701) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16669: [FLINK-23544][table-planner]Window TVF Supports session window
flinkbot edited a comment on pull request #16669: URL: https://github.com/apache/flink/pull/16669#issuecomment-890847741 ## CI report: * 889dfbb1b28097728eea054580fa4e0e6bb61c22 UNKNOWN * 26a9f1ad70ba1a7f1231bdc8cd8b62fef6510472 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21689) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21707) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16620: [FLINK-23246][table-planner] Refactor the time indicator materialization
flinkbot edited a comment on pull request #16620: URL: https://github.com/apache/flink/pull/16620#issuecomment-888120908 ## CI report: * 12c0dbb7a1359053f4804910f58f06434e542dad UNKNOWN * 9855605eb69ba78b8fc5b7bb02f0529221c9521e Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21592) Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21706) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] PatrickRen commented on pull request #16551: [FLINK-23255][test] Introduce JUnit 5 dependencies
PatrickRen commented on pull request #16551: URL: https://github.com/apache/flink/pull/16551#issuecomment-894343427 @AHeise Thanks again for the review! I made a rebase to sync with the latest master. I manually ran CI twice in my own AZP project, one with the JUnit 5 dependencies[1] and another without[2]. Number of tests are almost identical to each other (59,186 vs 59,189) only with slight diffs. Missing tests with JUnit5 dependencies: - org.apache.flink.testutils.junit.RetryRuleTest$TestClassWithAnnotation - org.apache.flink.testutils.junit.RetryRuleTest$TestClassWithAnnotationOnMethod - org.apache.flink.testutils.junit.RetryRuleTest$TestClassWithTestExpectingRuntimeException - org.apache.flink.testutils.junit.RetryRuleTest$TestClassWithoutAnnotation - org.apache.flink.test.checkpointing.LocalRecoveryITCase$EventTimeWindowCheckpointingITCaseInstance - org.apache.flink.api.common.typeutils.CompositeSerializerTest$CompositeSerializerTestInstance - org.apache.flink.api.java.typeutils.runtime.AbstractGenericTypeComparatorTest$ComparatorTestInstance - org.apache.flink.api.java.typeutils.runtime.EitherSerializerTest$EitherSerializerTestInstance - org.apache.flink.api.java.typeutils.runtime.LegacyRowSerializerTest$RowSerializerTestInstance - org.apache.flink.api.java.typeutils.runtime.RowSerializerTest$RowSerializerTestInstance Interesting thing is that all these tests are annotated with ```@Ignore```. Not sure why these cases are run in JUnit4. Additional tests with JUnit5 dependencies: - org.apache.flink.test.junit5.JUnitJupiterTest * 6 (Intentionally added for testing Jupiter engine) - org.apache.flink.connector.jdbc.xa.JdbcXaSinkMigrationTest#testCommitFromSnapshot (Not sure why this case is not run in JUnit4) In general, I think all test cases are covered with by vintage engine, and new Jupiter engine is validated by ```JUnitJupiterTest```. [1] With JUnit 5: https://dev.azure.com/renqs/Apache%20Flink/_build/results?buildId=42=ms.vss-test-web.build-test-results-tab [2] Without JUnit 5: https://dev.azure.com/renqs/Apache%20Flink/_build/results?buildId=43=ms.vss-test-web.build-test-results-tab -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Reopened] (FLINK-23560) Performance regression on 29.07.2021
[
https://issues.apache.org/jira/browse/FLINK-23560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Piotr Nowojski reopened FLINK-23560:
The issue in
http://codespeed.dak8s.net:8000/timeline/?ben=sortedTwoInput=2
http://codespeed.dak8s.net:8000/timeline/?ben=sortedMultiInput=2
still persists. It looks like there were two different performance regressions
in the same commit range. Which makes sense, because my and [~akalashnikov]'s
fix for the first regression couldn't explain those {{sortedInput}} benchmarks
as:
# those benchmarks are so slow (2M records/s) and involve spilling to disk,
that any regression around enqueuing mailbox action shouldnt’ be visible
# those benchmarks are using FLIP-27 sources, so no problem with biased locking
as described by [~akalashnikov]
> Performance regression on 29.07.2021
>
>
> Key: FLINK-23560
> URL: https://issues.apache.org/jira/browse/FLINK-23560
> Project: Flink
> Issue Type: Bug
> Components: Benchmarks
>Affects Versions: 1.14.0
>Reporter: Piotr Nowojski
>Assignee: Piotr Nowojski
>Priority: Blocker
> Labels: pull-request-available
> Fix For: 1.14.0
>
> Attachments: Screenshot 2021-07-30 at 15.46.54.png
>
>
> http://codespeed.dak8s.net:8000/timeline/?ben=remoteFilePartition=2
> http://codespeed.dak8s.net:8000/timeline/?ben=uncompressedMmapPartition=2
> http://codespeed.dak8s.net:8000/timeline/?ben=compressedFilePartition=2
> http://codespeed.dak8s.net:8000/timeline/?ben=tupleKeyBy=2
> http://codespeed.dak8s.net:8000/timeline/?ben=arrayKeyBy=2
> http://codespeed.dak8s.net:8000/timeline/?ben=uncompressedFilePartition=2
> http://codespeed.dak8s.net:8000/timeline/?ben=sortedTwoInput=2
> http://codespeed.dak8s.net:8000/timeline/?ben=sortedMultiInput=2
> http://codespeed.dak8s.net:8000/timeline/?ben=globalWindow=2
> (And potentially other benchmarks)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [flink] beyond1920 commented on pull request #16620: [FLINK-23246][table-planner] Refactor the time indicator materialization
beyond1920 commented on pull request #16620: URL: https://github.com/apache/flink/pull/16620#issuecomment-894332563 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] beyond1920 commented on pull request #16669: [FLINK-23544][table-planner]Window TVF Supports session window
beyond1920 commented on pull request #16669: URL: https://github.com/apache/flink/pull/16669#issuecomment-894332189 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-23272) FLIP-181: Custom netty HTTP request inbound/outbound handlers
[ https://issues.apache.org/jira/browse/FLINK-23272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394817#comment-17394817 ] Gabor Somogyi commented on FLINK-23272: --- The handlers has been added in https://github.com/apache/flink/commit/646ff2d36f40704f5dca017b8fffed78bd51b307. Starting to publish the example applications. > FLIP-181: Custom netty HTTP request inbound/outbound handlers > - > > Key: FLINK-23272 > URL: https://issues.apache.org/jira/browse/FLINK-23272 > Project: Flink > Issue Type: Improvement > Components: Runtime / Web Frontend >Affects Versions: 1.13.0 >Reporter: Márton Balassi >Assignee: Gabor Somogyi >Priority: Major > Labels: pull-request-available > > FLIP: > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=184616200 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink] flinkbot edited a comment on pull request #16739: [FLINK-23247][table-planner] Materialize attribute fields of regular join's inputs.
flinkbot edited a comment on pull request #16739: URL: https://github.com/apache/flink/pull/16739#issuecomment-894176378 ## CI report: * 3fc4b86635d6fe45478cda40be9604842b6b9cd5 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21686) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16741: [FLINK-23662][rpc][akka] Port all Scala code to Java
flinkbot edited a comment on pull request #16741: URL: https://github.com/apache/flink/pull/16741#issuecomment-894188972 ## CI report: * 4182d8f3b326218058f9d0a5675b22d7a3e22154 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21690) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16669: [FLINK-23544][table-planner]Window TVF Supports session window
flinkbot edited a comment on pull request #16669: URL: https://github.com/apache/flink/pull/16669#issuecomment-890847741 ## CI report: * 889dfbb1b28097728eea054580fa4e0e6bb61c22 UNKNOWN * 26a9f1ad70ba1a7f1231bdc8cd8b62fef6510472 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21689) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16723: [FLINK-22885][table] Supports 'SHOW COLUMNS' syntax.
flinkbot edited a comment on pull request #16723: URL: https://github.com/apache/flink/pull/16723#issuecomment-893364145 ## CI report: * ec9f0a4246bacb1ace44d2ea93481c3ae904526b Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21685) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16742: [FLINK-23626] [Runtime / Metrics] Migrate all TaskMG instantiations to factory method
flinkbot edited a comment on pull request #16742: URL: https://github.com/apache/flink/pull/16742#issuecomment-894189043 ## CI report: * ee402de0c5b5029a1ee549e0789708856ac6dba4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21691) * ed944abc48852ceb98a1dffee986692654b7b0df Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21704) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16720: [FLINK-23507] Use IP address of a kubernetes node when constructing node port connection string for the REST gateway.
flinkbot edited a comment on pull request #16720: URL: https://github.com/apache/flink/pull/16720#issuecomment-893298023 ## CI report: * 9120cbffaf457c0b5bd7d973c085d28b6cc6be76 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21597) * 6637de3fb6b7ef24959c396d6db5dfed8ebb8551 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21703) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16637: [FLINK-23189][checkpoint]Count and fail the task when the disk is error on JobManager
flinkbot edited a comment on pull request #16637: URL: https://github.com/apache/flink/pull/16637#issuecomment-889099584 ## CI report: * 0fb4be42643b0d2803477ee6e2b3bf4fc4b6ce17 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21680) * eb8c1b59b1fe328cfefc51c1204ced5202ad4448 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21702) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] StephanEwen edited a comment on pull request #16655: [FLINK-23512][runtime][checkpoint] Check for illegal modifications of JobGraph with partially finished operators
StephanEwen edited a comment on pull request #16655: URL: https://github.com/apache/flink/pull/16655#issuecomment-894305960 Thanks for the discussion and digging out the corner cases to check. I was wondering is a very simple rule could actually be good enough here: *You can only change the JobGraph operator chains from a checkpoint if it has no partially finished tasks.* That would be both simple to implement, simple to explain to users, and would prevent all the corner cases we talked about here. The question is: Is it too restrictive, will it make some common case impossible or in-practical? _What use cases to we need to support for changing the JobGraph with finished tasks?_ 1. Rescaling due to lack of resources and in reactive mode. This doesn't change the JobGraph structure, but only the parallelism of operators (including possibly operators that are partially finished). @gaoyunhaii is it guaranteed that this still works? 2. Upgrading an application after "stop-with-savepoint" (maybe "stop-with-checkpoint" in the future). This should be fine, because the final checkpoint should have all tasks finished. @pnowojski Can we double check this is also guaranteed with Unaligned Checkpoints? 3. For application joining some bounded inputs and some unbounded inputs, the application often runs the majority of the time after the bounded input finished. They should still be modifiable then. This should also be fine because in that case the bounded source and the bounded stream sub-flow have only a small time window in which they are partially finished. After that, for they are permanently finished. _What use cases would be not support?_ - Upgrades in the middle of a stopping procedure, which has partially completed. - Upgrades in the small window while a bounded join input has partially completed (see point (3) above). Maybe I am overlooking some important use cases here. But if the above assessment of use cases is correct, this simplification could simplify our code a lot, simplify the understanding for the users, also avoid some unexpected surprises for users. Yun Gao mentioned an interesting case with `reinterpretAsKeyedStream()`. Such cases where users make some non-standard assumptions always exist and confuse the users. It would be more explicit for users if they could not restore their checkpoint with changed JobGraph (re-scaling would still work, though) but would get an explicit error and need to bring the job into stable state again. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] StephanEwen commented on pull request #16655: [FLINK-23512][runtime][checkpoint] Check for illegal modifications of JobGraph with partially finished operators
StephanEwen commented on pull request #16655: URL: https://github.com/apache/flink/pull/16655#issuecomment-894305960 Thanks for the discussion and digging out the corner cases to check. I was wondering is a very simple rule could actually be good enough here: *You can only change the JobGraph operator chains from a checkpoint if it has no partially finished tasks.* That would be both simple to implement, simple to explain to users, and would prevent all the corner cases we talked about here. The question is: Is it too restrictive, will it make some common case impossible or in-practical? _What use cases to we need to support for changing the JobGraph with finished tasks?_ 1. Rescaling due to lack of resources and in reactive mode. This doesn't change the JobGraph structure, but only the parallelism of operators (including possibly operators that are partially finished). @gaoyunhaii is it guaranteed that this still works? 2. Upgrading an application after "stop-with-savepoint" (maybe "stop-with-checkpoint" in the future). This should be fine, because the final checkpoint should have all tasks finished. @pnowojski Can we double check this is also guaranteed with Unaligned Checkpoints? 3. For application joining some bounded inputs and some unbounded inputs, the application often runs the majority of the time after the bounded input finished. They should still be modifiable then. This should also be fine because in that case the bounded source and the bounded stream sub-flow have only a small time window in which they are partially finished. After that, for they are permanently finished. _What use cases would be not support?_ - Upgrades in the middle of a stopping procedure, which has partially completed. - Upgrades in the small window while a bounded join input has partially completed (see point (3) above). Maybe I am overlooking some important use cases here. But if the above is correct, could this really simplify our code and also avoid some unexpected surprises? Yun Gao mentioned an interesting case with `reinterpretAsKeyedStream()`. Such cases where users make some non-standard assumptions always exist and confuse the users. It would be more explicit for users if they could not restore their checkpoint with changed JobGraph (re-scaling would still work, though) but would get an explicit error and need to bring the job into stable state again. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-23671) Failed to inference type in correlate
[
https://issues.apache.org/jira/browse/FLINK-23671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394805#comment-17394805
]
Timo Walther commented on FLINK-23671:
--
How is {{func111}} defined?
> Failed to inference type in correlate
> --
>
> Key: FLINK-23671
> URL: https://issues.apache.org/jira/browse/FLINK-23671
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.13.2
>Reporter: Shengkai Fang
>Priority: Major
>
> {code:java}
> CREATE TABLE side(
> `id2` VARCHAR,
> PRIMARY KEY (`id2`) NOT ENFORCED
> ) WITH (
> 'connector' = 'values'
> );
> !info
> CREATE TABLE main(
> `id` VARCHAR,
> `proctime` as proctime()
> ) WITH (
> 'connector' = 'datagen',
> 'number-of-rows' = '10'
> );
> CREATE TABLE blackhole(
> `id` VARCHAR
> ) WITH (
> 'connector' = 'blackhole'
> );
> INSERT INTO blackhole
> SELECT `id`
> FROM main
> JOIN side FOR SYSTEM_TIME AS OF main.`proctime` ON main.`id` = side.`id2`
> INNER join lateral table(func111(side.`id2`)) as T(`is_match`,
> `match_bizline`, `match_page_id`, `source_type`) ON 1 = 1;
> {code}
> The exception stack as follows.
> {code:java}
> org.apache.flink.table.planner.codegen.CodeGenException: Mismatch of
> function's argument data type 'STRING NOT NULL' and actual argument type
> 'STRING'.
> at
> org.apache.flink.table.planner.codegen.calls.BridgingFunctionGenUtil$$anonfun$verifyArgumentTypes$1.apply(BridgingFunctionGenUtil.scala:323)
> at
> org.apache.flink.table.planner.codegen.calls.BridgingFunctionGenUtil$$anonfun$verifyArgumentTypes$1.apply(BridgingFunctionGenUtil.scala:320)
> at
> scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
> at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
> at
> org.apache.flink.table.planner.codegen.calls.BridgingFunctionGenUtil$.verifyArgumentTypes(BridgingFunctionGenUtil.scala:320)
> at
> org.apache.flink.table.planner.codegen.calls.BridgingFunctionGenUtil$.generateFunctionAwareCallWithDataType(BridgingFunctionGenUtil.scala:95)
> at
> org.apache.flink.table.planner.codegen.calls.BridgingFunctionGenUtil$.generateFunctionAwareCall(BridgingFunctionGenUtil.scala:65)
> at
> org.apache.flink.table.planner.codegen.calls.BridgingSqlFunctionCallGen.generate(BridgingSqlFunctionCallGen.scala:73)
> at
> org.apache.flink.table.planner.codegen.ExprCodeGenerator.generateCallExpression(ExprCodeGenerator.scala:861)
> at
> org.apache.flink.table.planner.codegen.ExprCodeGenerator.visitCall(ExprCodeGenerator.scala:537)
> at
> org.apache.flink.table.planner.codegen.ExprCodeGenerator.visitCall(ExprCodeGenerator.scala:57)
> at org.apache.calcite.rex.RexCall.accept(RexCall.java:174)
> at
> org.apache.flink.table.planner.codegen.ExprCodeGenerator.generateExpression(ExprCodeGenerator.scala:157)
> at
> org.apache.flink.table.planner.codegen.CorrelateCodeGenerator$.generateOperator(CorrelateCodeGenerator.scala:127)
> at
> org.apache.flink.table.planner.codegen.CorrelateCodeGenerator$.generateCorrelateTransformation(CorrelateCodeGenerator.scala:75)
> at
> org.apache.flink.table.planner.codegen.CorrelateCodeGenerator.generateCorrelateTransformation(CorrelateCodeGenerator.scala)
> at
> org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecCorrelate.translateToPlanInternal(CommonExecCorrelate.java:102)
> at
> org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase.translateToPlan(ExecNodeBase.java:210)
> at
> org.apache.flink.table.planner.plan.nodes.exec.ExecEdge.translateToPlan(ExecEdge.java:289)
> at
> org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase.lambda$translateInputToPlan$5(ExecNodeBase.java:244)
>
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [flink] asfgit closed pull request #16463: [FLINK-23272][web] Add custom netty HTTP request inbound/outbound handlers
asfgit closed pull request #16463: URL: https://github.com/apache/flink/pull/16463 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16742: [FLINK-23626] [Runtime / Metrics] Migrate all TaskMG instantiations to factory method
flinkbot edited a comment on pull request #16742: URL: https://github.com/apache/flink/pull/16742#issuecomment-894189043 ## CI report: * ee402de0c5b5029a1ee549e0789708856ac6dba4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21691) * ed944abc48852ceb98a1dffee986692654b7b0df UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16738: [FLINK-23661][build] Fix protobuf plugin proxy issue
flinkbot edited a comment on pull request #16738: URL: https://github.com/apache/flink/pull/16738#issuecomment-894157245 ## CI report: * 858177dbd89b8e3bc062cd629f8d7d0a19f095ab Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21684) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16720: [FLINK-23507] Use IP address of a kubernetes node when constructing node port connection string for the REST gateway.
flinkbot edited a comment on pull request #16720: URL: https://github.com/apache/flink/pull/16720#issuecomment-893298023 ## CI report: * 9120cbffaf457c0b5bd7d973c085d28b6cc6be76 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21597) * 6637de3fb6b7ef24959c396d6db5dfed8ebb8551 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16637: [FLINK-23189][checkpoint]Count and fail the task when the disk is error on JobManager
flinkbot edited a comment on pull request #16637: URL: https://github.com/apache/flink/pull/16637#issuecomment-889099584 ## CI report: * 0fb4be42643b0d2803477ee6e2b3bf4fc4b6ce17 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21680) * eb8c1b59b1fe328cfefc51c1204ced5202ad4448 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Closed] (FLINK-23669) Avoid using Scala >= 2.12.8 in Flink Training exercises
[ https://issues.apache.org/jira/browse/FLINK-23669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber closed FLINK-23669. --- Resolution: Fixed Merged on master via 1704fd959122aa197b48803441338c1fb0470091 > Avoid using Scala >= 2.12.8 in Flink Training exercises > --- > > Key: FLINK-23669 > URL: https://issues.apache.org/jira/browse/FLINK-23669 > Project: Flink > Issue Type: Bug > Components: Documentation / Training / Exercises >Affects Versions: 1.13.2 >Reporter: Nico Kruber >Assignee: Nico Kruber >Priority: Major > Labels: pull-request-available > Fix For: 1.13.3 > > > The current IDE setup instructions of the Flink training exercises do not > mention a specific Scala SDK to set up. For compatibility reasons described > in > https://ci.apache.org/projects/flink/flink-docs-stable/docs/dev/datastream/project-configuration/#scala-versions, > we should also not use 2.12.8 and up. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (FLINK-23667) Fix training exercises IDE setup description for Scala
[ https://issues.apache.org/jira/browse/FLINK-23667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber closed FLINK-23667. --- Resolution: Fixed Merged on master via 08f5bf4d93d241f58d67148dc3e054a2325b64a0 > Fix training exercises IDE setup description for Scala > -- > > Key: FLINK-23667 > URL: https://issues.apache.org/jira/browse/FLINK-23667 > Project: Flink > Issue Type: Bug > Components: Documentation / Training / Exercises >Affects Versions: 1.13.2 >Reporter: Nico Kruber >Assignee: Nico Kruber >Priority: Minor > Labels: pull-request-available > Fix For: 1.13.3 > > > If you follow the training exercises instructions to set up your IDE with > code formatting and the Save Actions plugin while having Scala enabled, it > will completely reformat your Scala code files instead of keeping them as is. > The instructions should be updated to match the ones used for the Flink main > project. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink-training] NicoK merged pull request #32: [FLINK-23669] avoid using Scala >= 2.12.8 when setting up an IDE
NicoK merged pull request #32: URL: https://github.com/apache/flink-training/pull/32 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16735: [FLINK-21090][DRAFT] ITCase for final checkpoints
flinkbot edited a comment on pull request #16735: URL: https://github.com/apache/flink/pull/16735#issuecomment-894143147 ## CI report: * c3ec55e4a4be37e8a50639d575bad085fbc5da0b Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21679) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16734: [FLINK-23408] Waiting for final checkpoint completed before finishing a task
flinkbot edited a comment on pull request #16734: URL: https://github.com/apache/flink/pull/16734#issuecomment-894121432 ## CI report: * cba5a1c22f4e7a9c9214b2c4e5f802efdfca Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21678) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16731: [FLINK-23612][table-runtime] Fix compile exception for ROUND function with some numeric input arguments
flinkbot edited a comment on pull request #16731: URL: https://github.com/apache/flink/pull/16731#issuecomment-893977654 ## CI report: * aac3509302c236a01d2ea8f7b75167a227a2039b Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21677) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16736: [FLINK-23658][metrics][jmx] Cleanup code
flinkbot edited a comment on pull request #16736: URL: https://github.com/apache/flink/pull/16736#issuecomment-894157145 ## CI report: * f8e52dd6e12b808f0bc5b4a7a6e1a42c726bc72a Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21682) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16676: [FLINK-22902] Port KafkaSink to FLIP-143
flinkbot edited a comment on pull request #16676: URL: https://github.com/apache/flink/pull/16676#issuecomment-890987522 ## CI report: * 0fd6c57783b7dee619945551d94490442b77af0a UNKNOWN * 5f636910791eb5ddaa6b9b210c3a4b3230fc60bd UNKNOWN * 055d0fd83c72f141a1bd2d8a4bc0e30bf637687f Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21681) * 96995fe1f26d7a08e91308409d2c66ec32ec8819 UNKNOWN * 2d1d736dc15e4b96b13a917ecfdd9716d8d48be4 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21692) * 483a1a6e982e43b538f13152d41b71144143e444 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21701) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink-training] NicoK merged pull request #33: [FLINK-23667] fix code formatting IDE instructions
NicoK merged pull request #33: URL: https://github.com/apache/flink-training/pull/33 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16637: [FLINK-23189][checkpoint]Count and fail the task when the disk is error on JobManager
flinkbot edited a comment on pull request #16637: URL: https://github.com/apache/flink/pull/16637#issuecomment-889099584 ## CI report: * 0fb4be42643b0d2803477ee6e2b3bf4fc4b6ce17 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21680) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #16599: [FLINK-23479][table-planner] Fix the unstable test cases about json plan
flinkbot edited a comment on pull request #16599: URL: https://github.com/apache/flink/pull/16599#issuecomment-886750468 ## CI report: * b3e7026169e39a12c7fe8629a358cd3bf66a7153 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21700) Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=21565) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run travis` re-run the last Travis build - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-23670) Add Scala formatting checks to training exercises
[ https://issues.apache.org/jira/browse/FLINK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-23670: --- Labels: pull-request-available (was: ) > Add Scala formatting checks to training exercises > - > > Key: FLINK-23670 > URL: https://issues.apache.org/jira/browse/FLINK-23670 > Project: Flink > Issue Type: Bug > Components: Documentation / Training / Exercises >Affects Versions: 1.13.2 >Reporter: Nico Kruber >Assignee: Nico Kruber >Priority: Major > Labels: pull-request-available > Fix For: 1.13.3 > > > Currently, there are no formatting checks for Scala code in the training > exercises. We should employ the same checks that the main Flink project is > using. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [flink-training] NicoK opened a new pull request #34: [FLINK-23670] Add Scala formatting checks to training exercises
NicoK opened a new pull request #34: URL: https://github.com/apache/flink-training/pull/34 This adds the same Scalastyle checks that the main Flink project is using. BEWARE: do not merge as is - the `.git-blame-ignore-revs` file needs to be adapted manually! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
