[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * 1ce5968cac8a461a937b59feae490bb0c840cd4b Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27041) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] snuyanzin commented on pull request #17830: [FLINK-24893][Table SQL/Client][FLIP-189] SQL Client prompts customization
snuyanzin commented on pull request #17830: URL: https://github.com/apache/flink/pull/17830#issuecomment-978922587 @twalthr could you please help to review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-24328) Long term fix for receiving new buffer size before network reader configured
[
https://issues.apache.org/jira/browse/FLINK-24328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Wysakowicz updated FLINK-24328:
-
Fix Version/s: (was: 1.14.1)
> Long term fix for receiving new buffer size before network reader configured
>
>
> Key: FLINK-24328
> URL: https://issues.apache.org/jira/browse/FLINK-24328
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Network
>Affects Versions: 1.14.0
>Reporter: Anton Kalashnikov
>Assignee: Dawid Wysakowicz
>Priority: Critical
> Labels: pull-request-available, stale-assigned
> Fix For: 1.15.0
>
>
> It happened on the big cluster(parallelism = 75, TM=5, task=8) just on the
> initialization moment.
> {noformat}
> 2021-09-09 14:36:42,383 WARN org.apache.flink.runtime.taskmanager.Task
> [] - Map -> Flat Map (71/75)#0
> (7a5b971e0cd57aa5d057a114e2679b03) switched from RUNNING to FAILED with
> failure c
> ause:
> org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException:
> Fatal error at remote task manager
> 'ip-172-31-22-183.eu-central-1.compute.internal/172.31.22.183:42085'.
> at
> org.apache.flink.runtime.io.network.netty.CreditBasedPartitionRequestClientHandler.decodeMsg(CreditBasedPartitionRequestClientHandler.java:339)
> at
> org.apache.flink.runtime.io.network.netty.CreditBasedPartitionRequestClientHandler.channelRead(CreditBasedPartitionRequestClientHandler.java:240)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
> at
> org.apache.flink.runtime.io.network.netty.NettyMessageClientDecoderDelegate.channelRead(NettyMessageClientDecoderDelegate.java:112)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:795)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:480)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
> at
> org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
> at
> org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.IllegalStateException: No reader for receiverId =
> 296559f497c54a82534945f4549b9e2d exists.
> at
> org.apache.flink.runtime.io.network.netty.PartitionRequestQueue.obtainReader(PartitionRequestQueue.java:194)
> at
> org.apache.flink.runtime.io.network.netty.PartitionRequestQueue.notifyNewBufferSize(PartitionRequestQueue.java:188)
> at
> org.apache.flink.runtime.io.network.netty.PartitionRequestServerHandler.channelRead0(PartitionRequestServerHandler.java:134)
> at
> org.apache.flink.runtime.io.network.netty.PartitionRequestServerHandler.channelRead0(PartitionRequestServerHandler.java:42)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
> at
> org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
>
[GitHub] [flink] dawidwys commented on pull request #17701: [FLINK-24294][streaming] Register all stream task resources to one cl…
dawidwys commented on pull request #17701: URL: https://github.com/apache/flink/pull/17701#issuecomment-978921510 @akalash do you think it makes sense to backport it to 1.14.x and 1.13.x? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17900: [FLINK-24803][Table SQL/Planner] Fix cast BINARY/VARBINARY to STRING
flinkbot edited a comment on pull request #17900: URL: https://github.com/apache/flink/pull/17900#issuecomment-978731052 ## CI report: * e40e860c06173302cfdda5a2f136e2d3c474fb68 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27035) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17899: [FLINK-24446][Table SQL/Planner] Casting from STRING to TIMESTAMP_LTZ looses fractional seconds
flinkbot edited a comment on pull request #17899: URL: https://github.com/apache/flink/pull/17899#issuecomment-978728442 ## CI report: * 65f417af302f4173d325f6816a7fd1f912309ea9 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27034) * c9abec78c59f5c1a7823e02baadfc6c8e18a6c06 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27040) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * 1ce5968cac8a461a937b59feae490bb0c840cd4b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17899: [FLINK-24446][Table SQL/Planner] Casting from STRING to TIMESTAMP_LTZ looses fractional seconds
flinkbot edited a comment on pull request #17899: URL: https://github.com/apache/flink/pull/17899#issuecomment-978728442 ## CI report: * 65f417af302f4173d325f6816a7fd1f912309ea9 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27034) * c9abec78c59f5c1a7823e02baadfc6c8e18a6c06 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] dawidwys closed pull request #17701: [FLINK-24294][streaming] Register all stream task resources to one cl…
dawidwys closed pull request #17701: URL: https://github.com/apache/flink/pull/17701 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-24874) Dropdown menu is not properly shown in UI
[
https://issues.apache.org/jira/browse/FLINK-24874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias updated FLINK-24874:
-
Release Note: 1.14.0 introduced a new dropdown menu to browse through
concurrently failed Executions. This feature was accidentally disabled due to
some ngzorro modules not being imported properly. This imports the missing
modules to make the dropdown menu being rendered properly. (was: 1.14.0
introduced a new dropdown menu to browse through concurrently failed
{{Executions}}. This feature was accidentally disabled due to some ngzorro
modules not being imported properly. This imports the missing modules to make
the dropdown menu being rendered properly.)
> Dropdown menu is not properly shown in UI
> -
>
> Key: FLINK-24874
> URL: https://issues.apache.org/jira/browse/FLINK-24874
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Web Frontend
>Affects Versions: 1.14.0
>Reporter: Matthias
>Assignee: Matthias
>Priority: Minor
> Labels: pull-request-available
> Fix For: 1.14.1
>
>
> FLINK-21867 introduced a new dropdown menu to browse through concurrently
> failed {{Executions}}. This feature is disabled due to ngzorro modules not
> being imported properly in {{release-1.14}}.
> Additionally, the tooltip is not printed correctly.
> These two issues are fixed on {{master}} already due to
> [903185d|https://github.com/apache/flink/commit/903185d72c97dd93c777eeb90cb81a7b1c7465e7]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-24874) Dropdown menu is not properly shown in UI
[
https://issues.apache.org/jira/browse/FLINK-24874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias updated FLINK-24874:
-
Release Note: 1.14.0 introduced a new dropdown menu to browse through
concurrently failed Executions in the exception history. This feature was
accidentally disabled due to some ngzorro modules not being imported properly.
This imports the missing modules to make the dropdown menu being rendered
properly. (was: 1.14.0 introduced a new dropdown menu to browse through
concurrently failed Executions. This feature was accidentally disabled due to
some ngzorro modules not being imported properly. This imports the missing
modules to make the dropdown menu being rendered properly.)
> Dropdown menu is not properly shown in UI
> -
>
> Key: FLINK-24874
> URL: https://issues.apache.org/jira/browse/FLINK-24874
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Web Frontend
>Affects Versions: 1.14.0
>Reporter: Matthias
>Assignee: Matthias
>Priority: Minor
> Labels: pull-request-available
> Fix For: 1.14.1
>
>
> FLINK-21867 introduced a new dropdown menu to browse through concurrently
> failed {{Executions}}. This feature is disabled due to ngzorro modules not
> being imported properly in {{release-1.14}}.
> Additionally, the tooltip is not printed correctly.
> These two issues are fixed on {{master}} already due to
> [903185d|https://github.com/apache/flink/commit/903185d72c97dd93c777eeb90cb81a7b1c7465e7]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-24874) Dropdown menu is not properly shown in UI
[
https://issues.apache.org/jira/browse/FLINK-24874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias updated FLINK-24874:
-
Release Note: 1.14.0 introduced a new dropdown menu to browse through
concurrently failed {{Executions}}. This feature was accidentally disabled due
to some ngzorro modules not being imported properly. This imports the missing
modules to make the dropdown menu being rendered properly.
> Dropdown menu is not properly shown in UI
> -
>
> Key: FLINK-24874
> URL: https://issues.apache.org/jira/browse/FLINK-24874
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Web Frontend
>Affects Versions: 1.14.0
>Reporter: Matthias
>Assignee: Matthias
>Priority: Minor
> Labels: pull-request-available
> Fix For: 1.14.1
>
>
> FLINK-21867 introduced a new dropdown menu to browse through concurrently
> failed {{Executions}}. This feature is disabled due to ngzorro modules not
> being imported properly in {{release-1.14}}.
> Additionally, the tooltip is not printed correctly.
> These two issues are fixed on {{master}} already due to
> [903185d|https://github.com/apache/flink/commit/903185d72c97dd93c777eeb90cb81a7b1c7465e7]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * 1ce5968cac8a461a937b59feae490bb0c840cd4b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] fapaul commented on a change in pull request #17870: [FLINK-24596][kafka] Fix buffered KafkaUpsert sink
fapaul commented on a change in pull request #17870:
URL: https://github.com/apache/flink/pull/17870#discussion_r756637602
##
File path:
flink-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/table/KafkaDynamicSink.java
##
@@ -228,10 +227,8 @@ public SinkRuntimeProvider getSinkRuntimeProvider(Context
context) {
flushMode,
objectReuse
? createRowDataTypeSerializer(
-context,
-
dataStream.getExecutionConfig())
-::copy
-: Function.identity());
Review comment:
None of those functions is serializable therefore we cannot pass them
directly to the sink.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] fapaul commented on a change in pull request #17870: [FLINK-24596][kafka] Fix buffered KafkaUpsert sink
fapaul commented on a change in pull request #17870:
URL: https://github.com/apache/flink/pull/17870#discussion_r756637224
##
File path:
flink-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/table/SinkBufferFlushMode.java
##
@@ -18,10 +18,11 @@
package org.apache.flink.streaming.connectors.kafka.table;
+import java.io.Serializable;
import java.util.Objects;
/** Sink buffer flush configuration. */
-public class SinkBufferFlushMode {
+public class SinkBufferFlushMode implements Serializable {
Review comment:
Objects of this class are passed to the `ReducingUpsertSink` which is
instantiated by the jobmanager and needs to be serialized before it is sent to
the taskmanagers to create the writer instances.
In general, classes that are passed to the sink should be serializable.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * 1ce5968cac8a461a937b59feae490bb0c840cd4b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17899: [FLINK-24446][Table SQL/Planner] Casting from STRING to TIMESTAMP_LTZ looses fractional seconds
flinkbot edited a comment on pull request #17899: URL: https://github.com/apache/flink/pull/17899#issuecomment-978728442 ## CI report: * 65f417af302f4173d325f6816a7fd1f912309ea9 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27034) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Comment Edited] (FLINK-24261) KafkaSourceITCase.testMultipleSplits fails due to "Cannot create topic"
[
https://issues.apache.org/jira/browse/FLINK-24261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448986#comment-17448986
]
Matthias edited comment on FLINK-24261 at 11/25/21, 7:38 AM:
-
We experienced the same issue in our Flink Fork for 1.14 pointing to
{{release-1.14}} as the upstream base branch:
{code}
Nov 24 18:21:38 [ERROR] testAbortTransactionsOfPendingCheckpointsAfterFailure
Time elapsed: 60.07 s <<< ERROR!
Nov 24 18:21:38 java.util.concurrent.TimeoutException
Nov 24 18:21:38 at
org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:108)
Nov 24 18:21:38 at
org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:272)
Nov 24 18:21:38 at
org.apache.flink.connector.kafka.sink.KafkaSinkITCase.createTestTopic(KafkaSinkITCase.java:423)
Nov 24 18:21:38 at
org.apache.flink.connector.kafka.sink.KafkaSinkITCase.setUp(KafkaSinkITCase.java:155)
Nov 24 18:21:38 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
Nov 24 18:21:38 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Nov 24 18:21:38 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Nov 24 18:21:38 at java.lang.reflect.Method.invoke(Method.java:498)
Nov 24 18:21:38 at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Nov 24 18:21:38 at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Nov 24 18:21:38 at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Nov 24 18:21:38 at
org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33)
Nov 24 18:21:38 at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
Nov 24 18:21:38 at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
Nov 24 18:21:38 at
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
Nov 24 18:21:38 at
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
Nov 24 18:21:38 at
org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
Nov 24 18:21:38 at
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Nov 24 18:21:38 at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
Nov 24 18:21:38 at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
Nov 24 18:21:38 at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
Nov 24 18:21:38 at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
Nov 24 18:21:38 at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
Nov 24 18:21:38 at
org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
Nov 24 18:21:38 at org.junit.rules.RunRules.evaluate(RunRules.java:20)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner.run(ParentRunner.java:413)
Nov 24 18:21:38 at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
Nov 24 18:21:38 at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
Nov 24 18:21:38 at
org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
Nov 24 18:21:38 at
java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
Nov 24 18:21:38 at
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
Nov 24 18:21:38 at
java.util.Iterator.forEachRemaining(Iterator.java:116)
Nov 24 18:21:38 at
java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
Nov 24 18:21:38 at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
Nov 24 18:21:38 at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
Nov 24 18:21:38 at
[jira] [Updated] (FLINK-24261) KafkaSourceITCase.testMultipleSplits fails due to "Cannot create topic"
[
https://issues.apache.org/jira/browse/FLINK-24261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias updated FLINK-24261:
-
Affects Version/s: 1.14.0
> KafkaSourceITCase.testMultipleSplits fails due to "Cannot create topic"
> ---
>
> Key: FLINK-24261
> URL: https://issues.apache.org/jira/browse/FLINK-24261
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
>Affects Versions: 1.14.0, 1.15.0
>Reporter: Xintong Song
>Priority: Major
> Labels: test-stability
> Fix For: 1.15.0
>
> Attachments: mvn-1.FLINK-24261-vvp-flink-1.14-stream.log.gz
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23955=logs=b0097207-033c-5d9a-b48c-6d4796fbe60d=8338a7d2-16f7-52e5-f576-4b7b3071eb3d=7119
> {code}
> Sep 13 01:14:27 [ERROR] Tests run: 12, Failures: 0, Errors: 1, Skipped: 0,
> Time elapsed: 180.412 s <<< FAILURE! - in
> org.apache.flink.connector.kafka.source.KafkaSourceITCase
> Sep 13 01:14:27 [ERROR] testMultipleSplits{TestEnvironment,
> ExternalContext}[1] Time elapsed: 120.244 s <<< ERROR!
> Sep 13 01:14:27 java.lang.RuntimeException: Cannot create topic
> 'kafka-single-topic-7245292146378659602'
> Sep 13 01:14:27 at
> org.apache.flink.connector.kafka.source.testutils.KafkaSingleTopicExternalContext.createTopic(KafkaSingleTopicExternalContext.java:100)
> Sep 13 01:14:27 at
> org.apache.flink.connector.kafka.source.testutils.KafkaSingleTopicExternalContext.createSourceSplitDataWriter(KafkaSingleTopicExternalContext.java:142)
> Sep 13 01:14:27 at
> org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.generateAndWriteTestData(SourceTestSuiteBase.java:301)
> Sep 13 01:14:27 at
> org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.testMultipleSplits(SourceTestSuiteBase.java:142)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-24261) KafkaSourceITCase.testMultipleSplits fails due to "Cannot create topic"
[
https://issues.apache.org/jira/browse/FLINK-24261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias updated FLINK-24261:
-
Attachment: mvn-1.FLINK-24261-vvp-flink-1.14-stream.log.gz
> KafkaSourceITCase.testMultipleSplits fails due to "Cannot create topic"
> ---
>
> Key: FLINK-24261
> URL: https://issues.apache.org/jira/browse/FLINK-24261
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
>Affects Versions: 1.15.0
>Reporter: Xintong Song
>Priority: Major
> Labels: test-stability
> Fix For: 1.15.0
>
> Attachments: mvn-1.FLINK-24261-vvp-flink-1.14-stream.log.gz
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23955=logs=b0097207-033c-5d9a-b48c-6d4796fbe60d=8338a7d2-16f7-52e5-f576-4b7b3071eb3d=7119
> {code}
> Sep 13 01:14:27 [ERROR] Tests run: 12, Failures: 0, Errors: 1, Skipped: 0,
> Time elapsed: 180.412 s <<< FAILURE! - in
> org.apache.flink.connector.kafka.source.KafkaSourceITCase
> Sep 13 01:14:27 [ERROR] testMultipleSplits{TestEnvironment,
> ExternalContext}[1] Time elapsed: 120.244 s <<< ERROR!
> Sep 13 01:14:27 java.lang.RuntimeException: Cannot create topic
> 'kafka-single-topic-7245292146378659602'
> Sep 13 01:14:27 at
> org.apache.flink.connector.kafka.source.testutils.KafkaSingleTopicExternalContext.createTopic(KafkaSingleTopicExternalContext.java:100)
> Sep 13 01:14:27 at
> org.apache.flink.connector.kafka.source.testutils.KafkaSingleTopicExternalContext.createSourceSplitDataWriter(KafkaSingleTopicExternalContext.java:142)
> Sep 13 01:14:27 at
> org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.generateAndWriteTestData(SourceTestSuiteBase.java:301)
> Sep 13 01:14:27 at
> org.apache.flink.connectors.test.common.testsuites.SourceTestSuiteBase.testMultipleSplits(SourceTestSuiteBase.java:142)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (FLINK-24261) KafkaSourceITCase.testMultipleSplits fails due to "Cannot create topic"
[
https://issues.apache.org/jira/browse/FLINK-24261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448986#comment-17448986
]
Matthias commented on FLINK-24261:
--
We experienced the same issue in our Flink Fork for 1.14 pointing to
`release-1.14` as the upstream base branch:
{code}
Nov 24 18:21:38 [ERROR] testAbortTransactionsOfPendingCheckpointsAfterFailure
Time elapsed: 60.07 s <<< ERROR!
Nov 24 18:21:38 java.util.concurrent.TimeoutException
Nov 24 18:21:38 at
org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:108)
Nov 24 18:21:38 at
org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:272)
Nov 24 18:21:38 at
org.apache.flink.connector.kafka.sink.KafkaSinkITCase.createTestTopic(KafkaSinkITCase.java:423)
Nov 24 18:21:38 at
org.apache.flink.connector.kafka.sink.KafkaSinkITCase.setUp(KafkaSinkITCase.java:155)
Nov 24 18:21:38 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
Nov 24 18:21:38 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Nov 24 18:21:38 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Nov 24 18:21:38 at java.lang.reflect.Method.invoke(Method.java:498)
Nov 24 18:21:38 at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Nov 24 18:21:38 at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Nov 24 18:21:38 at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Nov 24 18:21:38 at
org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33)
Nov 24 18:21:38 at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
Nov 24 18:21:38 at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
Nov 24 18:21:38 at
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
Nov 24 18:21:38 at
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
Nov 24 18:21:38 at
org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
Nov 24 18:21:38 at
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Nov 24 18:21:38 at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
Nov 24 18:21:38 at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
Nov 24 18:21:38 at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
Nov 24 18:21:38 at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
Nov 24 18:21:38 at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
Nov 24 18:21:38 at
org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
Nov 24 18:21:38 at org.junit.rules.RunRules.evaluate(RunRules.java:20)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Nov 24 18:21:38 at
org.junit.runners.ParentRunner.run(ParentRunner.java:413)
Nov 24 18:21:38 at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
Nov 24 18:21:38 at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
Nov 24 18:21:38 at
org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
Nov 24 18:21:38 at
java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
Nov 24 18:21:38 at
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
Nov 24 18:21:38 at
java.util.Iterator.forEachRemaining(Iterator.java:116)
Nov 24 18:21:38 at
java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
Nov 24 18:21:38 at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
Nov 24 18:21:38 at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
Nov 24 18:21:38 at
java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
Nov 24 18:21:38
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * 1ce5968cac8a461a937b59feae490bb0c840cd4b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17903: [hotfix][csv] Remove duplicate code.
flinkbot edited a comment on pull request #17903: URL: https://github.com/apache/flink/pull/17903#issuecomment-978907028 ## CI report: * 9ff39862f984dae0573a9c811c06a74cfc6c380e Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27039) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17903: [hotfix][csv] Remove duplicate code.
flinkbot commented on pull request #17903: URL: https://github.com/apache/flink/pull/17903#issuecomment-978907749 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the progress of the review. ## Automated Checks Last check on commit 9ff39862f984dae0573a9c811c06a74cfc6c380e (Thu Nov 25 07:31:40 UTC 2021) **Warnings:** * No documentation files were touched! Remember to keep the Flink docs up to date! Mention the bot in a comment to re-run the automated checks. ## Review Progress * ❓ 1. The [description] looks good. * ❓ 2. There is [consensus] that the contribution should go into to Flink. * ❓ 3. Needs [attention] from. * ❓ 4. The change fits into the overall [architecture]. * ❓ 5. Overall code [quality] is good. Please see the [Pull Request Review Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commands The @flinkbot bot supports the following commands: - `@flinkbot approve description` to approve one or more aspects (aspects: `description`, `consensus`, `architecture` and `quality`) - `@flinkbot approve all` to approve all aspects - `@flinkbot approve-until architecture` to approve everything until `architecture` - `@flinkbot attention @username1 [@username2 ..]` to require somebody's attention - `@flinkbot disapprove architecture` to remove an approval you gave earlier -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17903: [hotfix][csv] Remove duplicate code.
flinkbot commented on pull request #17903: URL: https://github.com/apache/flink/pull/17903#issuecomment-978907028 ## CI report: * 9ff39862f984dae0573a9c811c06a74cfc6c380e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * 1ce5968cac8a461a937b59feae490bb0c840cd4b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink-ml] weibozhao commented on a change in pull request #24: [Flink 24557] - Add knn algorithm to flink-ml
weibozhao commented on a change in pull request #24:
URL: https://github.com/apache/flink-ml/pull/24#discussion_r756627878
##
File path:
flink-ml-api/src/main/java/org/apache/flink/ml/linalg/DenseVector.java
##
@@ -60,6 +75,74 @@ public boolean equals(Object obj) {
return Arrays.equals(values, ((DenseVector) obj).values);
}
+/**
+ * Parse the dense vector from a formatted string.
+ *
+ * The format of a dense vector is space separated values such as "1 2
3 4".
+ *
+ * @param str A string of space separated values.
+ * @return The parsed vector.
+ */
+public static DenseVector fromString(String str) {
Review comment:
OK
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * bc9909664df562b0ab1c9a83ca6e67400b41004f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] ZhangChaoming opened a new pull request #17903: [hotfix][csv] Remove duplicate code.
ZhangChaoming opened a new pull request #17903: URL: https://github.com/apache/flink/pull/17903 ## What is the purpose of the change This pull request removes the duplicated code in `org.apache.flink.formats.csv.CsvFileSystemFormatFactory`. ## Brief change log - Remove duplicated code. ## Verifying this change This change is a trivial rework / code cleanup without any test coverage. ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): (yes / **no**) - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (yes / **no**) - The serializers: (yes / **no** / don't know) - The runtime per-record code paths (performance sensitive): (yes / **no** / don't know) - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / **no** / don't know) - The S3 file system connector: (yes / **no** / don't know) ## Documentation - Does this pull request introduce a new feature? (yes / **no**) - If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * bc9909664df562b0ab1c9a83ca6e67400b41004f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * bc9909664df562b0ab1c9a83ca6e67400b41004f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17902: [FLINK-25050][docs-zh] Translate "Metrics" page of "Operations" into Chinese
flinkbot edited a comment on pull request #17902: URL: https://github.com/apache/flink/pull/17902#issuecomment-978895303 ## CI report: * 8a398a42490ca1ab93a23b93d9e8c3c2abf14670 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27038) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17902: [FLINK-25050][docs-zh] Translate "Metrics" page of "Operations" into Chinese
flinkbot commented on pull request #17902: URL: https://github.com/apache/flink/pull/17902#issuecomment-978895593 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the progress of the review. ## Automated Checks Last check on commit 8a398a42490ca1ab93a23b93d9e8c3c2abf14670 (Thu Nov 25 07:10:24 UTC 2021) **Warnings:** * No documentation files were touched! Remember to keep the Flink docs up to date! * **This pull request references an unassigned [Jira ticket](https://issues.apache.org/jira/browse/FLINK-25050).** According to the [code contribution guide](https://flink.apache.org/contributing/contribute-code.html), tickets need to be assigned before starting with the implementation work. Mention the bot in a comment to re-run the automated checks. ## Review Progress * ❓ 1. The [description] looks good. * ❓ 2. There is [consensus] that the contribution should go into to Flink. * ❓ 3. Needs [attention] from. * ❓ 4. The change fits into the overall [architecture]. * ❓ 5. Overall code [quality] is good. Please see the [Pull Request Review Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commands The @flinkbot bot supports the following commands: - `@flinkbot approve description` to approve one or more aspects (aspects: `description`, `consensus`, `architecture` and `quality`) - `@flinkbot approve all` to approve all aspects - `@flinkbot approve-until architecture` to approve everything until `architecture` - `@flinkbot attention @username1 [@username2 ..]` to require somebody's attention - `@flinkbot disapprove architecture` to remove an approval you gave earlier -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17902: [FLINK-25050][docs-zh] Translate "Metrics" page of "Operations" into Chinese
flinkbot commented on pull request #17902: URL: https://github.com/apache/flink/pull/17902#issuecomment-978895303 ## CI report: * 8a398a42490ca1ab93a23b93d9e8c3c2abf14670 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * 25da71fb7f65f2fc7c7ec8c890fd11be446553f4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27004) * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * bc9909664df562b0ab1c9a83ca6e67400b41004f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (FLINK-25050) Translate "Metrics" page of "Operations" into Chinese
[ https://issues.apache.org/jira/browse/FLINK-25050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-25050: --- Labels: pull-request-available (was: ) > Translate "Metrics" page of "Operations" into Chinese > - > > Key: FLINK-25050 > URL: https://issues.apache.org/jira/browse/FLINK-25050 > Project: Flink > Issue Type: Improvement > Components: chinese-translation >Reporter: ZhiJie Yang >Priority: Minor > Labels: pull-request-available > > The page url is > https://nightlies.apache.org/flink/flink-docs-master/docs/zh/docs/ops/metrics/ > The markdown file is located in flink/docs/content.zh/docs/ops/metrics.md -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] ZhijieYang opened a new pull request #17902: [FLINK-25050][docs-zh] Translate "Metrics" page of "Operations" into Chinese
ZhijieYang opened a new pull request #17902: URL: https://github.com/apache/flink/pull/17902 ## What is the purpose of the change Translate "Metrics" page of "Operations" into Chinese ## Brief change log Translate "Metrics" page of "Operations" into Chinese ## Verifying this change This change is a trivial rework / code cleanup without any test coverage. ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency):no - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: no - The serializers: no - The runtime per-record code paths (performance sensitive): no - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no - The S3 file system connector: no ## Documentation - Does this pull request introduce a new feature? no -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * 25da71fb7f65f2fc7c7ec8c890fd11be446553f4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27004) * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * 25da71fb7f65f2fc7c7ec8c890fd11be446553f4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27004) * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * bc9909664df562b0ab1c9a83ca6e67400b41004f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * 25da71fb7f65f2fc7c7ec8c890fd11be446553f4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27004) * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * 25da71fb7f65f2fc7c7ec8c890fd11be446553f4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27004) * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) * d3522c91bafe5a29d667cf85dc15c03b269c1486 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * 25da71fb7f65f2fc7c7ec8c890fd11be446553f4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27004) * c7cee5ae6a1f9555e910332bd533e406289e66bc Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27037) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17847: [FLINK-6573][Connectors/Common ] Flink MongoDB Connector
flinkbot edited a comment on pull request #17847: URL: https://github.com/apache/flink/pull/17847#issuecomment-974817636 ## CI report: * 25da71fb7f65f2fc7c7ec8c890fd11be446553f4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27004) * c7cee5ae6a1f9555e910332bd533e406289e66bc UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (FLINK-25050) Translate "Metrics" page of "Operations" into Chinese
[ https://issues.apache.org/jira/browse/FLINK-25050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448965#comment-17448965 ] ZhiJie Yang commented on FLINK-25050: - Please assignee it to me , thanks. [~jark] > Translate "Metrics" page of "Operations" into Chinese > - > > Key: FLINK-25050 > URL: https://issues.apache.org/jira/browse/FLINK-25050 > Project: Flink > Issue Type: Improvement > Components: chinese-translation >Reporter: ZhiJie Yang >Priority: Minor > > The page url is > https://nightlies.apache.org/flink/flink-docs-master/docs/zh/docs/ops/metrics/ > The markdown file is located in flink/docs/content.zh/docs/ops/metrics.md -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25050) Translate "Metrics" page of "Operations" into Chinese
ZhiJie Yang created FLINK-25050: --- Summary: Translate "Metrics" page of "Operations" into Chinese Key: FLINK-25050 URL: https://issues.apache.org/jira/browse/FLINK-25050 Project: Flink Issue Type: Improvement Components: chinese-translation Reporter: ZhiJie Yang The page url is https://nightlies.apache.org/flink/flink-docs-master/docs/zh/docs/ops/metrics/ The markdown file is located in flink/docs/content.zh/docs/ops/metrics.md -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25049) sql-client.sh execute batch job in async mode failed with java.io.FileNotFoundException
macdoor615 created FLINK-25049:
--
Summary: sql-client.sh execute batch job in async mode failed with
java.io.FileNotFoundException
Key: FLINK-25049
URL: https://issues.apache.org/jira/browse/FLINK-25049
Project: Flink
Issue Type: Bug
Components: Table SQL / Client
Affects Versions: 1.14.0
Environment: {code:java}
//代码占位符
{code}
Reporter: macdoor615
execute multi simple sql in a sql file, like
{code:java}
insert overwrite bnpmp.p_biz_hcd_5m select * from bnpmp.p_biz_hcd_5m where
dt='2021-11-22';
insert overwrite bnpmp.p_biz_hjr_5m select * from bnpmp.p_biz_hjr_5m where
dt='2021-11-22';
insert overwrite bnpmp.p_biz_hswtv_5m select * from bnpmp.p_biz_hswtv_5m where
dt='2021-11-22';
...
{code}
if
{code:java}
SET table.dml-sync = true;{code}
execute properly.
if
{code:java}
SET table.dml-sync = false;{code}
some SQL Job failed with the following error
{code:java}
Caused by: java.lang.Exception: Failed to finalize execution on master ... 37
more Caused by: org.apache.flink.table.api.TableException: Exception in
finalizeGlobal at
org.apache.flink.table.filesystem.FileSystemOutputFormat.finalizeGlobal(FileSystemOutputFormat.java:91)
at
org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.finalizeOnMaster(InputOutputFormatVertex.java:148)
at
org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.vertexFinished(DefaultExecutionGraph.java:1086)
... 36 more Caused by: java.io.FileNotFoundException: File
hdfs://service1/user/hive/warehouse/bnpmp.db/p_snmp_f5_traffic_5m/.staging_1637821441497
does not exist. at
org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:901)
at
org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:112)
at
org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:961)
at
org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:958)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:958)
at
org.apache.flink.hive.shaded.fs.hdfs.HadoopFileSystem.listStatus(HadoopFileSystem.java:170)
at
org.apache.flink.table.filesystem.PartitionTempFileManager.listTaskTemporaryPaths(PartitionTempFileManager.java:104)
at
org.apache.flink.table.filesystem.FileSystemCommitter.commitPartitions(FileSystemCommitter.java:77)
at
org.apache.flink.table.filesystem.FileSystemOutputFormat.finalizeGlobal(FileSystemOutputFormat.java:89)
... 38 more
{code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (FLINK-24624) Add clean up phase when kubernetes session start failed
[ https://issues.apache.org/jira/browse/FLINK-24624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-24624: -- Fix Version/s: (was: 1.15.0) (was: 1.14.1) > Add clean up phase when kubernetes session start failed > --- > > Key: FLINK-24624 > URL: https://issues.apache.org/jira/browse/FLINK-24624 > Project: Flink > Issue Type: Improvement > Components: Deployment / Kubernetes >Affects Versions: 1.14.0 >Reporter: Aitozi >Assignee: Aitozi >Priority: Major > Labels: pull-request-available > > Serval k8s resources are created when deploy the kubernetes session. But the > resource are left there when deploy failed. This will lead to the next > failure or resource leak. So I think we should add the clean up phase when > start failed -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] wangyang0918 commented on a change in pull request #17554: [FLINK-24624][Kubernetes]Kill cluster when starting kubernetes session or application cluster failed
wangyang0918 commented on a change in pull request #17554:
URL: https://github.com/apache/flink/pull/17554#discussion_r756606603
##
File path:
flink-kubernetes/src/main/java/org/apache/flink/kubernetes/KubernetesClusterDescriptor.java
##
@@ -256,36 +244,51 @@ private String getWebMonitorAddress(Configuration
configuration) throws Exceptio
flinkConfig.get(JobManagerOptions.PORT));
}
+final KubernetesJobManagerParameters kubernetesJobManagerParameters =
+new KubernetesJobManagerParameters(flinkConfig,
clusterSpecification);
+
+final FlinkPod podTemplate =
+kubernetesJobManagerParameters
+.getPodTemplateFilePath()
+.map(
+file ->
+
KubernetesUtils.loadPodFromTemplateFile(
+client, file,
Constants.MAIN_CONTAINER_NAME))
+.orElse(new FlinkPod.Builder().build());
+final KubernetesJobManagerSpecification kubernetesJobManagerSpec =
+
KubernetesJobManagerFactory.buildKubernetesJobManagerSpecification(
+podTemplate, kubernetesJobManagerParameters);
+
+client.createJobManagerComponent(kubernetesJobManagerSpec);
+
+return createClusterClientProvider(clusterId);
+}
+
+private ClusterClientProvider safelyDeployCluster(
+SupplierWithException, Exception>
supplier)
+throws ClusterDeploymentException {
try {
-final KubernetesJobManagerParameters
kubernetesJobManagerParameters =
-new KubernetesJobManagerParameters(flinkConfig,
clusterSpecification);
-
-final FlinkPod podTemplate =
-kubernetesJobManagerParameters
-.getPodTemplateFilePath()
-.map(
-file ->
-
KubernetesUtils.loadPodFromTemplateFile(
-client, file,
Constants.MAIN_CONTAINER_NAME))
-.orElse(new FlinkPod.Builder().build());
-final KubernetesJobManagerSpecification kubernetesJobManagerSpec =
-
KubernetesJobManagerFactory.buildKubernetesJobManagerSpecification(
-podTemplate, kubernetesJobManagerParameters);
-
-client.createJobManagerComponent(kubernetesJobManagerSpec);
-
-return createClusterClientProvider(clusterId);
+
+ClusterClientProvider clusterClientProvider =
supplier.get();
+
+try (ClusterClient clusterClient =
clusterClientProvider.getClusterClient()) {
Review comment:
Re-create the client probably does not make sense for FLINK-24624 since
it will always fail due to permission issues.
After careful consideration, I lean to have more discussion and keep the
current behavior. I still appreciate for @Aitozi 's work on this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Closed] (FLINK-24760) Update user document for batch window tvf
[ https://issues.apache.org/jira/browse/FLINK-24760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang closed FLINK-24760. -- > Update user document for batch window tvf > - > > Key: FLINK-24760 > URL: https://issues.apache.org/jira/browse/FLINK-24760 > Project: Flink > Issue Type: Sub-task > Components: Documentation >Affects Versions: 1.15.0 >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Minor > Labels: pull-request-available > Fix For: 1.15.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Resolved] (FLINK-24760) Update user document for batch window tvf
[ https://issues.apache.org/jira/browse/FLINK-24760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang resolved FLINK-24760. Resolution: Fixed > Update user document for batch window tvf > - > > Key: FLINK-24760 > URL: https://issues.apache.org/jira/browse/FLINK-24760 > Project: Flink > Issue Type: Sub-task > Components: Documentation >Affects Versions: 1.15.0 >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Minor > Labels: pull-request-available > Fix For: 1.15.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-24760) Update user document for batch window tvf
[ https://issues.apache.org/jira/browse/FLINK-24760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448956#comment-17448956 ] Jing Zhang commented on FLINK-24760: Fixed in 1.15.0 5bc3951b21ee723671f727fdda8e610f76743dd6 > Update user document for batch window tvf > - > > Key: FLINK-24760 > URL: https://issues.apache.org/jira/browse/FLINK-24760 > Project: Flink > Issue Type: Sub-task > Components: Documentation >Affects Versions: 1.15.0 >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Minor > Labels: pull-request-available > Fix For: 1.15.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] beyond1920 merged pull request #17670: [FLINK-24760][docs] Update user document for batch window tvf
beyond1920 merged pull request #17670: URL: https://github.com/apache/flink/pull/17670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink-ml] yunfengzhou-hub commented on a change in pull request #32: [FLINK-24817] Add Naive Bayes implementation
yunfengzhou-hub commented on a change in pull request #32:
URL: https://github.com/apache/flink-ml/pull/32#discussion_r756597745
##
File path:
flink-ml-lib/src/main/java/org/apache/flink/ml/classification/naivebayes/NaiveBayesModel.java
##
@@ -0,0 +1,223 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.ml.classification.naivebayes;
+
+import org.apache.flink.api.common.eventtime.WatermarkStrategy;
+import org.apache.flink.api.common.functions.RichMapFunction;
+import org.apache.flink.api.common.typeinfo.TypeInformation;
+import org.apache.flink.api.connector.source.Source;
+import org.apache.flink.api.java.typeutils.RowTypeInfo;
+import org.apache.flink.connector.file.sink.FileSink;
+import org.apache.flink.connector.file.src.FileSource;
+import org.apache.flink.core.fs.Path;
+import org.apache.flink.ml.api.core.Model;
+import org.apache.flink.ml.common.broadcast.BroadcastUtils;
+import org.apache.flink.ml.common.datastream.TableUtils;
+import org.apache.flink.ml.linalg.BLAS;
+import org.apache.flink.ml.linalg.Vector;
+import org.apache.flink.ml.param.Param;
+import org.apache.flink.ml.util.ParamUtils;
+import org.apache.flink.ml.util.ReadWriteUtils;
+import org.apache.flink.streaming.api.datastream.DataStream;
+import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment;
+import
org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.BasePathBucketAssigner;
+import
org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.OnCheckpointRollingPolicy;
+import org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator;
+import org.apache.flink.streaming.api.operators.OneInputStreamOperator;
+import org.apache.flink.streaming.runtime.streamrecord.StreamRecord;
+import org.apache.flink.table.api.Table;
+import org.apache.flink.table.api.bridge.java.StreamTableEnvironment;
+import org.apache.flink.table.api.internal.TableImpl;
+import org.apache.flink.types.Row;
+import org.apache.flink.util.Preconditions;
+
+import org.apache.commons.lang3.ArrayUtils;
+
+import java.io.IOException;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Map;
+import java.util.function.Function;
+
+/** A Model which classifies data using the model data computed by {@link
NaiveBayes}. */
+public class NaiveBayesModel
+implements Model,
NaiveBayesModelParams {
+private static final long serialVersionUID = -4673084154965905629L;
+private final Map, Object> paramMap = new HashMap<>();
+private Table modelTable;
+
+public NaiveBayesModel() {
+ParamUtils.initializeMapWithDefaultValues(paramMap, this);
+}
+
+@Override
+public Table[] transform(Table... inputs) {
+Preconditions.checkArgument(inputs.length == 1);
+
+final String predictionCol = getPredictionCol();
+final String featuresCol = getFeaturesCol();
+final String broadcastModelKey = "NaiveBayesModelStream";
+
+RowTypeInfo inputTypeInfo =
TableUtils.getRowTypeInfo(inputs[0].getResolvedSchema());
+RowTypeInfo outputTypeInfo =
+new RowTypeInfo(
+ArrayUtils.addAll(
+inputTypeInfo.getFieldTypes(),
TypeInformation.of(Object.class)),
+ArrayUtils.addAll(inputTypeInfo.getFieldNames(),
predictionCol));
+
+StreamTableEnvironment tEnv =
+(StreamTableEnvironment) ((TableImpl)
modelTable).getTableEnvironment();
+DataStream modelStream =
+NaiveBayesModelData.toDataStream(tEnv, modelTable);
+DataStream input = tEnv.toDataStream(inputs[0]);
+
+Map> broadcastMap = new HashMap<>();
+broadcastMap.put(broadcastModelKey, modelStream);
+
+Function>, DataStream> function =
+dataStreams -> {
+DataStream stream = dataStreams.get(0);
+return stream.transform(
+this.getClass().getSimpleName(),
+outputTypeInfo,
+new PredictLabelOperator(
+new
[GitHub] [flink-ml] yunfengzhou-hub commented on a change in pull request #32: [FLINK-24817] Add Naive Bayes implementation
yunfengzhou-hub commented on a change in pull request #32:
URL: https://github.com/apache/flink-ml/pull/32#discussion_r755747666
##
File path:
flink-ml-lib/src/test/java/org/apache/flink/ml/util/StageTestUtils.java
##
@@ -0,0 +1,50 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.ml.util;
+
+import org.apache.flink.ml.api.core.Stage;
+import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment;
+
+import java.lang.reflect.Method;
+import java.nio.file.Files;
+
+/** Utility methods for testing stages. */
+public class StageTestUtils {
+/**
+ * Saves a stage to filesystem and reloads it with the static load()
method a stage must
+ * implement.
+ */
+public static > T
saveAndReload(StreamExecutionEnvironment env, T stage)
+throws Exception {
+String tempDir = Files.createTempDirectory("").toString();
Review comment:
OK. I'll do it.
The common practice in Flink tests is to initialize the `TemporaryFolder` in
each test class, and calls for initialization in `@Before` methods. Since the
usage of `TemporaryFolder` in our case is merely in static utility functions, I
think we can just put it as a static member of that class and initializes in
static context.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Commented] (FLINK-22300) Why TimeEvictor of Keyed Windows evictor do not support ProcessingTime of TimeCharacteristic
[ https://issues.apache.org/jira/browse/FLINK-22300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448954#comment-17448954 ] Paul Lin commented on FLINK-22300: -- Any follow-ups? I would be happy to take this issue if we reach a consensus on the solution. [~trohrmann] [~arvid] > Why TimeEvictor of Keyed Windows evictor do not support ProcessingTime of > TimeCharacteristic > > > Key: FLINK-22300 > URL: https://issues.apache.org/jira/browse/FLINK-22300 > Project: Flink > Issue Type: Improvement > Components: API / DataStream >Affects Versions: 1.11.3 >Reporter: Bo Huang >Priority: Minor > Labels: auto-deprioritized-major, stale-minor > > StreamExecutionEnvironment.setStreamTimeCharacteristic(TimeCharacteristic.ProcessingTime). > The data after Windows process can not be evicted by TimeEvictor of Keyed > Windows Beause TimestampedValue have no timestamp value. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] YesOrNo828 commented on a change in pull request #17831: [FLINK-15825][Table SQL/API] Add renameDatabase() to Catalog
YesOrNo828 commented on a change in pull request #17831:
URL: https://github.com/apache/flink/pull/17831#discussion_r756595287
##
File path:
flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/catalog/hive/HiveCatalog.java
##
@@ -398,6 +398,34 @@ public void alterDatabase(
}
}
+@Override
+public void renameDatabase(
+String databaseName, String newDatabaseName, boolean
ignoreIfNotExists)
+throws DatabaseNotExistException, DatabaseAlreadyExistException,
CatalogException {
+checkArgument(
+!isNullOrWhitespaceOnly(databaseName), "databaseName cannot be
null or empty");
+checkArgument(
+!isNullOrWhitespaceOnly(newDatabaseName),
+"newDatabaseName cannot be null or empty");
+
+try {
+if (databaseExists(databaseName)) {
+if (databaseExists(newDatabaseName)) {
+throw new DatabaseAlreadyExistException(getName(),
newDatabaseName);
+} else {
+Database database = getHiveDatabase(databaseName);
+database.setName(newDatabaseName);
+client.alterDatabase(databaseName, database);
Review comment:
@shenzhu you can set param `cascade = true`, when drop a not empty
database by this
[method](https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/catalog/hive/HiveCatalog.java#L426).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Comment Edited] (FLINK-20370) Result is wrong when sink primary key is not the same with query
[
https://issues.apache.org/jira/browse/FLINK-20370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441679#comment-17441679
]
lincoln lee edited comment on FLINK-20370 at 11/25/21, 6:08 AM:
Thanks for all your inputs!
Based on Jingson's summary and the discussion, let me try to summarize, please
correct me if I'm wrong
An upsert sink can accept such inputs:
1. input is changelog stream
1.1 primary key = upsert key, it's already ok
1.2 primary key != upsert key (upsert key can be none), we should add
upsertMaterialize
1.3 primary key contains upsert key, upsertMaterialize can be ommitted but sink
requires update_before
2. input is append stream
2.1 sink has same parallelism with the upstream operator, it's ok
2.2 sink's parallelism differs from the upstream operator, we should add a
'keyby' for the primary key by default
The current pr already addressed 1.2 & 1.3, so remaining the 2.2 to be done.
The fix is simple, but for the sake of be configurable,
we should introduce another job level config option similar to
'table.exec.sink.upsert-materialize' (since FLINK-24254 fine-grained setting
per INSERT INTO not ready now)
I temporally name it 'table.exec.sink.pk-shuffle', and updated the pr, welcome
your suggestions.
cc [~twalthr] [~lzljs3620320] [~wenlong.lwl]
was (Author: lincoln.86xy):
Thanks for all your inputs!
Based on Jingson's summary and the discussion, let me try to summarize, please
correct me if I'm wrong
An upsert sink can accept such inputs:
1. input is changelog stream
1.1 primary key = upsert key, it's already ok
1.2 primary key != upsert key (upsert key can be none), we should add
upsertMaterialize
1.3 primary key contains upsert key, upsertMaterialize can be committed but
sink requires update_before
2. input is append stream
2.1 sink has same parallelism with the upstream operator, it's ok
2.2 sink's parallelism differs from the upstream operator, we should add a
'keyby' for the primary key by default
The current pr already addressed 1.2 & 1.3, so remaining the 2.2 to be done.
The fix is simple, but for the sake of be configurable,
we should introduce another job level config option similar to
'table.exec.sink.upsert-materialize' (since FLINK-24254 fine-grained setting
per INSERT INTO not ready now)
I temporally name it 'table.exec.sink.pk-shuffle', and updated the pr, welcome
your suggestions.
cc [~twalthr] [~lzljs3620320] [~wenlong.lwl]
> Result is wrong when sink primary key is not the same with query
>
>
> Key: FLINK-20370
> URL: https://issues.apache.org/jira/browse/FLINK-20370
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.12.0
>Reporter: Jark Wu
>Assignee: lincoln lee
>Priority: Critical
> Labels: pull-request-available
> Fix For: 1.15.0
>
>
> Both sources are upsert-kafka which synchronizes the changes from MySQL
> tables (source_city, source_customer). The sink is another MySQL table which
> is in upsert mode with "city_name" primary key. The join key is "city_id".
> In this case, the result will be wrong when updating
> {{source_city.city_name}} column in MySQL, as the UPDATE_BEFORE is ignored
> and the old city_name is retained in the sink table.
> {code}
> Sink(table=[default_catalog.default_database.sink_kafka_count_city],
> fields=[city_name, count_customer, sum_gender], changelogMode=[NONE])
> +- Calc(select=[city_name, CAST(count_customer) AS count_customer,
> CAST(sum_gender) AS sum_gender], changelogMode=[I,UA,D])
>+- Join(joinType=[InnerJoin], where=[=(city_id, id)], select=[city_id,
> count_customer, sum_gender, id, city_name],
> leftInputSpec=[JoinKeyContainsUniqueKey],
> rightInputSpec=[JoinKeyContainsUniqueKey], changelogMode=[I,UA,D])
> :- Exchange(distribution=[hash[city_id]], changelogMode=[I,UA,D])
> : +- GlobalGroupAggregate(groupBy=[city_id], select=[city_id,
> COUNT_RETRACT(count1$0) AS count_customer, SUM_RETRACT((sum$1, count$2)) AS
> sum_gender], changelogMode=[I,UA,D])
> : +- Exchange(distribution=[hash[city_id]], changelogMode=[I])
> :+- LocalGroupAggregate(groupBy=[city_id], select=[city_id,
> COUNT_RETRACT(*) AS count1$0, SUM_RETRACT(gender) AS (sum$1, count$2)],
> changelogMode=[I])
> : +- Calc(select=[city_id, gender], changelogMode=[I,UB,UA,D])
> : +- ChangelogNormalize(key=[customer_id],
> changelogMode=[I,UB,UA,D])
> : +- Exchange(distribution=[hash[customer_id]],
> changelogMode=[UA,D])
> :+- MiniBatchAssigner(interval=[3000ms],
> mode=[ProcTime], changelogMode=[UA,D])
> : +-
[jira] [Commented] (FLINK-25029) Hadoop Caller Context Setting In Flink
[ https://issues.apache.org/jira/browse/FLINK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448950#comment-17448950 ] 刘方奇 commented on FLINK-25029: - [~dmvk] , Hi, Do U have any opinions about this issue？Look forward to your reply. THX! > Hadoop Caller Context Setting In Flink > -- > > Key: FLINK-25029 > URL: https://issues.apache.org/jira/browse/FLINK-25029 > Project: Flink > Issue Type: Improvement > Components: Runtime / Task >Reporter: 刘方奇 >Priority: Major > > For a given HDFS operation (e.g. delete file), it's very helpful to track > which upper level job issues it. The upper level callers may be specific > Oozie tasks, MR jobs, and hive queries. One scenario is that the namenode > (NN) is abused/spammed, the operator may want to know immediately which MR > job should be blamed so that she can kill it. To this end, the caller context > contains at least the application-dependent "tracking id". > The above is the main effect of the Caller Context. HDFS Client set Caller > Context, then name node get it in audit log to do some work. > Now the Spark and hive have the Caller Context to meet the HDFS Job Audit > requirement. > In my company, flink jobs often cause some problems for HDFS, so we did it > for preventing some cases. > If the feature is general enough. Should we support it, then I can submit a > PR for this. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #17900: [FLINK-24803][Table SQL/Planner] Fix cast BINARY/VARBINARY to STRING
flinkbot edited a comment on pull request #17900: URL: https://github.com/apache/flink/pull/17900#issuecomment-978731052 ## CI report: * 1ed9491679dfa934b1fa537b73404863a262415f Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27026) * e40e860c06173302cfdda5a2f136e2d3c474fb68 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27035) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17900: [FLINK-24803][Table SQL/Planner] Fix cast BINARY/VARBINARY to STRING
flinkbot edited a comment on pull request #17900: URL: https://github.com/apache/flink/pull/17900#issuecomment-978731052 ## CI report: * 1ed9491679dfa934b1fa537b73404863a262415f Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27026) * e40e860c06173302cfdda5a2f136e2d3c474fb68 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Closed] (FLINK-24922) Fix spelling errors in the word "parallism"
[ https://issues.apache.org/jira/browse/FLINK-24922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang closed FLINK-24922. -- Assignee: xiangqiao > Fix spelling errors in the word "parallism" > --- > > Key: FLINK-24922 > URL: https://issues.apache.org/jira/browse/FLINK-24922 > Project: Flink > Issue Type: Bug > Components: Documentation, Table SQL / Client >Reporter: xiangqiao >Assignee: xiangqiao >Priority: Major > Labels: pull-request-available > Fix For: 1.15.0, 1.14.1, 1.13.4 > > > Fix the spelling error of "parallism" in the document of SQL client. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #17899: [FLINK-24446][Table SQL/Planner] Casting from STRING to TIMESTAMP_LTZ looses fractional seconds
flinkbot edited a comment on pull request #17899: URL: https://github.com/apache/flink/pull/17899#issuecomment-978728442 ## CI report: * c0c5a63da79ad657b47f26b79d0144a8f8a07725 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27025) * 65f417af302f4173d325f6816a7fd1f912309ea9 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27034) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (FLINK-24922) Fix spelling errors in the word "parallism"
[ https://issues.apache.org/jira/browse/FLINK-24922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang resolved FLINK-24922. Resolution: Fixed > Fix spelling errors in the word "parallism" > --- > > Key: FLINK-24922 > URL: https://issues.apache.org/jira/browse/FLINK-24922 > Project: Flink > Issue Type: Bug > Components: Documentation, Table SQL / Client >Reporter: xiangqiao >Priority: Major > Labels: pull-request-available > Fix For: 1.15.0, 1.14.1, 1.13.4 > > > Fix the spelling error of "parallism" in the document of SQL client. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-24922) Fix spelling errors in the word "parallism"
[ https://issues.apache.org/jira/browse/FLINK-24922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated FLINK-24922: --- Fix Version/s: 1.15.0 1.14.1 1.13.4 > Fix spelling errors in the word "parallism" > --- > > Key: FLINK-24922 > URL: https://issues.apache.org/jira/browse/FLINK-24922 > Project: Flink > Issue Type: Bug > Components: Documentation, Table SQL / Client >Reporter: xiangqiao >Priority: Major > Labels: pull-request-available > Fix For: 1.15.0, 1.14.1, 1.13.4 > > > Fix the spelling error of "parallism" in the document of SQL client. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-24922) Fix spelling errors in the word "parallism"
[ https://issues.apache.org/jira/browse/FLINK-24922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated FLINK-24922: --- Affects Version/s: (was: 1.13.0) (was: 1.14.0) > Fix spelling errors in the word "parallism" > --- > > Key: FLINK-24922 > URL: https://issues.apache.org/jira/browse/FLINK-24922 > Project: Flink > Issue Type: Bug > Components: Documentation, Table SQL / Client >Reporter: xiangqiao >Priority: Major > Labels: pull-request-available > > Fix the spelling error of "parallism" in the document of SQL client. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-24922) Fix spelling errors in the word "parallism"
[ https://issues.apache.org/jira/browse/FLINK-24922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448941#comment-17448941 ] Jing Zhang commented on FLINK-24922: Fixed in 1.15.0: 591c398f518ece86023b2f51589e07bbd7a8cdc4 Fixed in 1.14.1 d654297eb2e696320628c6092c7f467d71933ea2 Fixed in 1.13.4 ada27e3b9794b57ec4cc20b096f1bc93827b0953 > Fix spelling errors in the word "parallism" > --- > > Key: FLINK-24922 > URL: https://issues.apache.org/jira/browse/FLINK-24922 > Project: Flink > Issue Type: Bug > Components: Documentation, Table SQL / Client >Affects Versions: 1.13.0, 1.14.0 >Reporter: xiangqiao >Priority: Major > Labels: pull-request-available > > Fix the spelling error of "parallism" in the document of SQL client. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] flinkbot edited a comment on pull request #17899: [FLINK-24446][Table SQL/Planner] Casting from STRING to TIMESTAMP_LTZ looses fractional seconds
flinkbot edited a comment on pull request #17899: URL: https://github.com/apache/flink/pull/17899#issuecomment-978728442 ## CI report: * c0c5a63da79ad657b47f26b79d0144a8f8a07725 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27025) * 65f417af302f4173d325f6816a7fd1f912309ea9 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17822: Release 1.14 kafka3.0 bug
flinkbot edited a comment on pull request #17822: URL: https://github.com/apache/flink/pull/17822#issuecomment-971696959 ## CI report: * 564dee0752619ecb739b4bee1cacba856ea53bac Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27006) * d654297eb2e696320628c6092c7f467d71933ea2 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27033) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17842: [FLINK-24966] [docs] Fix spelling errors in the project
flinkbot edited a comment on pull request #17842: URL: https://github.com/apache/flink/pull/17842#issuecomment-974310249 ## CI report: * 19490ae190b28ac5c4d2f17b3d4dbf9668165aa9 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27027) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17822: Release 1.14 kafka3.0 bug
flinkbot edited a comment on pull request #17822: URL: https://github.com/apache/flink/pull/17822#issuecomment-971696959 ## CI report: * 564dee0752619ecb739b4bee1cacba856ea53bac Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27006) * d654297eb2e696320628c6092c7f467d71933ea2 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Assigned] (FLINK-23999) Support evaluating individual window table-valued function in planner
[
https://issues.apache.org/jira/browse/FLINK-23999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang reassigned FLINK-23999:
--
Assignee: Jing Zhang (was: jingzhang#1)
> Support evaluating individual window table-valued function in planner
> -
>
> Key: FLINK-23999
> URL: https://issues.apache.org/jira/browse/FLINK-23999
> Project: Flink
> Issue Type: Sub-task
> Components: Table SQL / Planner
>Reporter: Jing Zhang
>Assignee: Jing Zhang
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.15.0
>
>
> {{Currently, window table-valued function has to be used with other window
> operation, such as window aggregate, window topN and window join. }}
> {{In the ticket, we aim to support evaluating individual window table-valued
> function in planner.}}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Assigned] (FLINK-24760) Update user document for batch window tvf
[ https://issues.apache.org/jira/browse/FLINK-24760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned FLINK-24760: -- Assignee: Jing Zhang (was: jingzhang#1) > Update user document for batch window tvf > - > > Key: FLINK-24760 > URL: https://issues.apache.org/jira/browse/FLINK-24760 > Project: Flink > Issue Type: Sub-task > Components: Documentation >Affects Versions: 1.15.0 >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Minor > Labels: pull-request-available > Fix For: 1.15.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [flink] beyond1920 merged pull request #17816: [FLINK-24922][docs] Backport fix spelling errors in the word "parallism"
beyond1920 merged pull request #17816: URL: https://github.com/apache/flink/pull/17816 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17901: [Typo]remove Chinese test characters in default doc
flinkbot edited a comment on pull request #17901: URL: https://github.com/apache/flink/pull/17901#issuecomment-978801879 ## CI report: * 6e23232ab2b720865f81914ba9541c7453c0b540 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27031) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17900: [FLINK-24803][Table SQL/Planner] Fix cast BINARY/VARBINARY to STRING
flinkbot edited a comment on pull request #17900: URL: https://github.com/apache/flink/pull/17900#issuecomment-978731052 ## CI report: * 1ed9491679dfa934b1fa537b73404863a262415f Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27026) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink-ml] lindong28 commented on a change in pull request #36: [FLINK-24933][python] Support ML Python API to implement FLIP-173 and FLP-174
lindong28 commented on a change in pull request #36: URL: https://github.com/apache/flink-ml/pull/36#discussion_r756575662 ## File path: flink-ml-python/README.md ## @@ -0,0 +1,20 @@ +Flink ML is a library which provides machine learning (ML) APIs and libraries that simplify the building of machine learning pipelines. It provides a set of standard ML APIs for MLlib developers to implement ML algorithms, as well as libraries of ML algorithms that can be used to build ML pipelines for both training and inference jobs. + +Flink ML is developed under the umbrella of [Apache Flink](https://flink.apache.org/). + +## Python Packaging + +Prerequisites for building apache-flink-ml: + +* Unix-like environment (we use Linux, Mac OS X) +* Python version(3.6, 3.7 or 3.8) is required + +Then go to the root directory of flink-ml-python source code and run this command to build the sdist package of apache-flink-ml: +```bash +cd flink-ml-python; python setup.py sdist; +``` + +The sdist package of apache-flink-ml will be found under ./flink-ml-python/dist/. It could be used for installation, such as: +```bash +python -m pip install dist/*.tar.gz Review comment: Sounds good. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17899: [FLINK-24446][Table SQL/Planner] Casting from STRING to TIMESTAMP_LTZ looses fractional seconds
flinkbot edited a comment on pull request #17899: URL: https://github.com/apache/flink/pull/17899#issuecomment-978728442 ## CI report: * c0c5a63da79ad657b47f26b79d0144a8f8a07725 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27025) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] leonardBang commented on pull request #17653: FLINK SQL checkpoint不生效
leonardBang commented on pull request #17653: URL: https://github.com/apache/flink/pull/17653#issuecomment-978819149 @fanghj I close this it's invalid -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] leonardBang closed pull request #17653: FLINK SQL checkpoint不生效
leonardBang closed pull request #17653: URL: https://github.com/apache/flink/pull/17653 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17816: [FLINK-24922][docs] Backport fix spelling errors in the word "parallism"
flinkbot edited a comment on pull request #17816: URL: https://github.com/apache/flink/pull/17816#issuecomment-971338462 ## CI report: * 251f55c950101b10454bfb031469e8cd643ea512 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26641) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17670: [FLINK-24760][docs] Update user document for batch window tvf
flinkbot edited a comment on pull request #17670: URL: https://github.com/apache/flink/pull/17670#issuecomment-960539433 ## CI report: * 7c571626f1139e8af963bc3314de12a801587f52 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26926) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink-ml] zhipeng93 commented on a change in pull request #32: [FLINK-24817] Add Naive Bayes implementation
zhipeng93 commented on a change in pull request #32:
URL: https://github.com/apache/flink-ml/pull/32#discussion_r756556452
##
File path:
flink-ml-lib/src/main/java/org/apache/flink/ml/classification/naivebayes/NaiveBayesModel.java
##
@@ -0,0 +1,223 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.ml.classification.naivebayes;
+
+import org.apache.flink.api.common.eventtime.WatermarkStrategy;
+import org.apache.flink.api.common.functions.RichMapFunction;
+import org.apache.flink.api.common.typeinfo.TypeInformation;
+import org.apache.flink.api.connector.source.Source;
+import org.apache.flink.api.java.typeutils.RowTypeInfo;
+import org.apache.flink.connector.file.sink.FileSink;
+import org.apache.flink.connector.file.src.FileSource;
+import org.apache.flink.core.fs.Path;
+import org.apache.flink.ml.api.core.Model;
+import org.apache.flink.ml.common.broadcast.BroadcastUtils;
+import org.apache.flink.ml.common.datastream.TableUtils;
+import org.apache.flink.ml.linalg.BLAS;
+import org.apache.flink.ml.linalg.Vector;
+import org.apache.flink.ml.param.Param;
+import org.apache.flink.ml.util.ParamUtils;
+import org.apache.flink.ml.util.ReadWriteUtils;
+import org.apache.flink.streaming.api.datastream.DataStream;
+import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment;
+import
org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.BasePathBucketAssigner;
+import
org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.OnCheckpointRollingPolicy;
+import org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator;
+import org.apache.flink.streaming.api.operators.OneInputStreamOperator;
+import org.apache.flink.streaming.runtime.streamrecord.StreamRecord;
+import org.apache.flink.table.api.Table;
+import org.apache.flink.table.api.bridge.java.StreamTableEnvironment;
+import org.apache.flink.table.api.internal.TableImpl;
+import org.apache.flink.types.Row;
+import org.apache.flink.util.Preconditions;
+
+import org.apache.commons.lang3.ArrayUtils;
+
+import java.io.IOException;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Map;
+import java.util.function.Function;
+
+/** A Model which classifies data using the model data computed by {@link
NaiveBayes}. */
+public class NaiveBayesModel
+implements Model,
NaiveBayesModelParams {
+private static final long serialVersionUID = -4673084154965905629L;
+private final Map, Object> paramMap = new HashMap<>();
+private Table modelTable;
+
+public NaiveBayesModel() {
+ParamUtils.initializeMapWithDefaultValues(paramMap, this);
+}
+
+@Override
+public Table[] transform(Table... inputs) {
+Preconditions.checkArgument(inputs.length == 1);
+
+final String predictionCol = getPredictionCol();
+final String featuresCol = getFeaturesCol();
+final String broadcastModelKey = "NaiveBayesModelStream";
+
+RowTypeInfo inputTypeInfo =
TableUtils.getRowTypeInfo(inputs[0].getResolvedSchema());
+RowTypeInfo outputTypeInfo =
+new RowTypeInfo(
+ArrayUtils.addAll(
+inputTypeInfo.getFieldTypes(),
TypeInformation.of(Object.class)),
+ArrayUtils.addAll(inputTypeInfo.getFieldNames(),
predictionCol));
+
+StreamTableEnvironment tEnv =
+(StreamTableEnvironment) ((TableImpl)
modelTable).getTableEnvironment();
+DataStream modelStream =
+NaiveBayesModelData.toDataStream(tEnv, modelTable);
+DataStream input = tEnv.toDataStream(inputs[0]);
+
+Map> broadcastMap = new HashMap<>();
+broadcastMap.put(broadcastModelKey, modelStream);
+
+Function>, DataStream> function =
+dataStreams -> {
+DataStream stream = dataStreams.get(0);
+return stream.transform(
+this.getClass().getSimpleName(),
+outputTypeInfo,
+new PredictLabelOperator(
+new
[GitHub] [flink-ml] zhipeng93 commented on a change in pull request #32: [FLINK-24817] Add Naive Bayes implementation
zhipeng93 commented on a change in pull request #32:
URL: https://github.com/apache/flink-ml/pull/32#discussion_r756556452
##
File path:
flink-ml-lib/src/main/java/org/apache/flink/ml/classification/naivebayes/NaiveBayesModel.java
##
@@ -0,0 +1,223 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.ml.classification.naivebayes;
+
+import org.apache.flink.api.common.eventtime.WatermarkStrategy;
+import org.apache.flink.api.common.functions.RichMapFunction;
+import org.apache.flink.api.common.typeinfo.TypeInformation;
+import org.apache.flink.api.connector.source.Source;
+import org.apache.flink.api.java.typeutils.RowTypeInfo;
+import org.apache.flink.connector.file.sink.FileSink;
+import org.apache.flink.connector.file.src.FileSource;
+import org.apache.flink.core.fs.Path;
+import org.apache.flink.ml.api.core.Model;
+import org.apache.flink.ml.common.broadcast.BroadcastUtils;
+import org.apache.flink.ml.common.datastream.TableUtils;
+import org.apache.flink.ml.linalg.BLAS;
+import org.apache.flink.ml.linalg.Vector;
+import org.apache.flink.ml.param.Param;
+import org.apache.flink.ml.util.ParamUtils;
+import org.apache.flink.ml.util.ReadWriteUtils;
+import org.apache.flink.streaming.api.datastream.DataStream;
+import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment;
+import
org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.BasePathBucketAssigner;
+import
org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.OnCheckpointRollingPolicy;
+import org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator;
+import org.apache.flink.streaming.api.operators.OneInputStreamOperator;
+import org.apache.flink.streaming.runtime.streamrecord.StreamRecord;
+import org.apache.flink.table.api.Table;
+import org.apache.flink.table.api.bridge.java.StreamTableEnvironment;
+import org.apache.flink.table.api.internal.TableImpl;
+import org.apache.flink.types.Row;
+import org.apache.flink.util.Preconditions;
+
+import org.apache.commons.lang3.ArrayUtils;
+
+import java.io.IOException;
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Map;
+import java.util.function.Function;
+
+/** A Model which classifies data using the model data computed by {@link
NaiveBayes}. */
+public class NaiveBayesModel
+implements Model,
NaiveBayesModelParams {
+private static final long serialVersionUID = -4673084154965905629L;
+private final Map, Object> paramMap = new HashMap<>();
+private Table modelTable;
+
+public NaiveBayesModel() {
+ParamUtils.initializeMapWithDefaultValues(paramMap, this);
+}
+
+@Override
+public Table[] transform(Table... inputs) {
+Preconditions.checkArgument(inputs.length == 1);
+
+final String predictionCol = getPredictionCol();
+final String featuresCol = getFeaturesCol();
+final String broadcastModelKey = "NaiveBayesModelStream";
+
+RowTypeInfo inputTypeInfo =
TableUtils.getRowTypeInfo(inputs[0].getResolvedSchema());
+RowTypeInfo outputTypeInfo =
+new RowTypeInfo(
+ArrayUtils.addAll(
+inputTypeInfo.getFieldTypes(),
TypeInformation.of(Object.class)),
+ArrayUtils.addAll(inputTypeInfo.getFieldNames(),
predictionCol));
+
+StreamTableEnvironment tEnv =
+(StreamTableEnvironment) ((TableImpl)
modelTable).getTableEnvironment();
+DataStream modelStream =
+NaiveBayesModelData.toDataStream(tEnv, modelTable);
+DataStream input = tEnv.toDataStream(inputs[0]);
+
+Map> broadcastMap = new HashMap<>();
+broadcastMap.put(broadcastModelKey, modelStream);
+
+Function>, DataStream> function =
+dataStreams -> {
+DataStream stream = dataStreams.get(0);
+return stream.transform(
+this.getClass().getSimpleName(),
+outputTypeInfo,
+new PredictLabelOperator(
+new
[GitHub] [flink] flinkbot edited a comment on pull request #17901: [Typo]remove Chinese test characters in default doc
flinkbot edited a comment on pull request #17901: URL: https://github.com/apache/flink/pull/17901#issuecomment-978801879 ## CI report: * 6e23232ab2b720865f81914ba9541c7453c0b540 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27031) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17901: [Typo]remove Chinese test characters in default doc
flinkbot commented on pull request #17901: URL: https://github.com/apache/flink/pull/17901#issuecomment-978802636 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the progress of the review. ## Automated Checks Last check on commit 6e23232ab2b720865f81914ba9541c7453c0b540 (Thu Nov 25 03:53:55 UTC 2021) **Warnings:** * Documentation files were touched, but no `docs/content.zh/` files: Update Chinese documentation or file Jira ticket. * **Invalid pull request title: No valid Jira ID provided** Mention the bot in a comment to re-run the automated checks. ## Review Progress * ❓ 1. The [description] looks good. * ❓ 2. There is [consensus] that the contribution should go into to Flink. * ❓ 3. Needs [attention] from. * ❓ 4. The change fits into the overall [architecture]. * ❓ 5. Overall code [quality] is good. Please see the [Pull Request Review Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full explanation of the review process. The Bot is tracking the review progress through labels. Labels are applied according to the order of the review items. For consensus, approval by a Flink committer of PMC member is required Bot commands The @flinkbot bot supports the following commands: - `@flinkbot approve description` to approve one or more aspects (aspects: `description`, `consensus`, `architecture` and `quality`) - `@flinkbot approve all` to approve all aspects - `@flinkbot approve-until architecture` to approve everything until `architecture` - `@flinkbot attention @username1 [@username2 ..]` to require somebody's attention - `@flinkbot disapprove architecture` to remove an approval you gave earlier -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #17901: [Typo]remove Chinese test characters in default doc
flinkbot commented on pull request #17901: URL: https://github.com/apache/flink/pull/17901#issuecomment-978801879 ## CI report: * 6e23232ab2b720865f81914ba9541c7453c0b540 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] Jiezhi opened a new pull request #17901: [Typo]remove Chinese test characters in default doc
Jiezhi opened a new pull request #17901: URL: https://github.com/apache/flink/pull/17901 Just see changed file. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17653: FLINK SQL checkpoint不生效
flinkbot edited a comment on pull request #17653: URL: https://github.com/apache/flink/pull/17653#issuecomment-958686553 ## CI report: * a2e241da13d788d165fe7f106b38f707a1cbf79f Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26918) * ada27e3b9794b57ec4cc20b096f1bc93827b0953 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=27030) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17816: [FLINK-24922][docs] Backport fix spelling errors in the word "parallism"
flinkbot edited a comment on pull request #17816: URL: https://github.com/apache/flink/pull/17816#issuecomment-971338462 ## CI report: * 251f55c950101b10454bfb031469e8cd643ea512 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26641) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17816: [FLINK-24922][docs] Backport fix spelling errors in the word "parallism"
flinkbot edited a comment on pull request #17816: URL: https://github.com/apache/flink/pull/17816#issuecomment-971338462 ## CI report: * 251f55c950101b10454bfb031469e8cd643ea512 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26641) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17653: FLINK SQL checkpoint不生效
flinkbot edited a comment on pull request #17653: URL: https://github.com/apache/flink/pull/17653#issuecomment-958686553 ## CI report: * a2e241da13d788d165fe7f106b38f707a1cbf79f Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26918) * ada27e3b9794b57ec4cc20b096f1bc93827b0953 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] beyond1920 merged pull request #17817: [FLINK-24922][docs] Backport fix spelling errors in the word "parallism"
beyond1920 merged pull request #17817: URL: https://github.com/apache/flink/pull/17817 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #17670: [FLINK-24760][docs] Update user document for batch window tvf
flinkbot edited a comment on pull request #17670: URL: https://github.com/apache/flink/pull/17670#issuecomment-960539433 ## CI report: * 7c571626f1139e8af963bc3314de12a801587f52 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26926) Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
