[jira] [Issue Comment Deleted] (FLINK-3955) Change Table.toSink() to Table.writeToSink()
[
https://issues.apache.org/jira/browse/FLINK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax updated FLINK-3955:
---
Comment: was deleted
(was: I am not sure if this name solve the issue. What about
{{Table.toDataSet()}} ?)
> Change Table.toSink() to Table.writeToSink()
>
>
> Key: FLINK-3955
> URL: https://issues.apache.org/jira/browse/FLINK-3955
> Project: Flink
> Issue Type: Improvement
> Components: Table API
>Affects Versions: 1.1.0
>Reporter: Fabian Hueske
>Assignee: Fabian Hueske
>
> Currently, a {{Table}} can be emitted to a {{TableSink}} using the
> {{Table.toSink()}} method.
> However, the name of the method indicates that the {{Table}} is converted
> into a {{Sink}}.
> Therefore, I propose to change the method to {{Table.writeToSink()}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-3955) Change Table.toSink() to Table.writeToSink()
[
https://issues.apache.org/jira/browse/FLINK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296356#comment-15296356
]
Matthias J. Sax commented on FLINK-3955:
I am not sure if this name solve the issue. What about {{Table.toDataSet()}} ?
> Change Table.toSink() to Table.writeToSink()
>
>
> Key: FLINK-3955
> URL: https://issues.apache.org/jira/browse/FLINK-3955
> Project: Flink
> Issue Type: Improvement
> Components: Table API
>Affects Versions: 1.1.0
>Reporter: Fabian Hueske
>Assignee: Fabian Hueske
>
> Currently, a {{Table}} can be emitted to a {{TableSink}} using the
> {{Table.toSink()}} method.
> However, the name of the method indicates that the {{Table}} is converted
> into a {{Sink}}.
> Therefore, I propose to change the method to {{Table.writeToSink()}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-3404) Extend Kafka consumers with interface StoppableFunction
[
https://issues.apache.org/jira/browse/FLINK-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264146#comment-15264146
]
Matthias J. Sax commented on FLINK-3404:
I think so. [~rmetzger] can you comment on this, as you are most familiar with
KafkaSource.
> Extend Kafka consumers with interface StoppableFunction
> ---
>
> Key: FLINK-3404
> URL: https://issues.apache.org/jira/browse/FLINK-3404
> Project: Flink
> Issue Type: Improvement
> Components: Kafka Connector
>Reporter: Matthias J. Sax
>
> Kafka consumers are not stoppable right now. To make them stoppable, they
> must implement {{StoppableFunction}}. Implementing method {{stop()}} must
> ensure, that the consumer stops pulling new messages from Kafka and issues a
> final checkpoint with the last offset. Afterwards, {{run()}} must return.
> When implementing this, keep in mind, that the gathered checkpoint might
> later be used as a savepoint.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-3601) JobManagerTest times out on StopSignal test
[
https://issues.apache.org/jira/browse/FLINK-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15260002#comment-15260002
]
Matthias J. Sax commented on FLINK-3601:
[~mxm] Are you working on this? If not, I could fix this.
> JobManagerTest times out on StopSignal test
> ---
>
> Key: FLINK-3601
> URL: https://issues.apache.org/jira/browse/FLINK-3601
> Project: Flink
> Issue Type: Bug
> Components: JobManager, Tests
>Affects Versions: 1.1.0
>Reporter: Maximilian Michels
>Assignee: Maximilian Michels
>Priority: Minor
> Labels: test-stability
>
> {noformat}
> testStopSignal(org.apache.flink.runtime.jobmanager.JobManagerTest) Time
> elapsed: 8.018 sec <<< FAILURE!
> java.lang.AssertionError: assertion failed: timeout (3 seconds) during
> expectMsgClass waiting for class
> org.apache.flink.runtime.messages.JobManagerMessages$JobResultSuccess
> at scala.Predef$.assert(Predef.scala:165)
> at
> akka.testkit.TestKitBase$class.expectMsgClass_internal(TestKit.scala:423)
> at akka.testkit.TestKitBase$class.expectMsgClass(TestKit.scala:410)
> at akka.testkit.TestKit.expectMsgClass(TestKit.scala:718)
> at akka.testkit.JavaTestKit.expectMsgClass(JavaTestKit.java:397)
> at
> org.apache.flink.runtime.jobmanager.JobManagerTest$2.(JobManagerTest.java:273)
> at
> org.apache.flink.runtime.jobmanager.JobManagerTest.testStopSignal(JobManagerTest.java:237)
> {noformat}
> I propose to replace the default timeout per {{expectMsg}} of 3 seconds with
> a total test duration of 15 seconds.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-3380) Unstable Test: JobSubmissionFailsITCase
[ https://issues.apache.org/jira/browse/FLINK-3380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1526#comment-1526 ] Matthias J. Sax commented on FLINK-3380: [~uce] Can this be closed? PR1611 was merged long ago. > Unstable Test: JobSubmissionFailsITCase > --- > > Key: FLINK-3380 > URL: https://issues.apache.org/jira/browse/FLINK-3380 > Project: Flink > Issue Type: Bug >Reporter: Kostas Kloudas >Priority: Critical > Labels: test-stability > > https://s3.amazonaws.com/archive.travis-ci.org/jobs/108034635/log.txt -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-3523) Storm SpoutSplitExample fails with a ClassCastException
[
https://issues.apache.org/jira/browse/FLINK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15228381#comment-15228381
]
Matthias J. Sax commented on FLINK-3523:
fixed via 02ef68fb4adbd413fa159c35980412f280179cbf
> Storm SpoutSplitExample fails with a ClassCastException
> ---
>
> Key: FLINK-3523
> URL: https://issues.apache.org/jira/browse/FLINK-3523
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Reporter: Stephan Ewen
>Assignee: Matthias J. Sax
>
> {code}
> Caused by: java.lang.ClassCastException:
> org.apache.flink.storm.util.SplitStreamType cannot be cast to
> java.lang.Integer
> at
> org.apache.flink.storm.wrappers.StormTuple.getInteger(StormTuple.java:152)
> at
> org.apache.flink.storm.split.operators.VerifyAndEnrichBolt.execute(VerifyAndEnrichBolt.java:52)
> at
> org.apache.flink.storm.wrappers.BoltWrapper.processElement(BoltWrapper.java:313)
> at
> org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:168)
> at
> org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:65)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:224)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
> at java.lang.Thread.run(Thread.java:745)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (FLINK-3523) Storm SpoutSplitExample fails with a ClassCastException
[
https://issues.apache.org/jira/browse/FLINK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax resolved FLINK-3523.
Resolution: Fixed
> Storm SpoutSplitExample fails with a ClassCastException
> ---
>
> Key: FLINK-3523
> URL: https://issues.apache.org/jira/browse/FLINK-3523
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Reporter: Stephan Ewen
>Assignee: Matthias J. Sax
>
> {code}
> Caused by: java.lang.ClassCastException:
> org.apache.flink.storm.util.SplitStreamType cannot be cast to
> java.lang.Integer
> at
> org.apache.flink.storm.wrappers.StormTuple.getInteger(StormTuple.java:152)
> at
> org.apache.flink.storm.split.operators.VerifyAndEnrichBolt.execute(VerifyAndEnrichBolt.java:52)
> at
> org.apache.flink.storm.wrappers.BoltWrapper.processElement(BoltWrapper.java:313)
> at
> org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:168)
> at
> org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:65)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:224)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
> at java.lang.Thread.run(Thread.java:745)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-2392) Instable test in flink-yarn-tests
[
https://issues.apache.org/jira/browse/FLINK-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221460#comment-15221460
]
Matthias J. Sax commented on FLINK-2392:
Yes. See post above from03/Dec/15
> Instable test in flink-yarn-tests
> -
>
> Key: FLINK-2392
> URL: https://issues.apache.org/jira/browse/FLINK-2392
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Affects Versions: 0.10.0
>Reporter: Matthias J. Sax
>Assignee: Robert Metzger
>Priority: Critical
> Labels: test-stability
> Fix For: 1.0.0
>
>
> The test YARNSessionFIFOITCase fails from time to time on an irregular basis.
> For example see: https://travis-ci.org/apache/flink/jobs/72019690
> {noformat}
> Tests run: 12, Failures: 1, Errors: 0, Skipped: 2, Time elapsed: 205.163 sec
> <<< FAILURE! - in org.apache.flink.yarn.YARNSessionFIFOITCase
> perJobYarnClusterWithParallelism(org.apache.flink.yarn.YARNSessionFIFOITCase)
> Time elapsed: 60.651 sec <<< FAILURE!
> java.lang.AssertionError: During the timeout period of 60 seconds the
> expected string did not show up
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.apache.flink.yarn.YarnTestBase.runWithArgs(YarnTestBase.java:478)
> at
> org.apache.flink.yarn.YARNSessionFIFOITCase.perJobYarnClusterWithParallelism(YARNSessionFIFOITCase.java:435)
> Results :
> Failed tests:
>
> YARNSessionFIFOITCase.perJobYarnClusterWithParallelism:435->YarnTestBase.runWithArgs:478
> During the timeout period of 60 seconds the expected string did not show up
> {noformat}
> Another error case is this (see
> https://travis-ci.org/mjsax/flink/jobs/77313444)
> {noformat}
> Tests run: 12, Failures: 3, Errors: 0, Skipped: 2, Time elapsed: 182.008 sec
> <<< FAILURE! - in org.apache.flink.yarn.YARNSessionFIFOITCase
> testTaskManagerFailure(org.apache.flink.yarn.YARNSessionFIFOITCase) Time
> elapsed: 27.356 sec <<< FAILURE!
> java.lang.AssertionError: Found a file
> /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_03/taskmanager.log
> with a prohibited string: [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:294)
> at
> org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:94)
> testNonexistingQueue(org.apache.flink.yarn.YARNSessionFIFOITCase) Time
> elapsed: 17.421 sec <<< FAILURE!
> java.lang.AssertionError: Found a file
> /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_03/taskmanager.log
> with a prohibited string: [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:294)
> at
> org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:94)
> testJavaAPI(org.apache.flink.yarn.YARNSessionFIFOITCase) Time elapsed:
> 11.984 sec <<< FAILURE!
> java.lang.AssertionError: Found a file
> /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_03/taskmanager.log
> with a prohibited string: [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:294)
> at
> org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:94)
> {noformat}
> Furthermore, this build failed too:
> https://travis-ci.org/apache/flink/jobs/77313450
> (no error, but Travis terminated to due no progress for 300 seconds ->
> deadlock?)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-2392) Instable test in flink-yarn-tests
[
https://issues.apache.org/jira/browse/FLINK-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221299#comment-15221299
]
Matthias J. Sax commented on FLINK-2392:
https://s3.amazonaws.com/archive.travis-ci.org/jobs/119950627/log.txt
> Instable test in flink-yarn-tests
> -
>
> Key: FLINK-2392
> URL: https://issues.apache.org/jira/browse/FLINK-2392
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Affects Versions: 0.10.0
>Reporter: Matthias J. Sax
>Assignee: Robert Metzger
>Priority: Critical
> Labels: test-stability
> Fix For: 1.0.0
>
>
> The test YARNSessionFIFOITCase fails from time to time on an irregular basis.
> For example see: https://travis-ci.org/apache/flink/jobs/72019690
> {noformat}
> Tests run: 12, Failures: 1, Errors: 0, Skipped: 2, Time elapsed: 205.163 sec
> <<< FAILURE! - in org.apache.flink.yarn.YARNSessionFIFOITCase
> perJobYarnClusterWithParallelism(org.apache.flink.yarn.YARNSessionFIFOITCase)
> Time elapsed: 60.651 sec <<< FAILURE!
> java.lang.AssertionError: During the timeout period of 60 seconds the
> expected string did not show up
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.apache.flink.yarn.YarnTestBase.runWithArgs(YarnTestBase.java:478)
> at
> org.apache.flink.yarn.YARNSessionFIFOITCase.perJobYarnClusterWithParallelism(YARNSessionFIFOITCase.java:435)
> Results :
> Failed tests:
>
> YARNSessionFIFOITCase.perJobYarnClusterWithParallelism:435->YarnTestBase.runWithArgs:478
> During the timeout period of 60 seconds the expected string did not show up
> {noformat}
> Another error case is this (see
> https://travis-ci.org/mjsax/flink/jobs/77313444)
> {noformat}
> Tests run: 12, Failures: 3, Errors: 0, Skipped: 2, Time elapsed: 182.008 sec
> <<< FAILURE! - in org.apache.flink.yarn.YARNSessionFIFOITCase
> testTaskManagerFailure(org.apache.flink.yarn.YARNSessionFIFOITCase) Time
> elapsed: 27.356 sec <<< FAILURE!
> java.lang.AssertionError: Found a file
> /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_03/taskmanager.log
> with a prohibited string: [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:294)
> at
> org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:94)
> testNonexistingQueue(org.apache.flink.yarn.YARNSessionFIFOITCase) Time
> elapsed: 17.421 sec <<< FAILURE!
> java.lang.AssertionError: Found a file
> /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_03/taskmanager.log
> with a prohibited string: [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:294)
> at
> org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:94)
> testJavaAPI(org.apache.flink.yarn.YARNSessionFIFOITCase) Time elapsed:
> 11.984 sec <<< FAILURE!
> java.lang.AssertionError: Found a file
> /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_03/taskmanager.log
> with a prohibited string: [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:294)
> at
> org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:94)
> {noformat}
> Furthermore, this build failed too:
> https://travis-ci.org/apache/flink/jobs/77313450
> (no error, but Travis terminated to due no progress for 300 seconds ->
> deadlock?)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Assigned] (FLINK-3523) Storm SpoutSplitExample fails with a ClassCastException
[
https://issues.apache.org/jira/browse/FLINK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax reassigned FLINK-3523:
--
Assignee: Matthias J. Sax
> Storm SpoutSplitExample fails with a ClassCastException
> ---
>
> Key: FLINK-3523
> URL: https://issues.apache.org/jira/browse/FLINK-3523
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Reporter: Stephan Ewen
>Assignee: Matthias J. Sax
>
> {code}
> Caused by: java.lang.ClassCastException:
> org.apache.flink.storm.util.SplitStreamType cannot be cast to
> java.lang.Integer
> at
> org.apache.flink.storm.wrappers.StormTuple.getInteger(StormTuple.java:152)
> at
> org.apache.flink.storm.split.operators.VerifyAndEnrichBolt.execute(VerifyAndEnrichBolt.java:52)
> at
> org.apache.flink.storm.wrappers.BoltWrapper.processElement(BoltWrapper.java:313)
> at
> org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:168)
> at
> org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:65)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:224)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
> at java.lang.Thread.run(Thread.java:745)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (FLINK-2338) Shut down "Storm Topologies" cleanly
[ https://issues.apache.org/jira/browse/FLINK-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax closed FLINK-2338. -- Resolution: Fixed > Shut down "Storm Topologies" cleanly > > > Key: FLINK-2338 > URL: https://issues.apache.org/jira/browse/FLINK-2338 > Project: Flink > Issue Type: Improvement > Components: Storm Compatibility >Reporter: Matthias J. Sax >Assignee: Matthias J. Sax >Priority: Minor > > Currently, it is not possible to stop a Flink streaming program in a clean > way. Thus, emulating Storm's "kill" command is done the "hard way" resulting > in the following exception shown in the log: > org.apache.flink.runtime.client.JobExecutionException: Communication with > JobManager failed: Lost connection to JobManager akka://flink/user/jobmanager > at > org.apache.flink.runtime.client.JobClient.submitJobAndWait(JobClient.java:169) > at > org.apache.flink.runtime.minicluster.FlinkMiniCluster.submitJobAndWait(FlinkMiniCluster.scala:205) > at > org.apache.flink.runtime.minicluster.FlinkMiniCluster.submitJobAndWait(FlinkMiniCluster.scala:195) > at > org.apache.flink.streaming.util.TestStreamEnvironment$1.run(TestStreamEnvironment.java:116) > Caused by: java.lang.Exception: Lost connection to JobManager > akka://flink/user/jobmanager > at > org.apache.flink.runtime.client.JobClientActor.onReceive(JobClientActor.java:131) > at > akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167) > at akka.actor.Actor$class.aroundReceive(Actor.scala:465) > at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97) > at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) > at > akka.actor.dungeon.DeathWatch$class.receivedTerminated(DeathWatch.scala:46) > at akka.actor.ActorCell.receivedTerminated(ActorCell.scala:369) > at akka.actor.ActorCell.autoReceiveMessage(ActorCell.scala:501) > at akka.actor.ActorCell.invoke(ActorCell.scala:486) > at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254) > at akka.dispatch.Mailbox.run(Mailbox.scala:221) > at akka.dispatch.Mailbox.exec(Mailbox.scala:231) > at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) > at > scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) > at > scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) > at > scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) > The exception is expected currently. However, a clean "kill" is preferable. > This can done after the new STOP signal is available > (https://issues.apache.org/jira/browse/FLINK-2111). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (FLINK-2111) Add "stop" signal to cleanly shutdown streaming jobs
[ https://issues.apache.org/jira/browse/FLINK-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax closed FLINK-2111. -- > Add "stop" signal to cleanly shutdown streaming jobs > > > Key: FLINK-2111 > URL: https://issues.apache.org/jira/browse/FLINK-2111 > Project: Flink > Issue Type: Improvement > Components: Distributed Runtime, JobManager, Local Runtime, > Streaming, TaskManager, Webfrontend >Reporter: Matthias J. Sax >Assignee: Matthias J. Sax >Priority: Minor > > Currently, streaming jobs can only be stopped using "cancel" command, what is > a "hard" stop with no clean shutdown. > The new introduced "stop" signal, will only affect streaming source tasks > such that the sources can stop emitting data and shutdown cleanly, resulting > in a clean shutdown of the whole streaming job. > This feature is a pre-requirment for > https://issues.apache.org/jira/browse/FLINK-1929 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-3409) Integrate STOP with Savepoints
Matthias J. Sax created FLINK-3409: -- Summary: Integrate STOP with Savepoints Key: FLINK-3409 URL: https://issues.apache.org/jira/browse/FLINK-3409 Project: Flink Issue Type: Improvement Components: Command-line client, JobManager Reporter: Matthias J. Sax Right now, if a savepoint is triggered the job keeps running. At the same time, on STOP a last checkpoint should be collected for a clean shutdown (WIP: https://issues.apache.org/jira/browse/FLINK-3408). This work should enable stopping a job and getting a final savepoint at the same time. Thus, a job can get stopped gracefully and resumed later on using the gathered checkpoint. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-3408) Make STOP signal reliable
Matthias J. Sax created FLINK-3408: -- Summary: Make STOP signal reliable Key: FLINK-3408 URL: https://issues.apache.org/jira/browse/FLINK-3408 Project: Flink Issue Type: Improvement Components: Distributed Runtime, JobManager, TaskManager Reporter: Matthias J. Sax Right now, STOP signal does not give any consistency guarantees. Thus, the signal might get (partial or completely) lost. In this work, it should be ensured, that STOP is never lost and a job is stopped gracefully if possible, including job restart after failure. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-3407) Extend TwitterSource with interface StoppableFunction
Matthias J. Sax created FLINK-3407:
--
Summary: Extend TwitterSource with interface StoppableFunction
Key: FLINK-3407
URL: https://issues.apache.org/jira/browse/FLINK-3407
Project: Flink
Issue Type: Improvement
Components: Streaming Connectors
Reporter: Matthias J. Sax
{{TwitterSource}} is not stoppable right now. To make it stoppable, is must
implement {{StoppableFunction}}. Implementing method {{stop()}} must ensure,
that the source stops receiving new Tweets and issues a final checkpoint.
Afterwards, {{run()}} must return.
When implementing this, keep in mind, that the gathered checkpoint might later
be used as a savepoint.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3406) Extend RabbitMQ source with interface StoppableFunction
Matthias J. Sax created FLINK-3406:
--
Summary: Extend RabbitMQ source with interface StoppableFunction
Key: FLINK-3406
URL: https://issues.apache.org/jira/browse/FLINK-3406
Project: Flink
Issue Type: Improvement
Components: Streaming Connectors
Reporter: Matthias J. Sax
{{RMQSource}} is not stoppable right now. To make it stoppable, is must
implement {{StoppableFunction}}. Implementing method {{stop()}} must ensure,
that the source stops receiving new messages from RabbitMQ and issues a final
checkpoint. Afterwards, {{run()}} must return.
When implementing this, keep in mind, that the gathered checkpoint might later
be used as a savepoint.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3405) Extend NiFiSource with interface StoppableFunction
Matthias J. Sax created FLINK-3405:
--
Summary: Extend NiFiSource with interface StoppableFunction
Key: FLINK-3405
URL: https://issues.apache.org/jira/browse/FLINK-3405
Project: Flink
Issue Type: Improvement
Components: Streaming Connectors
Reporter: Matthias J. Sax
Nifi source is not stoppable right now. To make it stoppable, is must implement
{{StoppableFunction}}. Implementing method {{stop()}} must ensure, that the
source stops receiving new messages from Nifi and issues a final checkpoint.
Afterwards, {{run()}} must return.
When implementing this, keep in mind, that the gathered checkpoint might later
be used as a savepoint.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3404) Extend Kafka consumers with interface StoppableFunction
Matthias J. Sax created FLINK-3404:
--
Summary: Extend Kafka consumers with interface StoppableFunction
Key: FLINK-3404
URL: https://issues.apache.org/jira/browse/FLINK-3404
Project: Flink
Issue Type: Improvement
Components: Kafka Connector
Reporter: Matthias J. Sax
Kafka consumers are not stoppable right now. To make them stoppable, they must
implement {{StoppableFunction}}. Implementing method {{stop()}} must ensure,
that the consumer stops pulling new messages from Kafka and issues a final
checkpoint with the last offset. Afterwards, {{run()}} must return.
When implementing this, keep in mind, that the gathered checkpoint might later
be used as a savepoint.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-3356) JobClientActorRecoveryITCase.testJobClientRecovery
[
https://issues.apache.org/jira/browse/FLINK-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140840#comment-15140840
]
Matthias J. Sax commented on FLINK-3356:
https://travis-ci.org/mjsax/flink/jobs/108263582
> JobClientActorRecoveryITCase.testJobClientRecovery
> --
>
> Key: FLINK-3356
> URL: https://issues.apache.org/jira/browse/FLINK-3356
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
>
> https://travis-ci.org/apache/flink/jobs/107597706
> https://travis-ci.org/mjsax/flink/jobs/107597700
> {noformat}
> Tests in error:
> JobClientActorRecoveryITCase.testJobClientRecovery:135 » Timeout Futures
> timed...
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-2915) JobManagerProcessFailureBatchRecoveryITCase
[
https://issues.apache.org/jira/browse/FLINK-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140844#comment-15140844
]
Matthias J. Sax commented on FLINK-2915:
https://travis-ci.org/apache/flink/jobs/108263590
> JobManagerProcessFailureBatchRecoveryITCase
> ---
>
> Key: FLINK-2915
> URL: https://issues.apache.org/jira/browse/FLINK-2915
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
>
> https://travis-ci.org/apache/flink/jobs/87193692
> {noformat}
> Failed tests:
> JobManagerProcessFailureBatchRecoveryITCase>AbstractJobManagerProcessFailureRecoveryITCase.testJobManagerProcessFailure:259
> JobManager did not start up within 291736881301 nanoseconds.
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (FLINK-3035) Redis as State Backend
[ https://issues.apache.org/jira/browse/FLINK-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136904#comment-15136904 ] Matthias J. Sax edited comment on FLINK-3035 at 2/8/16 12:52 PM: - The embedded-redis project seems not to be something officially. Thus, I would not go for it. Requiring an external Redis server sound reasonable to me. If you have further questions, I would like you to move this discussion to the dev mailing list. This allows others to follow the discussion more easily. Thanks. was (Author: mjsax): The embedded-redis project seems not to be something officially. Thus, I would not go for it. Requiring an external Redis server sound reasonable to to me. > Redis as State Backend > -- > > Key: FLINK-3035 > URL: https://issues.apache.org/jira/browse/FLINK-3035 > Project: Flink > Issue Type: New Feature > Components: Streaming >Reporter: Matthias J. Sax >Assignee: Subhobrata Dey >Priority: Minor > > Add Redis as a state backend for distributed snapshots. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-3035) Redis as State Backend
[ https://issues.apache.org/jira/browse/FLINK-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136904#comment-15136904 ] Matthias J. Sax commented on FLINK-3035: The embedded-redis project seems not to be something officially. Thus, I would not go for it. Requiring an external Redis server sound reasonable to to me. > Redis as State Backend > -- > > Key: FLINK-3035 > URL: https://issues.apache.org/jira/browse/FLINK-3035 > Project: Flink > Issue Type: New Feature > Components: Streaming >Reporter: Matthias J. Sax >Assignee: Subhobrata Dey >Priority: Minor > > Add Redis as a state backend for distributed snapshots. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (FLINK-1870) Reintroduce Indexed reader functionality to streaming
[ https://issues.apache.org/jira/browse/FLINK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax closed FLINK-1870. -- Resolution: Not A Problem > Reintroduce Indexed reader functionality to streaming > - > > Key: FLINK-1870 > URL: https://issues.apache.org/jira/browse/FLINK-1870 > Project: Flink > Issue Type: Task > Components: Streaming >Reporter: Gyula Fora >Assignee: Matthias J. Sax >Priority: Minor > > The Indexed record reader classes (IndexedReaderIterator, > IndexedMutableReader) were introduced to allow the streaming operators to > access the index of the last read channel from the input gate. This was a > necessary step toward future input sorting operators. > Unfortunately this untested feature was patched away by the following commit: > https://github.com/apache/flink/commit/5232c56b13b7e13e2cf10dbe818c221f5557426d > At some point we need to reimplement these features with proper tests. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2504) ExternalSortLargeRecordsITCase.testSortWithLongAndShortRecordsMixed failed spuriously
[
https://issues.apache.org/jira/browse/FLINK-2504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136372#comment-15136372
]
Matthias J. Sax commented on FLINK-2504:
Again: https://travis-ci.org/mjsax/flink/jobs/107597700
> ExternalSortLargeRecordsITCase.testSortWithLongAndShortRecordsMixed failed
> spuriously
> -
>
> Key: FLINK-2504
> URL: https://issues.apache.org/jira/browse/FLINK-2504
> Project: Flink
> Issue Type: Bug
>Affects Versions: 0.10.0
>Reporter: Till Rohrmann
>Priority: Critical
> Labels: test-stability
> Fix For: 1.0.0
>
>
> The test
> {{ExternalSortLargeRecordsITCase.testSortWithLongAndShortRecordsMixed}}
> failed in one of my Travis builds:
> https://travis-ci.org/tillrohrmann/flink/jobs/74881883
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-2915) JobManagerProcessFailureBatchRecoveryITCase
[
https://issues.apache.org/jira/browse/FLINK-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136374#comment-15136374
]
Matthias J. Sax commented on FLINK-2915:
One more: https://travis-ci.org/mjsax/flink/jobs/107597701
> JobManagerProcessFailureBatchRecoveryITCase
> ---
>
> Key: FLINK-2915
> URL: https://issues.apache.org/jira/browse/FLINK-2915
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
>
> https://travis-ci.org/apache/flink/jobs/87193692
> {noformat}
> Failed tests:
> JobManagerProcessFailureBatchRecoveryITCase>AbstractJobManagerProcessFailureRecoveryITCase.testJobManagerProcessFailure:259
> JobManager did not start up within 291736881301 nanoseconds.
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3356) JobClientActorRecoveryITCase.testJobClientRecovery
Matthias J. Sax created FLINK-3356:
--
Summary: JobClientActorRecoveryITCase.testJobClientRecovery
Key: FLINK-3356
URL: https://issues.apache.org/jira/browse/FLINK-3356
Project: Flink
Issue Type: Bug
Components: Tests
Reporter: Matthias J. Sax
Priority: Critical
https://travis-ci.org/apache/flink/jobs/107597706
https://travis-ci.org/mjsax/flink/jobs/107597700
{noformat}
Tests in error:
JobClientActorRecoveryITCase.testJobClientRecovery:135 » Timeout Futures
timed...
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (FLINK-2721) Add Tuple meta information
[
https://issues.apache.org/jira/browse/FLINK-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax closed FLINK-2721.
--
Resolution: Fixed
> Add Tuple meta information
> --
>
> Key: FLINK-2721
> URL: https://issues.apache.org/jira/browse/FLINK-2721
> Project: Flink
> Issue Type: New Feature
> Components: Storm Compatibility
>Reporter: Matthias J. Sax
>Assignee: Matthias J. Sax
>Priority: Minor
>
> In {{Bolt.execute(Tuple input)}} the given input tuple contains meta
> information about its origin (like source component name, stream id, source
> task ID).
> This meta information in currently not provided by Flink and the
> corresponding methods throw an {{UnsupportedOperationException}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3344) EventTimeWindowCheckpointingITCase.testPreAggregatedTumblingTimeWindow
Matthias J. Sax created FLINK-3344:
--
Summary:
EventTimeWindowCheckpointingITCase.testPreAggregatedTumblingTimeWindow
Key: FLINK-3344
URL: https://issues.apache.org/jira/browse/FLINK-3344
Project: Flink
Issue Type: Bug
Components: Tests
Reporter: Matthias J. Sax
Priority: Critical
https://travis-ci.org/apache/flink/jobs/107198388
https://travis-ci.org/mjsax/flink/jobs/107198383
{noformat}
Maven produced no output for 300 seconds.
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3324) Flume connector not documented
Matthias J. Sax created FLINK-3324: -- Summary: Flume connector not documented Key: FLINK-3324 URL: https://issues.apache.org/jira/browse/FLINK-3324 Project: Flink Issue Type: Improvement Components: Documentation Reporter: Matthias J. Sax Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (FLINK-3324) Flume connector not documented
[
https://issues.apache.org/jira/browse/FLINK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax updated FLINK-3324:
---
Description: Add Flume-connector documentation to the "Data Stream /
Connectors" web page docs. Also clean up the code by removing dummy files
{{FlumeSource.java}} and {{FlumeTopology.java}}. See also FLINK-3323
> Flume connector not documented
> --
>
> Key: FLINK-3324
> URL: https://issues.apache.org/jira/browse/FLINK-3324
> Project: Flink
> Issue Type: Improvement
> Components: Documentation, Streaming Connectors
>Reporter: Matthias J. Sax
>Priority: Minor
>
> Add Flume-connector documentation to the "Data Stream / Connectors" web page
> docs. Also clean up the code by removing dummy files {{FlumeSource.java}} and
> {{FlumeTopology.java}}. See also FLINK-3323
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (FLINK-3324) Flume connector not documented
[
https://issues.apache.org/jira/browse/FLINK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax updated FLINK-3324:
---
Component/s: Streaming Connectors
> Flume connector not documented
> --
>
> Key: FLINK-3324
> URL: https://issues.apache.org/jira/browse/FLINK-3324
> Project: Flink
> Issue Type: Improvement
> Components: Documentation, Streaming Connectors
>Reporter: Matthias J. Sax
>Priority: Minor
>
> Add Flume-connector documentation to the "Data Stream / Connectors" web page
> docs. Also clean up the code by removing dummy files {{FlumeSource.java}} and
> {{FlumeTopology.java}}. See also FLINK-3323
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3323) Nifi connector not documented
Matthias J. Sax created FLINK-3323: -- Summary: Nifi connector not documented Key: FLINK-3323 URL: https://issues.apache.org/jira/browse/FLINK-3323 Project: Flink Issue Type: Improvement Components: Documentation Reporter: Matthias J. Sax Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (FLINK-3323) Nifi connector not documented
[ https://issues.apache.org/jira/browse/FLINK-3323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated FLINK-3323: --- Description: Add Nifi-connector documentation to the "Data Stream / Connectors" web page docs. See also FLINK-3324 > Nifi connector not documented > - > > Key: FLINK-3323 > URL: https://issues.apache.org/jira/browse/FLINK-3323 > Project: Flink > Issue Type: Improvement > Components: Documentation >Reporter: Matthias J. Sax >Priority: Minor > > Add Nifi-connector documentation to the "Data Stream / Connectors" web page > docs. See also FLINK-3324 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (FLINK-3324) Flume connector not documented
[
https://issues.apache.org/jira/browse/FLINK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax updated FLINK-3324:
---
Description: Add Flume-connector documentation to the "Data Stream /
Connectors" web page docs. See also FLINK-3323 (was: Add Flume-connector
documentation to the "Data Stream / Connectors" web page docs. Also clean up
the code by removing dummy files {{FlumeSource.java}} and
{{FlumeTopology.java}}. See also FLINK-3323)
> Flume connector not documented
> --
>
> Key: FLINK-3324
> URL: https://issues.apache.org/jira/browse/FLINK-3324
> Project: Flink
> Issue Type: Improvement
> Components: Documentation
>Reporter: Matthias J. Sax
>Priority: Minor
>
> Add Flume-connector documentation to the "Data Stream / Connectors" web page
> docs. See also FLINK-3323
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (FLINK-3324) Flume connector not documented
[
https://issues.apache.org/jira/browse/FLINK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax updated FLINK-3324:
---
Component/s: (was: Streaming Connectors)
> Flume connector not documented
> --
>
> Key: FLINK-3324
> URL: https://issues.apache.org/jira/browse/FLINK-3324
> Project: Flink
> Issue Type: Improvement
> Components: Documentation
>Reporter: Matthias J. Sax
>Priority: Minor
>
> Add Flume-connector documentation to the "Data Stream / Connectors" web page
> docs. Also clean up the code by removing dummy files {{FlumeSource.java}} and
> {{FlumeTopology.java}}. See also FLINK-3323
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-3034) Redis SInk Connector
[ https://issues.apache.org/jira/browse/FLINK-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128045#comment-15128045 ] Matthias J. Sax commented on FLINK-3034: [~sbcd90], if the PR gets opened, please help to review. > Redis SInk Connector > > > Key: FLINK-3034 > URL: https://issues.apache.org/jira/browse/FLINK-3034 > Project: Flink > Issue Type: New Feature > Components: Streaming Connectors >Reporter: Matthias J. Sax >Assignee: subhankar biswas >Priority: Minor > > Flink does not provide a sink connector for Redis. > See FLINK-3033 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-3035) Redis as State Backend
[ https://issues.apache.org/jira/browse/FLINK-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128050#comment-15128050 ] Matthias J. Sax commented on FLINK-3035: [~sbcd90], maybe you are interested in this ticket ;) > Redis as State Backend > -- > > Key: FLINK-3035 > URL: https://issues.apache.org/jira/browse/FLINK-3035 > Project: Flink > Issue Type: New Feature > Components: Streaming >Reporter: Matthias J. Sax >Priority: Minor > > Add Redis as a state backend for distributed snapshots. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-3033) Redis Source Connector
[ https://issues.apache.org/jira/browse/FLINK-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128048#comment-15128048 ] Matthias J. Sax commented on FLINK-3033: [~sbcd90], if the PR gets opened, please help to review. > Redis Source Connector > -- > > Key: FLINK-3033 > URL: https://issues.apache.org/jira/browse/FLINK-3033 > Project: Flink > Issue Type: New Feature > Components: Streaming Connectors >Reporter: Matthias J. Sax >Assignee: subhankar biswas >Priority: Minor > > Flink does not provide a source connector for Redis. > See FLINK-3034 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-3033) Redis Source Connector
[ https://issues.apache.org/jira/browse/FLINK-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125950#comment-15125950 ] Matthias J. Sax commented on FLINK-3033: [~neo20iitkgp] please assign the JIRA to yourself and open a PR. > Redis Source Connector > -- > > Key: FLINK-3033 > URL: https://issues.apache.org/jira/browse/FLINK-3033 > Project: Flink > Issue Type: New Feature > Components: Streaming Connectors >Reporter: Matthias J. Sax >Priority: Minor > > Flink does not provide a source connector for Redis. > See FLINK-3034 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-3034) Redis SInk Connector
[ https://issues.apache.org/jira/browse/FLINK-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125952#comment-15125952 ] Matthias J. Sax commented on FLINK-3034: @ [~neo20iitkgp] please assign the JIRA to yourself and open a PR. > Redis SInk Connector > > > Key: FLINK-3034 > URL: https://issues.apache.org/jira/browse/FLINK-3034 > Project: Flink > Issue Type: New Feature > Components: Streaming Connectors >Reporter: Matthias J. Sax >Priority: Minor > > Flink does not provide a sink connector for Redis. > See FLINK-3033 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-3238) EventTimeAllWindowCheckpointingITCase.testSlidingTimeWindow()
[ https://issues.apache.org/jira/browse/FLINK-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105812#comment-15105812 ] Matthias J. Sax commented on FLINK-3238: Also happend for `EventTimeAllWindowCheckpointingITCase.testTumblingTimeWindow` https://travis-ci.org/mjsax/flink/jobs/103179444 > EventTimeAllWindowCheckpointingITCase.testSlidingTimeWindow() > - > > Key: FLINK-3238 > URL: https://issues.apache.org/jira/browse/FLINK-3238 > Project: Flink > Issue Type: Bug > Components: Tests >Reporter: Matthias J. Sax > Labels: test-stability > > "Maven produced no output for 300 seconds." > https://travis-ci.org/mjsax/flink/jobs/102475719 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2586) Unstable Storm Compatibility Tests
[
https://issues.apache.org/jira/browse/FLINK-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101497#comment-15101497
]
Matthias J. Sax commented on FLINK-2586:
Fixed via d1c93d286b95f069f6ba0a4e60e3a34655a395e3
> Unstable Storm Compatibility Tests
> --
>
> Key: FLINK-2586
> URL: https://issues.apache.org/jira/browse/FLINK-2586
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Affects Versions: 0.10.0
>Reporter: Stephan Ewen
>Assignee: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
> Fix For: 1.0.0
>
>
> The Storm Compatibility tests frequently fail.
> The reason is that they kill the topologies after a certain time interval.
> That may fail on CI infrastructure when certain steps are delayed beyond
> usual. Trying to guarantee progress by time is inherently problematic:
> - Waiting too short makes tests unstable
> - Waiting too long makes tests slow
> The right way to go is letting the program decide when to terminate, for
> example by throwing a special {{SuccessException}}.
> Have a look at the Kafka connector tests, they do this a lot and hence run
> exactly as short or as long as they need to.
> Here is an example of a failed run:
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/77499577/log.txt
> From FLINK-2801
> bq. The tests for the storm compatibiliy layer are all working with timeouts
> (running the program for 10 seconds) and then checking whether teh expected
> result has been written.
> bq. That is inherently unstable and slow (long delays). They should be
> rewritten in a similar manner like for example the KafkaITCase tests, where
> the streaming jobs terminate themselves with a "SuccessException", which can
> be recognized as successful completion when thrown by the job client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (FLINK-2586) Unstable Storm Compatibility Tests
[
https://issues.apache.org/jira/browse/FLINK-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax resolved FLINK-2586.
Resolution: Fixed
> Unstable Storm Compatibility Tests
> --
>
> Key: FLINK-2586
> URL: https://issues.apache.org/jira/browse/FLINK-2586
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Affects Versions: 0.10.0
>Reporter: Stephan Ewen
>Assignee: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
> Fix For: 1.0.0
>
>
> The Storm Compatibility tests frequently fail.
> The reason is that they kill the topologies after a certain time interval.
> That may fail on CI infrastructure when certain steps are delayed beyond
> usual. Trying to guarantee progress by time is inherently problematic:
> - Waiting too short makes tests unstable
> - Waiting too long makes tests slow
> The right way to go is letting the program decide when to terminate, for
> example by throwing a special {{SuccessException}}.
> Have a look at the Kafka connector tests, they do this a lot and hence run
> exactly as short or as long as they need to.
> Here is an example of a failed run:
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/77499577/log.txt
> From FLINK-2801
> bq. The tests for the storm compatibiliy layer are all working with timeouts
> (running the program for 10 seconds) and then checking whether teh expected
> result has been written.
> bq. That is inherently unstable and slow (long delays). They should be
> rewritten in a similar manner like for example the KafkaITCase tests, where
> the streaming jobs terminate themselves with a "SuccessException", which can
> be recognized as successful completion when thrown by the job client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3238) EventTimeAllWindowCheckpointingITCase.testSlidingTimeWindow()
Matthias J. Sax created FLINK-3238: -- Summary: EventTimeAllWindowCheckpointingITCase.testSlidingTimeWindow() Key: FLINK-3238 URL: https://issues.apache.org/jira/browse/FLINK-3238 Project: Flink Issue Type: Bug Components: Tests Reporter: Matthias J. Sax "Maven produced no output for 300 seconds." https://travis-ci.org/mjsax/flink/jobs/102475719 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (FLINK-2847) Fix flaky test in StormTestBase.testJob
[
https://issues.apache.org/jira/browse/FLINK-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax closed FLINK-2847.
--
Resolution: Duplicate
StormTestBase was deleted by commit 88636799ee68cae80b093436ff2e5eace0675b95
> Fix flaky test in StormTestBase.testJob
> ---
>
> Key: FLINK-2847
> URL: https://issues.apache.org/jira/browse/FLINK-2847
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Henry Saputra
>Priority: Minor
> Labels: test-stability
>
> {code}
> testJob(org.apache.flink.storm.wordcount.WordCountLocalITCase) Time elapsed:
> 12.845 sec <<< FAILURE!
> java.lang.AssertionError: Different number of lines in expected and obtained
> result. expected:<801> but was:<0>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:743)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:555)
> at
> org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:305)
> at
> org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:291)
> at
> org.apache.flink.storm.wordcount.WordCountLocalITCase.postSubmit(WordCountLocalITCase.java:38)
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.815 sec -
> in org.apache.flink.storm.wordcount.BoltTokenizerWordCountWithNamesITCase
> Running org.apache.flink.storm.wordcount.BoltTokenizerWordCountITCase
> Running org.apache.flink.storm.wordcount.BoltTokenizerWordCountPojoITCase
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.55 sec - in
> org.apache.flink.storm.wordcount.BoltTokenizerWordCountPojoITCase
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.801 sec -
> in org.apache.flink.storm.wordcount.BoltTokenizerWordCountITCase
> Results :
> Failed tests:
>
> WordCountLocalITCase>StormTestBase.testJob:98->postSubmit:38->TestBaseUtils.compareResultsByLinesInMemory:291->TestBaseUtils.compareResultsByLinesInMemory:305
> Different number of lines in expected and obtained result. expected:<801>
> but was:<0>
> Tests run: 11, Failures: 1, Errors: 0, Skipped: 0
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-3175) KafkaITCase.testOffsetAutocommitTest
[
https://issues.apache.org/jira/browse/FLINK-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094306#comment-15094306
]
Matthias J. Sax commented on FLINK-3175:
Happened again: https://travis-ci.org/mjsax/flink/jobs/101866207
> KafkaITCase.testOffsetAutocommitTest
>
>
> Key: FLINK-3175
> URL: https://issues.apache.org/jira/browse/FLINK-3175
> Project: Flink
> Issue Type: Bug
> Components: Kafka Connector, Tests
>Reporter: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
>
> https://travis-ci.org/apache/flink/jobs/96981797
> {noformat}
> Tests run: 16, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 126.278 sec
> <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.KafkaITCase
> testOffsetAutocommitTest(org.apache.flink.streaming.connectors.kafka.KafkaITCase)
> Time elapsed: 12.735 sec <<< FAILURE!
> java.lang.AssertionError: Offset of o1=-915623761776 was not in range
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runOffsetAutocommitTest(KafkaConsumerTestBase.java:333)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaITCase.testOffsetAutocommitTest(KafkaITCase.java:56)
> Results :
> Failed tests:
> KafkaITCase.testOffsetAutocommitTest:56->KafkaConsumerTestBase.runOffsetAutocommitTest:333
> Offset of o1=-915623761776 was not in range
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-3212) JobManagerCheckpointRecoveryITCase
[
https://issues.apache.org/jira/browse/FLINK-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091516#comment-15091516
]
Matthias J. Sax commented on FLINK-3212:
Again: this time, test hung for 300 seconds and build got canceled:
https://travis-ci.org/mjsax/flink/jobs/101460076
> JobManagerCheckpointRecoveryITCase
> --
>
> Key: FLINK-3212
> URL: https://issues.apache.org/jira/browse/FLINK-3212
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
>
> {noformat}
> Tests in error:
> JobManagerCheckpointRecoveryITCase.testCheckpointRecoveryFailure:354 »
> IllegalState
> JobManagerCheckpointRecoveryITCase.testCheckpointedStreamingSumProgram:192 »
> IO
> {noformat}
> https://travis-ci.org/mjsax/flink/jobs/101407273
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3214) WindowCheckpointingITCase
Matthias J. Sax created FLINK-3214: -- Summary: WindowCheckpointingITCase Key: FLINK-3214 URL: https://issues.apache.org/jira/browse/FLINK-3214 Project: Flink Issue Type: Bug Components: Tests Reporter: Matthias J. Sax Priority: Critical No Output for 300 seconds. Build got canceled. https://travis-ci.org/apache/flink/jobs/101407292 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-3212) JobManagerCheckpointRecoveryITCase
Matthias J. Sax created FLINK-3212:
--
Summary: JobManagerCheckpointRecoveryITCase
Key: FLINK-3212
URL: https://issues.apache.org/jira/browse/FLINK-3212
Project: Flink
Issue Type: Bug
Components: Tests
Reporter: Matthias J. Sax
Priority: Critical
{noformat}
Tests in error:
JobManagerCheckpointRecoveryITCase.testCheckpointRecoveryFailure:354 »
IllegalState
JobManagerCheckpointRecoveryITCase.testCheckpointedStreamingSumProgram:192 » IO
{noformat}
https://travis-ci.org/mjsax/flink/jobs/101407273
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3199) KafkaITCase.testOneToOneSources
Matthias J. Sax created FLINK-3199:
--
Summary: KafkaITCase.testOneToOneSources
Key: FLINK-3199
URL: https://issues.apache.org/jira/browse/FLINK-3199
Project: Flink
Issue Type: Bug
Components: Tests
Reporter: Matthias J. Sax
Priority: Critical
https://travis-ci.org/mjsax/flink/jobs/100167558
{noformat}
Failed tests:
KafkaITCase.testOneToOneSources:96->KafkaConsumerTestBase.runOneToOneExactlyOnceTest:521->KafkaTestBase.tryExecute:318
Test failed: The program execution failed: Job execution failed.
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-3189) Error while parsing job arguments passed by CLI
[
https://issues.apache.org/jira/browse/FLINK-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15076284#comment-15076284
]
Matthias J. Sax commented on FLINK-3189:
The JIRA text was not correct. I juts updated it. The failing command is
{noformat}
bin/flink info myJarFile.jar -f flink -i -m 1
{noformat}
> Error while parsing job arguments passed by CLI
> ---
>
> Key: FLINK-3189
> URL: https://issues.apache.org/jira/browse/FLINK-3189
> Project: Flink
> Issue Type: Bug
> Components: Command-line client
>Affects Versions: 0.10.1
>Reporter: Filip Leczycki
>Priority: Minor
>
> Flink CLI treats job arguments provided in format "-" as its own
> parameters, which results in errors in execution.
> Example 1:
> call: >bin/flink info myJarFile.jar -f flink -i -m 1
> error: Unrecognized option: -f
> Example 2:
> Job myJarFile.jar is uploaded to web submission client, flink parameter box
> is empty
> program arguments box: -f flink -i -m 1
> error:
> An unexpected error occurred:
> Unrecognized option: -f
> org.apache.flink.client.cli.CliArgsException: Unrecognized option: -f
> at
> org.apache.flink.client.cli.CliFrontendParser.parseInfoCommand(CliFrontendParser.java:296)
> at org.apache.flink.client.CliFrontend.info(CliFrontend.java:376)
> at
> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:983)
> at
> org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:171)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:734)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
> at
> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532)
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453)
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965)
> at
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388)
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
> at
> org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
> at org.eclipse.jetty.server.Server.handle(Server.java:348)
> at
> org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596)
> at
> org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048)
> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549)
> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211)
> at
> org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425)
> at
> org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
> at java.lang.Thread.run(Thread.java:745)
> Execution of
> >bin/flink run myJarFile.jar -f flink -i -m 1
> works perfectly fine
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (FLINK-3189) Error while parsing job arguments passed by CLI
[ https://issues.apache.org/jira/browse/FLINK-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated FLINK-3189: --- Description: Flink CLI treats job arguments provided in format "-" as its own parameters, which results in errors in execution. Example 1: call: >bin/flink info myJarFile.jar -f flink -i -m 1 error: Unrecognized option: -f Example 2: Job myJarFile.jar is uploaded to web submission client, flink parameter box is empty program arguments box: -f flink -i -m 1 error: An unexpected error occurred: Unrecognized option: -f org.apache.flink.client.cli.CliArgsException: Unrecognized option: -f at org.apache.flink.client.cli.CliFrontendParser.parseInfoCommand(CliFrontendParser.java:296) at org.apache.flink.client.CliFrontend.info(CliFrontend.java:376) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:983) at org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:171) at javax.servlet.http.HttpServlet.service(HttpServlet.java:734) at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113) at org.eclipse.jetty.server.Server.handle(Server.java:348) at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596) at org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:549) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:211) at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:425) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:489) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436) at java.lang.Thread.run(Thread.java:745) Execution of >bin/flink run myJarFile.jar -f flink -i -m 1 works perfectly fine was: Flink CLI treats job arguments provided in format "-" as its own parameters, which results in errors in execution. Example 1: call: >bin/flink myJarFile.jar -f flink -i -m 1 error: Unrecognized option: -f Example 2: Job myJarFile.jar is uploaded to web submission client, flink parameter box is empty program arguments box: -f flink -i -m 1 error: An unexpected error occurred: Unrecognized option: -f org.apache.flink.client.cli.CliArgsException: Unrecognized option: -f at org.apache.flink.client.cli.CliFrontendParser.parseInfoCommand(CliFrontendParser.java:296) at org.apache.flink.client.CliFrontend.info(CliFrontend.java:376) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:983) at org.apache.flink.client.web.JobSubmissionServlet.doGet(JobSubmissionServlet.java:171) at javax.servlet.http.HttpServlet.service(HttpServlet.java:734) at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:532) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:453) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:965) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:388) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:187) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:901) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:47) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113) at org.eclipse.jetty.server.Server.handle(Server.java:348) at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:596) at
[jira] [Commented] (FLINK-3072) DbStateBackendTest
[
https://issues.apache.org/jira/browse/FLINK-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072624#comment-15072624
]
Matthias J. Sax commented on FLINK-3072:
Again: https://s3.amazonaws.com/archive.travis-ci.org/jobs/98922653/log.txt
> DbStateBackendTest
> --
>
> Key: FLINK-3072
> URL: https://issues.apache.org/jira/browse/FLINK-3072
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Matthias J. Sax
>Assignee: Gyula Fora
>Priority: Critical
> Labels: test-stability
>
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/92924255/log.txt
> {noformat}
> Tests run: 5, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 4.505 sec <<<
> FAILURE! - in org.apache.flink.contrib.streaming.state.DbStateBackendTest
> testCompaction(org.apache.flink.contrib.streaming.state.DbStateBackendTest)
> Time elapsed: 0.008 sec <<< ERROR!
> java.sql.SQLNonTransientConnectionException: java.net.ConnectException :
> Error connecting to server localhost on port 1,527 with message Connection
> refused.
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at
> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> at
> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> at java.net.Socket.connect(Socket.java:579)
> at java.net.Socket.connect(Socket.java:528)
> at java.net.Socket.(Socket.java:425)
> at java.net.Socket.(Socket.java:208)
> at javax.net.DefaultSocketFactory.createSocket(SocketFactory.java:271)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
> at java.security.AccessController.doPrivileged(Native Method)
> at org.apache.derby.client.net.NetAgent.(Unknown Source)
> at org.apache.derby.client.net.NetConnection.newAgent_(Unknown Source)
> at org.apache.derby.client.am.ClientConnection.(Unknown Source)
> at org.apache.derby.client.net.NetConnection.(Unknown Source)
> at
> org.apache.derby.client.net.ClientJDBCObjectFactoryImpl.newNetConnection(Unknown
> Source)
> at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source)
> at java.sql.DriverManager.getConnection(DriverManager.java:571)
> at java.sql.DriverManager.getConnection(DriverManager.java:215)
> at
> org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:45)
> at
> org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:51)
> at
> org.apache.flink.contrib.streaming.state.DbBackendConfig.createShardedConnection(DbBackendConfig.java:325)
> at
> org.apache.flink.contrib.streaming.state.DbStateBackend.initializeForJob(DbStateBackend.java:197)
> at
> org.apache.flink.contrib.streaming.state.DbStateBackendTest.testCompaction(DbStateBackendTest.java:242)
> testSetupAndSerialization(org.apache.flink.contrib.streaming.state.DbStateBackendTest)
> Time elapsed: 0.004 sec <<< ERROR!
> java.sql.SQLNonTransientConnectionException: java.net.ConnectException :
> Error connecting to server localhost on port 1,527 with message Connection
> refused.
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at
> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> at
> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> at java.net.Socket.connect(Socket.java:579)
> at java.net.Socket.connect(Socket.java:528)
> at java.net.Socket.(Socket.java:425)
> at java.net.Socket.(Socket.java:208)
> at javax.net.DefaultSocketFactory.createSocket(SocketFactory.java:271)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
> at java.security.AccessController.doPrivileged(Native Method)
> at org.apache.derby.client.net.NetAgent.(Unknown Source)
> at org.apache.derby.client.net.NetConnection.newAgent_(Unknown Source)
> at org.apache.derby.client.am.ClientConnection.(Unknown Source)
> at org.apache.derby.client.net.NetConnection.(Unknown Source)
> at
> org.apache.derby.client.net.ClientJDBCObjectFactoryImpl.newNetConnection(Unknown
> Source)
> at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source)
> at
[jira] [Commented] (FLINK-2837) FlinkTopologyBuilder cannot handle multiple input streams
[
https://issues.apache.org/jira/browse/FLINK-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072651#comment-15072651
]
Matthias J. Sax commented on FLINK-2837:
Sorry. :( I thought a PR is only required for committers if they work on
components they are not yet familiar with...
> FlinkTopologyBuilder cannot handle multiple input streams
> -
>
> Key: FLINK-2837
> URL: https://issues.apache.org/jira/browse/FLINK-2837
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Reporter: Matthias J. Sax
>Assignee: Matthias J. Sax
>
> FlinkTopologyBuilder cannot handle multiple input streams correctly. Instead
> of union the incoming streams, it replicates the consuming bolt and each
> (logical) instance processes one of the input streams.
> For example:
> {noformat}
> final FlinkTopologyBuilder builder = new FlinkTopologyBuilder();
> builder.setSpout(spoutId1, new FiniteRandomSpout(0, 10));
> builder.setSpout(spoutId2, new FiniteRandomSpout(1, 8));
> builder.setSpout(spoutId3, new FiniteRandomSpout(2, 13));
> builder.setBolt(boltId, new MergerBolt())
> .shuffleGrouping(spoutId1)
> .shuffleGrouping(spoutId2)
> .shuffleGrouping(spoutId3);
> builder.setBolt("sink", new BoltPrintSink(new SimpleOutputFormatter()))
> .shuffleGrouping(boltId);
> {noformat}
> will only print the data from a single source instead of all sources.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-2837) FlinkTopologyBuilder cannot handle multiple input streams
[
https://issues.apache.org/jira/browse/FLINK-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072627#comment-15072627
]
Matthias J. Sax commented on FLINK-2837:
Fixed via f7b113d965fd30db993cac99b63194dcd7869ad4
> FlinkTopologyBuilder cannot handle multiple input streams
> -
>
> Key: FLINK-2837
> URL: https://issues.apache.org/jira/browse/FLINK-2837
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Reporter: Matthias J. Sax
>Assignee: Matthias J. Sax
>
> FlinkTopologyBuilder cannot handle multiple input streams correctly. Instead
> of union the incoming streams, it replicates the consuming bolt and each
> (logical) instance processes one of the input streams.
> For example:
> {noformat}
> final FlinkTopologyBuilder builder = new FlinkTopologyBuilder();
> builder.setSpout(spoutId1, new FiniteRandomSpout(0, 10));
> builder.setSpout(spoutId2, new FiniteRandomSpout(1, 8));
> builder.setSpout(spoutId3, new FiniteRandomSpout(2, 13));
> builder.setBolt(boltId, new MergerBolt())
> .shuffleGrouping(spoutId1)
> .shuffleGrouping(spoutId2)
> .shuffleGrouping(spoutId3);
> builder.setBolt("sink", new BoltPrintSink(new SimpleOutputFormatter()))
> .shuffleGrouping(boltId);
> {noformat}
> will only print the data from a single source instead of all sources.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (FLINK-2837) FlinkTopologyBuilder cannot handle multiple input streams
[
https://issues.apache.org/jira/browse/FLINK-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax closed FLINK-2837.
--
Resolution: Fixed
> FlinkTopologyBuilder cannot handle multiple input streams
> -
>
> Key: FLINK-2837
> URL: https://issues.apache.org/jira/browse/FLINK-2837
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Reporter: Matthias J. Sax
>Assignee: Matthias J. Sax
>
> FlinkTopologyBuilder cannot handle multiple input streams correctly. Instead
> of union the incoming streams, it replicates the consuming bolt and each
> (logical) instance processes one of the input streams.
> For example:
> {noformat}
> final FlinkTopologyBuilder builder = new FlinkTopologyBuilder();
> builder.setSpout(spoutId1, new FiniteRandomSpout(0, 10));
> builder.setSpout(spoutId2, new FiniteRandomSpout(1, 8));
> builder.setSpout(spoutId3, new FiniteRandomSpout(2, 13));
> builder.setBolt(boltId, new MergerBolt())
> .shuffleGrouping(spoutId1)
> .shuffleGrouping(spoutId2)
> .shuffleGrouping(spoutId3);
> builder.setBolt("sink", new BoltPrintSink(new SimpleOutputFormatter()))
> .shuffleGrouping(boltId);
> {noformat}
> will only print the data from a single source instead of all sources.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Assigned] (FLINK-2837) FlinkTopologyBuilder cannot handle multiple input streams
[
https://issues.apache.org/jira/browse/FLINK-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax reassigned FLINK-2837:
--
Assignee: Matthias J. Sax (was: Maximilian Michels)
> FlinkTopologyBuilder cannot handle multiple input streams
> -
>
> Key: FLINK-2837
> URL: https://issues.apache.org/jira/browse/FLINK-2837
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Reporter: Matthias J. Sax
>Assignee: Matthias J. Sax
>
> FlinkTopologyBuilder cannot handle multiple input streams correctly. Instead
> of union the incoming streams, it replicates the consuming bolt and each
> (logical) instance processes one of the input streams.
> For example:
> {noformat}
> final FlinkTopologyBuilder builder = new FlinkTopologyBuilder();
> builder.setSpout(spoutId1, new FiniteRandomSpout(0, 10));
> builder.setSpout(spoutId2, new FiniteRandomSpout(1, 8));
> builder.setSpout(spoutId3, new FiniteRandomSpout(2, 13));
> builder.setBolt(boltId, new MergerBolt())
> .shuffleGrouping(spoutId1)
> .shuffleGrouping(spoutId2)
> .shuffleGrouping(spoutId3);
> builder.setBolt("sink", new BoltPrintSink(new SimpleOutputFormatter()))
> .shuffleGrouping(boltId);
> {noformat}
> will only print the data from a single source instead of all sources.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3175) KafkaITCase.testOffsetAutocommitTest
Matthias J. Sax created FLINK-3175:
--
Summary: KafkaITCase.testOffsetAutocommitTest
Key: FLINK-3175
URL: https://issues.apache.org/jira/browse/FLINK-3175
Project: Flink
Issue Type: Bug
Components: Kafka Connector, Tests
Reporter: Matthias J. Sax
Priority: Critical
https://travis-ci.org/apache/flink/jobs/96981797
{noformat}
Tests run: 16, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 126.278 sec
<<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.KafkaITCase
testOffsetAutocommitTest(org.apache.flink.streaming.connectors.kafka.KafkaITCase)
Time elapsed: 12.735 sec <<< FAILURE!
java.lang.AssertionError: Offset of o1=-915623761776 was not in range
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at
org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runOffsetAutocommitTest(KafkaConsumerTestBase.java:333)
at
org.apache.flink.streaming.connectors.kafka.KafkaITCase.testOffsetAutocommitTest(KafkaITCase.java:56)
Results :
Failed tests:
KafkaITCase.testOffsetAutocommitTest:56->KafkaConsumerTestBase.runOffsetAutocommitTest:333
Offset of o1=-915623761776 was not in range
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3142) CheckpointCoordinatorTest fails
Matthias J. Sax created FLINK-3142:
--
Summary: CheckpointCoordinatorTest fails
Key: FLINK-3142
URL: https://issues.apache.org/jira/browse/FLINK-3142
Project: Flink
Issue Type: Bug
Components: Tests
Reporter: Matthias J. Sax
Priority: Critical
https://travis-ci.org/mjsax/flink/jobs/95439203
{noformat}
Tests run: 14, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 63.713 sec <<<
FAILURE! - in org.apache.flink.runtime.checkpoint.CheckpointCoordinatorTest
testMaxConcurrentAttempsWithSubsumption(org.apache.flink.runtime.checkpoint.CheckpointCoordinatorTest)
Time elapsed: 60.145 sec <<< FAILURE!
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertNotNull(Assert.java:621)
at org.junit.Assert.assertNotNull(Assert.java:631)
at
org.apache.flink.runtime.checkpoint.CheckpointCoordinatorTest.testMaxConcurrentAttempsWithSubsumption(CheckpointCoordinatorTest.java:946)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-3096) ChaosMonkeyITCase fails in checkCleanRecoveryState with Unclean checkpoints
[ https://issues.apache.org/jira/browse/FLINK-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046511#comment-15046511 ] Matthias J. Sax commented on FLINK-3096: https://travis-ci.org/mjsax/flink/jobs/95439204 > ChaosMonkeyITCase fails in checkCleanRecoveryState with Unclean checkpoints > --- > > Key: FLINK-3096 > URL: https://issues.apache.org/jira/browse/FLINK-3096 > Project: Flink > Issue Type: Bug > Components: JobManager >Affects Versions: 1.0.0 >Reporter: Robert Metzger >Assignee: Ufuk Celebi > Labels: test-stability > > The issue occurred here: https://travis-ci.org/apache/flink/jobs/94155702 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-3096) ChaosMonkeyITCase fails in checkCleanRecoveryState with Unclean checkpoints
[ https://issues.apache.org/jira/browse/FLINK-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041549#comment-15041549 ] Matthias J. Sax commented on FLINK-3096: Happend again: https://s3.amazonaws.com/archive.travis-ci.org/jobs/94847219/log.txt > ChaosMonkeyITCase fails in checkCleanRecoveryState with Unclean checkpoints > --- > > Key: FLINK-3096 > URL: https://issues.apache.org/jira/browse/FLINK-3096 > Project: Flink > Issue Type: Bug > Components: JobManager >Affects Versions: 1.0.0 >Reporter: Robert Metzger >Assignee: Ufuk Celebi > Labels: test-stability > > The issue occurred here: https://travis-ci.org/apache/flink/jobs/94155702 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (FLINK-3072) DbStateBackendTest
[
https://issues.apache.org/jira/browse/FLINK-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax reopened FLINK-3072:
> DbStateBackendTest
> --
>
> Key: FLINK-3072
> URL: https://issues.apache.org/jira/browse/FLINK-3072
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Matthias J. Sax
>Assignee: Gyula Fora
>Priority: Critical
> Labels: test-stability
>
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/92924255/log.txt
> {noformat}
> Tests run: 5, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 4.505 sec <<<
> FAILURE! - in org.apache.flink.contrib.streaming.state.DbStateBackendTest
> testCompaction(org.apache.flink.contrib.streaming.state.DbStateBackendTest)
> Time elapsed: 0.008 sec <<< ERROR!
> java.sql.SQLNonTransientConnectionException: java.net.ConnectException :
> Error connecting to server localhost on port 1,527 with message Connection
> refused.
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at
> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> at
> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> at java.net.Socket.connect(Socket.java:579)
> at java.net.Socket.connect(Socket.java:528)
> at java.net.Socket.(Socket.java:425)
> at java.net.Socket.(Socket.java:208)
> at javax.net.DefaultSocketFactory.createSocket(SocketFactory.java:271)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
> at java.security.AccessController.doPrivileged(Native Method)
> at org.apache.derby.client.net.NetAgent.(Unknown Source)
> at org.apache.derby.client.net.NetConnection.newAgent_(Unknown Source)
> at org.apache.derby.client.am.ClientConnection.(Unknown Source)
> at org.apache.derby.client.net.NetConnection.(Unknown Source)
> at
> org.apache.derby.client.net.ClientJDBCObjectFactoryImpl.newNetConnection(Unknown
> Source)
> at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source)
> at java.sql.DriverManager.getConnection(DriverManager.java:571)
> at java.sql.DriverManager.getConnection(DriverManager.java:215)
> at
> org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:45)
> at
> org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:51)
> at
> org.apache.flink.contrib.streaming.state.DbBackendConfig.createShardedConnection(DbBackendConfig.java:325)
> at
> org.apache.flink.contrib.streaming.state.DbStateBackend.initializeForJob(DbStateBackend.java:197)
> at
> org.apache.flink.contrib.streaming.state.DbStateBackendTest.testCompaction(DbStateBackendTest.java:242)
> testSetupAndSerialization(org.apache.flink.contrib.streaming.state.DbStateBackendTest)
> Time elapsed: 0.004 sec <<< ERROR!
> java.sql.SQLNonTransientConnectionException: java.net.ConnectException :
> Error connecting to server localhost on port 1,527 with message Connection
> refused.
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at
> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> at
> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> at java.net.Socket.connect(Socket.java:579)
> at java.net.Socket.connect(Socket.java:528)
> at java.net.Socket.(Socket.java:425)
> at java.net.Socket.(Socket.java:208)
> at javax.net.DefaultSocketFactory.createSocket(SocketFactory.java:271)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
> at java.security.AccessController.doPrivileged(Native Method)
> at org.apache.derby.client.net.NetAgent.(Unknown Source)
> at org.apache.derby.client.net.NetConnection.newAgent_(Unknown Source)
> at org.apache.derby.client.am.ClientConnection.(Unknown Source)
> at org.apache.derby.client.net.NetConnection.(Unknown Source)
> at
> org.apache.derby.client.net.ClientJDBCObjectFactoryImpl.newNetConnection(Unknown
> Source)
> at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source)
> at java.sql.DriverManager.getConnection(DriverManager.java:571)
> at java.sql.DriverManager.getConnection(DriverManager.java:215)
> at
>
[jira] [Commented] (FLINK-3072) DbStateBackendTest
[
https://issues.apache.org/jira/browse/FLINK-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036835#comment-15036835
]
Matthias J. Sax commented on FLINK-3072:
Happened again. Yes, I did rebase to current master ;)
https://s3.amazonaws.com/archive.travis-ci.org/jobs/94500748/log.txt
{noformat}
Results :
Tests in error:
DbStateBackendTest.testCaching:328 » SQLNonTransientConnection DERBY SQL
error...
DbStateBackendTest.testCompaction:269 » SQLNonTransientConnection DERBY SQL
er...
DbStateBackendTest.testKeyValueState:194 » SQLNonTransientConnection DERBY
SQL...
DbStateBackendTest.testSerializableState:151 » SQLNonTransientConnection
DERBY...
DbStateBackendTest.testSetupAndSerialization:132 » SQLNonTransientConnection
D...
Tests run: 6, Failures: 0, Errors: 5, Skipped: 0
{noformat}
> DbStateBackendTest
> --
>
> Key: FLINK-3072
> URL: https://issues.apache.org/jira/browse/FLINK-3072
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Matthias J. Sax
>Assignee: Gyula Fora
>Priority: Critical
> Labels: test-stability
>
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/92924255/log.txt
> {noformat}
> Tests run: 5, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 4.505 sec <<<
> FAILURE! - in org.apache.flink.contrib.streaming.state.DbStateBackendTest
> testCompaction(org.apache.flink.contrib.streaming.state.DbStateBackendTest)
> Time elapsed: 0.008 sec <<< ERROR!
> java.sql.SQLNonTransientConnectionException: java.net.ConnectException :
> Error connecting to server localhost on port 1,527 with message Connection
> refused.
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at
> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> at
> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> at java.net.Socket.connect(Socket.java:579)
> at java.net.Socket.connect(Socket.java:528)
> at java.net.Socket.(Socket.java:425)
> at java.net.Socket.(Socket.java:208)
> at javax.net.DefaultSocketFactory.createSocket(SocketFactory.java:271)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
> at java.security.AccessController.doPrivileged(Native Method)
> at org.apache.derby.client.net.NetAgent.(Unknown Source)
> at org.apache.derby.client.net.NetConnection.newAgent_(Unknown Source)
> at org.apache.derby.client.am.ClientConnection.(Unknown Source)
> at org.apache.derby.client.net.NetConnection.(Unknown Source)
> at
> org.apache.derby.client.net.ClientJDBCObjectFactoryImpl.newNetConnection(Unknown
> Source)
> at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source)
> at java.sql.DriverManager.getConnection(DriverManager.java:571)
> at java.sql.DriverManager.getConnection(DriverManager.java:215)
> at
> org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:45)
> at
> org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:51)
> at
> org.apache.flink.contrib.streaming.state.DbBackendConfig.createShardedConnection(DbBackendConfig.java:325)
> at
> org.apache.flink.contrib.streaming.state.DbStateBackend.initializeForJob(DbStateBackend.java:197)
> at
> org.apache.flink.contrib.streaming.state.DbStateBackendTest.testCompaction(DbStateBackendTest.java:242)
> testSetupAndSerialization(org.apache.flink.contrib.streaming.state.DbStateBackendTest)
> Time elapsed: 0.004 sec <<< ERROR!
> java.sql.SQLNonTransientConnectionException: java.net.ConnectException :
> Error connecting to server localhost on port 1,527 with message Connection
> refused.
> at java.net.PlainSocketImpl.socketConnect(Native Method)
> at
> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> at
> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> at java.net.Socket.connect(Socket.java:579)
> at java.net.Socket.connect(Socket.java:528)
> at java.net.Socket.(Socket.java:425)
> at java.net.Socket.(Socket.java:208)
> at javax.net.DefaultSocketFactory.createSocket(SocketFactory.java:271)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
> at org.apache.derby.client.net.OpenSocketAction.run(Unknown
[jira] [Commented] (FLINK-2392) Instable test in flink-yarn-tests
[
https://issues.apache.org/jira/browse/FLINK-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036840#comment-15036840
]
Matthias J. Sax commented on FLINK-2392:
One more: https://s3.amazonaws.com/archive.travis-ci.org/jobs/94500744/log.tx
{noformat}
Results :
Failed tests:
YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:156 There is at least
one application on the cluster is not finished.App
application_1449096897760_0005 is in state RUNNING
YARNSessionFIFOITCase.testDetachedMode:131 Unable to find expected string
'The Flink YARN client has been started in detached mode' in log messages
YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:156 There is at least
one application on the cluster is not finished.App
application_1449096897760_0005 is in state RUNNING
YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:156 There is at least
one application on the cluster is not finished.App
application_1449096897760_0005 is in state RUNNING
YARNSessionFIFOITCase>YarnTestBase.checkClusterEmpty:156 There is at least
one application on the cluster is not finished.App
application_1449096897760_0005 is in state RUNNING
Tests run: 15, Failures: 5, Errors: 0, Skipped: 2
{noformat}
> Instable test in flink-yarn-tests
> -
>
> Key: FLINK-2392
> URL: https://issues.apache.org/jira/browse/FLINK-2392
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Affects Versions: 0.10.0
>Reporter: Matthias J. Sax
>Assignee: Robert Metzger
>Priority: Critical
> Labels: test-stability
> Fix For: 1.0.0
>
>
> The test YARNSessionFIFOITCase fails from time to time on an irregular basis.
> For example see: https://travis-ci.org/apache/flink/jobs/72019690
> {noformat}
> Tests run: 12, Failures: 1, Errors: 0, Skipped: 2, Time elapsed: 205.163 sec
> <<< FAILURE! - in org.apache.flink.yarn.YARNSessionFIFOITCase
> perJobYarnClusterWithParallelism(org.apache.flink.yarn.YARNSessionFIFOITCase)
> Time elapsed: 60.651 sec <<< FAILURE!
> java.lang.AssertionError: During the timeout period of 60 seconds the
> expected string did not show up
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.apache.flink.yarn.YarnTestBase.runWithArgs(YarnTestBase.java:478)
> at
> org.apache.flink.yarn.YARNSessionFIFOITCase.perJobYarnClusterWithParallelism(YARNSessionFIFOITCase.java:435)
> Results :
> Failed tests:
>
> YARNSessionFIFOITCase.perJobYarnClusterWithParallelism:435->YarnTestBase.runWithArgs:478
> During the timeout period of 60 seconds the expected string did not show up
> {noformat}
> Another error case is this (see
> https://travis-ci.org/mjsax/flink/jobs/77313444)
> {noformat}
> Tests run: 12, Failures: 3, Errors: 0, Skipped: 2, Time elapsed: 182.008 sec
> <<< FAILURE! - in org.apache.flink.yarn.YARNSessionFIFOITCase
> testTaskManagerFailure(org.apache.flink.yarn.YARNSessionFIFOITCase) Time
> elapsed: 27.356 sec <<< FAILURE!
> java.lang.AssertionError: Found a file
> /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_03/taskmanager.log
> with a prohibited string: [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:294)
> at
> org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:94)
> testNonexistingQueue(org.apache.flink.yarn.YARNSessionFIFOITCase) Time
> elapsed: 17.421 sec <<< FAILURE!
> java.lang.AssertionError: Found a file
> /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_03/taskmanager.log
> with a prohibited string: [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:294)
> at
> org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:94)
> testJavaAPI(org.apache.flink.yarn.YARNSessionFIFOITCase) Time elapsed:
> 11.984 sec <<< FAILURE!
> java.lang.AssertionError: Found a file
> /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_03/taskmanager.log
> with a prohibited string: [Exception, Started
> SelectChannelConnector@0.0.0.0:8081]
> at org.junit.Assert.fail(Assert.java:88)
>
[jira] [Created] (FLINK-3072) DbStateBackendTest
Matthias J. Sax created FLINK-3072:
--
Summary: DbStateBackendTest
Key: FLINK-3072
URL: https://issues.apache.org/jira/browse/FLINK-3072
Project: Flink
Issue Type: Bug
Components: Tests
Reporter: Matthias J. Sax
Priority: Critical
https://s3.amazonaws.com/archive.travis-ci.org/jobs/92924255/log.txt
{noformat}
Tests run: 5, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 4.505 sec <<<
FAILURE! - in org.apache.flink.contrib.streaming.state.DbStateBackendTest
testCompaction(org.apache.flink.contrib.streaming.state.DbStateBackendTest)
Time elapsed: 0.008 sec <<< ERROR!
java.sql.SQLNonTransientConnectionException: java.net.ConnectException : Error
connecting to server localhost on port 1,527 with message Connection refused.
at java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at java.net.Socket.(Socket.java:425)
at java.net.Socket.(Socket.java:208)
at javax.net.DefaultSocketFactory.createSocket(SocketFactory.java:271)
at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at org.apache.derby.client.net.NetAgent.(Unknown Source)
at org.apache.derby.client.net.NetConnection.newAgent_(Unknown Source)
at org.apache.derby.client.am.ClientConnection.(Unknown Source)
at org.apache.derby.client.net.NetConnection.(Unknown Source)
at
org.apache.derby.client.net.ClientJDBCObjectFactoryImpl.newNetConnection(Unknown
Source)
at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source)
at java.sql.DriverManager.getConnection(DriverManager.java:571)
at java.sql.DriverManager.getConnection(DriverManager.java:215)
at
org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:45)
at
org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:51)
at
org.apache.flink.contrib.streaming.state.DbBackendConfig.createShardedConnection(DbBackendConfig.java:325)
at
org.apache.flink.contrib.streaming.state.DbStateBackend.initializeForJob(DbStateBackend.java:197)
at
org.apache.flink.contrib.streaming.state.DbStateBackendTest.testCompaction(DbStateBackendTest.java:242)
testSetupAndSerialization(org.apache.flink.contrib.streaming.state.DbStateBackendTest)
Time elapsed: 0.004 sec <<< ERROR!
java.sql.SQLNonTransientConnectionException: java.net.ConnectException : Error
connecting to server localhost on port 1,527 with message Connection refused.
at java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at java.net.Socket.(Socket.java:425)
at java.net.Socket.(Socket.java:208)
at javax.net.DefaultSocketFactory.createSocket(SocketFactory.java:271)
at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at org.apache.derby.client.net.NetAgent.(Unknown Source)
at org.apache.derby.client.net.NetConnection.newAgent_(Unknown Source)
at org.apache.derby.client.am.ClientConnection.(Unknown Source)
at org.apache.derby.client.net.NetConnection.(Unknown Source)
at
org.apache.derby.client.net.ClientJDBCObjectFactoryImpl.newNetConnection(Unknown
Source)
at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source)
at java.sql.DriverManager.getConnection(DriverManager.java:571)
at java.sql.DriverManager.getConnection(DriverManager.java:215)
at
org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:45)
at
org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:51)
at
[jira] [Commented] (FLINK-3072) DbStateBackendTest
[
https://issues.apache.org/jira/browse/FLINK-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024633#comment-15024633
]
Matthias J. Sax commented on FLINK-3072:
Similar here:
https://s3.amazonaws.com/archive.travis-ci.org/jobs/92924256/log.txt
{noformat}
Tests run: 5, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 1.002 sec <<<
FAILURE! - in org.apache.flink.contrib.streaming.state.DbStateBackendTest
testCompaction(org.apache.flink.contrib.streaming.state.DbStateBackendTest)
Time elapsed: 0.008 sec <<< ERROR!
java.sql.SQLNonTransientConnectionException: java.net.ConnectException : Error
connecting to server localhost on port 1,527 with message Connection refused.
at java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at java.net.Socket.(Socket.java:425)
at java.net.Socket.(Socket.java:208)
at javax.net.DefaultSocketFactory.createSocket(SocketFactory.java:271)
at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at org.apache.derby.client.net.NetAgent.(Unknown Source)
at org.apache.derby.client.net.NetConnection.newAgent_(Unknown Source)
at org.apache.derby.client.am.ClientConnection.(Unknown Source)
at org.apache.derby.client.net.NetConnection.(Unknown Source)
at
org.apache.derby.client.net.ClientJDBCObjectFactoryImpl.newNetConnection(Unknown
Source)
at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source)
at java.sql.DriverManager.getConnection(DriverManager.java:571)
at java.sql.DriverManager.getConnection(DriverManager.java:215)
at
org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:45)
at
org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:51)
at
org.apache.flink.contrib.streaming.state.DbBackendConfig.createShardedConnection(DbBackendConfig.java:325)
at
org.apache.flink.contrib.streaming.state.DbStateBackend.initializeForJob(DbStateBackend.java:197)
at
org.apache.flink.contrib.streaming.state.DbStateBackendTest.testCompaction(DbStateBackendTest.java:242)
testSetupAndSerialization(org.apache.flink.contrib.streaming.state.DbStateBackendTest)
Time elapsed: 0.002 sec <<< ERROR!
java.sql.SQLNonTransientConnectionException: java.net.ConnectException : Error
connecting to server localhost on port 1,527 with message Connection refused.
at java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at java.net.Socket.(Socket.java:425)
at java.net.Socket.(Socket.java:208)
at javax.net.DefaultSocketFactory.createSocket(SocketFactory.java:271)
at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at org.apache.derby.client.net.NetAgent.(Unknown Source)
at org.apache.derby.client.net.NetConnection.newAgent_(Unknown Source)
at org.apache.derby.client.am.ClientConnection.(Unknown Source)
at org.apache.derby.client.net.NetConnection.(Unknown Source)
at
org.apache.derby.client.net.ClientJDBCObjectFactoryImpl.newNetConnection(Unknown
Source)
at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source)
at java.sql.DriverManager.getConnection(DriverManager.java:571)
at java.sql.DriverManager.getConnection(DriverManager.java:215)
at
org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:45)
at
org.apache.flink.contrib.streaming.state.ShardedConnection.(ShardedConnection.java:51)
at
org.apache.flink.contrib.streaming.state.DbBackendConfig.createShardedConnection(DbBackendConfig.java:325)
at
[jira] [Commented] (FLINK-2861) Fields grouping on split streams fails
[
https://issues.apache.org/jira/browse/FLINK-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024419#comment-15024419
]
Matthias J. Sax commented on FLINK-2861:
Fixed via 4c46b2feee2c1ecda21e5ba62d02dfd7df73e256
> Fields grouping on split streams fails
> --
>
> Key: FLINK-2861
> URL: https://issues.apache.org/jira/browse/FLINK-2861
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Affects Versions: 0.10.0
>Reporter: Stephan Ewen
>Assignee: Matthias J. Sax
>
> Using split streams works for shuffle grouping, but not for Fields grouping.
> The reason is that the KeySelector expects an array, and the given type is
> the {{SplitStreamType}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (FLINK-2861) Fields grouping on split streams fails
[
https://issues.apache.org/jira/browse/FLINK-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax resolved FLINK-2861.
Resolution: Fixed
> Fields grouping on split streams fails
> --
>
> Key: FLINK-2861
> URL: https://issues.apache.org/jira/browse/FLINK-2861
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Affects Versions: 0.10.0
>Reporter: Stephan Ewen
>Assignee: Matthias J. Sax
>
> Using split streams works for shuffle grouping, but not for Fields grouping.
> The reason is that the KeySelector expects an array, and the given type is
> the {{SplitStreamType}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-2837) FlinkTopologyBuilder cannot handle multiple input streams
[
https://issues.apache.org/jira/browse/FLINK-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021102#comment-15021102
]
Matthias J. Sax commented on FLINK-2837:
No. Go ahead with your PR.
> FlinkTopologyBuilder cannot handle multiple input streams
> -
>
> Key: FLINK-2837
> URL: https://issues.apache.org/jira/browse/FLINK-2837
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Reporter: Matthias J. Sax
>Assignee: Matthias J. Sax
>
> FlinkTopologyBuilder cannot handle multiple input streams correctly. Instead
> of union the incoming streams, it replicates the consuming bolt and each
> (logical) instance processes one of the input streams.
> For example:
> {noformat}
> final FlinkTopologyBuilder builder = new FlinkTopologyBuilder();
> builder.setSpout(spoutId1, new FiniteRandomSpout(0, 10));
> builder.setSpout(spoutId2, new FiniteRandomSpout(1, 8));
> builder.setSpout(spoutId3, new FiniteRandomSpout(2, 13));
> builder.setBolt(boltId, new MergerBolt())
> .shuffleGrouping(spoutId1)
> .shuffleGrouping(spoutId2)
> .shuffleGrouping(spoutId3);
> builder.setBolt("sink", new BoltPrintSink(new SimpleOutputFormatter()))
> .shuffleGrouping(boltId);
> {noformat}
> will only print the data from a single source instead of all sources.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (FLINK-2837) FlinkTopologyBuilder cannot handle multiple input streams
[
https://issues.apache.org/jira/browse/FLINK-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax updated FLINK-2837:
---
Assignee: Maximilian Michels (was: Matthias J. Sax)
> FlinkTopologyBuilder cannot handle multiple input streams
> -
>
> Key: FLINK-2837
> URL: https://issues.apache.org/jira/browse/FLINK-2837
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Reporter: Matthias J. Sax
>Assignee: Maximilian Michels
>
> FlinkTopologyBuilder cannot handle multiple input streams correctly. Instead
> of union the incoming streams, it replicates the consuming bolt and each
> (logical) instance processes one of the input streams.
> For example:
> {noformat}
> final FlinkTopologyBuilder builder = new FlinkTopologyBuilder();
> builder.setSpout(spoutId1, new FiniteRandomSpout(0, 10));
> builder.setSpout(spoutId2, new FiniteRandomSpout(1, 8));
> builder.setSpout(spoutId3, new FiniteRandomSpout(2, 13));
> builder.setBolt(boltId, new MergerBolt())
> .shuffleGrouping(spoutId1)
> .shuffleGrouping(spoutId2)
> .shuffleGrouping(spoutId3);
> builder.setBolt("sink", new BoltPrintSink(new SimpleOutputFormatter()))
> .shuffleGrouping(boltId);
> {noformat}
> will only print the data from a single source instead of all sources.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3053) SuccessAfterNetworkBuffersFailureITCase.testSuccessfulProgramAfterFailure
Matthias J. Sax created FLINK-3053:
--
Summary:
SuccessAfterNetworkBuffersFailureITCase.testSuccessfulProgramAfterFailure
Key: FLINK-3053
URL: https://issues.apache.org/jira/browse/FLINK-3053
Project: Flink
Issue Type: Bug
Components: Tests
Reporter: Matthias J. Sax
Priority: Critical
https://travis-ci.org/apache/flink/jobs/92091437
{noformat}
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 16.09 sec <<<
FAILURE! - in org.apache.flink.test.misc.SuccessAfterNetworkBuffersFailureITCase
testSuccessfulProgramAfterFailure(org.apache.flink.test.misc.SuccessAfterNetworkBuffersFailureITCase)
Time elapsed: 16.08 sec <<< FAILURE!
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at
org.apache.flink.test.misc.SuccessAfterNetworkBuffersFailureITCase.testSuccessfulProgramAfterFailure(SuccessAfterNetworkBuffersFailureITCase.java:72)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3048) DataSinkTaskTest.testCancelDataSinkTask
Matthias J. Sax created FLINK-3048:
--
Summary: DataSinkTaskTest.testCancelDataSinkTask
Key: FLINK-3048
URL: https://issues.apache.org/jira/browse/FLINK-3048
Project: Flink
Issue Type: Bug
Components: Tests
Reporter: Matthias J. Sax
Priority: Critical
https://travis-ci.org/apache/flink/jobs/91941025
{noformat}
Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 16.483 sec <<<
FAILURE! - in org.apache.flink.runtime.operators.DataSinkTaskTest
testCancelDataSinkTask(org.apache.flink.runtime.operators.DataSinkTaskTest)
Time elapsed: 1.136 sec <<< FAILURE!
java.lang.AssertionError: Temp output file has not been removed
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertFalse(Assert.java:64)
at
org.apache.flink.runtime.operators.DataSinkTaskTest.testCancelDataSinkTask(DataSinkTaskTest.java:397)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Assigned] (FLINK-2861) Fields grouping on split streams fails
[
https://issues.apache.org/jira/browse/FLINK-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax reassigned FLINK-2861:
--
Assignee: Matthias J. Sax
> Fields grouping on split streams fails
> --
>
> Key: FLINK-2861
> URL: https://issues.apache.org/jira/browse/FLINK-2861
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Affects Versions: 0.10.0
>Reporter: Stephan Ewen
>Assignee: Matthias J. Sax
>
> Using split streams works for shuffle grouping, but not for Fields grouping.
> The reason is that the KeySelector expects an array, and the given type is
> the {{SplitStreamType}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-3031) Consistent Shutdown of Streaming Jobs
Matthias J. Sax created FLINK-3031: -- Summary: Consistent Shutdown of Streaming Jobs Key: FLINK-3031 URL: https://issues.apache.org/jira/browse/FLINK-3031 Project: Flink Issue Type: Bug Components: Streaming Reporter: Matthias J. Sax Depends on FLINK-2111 When a streaming job is shut down cleanly via "stop", a last consistent snapshot should be collected. This snapshot could be used to resume a job later on. See mail archive for more details of the discussion: https://mail-archives.apache.org/mod_mbox/flink-dev/201511.mbox/%3CCA%2Bfaj9xDFAUG_zi%3D%3DE2H8s-8R4cn8ZBDON_hf%2B1Rud5pJqvZ4A%40mail.gmail.com%3E -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-3034) Redis SInk Connector
Matthias J. Sax created FLINK-3034: -- Summary: Redis SInk Connector Key: FLINK-3034 URL: https://issues.apache.org/jira/browse/FLINK-3034 Project: Flink Issue Type: New Feature Components: Streaming Connectors Reporter: Matthias J. Sax Priority: Minor Flink does not provide a sink connector for Redis. See FLINK-3033 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (FLINK-3033) Redis Source Connector
[ https://issues.apache.org/jira/browse/FLINK-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated FLINK-3033: --- Description: Flink does not provide a source connector for Redis. See FLINK-3034 was:Flink does not provide a source connector for Redis. > Redis Source Connector > -- > > Key: FLINK-3033 > URL: https://issues.apache.org/jira/browse/FLINK-3033 > Project: Flink > Issue Type: New Feature > Components: Streaming Connectors >Reporter: Matthias J. Sax >Priority: Minor > > Flink does not provide a source connector for Redis. > See FLINK-3034 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-3033) Redis Source Connector
Matthias J. Sax created FLINK-3033: -- Summary: Redis Source Connector Key: FLINK-3033 URL: https://issues.apache.org/jira/browse/FLINK-3033 Project: Flink Issue Type: New Feature Components: Streaming Connectors Reporter: Matthias J. Sax Priority: Minor Flink does not provide a source connector for Redis. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-3035) Redis as State Backend
Matthias J. Sax created FLINK-3035: -- Summary: Redis as State Backend Key: FLINK-3035 URL: https://issues.apache.org/jira/browse/FLINK-3035 Project: Flink Issue Type: New Feature Components: Streaming Reporter: Matthias J. Sax Priority: Minor Add Redis as a state backend for distributed snapshots. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-3017) Broken 'Slots' link on Streaming Programming Guide
[ https://issues.apache.org/jira/browse/FLINK-3017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006563#comment-15006563 ] Matthias J. Sax commented on FLINK-3017: Fixed via feb6994ffca04e4b7ad6174ca08048ea452e19f6 Thanks for your contribution. > Broken 'Slots' link on Streaming Programming Guide > -- > > Key: FLINK-3017 > URL: https://issues.apache.org/jira/browse/FLINK-3017 > Project: Flink > Issue Type: Improvement > Components: Documentation >Affects Versions: 0.10 >Reporter: Suneel Marthi >Assignee: Suneel Marthi >Priority: Minor > Fix For: 1.0 > > > Broken 'Slots' link on > > https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#task-chaining-and-resource-groups > The link to > https://ci.apache.org/projects/flink/flink-docs-master/apis/config#configuring-taskmanager-processing-slots > > is broken -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (FLINK-3017) Broken 'Slots' link on Streaming Programming Guide
[ https://issues.apache.org/jira/browse/FLINK-3017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax closed FLINK-3017. -- > Broken 'Slots' link on Streaming Programming Guide > -- > > Key: FLINK-3017 > URL: https://issues.apache.org/jira/browse/FLINK-3017 > Project: Flink > Issue Type: Improvement > Components: Documentation >Affects Versions: 0.10 >Reporter: Suneel Marthi >Assignee: Suneel Marthi >Priority: Minor > Fix For: 1.0 > > > Broken 'Slots' link on > > https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming_guide.html#task-chaining-and-resource-groups > The link to > https://ci.apache.org/projects/flink/flink-docs-master/apis/config#configuring-taskmanager-processing-slots > > is broken -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2671) Instable Test StreamCheckpointNotifierITCase
[
https://issues.apache.org/jira/browse/FLINK-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000435#comment-15000435
]
Matthias J. Sax commented on FLINK-2671:
Occurred again: https://travis-ci.org/apache/flink/jobs/90228003
> Instable Test StreamCheckpointNotifierITCase
>
>
> Key: FLINK-2671
> URL: https://issues.apache.org/jira/browse/FLINK-2671
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Affects Versions: 0.10
>Reporter: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
> Fix For: 0.10
>
>
> {noformat}
> Failed tests:
>
> StreamCheckpointNotifierITCase>StreamFaultToleranceTestBase.runCheckpointedProgram:105->postSubmit:115
> No checkpoint notification was received.{noformat}
> https://travis-ci.org/apache/flink/jobs/80344489
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-2752) Documentation is not easily differentiable from the Flink homepage
[ https://issues.apache.org/jira/browse/FLINK-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996328#comment-14996328 ] Matthias J. Sax commented on FLINK-2752: Some improvements via c607549537894d3a3ffc0cdc4aad088b2ef8 > Documentation is not easily differentiable from the Flink homepage > -- > > Key: FLINK-2752 > URL: https://issues.apache.org/jira/browse/FLINK-2752 > Project: Flink > Issue Type: Bug > Components: Documentation >Affects Versions: 0.9, 0.10 >Reporter: Maximilian Michels >Assignee: Matthias J. Sax >Priority: Minor > Labels: starter > Fix For: 0.9, 0.10 > > > When users go to the documentation, either via the homepage's quickstart menu > or the documentation menu, the transition to the documentation is not easily > noticeable; the layout of both pages are pretty much the same. There should > be a hint in the documentation page "Flink documentation version X. Click > here to go back to the homepage" or something similar. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (FLINK-2752) Documentation is not easily differentiable from the Flink homepage
[ https://issues.apache.org/jira/browse/FLINK-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated FLINK-2752: --- Assignee: (was: Matthias J. Sax) > Documentation is not easily differentiable from the Flink homepage > -- > > Key: FLINK-2752 > URL: https://issues.apache.org/jira/browse/FLINK-2752 > Project: Flink > Issue Type: Bug > Components: Documentation >Affects Versions: 0.9, 0.10 >Reporter: Maximilian Michels >Priority: Minor > Labels: starter > Fix For: 0.9, 0.10 > > > When users go to the documentation, either via the homepage's quickstart menu > or the documentation menu, the transition to the documentation is not easily > noticeable; the layout of both pages are pretty much the same. There should > be a hint in the documentation page "Flink documentation version X. Click > here to go back to the homepage" or something similar. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (FLINK-2752) Documentation is not easily differentiable from the Flink homepage
[ https://issues.apache.org/jira/browse/FLINK-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned FLINK-2752: -- Assignee: Matthias J. Sax > Documentation is not easily differentiable from the Flink homepage > -- > > Key: FLINK-2752 > URL: https://issues.apache.org/jira/browse/FLINK-2752 > Project: Flink > Issue Type: Bug > Components: Documentation >Affects Versions: 0.9, 0.10 >Reporter: Maximilian Michels >Assignee: Matthias J. Sax >Priority: Minor > Labels: starter > Fix For: 0.9, 0.10 > > > When users go to the documentation, either via the homepage's quickstart menu > or the documentation menu, the transition to the documentation is not easily > noticeable; the layout of both pages are pretty much the same. There should > be a hint in the documentation page "Flink documentation version X. Click > here to go back to the homepage" or something similar. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2735) KafkaProducerITCase.testCustomPartitioning sporadically fails
[
https://issues.apache.org/jira/browse/FLINK-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987339#comment-14987339
]
Matthias J. Sax commented on FLINK-2735:
https://travis-ci.org/mjsax/flink/jobs/88997932
> KafkaProducerITCase.testCustomPartitioning sporadically fails
> -
>
> Key: FLINK-2735
> URL: https://issues.apache.org/jira/browse/FLINK-2735
> Project: Flink
> Issue Type: Bug
> Components: Kafka Connector
>Affects Versions: 0.10
>Reporter: Robert Metzger
> Labels: test-stability
>
> In the following test run:
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/8158/log.txt
> there was the following failure
> {code}
> Caused by: java.lang.Exception: Unable to get last offset for topic
> customPartitioningTestTopic and partitions [FetchPartition {partition=2,
> offset=-915623761776}].
> Exception for partition 2: kafka.common.UnknownException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:408)
> at java.lang.Class.newInstance(Class.java:438)
> at kafka.common.ErrorMapping$.exceptionFor(ErrorMapping.scala:86)
> at kafka.common.ErrorMapping.exceptionFor(ErrorMapping.scala)
> at
> org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher$SimpleConsumerThread.getLastOffset(LegacyFetcher.java:521)
> at
> org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher$SimpleConsumerThread.run(LegacyFetcher.java:370)
> at
> org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher.run(LegacyFetcher.java:242)
> at
> org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer.run(FlinkKafkaConsumer.java:382)
> at
> org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58)
> at
> org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:58)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:168)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:579)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.RuntimeException: Unable to get last offset for topic
> customPartitioningTestTopic and partitions [FetchPartition {partition=2,
> offset=-915623761776}].
> Exception for partition 2: kafka.common.UnknownException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:408)
> at java.lang.Class.newInstance(Class.java:438)
> at kafka.common.ErrorMapping$.exceptionFor(ErrorMapping.scala:86)
> at kafka.common.ErrorMapping.exceptionFor(ErrorMapping.scala)
> at
> org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher$SimpleConsumerThread.getLastOffset(LegacyFetcher.java:521)
> at
> org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher$SimpleConsumerThread.run(LegacyFetcher.java:370)
> at
> org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher$SimpleConsumerThread.getLastOffset(LegacyFetcher.java:524)
> at
> org.apache.flink.streaming.connectors.kafka.internals.LegacyFetcher$SimpleConsumerThread.run(LegacyFetcher.java:370)
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 17.455 sec
> <<< FAILURE! - in
> org.apache.flink.streaming.connectors.kafka.KafkaProducerITCase
> testCustomPartitioning(org.apache.flink.streaming.connectors.kafka.KafkaProducerITCase)
> Time elapsed: 7.809 sec <<< FAILURE!
> java.lang.AssertionError: Test failed: The program execution failed: Job
> execution failed.
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase.tryExecute(KafkaTestBase.java:313)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaProducerITCase.testCustomPartitioning(KafkaProducerITCase.java:155)
> {code}
> From the broker logs it seems to be an issue in the Kafka broker
> {code}
> 14:43:03,328 INFO kafka.network.Processor
>- Closing socket connection to /127.0.0.1.
> 14:43:03,334 WARN kafka.server.KafkaApis
>- [KafkaApi-0] Error while responding to offset request
>
[jira] [Commented] (FLINK-2571) Add task hooks support in Storm-compatibility
[ https://issues.apache.org/jira/browse/FLINK-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982244#comment-14982244 ] Matthias J. Sax commented on FLINK-2571: Are you working on this? Or is anything blocking your progress? > Add task hooks support in Storm-compatibility > -- > > Key: FLINK-2571 > URL: https://issues.apache.org/jira/browse/FLINK-2571 > Project: Flink > Issue Type: New Feature > Components: Storm Compatibility >Reporter: fangfengbin >Assignee: fangfengbin >Priority: Minor > > Storm provides hooks with which users can insert custom code to run on any > number of events(emit, cleanup, spoutAck...) within Storm. Users create a > hook by extending the BaseTaskHook class and overriding the appropriate > method for the event users want to catch. > There are two ways to register your hook: > 1.In the open method of your spout or prepare method of your bolt using the > TopologyContext#addTaskHook method. > 2.Through the Storm configuration using the "topology.auto.task.hooks" > config.You can use user-defined hooks class names as value of > "topology.auto.task.hooks" .These hooks are automatically registered in every > spout or bolt. > When the events happen, it will get hooks-list from TopologyContext and call > hooks function. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-2915) JobManagerProcessFailureBatchRecoveryITCase
Matthias J. Sax created FLINK-2915:
--
Summary: JobManagerProcessFailureBatchRecoveryITCase
Key: FLINK-2915
URL: https://issues.apache.org/jira/browse/FLINK-2915
Project: Flink
Issue Type: Bug
Components: Tests
Reporter: Matthias J. Sax
Priority: Critical
https://travis-ci.org/apache/flink/jobs/87193692
{noformat}
Failed tests:
JobManagerProcessFailureBatchRecoveryITCase>AbstractJobManagerProcessFailureRecoveryITCase.testJobManagerProcessFailure:259
JobManager did not start up within 291736881301 nanoseconds.
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (FLINK-2862) FlinkTopologyBuilder should use proper generic types
[ https://issues.apache.org/jira/browse/FLINK-2862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved FLINK-2862. Resolution: Fixed > FlinkTopologyBuilder should use proper generic types > > > Key: FLINK-2862 > URL: https://issues.apache.org/jira/browse/FLINK-2862 > Project: Flink > Issue Type: Bug > Components: Storm Compatibility >Affects Versions: 0.10 >Reporter: Stephan Ewen >Assignee: Matthias J. Sax > > The Flink Topology Builder uses only raw types, resulting in bugs due to > missing compile time checks of types. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2862) FlinkTopologyBuilder should use proper generic types
[ https://issues.apache.org/jira/browse/FLINK-2862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972624#comment-14972624 ] Matthias J. Sax commented on FLINK-2862: Resolved via fa88d9eb1b88641d6ca03b38e2058d30971c7a2f > FlinkTopologyBuilder should use proper generic types > > > Key: FLINK-2862 > URL: https://issues.apache.org/jira/browse/FLINK-2862 > Project: Flink > Issue Type: Bug > Components: Storm Compatibility >Affects Versions: 0.10 >Reporter: Stephan Ewen >Assignee: Matthias J. Sax > > The Flink Topology Builder uses only raw types, resulting in bugs due to > missing compile time checks of types. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-2911) AccumulatingAlignedProcessingTimeWindowOperatorTest.checkpointRestoreWithPendingWindowTumbling
Matthias J. Sax created FLINK-2911:
--
Summary:
AccumulatingAlignedProcessingTimeWindowOperatorTest.checkpointRestoreWithPendingWindowTumbling
Key: FLINK-2911
URL: https://issues.apache.org/jira/browse/FLINK-2911
Project: Flink
Issue Type: Bug
Components: Streaming
Reporter: Matthias J. Sax
Priority: Critical
https://travis-ci.org/mjsax/flink/jobs/87181219
{noformat}
Tests run: 11, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 6.277 sec <<<
FAILURE! - in
org.apache.flink.streaming.runtime.operators.windowing.AccumulatingAlignedProcessingTimeWindowOperatorTest
checkpointRestoreWithPendingWindowTumbling(org.apache.flink.streaming.runtime.operators.windowing.AccumulatingAlignedProcessingTimeWindowOperatorTest)
Time elapsed: 1.511 sec <<< FAILURE!
java.lang.AssertionError: expected:<1000> but was:<1001>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at
org.apache.flink.streaming.runtime.operators.windowing.AccumulatingAlignedProcessingTimeWindowOperatorTest.checkpointRestoreWithPendingWindowTumbling(AccumulatingAlignedProcessingTimeWindowOperatorTest.java:603)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Assigned] (FLINK-2862) FlinkTopologyBuilder should use proper generic types
[ https://issues.apache.org/jira/browse/FLINK-2862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned FLINK-2862: -- Assignee: Matthias J. Sax > FlinkTopologyBuilder should use proper generic types > > > Key: FLINK-2862 > URL: https://issues.apache.org/jira/browse/FLINK-2862 > Project: Flink > Issue Type: Bug > Components: Storm Compatibility >Affects Versions: 0.10 >Reporter: Stephan Ewen >Assignee: Matthias J. Sax > > The Flink Topology Builder uses only raw types, resulting in bugs due to > missing compile time checks of types. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (FLINK-2847) Fix flaky test in StormTestBase.testJob
[
https://issues.apache.org/jira/browse/FLINK-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax closed FLINK-2847.
--
Resolution: Fixed
> Fix flaky test in StormTestBase.testJob
> ---
>
> Key: FLINK-2847
> URL: https://issues.apache.org/jira/browse/FLINK-2847
> Project: Flink
> Issue Type: Bug
> Components: Tests
>Reporter: Henry Saputra
>Priority: Minor
> Labels: test-stability
>
> {code}
> testJob(org.apache.flink.storm.wordcount.WordCountLocalITCase) Time elapsed:
> 12.845 sec <<< FAILURE!
> java.lang.AssertionError: Different number of lines in expected and obtained
> result. expected:<801> but was:<0>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:743)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:555)
> at
> org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:305)
> at
> org.apache.flink.test.util.TestBaseUtils.compareResultsByLinesInMemory(TestBaseUtils.java:291)
> at
> org.apache.flink.storm.wordcount.WordCountLocalITCase.postSubmit(WordCountLocalITCase.java:38)
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.815 sec -
> in org.apache.flink.storm.wordcount.BoltTokenizerWordCountWithNamesITCase
> Running org.apache.flink.storm.wordcount.BoltTokenizerWordCountITCase
> Running org.apache.flink.storm.wordcount.BoltTokenizerWordCountPojoITCase
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.55 sec - in
> org.apache.flink.storm.wordcount.BoltTokenizerWordCountPojoITCase
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.801 sec -
> in org.apache.flink.storm.wordcount.BoltTokenizerWordCountITCase
> Results :
> Failed tests:
>
> WordCountLocalITCase>StormTestBase.testJob:98->postSubmit:38->TestBaseUtils.compareResultsByLinesInMemory:291->TestBaseUtils.compareResultsByLinesInMemory:305
> Different number of lines in expected and obtained result. expected:<801>
> but was:<0>
> Tests run: 11, Failures: 1, Errors: 0, Skipped: 0
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (FLINK-2831) Failing Test: WrapperSetupHelperTest
[
https://issues.apache.org/jira/browse/FLINK-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950060#comment-14950060
]
Matthias J. Sax edited comment on FLINK-2831 at 10/9/15 9:14 AM:
-
The last "fix" has a bug.
was (Author: mjsax):
It's a stupid test and it does have an issue... I will change it once more...
Obviously, the last "fix" was not good enough...
> Failing Test: WrapperSetupHelperTest
>
>
> Key: FLINK-2831
> URL: https://issues.apache.org/jira/browse/FLINK-2831
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Affects Versions: 0.10
>Reporter: Vasia Kalavri
>Assignee: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
> Fix For: 0.10
>
>
> I saw this failure of {{WrapperSetupHelperTest.testCreateTopologyContext}}.
> Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 49.419 sec
> <<< FAILURE! - in org.apache.flink.storm.wrappers.WrapperSetupHelperTest
> testCreateTopologyContext(org.apache.flink.storm.wrappers.WrapperSetupHelperTest)
> Time elapsed: 47.907 sec <<< FAILURE!
> java.lang.AssertionError: null
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at
> org.apache.flink.storm.wrappers.WrapperSetupHelperTest.testCreateTopologyContext(WrapperSetupHelperTest.java:203)
> Running org.apache.flink.storm.wrappers.SpoutWrapperTest
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.303 sec -
> in org.apache.flink.storm.wrappers.SpoutWrapperTest
> Running org.apache.flink.storm.wrappers.SpoutCollectorTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec -
> in org.apache.flink.storm.wrappers.SpoutCollectorTest
> Running org.apache.flink.storm.util.StormStreamSelectorTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec -
> in org.apache.flink.storm.util.StormStreamSelectorTest
> Running org.apache.flink.storm.api.FlinkOutputFieldsDeclarerTest
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.077 sec -
> in org.apache.flink.storm.api.FlinkOutputFieldsDeclarerTest
> Running org.apache.flink.storm.api.FlinkTopologyBuilderTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.097 sec -
> in org.apache.flink.storm.api.FlinkTopologyBuilderTest
> Running org.apache.flink.storm.api.FlinkTopologyTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec -
> in org.apache.flink.storm.api.FlinkTopologyTest
> Results :
> Failed tests:
> WrapperSetupHelperTest.testCreateTopologyContext:203 null
> Full log [here|https://travis-ci.org/vasia/flink/jobs/84120132] .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-2831) Failing Test: WrapperSetupHelperTest
[
https://issues.apache.org/jira/browse/FLINK-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950060#comment-14950060
]
Matthias J. Sax commented on FLINK-2831:
It's a stupid test and it does have an issue... I will change it once more...
Obviously, the last "fix" was not good enough...
> Failing Test: WrapperSetupHelperTest
>
>
> Key: FLINK-2831
> URL: https://issues.apache.org/jira/browse/FLINK-2831
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Affects Versions: 0.10
>Reporter: Vasia Kalavri
>Assignee: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
> Fix For: 0.10
>
>
> I saw this failure of {{WrapperSetupHelperTest.testCreateTopologyContext}}.
> Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 49.419 sec
> <<< FAILURE! - in org.apache.flink.storm.wrappers.WrapperSetupHelperTest
> testCreateTopologyContext(org.apache.flink.storm.wrappers.WrapperSetupHelperTest)
> Time elapsed: 47.907 sec <<< FAILURE!
> java.lang.AssertionError: null
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at
> org.apache.flink.storm.wrappers.WrapperSetupHelperTest.testCreateTopologyContext(WrapperSetupHelperTest.java:203)
> Running org.apache.flink.storm.wrappers.SpoutWrapperTest
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.303 sec -
> in org.apache.flink.storm.wrappers.SpoutWrapperTest
> Running org.apache.flink.storm.wrappers.SpoutCollectorTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec -
> in org.apache.flink.storm.wrappers.SpoutCollectorTest
> Running org.apache.flink.storm.util.StormStreamSelectorTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec -
> in org.apache.flink.storm.util.StormStreamSelectorTest
> Running org.apache.flink.storm.api.FlinkOutputFieldsDeclarerTest
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.077 sec -
> in org.apache.flink.storm.api.FlinkOutputFieldsDeclarerTest
> Running org.apache.flink.storm.api.FlinkTopologyBuilderTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.097 sec -
> in org.apache.flink.storm.api.FlinkTopologyBuilderTest
> Running org.apache.flink.storm.api.FlinkTopologyTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec -
> in org.apache.flink.storm.api.FlinkTopologyTest
> Results :
> Failed tests:
> WrapperSetupHelperTest.testCreateTopologyContext:203 null
> Full log [here|https://travis-ci.org/vasia/flink/jobs/84120132] .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-2845) TimestampITCase.testWatermarkPropagation
Matthias J. Sax created FLINK-2845: -- Summary: TimestampITCase.testWatermarkPropagation Key: FLINK-2845 URL: https://issues.apache.org/jira/browse/FLINK-2845 Project: Flink Issue Type: Bug Components: Streaming Reporter: Matthias J. Sax Priority: Critical -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (FLINK-2845) TimestampITCase.testWatermarkPropagation
[
https://issues.apache.org/jira/browse/FLINK-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax updated FLINK-2845:
---
Description:
https://travis-ci.org/apache/flink/jobs/84479912
{noformat}
Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 16.592 sec <<<
FAILURE! - in org.apache.flink.streaming.timestamp.TimestampITCase
testWatermarkPropagation(org.apache.flink.streaming.timestamp.TimestampITCase)
Time elapsed: 3.747 sec <<< FAILURE!
java.lang.AssertionError: Wrong watermark.
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.flink.streaming.timestamp.TimestampITCase.testWatermarkPropagation(TimestampITCase.java:163)
{noformat}
> TimestampITCase.testWatermarkPropagation
>
>
> Key: FLINK-2845
> URL: https://issues.apache.org/jira/browse/FLINK-2845
> Project: Flink
> Issue Type: Bug
> Components: Streaming
>Reporter: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
>
> https://travis-ci.org/apache/flink/jobs/84479912
> {noformat}
> Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 16.592 sec
> <<< FAILURE! - in org.apache.flink.streaming.timestamp.TimestampITCase
> testWatermarkPropagation(org.apache.flink.streaming.timestamp.TimestampITCase)
> Time elapsed: 3.747 sec <<< FAILURE!
> java.lang.AssertionError: Wrong watermark.
> at org.junit.Assert.fail(Assert.java:88)
> at
> org.apache.flink.streaming.timestamp.TimestampITCase.testWatermarkPropagation(TimestampITCase.java:163)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (FLINK-2831) Failing Test: WrapperSetupHelperTest
[
https://issues.apache.org/jira/browse/FLINK-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950200#comment-14950200
]
Matthias J. Sax commented on FLINK-2831:
Fixed via 998be1bbbc823e1299dcb6bfe56774ec2f7286ab
> Failing Test: WrapperSetupHelperTest
>
>
> Key: FLINK-2831
> URL: https://issues.apache.org/jira/browse/FLINK-2831
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Affects Versions: 0.10
>Reporter: Vasia Kalavri
>Assignee: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
> Fix For: 0.10
>
>
> I saw this failure of {{WrapperSetupHelperTest.testCreateTopologyContext}}.
> Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 49.419 sec
> <<< FAILURE! - in org.apache.flink.storm.wrappers.WrapperSetupHelperTest
> testCreateTopologyContext(org.apache.flink.storm.wrappers.WrapperSetupHelperTest)
> Time elapsed: 47.907 sec <<< FAILURE!
> java.lang.AssertionError: null
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at
> org.apache.flink.storm.wrappers.WrapperSetupHelperTest.testCreateTopologyContext(WrapperSetupHelperTest.java:203)
> Running org.apache.flink.storm.wrappers.SpoutWrapperTest
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.303 sec -
> in org.apache.flink.storm.wrappers.SpoutWrapperTest
> Running org.apache.flink.storm.wrappers.SpoutCollectorTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec -
> in org.apache.flink.storm.wrappers.SpoutCollectorTest
> Running org.apache.flink.storm.util.StormStreamSelectorTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec -
> in org.apache.flink.storm.util.StormStreamSelectorTest
> Running org.apache.flink.storm.api.FlinkOutputFieldsDeclarerTest
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.077 sec -
> in org.apache.flink.storm.api.FlinkOutputFieldsDeclarerTest
> Running org.apache.flink.storm.api.FlinkTopologyBuilderTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.097 sec -
> in org.apache.flink.storm.api.FlinkTopologyBuilderTest
> Running org.apache.flink.storm.api.FlinkTopologyTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec -
> in org.apache.flink.storm.api.FlinkTopologyTest
> Results :
> Failed tests:
> WrapperSetupHelperTest.testCreateTopologyContext:203 null
> Full log [here|https://travis-ci.org/vasia/flink/jobs/84120132] .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (FLINK-2831) Failing Test: WrapperSetupHelperTest
[
https://issues.apache.org/jira/browse/FLINK-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax resolved FLINK-2831.
Resolution: Fixed
> Failing Test: WrapperSetupHelperTest
>
>
> Key: FLINK-2831
> URL: https://issues.apache.org/jira/browse/FLINK-2831
> Project: Flink
> Issue Type: Bug
> Components: Storm Compatibility
>Affects Versions: 0.10
>Reporter: Vasia Kalavri
>Assignee: Matthias J. Sax
>Priority: Critical
> Labels: test-stability
> Fix For: 0.10
>
>
> I saw this failure of {{WrapperSetupHelperTest.testCreateTopologyContext}}.
> Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 49.419 sec
> <<< FAILURE! - in org.apache.flink.storm.wrappers.WrapperSetupHelperTest
> testCreateTopologyContext(org.apache.flink.storm.wrappers.WrapperSetupHelperTest)
> Time elapsed: 47.907 sec <<< FAILURE!
> java.lang.AssertionError: null
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at
> org.apache.flink.storm.wrappers.WrapperSetupHelperTest.testCreateTopologyContext(WrapperSetupHelperTest.java:203)
> Running org.apache.flink.storm.wrappers.SpoutWrapperTest
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.303 sec -
> in org.apache.flink.storm.wrappers.SpoutWrapperTest
> Running org.apache.flink.storm.wrappers.SpoutCollectorTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec -
> in org.apache.flink.storm.wrappers.SpoutCollectorTest
> Running org.apache.flink.storm.util.StormStreamSelectorTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec -
> in org.apache.flink.storm.util.StormStreamSelectorTest
> Running org.apache.flink.storm.api.FlinkOutputFieldsDeclarerTest
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.077 sec -
> in org.apache.flink.storm.api.FlinkOutputFieldsDeclarerTest
> Running org.apache.flink.storm.api.FlinkTopologyBuilderTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.097 sec -
> in org.apache.flink.storm.api.FlinkTopologyBuilderTest
> Running org.apache.flink.storm.api.FlinkTopologyTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec -
> in org.apache.flink.storm.api.FlinkTopologyTest
> Results :
> Failed tests:
> WrapperSetupHelperTest.testCreateTopologyContext:203 null
> Full log [here|https://travis-ci.org/vasia/flink/jobs/84120132] .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (FLINK-2835) Update Documenation for new Streaming API
Matthias J. Sax created FLINK-2835: -- Summary: Update Documenation for new Streaming API Key: FLINK-2835 URL: https://issues.apache.org/jira/browse/FLINK-2835 Project: Flink Issue Type: Task Components: Documentation Reporter: Matthias J. Sax Priority: Blocker The Streaming API gets re-factored but the documentation at the project web page was not updated accordingly yet. For example: groupBy -> keyBy Simplified class names: KeyedDataStream -> KeyedStream ConnectedDataStream -> ConnectedStream IterativeDataStream -> IterativeStream SplitDataStream -> SplitStream (please extend this list) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (FLINK-2836) Cyclic Topologies not supported
Matthias J. Sax created FLINK-2836: -- Summary: Cyclic Topologies not supported Key: FLINK-2836 URL: https://issues.apache.org/jira/browse/FLINK-2836 Project: Flink Issue Type: Improvement Components: Storm Compatibility Reporter: Matthias J. Sax Currently, FlinkTopologyBuilder cannot handle cyclic topologies. In order to implement this feature correctly, FlinkTopologyBuilder must first *detect* cycles in the topology and assembly the Flink streaming program accordingly. As Storm allows for arbitrary dataflow structure, multiple cycles would be allows. Not sure if Flink can handle those. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
