[jira] [Commented] (FLINK-8107) UNNEST causes cyclic type checking exception

2018-03-06 Thread lincoln.lee (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387448#comment-16387448 ] lincoln.lee commented on FLINK-8107: @Timo Walther It seems not a bug here. The above

[GitHub] flink issue #5639: [FLINK-8862] [HBase] Support HBase snapshot read

2018-03-06 Thread neoremind
Github user neoremind commented on the issue: https://github.com/apache/flink/pull/5639 @zentol I was thinking could you help me review the feature and code? Or is there anyone more appropriate for this PR? many thanks. ---

[jira] [Commented] (FLINK-8862) Support HBase snapshot read

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387457#comment-16387457 ] ASF GitHub Bot commented on FLINK-8862: --- Github user neoremind commented on the issu

[jira] [Resolved] (FLINK-8517) StaticlyNestedIterationsITCase.testJobWithoutObjectReuse unstable on Travis

2018-03-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber resolved FLINK-8517. Resolution: Fixed Assignee: Nico Kruber Fix Version/s: 1.6.0 Fixed with master: 50db

[jira] [Resolved] (FLINK-8458) Add the switch for keeping both the old mode and the new credit-based mode

2018-03-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber resolved FLINK-8458. Resolution: Fixed Fix Version/s: 1.6.0 Fixed with master: - 0093bcbe771f296baf3857ef15fe7ec9b

[jira] [Resolved] (FLINK-8769) Quickstart job execution in IDE logs contain several exceptions

2018-03-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber resolved FLINK-8769. Resolution: Fixed Fix Version/s: 1.6.0 Fixed with master: fc0001c8585ff68f1d2568434727b29c854

[GitHub] flink issue #5601: [FLINK-8818][yarn/s3][tests] harden YarnFileStageTest upl...

2018-03-06 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/5601 Different FS implementations try to circumvent the problem (or not), e.g. Presto's implementation implements the retries itself whenever it cannot find an object, while Hadoop's implementation did not

[GitHub] flink issue #5481: [FLINK-8560] Access to the current key in ProcessFunction...

2018-03-06 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5481 Thanks @bowenli86 ! I will merge as soon as Travis gives green. ---

[jira] [Commented] (FLINK-8818) Harden YarnFileStageTest upload test for eventual consistent read-after-write

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387511#comment-16387511 ] ASF GitHub Bot commented on FLINK-8818: --- Github user NicoK commented on the issue:

[jira] [Commented] (FLINK-8560) add KeyedProcessFunction to expose the key in onTimer() and other methods

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387512#comment-16387512 ] ASF GitHub Bot commented on FLINK-8560: --- Github user kl0u commented on the issue:

[jira] [Commented] (FLINK-8813) AutoParallellismITCase fails with Flip6

2018-03-06 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387518#comment-16387518 ] Stephan Ewen commented on FLINK-8813: - +1 for dropping auto-max parallelism and failin

[jira] [Resolved] (FLINK-8818) Harden YarnFileStageTest upload test for eventual consistent read-after-write

2018-03-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber resolved FLINK-8818. Resolution: Fixed Fix Version/s: (was: 1.4.3) 1.6.0 Fixed with - maste

[GitHub] flink issue #5601: [FLINK-8818][yarn/s3][tests] harden YarnFileStageTest upl...

2018-03-06 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/5601 also see further test changes in this regard in #5624 ---

[jira] [Commented] (FLINK-8819) Rework travis script to use build stages

2018-03-06 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387522#comment-16387522 ] Stephan Ewen commented on FLINK-8819: - I agree, already helps. Does the "compile" sta

[jira] [Commented] (FLINK-8818) Harden YarnFileStageTest upload test for eventual consistent read-after-write

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387523#comment-16387523 ] ASF GitHub Bot commented on FLINK-8818: --- Github user NicoK commented on the issue:

[jira] [Commented] (FLINK-8819) Rework travis script to use build stages

2018-03-06 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387528#comment-16387528 ] Chesnay Schepler commented on FLINK-8819: - Yes. The "compile" stage also covers th

[jira] [Comment Edited] (FLINK-8819) Rework travis script to use build stages

2018-03-06 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16382609#comment-16382609 ] Chesnay Schepler edited comment on FLINK-8819 at 3/6/18 9:43 AM: ---

[GitHub] flink pull request #5644: [FLINK-8847][build] Prevent unnecessary recompilat...

2018-03-06 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5644 [FLINK-8847][build] Prevent unnecessary recompilation ## What is the purpose of the change This PR contains 2 changes to prevent the `maven-compiler-plugin` from recompiling a module that d

[jira] [Commented] (FLINK-8847) Modules containing package-info.java are always recompiled

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387561#comment-16387561 ] ASF GitHub Bot commented on FLINK-8847: --- GitHub user zentol opened a pull request:

[jira] [Commented] (FLINK-7612) Implement Event-driven Network IO

2018-03-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387578#comment-16387578 ] Nico Kruber commented on FLINK-7612: The original approach had some issues with cases

[jira] [Closed] (FLINK-7612) Implement Event-driven Network IO

2018-03-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber closed FLINK-7612. -- Resolution: Won't Do > Implement Event-driven Network IO > - > >

[jira] [Closed] (FLINK-3096) ChaosMonkeyITCase fails in checkCleanRecoveryState with Unclean checkpoints

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-3096. --- Resolution: Invalid Fix Version/s: (was: 1.5.0) The test is not in the code base an

[jira] [Closed] (FLINK-2671) Instable Test StreamCheckpointNotifierITCase

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-2671. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-3516) JobManagerHACheckpointRecoveryITCase testCheckpointedStreamingSumProgram fails

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-3516. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-3823) Kafka08ITCase.testOffsetInZookeeper failed on Travis

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-3823. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-3572) SourceStreamTaskTest.testCheckpointing fails on Travis

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-3572. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-3807) FastFailuresITCase deadlocks on Travis

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-3807. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-3990) ZooKeeperLeaderElectionTest kills the JVM

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-3990. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-4005) LocalExecutorITCase.testLocalExecutorWithWordCount fails

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-4005. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-4328) Harden JobManagerHA*ITCase

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-4328. --- Resolution: Won't Fix Fix Version/s: (was: 1.5.0) Closing for now since these legac

[jira] [Closed] (FLINK-4072) EventTimeWindowCheckpointingITCase.testSlidingTimeWindow fails on Travis

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-4072. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-4878) ReduceTaskExternalITCase.testMultiLevelMergeCombiningReduceTask test instable

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-4878. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-5100) Test testZooKeeperReelection is instable

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-5100. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-4524) JobManagerProcessReapingTest.testReapProcessOnFailure unstable

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-4524. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-5202) test timeout (no output for 300s) in YARNHighAvailabilityITCase

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-5202. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-5191) ConnectedComponentsWithDeferredUpdateITCase failed

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-5191. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-5204) Flakey YARNSessionCapacitySchedulerITCase (NullPointerException)

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-5204. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-5203) YARNHighAvailabilityITCase fails to deploy YARN cluster

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-5203. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-5212) Flakey ScalaShellITCase#testPreventRecreationBatch (out of Java heap space)

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-5212. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Closed] (FLINK-5286) Build instability: WordCountSubclassPOJOITCase fails with IOException: Stream Closed

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-5286. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.0) Closing for now since we h

[jira] [Created] (FLINK-8875) Watermark tab on Web Interface should display low watermark in ISO8601

2018-03-06 Thread Daniel Harper (JIRA)
Daniel Harper created FLINK-8875: Summary: Watermark tab on Web Interface should display low watermark in ISO8601 Key: FLINK-8875 URL: https://issues.apache.org/jira/browse/FLINK-8875 Project: Flink

[jira] [Created] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-06 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8876: --- Summary: Improve concurrent access handling in stateful serializers Key: FLINK-8876 URL: https://issues.apache.org/jira/browse/FLINK-8876 Project: Flink Issue

[jira] [Created] (FLINK-8877) Configure Kryo's log level based on Flink's log level

2018-03-06 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8877: --- Summary: Configure Kryo's log level based on Flink's log level Key: FLINK-8877 URL: https://issues.apache.org/jira/browse/FLINK-8877 Project: Flink Issue Type:

[jira] [Created] (FLINK-8878) Check for concurrent access to Kryo Serializer

2018-03-06 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8878: --- Summary: Check for concurrent access to Kryo Serializer Key: FLINK-8878 URL: https://issues.apache.org/jira/browse/FLINK-8878 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-8879) Add concurrent access check to AvroSerializer

2018-03-06 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8879: --- Summary: Add concurrent access check to AvroSerializer Key: FLINK-8879 URL: https://issues.apache.org/jira/browse/FLINK-8879 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-8880) Validate configurations for SQL Client

2018-03-06 Thread Xingcan Cui (JIRA)
Xingcan Cui created FLINK-8880: -- Summary: Validate configurations for SQL Client Key: FLINK-8880 URL: https://issues.apache.org/jira/browse/FLINK-8880 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-8880) Validate configurations for SQL Client

2018-03-06 Thread Xingcan Cui (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingcan Cui updated FLINK-8880: --- Component/s: Table API & SQL > Validate configurations for SQL Client > --

[jira] [Created] (FLINK-8881) Accumulators not updated for running jobs

2018-03-06 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8881: --- Summary: Accumulators not updated for running jobs Key: FLINK-8881 URL: https://issues.apache.org/jira/browse/FLINK-8881 Project: Flink Issue Type: Bug

[GitHub] flink pull request #5645: FLINK-8876 Improve concurrent access handling in s...

2018-03-06 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/5645 FLINK-8876 Improve concurrent access handling in stateful serializers ## What is the purpose of the change Help detecting accidental concurrent use of serializers. If the log is

[jira] [Commented] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387660#comment-16387660 ] ASF GitHub Bot commented on FLINK-8876: --- GitHub user StephanEwen opened a pull reque

[jira] [Created] (FLINK-8882) flink-tests fails with core dump

2018-03-06 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8882: --- Summary: flink-tests fails with core dump Key: FLINK-8882 URL: https://issues.apache.org/jira/browse/FLINK-8882 Project: Flink Issue Type: Bug

[GitHub] flink issue #5634: [FLINK-5479] [kafka] Idleness detection for periodic per-...

2018-03-06 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5634 I would suggest to approach this in a different way. 1. Idleness detection is something that watermark generation benefits from in general, not just in Kafka 2. Unless there is a

[jira] [Commented] (FLINK-5479) Per-partition watermarks in FlinkKafkaConsumer should consider idle partitions

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387700#comment-16387700 ] ASF GitHub Bot commented on FLINK-5479: --- Github user StephanEwen commented on the is

[GitHub] flink issue #5624: [FLINK-8402][s3][tests] fix hadoop/presto S3 IT cases for...

2018-03-06 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5624 The code and the tests should not rely on eventually consistent operations at all, but only on strongly consistent operations, like "read after create". That should also eliminate any nee

[jira] [Commented] (FLINK-8402) HadoopS3FileSystemITCase.testDirectoryListing fails on Travis

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387702#comment-16387702 ] ASF GitHub Bot commented on FLINK-8402: --- Github user StephanEwen commented on the is

[GitHub] flink issue #5614: [FLINK-8827] When FLINK_CONF_DIR contains spaces, execute...

2018-03-06 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5614 +1 merging this ---

[jira] [Commented] (FLINK-8827) When FLINK_CONF_DIR contains spaces, execute zookeeper related scripts failed

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387703#comment-16387703 ] ASF GitHub Bot commented on FLINK-8827: --- Github user StephanEwen commented on the is

[GitHub] flink issue #5645: FLINK-8876 Improve concurrent access handling in stateful...

2018-03-06 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5645 We got a bunch of failing tests: ``` Failed tests: MultidimensionalArraySerializerTest.testObjectArrays:84 Exception in test: Serializer already accessed by thread main PojoGeneri

[jira] [Commented] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387708#comment-16387708 ] ASF GitHub Bot commented on FLINK-8876: --- Github user zentol commented on the issue:

[jira] [Commented] (FLINK-8687) MaterializedCollectStreamResult#retrievePage should take resultLock

2018-03-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387710#comment-16387710 ] Ted Yu commented on FLINK-8687: --- CliTableResultView is not in gateway package. Can you desc

[GitHub] flink pull request #5645: FLINK-8876 Improve concurrent access handling in s...

2018-03-06 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5645#discussion_r172508524 --- Diff: flink-core/src/main/java/org/apache/flink/api/java/typeutils/runtime/kryo/KryoSerializer.java --- @@ -502,6 +572,22 @@ private void readObject(Obje

[jira] [Commented] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387720#comment-16387720 ] ASF GitHub Bot commented on FLINK-8876: --- Github user zentol commented on a diff in t

[GitHub] flink pull request #5645: FLINK-8876 Improve concurrent access handling in s...

2018-03-06 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5645#discussion_r172509993 --- Diff: flink-core/src/main/java/org/apache/flink/api/java/typeutils/runtime/kryo/KryoSerializer.java --- @@ -502,6 +572,22 @@ private void readObject(Obje

[jira] [Commented] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387729#comment-16387729 ] ASF GitHub Bot commented on FLINK-8876: --- Github user zentol commented on a diff in t

[jira] [Commented] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387730#comment-16387730 ] ASF GitHub Bot commented on FLINK-8876: --- Github user zentol commented on a diff in t

[GitHub] flink pull request #5645: FLINK-8876 Improve concurrent access handling in s...

2018-03-06 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5645#discussion_r172510349 --- Diff: flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/typeutils/AvroSerializer.java --- @@ -277,6 +349,26 @@ private void initialize

[jira] [Closed] (FLINK-8807) ZookeeperCompleted checkpoint store can get stuck in infinite loop

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-8807. --- Resolution: Fixed Assignee: Aljoscha Krettek > ZookeeperCompleted checkpoint store can g

[jira] [Commented] (FLINK-8807) ZookeeperCompleted checkpoint store can get stuck in infinite loop

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387771#comment-16387771 ] Aljoscha Krettek commented on FLINK-8807: - Fixed on release-1.3 in 0069541d7bb6e59

[jira] [Commented] (FLINK-8871) Checkpoint cancellation is not propagated to stop checkpointing threads on the task manager

2018-03-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387786#comment-16387786 ] Stefan Richter commented on FLINK-8871: --- [~sihuazhou] Given the release plan, this w

[jira] [Comment Edited] (FLINK-8871) Checkpoint cancellation is not propagated to stop checkpointing threads on the task manager

2018-03-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387786#comment-16387786 ] Stefan Richter edited comment on FLINK-8871 at 3/6/18 1:40 PM: -

[jira] [Commented] (FLINK-8871) Checkpoint cancellation is not propagated to stop checkpointing threads on the task manager

2018-03-06 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387820#comment-16387820 ] Sihua Zhou commented on FLINK-8871: --- [~srichter] That is fine, looking forward the PR. ;

[GitHub] flink issue #5645: FLINK-8876 Improve concurrent access handling in stateful...

2018-03-06 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5645 Thanks for the great review. Good catch, I bet the missing check against the current thread is the reason for the test failure. ---

[jira] [Commented] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387845#comment-16387845 ] ASF GitHub Bot commented on FLINK-8876: --- Github user StephanEwen commented on the is

[jira] [Commented] (FLINK-8871) Checkpoint cancellation is not propagated to stop checkpointing threads on the task manager

2018-03-06 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387849#comment-16387849 ] Stephan Ewen commented on FLINK-8871: - For a change to checkpointing like this, we nee

[jira] [Commented] (FLINK-4387) Instability in KvStateClientTest.testClientServerIntegration()

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387966#comment-16387966 ] Aljoscha Krettek commented on FLINK-4387: - [~NicoK] Why is this not {{fixVersion =

[jira] [Commented] (FLINK-8834) Job fails to restart due to some tasks stuck in cancelling state

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387970#comment-16387970 ] Aljoscha Krettek commented on FLINK-8834: - [~StephanEwen] What does that mean for

[jira] [Closed] (FLINK-8870) End-to-end tests wrongly pass if md5sum is not installed

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-8870. --- Resolution: Not A Problem Fix Version/s: (was: 1.5.0) > End-to-end tests wrongly pa

[jira] [Reopened] (FLINK-8870) End-to-end tests wrongly pass if md5sum is not installed

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened FLINK-8870: - Reopen to remove fixVersion > End-to-end tests wrongly pass if md5sum is not installed >

[jira] [Commented] (FLINK-8867) Rocksdb checkpointing failing with fs.default-scheme: hdfs:// config

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388008#comment-16388008 ] Aljoscha Krettek commented on FLINK-8867: - [~srichter] & [~StephanEwen] do you hav

[jira] [Commented] (FLINK-8867) Rocksdb checkpointing failing with fs.default-scheme: hdfs:// config

2018-03-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388012#comment-16388012 ] Stefan Richter commented on FLINK-8867: --- The reported exception is not showing the r

[jira] [Updated] (FLINK-8836) Duplicating a KryoSerializer does not duplicate registered default serializers

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8836: Priority: Major (was: Critical) > Duplicating a KryoSerializer does not duplicate registere

[jira] [Updated] (FLINK-8830) YarnResourceManager throws NullPointerException

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8830: Priority: Blocker (was: Major) > YarnResourceManager throws NullPointerException >

[jira] [Updated] (FLINK-8830) YarnResourceManager throws NullPointerException

2018-03-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8830: Fix Version/s: 1.5.0 > YarnResourceManager throws NullPointerException > ---

[GitHub] flink pull request #5481: [FLINK-8560] Access to the current key in ProcessF...

2018-03-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5481 ---

[jira] [Commented] (FLINK-8560) add KeyedProcessFunction to expose the key in onTimer() and other methods

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388031#comment-16388031 ] ASF GitHub Bot commented on FLINK-8560: --- Github user asfgit closed the pull request

[GitHub] flink issue #5620: [FLINK-8824] [kafka] Replace getCanonicalName with getNam...

2018-03-06 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5620 +1 Looks good, merging this. ---

[jira] [Commented] (FLINK-8824) In Kafka Consumers, replace 'getCanonicalName()' with 'getClassName()'

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388034#comment-16388034 ] ASF GitHub Bot commented on FLINK-8824: --- Github user StephanEwen commented on the is

[jira] [Closed] (FLINK-8560) add KeyedProcessFunction to expose the key in onTimer() and other methods

2018-03-06 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Kloudas closed FLINK-8560. - Resolution: Fixed Merged on master with 159986292e35a71737bcc434d5f20f385973fafa and on release-1

[jira] [Commented] (FLINK-6924) ADD LOG(X) supported in TableAPI

2018-03-06 Thread Wind (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388046#comment-16388046 ] Wind commented on FLINK-6924: - I am not sure if [~Terry1897] is still doing this. However, I

[GitHub] flink issue #5645: FLINK-8876 Improve concurrent access handling in stateful...

2018-03-06 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5645 Making the concurrent access check re-entrant fixes all tests. My feeling would be to not add an end-to-end test for this, because end-to-end tests are quite expensive. Is this mainly for

[jira] [Commented] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388049#comment-16388049 ] ASF GitHub Bot commented on FLINK-8876: --- Github user StephanEwen commented on the is

[jira] [Created] (FLINK-8883) ExceptionUtils.rethrowIfFatalError should tread ThreadDeath as fatal.

2018-03-06 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8883: --- Summary: ExceptionUtils.rethrowIfFatalError should tread ThreadDeath as fatal. Key: FLINK-8883 URL: https://issues.apache.org/jira/browse/FLINK-8883 Project: Flink

[jira] [Created] (FLINK-8885) The DispatcherThreadFactory should register uncaught exception handlers

2018-03-06 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8885: --- Summary: The DispatcherThreadFactory should register uncaught exception handlers Key: FLINK-8885 URL: https://issues.apache.org/jira/browse/FLINK-8885 Project: Flink

[jira] [Created] (FLINK-8884) The DispatcherThreadFactory should register uncaught exception handlers

2018-03-06 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8884: --- Summary: The DispatcherThreadFactory should register uncaught exception handlers Key: FLINK-8884 URL: https://issues.apache.org/jira/browse/FLINK-8884 Project: Flink

[GitHub] flink pull request #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFu...

2018-03-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5500 ---

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388067#comment-16388067 ] ASF GitHub Bot commented on FLINK-8667: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-4387) Instability in KvStateClientTest.testClientServerIntegration()

2018-03-06 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388066#comment-16388066 ] Nico Kruber commented on FLINK-4387: because it is not fixed :( - and I'd target this

[jira] [Closed] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-03-06 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Kloudas closed FLINK-8667. - Resolution: Fixed Merged on master with  836998bd65ef2d0d0276faed189a0dfe8a7a6dc3 and on release-

[jira] [Comment Edited] (FLINK-6105) Properly handle InterruptedException in HadoopInputFormatBase

2018-03-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16307281#comment-16307281 ] Ted Yu edited comment on FLINK-6105 at 3/6/18 5:03 PM: --- In flink-co

[GitHub] flink issue #5634: [FLINK-5479] [kafka] Idleness detection for periodic per-...

2018-03-06 Thread tweise
Github user tweise commented on the issue: https://github.com/apache/flink/pull/5634 There was a related discussion on the mailing list; this and several other features could be provided by a common connector framework. Such initiative is a much larger effort though and it is not clea

  1   2   >