[jira] [Commented] (FLINK-8275) Flink YARN deployment with Kerberos enabled not working

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337049#comment-16337049 ] ASF GitHub Bot commented on FLINK-8275: --- Github user toggm commented on the issue:

[GitHub] flink issue #5172: [FLINK-8275] [Security] fix keytab local path in YarnTask...

2018-01-23 Thread toggm
Github user toggm commented on the issue: https://github.com/apache/flink/pull/5172 We try to use apache flink in Kerberos secured environment and had to backport to flink 1.3.2 because of that issue. Would be good to have that PR to be able to migrate to the latest flink version.

[jira] [Commented] (FLINK-7129) Dynamically changing patterns

2018-01-23 Thread aitozi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336981#comment-16336981 ] aitozi commented on FLINK-7129: --- Hi,can i ask the progress of this feature ? > Dynamically changing

[jira] [Commented] (FLINK-8492) [FLINK-8492][table] Fix calc cost bug

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336937#comment-16336937 ] ASF GitHub Bot commented on FLINK-8492: --- GitHub user hequn8128 opened a pull request:

[GitHub] flink pull request #5347: [FLINK-8492][table] Fix calc cost bug

2018-01-23 Thread hequn8128
GitHub user hequn8128 opened a pull request: https://github.com/apache/flink/pull/5347 [FLINK-8492][table] Fix calc cost bug ## What is the purpose of the change Fix calc cost bug. Currently, unsupported exception will be thrown when multi calc existing between

[jira] [Created] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-01-23 Thread yanxiaobin (JIRA)
yanxiaobin created FLINK-8500: - Summary: Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher) Key: FLINK-8500 URL: https://issues.apache.org/jira/browse/FLINK-8500 Project: Flink

[jira] [Updated] (FLINK-8492) [FLINK-8492][table] Fix calc cost bug

2018-01-23 Thread Hequn Cheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hequn Cheng updated FLINK-8492: --- Summary: [FLINK-8492][table] Fix calc cost bug (was: Fix unsupported exception for udtf with multi

[jira] [Commented] (FLINK-8492) Fix unsupported exception for udtf with multi calc

2018-01-23 Thread Hequn Cheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336778#comment-16336778 ] Hequn Cheng commented on FLINK-8492: Cool, It's an excellent solution! I will submit a pr soon. Thanks

[jira] [Commented] (FLINK-8490) Allow custom docker parameters for docker tasks on Mesos

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336554#comment-16336554 ] ASF GitHub Bot commented on FLINK-8490: --- Github user EronWright commented on the issue:

[GitHub] flink issue #5346: [FLINK-8490] [mesos] Allow custom docker parameters for d...

2018-01-23 Thread EronWright
Github user EronWright commented on the issue: https://github.com/apache/flink/pull/5346 +1 ---

[jira] [Commented] (FLINK-7386) Flink Elasticsearch 5 connector is not compatible with Elasticsearch 5.2+ client

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336536#comment-16336536 ] ASF GitHub Bot commented on FLINK-7386: --- Github user cjolif commented on the issue:

[GitHub] flink issue #4675: [FLINK-7386] FIx Elasticsearch 5 connector is not compati...

2018-01-23 Thread cjolif
Github user cjolif commented on the issue: https://github.com/apache/flink/pull/4675 @zjureel do you have by any chance an updated version of the PR against latest code (looks like current one conflicts)? ---

[jira] [Commented] (FLINK-8490) Allow custom docker parameters for docker tasks on Mesos

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336477#comment-16336477 ] ASF GitHub Bot commented on FLINK-8490: --- Github user joerg84 commented on the issue:

[GitHub] flink issue #5346: [FLINK-8490] [mesos] Allow custom docker parameters for d...

2018-01-23 Thread joerg84
Github user joerg84 commented on the issue: https://github.com/apache/flink/pull/5346 Looks great! I need to test that tomorrow in more detail. @tillrohrmann @EronWright ---

[jira] [Commented] (FLINK-8490) Allow custom docker parameters for docker tasks on Mesos

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336460#comment-16336460 ] ASF GitHub Bot commented on FLINK-8490: --- GitHub user lishim opened a pull request:

[GitHub] flink pull request #5346: [FLINK-8490] [mesos] Allow custom docker parameter...

2018-01-23 Thread lishim
GitHub user lishim opened a pull request: https://github.com/apache/flink/pull/5346 [FLINK-8490] [mesos] Allow custom docker parameters for docker tasks on Mesos ## What is the purpose of the change - This pull request introduces a feature that allows passing custom parameters

[jira] [Commented] (FLINK-8484) Kinesis consumer re-reads closed shards on job restart

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336396#comment-16336396 ] ASF GitHub Bot commented on FLINK-8484: --- Github user bowenli86 commented on the issue:

[GitHub] flink issue #5337: [FLINK-8484][flink-kinesis-connector] Ensure a Kinesis co...

2018-01-23 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5337 I'm wondering if this is valid? My understanding is that, by default, flink-connector-kinesis will get kinesis metadata (#shard, shard id, etc) every 10s (defined by

[jira] [Commented] (FLINK-8242) ClassCastException in OrcTableSource.toOrcPredicate

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336382#comment-16336382 ] ASF GitHub Bot commented on FLINK-8242: --- GitHub user fhueske opened a pull request:

[GitHub] flink pull request #5345: [FLINK-8242] [table] Fix predicate push-down of Or...

2018-01-23 Thread fhueske
GitHub user fhueske opened a pull request: https://github.com/apache/flink/pull/5345 [FLINK-8242] [table] Fix predicate push-down of OrcTableSource ## What is the purpose of the change * Fix `ClassClassException` in `OrcTableSource` caused by hard cast to `Serializable`

[jira] [Commented] (FLINK-8485) Running Flink inside Intellij no longer works after upgrading from 1.3.2 to 1.4.0

2018-01-23 Thread Xuan Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336375#comment-16336375 ] Xuan Nguyen commented on FLINK-8485: It happens all the time regardless of what code I'm running.  I

[jira] [Comment Edited] (FLINK-8485) Running Flink inside Intellij no longer works after upgrading from 1.3.2 to 1.4.0

2018-01-23 Thread Xuan Nguyen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336375#comment-16336375 ] Xuan Nguyen edited comment on FLINK-8485 at 1/23/18 9:11 PM: - It happens all

[jira] [Commented] (FLINK-8484) Kinesis consumer re-reads closed shards on job restart

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336373#comment-16336373 ] ASF GitHub Bot commented on FLINK-8484: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #5337: [FLINK-8484][flink-kinesis-connector] Ensure a Kinesis co...

2018-01-23 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5337 I am not deeply into the Kinesis Consumer logic, just writing here to double check that we do not build a solution where state grows infinitely. For example, it would not be feasible to

[jira] [Commented] (FLINK-8243) OrcTableSource should recursively read all files in nested directories of the input path.

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336365#comment-16336365 ] ASF GitHub Bot commented on FLINK-8243: --- GitHub user fhueske opened a pull request:

[GitHub] flink pull request #5344: [FLINK-8243] [orc] OrcTableSource reads input path...

2018-01-23 Thread fhueske
GitHub user fhueske opened a pull request: https://github.com/apache/flink/pull/5344 [FLINK-8243] [orc] OrcTableSource reads input path recursively by default. ## What is the purpose of the change - enable recursive directory enumeration for `OrcTableSource` (Hive's

[jira] [Created] (FLINK-8499) Kryo must not be child-first loaded

2018-01-23 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8499: --- Summary: Kryo must not be child-first loaded Key: FLINK-8499 URL: https://issues.apache.org/jira/browse/FLINK-8499 Project: Flink Issue Type: Bug

[jira] [Assigned] (FLINK-8466) ErrorInfo needs to hold Exception as SerializedThrowable

2018-01-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen reassigned FLINK-8466: --- Assignee: Stephan Ewen > ErrorInfo needs to hold Exception as SerializedThrowable >

[jira] [Updated] (FLINK-8466) ErrorInfo needs to hold Exception as SerializedThrowable

2018-01-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-8466: Description: MemoryArchivist holding on to last thrown exception prevents the user code

[jira] [Updated] (FLINK-8466) MemoryArchivist holding on to last thrown exception prevents the user code classloader from being garbage collected

2018-01-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-8466: Fix Version/s: 1.4.1 1.5.0 > MemoryArchivist holding on to last thrown exception

[jira] [Updated] (FLINK-8466) MemoryArchivist holding on to last thrown exception prevents the user code classloader from being garbage collected

2018-01-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-8466: Priority: Blocker (was: Major) > MemoryArchivist holding on to last thrown exception prevents the

[jira] [Updated] (FLINK-8466) ErrorInfo needs to hold Exception as SerializedThrowable

2018-01-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-8466: Summary: ErrorInfo needs to hold Exception as SerializedThrowable (was: MemoryArchivist holding on

[jira] [Commented] (FLINK-8467) Restoring job that does not use checkpointing from savepoint breaks

2018-01-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336277#comment-16336277 ] Stephan Ewen commented on FLINK-8467: - A job that is restored from a savepoint is expected to use the

[jira] [Commented] (FLINK-8485) Running Flink inside Intellij no longer works after upgrading from 1.3.2 to 1.4.0

2018-01-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336263#comment-16336263 ] Stephan Ewen commented on FLINK-8485: - Can you try and see if this error occurs all the time? The logs

[jira] [Commented] (FLINK-8493) Integrate queryable state with Flip-6

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336152#comment-16336152 ] ASF GitHub Bot commented on FLINK-8493: --- Github user GJL commented on the issue:

[GitHub] flink issue #5339: [FLINK-8493] [flip6] Integrate queryable state with Flip-...

2018-01-23 Thread GJL
Github user GJL commented on the issue: https://github.com/apache/flink/pull/5339 ui ---

[jira] [Commented] (FLINK-8492) Fix unsupported exception for udtf with multi calc

2018-01-23 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336105#comment-16336105 ] Fabian Hueske commented on FLINK-8492: -- OK, I think I found a simple fix. The problem is in fact a

[jira] [Commented] (FLINK-8498) GetExecutionPlan fails with IllegalArgumentException in Comparator

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336078#comment-16336078 ] Chesnay Schepler commented on FLINK-8498: - Can you provide example code to reproduce this? >

[jira] [Updated] (FLINK-5322) Clean up yarn configuration documentation

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-5322: Fix Version/s: (was: 1.1.5) > Clean up yarn configuration documentation >

[jira] [Resolved] (FLINK-5227) Add warning to include flink-table in job fat jars

2018-01-23 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske resolved FLINK-5227. -- Resolution: Fixed Fix Version/s: (was: 1.1.5) Warning has been added to the docs

[jira] [Commented] (FLINK-5227) Add warning to include flink-table in job fat jars

2018-01-23 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336072#comment-16336072 ] Fabian Hueske commented on FLINK-5227: -- I haven't checked recently. However, the issue has been

[jira] [Updated] (FLINK-6209) StreamPlanEnvironment always has a parallelism of 1

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-6209: Fix Version/s: (was: 1.2.2) > StreamPlanEnvironment always has a parallelism of 1 >

[jira] [Updated] (FLINK-5030) Support hostname verification

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-5030: Fix Version/s: (was: 1.2.2) > Support hostname verification >

[jira] [Closed] (FLINK-6142) RemoteStreamExecutionEnvironment throw class cast exception

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-6142. --- Resolution: Won't Fix > RemoteStreamExecutionEnvironment throw class cast exception >

[jira] [Closed] (FLINK-6102) Update protobuf to latest version

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-6102. --- Resolution: Won't Fix Fix Version/s: (was: 1.2.2) > Update protobuf to latest

[jira] [Commented] (FLINK-5227) Add warning to include flink-table in job fat jars

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336061#comment-16336061 ] Chesnay Schepler commented on FLINK-5227: - [~fhueske] Is this issue still relevant to newer

[jira] [Created] (FLINK-8498) GetExecutionPlan fails with IllegalArgumentException in Comparator

2018-01-23 Thread JIRA
Julian Bauß created FLINK-8498: -- Summary: GetExecutionPlan fails with IllegalArgumentException in Comparator Key: FLINK-8498 URL: https://issues.apache.org/jira/browse/FLINK-8498 Project: Flink

[jira] [Assigned] (FLINK-8496) WebUI does not display TM MemorySegment metrics

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-8496: --- Assignee: Chesnay Schepler > WebUI does not display TM MemorySegment metrics >

[jira] [Commented] (FLINK-8496) WebUI does not display TM MemorySegment metrics

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336042#comment-16336042 ] ASF GitHub Bot commented on FLINK-8496: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request #5343: [FLINK-8496][metrics] Create missing "Network" gro...

2018-01-23 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5343 [FLINK-8496][metrics] Create missing "Network" group ## What is the purpose of the change This PR reverts a change to the metric names for the AvailableMemorySegments/TotalMemorySegments

[jira] [Commented] (FLINK-8484) Kinesis consumer re-reads closed shards on job restart

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336041#comment-16336041 ] ASF GitHub Bot commented on FLINK-8484: --- Github user pluppens commented on the issue:

[GitHub] flink issue #5337: [FLINK-8484][flink-kinesis-connector] Ensure a Kinesis co...

2018-01-23 Thread pluppens
Github user pluppens commented on the issue: https://github.com/apache/flink/pull/5337 Alright, I've given it a quick stab - but the whole 'remove/update/re-add' cycle is kinda ugly due to the hashcode change. And I've just copied the test from the other example rather than using the

[jira] [Commented] (FLINK-8470) DelayTrigger and DelayAndCountTrigger in Flink Streaming Window API

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336036#comment-16336036 ] ASF GitHub Bot commented on FLINK-8470: --- GitHub user florianschmidt1994 opened a pull request:

[GitHub] flink pull request #5342: [FLINK-8470] Timebounded stream join

2018-01-23 Thread florianschmidt1994
GitHub user florianschmidt1994 opened a pull request: https://github.com/apache/flink/pull/5342 [FLINK-8470] Timebounded stream join ## What is the purpose of the change Add a time-bounded inner join implementation of two streams as a TwoInputStreamOperator, as discussed in

[jira] [Created] (FLINK-8497) KafkaConsumer throws NPE if topic doesn't exist

2018-01-23 Thread chris snow (JIRA)
chris snow created FLINK-8497: - Summary: KafkaConsumer throws NPE if topic doesn't exist Key: FLINK-8497 URL: https://issues.apache.org/jira/browse/FLINK-8497 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-8492) Fix unsupported exception for udtf with multi calc

2018-01-23 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335963#comment-16335963 ] Fabian Hueske commented on FLINK-8492: -- If I see that right, the calc merging rules are applied in

[jira] [Commented] (FLINK-8473) JarListHandler may fail with NPE if directory is deleted

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335914#comment-16335914 ] ASF GitHub Bot commented on FLINK-8473: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #5331: [FLINK-8473][webUI] Improve error behavior of JarListHand...

2018-01-23 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5331 Thanks, looks good! Please merge into `master` and `release-1.4`... ---

[jira] [Commented] (FLINK-8492) Fix unsupported exception for udtf with multi calc

2018-01-23 Thread Hequn Cheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335891#comment-16335891 ] Hequn Cheng commented on FLINK-8492: Hi [~fhueske], thanks for your reply. We can move calc rules

[jira] [Updated] (FLINK-8496) WebUI does not display TM MemorySegment metrics

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-8496: Affects Version/s: (was: 1.3.0) > WebUI does not display TM MemorySegment metrics >

[jira] [Updated] (FLINK-8496) WebUI does not display TM MemorySegment metrics

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-8496: Affects Version/s: 1.3.0 > WebUI does not display TM MemorySegment metrics >

[jira] [Created] (FLINK-8496) WebUI does not display TM MemorySegment metrics

2018-01-23 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8496: --- Summary: WebUI does not display TM MemorySegment metrics Key: FLINK-8496 URL: https://issues.apache.org/jira/browse/FLINK-8496 Project: Flink Issue

[jira] [Commented] (FLINK-8489) Data is not emitted by second ElasticSearch connector

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335857#comment-16335857 ] Chesnay Schepler commented on FLINK-8489: - What happens if you provide separate config maps to

[jira] [Commented] (FLINK-8495) Serve main cluster components log and stdout file

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335832#comment-16335832 ] ASF GitHub Bot commented on FLINK-8495: --- GitHub user tillrohrmann opened a pull request:

[GitHub] flink pull request #5341: [FLINK-8495] [flip6] Enable main cluster component...

2018-01-23 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5341 [FLINK-8495] [flip6] Enable main cluster component's log and stdout file retrieval ## What is the purpose of the change This commit enables the log and stdout file retrieval of the

[GitHub] flink pull request #5340: [FLINK-8475][config][docs] Integrate more ConfigOp...

2018-01-23 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5340 [FLINK-8475][config][docs] Integrate more ConfigOptions into documentation ## What is the purpose of the change This PR significantly extends the integration of ConfigOptions into the

[jira] [Commented] (FLINK-8475) Move remaining sections to generated tables

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335830#comment-16335830 ] ASF GitHub Bot commented on FLINK-8475: --- GitHub user zentol opened a pull request:

[jira] [Created] (FLINK-8495) Serve main cluster components log and stdout file

2018-01-23 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8495: Summary: Serve main cluster components log and stdout file Key: FLINK-8495 URL: https://issues.apache.org/jira/browse/FLINK-8495 Project: Flink Issue Type:

[jira] [Commented] (FLINK-6883) Serializer for collection of Scala case classes are generated with different anonymous class names in 1.3

2018-01-23 Thread Shashank Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335823#comment-16335823 ] Shashank Agarwal commented on FLINK-6883: - I am facing something similar issue in 1.4 where i have

[jira] [Commented] (FLINK-8494) Migrate CC#DEFAULT_PARALLELISM_KEY

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335817#comment-16335817 ] Chesnay Schepler commented on FLINK-8494: - well this is a bit trickier than expected since the

[jira] [Assigned] (FLINK-8494) Migrate CC#DEFAULT_PARALLELISM_KEY

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-8494: --- Assignee: Chesnay Schepler > Migrate CC#DEFAULT_PARALLELISM_KEY >

[jira] [Updated] (FLINK-8494) Migrate CC#DEFAULT_PARALLELISM_KEY

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-8494: Priority: Blocker (was: Major) > Migrate CC#DEFAULT_PARALLELISM_KEY >

[jira] [Updated] (FLINK-8494) Migrate CC#DEFAULT_PARALLELISM_KEY

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-8494: Fix Version/s: 1.5.0 > Migrate CC#DEFAULT_PARALLELISM_KEY >

[jira] [Created] (FLINK-8494) Migrate CC#DEFAULT_PARALLELISM_KEY

2018-01-23 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8494: --- Summary: Migrate CC#DEFAULT_PARALLELISM_KEY Key: FLINK-8494 URL: https://issues.apache.org/jira/browse/FLINK-8494 Project: Flink Issue Type: Sub-task

[jira] [Closed] (FLINK-4766) Migrate TaskManager configuration options

2018-01-23 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-4766. --- Resolution: Fixed Was resolved in the meantime. > Migrate TaskManager configuration options

[jira] [Commented] (FLINK-8022) Kafka at-least-once tests fail occasionally

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335786#comment-16335786 ] ASF GitHub Bot commented on FLINK-8022: --- Github user pnowojski commented on the issue:

[GitHub] flink issue #5316: [FLINK-8022][kafka-tests] Disable at-least-once tests for...

2018-01-23 Thread pnowojski
Github user pnowojski commented on the issue: https://github.com/apache/flink/pull/5316 What do you mean? Do you want to re-run this test three times and fail it if only two or three runs have failed? This test fails on reading the data back from Kafka during the checking

[jira] [Commented] (FLINK-8492) Fix unsupported exception for udtf with multi calc

2018-01-23 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335784#comment-16335784 ] Fabian Hueske commented on FLINK-8492: -- Isn't there already a rule that merges calcs and could be

[jira] [Closed] (FLINK-8441) serialize values and value separator directly to stream in RocksDBListState

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8441. - Resolution: Fixed Merged in ce25688bac1c1ecfa53a03ab1857bb82963b0696 . > serialize values and

[jira] [Closed] (FLINK-8365) Relax List type in HeapListState and HeapKeyedStateBackend

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8365. - Resolution: Fixed Merged in e075da5d5eb0f5ae8c394ea0c549f9dbce28fcf3 . > Relax List type in

[jira] [Closed] (FLINK-8411) HeapListState#add(null) will wipe out entire list state

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8411. - Resolution: Fixed Merged in e157cfa77f83608a0cd6d7d41a96edb0ca1f97f6 . > HeapListState#add(null)

[jira] [Closed] (FLINK-8469) relocate and unify RocksDB option params in RocksDBPerformanceTest

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8469. - Resolution: Fixed Merged in 1c9c1e36c1dd7b3f2a160216e405302d7854c148 . > relocate and unify

[jira] [Commented] (FLINK-8484) Kinesis consumer re-reads closed shards on job restart

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335765#comment-16335765 ] ASF GitHub Bot commented on FLINK-8484: --- Github user tzulitai commented on the issue:

[GitHub] flink issue #5337: [FLINK-8484][flink-kinesis-connector] Ensure a Kinesis co...

2018-01-23 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/5337 @pluppens yes, that sounds correct. `parentShardId` `adjacentParentShardId` `startingHashKey` `endingHashKey` `startingSequenceNumber` these should all be fixed once the

[jira] [Commented] (FLINK-8484) Kinesis consumer re-reads closed shards on job restart

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335762#comment-16335762 ] ASF GitHub Bot commented on FLINK-8484: --- Github user pluppens commented on the issue:

[GitHub] flink issue #5337: [FLINK-8484][flink-kinesis-connector] Ensure a Kinesis co...

2018-01-23 Thread pluppens
Github user pluppens commented on the issue: https://github.com/apache/flink/pull/5337 Just a small remark - from what I understood, the only property that *can* change is the endingSequenceNumber - all other state should be considered as 'set once', so there should be no point in

[jira] [Updated] (FLINK-8492) Fix unsupported exception for udtf with multi calc

2018-01-23 Thread Hequn Cheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hequn Cheng updated FLINK-8492: --- Description: Considering the following test, unsupported exception will be thrown due to  multi calc

[GitHub] flink pull request #5339: [FLINK-8493] [flip6] Integrate queryable state wit...

2018-01-23 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5339 [FLINK-8493] [flip6] Integrate queryable state with Flip-6 ## What is the purpose of the change Adapt KvStateRegistry to accept multiple KvStateRegistryListeners. Introduce the

[jira] [Commented] (FLINK-8493) Integrate queryable state with Flip-6

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335755#comment-16335755 ] ASF GitHub Bot commented on FLINK-8493: --- GitHub user tillrohrmann opened a pull request:

[jira] [Commented] (FLINK-8411) HeapListState#add(null) will wipe out entire list state

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335753#comment-16335753 ] ASF GitHub Bot commented on FLINK-8411: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-8365) Relax List type in HeapListState and HeapKeyedStateBackend

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335752#comment-16335752 ] ASF GitHub Bot commented on FLINK-8365: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-8469) relocate and unify RocksDB option params in RocksDBPerformanceTest

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335754#comment-16335754 ] ASF GitHub Bot commented on FLINK-8469: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5325: [FLINK-8469] [State Backend] [RocksDB] relocate an...

2018-01-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5325 ---

[GitHub] flink pull request #5300: [FLINK-8411] [State Backends] HeapListState#add(nu...

2018-01-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5300 ---

[GitHub] flink pull request #5326: [FLINK-8365] [State Backend] Relax List type in He...

2018-01-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5326 ---

[jira] [Created] (FLINK-8493) Integrate queryable state with Flip-6

2018-01-23 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8493: Summary: Integrate queryable state with Flip-6 Key: FLINK-8493 URL: https://issues.apache.org/jira/browse/FLINK-8493 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-8492) Fix unsupported exception for udtf with multi calc

2018-01-23 Thread Hequn Cheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hequn Cheng updated FLINK-8492: --- Description: Considering the following test, unsupported exception will be thrown due to  multi calc

[jira] [Updated] (FLINK-8492) Fix unsupported exception for udtf with multi calc

2018-01-23 Thread Hequn Cheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hequn Cheng updated FLINK-8492: --- Description: Considering the following test, unsupported exception will be thrown due to  multi calc

[jira] [Created] (FLINK-8492) Fix unsupported exception for udtf with multi calc

2018-01-23 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-8492: -- Summary: Fix unsupported exception for udtf with multi calc Key: FLINK-8492 URL: https://issues.apache.org/jira/browse/FLINK-8492 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-8484) Kinesis consumer re-reads closed shards on job restart

2018-01-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335726#comment-16335726 ] ASF GitHub Bot commented on FLINK-8484: --- Github user pluppens commented on the issue:

  1   2   >