JSONKeyValueDeserializationSchema does not handle null Kafka keys

Hi devs, I was testing writing data to a Kafka topic and reading from it using the JSONKeyValueDeserializationSchema and encountered NPEs. After tracing them, it seems that null messageKeys are not handled:

[jira] [Created] (FLINK-6564) Build fails on file systems that do not distinguish between upper and lower case

Fabian Hueske created FLINK-6564: Summary: Build fails on file systems that do not distinguish between upper and lower case Key: FLINK-6564 URL: https://issues.apache.org/jira/browse/FLINK-6564

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

Hi, Just curious -- do we have anything to track the blockers on the table / SQL side? For example, it seems to me that FLINK-6563 is a blocker because all group windows in SQL will not work without it. I think that Fabian / Timo might want to get several jiras into 1.3. Regards, Haohui On Thu,

[jira] [Created] (FLINK-6563) Expose time indicator attributes in the KafkaTableSource

Haohui Mai created FLINK-6563: - Summary: Expose time indicator attributes in the KafkaTableSource Key: FLINK-6563 URL: https://issues.apache.org/jira/browse/FLINK-6563 Project: Flink Issue Type:

[jira] [Created] (FLINK-6562) Support implicit table references for nested fields in SQL

Haohui Mai created FLINK-6562: - Summary: Support implicit table references for nested fields in SQL Key: FLINK-6562 URL: https://issues.apache.org/jira/browse/FLINK-6562 Project: Flink Issue

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

>From the above list, I addressed a bunch of issues. - FLINK-6514 Cannot start Flink Cluster in standalone mode has an open Pull Request: - master: https://github.com/apache/flink/pull/3876 - 1.3: https://github.com/apache/flink/pull/3877 Left are: - FLINK-6537 Umbrella issue for fixes to

Re: [DISCUSS] Changing Flink's shading model

@eron I would try to rely almost purely on the shade plugin On Thu, May 11, 2017 at 7:53 PM, Eron Wright wrote: > In my opinion, the ideal approach to mitigating conflicts between > application code and Flink itself is to relocate all of Flink's > dependencies. Rationale

Re: [DISCUSS] Changing Flink's shading model

In my opinion, the ideal approach to mitigating conflicts between application code and Flink itself is to relocate all of Flink's dependencies. Rationale is to avoid placing the burden of relocation on the app developer, and ultimately to eliminate the need for an app uber-jar. For example,

[jira] [Created] (FLINK-6560) Restore maven parallelism in flink-tests

Greg Hogan created FLINK-6560: - Summary: Restore maven parallelism in flink-tests Key: FLINK-6560 URL: https://issues.apache.org/jira/browse/FLINK-6560 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6559) Rename 'slaves' to 'workers'

Stephan Ewen created FLINK-6559: --- Summary: Rename 'slaves' to 'workers' Key: FLINK-6559 URL: https://issues.apache.org/jira/browse/FLINK-6559 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6558) Yarn tests fail on Windows

Chesnay Schepler created FLINK-6558: --- Summary: Yarn tests fail on Windows Key: FLINK-6558 URL: https://issues.apache.org/jira/browse/FLINK-6558 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6557) RocksDbStateBackendTest fails on Windows

Chesnay Schepler created FLINK-6557: --- Summary: RocksDbStateBackendTest fails on Windows Key: FLINK-6557 URL: https://issues.apache.org/jira/browse/FLINK-6557 Project: Flink Issue Type:

[jira] [Created] (FLINK-6556) Include and expose Flink version in the savepoint data

Stefan Richter created FLINK-6556: - Summary: Include and expose Flink version in the savepoint data Key: FLINK-6556 URL: https://issues.apache.org/jira/browse/FLINK-6556 Project: Flink Issue

[jira] [Created] (FLINK-6555) Generalize ConjunctFuture

Till Rohrmann created FLINK-6555: Summary: Generalize ConjunctFuture Key: FLINK-6555 URL: https://issues.apache.org/jira/browse/FLINK-6555 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6554) CompatibilityResult should contain a notCompatible() option

Chesnay Schepler created FLINK-6554: --- Summary: CompatibilityResult should contain a notCompatible() option Key: FLINK-6554 URL: https://issues.apache.org/jira/browse/FLINK-6554 Project: Flink

[jira] [Created] (FLINK-6553) Calls to getSideOutput() result in warnings regarding unchecked assignments

Chesnay Schepler created FLINK-6553: --- Summary: Calls to getSideOutput() result in warnings regarding unchecked assignments Key: FLINK-6553 URL: https://issues.apache.org/jira/browse/FLINK-6553

[jira] [Created] (FLINK-6552) Ambiguous error message when retrieving multiple side-outputs

Chesnay Schepler created FLINK-6552: --- Summary: Ambiguous error message when retrieving multiple side-outputs Key: FLINK-6552 URL: https://issues.apache.org/jira/browse/FLINK-6552 Project: Flink

[jira] [Created] (FLINK-6551) OutputTag name should not be empty

Chesnay Schepler created FLINK-6551: --- Summary: OutputTag name should not be empty Key: FLINK-6551 URL: https://issues.apache.org/jira/browse/FLINK-6551 Project: Flink Issue Type:

[jira] [Created] (FLINK-6550) Calling ctx.collect with a null OutputTag should log a warning or throw an exception

Chesnay Schepler created FLINK-6550: --- Summary: Calling ctx.collect with a null OutputTag should log a warning or throw an exception Key: FLINK-6550 URL: https://issues.apache.org/jira/browse/FLINK-6550

[jira] [Created] (FLINK-6549) Improve error message for type mismatches with side outputs

Chesnay Schepler created FLINK-6549: --- Summary: Improve error message for type mismatches with side outputs Key: FLINK-6549 URL: https://issues.apache.org/jira/browse/FLINK-6549 Project: Flink

[jira] [Created] (FLINK-6548) AvroOutputFormatTest fails on Windows

Chesnay Schepler created FLINK-6548: --- Summary: AvroOutputFormatTest fails on Windows Key: FLINK-6548 URL: https://issues.apache.org/jira/browse/FLINK-6548 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6547) Improve toString methods of Table API expressions

Timo Walther created FLINK-6547: --- Summary: Improve toString methods of Table API expressions Key: FLINK-6547 URL: https://issues.apache.org/jira/browse/FLINK-6547 Project: Flink Issue Type:

[jira] [Created] (FLINK-6546) Fix dependencies of flink-mesos

Stephan Ewen created FLINK-6546: --- Summary: Fix dependencies of flink-mesos Key: FLINK-6546 URL: https://issues.apache.org/jira/browse/FLINK-6546 Project: Flink Issue Type: Bug

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

It seems that we found quite a large number of critical issues in the first RC. - FLINK-6537 Umbrella issue for fixes to incremental snapshots (Stefan has a PR open to fix the critical ones) - FLINK-6531 Deserialize checkpoint hooks with user classloader (has a pending PR) - FLINK-6515

[jira] [Created] (FLINK-6545) Make incremental checkpoints externalizable

Stefan Richter created FLINK-6545: - Summary: Make incremental checkpoints externalizable Key: FLINK-6545 URL: https://issues.apache.org/jira/browse/FLINK-6545 Project: Flink Issue Type:

[jira] [Created] (FLINK-6544) Expose Backend State Interface for UDAGG

Kaibo Zhou created FLINK-6544: - Summary: Expose Backend State Interface for UDAGG Key: FLINK-6544 URL: https://issues.apache.org/jira/browse/FLINK-6544 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6543) Deprecate toDataStream

Timo Walther created FLINK-6543: --- Summary: Deprecate toDataStream Key: FLINK-6543 URL: https://issues.apache.org/jira/browse/FLINK-6543 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6542) Non-keyed, non-windowed aggregation fails

Timo Walther created FLINK-6542: --- Summary: Non-keyed, non-windowed aggregation fails Key: FLINK-6542 URL: https://issues.apache.org/jira/browse/FLINK-6542 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6541) Jar upload directory not created

Andrey created FLINK-6541: - Summary: Jar upload directory not created Key: FLINK-6541 URL: https://issues.apache.org/jira/browse/FLINK-6541 Project: Flink Issue Type: Bug Affects Versions: 1.2.0

Re: [DISCUSS] Changing Flink's shading model

On Thu, May 11, 2017 at 10:59 AM, Till Rohrmann wrote: > Have we somewhere documented how to publish > artifacts on Maven central? Pulling in Robert who published frocks. @Robert: Would you like to volunteer for this? Would really help to combine this with some docs about

[jira] [Created] (FLINK-6540) Create tests that cover all the issues

Stefan Richter created FLINK-6540: - Summary: Create tests that cover all the issues Key: FLINK-6540 URL: https://issues.apache.org/jira/browse/FLINK-6540 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-6539) Add automated end-to-end tests

Aljoscha Krettek created FLINK-6539: --- Summary: Add automated end-to-end tests Key: FLINK-6539 URL: https://issues.apache.org/jira/browse/FLINK-6539 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6538) Emit late elements as Side Outputs

Kostas Kloudas created FLINK-6538: - Summary: Emit late elements as Side Outputs Key: FLINK-6538 URL: https://issues.apache.org/jira/browse/FLINK-6538 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

Stefan Richter created FLINK-6537: - Summary: Umbrella issue for fixes to incremental snapshots Key: FLINK-6537 URL: https://issues.apache.org/jira/browse/FLINK-6537 Project: Flink Issue

[jira] [Created] (FLINK-6536) Improve error message in SharedBuffer::put()

Kostas Kloudas created FLINK-6536: - Summary: Improve error message in SharedBuffer::put() Key: FLINK-6536 URL: https://issues.apache.org/jira/browse/FLINK-6536 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6535) JobID should not be part of the registration key to the SharedStateRegistry

Stefan Richter created FLINK-6535: - Summary: JobID should not be part of the registration key to the SharedStateRegistry Key: FLINK-6535 URL: https://issues.apache.org/jira/browse/FLINK-6535 Project:

Re: [DISCUSS] Changing Flink's shading model

I agree that shading is a nasty business it would make things a bit more explicit to program directly against the relocated API of the above-mentioned libraries. I assume that we should be able to follow the examples of flakka and frocks. Have we somewhere documented how to publish artifacts on

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

Unfortunately, it won't be fully functional in 1.3. Cheers, Till On Thu, May 11, 2017 at 10:45 AM, Renjie Liu wrote: > @Rohrmann Will FLIP 6 be fully functional in 1.3 release? > > On Thu, May 11, 2017 at 4:12 PM Gyula Fóra wrote: > > > Thanks

Re: [DISCUSS] Changing Flink's shading model

@Ufuk - I have never set up artifact deployment in Maven, could need some help there. Regarding shading Netty, I agree, would be good to do that as well... On Thu, May 11, 2017 at 10:52 AM, Ufuk Celebi wrote: > The advantages you've listed sound really compelling to me. > > -

Re: [DISCUSS] Changing Flink's shading model

The advantages you've listed sound really compelling to me. - Do you have time to implement these changes or do we need a volunteer? ;) - I assume that republishing the artifacts as you propose doesn't have any new legal implications since we already publish them with our JARs, right? - We

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

@Rohrmann Will FLIP 6 be fully functional in 1.3 release? On Thu, May 11, 2017 at 4:12 PM Gyula Fóra wrote: > Thanks Stefan! > Gyula > > Stefan Richter ezt írta (időpont: 2017. máj. > 11., Cs, 10:04): > > > > > Hi, > > > > Thanks for reporting

[jira] [Created] (FLINK-6534) SharedStateRegistry is disposing state handles from main thread

Stefan Richter created FLINK-6534: - Summary: SharedStateRegistry is disposing state handles from main thread Key: FLINK-6534 URL: https://issues.apache.org/jira/browse/FLINK-6534 Project: Flink

[jira] [Created] (FLINK-6533) Duplicated registration of new shared state when checkpoint confirmations are still pending

Stefan Richter created FLINK-6533: - Summary: Duplicated registration of new shared state when checkpoint confirmations are still pending Key: FLINK-6533 URL: https://issues.apache.org/jira/browse/FLINK-6533

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

Thanks Stefan! Gyula Stefan Richter ezt írta (időpont: 2017. máj. 11., Cs, 10:04): > > Hi, > > Thanks for reporting this. I found a couple of issues yesterday and I am > currently working on a bundle of fixes. I will take a look at this problem, > and if it is

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

Hi, Thanks for reporting this. I found a couple of issues yesterday and I am currently working on a bundle of fixes. I will take a look at this problem, and if it is already covered. Best, Stefan > Am 11.05.2017 um 09:47 schrieb Gyula Fóra : > > Hi, > I am not sure if

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

Hi, I am not sure if this belong to this thread, but while trying to run a job with rocks incremental backend I ran into 2 issues: One with savepoints, I can't figure out because I can't make sense of the error or how it happenned: The error stack trace is here:

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

Hi Renjie, 1.3 already contains some Flip-6 code. However, it is not yet fully functional. What you already can do is to run local jobs on the Flip-6 code base by instantiating a MiniCluster and then using the Flip6LocalStreamEnvironment. Cheers, Till On Thu, May 11, 2017 at 6:00 AM, Renjie Liu