Re: [DISCUSS] Release Flink 0.10.1 soon

@Suneel, I think https://issues.apache.org/jira/browse/FLINK-2949 is a new feature. The 0.10.1 release is intended as a bugfix release only. FLINK-3013 and FLINK-3036 have been merged to master only. Are there plans to merge it to "release-0.10" as well? The list of issues now looks as follows:

Re: [DISCUSS] Release Flink 0.10.1 soon

Yes forgot about merging them to release-0.10. Will do it right away. On Nov 19, 2015 9:40 AM, "Robert Metzger" wrote: > @Suneel, I think https://issues.apache.org/jira/browse/FLINK-2949 is a new > feature. The 0.10.1 release is intended as a bugfix release only. > >

Re: [DISCUSS] Release Flink 0.10.1 soon

If they cover things which are also wrongly documented in 0.10, then they should be merged to 0.10-release as well. On Thu, Nov 19, 2015 at 10:01 AM, Suneel Marthi wrote: > @Till Should the recent updates to docs/apis/streaming-guide.md be also > merged to 'release

Re: [DISCUSS] Release Flink 0.10.1 soon

+1 for a 0.10.1 release pretty soon. I merged FLINK-2989 (job cancel button doesn't work on YARN). On Thu, Nov 19, 2015 at 10:10 AM, Till Rohrmann wrote: > If they cover things which are also wrongly documented in 0.10, then they > should be merged to 0.10-release as

[jira] [Created] (FLINK-3045) Properly expose the key of a kafka message

Robert Metzger created FLINK-3045: - Summary: Properly expose the key of a kafka message Key: FLINK-3045 URL: https://issues.apache.org/jira/browse/FLINK-3045 Project: Flink Issue Type:

Re: [DISCUSS] Release Flink 0.10.1 soon

Flink-3017, Flink-3022, and some hotfixes u had put in over the past few days. Flink-3041 and Flink-3043 are pending PRs at the moment. On Thu, Nov 19, 2015 at 4:10 AM, Till Rohrmann wrote: > If they cover things which are also wrongly documented in 0.10, then they >

Re: [DISCUSS] Release Flink 0.10.1 soon

@Till Should the recent updates to docs/apis/streaming-guide.md be also merged to 'release 0.10'? There are other related PRs pending. On Thu, Nov 19, 2015 at 3:42 AM, Till Rohrmann wrote: > Yes forgot about merging them to release-0.10. Will do it right away. > On Nov 19,

SETUP ISSUES

*Greetings* *I am just getting started with FLINK and i have having problems knowing what dependencies i need to run FLINK DATASET API & other APIs Please advise if you can assist in me getting started * *John M*

Re: SETUP ISSUES

Hi John, Flink has a nice documentation for all APIs [1]. To get you started with the correct Maven dependencies for the DataSet API, please have a look at "Linking With Flink" [2]. On that site, you will also find a lot of Java and Scala examples. Please let us know, if you need help. Best,

Re: [DISCUSS] Include import statements in documentation code examples

Thank you for the feedback. I was also spending some time thinking about automating this, but I don't have the time right now to bring the required infrastructure in place. For now, I'll just add import statements for classes with the potential of confusion (in particular between the Scala and

Re: How to use static data with streams?

Hi Ali, sorry for the delayed response. Regarding your question: This is a bit tricky but doable. I assume you have CSV records with ID's 1 - 1000 and you run your stuff with a parallelism of 2. The Rich* variants of the user defined functions allow you to access a runtime context. This

Re: Add BigDecimal and BigInteger as types

Ah, support as an efficient key types is a fair argument, yes! On Thu, Nov 19, 2015 at 2:30 PM, Timo Walther wrote: > I could image that some applications also want to group or join by a > BigInteger or sort by BigDecimal. All DBMS support this types by default. > I'm not

[jira] [Created] (FLINK-3049) Move "Either" type to package "org.apache.flink.types"

Stephan Ewen created FLINK-3049: --- Summary: Move "Either" type to package "org.apache.flink.types" Key: FLINK-3049 URL: https://issues.apache.org/jira/browse/FLINK-3049 Project: Flink Issue

[jira] [Created] (FLINK-3051) Define a maximum number of concurrent inflight checkpoints

Stephan Ewen created FLINK-3051: --- Summary: Define a maximum number of concurrent inflight checkpoints Key: FLINK-3051 URL: https://issues.apache.org/jira/browse/FLINK-3051 Project: Flink Issue

[jira] [Created] (FLINK-3048) DataSinkTaskTest.testCancelDataSinkTask

Matthias J. Sax created FLINK-3048: -- Summary: DataSinkTaskTest.testCancelDataSinkTask Key: FLINK-3048 URL: https://issues.apache.org/jira/browse/FLINK-3048 Project: Flink Issue Type: Bug

Re: [DISCUSSION] Type hints versus TypeInfoParser

All that you have mentioned is implemented in the TypeExtractor. I just mean corner cases e.g. if you have a POJO public class MyPojo { public Object field1; public Object field2; public Tuple2 field3; } Where the TypeExtractor can not analyze anything. Then you may want to

Re: Add BigDecimal and BigInteger as types

I could image that some applications also want to group or join by a BigInteger or sort by BigDecimal. All DBMS support this types by default. I'm not from the industry but there is a need for that I think. On 18.11.2015 18:21, Stephan Ewen wrote: I agree that they are important. They are

Re: [DISCUSSION] Type hints versus TypeInfoParser

Ah, I see. Sounds a bit corner case to me, actually. On Thu, Nov 19, 2015 at 2:20 PM, Timo Walther wrote: > All that you have mentioned is implemented in the TypeExtractor. I just > mean corner cases e.g. if you have a POJO > > public class MyPojo { > public Object

Re: [DISCUSS] Include import statements in documentation code examples

I think it's confusing to only have a subset of import statements provided. But then again, the missing ones will be resolved without confusion (hopefully) ;) We can go with this and see what feedback we get. (Just doing it for some examples sounds reasonable.) – Ufuk On Thu, Nov 19, 2015 at