[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950170#comment-14950170 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-146826450 I will merge this now since the code is also changed. We can iterate on this if need be. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950180#comment-14950180 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-146829953 @asfgit didn't close it automatically, could you please close it @ktzoumas . > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950318#comment-14950318 ] ASF GitHub Bot commented on FLINK-2779: --- Github user ktzoumas closed the pull request at: https://github.com/apache/flink/pull/1208 > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14948328#comment-14948328 ] ASF GitHub Bot commented on FLINK-2779: --- Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-146464070 Last part of review: Connectors - (with the exception of Twitter where only a source is provided and Elasticsearch where only a sink is provided) -> The following list only shows sink for HDFS. I'd just remove the exception sentence. Kafka Source: - This section describes the FlinkKafkaConsumer082 and not the KafkaSource Kafka Sink: - This sentence is confusing, IMO: "Also the serializer configuration should be left default, the serialization should be set via SerializationSchema." Elasticsearch: - "Sink" is sometimes capitalized, sometimes not. - Not how -> Note how Hadoop FileSystem - Hadoop FileSystem -> Hadoop File System - "Sink" is sometimes capitalized, sometimes not. Twitter Streaming API - Remember to keep these pieces of information a secret -> Remember to keep these pieces of information secret (remove "a") - numberOfTweets determine how many tweet the source emits. -> numberOfTweets determineS how many tweet the source emits. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14948431#comment-14948431 ] ASF GitHub Bot commented on FLINK-2779: --- Github user ktzoumas commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-146484570 Thanks a lot Fabian for the fantastic review! I addressed most of your comments. The state section needs to be rewritten after https://github.com/apache/flink/pull/1239 has been merged. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14948632#comment-14948632 ] ASF GitHub Bot commented on FLINK-2779: --- Github user mbalassi commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-146542207 Thanks for this big update, guys! Some comments: * Explanation of operator chaining and options are missing. * Collection Data Sources: The following sentence should be removed: 'Currently, the collection data source requires that data types and iterators implement Serializable.' This is not true anymore. * Transformations DataStream,DataStream → DataStream looks better with a tuple-style input for me: (DataStream, DataStream) → DataStream if that fits on the page. * In the source code examples I would use the diamond operator for Java7, e.g. in the Splitter of the WC. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14948814#comment-14948814 ] ASF GitHub Bot commented on FLINK-2779: --- Github user ktzoumas commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-146576052 @mbalassi: is the operator chaining currently documented somewhere? Same about partitioning between operators of different parallelism > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14948868#comment-14948868 ] ASF GitHub Bot commented on FLINK-2779: --- Github user mbalassi commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-146583059 @ktzoumas chaining has decent documentation in the Javadocs. The behavior of subsequent operations with different parallelism is not really documented unless I am missing something. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14948988#comment-14948988 ] ASF GitHub Bot commented on FLINK-2779: --- Github user ktzoumas commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-146624231 Added docs for chaining and resource groups > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14946886#comment-14946886 ] ASF GitHub Bot commented on FLINK-2779: --- Github user ktzoumas commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-146203981 Once https://github.com/apache/flink/pull/1238 is merged, this is ready to be merged as well (the docs track the changes in that PR) > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945424#comment-14945424 ] ASF GitHub Bot commented on FLINK-2779: --- Github user ktzoumas commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145936851 I addressed the comments above, added the content for Scala, reworked the iterations section, added content to the windows section, and made the DataStream API guide almost identical to the DataSet API guide content-wise (still with links towards the DataSet guide). I also made changes to the docs as a whole to reflect the equal status of the DataSet and DataStream APIs. There are still some features that are missing from the docs or are poorly documented (aggregations and state). I am working on those. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941136#comment-14941136 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145021034 There should be some streaming specific stuff in the `Execution Config` section. For example, there is `enableTimestamps()` and `setAutoWatermarkInterval()`. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941150#comment-14941150 ] ASF GitHub Bot commented on FLINK-2779: --- Github user senorcarbone commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145025577 Nice doc so far ^^ One tiny fix on the *Advanced window constructs* subsection: [0,1000], [100,1100], **[200,1200]**, ..., [1000, 2000] > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941090#comment-14941090 ] ASF GitHub Bot commented on FLINK-2779: --- Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145013573 Two comments: - I would call the section "Buffer Timeout" rather "Controlling Latency" or so. It helps people that are interested in latency to find the section relevant for them - The code example in "Making local variables consistent" is wrong, the types of the interfaces/casting is not correct > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941113#comment-14941113 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145017010 Sometimes you write DataSet in the stream guide where it should be DataStream. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941127#comment-14941127 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145019903 The WindowFunction has a different signature for regular windows and all windows. This should maybe be visible in the transformations section. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941119#comment-14941119 ] ASF GitHub Bot commented on FLINK-2779: --- Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145017991 The description of Evictors for the keyed windows are a little bit messy, what gets evicted from where. There is also some conflict with the example and the description: "Retain 1000 elements from the end of the window backwards, evicting all others." vs "and every time execution is triggered, 10 elements are removed from the window". As far as I understand triggers and evictors work with the same semantics as now, but there is always a fix time trigger/eviction determined by the window assigner. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941118#comment-14941118 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145017812 In the section "Transformations" you sometimes use the `` syntax to highlight words, such as DataStream. Inside the table they don't get properly translated, however. (At least on my machine.) > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941179#comment-14941179 ] ASF GitHub Bot commented on FLINK-2779: --- Github user senorcarbone commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145032778 Ah Indeed. I just reviewed this with the prospect of custom pre-aggregations in mind and it seems like pre-aggregation strategies operate on bucket-granularity. Solely on windowing semantics what you suggest covers my question though. thanks ^^ > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941148#comment-14941148 ] ASF GitHub Bot commented on FLINK-2779: --- Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145025216 Would be a nice addition to the docs, to state that global time reduce (and other aggregations) are pre-aggregated in parallel. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941144#comment-14941144 ] ASF GitHub Bot commented on FLINK-2779: --- Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145024435 Global windows are not parallel, not in any system, it is inherent in the operation. You can pre-aggregate in parallel, if the windows are time windows. These are probably the most common windows. Any other windows are not even supported in any other system that I have worked with... > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941163#comment-14941163 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145029475 @senorcarbone It doesn't restrict. You can use an assigner that assigns to one single window. Then using, trigger and evictor you can implement everything that was possible before. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941128#comment-14941128 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020080 @gyfora Yes, they work with the same semantics. What do you mean by "fix time trigger/eviction determined by the window assigner"? > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941129#comment-14941129 ] ASF GitHub Bot commented on FLINK-2779: --- Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020261 @aljoscha : what I meant was just that we define some time semantics with the window assigner > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941130#comment-14941130 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020330 @gyfora, yes, thats right > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941134#comment-14941134 ] ASF GitHub Bot commented on FLINK-2779: --- Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020604 "Windows on unkeyed data streams (non-parallel windows)" I still think that this gives a bad false impression of executing all global windows including time in a non-parallel way. I can already here people say that Spark can do global time windows in parallel while Flink cant :P > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941132#comment-14941132 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020475 The ConnectedStreams example formatting is off (in Transformations section), also there should be something like: ```java ConnectedStreams<> connectedStreams = someStream.connect(otherStream) ``` > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941133#comment-14941133 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020534 If split is mentioned select should also be mentioned. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941146#comment-14941146 ] ASF GitHub Bot commented on FLINK-2779: --- Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145024860 That is what I mean, global time reduce. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941160#comment-14941160 ] ASF GitHub Bot commented on FLINK-2779: --- Github user senorcarbone commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145028978 From a quick read on the documentation (and prior knowledge from google dataflow) it is easy to get a full picture of the new semantics. Even though I like it from a engineering perspective, It needs to be pointed out though that the addition of the *Assigner* restricts our previous windowing semantics to periodic windows, i.e. at the moment you receive a record you have to know all the possible buckets this record will fall into while before we did not have such a constraint. In other words we no longer support dynamic windows where range and slide can change dynamically. > Update documentation to reflect new Stream/Window API > - > > Key: FLINK-2779 > URL: https://issues.apache.org/jira/browse/FLINK-2779 > Project: Flink > Issue Type: Sub-task > Components: Streaming >Reporter: Aljoscha Krettek >Assignee: Kostas Tzoumas > Fix For: 0.10 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
