Re: [DISCUSS] ElasticSearch in Flink Strategy

Hi, As part of restructuring the ES connectors, I think it also a very good timing to unify how our ES connectors are used. For the 1.x connector, users provide a “IndexRequestBuilder” that was only capable of indexing a single document for each record. For the 2.x and pending 5.x connector,

[jira] [Created] (FLINK-5432) ContinuousFileMonitoringFunction is not monitoring nested files

Yassine Marzougui created FLINK-5432: Summary: ContinuousFileMonitoringFunction is not monitoring nested files Key: FLINK-5432 URL: https://issues.apache.org/jira/browse/FLINK-5432 Project: Flink

Slow duplicated tests

Hi, I am trying make small review for slow test and I found small issue: NonReusingReOpenableHashTableITCase testSpillingHashJoinWithMassiveCollisions testSpillingHashJoinWithTwoRecursions for testSpillingHashJoinWithTwoRecursions exist description /* * This test is basically identical to

Re: time format for akka status

Hi, Till I created https://issues.apache.org/jira/browse/FLINK-5431 I prefer use "-MM-dd HH:mm:ss" because it's more similar to ISO date format. We can't stay only "HH:mm:ss" because this formatter are using for output data on console (System.out ) and for longrunning applications print

[jira] [Created] (FLINK-5431) time format for akka status

Alexey Diomin created FLINK-5431: Summary: time format for akka status Key: FLINK-5431 URL: https://issues.apache.org/jira/browse/FLINK-5431 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Proposed updates to Flink project site

Looks great! Some minor comments: - Font page: Maybe put the latest blog posts before the power by logos? - Nav bar on the left: I noticed that for some links the active color does not show. Clicking on "Blog" makes highlights the link but not for others like "Powered By" On Mon, Jan 9, 2017 at

Re: [DISCUSS] Proposed updates to Flink project site

Hi, you can also now preview the site here: https://wints.github.io/flink-web/. -Mike On Mon, Jan 9, 2017 at 3:07 PM, Mike Winters wrote: > Hi everyone, > > For the sake of having many sets of eyes to help catch potential issues, I > decided to wait until after the new year

[jira] [Created] (FLINK-5430) Bring documentation up to speed for current feature set

Stephan Ewen created FLINK-5430: --- Summary: Bring documentation up to speed for current feature set Key: FLINK-5430 URL: https://issues.apache.org/jira/browse/FLINK-5430 Project: Flink Issue

Re: [DISCUSS] ElasticSearch in Flink Strategy

+1 for keeping the ES connector in Flink On Mon, Jan 9, 2017 at 2:53 PM, Robert Metzger wrote: > Thanks for bringing this up again Flavio. > > The good thing about a common base for all ES connectors is that we can fix > the issue for all ES versions (ideally). > > Thanks a

Re: [DISCUSS] Proposed updates to Flink project site

Hi everyone, For the sake of having many sets of eyes to help catch potential issues, I decided to wait until after the new year to create a PR for the updated Flink site. You can find it here: https://github.com/apache/flink-web/pull/44 Please share any feedback! Thanks, Mike On Fri, Dec 2,

[jira] [Created] (FLINK-5429) Code generate types between operators in Table API

Timo Walther created FLINK-5429: --- Summary: Code generate types between operators in Table API Key: FLINK-5429 URL: https://issues.apache.org/jira/browse/FLINK-5429 Project: Flink Issue Type:

Re: [DISCUSS] ElasticSearch in Flink Strategy

Thanks for bringing this up again Flavio. The good thing about a common base for all ES connectors is that we can fix the issue for all ES versions (ideally). Thanks a lot for taking care of my proposed changes Gordon! On Mon, Jan 9, 2017 at 12:47 PM, Flavio Pompermaier

Re: time format for akka status

Hi Alexey, this is a good proposal. Could you open a corresponding JIRA issue for this change? Cheers, Till On Sun, Jan 8, 2017 at 8:32 AM, Alexey Demin wrote: > Hi > > In ExecutionGraphMessages we have code > > private val DATE_FORMATTER: SimpleDateFormat = new >

Re: Categorize or GroupBy datastream data and process with CEP separately

Hi, Flink’s Pattern API allows you to specify a time interval for a pattern to occur. Use the within call to specify a valid time interval for your pattern. Pattern pattern = ...; Pattern timedPattern = pattern.within(Time.minutes(10)); Cheers, Till ​ On Thu, Jan 5, 2017 at

Re: [DISCUSS] schedule for execution from different list of ExecutionJobVertex

Hi Jinkui, the difference between `getVerticesTopologically` and `tasks.values()` is that the former returns an `Iterator` which iterates over the different `ExecutionJobVertices` in topological order whereas the latter returns a simple collection of `ExecutionJobVertices` with no specified

Re: [DISCUSS] ElasticSearch in Flink Strategy

I think also https://issues.apache.org/jira/browse/FLINK-5353 should be solved sooner or later... Best, Flavio On 9 Jan 2017 12:24, "Tzu-Li (Gordon) Tai" wrote: > Thanks for starting the discussion Robert. > > I agree that we should try to treat the Elasticsearch

Re: [FLINK-3615] Add support for non-native SQL types

You are right. The issue has been solved. I closed it. Timo Am 09/01/17 um 11:58 schrieb Till Rohrmann: Hi Alex, I guess that Fabian and Timo (cc'ed) will be able to answer this question. Cheers, Till On Wed, Dec 28, 2016 at 9:38 AM, Alexander Chermenin

Re: [DISCUSS] ElasticSearch in Flink Strategy

Thanks for starting the discussion Robert. I agree that we should try to treat the Elasticsearch connectors in a similar fashion to the multiple Kafka connector versions. +1 for flink-connector-elasticsearch-base +1 to consolidating the documents +1 for keeping the ES connector in Flink I’d

Re: [FLINK-3615] Add support for non-native SQL types

Hi Alex, I guess that Fabian and Timo (cc'ed) will be able to answer this question. Cheers, Till On Wed, Dec 28, 2016 at 9:38 AM, Alexander Chermenin wrote: > Hi all. > > Is FLINK-3615 an actual > issue now? Or it has

[jira] [Created] (FLINK-5428) Decrease restart delay in RecoveryITCase

Ufuk Celebi created FLINK-5428: -- Summary: Decrease restart delay in RecoveryITCase Key: FLINK-5428 URL: https://issues.apache.org/jira/browse/FLINK-5428 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-5427) Typo in the event_timestamps_watermarks doc

Yelei Feng created FLINK-5427: - Summary: Typo in the event_timestamps_watermarks doc Key: FLINK-5427 URL: https://issues.apache.org/jira/browse/FLINK-5427 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] Flink 1.1.4 Released

Thanks a lot Ufuk for your hard work. Good work team! :-) On Sun, Dec 25, 2016 at 3:50 PM, Jean-Baptiste Onofré wrote: > Great. Good job team ! > > Regards > JB⁣​ > > On Dec 25, 2016, 11:04, at 11:04, Aljoscha Krettek > wrote: > >Very nice. Good work,

Re: DataStream and CEP - Pattern not matching after applying a window

Hi Because flink use lazy evaluation and because inactivityCEP don't have any output then you pattern not apply. / inactivityCEP.select(new PatternSelectFunction() { @Override public Object select(Map pattern) throws Exception {