Re:Window's Checkpoint problem

2016-11-25 Thread 时某人
Is there some State backend and checkpoint design architecture document? ChengXiang Li have some sharing about checkout on Hangzhou Flink Meetup.

Window's Checkpoint problem

2016-11-25 Thread liuxinchun
Hi all: I am paying attention to Flink, and encounter a problem about user defined window with checkpoint. My code like this: class WindowStatistics extends WindowFunction[Event, Int, Tuple, TimeWindow] with Checkpointed[Option[Int]]: Unit = { private var count = 0 override def

[jira] [Created] (FLINK-5167) StreamExecutionEnvironment's set function return `this` instead of void

2016-11-25 Thread shijinkui (JIRA)
shijinkui created FLINK-5167: Summary: StreamExecutionEnvironment's set function return `this` instead of void Key: FLINK-5167 URL: https://issues.apache.org/jira/browse/FLINK-5167 Project: Flink

[jira] [Created] (FLINK-5166) TextInputFormatTest.testNestedFileRead

2016-11-25 Thread shijinkui (JIRA)
shijinkui created FLINK-5166: Summary: TextInputFormatTest.testNestedFileRead Key: FLINK-5166 URL: https://issues.apache.org/jira/browse/FLINK-5166 Project: Flink Issue Type: Bug

RE: Move Row, RowInputFormat to core package

2016-11-25 Thread Anton Solovev
I agree that we should improve RowTypeInfo. But why not to keep it in Scala? In case flink-2186 that the "Row" is a "Product" is a reason of supporting wide columns indeed. Just for example I tried to move the "Row" to flink-scala module

RE: Flink using Yarn on MapR

2016-11-25 Thread Anton Solovev
Sorry, wrong thread -Original Message- From: Anton Solovev [mailto:anton_solo...@epam.com] Sent: Friday, November 25, 2016 7:20 PM To: dev@flink.apache.org Subject: RE: Flink using Yarn on MapR I agree that we should improve RowTypeInfo. But why not to keep it in Scala? In case

[jira] [Created] (FLINK-5165) Checkpointing tests using FsStatebackend fail on Windows

2016-11-25 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-5165: --- Summary: Checkpointing tests using FsStatebackend fail on Windows Key: FLINK-5165 URL: https://issues.apache.org/jira/browse/FLINK-5165 Project: Flink

RE: Flink using Yarn on MapR

2016-11-25 Thread Anton Solovev
I agree that we should improve RowTypeInfo. But why not to keep it in Scala? In case flink-2186 that the "Row" is a "Product" is a reason of supporting wide columns indeed. Just for example I tried to move the "Row" to flink-scala module

[jira] [Created] (FLINK-5164) Hadoop-compat IOFormat tests fail on Windows

2016-11-25 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-5164: --- Summary: Hadoop-compat IOFormat tests fail on Windows Key: FLINK-5164 URL: https://issues.apache.org/jira/browse/FLINK-5164 Project: Flink Issue Type:

Re: Flink using Yarn on MapR

2016-11-25 Thread Maximilian Michels
Fix is now in the master and everything should run smooth with MapR Hadoop. I'd be happy if you gave it another try. -Max On Thu, Nov 24, 2016 at 6:22 PM, Maximilian Michels wrote: > Hi Naveen, > > The new Kerberos authentication code in Flink assumes that we're > running

Re: Move Row, RowInputFormat to core package

2016-11-25 Thread Flavio Pompermaier
Fully agree with Timo :) On Fri, Nov 25, 2016 at 2:30 PM, Timo Walther wrote: > Hi Anton, > > I would also support the idea of moving Row and RowTypeInfo to Flink core. > I think there are many real-world use cases where a variable-length record > that supports null values

Re: Move Row, RowInputFormat to core package

2016-11-25 Thread Timo Walther
Hi Anton, I would also support the idea of moving Row and RowTypeInfo to Flink core. I think there are many real-world use cases where a variable-length record that supports null values is required. However, I think that those classes needs to be reworked before. They should not depend on

Start to contribute

2016-11-25 Thread Minudika Malshan
Hi all, I am interested in stream processing and willing to contribute for the development of Apache Flink. Could you please provide some suitable jira tickets for me to get started. Your help is much appriciated. BR Minudika

[jira] [Created] (FLINK-5163) Make the production functions rescalable (apart from the Rolling/Bucketing Sinks)

2016-11-25 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-5163: - Summary: Make the production functions rescalable (apart from the Rolling/Bucketing Sinks) Key: FLINK-5163 URL: https://issues.apache.org/jira/browse/FLINK-5163

[jira] [Created] (FLINK-5162) BlobRecoveryItCase#testBlobServerRecovery fails on Windows

2016-11-25 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-5162: --- Summary: BlobRecoveryItCase#testBlobServerRecovery fails on Windows Key: FLINK-5162 URL: https://issues.apache.org/jira/browse/FLINK-5162 Project: Flink

[jira] [Created] (FLINK-5161) accepting NullValue for VV in Gelly examples and GSA

2016-11-25 Thread wouter ligtenberg (JIRA)
wouter ligtenberg created FLINK-5161: Summary: accepting NullValue for VV in Gelly examples and GSA Key: FLINK-5161 URL: https://issues.apache.org/jira/browse/FLINK-5161 Project: Flink

[jira] [Created] (FLINK-5160) SecurityContextTest#testCreateInsecureHadoopCtx fails on windows

2016-11-25 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-5160: --- Summary: SecurityContextTest#testCreateInsecureHadoopCtx fails on windows Key: FLINK-5160 URL: https://issues.apache.org/jira/browse/FLINK-5160 Project: Flink

[jira] [Created] (FLINK-5159) Improve perfomance of inner joins with a single row input

2016-11-25 Thread Alexander Shoshin (JIRA)
Alexander Shoshin created FLINK-5159: Summary: Improve perfomance of inner joins with a single row input Key: FLINK-5159 URL: https://issues.apache.org/jira/browse/FLINK-5159 Project: Flink