Re: [Dev] Dependencies issue related to implementing InputFormat Interface

Hi Pawan, If you want to read a file, you might want to extend the FileInputFormat class. It has already a lot of file-related functionality implemented. OT is the type of the records produced by the InputFormat. For example Tuple2 if the input format produce a tuple with two

[jira] [Created] (FLINK-5545) remove FlinkAggregateExpandDistinctAggregatesRule when we upgrade calcite

Zhenghua Gao created FLINK-5545: --- Summary: remove FlinkAggregateExpandDistinctAggregatesRule when we upgrade calcite Key: FLINK-5545 URL: https://issues.apache.org/jira/browse/FLINK-5545 Project: Flink

Re: [jira] [Created] (FLINK-5544) Implement Internal Timer Service in RocksDB

Hi Florian, The memory usage depends on the types of keys and namespaces. We have not experienced that many concurrently open windows. But given that each open window needs several bytes for its timer, 2M open windows may cost up to hundreds of MB. Regards Xiaogang 2017-01-18 14:45 GMT+08:00

Re: [jira] [Created] (FLINK-5544) Implement Internal Timer Service in RocksDB

Hi, that sounds very useful. We are using quite a lot of timers in custom windows. Does anybody have experience with the memory requirements of, let’s say, 2 million concurrently open windows and the associated timers? Thanks Florian > Am 18.01.2017 um 04:40 schrieb Xiaogang Shi (JIRA)

Re: [Dev] Dependencies issue related to implementing InputFormat Interface

Hi, Yeah I also wrote in the way you have written.. public class ReadFromFile implements InputFormat{ } Is that a problem with that declaration or dependencies ? Thanks, Pawan On Tue, Jan 17, 2017 at 7:56 PM, Chesnay Schepler wrote: > Hello, >

[jira] [Created] (FLINK-5544) Implement Internal Timer Service in RocksDB

Xiaogang Shi created FLINK-5544: --- Summary: Implement Internal Timer Service in RocksDB Key: FLINK-5544 URL: https://issues.apache.org/jira/browse/FLINK-5544 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-5543) customCommandLine tips in CliFrontend

shijinkui created FLINK-5543: Summary: customCommandLine tips in CliFrontend Key: FLINK-5543 URL: https://issues.apache.org/jira/browse/FLINK-5543 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-5542) YARN client incorrectly uses local YARN config to check vcore capacity

Shannon Carey created FLINK-5542: Summary: YARN client incorrectly uses local YARN config to check vcore capacity Key: FLINK-5542 URL: https://issues.apache.org/jira/browse/FLINK-5542 Project: Flink

[jira] [Created] (FLINK-5541) Missing null check for localJar in FlinkSubmitter#submitTopology()

Ted Yu created FLINK-5541: - Summary: Missing null check for localJar in FlinkSubmitter#submitTopology() Key: FLINK-5541 URL: https://issues.apache.org/jira/browse/FLINK-5541 Project: Flink Issue

Re: 答复: States split over to external storage

Hi liuxinchun, Thanks for expedite feedback! I think if dev community find it makes sense to invest on this feature, allowing user config eviction strategy(2) makes sense to me. Given the nature how flink job states increase various a lot, there might be a interface allow state backend decide

[jira] [Created] (FLINK-5539) CLI: info/list/stop/cancel

Eron Wright created FLINK-5539: --- Summary: CLI: info/list/stop/cancel Key: FLINK-5539 URL: https://issues.apache.org/jira/browse/FLINK-5539 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-5540) CLI: savepoint

Eron Wright created FLINK-5540: --- Summary: CLI: savepoint Key: FLINK-5540 URL: https://issues.apache.org/jira/browse/FLINK-5540 Project: Flink Issue Type: Sub-task Reporter: Eron

[jira] [Created] (FLINK-5538) Config option: Kerberos

Eron Wright created FLINK-5538: --- Summary: Config option: Kerberos Key: FLINK-5538 URL: https://issues.apache.org/jira/browse/FLINK-5538 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-5537) Config option: SSL

Eron Wright created FLINK-5537: --- Summary: Config option: SSL Key: FLINK-5537 URL: https://issues.apache.org/jira/browse/FLINK-5537 Project: Flink Issue Type: Sub-task Reporter:

[jira] [Created] (FLINK-5535) Config option: HDFS

Eron Wright created FLINK-5535: --- Summary: Config option: HDFS Key: FLINK-5535 URL: https://issues.apache.org/jira/browse/FLINK-5535 Project: Flink Issue Type: Sub-task Reporter:

[jira] [Created] (FLINK-5536) Config option: HA

Eron Wright created FLINK-5536: --- Summary: Config option: HA Key: FLINK-5536 URL: https://issues.apache.org/jira/browse/FLINK-5536 Project: Flink Issue Type: Sub-task Reporter:

[jira] [Created] (FLINK-5534) Config option: 'flink-options'

Eron Wright created FLINK-5534: --- Summary: Config option: 'flink-options' Key: FLINK-5534 URL: https://issues.apache.org/jira/browse/FLINK-5534 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-5533) DCOS Integration

Eron Wright created FLINK-5533: --- Summary: DCOS Integration Key: FLINK-5533 URL: https://issues.apache.org/jira/browse/FLINK-5533 Project: Flink Issue Type: New Feature Components:

[jira] [Created] (FLINK-5532) Make the marker windowassignes for the fast aligned windows non-extendable.

Kostas Kloudas created FLINK-5532: - Summary: Make the marker windowassignes for the fast aligned windows non-extendable. Key: FLINK-5532 URL: https://issues.apache.org/jira/browse/FLINK-5532 Project:

[jira] [Created] (FLINK-5531) SSl code block formatting is broken

Chesnay Schepler created FLINK-5531: --- Summary: SSl code block formatting is broken Key: FLINK-5531 URL: https://issues.apache.org/jira/browse/FLINK-5531 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-5530) race condition in AbstractRocksDBState#getSerializedValue

Nico Kruber created FLINK-5530: -- Summary: race condition in AbstractRocksDBState#getSerializedValue Key: FLINK-5530 URL: https://issues.apache.org/jira/browse/FLINK-5530 Project: Flink Issue

Re: [Dev] Dependencies issue related to implementing InputFormat Interface

Hello, Did you write something like this? public class MyInputFormat implements InputFormat { } Regards, Chesnay On 17.01.2017 04:18, Pawan Manishka Gunarathna wrote: Hi, I'm currently working on Flink InputFormat Interface implementation. I'm

[jira] [Created] (FLINK-5529) Improve / extends windowing documentation

Stephan Ewen created FLINK-5529: --- Summary: Improve / extends windowing documentation Key: FLINK-5529 URL: https://issues.apache.org/jira/browse/FLINK-5529 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-5528) tests: reduce the retry delay in QueryableStateITCase

Nico Kruber created FLINK-5528: -- Summary: tests: reduce the retry delay in QueryableStateITCase Key: FLINK-5528 URL: https://issues.apache.org/jira/browse/FLINK-5528 Project: Flink Issue Type:

[jira] [Created] (FLINK-5527) QueryableState: requesting a non-existing key in MemoryStateBackend or FsStateBackend does not return the default value

Nico Kruber created FLINK-5527: -- Summary: QueryableState: requesting a non-existing key in MemoryStateBackend or FsStateBackend does not return the default value Key: FLINK-5527 URL:

[jira] [Created] (FLINK-5526) QueryableState: notify upon receiving a query but having queryable state disabled

Nico Kruber created FLINK-5526: -- Summary: QueryableState: notify upon receiving a query but having queryable state disabled Key: FLINK-5526 URL: https://issues.apache.org/jira/browse/FLINK-5526 Project:

[jira] [Created] (FLINK-5525) Streaming Version of a Linear Regression model

Stavros Kontopoulos created FLINK-5525: -- Summary: Streaming Version of a Linear Regression model Key: FLINK-5525 URL: https://issues.apache.org/jira/browse/FLINK-5525 Project: Flink

Re: New Flink team member - Kate Eri.

ok, I've got it. I will take a look at https://github.com/apache/flink/pull/2735. вт, 17 янв. 2017 г. в 14:36, Theodore Vasiloudis < theodoros.vasilou...@gmail.com>: > Hello Katherin, > > Welcome to the Flink community! > > The ML component definitely needs a lot of work you are correct, we are

Re: New Flink team member - Kate Eri.

Hello Katherin, Welcome to the Flink community! The ML component definitely needs a lot of work you are correct, we are facing similar problems to CEP, which we'll hopefully resolve with the restructuring Stephan has mentioned in that thread. If you'd like to help out with PRs we have many

[jira] [Created] (FLINK-5524) Support early out for code generated conjunctive conditions

Fabian Hueske created FLINK-5524: Summary: Support early out for code generated conjunctive conditions Key: FLINK-5524 URL: https://issues.apache.org/jira/browse/FLINK-5524 Project: Flink

[jira] [Created] (FLINK-5523) Improve access of fields in code generated functions with filters

Fabian Hueske created FLINK-5523: Summary: Improve access of fields in code generated functions with filters Key: FLINK-5523 URL: https://issues.apache.org/jira/browse/FLINK-5523 Project: Flink

Re: New Flink team member - Kate Eri.

Hi Katherin, welcome to the Flink community! Help with reviewing PRs is always very welcome and a great way to contribute. Best, Fabian 2017-01-17 11:17 GMT+01:00 Katherin Sotenko : > Thank you, Timo. > I have started the analysis of the topic. > And if it necessary,

[jira] [Created] (FLINK-5522) Storm LocalCluster can't run with powermock

liuyuzhong7 created FLINK-5522: -- Summary: Storm LocalCluster can't run with powermock Key: FLINK-5522 URL: https://issues.apache.org/jira/browse/FLINK-5522 Project: Flink Issue Type:

Re: New Flink team member - Kate Eri.

Thank you, Timo. I have started the analysis of the topic. And if it necessary, I will try to perform the review of other pulls) вт, 17 янв. 2017 г. в 13:09, Timo Walther : > Hi Katherin, > > great to hear that you would like to contribute! Welcome! > > I gave you

Re: New Flink team member - Kate Eri.

Hi Katherin, great to hear that you would like to contribute! Welcome! I gave you contributor permissions. You can now assign issues to yourself. I assigned FLINK-1750 to you. Right now there are many open ML pull requests, you are very welcome to review the code of others, too. Timo Am

[jira] [Created] (FLINK-5521) remove unused KvStateRequestSerializer#serializeList

Nico Kruber created FLINK-5521: -- Summary: remove unused KvStateRequestSerializer#serializeList Key: FLINK-5521 URL: https://issues.apache.org/jira/browse/FLINK-5521 Project: Flink Issue Type:

New Flink team member - Kate Eri.

Hello, All! I'm Kate Eri, I'm java developer with 6-year enterprise experience, also I have some expertise with scala (half of the year). Last 2 years I have participated in several BigData projects that were related to Machine Learning (Time series analysis, Recommender systems, Social