Submitting jobs via maven coordinates?

2017-11-13 Thread Ron Crocker
Internally we use artifactory to store our jars. I have a team that would like to submit their Flink jobs via their maven coordinates, resulting in pull the specified jar from the artifactory repository. Has anyone else seen a need for this? Has it already been accomplished? Ron — Ron

The right approach to store intermediate value

2017-11-13 Thread Shengnan YU
Dear Flink committers: I am starting to learn implementing some data streaming algorithm based on Flink API. Now I am working on MisraGries algorithm. It keeps k counters to record the data summary by increment or decrement. I want to know what is the best approach to store those counters(a

Re: I dont understand

2017-11-13 Thread Stephan Ewen
A lot of projects evolve out of use cases, Flink evolved out of the Big Data ecosystem, which was a few years ago dominated by Hadoop. The next version of Flink is also independent from Hadoop, but bundles it as an optional dependency for the convenience of many users. On Nov 12, 2017 02:02,

Re: I dont understand

2017-11-13 Thread Stephan Ewen
Hi! A lot of projects evolve out of use cases, Flink evolved out of the Bug Data ecosystem On Nov 12, 2017 02:02, "Cristian Lorenzetto" wrote: > Sincerely i dont understand how it is developed this project. > You are essentially developing a streaming management

[jira] [Created] (FLINK-8066) Changed configuration of taskmanagers should recreate them

2017-11-13 Thread Stephen Gran (JIRA)
Stephen Gran created FLINK-8066: --- Summary: Changed configuration of taskmanagers should recreate them Key: FLINK-8066 URL: https://issues.apache.org/jira/browse/FLINK-8066 Project: Flink Issue

[jira] [Created] (FLINK-8065) Extend exception message if client is already shut down

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8065: --- Summary: Extend exception message if client is already shut down Key: FLINK-8065 URL: https://issues.apache.org/jira/browse/FLINK-8065 Project: Flink

[jira] [Created] (FLINK-8064) Extend dependecy section to list flink-core

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8064: --- Summary: Extend dependecy section to list flink-core Key: FLINK-8064 URL: https://issues.apache.org/jira/browse/FLINK-8064 Project: Flink Issue Type:

[jira] [Created] (FLINK-8063) Client blocks indefinitely when querying a non-existing state

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8063: --- Summary: Client blocks indefinitely when querying a non-existing state Key: FLINK-8063 URL: https://issues.apache.org/jira/browse/FLINK-8063 Project: Flink

[jira] [Created] (FLINK-8062) QueryableStateClient#getKvState(...N Namespace,...) not documented

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8062: --- Summary: QueryableStateClient#getKvState(...N Namespace,...) not documented Key: FLINK-8062 URL: https://issues.apache.org/jira/browse/FLINK-8062 Project:

[jira] [Created] (FLINK-8061) Remove trailing asterisk in QueryableStateClient javadocs

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8061: --- Summary: Remove trailing asterisk in QueryableStateClient javadocs Key: FLINK-8061 URL: https://issues.apache.org/jira/browse/FLINK-8061 Project: Flink

[jira] [Created] (FLINK-8060) Operator can make states queryable under the same name

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8060: --- Summary: Operator can make states queryable under the same name Key: FLINK-8060 URL: https://issues.apache.org/jira/browse/FLINK-8060 Project: Flink

[jira] [Created] (FLINK-8059) Querying the state of a non-existing jobs should throw JobNotFoundException

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8059: --- Summary: Querying the state of a non-existing jobs should throw JobNotFoundException Key: FLINK-8059 URL: https://issues.apache.org/jira/browse/FLINK-8059

[jira] [Created] (FLINK-8058) Queryable state should check types

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8058: --- Summary: Queryable state should check types Key: FLINK-8058 URL: https://issues.apache.org/jira/browse/FLINK-8058 Project: Flink Issue Type:

[jira] [Created] (FLINK-8057) KvStateRegistry#registerKvState may randomly fail

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8057: --- Summary: KvStateRegistry#registerKvState may randomly fail Key: FLINK-8057 URL: https://issues.apache.org/jira/browse/FLINK-8057 Project: Flink Issue

[jira] [Created] (FLINK-8056) Default config.yml uses deprecated keys

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8056: --- Summary: Default config.yml uses deprecated keys Key: FLINK-8056 URL: https://issues.apache.org/jira/browse/FLINK-8056 Project: Flink Issue Type:

[jira] [Created] (FLINK-8055) Deduplicate logging messages about QS start

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8055: --- Summary: Deduplicate logging messages about QS start Key: FLINK-8055 URL: https://issues.apache.org/jira/browse/FLINK-8055 Project: Flink Issue Type:

[jira] [Created] (FLINK-8054) Deduplicate Time classes

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8054: --- Summary: Deduplicate Time classes Key: FLINK-8054 URL: https://issues.apache.org/jira/browse/FLINK-8054 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-8053) Default to asynchronous snapshots for FsStateBackend

2017-11-13 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-8053: --- Summary: Default to asynchronous snapshots for FsStateBackend Key: FLINK-8053 URL: https://issues.apache.org/jira/browse/FLINK-8053 Project: Flink

[jira] [Created] (FLINK-8052) Bump docs scala version to 2.11

2017-11-13 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8052: --- Summary: Bump docs scala version to 2.11 Key: FLINK-8052 URL: https://issues.apache.org/jira/browse/FLINK-8052 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8051) Reactivate Scaladoc aggregation using genjavadoc

2017-11-13 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-8051: --- Summary: Reactivate Scaladoc aggregation using genjavadoc Key: FLINK-8051 URL: https://issues.apache.org/jira/browse/FLINK-8051 Project: Flink Issue