[jira] [Created] (FLINK-5137) Config JVM options and set onto the TaskManager container

Zhijiang Wang created FLINK-5137: Summary: Config JVM options and set onto the TaskManager container Key: FLINK-5137 URL: https://issues.apache.org/jira/browse/FLINK-5137 Project: Flink

[jira] [Created] (FLINK-5139) consum kafka can set offset

jing lining created FLINK-5139: -- Summary: consum kafka can set offset Key: FLINK-5139 URL: https://issues.apache.org/jira/browse/FLINK-5139 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-5132) Introduce the ResourceSpec for grouping different resource factors in API

Zhijiang Wang created FLINK-5132: Summary: Introduce the ResourceSpec for grouping different resource factors in API Key: FLINK-5132 URL: https://issues.apache.org/jira/browse/FLINK-5132 Project:

[jira] [Created] (FLINK-5133) Add new setResource API for DataStream and DataSet

Zhijiang Wang created FLINK-5133: Summary: Add new setResource API for DataStream and DataSet Key: FLINK-5133 URL: https://issues.apache.org/jira/browse/FLINK-5133 Project: Flink Issue Type:

Re: [DISCUSS] Hold copies in HeapStateBackend

Hi, Fabian So much code changes. Can you show us the key changes code for the object copy? Object reference maybe hold more deep reference, it can be a bomb. Can we renew a object with its data or direct use kryo for object serialization? I’m not prefer object copy. > On Nov 22, 2016, at

[jira] [Created] (FLINK-5136) ResourceManager should consider both slot resource profile and framework memory for requesting resource from cluster

Zhijiang Wang created FLINK-5136: Summary: ResourceManager should consider both slot resource profile and framework memory for requesting resource from cluster Key: FLINK-5136 URL:

[jira] [Created] (FLINK-5131) Fine-grained Resource Configuration

Zhijiang Wang created FLINK-5131: Summary: Fine-grained Resource Configuration Key: FLINK-5131 URL: https://issues.apache.org/jira/browse/FLINK-5131 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-5134) Aggregate ResourceSpe for chained operators when generating stream graph

Zhijiang Wang created FLINK-5134: Summary: Aggregate ResourceSpe for chained operators when generating stream graph Key: FLINK-5134 URL: https://issues.apache.org/jira/browse/FLINK-5134 Project:

[jira] [Created] (FLINK-5135) ResourceProfile should be expanded to correspond with ResourceSpec

Zhijiang Wang created FLINK-5135: Summary: ResourceProfile should be expanded to correspond with ResourceSpec Key: FLINK-5135 URL: https://issues.apache.org/jira/browse/FLINK-5135 Project: Flink

[jira] [Created] (FLINK-5138) The StateBackend provides the method to estimate memory usage based on hint of state size in ResourceSpec

Zhijiang Wang created FLINK-5138: Summary: The StateBackend provides the method to estimate memory usage based on hint of state size in ResourceSpec Key: FLINK-5138 URL:

[jira] [Created] (FLINK-5140) NoResourceAvailableException is thrown while starting a new job

Biao Liu created FLINK-5140: --- Summary: NoResourceAvailableException is thrown while starting a new job Key: FLINK-5140 URL: https://issues.apache.org/jira/browse/FLINK-5140 Project: Flink Issue

[DISCUSS] deprecated function need more detail

Hi, all Let’s have look at Checkpointed interface below. It declared deprecated but have no detail for why, when and how replace this function. It’s a big trouble for the users. @Deprecated @PublicEvolving public interface Checkpointed extends CheckpointedRestoring { I think we should have

Re: Kafka Sink stuck in cancelling

Hi Gyula! Not sure what is happening there. I found that the Kafka code had a few issues with cancellation and concurrent closing. That affected mostly the producer, though. What Kafka version are you using? 0.8 or 0.9? Greetings, Stephan On Tue, Nov 22, 2016 at 10:03 AM, Gyula Fóra

Re: [DISCUSS] Hold copies in HeapStateBackend

That's right, yes. On Mon, 21 Nov 2016 at 19:14 Fabian Hueske wrote: > Right, but that would be a much bigger change than "just" copying the > *first* record that goes into the ReduceState, or am I missing something? > > > 2016-11-21 18:41 GMT+01:00 Aljoscha Krettek

Re: [DISCUSS] Hold copies in HeapStateBackend

Does anybody have objections against copying the first record that goes into the ReduceState? 2016-11-22 12:49 GMT+01:00 Aljoscha Krettek : > That's right, yes. > > On Mon, 21 Nov 2016 at 19:14 Fabian Hueske wrote: > > > Right, but that would be a much

Re: [RESULT] [VOTE] Release Apache Flink 1.1.4 (RC1)

OK, Fabian. Let me add this one here as well:  https://issues.apache.org/jira/browse/FLINK-5116 (Adding a RocksDBStateBackendFactory). Stephan Ewen discovered another issue with unfair consumption of input channels that would be critical to fix for this release, too. There is no issue for it

[jira] [Created] (FLINK-5123) Add description how to do proper shading to Flink docs.

Stephan Ewen created FLINK-5123: --- Summary: Add description how to do proper shading to Flink docs. Key: FLINK-5123 URL: https://issues.apache.org/jira/browse/FLINK-5123 Project: Flink Issue

Re: Kafka Sink stuck in cancelling

Hi Gyula, I'm not aware of any recent issues with the Kafka Producer. However there was one with the Kafka Consumer which prevented the proper cancellation ( https://issues.apache.org/jira/browse/FLINK-5048). Which version of Flink and which Kafka Producer were you using? Cheers, Till On Tue,

Re: Kafka Sink stuck in cancelling

Ah sorry I completely missed the version details. I am using Flink 1.1.3 with Kafka 0.8 producer. We havent had issues with the consumers yet and this is the first time this happenned as well. Gyula On Tue, Nov 22, 2016, 12:15 Till Rohrmann wrote: > Hi Gyula, > > I'm not

[jira] [Created] (FLINK-5124) Support more temporal arithmetic

Timo Walther created FLINK-5124: --- Summary: Support more temporal arithmetic Key: FLINK-5124 URL: https://issues.apache.org/jira/browse/FLINK-5124 Project: Flink Issue Type: Improvement

Kafka Sink stuck in cancelling

Hi, Has anyone ever experienced the Kafka producer getting stuck in cancelling? I am aware that there were problems with the Kafka consumer before but I haven't seen this one yet. It happened simultaneously to 3 of my jobs last night, they were stuck from about 8 pm to 8 am (not exact times but

Re: [DISCUSS] Merge batch and stream connector modules

Hi all, should we do this refactoring for the 1.2 release? If yes, I'll prepare a PR for that. Cheers, Fabian 2016-09-26 13:55 GMT+02:00 Fabian Hueske : > Thanks everybody for your comments. > > I opened FLINK-4676 [1] for merging the connector modules. > > [1]

[jira] [Created] (FLINK-5125) ContinuousFileProcessingCheckpointITCase is Flaky

Aljoscha Krettek created FLINK-5125: --- Summary: ContinuousFileProcessingCheckpointITCase is Flaky Key: FLINK-5125 URL: https://issues.apache.org/jira/browse/FLINK-5125 Project: Flink Issue

[jira] [Created] (FLINK-5126) Remove Checked Exceptions from State Interfaces

Aljoscha Krettek created FLINK-5126: --- Summary: Remove Checked Exceptions from State Interfaces Key: FLINK-5126 URL: https://issues.apache.org/jira/browse/FLINK-5126 Project: Flink Issue

[jira] [Created] (FLINK-5127) Reduce the amount of intermediate data in vertex-centric iterations

Vasia Kalavri created FLINK-5127: Summary: Reduce the amount of intermediate data in vertex-centric iterations Key: FLINK-5127 URL: https://issues.apache.org/jira/browse/FLINK-5127 Project: Flink

[jira] [Created] (FLINK-5128) Get Kafka partitions in FlinkKafkaProducer only if a partitioner is set

Tzu-Li (Gordon) Tai created FLINK-5128: -- Summary: Get Kafka partitions in FlinkKafkaProducer only if a partitioner is set Key: FLINK-5128 URL: https://issues.apache.org/jira/browse/FLINK-5128

[jira] [Created] (FLINK-5130) Remove Deprecated Methods from WindowedStream

Aljoscha Krettek created FLINK-5130: --- Summary: Remove Deprecated Methods from WindowedStream Key: FLINK-5130 URL: https://issues.apache.org/jira/browse/FLINK-5130 Project: Flink Issue

Re: [DISCUSS] Merge batch and stream connector modules

+1 On Tue, Nov 22, 2016 at 9:08 AM, Fabian Hueske wrote: > Hi all, > > should we do this refactoring for the 1.2 release? > If yes, I'll prepare a PR for that. > > Cheers, > Fabian > > 2016-09-26 13:55 GMT+02:00 Fabian Hueske : > >> Thanks everybody for your

[DISCUSS] @Public libraries

Hi all, Should stable APIs in Flink's CEP, ML, and Gelly libraries be annotated @Public or restricted to use of @PublicEvolving? We would ensure that library APIs do not add restrictions to the core APIs. Libraries could use @PublicEvolving or @Internal core APIs within @Public or