Re: [DISCUSS] Remove Combinable Annotation from DataSet API

2016-01-14 Thread Henry Saputra
+1 for approach #1 - Henry On Thu, Jan 14, 2016 at 5:35 AM, Chiwan Park wrote: > I’m also for approach #1. Now is nice time to apply some API-breaking > changes. > > > On Jan 14, 2016, at 1:19 AM, Aljoscha Krettek > wrote: > > > > I’m also for

[jira] [Created] (FLINK-3233) PartitionOperator does not support expression keys on atomic types

2016-01-14 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3233: Summary: PartitionOperator does not support expression keys on atomic types Key: FLINK-3233 URL: https://issues.apache.org/jira/browse/FLINK-3233 Project: Flink

Re: UpdateTaskExecutionState during JobManager failover

2016-01-14 Thread Stephan Ewen
Hi! That is a super interesting idea. If I understand you correctly, you are suggesting to try and reconcile the TaskManagers and the JobManager before restarting the job. That would mean that in case of a master failure, the jobs may simply continue to run. That would be a nice enhancements, but

UpdateTaskExecutionState during JobManager failover

2016-01-14 Thread wangzhijiang999
Hi,     As i know, when TaskManager send UpdateTaskExecutionState to JobManager, if the JobManager failover and the future response is fail, the task will be failed. Is it feasible to retry send UpdateTaskExecutionState again when future response fail until success. In JobManager HA mode, the 

Re: [DISCUSS] Remove Combinable Annotation from DataSet API

2016-01-14 Thread Chiwan Park
I’m also for approach #1. Now is nice time to apply some API-breaking changes. > On Jan 14, 2016, at 1:19 AM, Aljoscha Krettek wrote: > > I’m also for Approach #1. I like simplifying things. >> On 13 Jan 2016, at 14:25, Vasiliki Kalavri wrote: >>

答复:UpdateTaskExecutionState during JobManager failover

2016-01-14 Thread wangzhijiang999
Hi Stephan,  Thank you for detail explaination.  As you said, my opition is to keep task still running druing jobmanager failover, even though sending update status failed. For the first reason you mentioned, if i understand correctly, the key issue is status out of sync between taskmanager and

Re: FileNotFoundException thrown by BlobCache when running "mvn test" against flink-runtime 0.10 for Scala 2.11

2016-01-14 Thread Prez Cannady
My bad. Gist with exception is here: https://gist.github.com/revprez/5a730a45674f0fc6e52b Prez Cannady p: 617 500 3378 e: revp...@opencorrelate.org GH: https://github.com/opencorrelate

flink-shaded-hadoop modules disconnected from parent pom

2016-01-14 Thread Nick Dimiduk
Hi folks, I noticed today that the parent pom for the flink-shaded-hadoop pom (and thus also it's children) are not using ${ROOT}/pom.xml as their parent. However, ${ROOT}/pom.xml lists the hierarchy as a module. I'm curious to know why this is. It seems one artifact of this disconnect is that

FileNotFoundException thrown by BlobCache when running "mvn test" against flink-runtime 0.10 for Scala 2.11

2016-01-14 Thread Prez Cannady
Steps Forked, cut bug fix branch off of release–0.10. One line change to fix class loader issue. Ran mvn clean test in flink-runtime. All 894 tests pass. Ran ./tools/change-scala-version 2.11 in the root. Ran mvn clean test -Dscala.version=2.11.7 in flink-runtime. Expected result All 894 tests

[jira] [Created] (FLINK-3235) Drop Flink-on-Tez code

2016-01-14 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3235: -- Summary: Drop Flink-on-Tez code Key: FLINK-3235 URL: https://issues.apache.org/jira/browse/FLINK-3235 Project: Flink Issue Type: Improvement

Re: Dripping the Flink-on-Tez code for Flink 1.0

2016-01-14 Thread Ufuk Celebi
I’ve created an issue [1] and closed all other Tez issues. [1] https://issues.apache.org/jira/browse/FLINK-3235 > On 11 Jan 2016, at 02:52, Henry Saputra wrote: > > +1 > > I am always for simplifying our code base when possible. > > > > On Sunday, January 10, 2016,

[jira] [Created] (FLINK-3237) Create AsynchronousKvStateSnapshot similar to AsynchronousStateHandle

2016-01-14 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-3237: - Summary: Create AsynchronousKvStateSnapshot similar to AsynchronousStateHandle Key: FLINK-3237 URL: https://issues.apache.org/jira/browse/FLINK-3237 Project: Flink