[jira] [Created] (FLINK-6106) Blob Server doesn't delete tmp fold when exit in HA mode.

2017-03-17 Thread Syinchwun Leo (JIRA)
Syinchwun Leo created FLINK-6106: Summary: Blob Server doesn't delete tmp fold when exit in HA mode. Key: FLINK-6106 URL: https://issues.apache.org/jira/browse/FLINK-6106 Project: Flink Issue

Re: [DISCUSS] FLIP-17 Side Inputs

2017-03-17 Thread Ventura Del Monte
I agree with your analysis, I think we now have almost everything to start, and I also would be interested in helping you. Please feel free to count me in. Besides, I have few real use cases which require side input and could help in benchmarking the final implementation. Best, Ventura This me

Re: Machine Learning on Flink - Next steps

2017-03-17 Thread Gábor Hermann
Hi Chen, Thanks for the input! :) There is already a project [1] for using TensorFlow models in Flink, and Theodore has suggested to contact the author, Eron Wright for the model serving direction. [1] http://sf.flink-forward.org/kb_sessions/introducing-flink-tensorflow/ Cheers, Gabor On

Re: [DISCUSS] FLIP-17 Side Inputs

2017-03-17 Thread Gábor Hermann
Thanks for demonstrating the windowed side-input case. I completely agree that handling windowed side-input separately would just simply complicate the implementation. The triggering mechanism for the upstream window could define when the windowed input is ready. I would gladly contribute to a

Re: [DISCUSS] Project build time and possible restructuring

2017-03-17 Thread Greg Hogan
I’d like to use this refactoring opportunity to unspilt the Travis tests. With 51 builds queued up for the weekend (some of which may fail or have been force pushed) we are at the limit of the number of contributions we can process. Fixing this requires 1) splitting the project, 2) investigating

Re: Machine Learning on Flink - Next steps

2017-03-17 Thread Chen Qin
Hi there, I am not a machine learning expert :) But in recent, I see more and more adoption and trends towards tensor flow[1], which is backed by google and big vendors. If flink and somehow compatible and run tensor flow pipelines (with some modifications is fine) I think the adoption would be f

Re: [DISCUSS] Could we Improve tests time and stability?

2017-03-17 Thread Greg Hogan
Dmytro, This is a good idea and a nice speedup, though I notice that nearly half of the speedup (1104s of 2461s) is from job 7 which appears to have hung and timed out in the initial run. Could you test the two changes in isolation (increased maximum memory and garbage collector)? If the speed

[VOTE] Release Apache Flink 1.1.5 (RC1)

2017-03-17 Thread Tzu-Li (Gordon) Tai
Dear Flink community,  Please vote on releasing the following candidate as Apache Flink version 1.1.5. The commit to be voted on:  ed18e97 (http://git-wip-us.apache.org/repos/asf/flink/commit/ed18e97)  Branch:  release-1.1.5-rc1  (https://git1-us-west.apache.org/repos/asf/flink/repo?p=flink.git;

Re: Bumping API stability check version

2017-03-17 Thread Robert Metzger
I don't think we can script this (yet) in the release process, because the actual releasing (as opposed to the candidate creation process) is not automated. I just updated the https://cwiki.apache.org/confluence/display/FLINK/Releasing guide and included the japicmp Flink reference version change

Re: [DISCUSS] Could we Improve tests time and stability?

2017-03-17 Thread Robert Metzger
Cool, this is a good result. I think we can integrate this change into master. Can you open a pull request? On Fri, Mar 17, 2017 at 2:16 PM, Dmytro Shkvyra wrote: > Hi Robert, > > I have tried my proposal on my travis and accelerated my build in 9.4% > (see results below) > > # Test|Present JVM

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-17 Thread Robert Metzger
I don't think that his issue should be a reason to hold back a bugfix release. There are workarounds for the problem you are describing. Once we've fixed it, we can include it into the next upcoming bugfix release. On Fri, Mar 17, 2017 at 4:22 PM, Flavio Pompermaier wrote: > I propose to fix htt

[jira] [Created] (FLINK-6105) Properly handle InterruptedException

2017-03-17 Thread Ted Yu (JIRA)
Ted Yu created FLINK-6105: - Summary: Properly handle InterruptedException Key: FLINK-6105 URL: https://issues.apache.org/jira/browse/FLINK-6105 Project: Flink Issue Type: Bug Reporter: Te

[jira] [Created] (FLINK-6104) Unclosed WriteOptions in ListViaRangeSpeedMiniBenchmark#main()

2017-03-17 Thread Ted Yu (JIRA)
Ted Yu created FLINK-6104: - Summary: Unclosed WriteOptions in ListViaRangeSpeedMiniBenchmark#main() Key: FLINK-6104 URL: https://issues.apache.org/jira/browse/FLINK-6104 Project: Flink Issue Type: B

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-17 Thread Flavio Pompermaier
I propose to fix https://issues.apache.org/jira/browse/FLINK-6103 before issue a release On Fri, Mar 17, 2017 at 8:12 AM, Ufuk Celebi wrote: > Cool! Thanks for taking care of this Gordon :-) > > On Fri, Mar 17, 2017 at 7:13 AM, Tzu-Li (Gordon) Tai > wrote: > > Update for 1.1.5: > > The last fix

[jira] [Created] (FLINK-6103) LocalFileSystem rename() uses File.renameTo()

2017-03-17 Thread Flavio Pompermaier (JIRA)
Flavio Pompermaier created FLINK-6103: - Summary: LocalFileSystem rename() uses File.renameTo() Key: FLINK-6103 URL: https://issues.apache.org/jira/browse/FLINK-6103 Project: Flink Issue T

Re: [DISCUSS] FLIP-17 Side Inputs

2017-03-17 Thread Aljoscha Krettek
Yes, I agree! The implementation stuff we talked about so far is only visible at the operator level. A user function that uses the (future) side API would not be aware of whether buffering or blocking is used. It would simply know that it is invoked and that side input is ready. I'll also quickly

Re: Machine Learning on Flink - Next steps

2017-03-17 Thread Theodore Vasiloudis
> > What should be the way of work here? We could have sketches for the > separate projects in Gdocs, then the shepherds could make a proposal out of > it. Would that be feasible? That's what I was thinking as well. It's the responsibility of the shepherd to engage the people motivated to work on

RE: [DISCUSS] Could we Improve tests time and stability?

2017-03-17 Thread Dmytro Shkvyra
Hi Robert, I have tried my proposal on my travis and accelerated my build in 9.4% (see results below) # Test|Present JVM options |"-Xms256m -Xmx1536m -XX:+UseSerialGC" - 1 35 min 53 sec |

[jira] [Created] (FLINK-6102) Update protobuf to latest version

2017-03-17 Thread Su Ralph (JIRA)
Su Ralph created FLINK-6102: --- Summary: Update protobuf to latest version Key: FLINK-6102 URL: https://issues.apache.org/jira/browse/FLINK-6102 Project: Flink Issue Type: Task Components:

[jira] [Created] (FLINK-6101) GroupBy fields with expression can not be selected either using original name or expression

2017-03-17 Thread lincoln.lee (JIRA)
lincoln.lee created FLINK-6101: -- Summary: GroupBy fields with expression can not be selected either using original name or expression Key: FLINK-6101 URL: https://issues.apache.org/jira/browse/FLINK-6101

[jira] [Created] (FLINK-6100) Add documentation for Projectable and Filterable TableSource

2017-03-17 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-6100: Summary: Add documentation for Projectable and Filterable TableSource Key: FLINK-6100 URL: https://issues.apache.org/jira/browse/FLINK-6100 Project: Flink I

[jira] [Created] (FLINK-6099) not able to auto infer the row type when getting informationn from jdbc vertica

2017-03-17 Thread naveen holla U (JIRA)
naveen holla U created FLINK-6099: - Summary: not able to auto infer the row type when getting informationn from jdbc vertica Key: FLINK-6099 URL: https://issues.apache.org/jira/browse/FLINK-6099 Proj

[jira] [Created] (FLINK-6098) Cassandra sink freezes after write error

2017-03-17 Thread Jakub Nowacki (JIRA)
Jakub Nowacki created FLINK-6098: Summary: Cassandra sink freezes after write error Key: FLINK-6098 URL: https://issues.apache.org/jira/browse/FLINK-6098 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6097) Guaranteed the order of the extracted field references

2017-03-17 Thread sunjincheng (JIRA)
sunjincheng created FLINK-6097: -- Summary: Guaranteed the order of the extracted field references Key: FLINK-6097 URL: https://issues.apache.org/jira/browse/FLINK-6097 Project: Flink Issue Type:

[jira] [Created] (FLINK-6096) Refactor the migration of old versioned savepoints

2017-03-17 Thread Xiaogang Shi (JIRA)
Xiaogang Shi created FLINK-6096: --- Summary: Refactor the migration of old versioned savepoints Key: FLINK-6096 URL: https://issues.apache.org/jira/browse/FLINK-6096 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-6095) Introduce the SlotPoolOptions to config parameters for SlotPool

2017-03-17 Thread zhijiang (JIRA)
zhijiang created FLINK-6095: --- Summary: Introduce the SlotPoolOptions to config parameters for SlotPool Key: FLINK-6095 URL: https://issues.apache.org/jira/browse/FLINK-6095 Project: Flink Issue Ty

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-17 Thread Ufuk Celebi
Cool! Thanks for taking care of this Gordon :-) On Fri, Mar 17, 2017 at 7:13 AM, Tzu-Li (Gordon) Tai wrote: > Update for 1.1.5: > The last fixes for 1.1.5 are in! I will create the RC today and start the > vote. > > Cheers, > Gordon > > > On March 17, 2017 at 1:14:53 AM, Robert Metzger (rmetz...