Re: Machine Learning on Flink - Next steps

2017-03-31 Thread Jinkui Shi
. There will be more and more ml framework. We can’t support all of them, but can define the common API to adapter. Maybe we can start to discuss how to implement such ml framework and its design doc and API design. Best regards, Jinkui Shi > 在 2017年3月31日,下午7:41,Adarsh <ada...@thirdwatch.

Re: Machine Learning on Flink - Next steps

2017-03-31 Thread Jinkui Shi
. There will be more and more ml framework. We can’t support all of them, but can define the common API to adapter. Maybe we can start to discuss how to implement such ml framework and its design doc and API design. Best regards, Jinkui Shi > 在 2017年3月31日,下午7:41,Adarsh <ada...@thirdwatch.

Re: Java library for Flink-Kudu integration

2017-03-28 Thread Jinkui Shi
This make sense. Only one problem, bahir-flink is not very active. Maybe need more committee to pay some time on it, and have some new plan. We also plan to support carbondata[1] in bahir-flink. By the way, to keep the code base thin, can rewrite flink with Scala step by step until Flink 2.0

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-16 Thread Jinkui Shi
ful (making topology changes impossible) >> Status: PR - https://github.com/apache/flink/pull/3543, review in progress >> >> (5) https://issues.apache.org/jira/browse/FLINK-5650 >> Flink-python tests taking up too much time >> Status: I think Chesnay currently has some

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-15 Thread Jinkui Shi
Can we fix this issue in the 1.2.1: Flink-python tests cost too long time https://issues.apache.org/jira/browse/FLINK-5650 > 在 2017年3月15日,下午6:29,Vladislav Pernin 写道: > > I just tested in in my reproducer. It works.

Re: [DISCUSS] Code style / checkstyle

2017-02-23 Thread Jinkui Shi
Thanks to discuss this problem again. 1. Google checkstyle is good for java. 2. scala check style is here [1] 3. We can make a Flink plan contain issues, one sub-issue one rule. Resolve this in short time. Current code style may be historical accumulate. If we don’t normalize the code step by

Re: Using QueryableState inside Flink jobs (and Parameter Server implementation)

2017-02-12 Thread Jinkui Shi
hi,Gábor Hermann The online parameter server is a good proposal. PS’ paper [1] have a early implement [2], and now it’s mxnet [3]. I have some thought about online PS in Flink: 1. Whether support flexible and configurable update strategy? For example, in one iteration, computing

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Jinkui Shi
Congratulations, Jark Wu and Kostas Kloudas. > On Feb 8, 2017, at 09:52, Zhuoluo Yang wrote: > > Congrats! Good job guys! > > Thanks, > > Zhuoluo  > > > > > >> 在 2017年2月8日,上午4:59,Greg Hogan > > 写道: >> >>

Re: [Discuss] Declare class field's type in scala class field

2017-01-27 Thread Jinkui Shi
ype> Thanks Jinkui Shi > On Jan 27, 2017, at 02:33, Bruno Aranda <brunoara...@gmail.com> wrote: > > Hi, > > Twitter's Effective Scala contains very well-known and accepted conventions > for Scala: > > http://twitter.github.io/effectivescala/ > > Cheers, &g

[Discuss] Declare class field's type in scala class field

2017-01-26 Thread Jinkui Shi
compiling. Thanks Jinkui Shi -- object DeclareTypeTest { def main(args: Array[String]): Unit = { // 1 declareTypeFunction // 2 undeclareTypeFunction } def declareTypeFunction

Re: [DISCUSS] (Not) tagging reviewers

2017-01-25 Thread Jinkui Shi
whether close it or review it forward. I think we can have one reviewer whose main responsibility is identify the unworthiness issue and PR and close them. :) Best, Jinkui Shi > On Jan 26, 2017, at 13:58, Haohui Mai <ricet...@gmail.com> wrote: > > +1. Nice to be pinged if requir

Re: TestBaseUtils refactoring

2017-01-25 Thread Jinkui Shi
bility of TestBaseUtils, use as base unit test or as base util class of unit class? Util class should not be extends by unit test class. Best, Jinkui Shi > On Jan 26, 2017, at 11:37, Jark Wu <wuchong...@alibaba-inc.com> wrote: > > Hi Anton, > > Thanks for bringing up thi

Re: [DISCUSS] Development of SQL OVER / Table API Row Windows for streaming tables

2017-01-25 Thread Jinkui Shi
a lot Best Jinkui Shi > On Jan 25, 2017, at 17:55, Fabian Hueske <fhue...@gmail.com> wrote: > > Hi everybody, > > thanks for the great discussions so far. It's awesome to see so much > interest in this topic! > > First, I'd like to comment on the development proces

Re: [Discuss] Some problem Unit test

2017-01-23 Thread Jinkui Shi
**/*Suite.* > **/*Test.* > > > > > > > > cc Stephan Ewen > > > Best regards > -Jinkui Shi > >