Hi Andy,
Thanks for your quick response. What you concern is reasonable and understandable. But maybe there is some misunderstanding on our proposal. According to the current development situation in China, java core is indeed to bring more contributors here. That is reason why we begin to think if it is also a way for us to provide our contribution to Storm project. It is true that it is a risk to switch the core in a short period. Actually, if possible, maybe we can consider to take JStorm as a subproject of Storm(A branch or some other ways…). We will be responsible for the maintain of it and try to propagate the features from Storm to JStorm, and continue to develop our features and improvements on this. You guys can try the new core and take a long time to estimate if it is worth doing the switch in the future or taking JStorm as official optional core of Storm for user. Regards Basti 发件人: Andrew Feng [mailto:af...@yahoo-inc.com] 发送时间: 2014年10月24日 0:24 收件人: 封仲淹(纪君祥); nat...@nathanmarz.com; 徐明明(护城); ja...@cvk.ca; f...@infochimps.com; david...@microsoft.com; ptgo...@gmail.com; cutt...@apache.org; tdunn...@maprtech.com; arv...@apache.org; d...@hortonworks.com; m.ben.frank...@gmail.com; benjamin.hind...@gmail.com 抄送: aloha-dev; scott.z...@vipshop.com; yannia...@tencent.com; mlc...@iflytek.com; z...@tencent.com 主题: Re: 答复: Could JStorm project collaborate with Storm? Zhongyan: Yahoo almost took your path 2 years ago. After some discussion with Nathan, we decided to work with community on Storm, and some of us learned Clojure quickly. We are very glad that we did that. Under the assumption that Storm provides all features of JStorm, my personal vote will be NO for your proposal. * Storm has enjoyed its current success before Nathan built a very solid core in Clojure. We should not replace that core until we are 100% sure that alternative implementation is at least as good as our Clojure implementation. * Clojure has not prevent Storm attract contributors (currently 108). We have contributors who write code in Clojure and Java. It doesn’t take much time for one to be able to understand Clojure code. * The convergence of streaming processing and batch processing will occur at higher level of abstractions. Trident API, for example, is very much similar to batch API such as Pig or Cascading. * Including Jstorm under Storm will only create confusion to our user community at this stage. Why don’t you have discussion with 徐明明 to figure out an alternative path for JStorm? Thanks, Andy From: "封仲淹 (纪君祥)" <zhongyan.f...@alibaba-inc.com> Reply-To: "封仲淹(纪君祥)" <zhongyan.f...@alibaba-inc.com> Date: Wednesday, October 22, 2014 at 11:37 PM To: Andy Feng <af...@yahoo-inc.com>, "nat...@nathanmarz.com" <nat...@nathanmarz.com>, "徐明明(护城)" <mingming.x...@alibaba-inc.com>, "ja...@cvk.ca" <ja...@cvk.ca>, "f...@infochimps.com" <f...@infochimps.com>, "david...@microsoft.com" <david...@microsoft.com>, "ptgo...@gmail.com" <ptgo...@gmail.com>, Doug Cutting <cutt...@apache.org>, "tdunn...@maprtech.com" <tdunn...@maprtech.com>, "arv...@apache.org" <arv...@apache.org>, "d...@hortonworks.com" <d...@hortonworks.com>, "m.ben.frank...@gmail.com" <m.ben.frank...@gmail.com>, "benjamin.hind...@gmail.com" <benjamin.hind...@gmail.com> Cc: aloha-dev <aloha-...@list.alibaba-inc.com>, "scott.z...@vipshop.com" <scott.z...@vipshop.com>, "yannia...@tencent.com" <yannia...@tencent.com>, "mlc...@iflytek.com" <mlc...@iflytek.com>, "z...@tencent.com" <zeus@tencent. com> Subject: 答复: Could JStorm project collaborate with Storm? Andrew, Thanks for suggest. The problem is that the core of Storm is implemented by Clojure, if it is java, we are glad to merge all our commit into the Strom Trunk. If the core of Storm is implemented by Java, I think the contributor of Storm would be double. May I put forward 2 proposal: 1. Could Jstorm be the son project of Storm? 2. Task a long time to change Storm-core as Jstorm-core. a) If the core of Storm is implemented by Java, I think the contributor of Storm would be double. Once one user found one bug, maybe he is able to fix it by himself, in this method, Storm resolve problem will be double b) In the next one or two years, batch handling and stream handling will merge into one solution, Spark/Flink are doing this job. If we still use clojure, I am a little afraid that we can’t follow the steps of other community and this direction. Thanks Longda 发件人: Andrew Feng [mailto:af...@yahoo-inc.com] 发送时间: 2014年10月23日 13:31 收件人: 封仲淹(纪君祥); nat...@nathanmarz.com; 徐明明(护城); ja...@cvk.ca; f...@infochimps.com; david...@microsoft.com; ptgo...@gmail.com; cutt...@apache.org; tdunn...@maprtech.com; arv...@apache.org; d...@hortonworks.com; m.ben.frank...@gmail.com; benjamin.hind...@gmail.com 抄送: aloha-dev; scott.z...@vipshop.com; yannia...@tencent.com; mlc...@iflytek.com; z...@tencent.com 主题: Re: Could JStorm project collaborate with Storm? Zhongyan: I would suggest you identify a collection of key features in Jstorm, and then propose pull requests to Storm. Once these pull requests are accepted, you could then simply adopt Storm. Andy From: "封仲淹 (纪君祥)" <zhongyan.f...@alibaba-inc.com> Reply-To: "封仲淹(纪君祥)" <zhongyan.f...@alibaba-inc.com> Date: Wednesday, October 22, 2014 at 8:23 PM To: "nat...@nathanmarz.com" <nat...@nathanmarz.com>, "徐明明(护城)" <mingming.x...@alibaba-inc.com>, "ja...@cvk.ca" <ja...@cvk.ca>, Andy Feng <af...@yahoo-inc.com>, "f...@infochimps.com" <f...@infochimps.com>, "david...@microsoft.com" <david...@microsoft.com>, "ptgo...@gmail.com" <ptgo...@gmail.com>, Doug Cutting <cutt...@apache.org>, "tdunn...@maprtech.com" <tdunn...@maprtech.com>, "arv...@apache.org" <arv...@apache.org>, "d...@hortonworks.com" <d...@hortonworks.com>, "m.ben.frank...@gmail.com" <m.ben.frank...@gmail.com>, "benjamin.hind...@gmail.com" <benjamin.hind...@gmail.com> Cc: aloha-dev <aloha-...@list.alibaba-inc.com>, "scott.z...@vipshop.com" <scott.z...@vipshop.com>, "yannia...@tencent.com" <yannia...@tencent.com>, "mlc...@iflytek.com" <mlc...@iflytek.com>, "z...@tencent.com" <zeus@tencent. com> Subject: Could JStorm project collaborate with Storm? Hi all, Firstly, congratulate Storm becoming the top project of Apache. Since the first day of Storm opened source, it has become one of hottest technologies in the BigData field and brought a new perspective to the world, which has helped many companies resolve hundreds of requirements. Since 2012/4, we have forked a project named "JStorm". At the beginning time, we just wanted to implement Storm with Java. As time goes on, more and more features have been added to JStorm. In 2013/9, JStorm changed to be an open source project; from then on, more and more people and companies join this project. As JStorm is derived from Storm, and born in a great company named Alibaba, which just successfully listed on the New York Stock Exchange on Sept. 19, is a very open company. We also want to share our technology with more people, and favor rapid evolution of streaming technology. So, could JStorm project collaborate with Storm? A little introduction for JStorm as follows: JStorm is a distributed and fault-tolerant real-time computation system. Inspired by Apache Storm, JStorm has been completely rewritten in Java and provides more enhanced features. JStorm has been widely used in many enterprise environments and proved robust and stable. Begun from 2012/2, we have released 11 versions till 2014/09/28. More than 10 companies are using it, including several leading companies such as Alibaba, Tencent, Baidu, Huawei, ZTE in China. Please refer to https://github.com/alibaba/jstorm for more details Regards Longda
