Re: [PROPOSAL] External Join with KV Stores

forward option, as it doesn't require support in > runner level. > > Mingmin > > On Mon, Jul 17, 2017 at 8:56 PM, JingsongLee <lzljs3620...@aliyun.com> > wrote: > > > Sorry for so long to reply. > > Hi, Aljoscha, I think Async I/O operator and Batch the same, an

Re: [ANNOUNCEMENT] New committers, August 2017 edition!

Thank you all! And congratulations to other new committers. Best, Jingsong Lee--From:Mark Liu Time:2017 Aug 16 (Wed) 02:18To:dev Subject:Re: [ANNOUNCEMENT] New committers, August

[PROPOSAL] External Join with KV Stores

Hi all: In some scenarios, the user needs to query some information from external kv store in the pipeline.I think we can have a good abstraction that allows users  to get as little as possible with the underlying details.Here is a docs of this proposal, would like to receive your feedback.

Re: [DISCUSS] Apache Beam 2.1.0 release next week ?

Very nice to see this release. Include the merge of DSL_SQL? Pleased to see BEAM-1612 can be completed. (Not blocker)https://issues.apache.org/jira/browse/BEAM-1612 Best, JingsongLee --From:Kenneth Knowles <k...@google.com.INVA

Re: Reduced Availability from 17.6. - 24.6

Have a good time~ Best, JingsongLee--From:Jean-Baptiste Onofré <j...@nanthrax.net>Time:2017 Jun 22 (Thu) 10:21To:dev <dev@beam.apache.org>Subject:Re: Reduced Availability from 17.6. - 24.6 Enjoy !! Well deserved !

Re: Fwd: [Report] Eagle - June 2017

I'd like participate in doing some work. Best, JingsongLee --From:Davor Bonaci <da...@apache.org>Time:2017 Jun 22 (Thu) 06:10To:dev <dev@beam.apache.org>Subject:Fwd: [Report] Eagle - June 2017 From this month's 

Re: [DISCUSS] Bundle in Flink Runner

Thanks Aljoscha,  I will add these related links to the docs. Best, JingsongLee -- From:Aljoscha Krettek <aljos...@apache.org> Time:2017 Jun 14 (Wed) 20:56 To:dev <dev@beam.apache.org>; JingsongLee <lzljs3620...@aliyun.

[DISCUSS] Bundle in Flink Runner

Hi everyone, I take a discussion to the implement of real bundle in Flink Runner. https://docs.google.com/document/d/1UzELM4nFu8SIeu-QJkbs0sv7Uzd1Ux4aXXM3cw4s7po/edit?usp=sharing Feel free to comment/edit it. Best, JingsongLee

Re: [DISCUSS] Source Watermark Metrics

Hi @Ben Chambers @Aljoscha Krettek @Aviem Zur and other all,  I've written this up as a proposal found here:  https://docs.google.com/document/d/1ykjjG97DjVQP73jGbotGRbtK38hGvFbokNEOuNO4DAo/edit?usp=sharing Feel free to comment/edit it. Best, JingsongLee

Re: [DISCUSS] Source Watermark Metrics

,  and the  metric's type(Counter, Guage, Distribution) can not express it. Best,JingsongLee -- From:Ben Chambers <bchamb...@google.com.INVALID> Time:2017 Jun 2 (Fri) 21:46 To:dev <dev@beam.apache.org>; JingsongLee <lzljs362

Re: [DISCUSS] Remove TimerInternals.deleteTimer(*) and Timer.cancel()

+1 to remove this, I have not encountered such a strong case. best, JingsongLee -- From:Kenneth Knowles <k...@google.com.INVALID> Time:2017 May 9 (Tue) 05:45 To:dev <dev@beam.apache.org> Subject:Re: [DIS

Re: Congratulations Davor!

Congratulations! -- From:Jesse Anderson Time:2017 May 4 (Thu) 21:36 To:dev Subject:Re: Congratulations Davor! Congrats! On Thu, May 4, 2017, 6:20 AM Aljoscha Krettek 

Re: Community hackathon

+1 best, Jingsonglee --From:Ted Yu <yuzhih...@gmail.com>Time:2017 Apr 24 (Mon) 17:29To:dev <dev@beam.apache.org>Subject:Re: Community hackathon +1 > On Apr 24, 2017, at 12:51 AM, Jean-Baptiste Onofré <j...@n

Join to external table

interface is called ExternalState. There are HBaseState, JDBCState, RedisState. It is accessed by key and namespace. Provides bulk access to the external table for performance. Is there a better way to implement it? Can we make some abstracts in Beam Model?  What do you think? Best, JingsongLee

Re: Renaming SideOutput

strong +1 best, JingsongLee--From:Tang Jijun(上海_技术部_数据平台_唐觊隽) <tangji...@yhd.com>Time:2017 Apr 12 (Wed) 10:39To:dev@beam.apache.org <dev@beam.apache.org>Subject:答复: Renaming SideOutput +1 more clearer -邮件原件

Re: StatefulDoFnRunner

There is no suitable way to get the CurrentKey. I think using StepContext.timerInternals() and StepContext.stateInternals() is better. best, JingsongLee --From:Thomas Weise <t...@apache.org>Time:2017 Apr 6 (Thu) 12:45To:dev

Re: Update of Pei in Alibaba

gt; Maybe it's worth while to take a peek and see if something is reusable from > there. > > - Tibor > > On Sat, Apr 1, 2017 at 4:37 AM, JingsongLee <lzljs3620...@aliyun.com> wrote: > >> Wow, very glad to see JStorm also started building BeamRunner. >> I am working in Gala

Re: Call for help: let's add Splittable DoFn to Spark, Flink and Apex runners

Hi Aljoscha, I would like to work on the Flink runner with you. Best,JingsongLee--From:Jean-Baptiste Onofré <j...@nanthrax.net>Time:2017 Mar 28 (Tue) 14:04To:dev <dev@beam.apache.org>Subject:Re: Call for help: let's ad

回复： [ANNOUNCEMENT] New committers, March 2017 edition!

Congratulations to all! --原始邮件 --发件人：Stas Levin 日期：2017-03-18 23:09:55收件人：dev@beam.apache.org 主题：Re: [ANNOUNCEMENT] New committers, March 2017 edition!Congrats to the new committers! On Sat, Mar 18, 2017 at 3:44 PM

回复：How to implement Timer in runner

Thanks for the reply.Maybe we need a external priority queue.Happy Chinese New Year! --发件人：Aljoscha Krettek 发送时间：2017年1月25日(星期三) 18:38收件人：dev ; lzljs3620320 ;