Re: Contributor introduction

2017-10-02 Thread Kobi Salant
Welcome Uri 2017-10-02 15:37 GMT+03:00 Aviem Zur : > Added, welcome Uri! > > On Mon, Oct 2, 2017 at 3:32 PM Jean-Baptiste Onofré > wrote: > > > Hi Uri, > > > > what's your Jira ID ? > > > > Thanks, > > Regards > > JB > > > > On 10/02/2017 02:31 PM, Uri

Support for window analytic functions in SQL DSL

2017-10-02 Thread Kobi Salant
Hi, Calcite streaming documentation includes examples for using SQL window analytic functions https://calcite.apache.org/docs/stream.html#sliding-windows In the beam documentation https://beam.apache.org/documentation/dsls/sql/ there is no mention for this functionality. Does the DSL_SQL branch

Re: Adding Serializable implements to SDK classes like WindowedValue etc...

2017-08-24 Thread Kobi Salant
ializable to > the WindowedValue help? The user class, which is stored in a field in the > WindowedValue will still be non-serializable, and thus cause problems. > > On Thu, Aug 24, 2017 at 11:59 AM Kobi Salant <kobi.sal...@gmail.com> > wrote: > > > right, if it is not kryo or java

Re: Adding Serializable implements to SDK classes like WindowedValue etc...

2017-08-24 Thread Kobi Salant
right, if it is not kryo or java serializable then we should allow user to set caching off 2017-08-24 21:55 GMT+03:00 Reuven Lax <re...@google.com.invalid>: > However user classes are not guaranteed to be java serializable either. > > On Thu, Aug 24, 2017 at 11:31 AM, Kobi S

Re: Adding Serializable implements to SDK classes like WindowedValue etc...

2017-08-24 Thread Kobi Salant
e those are pretty simple types. > > > > Also, I don't see why they can't be tagged with Serializable but I think > > the original reasoning was that coders should be used to guarantee a > stable > > representation across JVM versions. > > > > On Thu, Aug 24, 2017 at 5:

Adding Serializable implements to SDK classes like WindowedValue etc...

2017-08-24 Thread Kobi Salant
Hi All, I am working on Spark runner issue https://issues.apache.org/jira/browse/BEAM-2669 "Kryo serialization exception when DStreams containing non-Kryo-serializable data are cached" Currently, Spark runner enforce the kryo serializer and in shuffling scenarios we always uses coders to

Re: [VOTE] Release 2.1.0, release candidate #3

2017-08-16 Thread Kobi Salant
Hi, Spark runner was tested with word count example and a more complex session based application on a yarn cluster. Both application run successfully so we can say that spark runner passed the sanity tests needed. Still there is an open ticket https://issues.apache.org/jira/browse/BEAM-2671

Re: [ANNOUNCEMENT] New PMC members, August 2017 edition!

2017-08-11 Thread Kobi Salant
Congrats Aviem בתאריך 11 באוג' 2017 21:49,‏ "Reuven Lax" כתב: > Congratulations! > > On Fri, Aug 11, 2017 at 10:40 AM, Davor Bonaci wrote: > > > Please join me and the rest of Beam PMC in welcoming the following > > committers as our newest PMC

Re: Beam spark 2.x runner status

2017-03-23 Thread Kobi Salant
Hi, We use SparkContext & SparkContextStreaming extensively in Spark runner to create the Dsteams & Rdds so we will need to work on migrating from the 1.X terms to 2.X terms (We may other incompatibilities that we will find out during the work). Regards Kobi 2017-03-23 6:55 GMT+02:00

Re: [ANNOUNCEMENT] New committers, March 2017 edition!

2017-03-18 Thread Kobi Salant
Congrats all בתאריך 18 במרץ 2017 2:17,‏ "Thomas Weise" כתב: > Congrats! > > > On Fri, Mar 17, 2017 at 4:28 PM, Chamikara Jayalath > wrote: > > > Thanks all. Congrats to other new committers !! > > > > I'm very excited to join. > > > > - Cham > > >

Re: Interest in a (virtual) contributor meeting?

2017-02-22 Thread Kobi Salant
+1 בתאריך 22 בפבר' 2017 2:54 PM,‏ "Aljoscha Krettek" כתב: > +1 > > On Wed, 22 Feb 2017 at 10:08 JingsongLee wrote: > > > +1 > > > > > > 来自阿里邮箱 iPhone版 --原始邮件 --发件人:Davor Bonaci > < > > da...@apache.org>日期:2017-02-22

Re: [ANNOUNCEMENT] New committers, January 2017 edition!

2017-01-26 Thread Kobi Salant
Congrats! Well deserved Stas בתאריך 27 בינו' 2017 7:26,‏ "Frances Perry" כתב: > Woohoo! Congrats ;-) > > On Thu, Jan 26, 2017 at 9:05 PM, Jean-Baptiste Onofré > wrote: > > > Welcome aboard !⁣ > > > > Regards > > JB > > > > On Jan 27, 2017, 01:27, at