Re: Window slide duration

2014-06-03 Thread Vadim Chekan
to me, window slide duration (4) is streaming context batch duration (1) *2. So, what's the problem? Spark-v1.0.0 -- From RFC 2631: In ASN.1, EXPLICIT tagging is implicit unless IMPLICIT is explicitly specified -- From RFC 2631: In ASN.1, EXPLICIT tagging is implicit unless IMPLICIT

Re: Window slide duration

2014-06-03 Thread Vadim Chekan
() === Seems all right to me, window slide duration (4) is streaming context batch duration (1) *2. So, what's the problem? Spark-v1.0.0 -- From RFC 2631: In ASN.1, EXPLICIT tagging is implicit unless IMPLICIT is explicitly specified -- From RFC 2631: In ASN.1, EXPLICIT tagging is implicit unless

Window slide duration

2014-06-02 Thread Vadim Chekan
My relevant code is: === ssc = new StreamingContext(conf, Seconds(1)) val messageEvents = events. flatMap(e = evaluatorCached.value.find(e)). window(Seconds(8), Seconds(4)) messageEvents.print() === Seems all right to me, window slide duration (4

Re: Window slide duration

2014-06-02 Thread Tathagata Das
() === Seems all right to me, window slide duration (4) is streaming context batch duration (1) *2. So, what's the problem? Spark-v1.0.0 -- From RFC 2631: In ASN.1, EXPLICIT tagging is implicit unless IMPLICIT is explicitly specified

Re: Window slide duration

2014-06-02 Thread Vadim Chekan
is: === ssc = new StreamingContext(conf, Seconds(1)) val messageEvents = events. flatMap(e = evaluatorCached.value.find(e)). window(Seconds(8), Seconds(4)) messageEvents.print() === Seems all right to me, window slide duration (4) is streaming context

Re: Window slide duration

2014-06-02 Thread Tathagata Das
= events. flatMap(e = evaluatorCached.value.find(e)). window(Seconds(8), Seconds(4)) messageEvents.print() === Seems all right to me, window slide duration (4) is streaming context batch duration (1) *2. So, what's the problem? Spark-v1.0.0 -- From RFC 2631

Re: Window slide duration

2014-06-02 Thread Vadim Chekan
= evaluatorCached.value.find(e)). window(Seconds(8), Seconds(4)) messageEvents.print() === Seems all right to me, window slide duration (4) is streaming context batch duration (1) *2. So, what's the problem? Spark-v1.0.0 -- From RFC 2631: In ASN.1, EXPLICIT tagging is implicit unless