Hi TD,
I have the same question: I need the workers to process using arrival order
since it's updating a state based on previous one.
tnks in advance.
Rod
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/range-partitioner-with-updateStateByKey-tp5190p7123
I’d like to know both ways: arrival order and sort order
-A
From: Tathagata Das [mailto:tathagata.das1...@gmail.com]
Sent: May-02-14 12:04 AM
To: user@spark.apache.org
Cc: u...@spark.incubator.apache.org
Subject: Re: range partitioner with updateStateByKey
Ordered by what? arrival order? sort
Ordered by what? arrival order? sort order?
TD
On Thu, May 1, 2014 at 2:35 PM, Adrian Mocanu wrote:
> If I use a range partitioner, will this make updateStateByKey take the
> tuples in order?
>
> Right now I see them not being taken in order (most of them are ordered
> but not all)
>
>
>
> -A
