Can you show us the function you passed to reduceByKey() ?
What release of Spark are you using ?
Cheers
On Sat, Apr 18, 2015 at 8:17 AM, SecondDatke lovejay-lovemu...@outlook.com
wrote:
I'm trying to solve a Word-Count like problem, the difference lies in
that, I need the count of a specific
I'm trying to solve a Word-Count like problem, the difference lies in that, I
need the count of a specific word among a specific timespan in a social message
stream.
My data is in the format of (time, message), and I transformed (flatMap etc.)
it into a series of (time, word_id), the time is
Do these datetime objects implement a the notion of equality you'd
expect? (This may be a dumb question; I'm thinking of the equivalent
of equals() / hashCode() from the Java world.)
On Sat, Apr 18, 2015 at 4:17 PM, SecondDatke
lovejay-lovemu...@outlook.com wrote:
I'm trying to solve a
in Python,
they're same.
And as I said, I also tried using String as the key, which also failed.
From: so...@cloudera.com
Date: Sat, 18 Apr 2015 16:30:59 +0100
Subject: Re: Does reduceByKey only work properly for numeric keys?
To: lovejay-lovemu...@outlook.com
CC: user@spark.apache.org
Do
keys makes sense.
Maybe I should update my system.
Date: Sat, 18 Apr 2015 08:28:50 -0700
Subject: Re: Does reduceByKey only work properly for numeric keys?
From: yuzhih...@gmail.com
To: lovejay-lovemu...@outlook.com
CC: user@spark.apache.org
Can you show us the function you passed to reduceByKey
the
duplicate keys in the result with == operator, and hashing them in Python,
they're same.
And as I said, I also tried using String as the key, which also failed.
From: so...@cloudera.com
Date: Sat, 18 Apr 2015 16:30:59 +0100
Subject: Re: Does reduceByKey only work properly for numeric keys
I should update my system.
--
Date: Sat, 18 Apr 2015 08:28:50 -0700
Subject: Re: Does reduceByKey only work properly for numeric keys?
From: yuzhih...@gmail.com
To: lovejay-lovemu...@outlook.com
CC: user@spark.apache.org
Can you show us the function you passed
