Fixing the type of the sentiment happiness value ## What changes were proposed in this pull request?
Added the conversion to int for the 'happiness value' read from the file. Otherwise, later on line 75 the multiplication will multiply a string by a number, yielding values like "-2-2" instead of -4. ## How was this patch tested? Tested manually. Author: Yury Liavitski <[email protected]> Author: Yury Liavitski <[email protected]> Closes #11540 from heliocentrist/fix-sentiment-value-type. Project: http://git-wip-us.apache.org/repos/asf/bahir/repo Commit: http://git-wip-us.apache.org/repos/asf/bahir/commit/3b4a1c0e Tree: http://git-wip-us.apache.org/repos/asf/bahir/tree/3b4a1c0e Diff: http://git-wip-us.apache.org/repos/asf/bahir/diff/3b4a1c0e Branch: refs/heads/master Commit: 3b4a1c0e2609ec7c852495f9d4aefac7e8730691 Parents: 9bff9b3 Author: Yury Liavitski <[email protected]> Authored: Mon Mar 7 10:54:33 2016 +0000 Committer: Sean Owen <[email protected]> Committed: Mon Mar 7 10:54:33 2016 +0000 ---------------------------------------------------------------------- .../streaming/twitter/TwitterHashTagJoinSentiments.scala | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/bahir/blob/3b4a1c0e/streaming-twitter/examples/src/main/scala/org/apache/spark/examples/streaming/twitter/TwitterHashTagJoinSentiments.scala ---------------------------------------------------------------------- diff --git a/streaming-twitter/examples/src/main/scala/org/apache/spark/examples/streaming/twitter/TwitterHashTagJoinSentiments.scala b/streaming-twitter/examples/src/main/scala/org/apache/spark/examples/streaming/twitter/TwitterHashTagJoinSentiments.scala index edf0e0b..a8d392c 100644 --- a/streaming-twitter/examples/src/main/scala/org/apache/spark/examples/streaming/twitter/TwitterHashTagJoinSentiments.scala +++ b/streaming-twitter/examples/src/main/scala/org/apache/spark/examples/streaming/twitter/TwitterHashTagJoinSentiments.scala @@ -56,8 +56,8 @@ object TwitterHashTagJoinSentiments { val wordSentimentFilePath = "data/streaming/AFINN-111.txt" val wordSentiments = ssc.sparkContext.textFile(wordSentimentFilePath).map { line => val Array(word, happinessValue) = line.split("\t") - (word, happinessValue) - } cache() + (word, happinessValue.toInt) + }.cache() // Determine the hash tags with the highest sentiment values by joining the streaming RDD // with the static RDD inside the transform() method and then multiplying
