You must try to directly convert tuple2 to integer. You shall get the integer from the tuple2 first then cast that in your workflow.
________________________________ From: Jeff Zhang <zjf...@gmail.com> Sent: Sunday, December 23, 2018 6:59 PM To: user Subject: Re: livy with sparkR issue This is due to livy 0.5 doesn't support spark 2.4. Because spark 2.4 changes its SparkR related method signature. I am afraid you have to downgrade to spark 2.3.x andrew shved <andrewshved.w...@gmail.com<mailto:andrewshved.w...@gmail.com>> 于2018年12月24日周一 上午7:48写道： Spark 2.4.0 Sorry Zeppelin 0.8.0 Livy 0.5 regular livy.sparkr commands like 1+1 work the issue when spark comes into play On Sun, Dec 23, 2018 at 6:44 PM andrew shved <andrewshved.w...@gmail.com<mailto:andrewshved.w...@gmail.com>> wrote: 0.5 with spark 2.4.9 on AWS EMR On Sun., Dec. 23, 2018, 6:41 p.m. Jeff Zhang <zjf...@gmail.com<mailto:zjf...@gmail.com> wrote: Which version of livy do you use ? andrew shved <andrewshved.w...@gmail.com<mailto:andrewshved.w...@gmail.com>> 于2018年12月23日周日 下午11:49写道： been struggling wiht zeppelin + livy + sparkR integration for days. I got livy.pyspark and livy.spark work no issues. with livy.sparkr I get 18/12/23 15:05:24 INFO SparkEntries: Created Spark session (with Hive support). Exception in thread "SparkR backend" java.lang.ClassCastException: scala.Tuple2 cannot be cast to java.lang.Integer at scala.runtime.BoxesRunTime.unboxToInt(BoxesRunTime.java:101) at org.apache.livy.repl.SparkRInterpreter$$anon$1.run(SparkRInterpreter.scala:83) all the time :disappointed: running out of things to try simple spark.R works Any ideas or advice would be appreciated. Thank you! -- Best Regards Jeff Zhang -- Best Regards Jeff Zhang
