how often you use Tachyon to accelerate Spark

2015-12-06 Thread Arvin
Hi,all
 Well, I have some questions about Tachyon and Spark. I found the
interactive between Spark and Tachyon is the caching RDD use off-heap. I
wonder if you guys use Tachyon frequently, such caching RDD by Tachyon? Is
this action(caching rdd by tachyon) has a profound effect to accelerate
Spark? 



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/how-often-you-use-Tachyon-to-accelerate-Spark-tp25613.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org



Re: AnalysisException Handling for unspecified field in Spark SQL

2015-11-10 Thread Arvin
Hi,you can add a the new column to your DataFrame just before your query. The
added column will be null in your new table, so you can have what you want.



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/AnalysisException-Handling-for-unspecified-field-in-Spark-SQL-tp25343p25344.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org