Re: Spark SQL Join returns less rows that expected

2014-11-25 Thread Yin Huai
ile.map(x => x.split("|")).map(f => >> F2(f(0),f(2),f(101),f(3))) >> productrdd.registerAsTable("F2") >> sqlContext.cacheTable("F2") >> >> val resrdd = sqlContext.sql("Select count(*) from F1, F2

Re: Spark SQL Join returns less rows that expected

2014-11-25 Thread Cheng Lian
"F2") val resrdd = sqlContext.sql("Select count(*) from F1, F2 where F1.c1 = F2.d1 ").count() // --- end of code --- Does anybody know what i missed ? Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Join-retu

Spark SQL Join returns less rows that expected

2014-11-25 Thread david
t i missed ? Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Join-returns-less-rows-that-expected-tp19731.html Sent from the Apache Spark User List mailing list archive at Nabble.com. ---