Any suggestions on how to do joins in Spark SQL. Above Spark SQL
format/Syntax is not working.
On Mon, Jan 4, 2016 at 2:33 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) wrote:
> There are three tables in action here.
>
> Table A (success_events.sojsuccessevents1) JOIN TABLE B (dw_bid) to
> create
There are three tables in action here.
Table A (success_events.sojsuccessevents1) JOIN TABLE B (dw_bid) to create
TABLE C (sojsuccessevents2_spark)
Now table success_events.sojsuccessevents1 has itemid that i confirmed by
running describe success_events.sojsuccessevents1 from spark-sql shell.
I
Code:
val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc)
hiveContext.sql("drop table sojsuccessevents2_spark")
hiveContext.sql("CREATE TABLE `sojsuccessevents2_spark`( `guid` string
COMMENT 'from deserializer', `sessionkey` bigint COMMENT 'from
deserializer',
Column 'itemId' is not present in table
'success_events.sojsuccessevents1' or 'dw_bid'
did you mean 'sojsuccessevents2_spark' table in your select query ?
Thanks,
Jins
On 01/03/2016 07:22 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) wrote:
Code:
val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc)