Re: Enrichment with static tables

2017-02-16 Thread Gaurav Agarwal
Thanks That worked for me previously I was using wrong join .that the reason it did Not worked for me Tbanks On Feb 16, 2017 01:20, "Sam Elamin" wrote: > You can do a join or a union to combine all the dataframes to one fat > dataframe > > or do a select on the columns

Re: Enrichment with static tables

2017-02-15 Thread Sam Elamin
You can do a join or a union to combine all the dataframes to one fat dataframe or do a select on the columns you want to produce your transformed dataframe Not sure if I understand the question though, If the goal is just an end state transformed dataframe that can easily be done Regards Sam

Enrichment with static tables

2017-02-15 Thread Gaurav Agarwal
Hello We want to enrich our spark RDD loaded with multiple Columns and multiple Rows . This need to be enriched with 3 different tables that i loaded 3 different spark dataframe . Can we write some logic in spark so i can enrich my spark RDD with different stattic tables. Thanks