Summarizing an offline message:
The following worked for Divya:
dffiltered = dffiltered.unionAll(dfresult.filter ...
On Mon, Mar 14, 2016 at 5:54 AM, Lohith Samaga M
wrote:
> If all sql results have same set of columns you could UNION all the
> dataframes
>
> Create an empty df and Union all
>
If all sql results have same set of columns you could UNION all the dataframes
Create an empty df and Union all
Then reassign new df to original df before next union all
Not sure if it is a good idea, but it works
Lohith
Sent from my Sony Xperia™ smartphone
Divya Gehlot wrote
Hi,
dffiltered = unionAll(dfresult.filter(dfFilterSQLs(
i)).select("Col1","Col2","Col3","Col4","Col5"))
FYI
On Sun, Mar 13, 2016 at 8:50 PM, Ted Yu wrote:
> Have you tried unionAll() method of DataFrame ?
>
> On Sun, Mar 13, 2016 at 8:44 PM, Divya Gehlot
> wrote:
>
>> Hi,
>>
>> Please bear me for
Have you tried unionAll() method of DataFrame ?
On Sun, Mar 13, 2016 at 8:44 PM, Divya Gehlot
wrote:
> Hi,
>
> Please bear me for asking such a naive question
> I have list of conditions (dynamic sqls) sitting in hbase table .
> I need to iterate through those dynamic sqls and add the data to
>
Hi,
Please bear me for asking such a naive question
I have list of conditions (dynamic sqls) sitting in hbase table .
I need to iterate through those dynamic sqls and add the data to dataframes.
As we know dataframes are immutable ,when I try to iterate in for loop as
shown below I get only last d
