Hi Imesh, If we take the above scenario, I need to insert the analyzed/aggregated data which is obtained as result after spark sql processing, to my mysql table (sample_table). In order to do that, first we need to create a temporary table using the corresponding mysql database (sample_datasource) and table(sample_table) in spark environment and then only by inserting data to this temporary table in spark environment, we can update our mysql table.
In DAS spark environment, we can't directly insert the analyzed data to our mysql table. We should create a temporary table using our datasources to manipulate them. I think that's why they named it as '*temporary*' table. @Niranda Please correct me if I'm wrong. Thanks. On Thu, Oct 1, 2015 at 7:00 AM, Imesh Gunaratne <[email protected]> wrote: > Hi Thanuja, > > Can you please explain the purpose of these temporary tables? > > Thanks > > On Wed, Sep 30, 2015 at 11:53 PM, Thanuja Uruththirakodeeswaran < > [email protected]> wrote: > >> Hi All, >> >> When we create temporary tables in spark environment using carbonJDBC >> option as explained in [1], we are using a datasource and tableName from >> which spark environment temporary table will get data as follow: >> CREATE TEMPORARY TABLE <temp_table> using CarbonJDBC options (dataSource >> "<datasource >> name>", tableName "<table name>"); >> >> I've used a mysql database (sample_datasource) for datasource and used >> mysql tables created in that database for tableName (sample_table) as >> follow: >> CREATE TEMPORARY TABLE sample using CarbonJDBC options (dataSource " >> sample_datasource", tableName "sample_table"); >> >> But I'm creating the mysql database and tables by executing sql >> statements manually. Is there a way in DAS that we can add these sql >> statements inside a script and create the database and tables when we start >> the server? >> >> [1]. https://docs.wso2.com/display/DAS300/Spark+Query+Language >> >> Thanks. >> >> -- >> Thanuja Uruththirakodeeswaran >> Software Engineer >> WSO2 Inc.;http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 774363167 >> >> _______________________________________________ >> Dev mailing list >> [email protected] >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > *Imesh Gunaratne* > Senior Technical Lead > WSO2 Inc: http://wso2.com > T: +94 11 214 5345 M: +94 77 374 2057 > W: http://imesh.gunaratne.org > Lean . Enterprise . Middleware > > -- Thanuja Uruththirakodeeswaran Software Engineer WSO2 Inc.;http://wso2.com lean.enterprise.middleware mobile: +94 774363167
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
