mistercrunch commented on issue #3302: Create a PandasDatasource
URL: 
https://github.com/apache/incubator-superset/issues/3302#issuecomment-322976592
 
 
   So we want the web server(s) to be stateless (Superset isn't a database!), 
that probably means that at each web request `PandasConnector` would have to 
read the raw data, filter/aggregate/compute, and flush the results so they can 
be garbage collected. 
   
   Seems pretty inefficient, why not flush your dataframe to a proper 
sql-speaking database an using the sqla connector. 
   
   An Apache Arrow connector seems like a more sensical idea though I'm unclear 
on the specifics.
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to