carloVentrella opened a new issue #9575: Set batch size for impala connections URL: https://github.com/apache/incubator-superset/issues/9575 When connecting to Impala, the default batch size in impyla is 1024. For large resultsets this can be a bottleneck and it would be useful to add the possibility to tune it via config file (e.g. an `IMPALA_BATCH_SIZE` parameter). Since `BaseEngineSpec` already handles the batchsize (i.e. arraysize) in the `fetch_data` method (https://github.com/apache/incubator-superset/blob/master/superset/db_engine_specs/base.py#L298), which is inherited by `impala.py`, it would be just a matter of populating the `arraysize` from the value set in the config.py.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
