robtandy opened a new pull request, #83: URL: https://github.com/apache/datafusion-ray/pull/83
Small fixes that came up during benchmarking. - query 15 (and others ) now runs all statements - `util::exec_sql_on_tables` replaced with `util::LocalValidator` as keeping state in its own `ctx` it can more easily handle multiple queries - update `ray.remote` annotations to denote the `SPREAD` scheduling strategy - update `ray.remote` to require `num_cpus=0.01` such that we do ask for a small amount of logical CPU, and this way can avoid being scheduled on the head node - Clippy formatted - `black --line-length 79` formatted python Note that DDL/DML statements, like in query 15, end up producing an empty physical plan and are sent to a `DFRayProcessor` for execution. This doesn't produce an incorrect result, but we should optimize this in a subsequent improvement. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
