This is an automated email from the ASF dual-hosted git repository.
timsaucer pushed a change to branch feat/distributed-extensions-example
in repository https://gitbox.apache.org/repos/asf/datafusion-python.git
from 4a8cb2ce Clear the small stuff off the distributed example
add b0030c79 Refuse a shuffle directory that already holds stage output
add 089a8563 Check a shuffle file's schema instead of adopting it
add d76822f9 Size a scalar function's output from the batch, not its
arguments
add 936cb1bd Say what the example-test gate actually does
add 857a9ff7 Keep the driver's scratch out of the results directory
No new revisions were added by this update.
Summary of changes:
.github/workflows/test.yml | 10 +-
.gitignore | 5 +
.../user-guide/distributing-work/query-engines.md | 10 ++
examples/distributed/README.md | 6 ++
.../engine-library/python/dfx_engine/driver.py | 62 +++++++++++-
.../engine-library/python/dfx_engine/session.py | 9 +-
.../python/tests/_test_three_libraries.py | 105 +++++++++++++++++++++
examples/distributed/engine-library/src/lib.rs | 11 +++
examples/distributed/engine-library/src/stage.rs | 64 ++++++++++++-
examples/distributed/run_tpch.py | 14 ++-
examples/distributed/udf-library/src/functions.rs | 28 +++++-
11 files changed, 304 insertions(+), 20 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]