akshaychitneni opened a new pull request, #2890:
URL: https://github.com/apache/datafusion-ballista/pull/2890
Part of #1829.
# Rationale for this change
There is no example of `DataFrame::cache()`, and none of pipelined mode.
The
release presents one engine for ETL and interactive queries, and caching is
where the two meet: prepare data once, then query it interactively.
# What changes are included in this PR?
- `examples/examples/standalone-dataframe-cache.rs`, in one session:
- turn caching on and cache a prepared DataFrame;
- in staged mode, the first query builds the cache and later ones read
it;
- switch to pipelined mode with one `SET`, and read the same cache with
three
parallel queries that stream their rows as they arrive;
- check that both modes return the same result.
- `examples/README.md` and `examples/Cargo.toml`: register the example.
- Tuning guide, "Caching DataFrames": include the example and note that
caching
works in both modes.
- Pipelined guide: a short section on caching, linking to the example.
# Are there any user-facing changes?
Documentation only: a new example and user-guide sections. No code or API
changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]