akshaychitneni opened a new pull request, #2890:
URL: https://github.com/apache/datafusion-ballista/pull/2890

   Part of #1829.
   
     # Rationale for this change
   
     There is no example of `DataFrame::cache()`, and none of pipelined mode. 
The
     release presents one engine for ETL and interactive queries, and caching is
     where the two meet: prepare data once, then query it interactively.
   
     # What changes are included in this PR?
   
     - `examples/examples/standalone-dataframe-cache.rs`, in one session:
       - turn caching on and cache a prepared DataFrame;
       - in staged mode, the first query builds the cache and later ones read 
it;
       - switch to pipelined mode with one `SET`, and read the same cache with 
three
         parallel queries that stream their rows as they arrive;
       - check that both modes return the same result.
     - `examples/README.md` and `examples/Cargo.toml`: register the example.
     - Tuning guide, "Caching DataFrames": include the example and note that 
caching
       works in both modes.
     - Pipelined guide: a short section on caching, linking to the example.
   
     # Are there any user-facing changes?
   
     Documentation only: a new example and user-guide sections. No code or API
     changes.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to