sandugood commented on PR #1993: URL: https://github.com/apache/datafusion-ballista/pull/1993#issuecomment-5231365878
Also, I think it is good to have an example with remote-checkpoint, so the user could see the output of it in the ballista-tui <img width="2110" height="972" alt="image" src="https://github.com/user-attachments/assets/21025e3b-539d-4dac-9c29-4e775978aa4a"; /> During this planning I have: 1. Read .`parquet` and applied a simple filter. Then called `.checkpoint_lazy()`, which split the plan into two jobs 2. Then reused the same D`F`, which didn't read from the original `.parquet`, but rather from the checkpointed part Hence having 3 separated jobs in the TUI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
