alamb opened a new pull request, #4130:
URL: https://github.com/apache/arrow-datafusion/pull/4130

   # Which issue does this PR close?
   
   re #3463 
   # Rationale for this change
   
   The parquet reader is both important and well tested in DataFusion. However, 
currently the tests are split in several places so it may not be all that clear 
what is covered.
   
   Also, the parquet integration test currently takes 24 seconds so more 
parallelism would be better
   
   ```shell
   $ cargo test --test parquet_filter_pushdown
   ...
   running 1 test
   test single_file ... ok
   
   test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; 
finished in 24.47s
   ```
   
   
   # What changes are included in this PR?
   
   
   Changes:
   Move most ParquetExec tests into the `parquet_exec` integration test:
   
   ```
   drwxr-xr-x   4 alamb  staff    128 Nov  2 17:36 parquet
   -rw-r--r--   1 alamb  staff  14682 Nov  5 07:05 parquet_filter_pushdown.rs
   -rw-r--r--   1 alamb  staff   7518 Nov  3 12:35 parquet_page_index_pruning.rs
   -rw-r--r--   1 alamb  staff  26958 Nov  5 07:05 parquet_pruning.rs
   ```
   
   So now we can run the parquet tests like:
   ```shell
   cargo test  --test parquet_exec
   ```
   
   # Are there any user-facing changes?
   No


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to