matthewmturner commented on issue #10609:
URL: https://github.com/apache/datafusion/issues/10609#issuecomment-6645189091
Okay but I see missing statistics here
```
> SET datafusion.explain.show_statistics = true;
0 row(s) fetched.
Elapsed 0.000 seconds.
> EXPLAIN ANALYZE SELECT * FROM 'out.parquet';
+-------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| plan_type | plan
|
+-------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Plan with Metrics | DataSourceExec: file_groups={1 group:
[[home/matth/OpenSource/datafusion/out.parquet]]}, projection=[id, item],
output_ordering=[id@0 ASC NULLS LAST], file_type=parquet,
metrics=[output_rows=3, elapsed_compute=226.92µs, output_bytes=96.0 B,
output_batches=1, files_ranges_pruned_statistics=1 total → 1 matched,
row_groups_pruned_statistics=1 total → 1 matched, page_index_pages_pruned=0
total → 0 matched, page_index_rows_pruned=0 total → 0 matched,
limit_pruned_row_groups=0 total → 0 matched, batches_split=0,
bytes_processed=1228.0 B, bytes_scanned=232.0 B, file_open_errors=0,
file_scan_errors=0, files_opened=1, files_processed=1,
num_predicate_creation_errors=0, predicate_evaluation_errors=0,
pushdown_rows_matched=0, pushdown_rows_pruned=0,
row_groups_pruned_dynamic_filter=0, predicate_cache_inner_records=0,
predicate_cache_records=0, bloom_filter_eval_time=91ns,
metadata_load_time=50.63µs, page_index_eval_time=2ns,
row_pushdown_eval_time=2ns, stati
stics_eval_time=2ns, time_elapsed_opening=167.93µs,
time_elapsed_processing=475.46µs, time_elapsed_scanning_total=419.28µs,
time_elapsed_scanning_until_data=368.95µs, output_rows_skew=0%,
scan_efficiency_ratio=18.89% (232/1.23 K)], statistics=[Rows=Exact(3),
Bytes=Absent, [(Col[0]: Min=Exact(Int64(1)) Max=Exact(Int64(3)) Null=Exact(0)
ScanBytes=Exact(24)),(Col[1]: Min=Inexact(Struct({name:,qty:}))
Max=Inexact(Struct({name:,qty:})))]] |
| |
|
+-------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row(s) fetched.
Elapsed 0.003 seconds.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
