Dandandan commented on PR #4229:
URL:
https://github.com/apache/arrow-datafusion/pull/4229#issuecomment-1410544463
Looking at the plan, it looks like the decimal filter values is coming
through nicely (though I think that we should see if we can default DataFusion
to `parse_float_as_decimal=true` in the parser).
So my guess is that either the multiplication of `lineitem.l_extendedprice *
lineitem.l_discount` is causing the error or the `SUM` aggregation is causing
it.
```
ProjectionExec: expr=[SUM(lineitem.l_extendedprice * lineitem.l_discount)@0
as revenue], metrics=[output_rows=1, elapsed_compute=250ns, spill_count=0,
spilled_bytes=0, mem_used=0]
AggregateExec: mode=Final, gby=[], aggr=[SUM(lineitem.l_extendedprice *
lineitem.l_discount)], metrics=[output_rows=1, elapsed_compute=665ns,
spill_count=0, spilled_bytes=0, mem_used=0]
CoalescePartitionsExec, metrics=[output_rows=2, elapsed_compute=1µs,
spill_count=0, spilled_bytes=0, mem_used=0]
AggregateExec: mode=Partial, gby=[],
aggr=[SUM(lineitem.l_extendedprice * lineitem.l_discount)],
metrics=[output_rows=2, elapsed_compute=1.550495ms, spill_count=0,
spilled_bytes=0, mem_used=0]
CoalesceBatchesExec: target_batch_size=8192,
metrics=[output_rows=114160, elapsed_compute=1.228926ms, spill_count=0,
spilled_bytes=0, mem_used=0]
FilterExec: l_shipdate@3 >= 8766 AND l_shipdate@3 < 9131 AND
l_discount@2 >= Some(5),15,2 AND l_discount@2 <= Some(7),15,2 AND l_quantity@0
< Some(2400),15,2, metrics=[output_rows=114160, elapsed_compute=20.476516ms,
spill_count=0, spilled_bytes=0, mem_used=0]
RepartitionExec: partitioning=RoundRobinBatch(2),
input_partitions=1, metrics=[fetch_time=1.795540669s, repart_time=1ns,
send_time=24.394149ms]
CsvExec: files={1 group:
[[Users/danielheres/Code/arrow-datafusion/benchmarks/tpch-dbgen/lineitem.tbl]]},
has_header=false, limit=None, projection=[l_quantity, l_extendedprice,
l_discount, l_shipdate], metrics=[output_rows=6001215, elapsed_compute=1ns,
spill_count=0, spilled_bytes=0, mem_used=0,
time_elapsed_scanning_total=1.819781372s,
time_elapsed_scanning_until_data=4.780458ms,
time_elapsed_processing=1.79542109s, time_elapsed_opening=59.708µs]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
