Jeeesie opened a new issue #327:
URL: https://github.com/apache/arrow-datafusion/issues/327
I want to execute benchmake q1.sql distributed, And I noticed that in
from_proto.rs there is PhysicalPlanType::ParquetScan, in which we can use
ParquetExec::try_from_files() to make several partitions.
However, in benchmark tests, the code didnot call this method, instead, it
directly use read_csv(). Can I know why? And how can I use parquetScan?
Also, I attempted to call datafusion's repartition() function in
register_table() :
` let rr_repartition = Partitioning::RoundRobinBatch(3);
let roundtrip_plan = LogicalPlan::Repartition {
input: Arc::from(table.to_logical_plan()),
partitioning_scheme: rr_repartition,
};
state
.tables
.insert(name.to_owned(), roundtrip_plan);`
but I meet the error:
`General("Invalid LogicalPlan::TableScan")`
Can you help to resolve this? My purpose is to execute benchmake q1.sql
distributed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
