matthewmturner commented on issue #147: URL: https://github.com/apache/arrow-datafusion/issues/147#issuecomment-1001090956
@Dandandan my understanding of what i did was set the expected partitions at the `ExecutionContext` / `ExecutionConfig` level and then collect that into record batches from a `DataFrame` with `df.collect_partitioned` which would take into account the target partitions. That being said i had to play around with that a lot to get a `MemTable` so im not confident its doing what i expected. I'll look into it a little more though. If what i did was incorrect is there a more idiomatic way to create a `MemTable` with the desired number of partitions? Separately, i havent been able to find docs on the supported math functions. Any info you could provide on that? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
