This is an automated email from the ASF dual-hosted git repository.
agrove pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
from 9b05dfeaf chore: 4.5x reduction in number of golden files (#3399)
add e9dafd0cb Feat: to_csv (#3004)
No new revisions were added by this update.
Summary of changes:
.github/workflows/pr_build_linux.yml | 1 +
.github/workflows/pr_build_macos.yml | 1 +
native/core/src/execution/planner.rs | 21 +-
native/proto/src/proto/expr.proto | 17 ++
native/spark-expr/Cargo.toml | 4 +
native/spark-expr/benches/to_csv.rs | 108 ++++++++++
.../spark-expr/src/csv_funcs/csv_write_options.rs | 61 ++++++
.../util => spark-expr/src/csv_funcs}/mod.rs | 11 +-
native/spark-expr/src/csv_funcs/to_csv.rs | 223 +++++++++++++++++++++
native/spark-expr/src/lib.rs | 2 +
.../org/apache/comet/serde/QueryPlanSerde.scala | 3 +-
.../scala/org/apache/comet/serde/structs.scala | 72 ++++++-
.../org/apache/comet/CometCsvExpressionSuite.scala | 198 ++++++++++++++++++
.../benchmark/CometCsvExpressionBenchmark.scala | 84 ++++++++
14 files changed, 795 insertions(+), 11 deletions(-)
create mode 100644 native/spark-expr/benches/to_csv.rs
create mode 100644 native/spark-expr/src/csv_funcs/csv_write_options.rs
copy native/{core/src/parquet/util => spark-expr/src/csv_funcs}/mod.rs (87%)
create mode 100644 native/spark-expr/src/csv_funcs/to_csv.rs
create mode 100644
spark/src/test/scala/org/apache/comet/CometCsvExpressionSuite.scala
create mode 100644
spark/src/test/scala/org/apache/spark/sql/benchmark/CometCsvExpressionBenchmark.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
