comphead commented on PR #1550:
URL:
https://github.com/apache/datafusion-comet/pull/1550#issuecomment-2744701637
> > > ```
> > > struct
> > > +- array
> > > +- struct
> > > ```
>
> fyi, currently some tests in Spark SQL (e.g. "add a nested column at the
end of the leaf struct column") fail because of structs like this with.
>
> ```
> Caused by: org.apache.comet.CometNativeException: no entry found for key
> [info] at comet::errors::init::{{closure}}(__internal__:0)
> [info] at std::panicking::rust_panic_with_hook(__internal__:0)
> [info] at
std::panicking::begin_panic_handler::{{closure}}(__internal__:0)
> [info] at
std::sys::backtrace::__rust_end_short_backtrace(__internal__:0)
> [info] at rust_begin_unwind(__internal__:0)
> [info] at core::panicking::panic_fmt(__internal__:0)
> [info] at core::option::expect_failed(__internal__:0)
> [info] at
comet::parquet::parquet_support::cast_struct_to_struct(__internal__:0)
> [info] at
comet::parquet::parquet_support::cast_array(__internal__:0)
> [info] at
comet::parquet::parquet_support::cast_struct_to_struct(__internal__:0)
> [info] at
comet::parquet::parquet_support::cast_array(__internal__:0)
> [info] at
comet::parquet::parquet_support::spark_parquet_convert(__internal__:0)
> [info] at <core::iter::adapters::GenericShunt<I,R> as
core::iter::traits::iterator::Iterator>::next(__internal__:0)
> [info] at <comet::parquet::schema_adapter::SchemaMapping as
datafusion::datasource::schema_adapter::SchemaMapper>::map_batch(__internal__:0)
> [info] at <futures_util::stream::stream::map::Map<St,F> as
futures_core::stream::Stream>::poll_next(__internal__:0)
> [info] at <datafusion_datasource::file_stream::FileStream as
futures_core::stream::Stream>::poll_next(__internal__:0)
> [info] at
Java_org_apache_comet_parquet_Native_readNextRecordBatch(__internal__:0)
> [info] at <unknown>(__internal__:0)
> [info] at org.apache.comet.parquet.Native.readNextRecordBatch(Native
Method)
> ```
appreciate if you can mention those tests in #1551 so we can double check if
they can pass
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
