[
https://issues.apache.org/jira/browse/SPARK-53011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta resolved SPARK-53011.
------------------------------------
Fix Version/s: connect-rust-0.1.0
Assignee: Kousuke Saruta
Resolution: Fixed
Issue resolved in https://github.com/apache/spark-connect-rust/pull/4
> test_df_unpivot doesn't pass with Spark 4.0
> -------------------------------------------
>
> Key: SPARK-53011
> URL: https://issues.apache.org/jira/browse/SPARK-53011
> Project: Spark
> Issue Type: Bug
> Components: Connect, Tests
> Affects Versions: connect-rust-0.1.0
> Reporter: Kousuke Saruta
> Assignee: Kousuke Saruta
> Priority: Minor
> Labels: pull-request-available
> Fix For: connect-rust-0.1.0
>
>
> test_df_unpivot doesn't pass with Spark 4.0.
> {code}
> ---- dataframe::tests::test_df_unpivot stdout ----
> SparkSession Setup
> thread 'dataframe::tests::test_df_unpivot' panicked at
> crates/connect/src/dataframe.rs:2463:9:
> assertion `left == right` failed
> left: RecordBatch { schema: Schema { fields: [Field { name: "id",
> data_type: Int64, nullable: false, dict_id: 0, dict_is_ordered: false,
> metadata: {} }, Field { name: "var", data_type: Utf8, nullable: false,
> dict_id: 0, dict_is_ordered: false, metadata: {} }, Field { name: "val",
> data_type: Float32, nullable: false, dict_id: 0, dict_is_ordered: false,
> metadata: {} }], metadata: {} }, columns: [PrimitiveArray<Int64>
> [
> 1,
> 1,
> 2,
> 2,
> ], StringArray
> [
> "int",
> "float",
> "int",
> "float",
> ], PrimitiveArray<Float32>
> [
> 11.0,
> 1.1,
> 12.0,
> 1.2,
> ]], row_count: 4 }
> right: RecordBatch { schema: Schema { fields: [Field { name: "id",
> data_type: Int64, nullable: false, dict_id: 0, dict_is_ordered: false,
> metadata: {} }, Field { name: "var", data_type: Utf8, nullable: false,
> dict_id: 0, dict_is_ordered: false, metadata: {} }, Field { name: "val",
> data_type: Float64, nullable: false, dict_id: 0, dict_is_ordered: false,
> metadata: {} }], metadata: {} }, columns: [PrimitiveArray<Int64>
> [
> 1,
> 1,
> 2,
> 2,
> ], StringArray
> [
> "int",
> "float",
> "int",
> "float",
> ], PrimitiveArray<Float64>
> [
> 11.0,
> 1.100000023841858,
> 12.0,
> 1.2000000476837158,
> ]], row_count: 4 }
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
