viirya commented on PR #54302: URL: https://github.com/apache/spark/pull/54302#issuecomment-3894781381
Okay. branch-3.5 also has this issue. ``` [info] - SPARK-55492: watermark on nested struct field *** FAILED *** (10 milliseconds) [info] java.lang.IllegalStateException: Failed to copy node. [info] Is otherCopyArgs specified correctly for EventTimeWatermark. [info] Exception message: java.lang.ClassCastException@7620d01e [info] ctor: public org.apache.spark.sql.catalyst.plans.logical.EventTimeWatermark(org.apache.spark.sql.catalyst.expressions.Attribute,org.apache.spark.unsafe.types.CalendarInterval,org.apache.spark.sql.catalyst.plans.logical.LogicalPlan)? [info] types: class org.apache.spark.sql.catalyst.expressions.Alias, class org.apache.spark.unsafe.types.CalendarInterval, class org.apache.spark.sql.catalyst.plans.logical.Project [info] args: kolona#284795.timestamp AS timestamp#284798, 0 seconds, Project [id#284789, nested_struct#284792 AS kolona#284795] [info] +- Project [value#284787 AS id#284789, struct(timestamp, timestamp_seconds(value#284787), value, cast(value#284787 as string)) AS nested_struct#284792] [info] +- StreamingRelationV2 org.apache.spark.sql.execution.streaming.MemoryStreamTableProvider$@50461597, memory, org.apache.spark.sql.execution.streaming.MemoryStreamTable@31f6a2fd, [], [value#284787] ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
