[
https://issues.apache.org/jira/browse/BEAM-10969?focusedWorklogId=492321&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-492321
]
ASF GitHub Bot logged work on BEAM-10969:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Sep/20 08:05
Start Date: 29/Sep/20 08:05
Worklog Time Spent: 10m
Work Description: iemejia commented on pull request #12937:
URL: https://github.com/apache/beam/pull/12937#issuecomment-700525027
@echauchot The exceptions with Structured Streaming runner seems too weird,
it is like if Spark was generating invalid code. I doubt that this is an issue
in the runner translation, but maybe we need to double check. maybe you have a
different insight?
```
Caused by: java.lang.IllegalAccessError:
org/apache/beam/sdk/transforms/GroupByKeyTest$BadEqualityKey
at
org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection.apply(Unknown
Source)
at
org.apache.spark.sql.execution.ObjectOperator$$anonfun$serializeObjectToRow$1.apply(objects.scala:155)
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 492321)
Time Spent: 3h (was: 2h 50m)
> Upgrade Spark to version 2.4.7
> ------------------------------
>
> Key: BEAM-10969
> URL: https://issues.apache.org/jira/browse/BEAM-10969
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Ismaël Mejía
> Assignee: Ismaël Mejía
> Priority: P3
> Time Spent: 3h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
