Ronan SY created BEAM-13610:
-------------------------------
Summary: Doesn't work with Spark 3.1.2
Key: BEAM-13610
URL: https://issues.apache.org/jira/browse/BEAM-13610
Project: Beam
Issue Type: Bug
Components: runner-spark
Affects Versions: 2.35.0, 2.34.0
Reporter: Ronan SY
When trying to use Beam with spark 3.1.2 we are running into this issue :
[https://www.mail-archive.com/[email protected]/msg297820.html]
It seems that this issue can be fixed :
=> either by compiling spark & beam with a scala version > 2.12.12
=> either by upgrading the spark version used by beam to 3.2.0
Do you know if the switch to spark 3.2.0 is planned ?
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
