[
https://issues.apache.org/jira/browse/HDDS-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang resolved HDDS-7501.
-----------------------------------
Fix Version/s: (was: 1.2.1)
Resolution: Duplicate
> Spark 3.2.2 and Ozone integration
> ---------------------------------
>
> Key: HDDS-7501
> URL: https://issues.apache.org/jira/browse/HDDS-7501
> Project: Apache Ozone
> Issue Type: Bug
> Affects Versions: 1.2.1
> Environment: * spark 3.2.2
> * hadoop 3.1.2
> * ozone 1.2.1
> Reporter: Dmitry Kravchuk
> Priority: Major
> Labels: spark
> Attachments: pyspark_ozone_1.txt
>
>
> We've integrated Ozone with HDFS and everything works fine from the shell -
> it's possible to use hdfs dfs -ls command for ozone filies.
> When we're trying to read files with spark it fails with strange error of
> class incomplitance.
> {code:java}
> org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos$OMRequest
> cannot be cast to org.apache.hadoop.shaded.com.google.protobuf.Message{code}
> Application log is attached.[^pyspark_ozone_1.txt]
> Can you please help?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
