Dmitry Kravchuk created HDDS-7501:
-------------------------------------
Summary: Spark 3.2.2 and Ozone integration
Key: HDDS-7501
URL: https://issues.apache.org/jira/browse/HDDS-7501
Project: Apache Ozone
Issue Type: Bug
Affects Versions: 1.2.1
Environment: * spark 3.2.2
* hadoop 3.1.2
* ozone 1.2.1
Reporter: Dmitry Kravchuk
Fix For: 1.2.1
Attachments: pyspark_ozone_1.txt
We've integrated Ozone with HDFS and everything works fine from the shell -
it's possible to use hdfs dfs -ls command for ozone filies.
When we're trying to read files with spark it fails with strange error of class
incomplitance.
{code:java}
org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos$OMRequest
cannot be cast to org.apache.hadoop.shaded.com.google.protobuf.Message{code}
Application log is attached.[^pyspark_ozone_1.txt]
Can you please help?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
