Michael Nazario created SPARK-5978:
--------------------------------------
Summary: Spark examples cannot compile with Hadoop 2
Key: SPARK-5978
URL: https://issues.apache.org/jira/browse/SPARK-5978
Project: Spark
Issue Type: Bug
Components: Examples, PySpark
Affects Versions: 1.2.1, 1.2.0
Reporter: Michael Nazario
This is a regression from Spark 1.1.1.
The Spark Examples includes an example for an avro converter for PySpark. When
I was trying to debug a problem, I discovered that even though you can build
with Hadoop 2 for Spark 1.2.0, an hbase dependency depends on Hadoop 1
somewhere else in the examples code.
An easy fix would be to separate the examples into hadoop specific versions.
Another way would be to fix the hbase dependencies so that they don't rely on
hadoop 1 specific code.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
