Mohit Sabharwal created PIG-4585:
------------------------------------
Summary: Use newAPIHadoopRDD instead of newAPIHadoopFile
Key: PIG-4585
URL: https://issues.apache.org/jira/browse/PIG-4585
Project: Pig
Issue Type: Sub-task
Components: spark
Affects Versions: spark-branch
Reporter: Mohit Sabharwal
Assignee: Mohit Sabharwal
Fix For: spark-branch
LoadConverter currently uses SparkContext.newAPIHadoopFile which won't work for
non-filesystem based input sources, like HBase.
newAPIHadoopFile assumes a FileInputFormat and attempts to
[verify|https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SparkContext.scala#L1065]
this in the constructor, which fails for HBaseTableInputFormat (which is not a
FileInputFormat)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
