[
https://issues.apache.org/jira/browse/BAHIR-75?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773972#comment-15773972
]
ASF GitHub Bot commented on BAHIR-75:
-------------------------------------
Github user sourav-mazumder commented on the issue:
https://github.com/apache/bahir/pull/27
This is now addressed in PR # 28. The new approach uses implementation of
Hadoop File System which can be accessed from Spark using custom file system
uri by setting SparkContext.hadoopConfiguration. This new approach can be used
in a generic way for any type of file format (csv, json, et.) without any file
format specific code.
> WebHDFS: Initial Code Delivery
> ------------------------------
>
> Key: BAHIR-75
> URL: https://issues.apache.org/jira/browse/BAHIR-75
> Project: Bahir
> Issue Type: Sub-task
> Components: Spark SQL Data Sources
> Reporter: Sourav Mazumder
> Original Estimate: 504h
> Remaining Estimate: 504h
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)