[jira] [Commented] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception
[
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879151#comment-15879151
]
Shivram Mani commented on HAWQ-1346:
Awesome. Feel free to submit a pull request. There is value in adding a new
profile using LineRecordReader for other default FS implementations.
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
> Issue Type: Bug
> Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Shivram Mani
>Priority: Critical
>
> In
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
> return (DFSInputStream) (fileIn.getWrappedStream());
> }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException:
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception
[
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877371#comment-15877371
]
Tian Hong Wang commented on HAWQ-1346:
--
[~shivram]
Thanks for your great help. I know how to change it.
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
> Issue Type: Bug
> Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Shivram Mani
>Priority: Critical
>
> In
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
> return (DFSInputStream) (fileIn.getWrappedStream());
> }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException:
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception
[
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877291#comment-15877291
]
Tian Hong Wang commented on HAWQ-1346:
--
[~shivram]
Thanks for your help. Could you tell me how to configure pxf profile to enable
LineBreakAccessor?
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
> Issue Type: Bug
> Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Shivram Mani
>Priority: Critical
>
> In
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
> return (DFSInputStream) (fileIn.getWrappedStream());
> }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException:
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception
[
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876624#comment-15876624
]
Shivram Mani commented on HAWQ-1346:
ChunkRecordReader was introduced to to improve performance in accessing text
files. This reader uses DFSInputStream for performance reasons and hence
wouldn't allow you to use HTTPFSFileSystem or WebHdfsFileSystem as the
defaultFS.
You can introduce a new PXF profile that uses an Accessor similar to
LineBreakAccessor which uses LineRecordReader instead of ChunkRecordReader.
LineRecordReader doesn't impose this restriction and should work with
WebHdfsFileSystem(we used to use this in the earlier version of PXF). The only
negative is that you will not get the same optimized performance as you get
with the ChunkRecordReader.
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
> Issue Type: Bug
> Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Shivram Mani
>Priority: Critical
>
> In
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
> return (DFSInputStream) (fileIn.getWrappedStream());
> }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException:
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception
[
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875586#comment-15875586
]
Tian Hong Wang commented on HAWQ-1346:
--
[~shivram]
Could you help me to have a look at this issue? Thanks.
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
> Issue Type: Bug
> Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Shivram Mani
>Priority: Critical
>
> In
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
> return (DFSInputStream) (fileIn.getWrappedStream());
> }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException:
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception
[
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875275#comment-15875275
]
Tian Hong Wang commented on HAWQ-1346:
--
Does hawq pxf support WebHdfsFileSystem now?
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
> Issue Type: Bug
> Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Ed Espino
>Priority: Critical
>
> In
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
> return (DFSInputStream) (fileIn.getWrappedStream());
> }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException:
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
