Hi
We're seeing exceptions when closing a FSDataInputStream. I'm not sure
how to interpret the exception. Is there anything that can be done to
avoid it?
Cheers,
-Kristoffer
[2016-07-29 09:28:20,162] ERROR Error closing
hdfs://hdpcluster/tmp/kafka-connect/logs/sting_actions_inscr
Solved by declare an empty somemethod() in FSInputStream and override it in
DFSInputStream
--
Nan Zhu
School of Computer Science,
McGill University
On Saturday, December 14, 2013 at 7:53 PM, Nan Zhu wrote:
> Hi, all
>
> I’m modifying FSDataInputStream for some project,
Hi, all
I’m modifying FSDataInputStream for some project,
I would like to directly manipulate “in" object in my implementation
as in the constructor a DFSInputStream is passed, so I convert “in” from
InputStream to DFSInputStream with
import org.apache.hadoop.hdfs.DFSC
I'm assuming that these methods exist to improve performance of certain I/O
patterns, but the API doc doesn't explain when one would use them. Our
software's I/O pattern is mostly sequential I/O in large buffers (e.g. 256k).
Would one set these differently for local block I/O vs remote block I
Ted,
Thanks, I see it now. Sorry for the bother... I must be too tired or something
;-)
John
From: Ted Yu [mailto:yuzhih...@gmail.com]
Sent: Tuesday, November 12, 2013 4:15 PM
To: common-u...@hadoop.apache.org
Subject: Re: Two questions about FSDataInputStream
For #1, I see the following in
:
> First, this documentation:
> http://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/FSDataInputStream.html
>
> claims that FSDataInputStream has a seek() method, but javap doesn’t show
> one:
>
> $ javap -classpath [haddoopjars] org.apache.hadoop.fs.FSDataInputStr
First, this documentation:
http://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/FSDataInputStream.html
claims that FSDataInputStream has a seek() method, but javap doesn't show one:
$ javap -classpath [haddoopjars] org.apache.hadoop.fs.FSDataInputStream
Compiled
