Thanks for replying. You are correct. I followed this example
https://gist.github.com/QwertyManiac/4724582
--
View this message in context:
http://apache-avro.679487.n3.nabble.com/Is-it-possible-to-append-to-an-already-existing-avro-file-tp3762049p4027789.html
Sent from the Avro - Users
pler.datasink.hdfs.HDFSDataSinkChangesTest.javadocExampleTest(HDFSDataSinkChangesTest.java:645)
>
> So, is the avro writer it not able to locate the file on hdfs? Could you
> please share some pointers what could be leading to this?
>
>
>
> --
> View this message in conte
s what could be leading to this?
--
View this message in context:
http://apache-avro.679487.n3.nabble.com/Is-it-possible-to-append-to-an-already-existing-avro-file-tp3762049p4027785.html
Sent from the Avro - Users mailing list archive at Nabble.com.
ng that code to AVRO-1035, in the hopes that someone will
>>> come up with an interface that requires just one line of user code to
>>> achieve append.
>>>
>>> --- On Wed, 2/6/13, Harsh J wrote:
>>>
>>>> From: Harsh J
>>>> Su
that code to AVRO-1035, in the hopes that someone will
>> come up with an interface that requires just one line of user code to
>> achieve append.
>>
>> --- On Wed, 2/6/13, Harsh J wrote:
>>
>>> From: Harsh J
>>> Subject: Re: Is it possible to ap
/7/13, Harsh J wrote:
> From: Harsh J
> Subject: Re: Is it possible to append to an already existing avro file
> To: user@avro.apache.org
> Date: Thursday, February 7, 2013, 9:28 AM
> I assume by non-trivial you meant the
> extra Seekable stuff I needed to
> wrap around the DFS
someone will come
> up with an interface that requires just one line of user code to achieve
> append.
>
> --- On Wed, 2/6/13, Harsh J wrote:
>
>> From: Harsh J
>> Subject: Re: Is it possible to append to an already existing avro file
>> To: user@avro.apache.org
>
/13, Harsh J wrote:
> From: Harsh J
> Subject: Re: Is it possible to append to an already existing avro file
> To: user@avro.apache.org
> Date: Wednesday, February 6, 2013, 11:17 AM
> Hey Michael,
>
> It does implement the regular Java OutputStream interface,
> as se
n Wed, Feb 6, 2013 at 9:00 AM, Michael Malak wrote:
> I don't believe a Hadoop FileSystem is a Java OutputStream?
>
> --- On Tue, 2/5/13, Doug Cutting wrote:
>
>> From: Doug Cutting
>> Subject: Re: Is it possible to append to an already existing avro file
>> T
I don't believe a Hadoop FileSystem is a Java OutputStream?
--- On Tue, 2/5/13, Doug Cutting wrote:
> From: Doug Cutting
> Subject: Re: Is it possible to append to an already existing avro file
> To: user@avro.apache.org
> Date: Tuesday, February 5, 2013, 5:27 PM
>
end to a file on the local filesystem, but
> not to a file on HDFS.
>
> --- On Tue, 2/5/13, Doug Cutting wrote:
>
>> From: Doug Cutting
>> Subject: Re: Is it possible to append to an already existing avro file
>> To: user@avro.apache.org
>> Date: Tuesday, F
My understanding is that will append to a file on the local filesystem, but not
to a file on HDFS.
--- On Tue, 2/5/13, Doug Cutting wrote:
> From: Doug Cutting
> Subject: Re: Is it possible to append to an already existing avro file
> To: user@avro.apache.org
> Date: Tuesday, Febr
.
>>>
>>>> Thanks,
>>>> Vyacheslav
>>>>
>>>> On Feb 21, 2012, at 5:29 AM, Harsh J wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> Use the appendTo feature of the DataFileWriter. See
>>>>
To feature of the DataFileWriter. See
>>>>
>>>> http://avro.apache.org/docs/1.6.2/api/java/org/apache/avro/file/DataFileWriter.html#appendTo(java.io.File)
>>>>
>>>> For a quick setup example, read also:
>>>>
>>>> http://stac
org/apache/avro/file/DataFileW
>>> riter.html#appendTo(java.io.File)
>>>
>>> For a quick setup example, read also:
>>>
>>> http://stackoverflow.com/questions/8806689/can-you-append-data-to-an-exis
>>> ting-avro-data-file
>>>
&
dTo(java.io.File)
>>
>> For a quick setup example, read also:
>>
>>http://stackoverflow.com/questions/8806689/can-you-append-data-to-an-exis
>>ting-avro-data-file
>>
>> On Tue, Feb 21, 2012 at 3:15 AM, Vyacheslav Zholudev
>> wrote:
>>> Hi,
>&g
etup example, read also:
> http://stackoverflow.com/questions/8806689/can-you-append-data-to-an-existing-avro-data-file
>
> On Tue, Feb 21, 2012 at 3:15 AM, Vyacheslav Zholudev
> wrote:
>> Hi,
>>
>> is it possible to append to an already existing avro file when
On Tue, Feb 21, 2012 at 3:15 AM, Vyacheslav Zholudev
wrote:
> Hi,
>
> is it possible to append to an already existing avro file when it was
> written and closed before?
>
> If I use
> outputStream = fs.append(avroFilePath);
>
> then later on I get: java.io.IOException:
Hi,
is it possible to append to an already existing avro file when it was written
and closed before?
If I use
outputStream = fs.append(avroFilePath);
then later on I get: java.io.IOException: Invalid sync!
Probably because the schema is written twice and some other issues.
If I use
19 matches
Mail list logo
