Hi Doug,
You are right, the code does compile with javac. Apparently it is some
maven error, where it doesn't like to compile package-less files.
Having said that, I still have the issue of not being able to use these
java files in my code, because there is no way to import them. One thing I
tried
Using the current trunk of Avro I am able to:
- extract the schema from the data file you provided (using
avro-tools schema command)
- generate Java classes for this schema (using the avro-tools compile command)
- compile these generated Java classes (using the javac command)
Can you provide a
There's no plan I know of to add this.
Avro's original file format wrote metadata at the end of the file.
This was changed in Avro 1.3 so that files could always be processed
sequentially, without seeking to the end.
Doug
On Wed, Oct 9, 2013 at 5:08 PM, Venkat wrote:
> Hi All
>
> Does Avro file
Hi All
Does Avro file format support storing some json metadata at the end of the file
(footer)? Currently, the header stores schema in json enabling consumers to
augment it with application specific info. But I'm not sure if there is a way
consumer can store specific metadata at the end of the
Does anyone else might have an idea how I can resolve this "namespace-less"
Avro schema code generation?
Thanks,
Vitaly
On Mon, Oct 7, 2013 at 2:04 PM, Vitaly Gordon wrote:
> Hi Sean,
> Here is a file that contains a single record that I cannot read using a
> specific reader.
>
> It's hard for
DataFileWriter#append() is not synchronized. If you have multiple
threads appending to the same file then you must synchronize. For
example:
synchronized (writer) { writer.append(value); }
Doug
On Wed, Oct 9, 2013 at 4:16 AM, David Ginzburg wrote:
> Hi,
> I am writing a kafka consumer that
The IDL compiler accepts any Java identifier as a property name, plus
dash-separated sequences of Java identifiers. Dashes were added to
support things like the java-class property. We could probably extend
this to include dots too. If you need this, please file an issue in
Jira.
Doug
On Wed,
hi all,
am I right in guessing that you cannot use any old string to as a property
name in the idl? for example, the avro.java.string property that
GenericData itself relies on is not something that
you could specify in the IDL as it's not a valid Identifier?
Hi,
I am writing a kafka consumer that persists messages into avro record files.
The consumer is a threaded application, but it is unclear to me if
DataFileWriter is thread safe, or I need to add some synchronization
code when appending messages ?
