Echo,
Just to make sure I understand you correctly - do you have a file with
multiple Avro datums in it, each one following a separate schema? And are
all of these schemas unioned together in a file-level "master schema?" (As
far as I know, Avro file readers and writers only support one schema per
file, so this is the only way your question makes sense to me.)
If that's the case, then you can get the file's "master schema" and
determine what all of the different types are:
List<Schema> allTypes = masterSchema.getTypes(); // Assumes masterSchema is
of Type.UNION
Then when you read each Avro datum in the file, you can check which of the
schemas it conforms to, and write a new file with just that sub-schema and
the one datum in it.
Does that make sense?
Mike
On Tue, Jul 22, 2014 at 3:22 PM, Lewis John Mcgibbney <
[email protected]> wrote:
> For the purpose of others on this list, can ytou please provide an example
> of your schema?
> Thanks
> Lewis
>
>
> On Tue, Jul 22, 2014 at 12:06 PM, Echo Li <[email protected]> wrote:
>
>> Hello,
>>
>> I'm new here, hope I can get help from you guys. Basically I have an avro
>> file with union/many schemas and mixed records. I will need to split it to
>> many avro file, one schema per file. All the stuff I've been reading is
>> about serializing and deserializing avro file with one schema, which is
>> pretty straightforward, but in my case I have no clue, any ideas?
>>
>
>
>
> --
> *Lewis*
>
