How to provide the multiple avro inputs to Two avroMappers and same mapper outputs to single avroReducer.

2013-03-21 Thread rajharireddy
How to provide the multiple avro inputs to Two avroMappers and same mapper outputs to single avroReducer. written code for single input to one avroMappers and same mapper outputs to single avroReducer. import java.io.File; import java.io.IOException; import org.apache.avro.Schema; import

[jira] [Created] (AVRO-1277) Improve performance of reflection-based serializers

2013-03-21 Thread Leo Romanoff (JIRA)
Leo Romanoff created AVRO-1277: -- Summary: Improve performance of reflection-based serializers Key: AVRO-1277 URL: https://issues.apache.org/jira/browse/AVRO-1277 Project: Avro Issue Type:

[jira] [Commented] (AVRO-1268) Add java-class, java-key-class and java-element-class support for stringable types to SpecificData

2013-03-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609140#comment-13609140 ] Doug Cutting commented on AVRO-1268: Another way we might implement this is to use the

[jira] [Commented] (AVRO-1268) Add java-class, java-key-class and java-element-class support for stringable types to SpecificData

2013-03-21 Thread Alexandre Normand (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609155#comment-13609155 ] Alexandre Normand commented on AVRO-1268: - I'm close to having the parallel tree

[jira] [Commented] (AVRO-1277) Improve performance of reflection-based serializers

2013-03-21 Thread Leo Romanoff (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609175#comment-13609175 ] Leo Romanoff commented on AVRO-1277: I attach a first version of my patch. It is just

[jira] [Commented] (AVRO-1277) Improve performance of reflection-based serializers

2013-03-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609207#comment-13609207 ] Doug Cutting commented on AVRO-1277: This looks like great stuff! Some comments: -

[jira] [Commented] (AVRO-1268) Add java-class, java-key-class and java-element-class support for stringable types to SpecificData

2013-03-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609215#comment-13609215 ] Doug Cutting commented on AVRO-1268: It would be interesting to see if the caching

[jira] [Commented] (AVRO-1268) Add java-class, java-key-class and java-element-class support for stringable types to SpecificData

2013-03-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609222#comment-13609222 ] Doug Cutting commented on AVRO-1268: I can take a stab at the parser-based solution if

[jira] [Commented] (AVRO-1277) Improve performance of reflection-based serializers

2013-03-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609229#comment-13609229 ] Doug Cutting commented on AVRO-1277: Holger, such problems can be avoided by making the

[jira] [Commented] (AVRO-1274) Add a schema builder API

2013-03-21 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609230#comment-13609230 ] Tom White commented on AVRO-1274: - nullable with null default, nullable with no default,

[jira] [Commented] (AVRO-1268) Add java-class, java-key-class and java-element-class support for stringable types to SpecificData

2013-03-21 Thread Alexandre Normand (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609240#comment-13609240 ] Alexandre Normand commented on AVRO-1268: - Regarding AVRO-1277, I've been following

[jira] [Commented] (AVRO-1277) Improve performance of reflection-based serializers

2013-03-21 Thread Leo Romanoff (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609281#comment-13609281 ] Leo Romanoff commented on AVRO-1277: @Doug: 1) If I add a test to Perf.java, I cannot

[jira] [Commented] (AVRO-1277) Improve performance of reflection-based serializers

2013-03-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609293#comment-13609293 ] Doug Cutting commented on AVRO-1277: # Yes, the standard approach is to run tests from

[jira] [Created] (AVRO-1278) Avro-C: Error parsing schema with fixed field default value

2013-03-21 Thread Carl Steinbach (JIRA)
Carl Steinbach created AVRO-1278: Summary: Avro-C: Error parsing schema with fixed field default value Key: AVRO-1278 URL: https://issues.apache.org/jira/browse/AVRO-1278 Project: Avro

[jira] [Commented] (AVRO-1277) Improve performance of reflection-based serializers

2013-03-21 Thread Leo Romanoff (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609297#comment-13609297 ] Leo Romanoff commented on AVRO-1277: BTW, regarding the use of ThreadLocals: I think

[jira] [Commented] (AVRO-1278) Avro-C: Error parsing schema with fixed field default value

2013-03-21 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609304#comment-13609304 ] Carl Steinbach commented on AVRO-1278: -- I observed the following behavior using Avro

[jira] [Updated] (AVRO-1278) Avro-C: Error parsing schema with fixed field default value

2013-03-21 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated AVRO-1278: - Attachment: ComplexTypes.avro Avro-C: Error parsing schema with fixed field default value

[jira] [Created] (AVRO-1279) Avro-C: file_read_header() segfaults when avro.codec is not defined

2013-03-21 Thread Carl Steinbach (JIRA)
Carl Steinbach created AVRO-1279: Summary: Avro-C: file_read_header() segfaults when avro.codec is not defined Key: AVRO-1279 URL: https://issues.apache.org/jira/browse/AVRO-1279 Project: Avro

[jira] [Assigned] (AVRO-1279) Avro-C: file_read_header() segfaults when avro.codec is not defined

2013-03-21 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach reassigned AVRO-1279: Assignee: Carl Steinbach Avro-C: file_read_header() segfaults when avro.codec is not

[jira] [Commented] (AVRO-1279) Avro-C: file_read_header() segfaults when avro.codec is not defined

2013-03-21 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609325#comment-13609325 ] Carl Steinbach commented on AVRO-1279: -- I observed the following behavior while using

[jira] [Commented] (AVRO-1277) Improve performance of reflection-based serializers

2013-03-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609326#comment-13609326 ] Doug Cutting commented on AVRO-1277: The ReflectDatumReader is a context here. The

[jira] [Assigned] (AVRO-1278) Avro-C: Error parsing schema with fixed field default value

2013-03-21 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach reassigned AVRO-1278: Assignee: Carl Steinbach Avro-C: Error parsing schema with fixed field default value

[jira] [Work started] (AVRO-1278) Avro-C: Error parsing schema with fixed field default value

2013-03-21 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AVRO-1278 started by Carl Steinbach. Avro-C: Error parsing schema with fixed field default value ---

[jira] [Updated] (AVRO-1279) Avro-C: file_read_header() segfaults when avro.codec is not defined

2013-03-21 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated AVRO-1279: - Attachment: PrimitiveTypesNoCodec.avro PrimitiveTypes.avro Avro-C:

[jira] [Work stopped] (AVRO-1278) Avro-C: Error parsing schema with fixed field default value

2013-03-21 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AVRO-1278 stopped by Carl Steinbach. Avro-C: Error parsing schema with fixed field default value ---

[jira] [Created] (AVRO-1280) Avro-C: Missing error checks in avro_schema_* functions

2013-03-21 Thread Carl Steinbach (JIRA)
Carl Steinbach created AVRO-1280: Summary: Avro-C: Missing error checks in avro_schema_* functions Key: AVRO-1280 URL: https://issues.apache.org/jira/browse/AVRO-1280 Project: Avro Issue

[jira] [Created] (AVRO-1281) DataFileWriter should default to using the null codec

2013-03-21 Thread Carl Steinbach (JIRA)
Carl Steinbach created AVRO-1281: Summary: DataFileWriter should default to using the null codec Key: AVRO-1281 URL: https://issues.apache.org/jira/browse/AVRO-1281 Project: Avro Issue Type:

[jira] [Commented] (AVRO-1281) DataFileWriter should default to using the null codec

2013-03-21 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609359#comment-13609359 ] Carl Steinbach commented on AVRO-1281: -- According to the Avro spec the header metadata

[jira] [Commented] (AVRO-1268) Add java-class, java-key-class and java-element-class support for stringable types to SpecificData

2013-03-21 Thread Alexandre Normand (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609486#comment-13609486 ] Alexandre Normand commented on AVRO-1268: - I've hit a snag. The parallel tree