How to provide the multiple avro inputs to Two avroMappers and same mapper
outputs to single avroReducer.
written code for single input to one avroMappers and same mapper outputs to
single avroReducer.
import java.io.File;
import java.io.IOException;
import org.apache.avro.Schema;
import
Leo Romanoff created AVRO-1277:
--
Summary: Improve performance of reflection-based serializers
Key: AVRO-1277
URL: https://issues.apache.org/jira/browse/AVRO-1277
Project: Avro
Issue Type:
[
https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609140#comment-13609140
]
Doug Cutting commented on AVRO-1268:
Another way we might implement this is to use the
[
https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609155#comment-13609155
]
Alexandre Normand commented on AVRO-1268:
-
I'm close to having the parallel tree
[
https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609175#comment-13609175
]
Leo Romanoff commented on AVRO-1277:
I attach a first version of my patch. It is just
[
https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609207#comment-13609207
]
Doug Cutting commented on AVRO-1277:
This looks like great stuff! Some comments:
-
[
https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609215#comment-13609215
]
Doug Cutting commented on AVRO-1268:
It would be interesting to see if the caching
[
https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609222#comment-13609222
]
Doug Cutting commented on AVRO-1268:
I can take a stab at the parser-based solution if
[
https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609229#comment-13609229
]
Doug Cutting commented on AVRO-1277:
Holger, such problems can be avoided by making the
[
https://issues.apache.org/jira/browse/AVRO-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609230#comment-13609230
]
Tom White commented on AVRO-1274:
-
nullable with null default, nullable with no default,
[
https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609240#comment-13609240
]
Alexandre Normand commented on AVRO-1268:
-
Regarding AVRO-1277, I've been following
[
https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609281#comment-13609281
]
Leo Romanoff commented on AVRO-1277:
@Doug:
1) If I add a test to Perf.java, I cannot
[
https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609293#comment-13609293
]
Doug Cutting commented on AVRO-1277:
# Yes, the standard approach is to run tests from
Carl Steinbach created AVRO-1278:
Summary: Avro-C: Error parsing schema with fixed field default
value
Key: AVRO-1278
URL: https://issues.apache.org/jira/browse/AVRO-1278
Project: Avro
[
https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609297#comment-13609297
]
Leo Romanoff commented on AVRO-1277:
BTW, regarding the use of ThreadLocals:
I think
[
https://issues.apache.org/jira/browse/AVRO-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609304#comment-13609304
]
Carl Steinbach commented on AVRO-1278:
--
I observed the following behavior using Avro
[
https://issues.apache.org/jira/browse/AVRO-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Steinbach updated AVRO-1278:
-
Attachment: ComplexTypes.avro
Avro-C: Error parsing schema with fixed field default value
Carl Steinbach created AVRO-1279:
Summary: Avro-C: file_read_header() segfaults when avro.codec is
not defined
Key: AVRO-1279
URL: https://issues.apache.org/jira/browse/AVRO-1279
Project: Avro
[
https://issues.apache.org/jira/browse/AVRO-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Steinbach reassigned AVRO-1279:
Assignee: Carl Steinbach
Avro-C: file_read_header() segfaults when avro.codec is not
[
https://issues.apache.org/jira/browse/AVRO-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609325#comment-13609325
]
Carl Steinbach commented on AVRO-1279:
--
I observed the following behavior while using
[
https://issues.apache.org/jira/browse/AVRO-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609326#comment-13609326
]
Doug Cutting commented on AVRO-1277:
The ReflectDatumReader is a context here. The
[
https://issues.apache.org/jira/browse/AVRO-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Steinbach reassigned AVRO-1278:
Assignee: Carl Steinbach
Avro-C: Error parsing schema with fixed field default value
[
https://issues.apache.org/jira/browse/AVRO-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on AVRO-1278 started by Carl Steinbach.
Avro-C: Error parsing schema with fixed field default value
---
[
https://issues.apache.org/jira/browse/AVRO-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Steinbach updated AVRO-1279:
-
Attachment: PrimitiveTypesNoCodec.avro
PrimitiveTypes.avro
Avro-C:
[
https://issues.apache.org/jira/browse/AVRO-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on AVRO-1278 stopped by Carl Steinbach.
Avro-C: Error parsing schema with fixed field default value
---
Carl Steinbach created AVRO-1280:
Summary: Avro-C: Missing error checks in avro_schema_* functions
Key: AVRO-1280
URL: https://issues.apache.org/jira/browse/AVRO-1280
Project: Avro
Issue
Carl Steinbach created AVRO-1281:
Summary: DataFileWriter should default to using the null codec
Key: AVRO-1281
URL: https://issues.apache.org/jira/browse/AVRO-1281
Project: Avro
Issue Type:
[
https://issues.apache.org/jira/browse/AVRO-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609359#comment-13609359
]
Carl Steinbach commented on AVRO-1281:
--
According to the Avro spec the header metadata
[
https://issues.apache.org/jira/browse/AVRO-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13609486#comment-13609486
]
Alexandre Normand commented on AVRO-1268:
-
I've hit a snag. The parallel tree
29 matches
Mail list logo