[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-09-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13449730#comment-13449730 ] Doug Cutting commented on AVRO-806: --- Also, Jakob, I may have overstated things a bit

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-09-05 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13448632#comment-13448632 ] Tom White commented on AVRO-806: +1 for option (1) add a column-major

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-09-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13449239#comment-13449239 ] Doug Cutting commented on AVRO-806: --- Raymie, putting the code in Avro's lang/java

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-09-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13449248#comment-13449248 ] Doug Cutting commented on AVRO-806: --- Raymie said: ... the Thrift and Protocol Buffer

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-09-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13449265#comment-13449265 ] Doug Cutting commented on AVRO-806: --- Jakob, I think the more common case will be that

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-09-04 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13448159#comment-13448159 ] Jakob Homan commented on AVRO-806: -- (1) sounds good. I'm curious about the decision to

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-09-04 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13448281#comment-13448281 ] Jakob Homan commented on AVRO-806: -- Yes, that's all reasonable. My concern is just

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-08-31 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13446228#comment-13446228 ] Doug Cutting commented on AVRO-806: --- I'd like to bring the Trevni

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-08-31 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13446273#comment-13446273 ] Scott Carey commented on AVRO-806: -- I think (1) is the best way to start. We could easily

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-05-03 Thread alex gemini (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13267317#comment-13267317 ] alex gemini commented on AVRO-806: -- 1.the file header should have some extra space in case

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-05-03 Thread alex gemini (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13267465#comment-13267465 ] alex gemini commented on AVRO-806: -- compression always treat everything as raw

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-05-02 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13267017#comment-13267017 ] Jakob Homan commented on AVRO-806: -- The Avro Serde already exists:

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-04-27 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13263424#comment-13263424 ] Doug Cutting commented on AVRO-806: --- Raymie, thanks for your thoughts. I agree that

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-04-24 Thread Raymie Stata (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13260732#comment-13260732 ] Raymie Stata commented on AVRO-806: --- This is the second attempt at a column-major codec.

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2012-04-18 Thread Doug Cutting (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13257077#comment-13257077 ] Doug Cutting commented on AVRO-806: --- I've implemented a new column-file format at:

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2011-07-22 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13069700#comment-13069700 ] Jeff Hammerbacher commented on AVRO-806: In addition to RCFile, it's also worth

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2011-06-30 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13058098#comment-13058098 ] Doug Cutting commented on AVRO-806: --- I think we should make unions columnar as well.

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2011-06-21 Thread Scott Carey (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13052721#comment-13052721 ] Scott Carey commented on AVRO-806: -- {quote} For now, unions have a single column,

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2011-04-20 Thread Douglas Creager (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13022253#comment-13022253 ] Douglas Creager commented on AVRO-806: -- Avro's formalism is a bit different than

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2011-04-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13022375#comment-13022375 ] Alejandro Abdelnur commented on AVRO-806: - Could we god simple at first? I.e.,

[jira] [Commented] (AVRO-806) add a column-major codec for data files

2011-04-19 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13021858#comment-13021858 ] Doug Cutting commented on AVRO-806: --- The writer would keep a buffer per field. As records