[jira] [Commented] (ARROW-2500) [Java] IPC Writers/readers are not always setting validity bits correctly

2018-04-24 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449781#comment-16449781 ] Emilio Lahr-Vivaz commented on ARROW-2500: -- Note: this didn't seem to occur in 0.6. > [Java] IPC

[jira] [Created] (ARROW-2500) [Java] IPC Writers/readers are not always setting validity bits correctly

2018-04-23 Thread Emilio Lahr-Vivaz (JIRA)
Emilio Lahr-Vivaz created ARROW-2500: Summary: [Java] IPC Writers/readers are not always setting validity bits correctly Key: ARROW-2500 URL: https://issues.apache.org/jira/browse/ARROW-2500

[jira] [Commented] (ARROW-1463) [JAVA] Restructure ValueVector hierarchy to minimize compile-time generated code

2017-09-06 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155303#comment-16155303 ] Emilio Lahr-Vivaz commented on ARROW-1463: -- +1 agree with everything said so far. I'd prefer not

[jira] [Commented] (ARROW-1407) Dictionaries can only hold a maximum of 4096 indices

2017-08-23 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138958#comment-16138958 ] Emilio Lahr-Vivaz commented on ARROW-1407: -- FYI, you don't have to use the DictionaryEncoder

[jira] [Created] (ARROW-1340) [Java] NullableMapVector field doesn't maintain metadata

2017-08-08 Thread Emilio Lahr-Vivaz (JIRA)
Emilio Lahr-Vivaz created ARROW-1340: Summary: [Java] NullableMapVector field doesn't maintain metadata Key: ARROW-1340 URL: https://issues.apache.org/jira/browse/ARROW-1340 Project: Apache Arrow

[jira] [Commented] (ARROW-886) VariableLengthVectors don't reAlloc offsets

2017-08-02 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110778#comment-16110778 ] Emilio Lahr-Vivaz commented on ARROW-886: - That would probably be fine. My use case is: 1. Create

[jira] [Commented] (ARROW-1175) [Java] Implement/test dictionary-encoded subfields

2017-07-03 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072494#comment-16072494 ] Emilio Lahr-Vivaz commented on ARROW-1175: -- Some more details - the important bit is calling

[jira] [Commented] (ARROW-1175) [Java] Implement/test dictionary-encoded subfields

2017-07-03 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072438#comment-16072438 ] Emilio Lahr-Vivaz commented on ARROW-1175: -- Note: I don't think it's directly supported by the

[jira] [Commented] (ARROW-886) VariableLengthVectors don't reAlloc offsets

2017-06-12 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046549#comment-16046549 ] Emilio Lahr-Vivaz commented on ARROW-886: - We are calling it explicitly. In our use case we have a

[jira] [Commented] (ARROW-886) VariableLengthVectors don't reAlloc offsets

2017-06-09 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1604#comment-1604 ] Emilio Lahr-Vivaz commented on ARROW-886: - I forget exactly what scenario led to this being an

[jira] [Commented] (ARROW-1045) [JAVA] Add support for custom metadata in org.apache.arrow.vector.types.pojo.*

2017-05-17 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014551#comment-16014551 ] Emilio Lahr-Vivaz commented on ARROW-1045: -- This might be fixed already by the two linked issues.

[jira] [Commented] (ARROW-994) Arrow is unable to reuse Memory chunk in the Pool.

2017-05-15 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010739#comment-16010739 ] Emilio Lahr-Vivaz commented on ARROW-994: - [~tokendeng] did you determine that this wasn't an

[jira] [Created] (ARROW-1015) [Java] Implement schema-level metadata

2017-05-12 Thread Emilio Lahr-Vivaz (JIRA)
Emilio Lahr-Vivaz created ARROW-1015: Summary: [Java] Implement schema-level metadata Key: ARROW-1015 URL: https://issues.apache.org/jira/browse/ARROW-1015 Project: Apache Arrow Issue

[jira] [Commented] (ARROW-999) [Java] Minor types don't account for nullable FieldType flag

2017-05-10 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005169#comment-16005169 ] Emilio Lahr-Vivaz commented on ARROW-999: - Thanks, maybe I should update this issue to be

[jira] [Updated] (ARROW-999) [Java] Minor types don't account for nullable FieldType flag

2017-05-10 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emilio Lahr-Vivaz updated ARROW-999: Issue Type: Improvement (was: Bug) > [Java] Minor types don't account for nullable

[jira] [Updated] (ARROW-999) [Java] Minor types don't account for nullable FieldType flag

2017-05-10 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emilio Lahr-Vivaz updated ARROW-999: Priority: Minor (was: Major) > [Java] Minor types don't account for nullable FieldType flag

[jira] [Assigned] (ARROW-999) [Java] Minor types don't account for nullable FieldType flag

2017-05-10 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emilio Lahr-Vivaz reassigned ARROW-999: --- Assignee: (was: Emilio Lahr-Vivaz) > [Java] Minor types don't account for

[jira] [Updated] (ARROW-999) [Java] Minor types don't account for nullable FieldType flag

2017-05-10 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emilio Lahr-Vivaz updated ARROW-999: Description: Calling e.g. `FLOAT4.getNewVector("foo", new FieldType(false, ...), ...)"

[jira] [Commented] (ARROW-999) [Java] Minor types don't account for nullable FieldType flag

2017-05-10 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004773#comment-16004773 ] Emilio Lahr-Vivaz commented on ARROW-999: - So it seems from the layout

[jira] [Assigned] (ARROW-999) [Java] Minor types don't account for nullable FieldType flag

2017-05-10 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emilio Lahr-Vivaz reassigned ARROW-999: --- Assignee: Emilio Lahr-Vivaz > [Java] Minor types don't account for nullable FieldType

[jira] [Created] (ARROW-999) [Java] Minor types don't account for nullable FieldType flag

2017-05-10 Thread Emilio Lahr-Vivaz (JIRA)
Emilio Lahr-Vivaz created ARROW-999: --- Summary: [Java] Minor types don't account for nullable FieldType flag Key: ARROW-999 URL: https://issues.apache.org/jira/browse/ARROW-999 Project: Apache Arrow

[jira] [Created] (ARROW-997) [Java] Implement transfer in FixedSizeListVector

2017-05-10 Thread Emilio Lahr-Vivaz (JIRA)
Emilio Lahr-Vivaz created ARROW-997: --- Summary: [Java] Implement transfer in FixedSizeListVector Key: ARROW-997 URL: https://issues.apache.org/jira/browse/ARROW-997 Project: Apache Arrow

[jira] [Commented] (ARROW-855) Arrow Memory Leak

2017-05-09 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16002694#comment-16002694 ] Emilio Lahr-Vivaz commented on ARROW-855: - Won't the buffer allocator hold on to and re-use

[jira] [Commented] (ARROW-482) [Java] Provide API access to "custom_metadata" Field attribute in IPC setting

2017-04-27 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987019#comment-15987019 ] Emilio Lahr-Vivaz commented on ARROW-482: - I'm going to work on this if no one else has claimed it.

[jira] [Assigned] (ARROW-482) [Java] Provide API access to "custom_metadata" Field attribute in IPC setting

2017-04-27 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emilio Lahr-Vivaz reassigned ARROW-482: --- Assignee: Emilio Lahr-Vivaz > [Java] Provide API access to "custom_metadata" Field

[jira] [Created] (ARROW-815) [Java] Allow for expanding underlying buffer size after allocation

2017-04-12 Thread Emilio Lahr-Vivaz (JIRA)
Emilio Lahr-Vivaz created ARROW-815: --- Summary: [Java] Allow for expanding underlying buffer size after allocation Key: ARROW-815 URL: https://issues.apache.org/jira/browse/ARROW-815 Project: Apache

[jira] [Commented] (ARROW-725) [Format] Constant length list type

2017-04-10 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963146#comment-15963146 ] Emilio Lahr-Vivaz commented on ARROW-725: - I'd like to get this into the 0.3 release if possible -

[jira] [Commented] (ARROW-796) [Java] Checkstyle additions causing build failure in some environments

2017-04-10 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962875#comment-15962875 ] Emilio Lahr-Vivaz commented on ARROW-796: - Yeah, I've been using 3.3.9 and didn't have a problem. I

[jira] [Comment Edited] (ARROW-725) [Format] Constant length list type

2017-03-29 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947126#comment-15947126 ] Emilio Lahr-Vivaz edited comment on ARROW-725 at 3/29/17 1:31 PM: -- Should

[jira] [Commented] (ARROW-725) [Format] Constant length list type

2017-03-29 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947126#comment-15947126 ] Emilio Lahr-Vivaz commented on ARROW-725: - Should I make that change as part of adding the list? Or

[jira] [Commented] (ARROW-725) [Format] Constant length list type

2017-03-29 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947105#comment-15947105 ] Emilio Lahr-Vivaz commented on ARROW-725: - Yeah, I'll try to put something up in the next day or

[jira] [Created] (ARROW-691) [Java] Encode dictionary Int type in message format

2017-03-22 Thread Emilio Lahr-Vivaz (JIRA)
Emilio Lahr-Vivaz created ARROW-691: --- Summary: [Java] Encode dictionary Int type in message format Key: ARROW-691 URL: https://issues.apache.org/jira/browse/ARROW-691 Project: Apache Arrow

[jira] [Commented] (ARROW-542) [Java] Implement dictionaries in stream/file encoding

2017-02-09 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860292#comment-15860292 ] Emilio Lahr-Vivaz commented on ARROW-542: - Another blocker I'm hitting is that I don't see any way

[jira] [Commented] (ARROW-542) [Java] Implement dictionaries in stream/file encoding

2017-02-09 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15859863#comment-15859863 ] Emilio Lahr-Vivaz commented on ARROW-542: - It's getting a little complicated trying to

[jira] [Commented] (ARROW-542) [Java] Implement dictionaries in stream/file encoding

2017-02-08 Thread Emilio Lahr-Vivaz (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858295#comment-15858295 ] Emilio Lahr-Vivaz commented on ARROW-542: - [~wesmckinn] I'm looking into how dictionary vectors

[jira] [Created] (ARROW-542) [Java] Implement dictionaries in stream/file encoding

2017-02-08 Thread Emilio Lahr-Vivaz (JIRA)
Emilio Lahr-Vivaz created ARROW-542: --- Summary: [Java] Implement dictionaries in stream/file encoding Key: ARROW-542 URL: https://issues.apache.org/jira/browse/ARROW-542 Project: Apache Arrow