[jira] [Updated] (ARROW-1178) [Python] Create alternative to Table.from_pandas that yields a list of RecordBatch objects with a given chunk size

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1178: Fix Version/s: (was: 0.7.0) 0.8.0 > [Python] Create alternative to

[jira] [Updated] (ARROW-504) [Python] Add adapter to write pandas.DataFrame in user-selected chunk size to streaming format

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-504: --- Fix Version/s: (was: 0.7.0) 0.8.0 > [Python] Add adapter to write

[jira] [Created] (ARROW-1503) [Python] Add serialization callbacks for pandas objects in pyarrow.serialize

2017-09-08 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1503: --- Summary: [Python] Add serialization callbacks for pandas objects in pyarrow.serialize Key: ARROW-1503 URL: https://issues.apache.org/jira/browse/ARROW-1503 Project:

[jira] [Updated] (ARROW-1425) [Python] Document semantic differences between Spark timestamps and Arrow timestamps

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1425: Fix Version/s: (was: 0.7.0) 0.8.0 > [Python] Document semantic differences

[jira] [Updated] (ARROW-507) [C++/Python] Construct List container from offsets and values subarrays

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-507: --- Fix Version/s: (was: 0.7.0) 0.8.0 > [C++/Python] Construct List container from

[jira] [Updated] (ARROW-772) [C++] Implement Take function for arrow::Array types

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-772: --- Labels: Analytics (was: ) > [C++] Implement Take function for arrow::Array types >

[jira] [Updated] (ARROW-614) [C++] Use glog (or some other tool) to print stack traces in debug builds on errors

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-614: --- Fix Version/s: 0.8.0 > [C++] Use glog (or some other tool) to print stack traces in debug builds on >

[jira] [Updated] (ARROW-517) C++: Verbose Array::Equals

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-517: --- Fix Version/s: 0.8.0 > C++: Verbose Array::Equals > -- > >

[jira] [Updated] (ARROW-555) [C++] String algorithm library for StringArray/BinaryArray

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-555: --- Labels: Analytics (was: ) > [C++] String algorithm library for StringArray/BinaryArray >

[jira] [Updated] (ARROW-448) [Python] Load HdfsClient default options from core-site.xml or hdfs-site.xml, if available

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-448: --- Fix Version/s: 0.8.0 > [Python] Load HdfsClient default options from core-site.xml or hdfs-site.xml,

[jira] [Commented] (ARROW-269) UnionVector getBuffers method does not include typevector

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16159605#comment-16159605 ] Wes McKinney commented on ARROW-269: cc [~icexelloss] > UnionVector getBuffers method does not include

[jira] [Updated] (ARROW-258) clarify definition of Buffer in context of RPC, IPC, File

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-258: --- Fix Version/s: 1.0.0 > clarify definition of Buffer in context of RPC, IPC, File >

[jira] [Updated] (ARROW-269) UnionVector getBuffers method does not include typevector

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-269: --- Fix Version/s: 1.0.0 > UnionVector getBuffers method does not include typevector >

[jira] [Created] (ARROW-1502) [JS] Define code entry point for integration testing

2017-09-08 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1502: --- Summary: [JS] Define code entry point for integration testing Key: ARROW-1502 URL: https://issues.apache.org/jira/browse/ARROW-1502 Project: Apache Arrow

[jira] [Created] (ARROW-1501) [JS] JavaScript integration tests

2017-09-08 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1501: --- Summary: [JS] JavaScript integration tests Key: ARROW-1501 URL: https://issues.apache.org/jira/browse/ARROW-1501 Project: Apache Arrow Issue Type: Improvement

[jira] [Resolved] (ARROW-1479) [JS] Expand JavaScript implementation

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1479. - Resolution: Fixed Issue resolved by pull request 1062 [https://github.com/apache/arrow/pull/1062]

[jira] [Updated] (ARROW-1479) [JS] Expand JavaScript implementation

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1479: Fix Version/s: 0.7.0 > [JS] Expand JavaScript implementation >

[jira] [Assigned] (ARROW-1479) [JS] Expand JavaScript implementation

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1479: --- Assignee: Paul Taylor > [JS] Expand JavaScript implementation >

[jira] [Resolved] (ARROW-1495) [C++] Store shared_ptr to boxed arrays in RecordBatch

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1495. - Resolution: Fixed Resolved in

[jira] [Resolved] (ARROW-1493) [C++] Flush the output stream at the end of each PrettyPrint function

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1493. - Resolution: Fixed Issue resolved by pull request 1066 [https://github.com/apache/arrow/pull/1066]

[jira] [Resolved] (ARROW-1480) [Python] Improve performance of serializing sets

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1480. - Resolution: Fixed Issue resolved by pull request 1060 [https://github.com/apache/arrow/pull/1060]

[jira] [Created] (ARROW-1500) [C++] Result of ftruncate ignored in MemoryMappedFile::Create

2017-09-08 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1500: --- Summary: [C++] Result of ftruncate ignored in MemoryMappedFile::Create Key: ARROW-1500 URL: https://issues.apache.org/jira/browse/ARROW-1500 Project: Apache Arrow

[jira] [Created] (ARROW-1499) [Python] Consider adding option to parquet.write_table that sets options for maximum Spark compatibility

2017-09-08 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1499: --- Summary: [Python] Consider adding option to parquet.write_table that sets options for maximum Spark compatibility Key: ARROW-1499 URL:

[jira] [Created] (ARROW-1498) [GitHub] Add CONTRIBUTING.md and ISSUE_TEMPLATE.md

2017-09-08 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1498: --- Summary: [GitHub] Add CONTRIBUTING.md and ISSUE_TEMPLATE.md Key: ARROW-1498 URL: https://issues.apache.org/jira/browse/ARROW-1498 Project: Apache Arrow Issue

[jira] [Commented] (ARROW-1497) [Java] JsonFileReader doesn't set value count for some vectors

2017-09-08 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158958#comment-16158958 ] Li Jin commented on ARROW-1497: --- https://github.com/apache/arrow/pull/1067 > [Java] JsonFileReader doesn't

[jira] [Comment Edited] (ARROW-1497) [Java] JsonFileReader doesn't set value count for some vectors

2017-09-08 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158958#comment-16158958 ] Li Jin edited comment on ARROW-1497 at 9/8/17 5:17 PM: --- PR:

[jira] [Assigned] (ARROW-1471) [JAVA] Document requirements and non/requirements for ValueVector updates

2017-09-08 Thread Siddharth Teotia (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Teotia reassigned ARROW-1471: --- Assignee: Siddharth Teotia > [JAVA] Document requirements and non/requirements for

[jira] [Created] (ARROW-1497) [Java] JsonFileReader doesn't set value count for some vectors

2017-09-08 Thread Li Jin (JIRA)
Li Jin created ARROW-1497: - Summary: [Java] JsonFileReader doesn't set value count for some vectors Key: ARROW-1497 URL: https://issues.apache.org/jira/browse/ARROW-1497 Project: Apache Arrow Issue

[jira] [Assigned] (ARROW-1470) [C++] Add BufferAllocator abstract interface

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1470: --- Assignee: Wes McKinney > [C++] Add BufferAllocator abstract interface >

[jira] [Created] (ARROW-1496) [JS] Upload coverage data to coveralls

2017-09-08 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1496: --- Summary: [JS] Upload coverage data to coveralls Key: ARROW-1496 URL: https://issues.apache.org/jira/browse/ARROW-1496 Project: Apache Arrow Issue Type:

[jira] [Updated] (ARROW-549) [C++] Add function to concatenate like-typed arrays

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-549: --- Fix Version/s: 0.8.0 > [C++] Add function to concatenate like-typed arrays >

[jira] [Commented] (ARROW-549) [C++] Add function to concatenate like-typed arrays

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158786#comment-16158786 ] Wes McKinney commented on ARROW-549: This will be useful soon enough in {{arrow::compute}} > [C++] Add

[jira] [Updated] (ARROW-554) [C++] Implement functions to conform unequal dictionaries amongst multiple Arrow arrays

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-554: --- Labels: Analytics (was: ) > [C++] Implement functions to conform unequal dictionaries amongst

[jira] [Updated] (ARROW-1114) [C++] Create Record Batch Builder class as a reusable and efficient way to transpose row-by-row data to columns

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1114: Fix Version/s: (was: 0.7.0) 0.8.0 > [C++] Create Record Batch Builder class

[jira] [Assigned] (ARROW-1495) [C++] Store shared_ptr to boxed arrays in RecordBatch

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1495: --- Assignee: Wes McKinney > [C++] Store shared_ptr to boxed arrays in RecordBatch >

[jira] [Resolved] (ARROW-1494) [C++] Document that shared_ptr returned by RecordBatch::column needs to be retained

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1494. - Resolution: Fixed Issue resolved by pull request 1065 [https://github.com/apache/arrow/pull/1065]

[jira] [Resolved] (ARROW-1481) [C++] Expose type casts as generic callable object that can write into pre-allocated memory

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1481. - Resolution: Fixed Resolved in

[jira] [Created] (ARROW-1495) [C++] Store shared_ptr to boxed arrays in RecordBatch

2017-09-08 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1495: --- Summary: [C++] Store shared_ptr to boxed arrays in RecordBatch Key: ARROW-1495 URL: https://issues.apache.org/jira/browse/ARROW-1495 Project: Apache Arrow

[jira] [Resolved] (ARROW-1156) [Python] pyarrow.Array.from_pandas should take a type parameter

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1156. - Resolution: Fixed Issue resolved by pull request 1063 [https://github.com/apache/arrow/pull/1063]

[jira] [Commented] (ARROW-1493) [C++] Flush the output stream at the end of each PrettyPrint function

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158669#comment-16158669 ] Wes McKinney commented on ARROW-1493: - PR: https://github.com/apache/arrow/pull/1066 > [C++] Flush

[jira] [Assigned] (ARROW-1494) [C++] Document that shared_ptr returned by RecordBatch::column needs to be retained

2017-09-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1494: --- Assignee: Wes McKinney > [C++] Document that shared_ptr returned by RecordBatch::column