[jira] [Updated] (ARROW-1860) [C++] Add data structure to "stage" a sequence of IPC messages from in-memory data

2018-09-21 Thread Wes McKinney (JIRA)


 [ 
https://issues.apache.org/jira/browse/ARROW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney updated ARROW-1860:

Fix Version/s: (was: 0.12.0)
   0.11.0

> [C++] Add data structure to "stage" a sequence of IPC messages from in-memory 
> data
> --
>
> Key: ARROW-1860
> URL: https://issues.apache.org/jira/browse/ARROW-1860
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>Priority: Major
>  Labels: flight, pull-request-available
> Fix For: 0.11.0
>
> Attachments: text.html
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Currently, when you need to pre-allocate space for a record batch or a stream 
> (schema + dictionaries + record batches), you must make multiple passes over 
> the data structures of interest (and use e.g. {{MockOutputStream}} to compute 
> the size of the output buffer). It would be useful to make a single pass to 
> "prepare" the IPC payload for both sizing and writing to prevent having to 
> make multiple passes



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ARROW-1860) [C++] Add data structure to "stage" a sequence of IPC messages from in-memory data

2018-08-30 Thread Wes McKinney (JIRA)


 [ 
https://issues.apache.org/jira/browse/ARROW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney updated ARROW-1860:

Labels: flight pull-request-available  (was: pull-request-available)

> [C++] Add data structure to "stage" a sequence of IPC messages from in-memory 
> data
> --
>
> Key: ARROW-1860
> URL: https://issues.apache.org/jira/browse/ARROW-1860
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>Priority: Major
>  Labels: flight, pull-request-available
> Fix For: 0.12.0
>
> Attachments: text.html
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Currently, when you need to pre-allocate space for a record batch or a stream 
> (schema + dictionaries + record batches), you must make multiple passes over 
> the data structures of interest (and use e.g. {{MockOutputStream}} to compute 
> the size of the output buffer). It would be useful to make a single pass to 
> "prepare" the IPC payload for both sizing and writing to prevent having to 
> make multiple passes



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ARROW-1860) [C++] Add data structure to "stage" a sequence of IPC messages from in-memory data

2018-08-30 Thread Wes McKinney (JIRA)


 [ 
https://issues.apache.org/jira/browse/ARROW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney updated ARROW-1860:

Fix Version/s: (was: 0.11.0)
   0.12.0

> [C++] Add data structure to "stage" a sequence of IPC messages from in-memory 
> data
> --
>
> Key: ARROW-1860
> URL: https://issues.apache.org/jira/browse/ARROW-1860
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>Priority: Major
>  Labels: flight, pull-request-available
> Fix For: 0.12.0
>
> Attachments: text.html
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Currently, when you need to pre-allocate space for a record batch or a stream 
> (schema + dictionaries + record batches), you must make multiple passes over 
> the data structures of interest (and use e.g. {{MockOutputStream}} to compute 
> the size of the output buffer). It would be useful to make a single pass to 
> "prepare" the IPC payload for both sizing and writing to prevent having to 
> make multiple passes



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ARROW-1860) [C++] Add data structure to "stage" a sequence of IPC messages from in-memory data

2018-06-29 Thread Wes McKinney (JIRA)


 [ 
https://issues.apache.org/jira/browse/ARROW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney updated ARROW-1860:

Fix Version/s: (was: 0.10.0)
   0.11.0

> [C++] Add data structure to "stage" a sequence of IPC messages from in-memory 
> data
> --
>
> Key: ARROW-1860
> URL: https://issues.apache.org/jira/browse/ARROW-1860
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.11.0
>
> Attachments: text.html
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Currently, when you need to pre-allocate space for a record batch or a stream 
> (schema + dictionaries + record batches), you must make multiple passes over 
> the data structures of interest (and use e.g. {{MockOutputStream}} to compute 
> the size of the output buffer). It would be useful to make a single pass to 
> "prepare" the IPC payload for both sizing and writing to prevent having to 
> make multiple passes



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ARROW-1860) [C++] Add data structure to "stage" a sequence of IPC messages from in-memory data

2018-03-11 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney updated ARROW-1860:

Fix Version/s: (was: 0.9.0)
   0.10.0

> [C++] Add data structure to "stage" a sequence of IPC messages from in-memory 
> data
> --
>
> Key: ARROW-1860
> URL: https://issues.apache.org/jira/browse/ARROW-1860
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.10.0
>
> Attachments: text.html
>
>
> Currently, when you need to pre-allocate space for a record batch or a stream 
> (schema + dictionaries + record batches), you must make multiple passes over 
> the data structures of interest (and use e.g. {{MockOutputStream}} to compute 
> the size of the output buffer). It would be useful to make a single pass to 
> "prepare" the IPC payload for both sizing and writing to prevent having to 
> make multiple passes



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ARROW-1860) [C++] Add data structure to "stage" a sequence of IPC messages from in-memory data

2018-01-24 Thread ASF GitHub Bot (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated ARROW-1860:
--
Labels: pull-request-available  (was: )

> [C++] Add data structure to "stage" a sequence of IPC messages from in-memory 
> data
> --
>
> Key: ARROW-1860
> URL: https://issues.apache.org/jira/browse/ARROW-1860
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
>Assignee: Wes McKinney
>Priority: Major
>  Labels: pull-request-available
> Fix For: 0.9.0
>
> Attachments: text.html
>
>
> Currently, when you need to pre-allocate space for a record batch or a stream 
> (schema + dictionaries + record batches), you must make multiple passes over 
> the data structures of interest (and use e.g. {{MockOutputStream}} to compute 
> the size of the output buffer). It would be useful to make a single pass to 
> "prepare" the IPC payload for both sizing and writing to prevent having to 
> make multiple passes



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (ARROW-1860) [C++] Add data structure to "stage" a sequence of IPC messages from in-memory data

2018-01-11 Thread Panchen Xue (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Panchen Xue updated ARROW-1860:
---
Description: {color:red}colored text{color}Currently, when you need to 
pre-allocate space for a record batch or a stream (schema + dictionaries + 
record batches), you must make multiple passes over the data structures of 
interest (and use e.g. {{MockOutputStream}} to compute the size of the output 
buffer). It would be useful to make a single pass to "prepare" the IPC payload 
for both sizing and writing to prevent having to make multiple passes  (was: 
Currently, when you need to pre-allocate space for a record batch or a stream 
(schema + dictionaries + record batches), you must make multiple passes over 
the data structures of interest (and use e.g. {{MockOutputStream}} to compute 
the size of the output buffer). It would be useful to make a single pass to 
"prepare" the IPC payload for both sizing and writing to prevent having to make 
multiple passes)

> [C++] Add data structure to "stage" a sequence of IPC messages from in-memory 
> data
> --
>
> Key: ARROW-1860
> URL: https://issues.apache.org/jira/browse/ARROW-1860
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
>Assignee: Panchen Xue
> Fix For: 0.9.0
>
> Attachments: text.html
>
>
> {color:red}colored text{color}Currently, when you need to pre-allocate space 
> for a record batch or a stream (schema + dictionaries + record batches), you 
> must make multiple passes over the data structures of interest (and use e.g. 
> {{MockOutputStream}} to compute the size of the output buffer). It would be 
> useful to make a single pass to "prepare" the IPC payload for both sizing and 
> writing to prevent having to make multiple passes



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ARROW-1860) [C++] Add data structure to "stage" a sequence of IPC messages from in-memory data

2018-01-11 Thread Panchen Xue (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Panchen Xue updated ARROW-1860:
---
Description: Currently, when you need to pre-allocate space for a record 
batch or a stream (schema + dictionaries + record batches), you must make 
multiple passes over the data structures of interest (and use e.g. 
{{MockOutputStream}} to compute the size of the output buffer). It would be 
useful to make a single pass to "prepare" the IPC payload for both sizing and 
writing to prevent having to make multiple passes  (was: {color:red}colored 
text{color}Currently, when you need to pre-allocate space for a record batch or 
a stream (schema + dictionaries + record batches), you must make multiple 
passes over the data structures of interest (and use e.g. {{MockOutputStream}} 
to compute the size of the output buffer). It would be useful to make a single 
pass to "prepare" the IPC payload for both sizing and writing to prevent having 
to make multiple passes)

> [C++] Add data structure to "stage" a sequence of IPC messages from in-memory 
> data
> --
>
> Key: ARROW-1860
> URL: https://issues.apache.org/jira/browse/ARROW-1860
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
>Assignee: Panchen Xue
> Fix For: 0.9.0
>
> Attachments: text.html
>
>
> Currently, when you need to pre-allocate space for a record batch or a stream 
> (schema + dictionaries + record batches), you must make multiple passes over 
> the data structures of interest (and use e.g. {{MockOutputStream}} to compute 
> the size of the output buffer). It would be useful to make a single pass to 
> "prepare" the IPC payload for both sizing and writing to prevent having to 
> make multiple passes



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ARROW-1860) [C++] Add data structure to "stage" a sequence of IPC messages from in-memory data

2017-12-15 Thread Brian Bowman (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Brian Bowman updated ARROW-1860:

Attachment: text.html

I’m out of the office for vacation, followed by the SAS Winter Holiday until 
Tuesay January 2nd 2018.

-Brian

On Nov 26, 2017, at 11:45 AM, Wes McKinney (JIRA)  wrote:

EXTERNAL

Wes McKinney created ARROW-1860:
---

Summary: [C++] Add data structure to "stage" a sequence of IPC 
messages from in-memory data
Key: ARROW-1860
URL: https://issues.apache.org/jira/browse/ARROW-1860
Project: Apache Arrow
 Issue Type: New Feature
 Components: C++
   Reporter: Wes McKinney


Currently, when you need to pre-allocate space for a record batch or a stream 
(schema + dictionaries + record batches), you must make multiple passes over 
the data structures of interest (and use e.g. {{MockOutputStream}} to compute 
the size of the output buffer). It would be useful to make a single pass to 
"prepare" the IPC payload for both sizing and writing to prevent having to make 
multiple passes



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


> [C++] Add data structure to "stage" a sequence of IPC messages from in-memory 
> data
> --
>
> Key: ARROW-1860
> URL: https://issues.apache.org/jira/browse/ARROW-1860
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
> Fix For: 0.9.0
>
> Attachments: text.html
>
>
> Currently, when you need to pre-allocate space for a record batch or a stream 
> (schema + dictionaries + record batches), you must make multiple passes over 
> the data structures of interest (and use e.g. {{MockOutputStream}} to compute 
> the size of the output buffer). It would be useful to make a single pass to 
> "prepare" the IPC payload for both sizing and writing to prevent having to 
> make multiple passes



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (ARROW-1860) [C++] Add data structure to "stage" a sequence of IPC messages from in-memory data

2017-12-07 Thread Wes McKinney (JIRA)

 [ 
https://issues.apache.org/jira/browse/ARROW-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wes McKinney updated ARROW-1860:

Fix Version/s: 0.9.0

> [C++] Add data structure to "stage" a sequence of IPC messages from in-memory 
> data
> --
>
> Key: ARROW-1860
> URL: https://issues.apache.org/jira/browse/ARROW-1860
> Project: Apache Arrow
>  Issue Type: New Feature
>  Components: C++
>Reporter: Wes McKinney
> Fix For: 0.9.0
>
>
> Currently, when you need to pre-allocate space for a record batch or a stream 
> (schema + dictionaries + record batches), you must make multiple passes over 
> the data structures of interest (and use e.g. {{MockOutputStream}} to compute 
> the size of the output buffer). It would be useful to make a single pass to 
> "prepare" the IPC payload for both sizing and writing to prevent having to 
> make multiple passes



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)