[jira] [Assigned] (ARROW-7800) [Python] Expose GetRecordBatchReader API in PyArrow

2021-01-06 Thread Joris Van den Bossche (Jira) 


 [ 
https://issues.apache.org/jira/browse/ARROW-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joris Van den Bossche reassigned ARROW-7800:


Assignee: Joris Van den Bossche

> [Python] Expose GetRecordBatchReader API in PyArrow
> ---
>
> Key: ARROW-7800
> URL: https://issues.apache.org/jira/browse/ARROW-7800
> Project: Apache Arrow
>  Issue Type: Improvement
>  Components: Python
>Reporter: Rollo Konig-brock
>Assignee: Joris Van den Bossche
>Priority: Minor
>  Labels: features, pull-request-available
> Fix For: 3.0.0
>
>  Time Spent: 10h 10m
>  Remaining Estimate: 0h
>
> The GetRecordBatchReader API is really useful for streaming ParquetFiles with 
> lots of RLE.
> I propose exposing this API in PyArrow in the following manner:
> {code}
> file_ = ParquetFile('file/path.parquet')
> for batch in file_.get_batches(batch_size=100):
>  pass
> {code}
> (If anyone has any better ideas hit me up, I'm not 100% sold on exposing it 
> this way.)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Assigned] (ARROW-7800) [Python] Expose GetRecordBatchReader API in PyArrow

2021-01-06 Thread Joris Van den Bossche (Jira) 


 [ 
https://issues.apache.org/jira/browse/ARROW-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joris Van den Bossche reassigned ARROW-7800:


Assignee: Will Jones  (was: Joris Van den Bossche)

> [Python] Expose GetRecordBatchReader API in PyArrow
> ---
>
> Key: ARROW-7800
> URL: https://issues.apache.org/jira/browse/ARROW-7800
> Project: Apache Arrow
>  Issue Type: Improvement
>  Components: Python
>Reporter: Rollo Konig-brock
>Assignee: Will Jones
>Priority: Minor
>  Labels: features, pull-request-available
> Fix For: 3.0.0
>
>  Time Spent: 10h 10m
>  Remaining Estimate: 0h
>
> The GetRecordBatchReader API is really useful for streaming ParquetFiles with 
> lots of RLE.
> I propose exposing this API in PyArrow in the following manner:
> {code}
> file_ = ParquetFile('file/path.parquet')
> for batch in file_.get_batches(batch_size=100):
>  pass
> {code}
> (If anyone has any better ideas hit me up, I'm not 100% sold on exposing it 
> this way.)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Assigned] (ARROW-7800) [Python] Expose GetRecordBatchReader API in PyArrow

2020-10-02 Thread Joris Van den Bossche (Jira) 


 [ 
https://issues.apache.org/jira/browse/ARROW-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joris Van den Bossche reassigned ARROW-7800:


Assignee: (was: Joris Van den Bossche)

> [Python] Expose GetRecordBatchReader API in PyArrow
> ---
>
> Key: ARROW-7800
> URL: https://issues.apache.org/jira/browse/ARROW-7800
> Project: Apache Arrow
>  Issue Type: Improvement
>  Components: Python
>Reporter: Rollo Konig-brock
>Priority: Minor
>  Labels: features, pull-request-available
> Fix For: 2.0.0
>
>  Time Spent: 7h 20m
>  Remaining Estimate: 0h
>
> The GetRecordBatchReader API is really useful for streaming ParquetFiles with 
> lots of RLE.
> I propose exposing this API in PyArrow in the following manner:
> {code}
> file_ = ParquetFile('file/path.parquet')
> for batch in file_.get_batches(batch_size=100):
>  pass
> {code}
> (If anyone has any better ideas hit me up, I'm not 100% sold on exposing it 
> this way.)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Assigned] (ARROW-7800) [Python] Expose GetRecordBatchReader API in PyArrow

2020-07-13 Thread Krisztian Szucs (Jira) 


 [ 
https://issues.apache.org/jira/browse/ARROW-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Szucs reassigned ARROW-7800:
--

Assignee: Joris Van den Bossche  (was: Krisztian Szucs)

> [Python] Expose GetRecordBatchReader API in PyArrow
> ---
>
> Key: ARROW-7800
> URL: https://issues.apache.org/jira/browse/ARROW-7800
> Project: Apache Arrow
>  Issue Type: Improvement
>  Components: Python
>Reporter: Rollo Konig-brock
>Assignee: Joris Van den Bossche
>Priority: Minor
>  Labels: features, pull-request-available
> Fix For: 1.0.0
>
>  Time Spent: 5.5h
>  Remaining Estimate: 0h
>
> The GetRecordBatchReader API is really useful for streaming ParquetFiles with 
> lots of RLE.
> I propose exposing this API in PyArrow in the following manner:
> {code}
> file_ = ParquetFile('file/path.parquet')
> for batch in file_.get_batches(batch_size=100):
>  pass
> {code}
> (If anyone has any better ideas hit me up, I'm not 100% sold on exposing it 
> this way.)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Assigned] (ARROW-7800) [Python] Expose GetRecordBatchReader API in PyArrow

2020-07-13 Thread Krisztian Szucs (Jira) 


 [ 
https://issues.apache.org/jira/browse/ARROW-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Krisztian Szucs reassigned ARROW-7800:
--

Assignee: Krisztian Szucs

> [Python] Expose GetRecordBatchReader API in PyArrow
> ---
>
> Key: ARROW-7800
> URL: https://issues.apache.org/jira/browse/ARROW-7800
> Project: Apache Arrow
>  Issue Type: Improvement
>  Components: Python
>Reporter: Rollo Konig-brock
>Assignee: Krisztian Szucs
>Priority: Minor
>  Labels: features, pull-request-available
> Fix For: 1.0.0
>
>  Time Spent: 5.5h
>  Remaining Estimate: 0h
>
> The GetRecordBatchReader API is really useful for streaming ParquetFiles with 
> lots of RLE.
> I propose exposing this API in PyArrow in the following manner:
> {code}
> file_ = ParquetFile('file/path.parquet')
> for batch in file_.get_batches(batch_size=100):
>  pass
> {code}
> (If anyone has any better ideas hit me up, I'm not 100% sold on exposing it 
> this way.)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)