[
https://issues.apache.org/jira/browse/ARROW-14798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478194#comment-17478194
]
Joris Van den Bossche edited comment on ARROW-14798 at 1/18/22, 8:45 PM:
-------------------------------------------------------------------------
Can we keep this on 7.0.0? (or keep ARROW-15329 on 7.0.0?)
The table repr is basically unusable right now unless you are using small test
data
was (Author: jorisvandenbossche):
Can we keep this on 7.0.0?
The table repr is basically unusable right now unless you are using small test
data
> [Python] Limit the size of the repr for large Tables
> ----------------------------------------------------
>
> Key: ARROW-14798
> URL: https://issues.apache.org/jira/browse/ARROW-14798
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, Python
> Reporter: Joris Van den Bossche
> Assignee: Will Jones
> Priority: Major
> Labels: good-first-issue, pull-request-available
> Fix For: 7.0.0
>
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> The new repr is nice that it shows a preview of the data, but this can also
> become very long flooding your console output for larger tables.
> We already default to 10 preview cols, but each column can still consist of
> many chunks. So it might be good to also limit it to 2 chunks?
> The ChunkedArray.to_string method already has a {{window}} keyword, but that
> seems to control both the number of elements to show per chunk as the number
> of chunks (while it would be nice to limit eg to 2 chunks but show up to 10
> elements for each chunk).
> cc [~amol-]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)