[jira] [Commented] (ARROW-7854) [C++][Dataset] Option to memory map when reading IPC format
[ https://issues.apache.org/jira/browse/ARROW-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062844#comment-17062844 ] Wes McKinney commented on ARROW-7854: - Well, it seems like this detail should perhaps not be so visible to users. If an interface prefers memory mapping if it's available, then it can do so without leaking this configuration detail into some other part of the system > [C++][Dataset] Option to memory map when reading IPC format > --- > > Key: ARROW-7854 > URL: https://issues.apache.org/jira/browse/ARROW-7854 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ - Dataset >Reporter: Joris Van den Bossche >Assignee: Francois Saint-Jacques >Priority: Major > > For the IPC format it would be interesting to be able to memory map the IPC > files? > cc [~fsaintjacques] [~bkietz] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-7854) [C++][Dataset] Option to memory map when reading IPC format
[ https://issues.apache.org/jira/browse/ARROW-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062505#comment-17062505 ] Francois Saint-Jacques commented on ARROW-7854: --- Which granularity would you like to see? A user can still create another LocalFilesystem without mmap. > [C++][Dataset] Option to memory map when reading IPC format > --- > > Key: ARROW-7854 > URL: https://issues.apache.org/jira/browse/ARROW-7854 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ - Dataset >Reporter: Joris Van den Bossche >Assignee: Francois Saint-Jacques >Priority: Major > > For the IPC format it would be interesting to be able to memory map the IPC > files? > cc [~fsaintjacques] [~bkietz] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-7854) [C++][Dataset] Option to memory map when reading IPC format
[ https://issues.apache.org/jira/browse/ARROW-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062135#comment-17062135 ] Wes McKinney commented on ARROW-7854: - I'm not totally satisfied by the global memory mapping option in LocalFilesystem so I opened ARROW-8156 > [C++][Dataset] Option to memory map when reading IPC format > --- > > Key: ARROW-7854 > URL: https://issues.apache.org/jira/browse/ARROW-7854 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ - Dataset >Reporter: Joris Van den Bossche >Assignee: Francois Saint-Jacques >Priority: Major > > For the IPC format it would be interesting to be able to memory map the IPC > files? > cc [~fsaintjacques] [~bkietz] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-7854) [C++][Dataset] Option to memory map when reading IPC format
[ https://issues.apache.org/jira/browse/ARROW-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061882#comment-17061882 ] Joris Van den Bossche commented on ARROW-7854: -- [~fsaintjacques] this actually already turned out to be possible from the python side, by specifying this option when creating the LocalFileSystem object. > [C++][Dataset] Option to memory map when reading IPC format > --- > > Key: ARROW-7854 > URL: https://issues.apache.org/jira/browse/ARROW-7854 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ - Dataset >Reporter: Joris Van den Bossche >Assignee: Francois Saint-Jacques >Priority: Major > > For the IPC format it would be interesting to be able to memory map the IPC > files? > cc [~fsaintjacques] [~bkietz] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ARROW-7854) [C++][Dataset] Option to memory map when reading IPC format
[ https://issues.apache.org/jira/browse/ARROW-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036986#comment-17036986 ] Wes McKinney commented on ARROW-7854: - IMHO this should be the default behavior except for remote filesystems > [C++][Dataset] Option to memory map when reading IPC format > --- > > Key: ARROW-7854 > URL: https://issues.apache.org/jira/browse/ARROW-7854 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ - Dataset >Reporter: Joris Van den Bossche >Priority: Major > > For the IPC format it would be interesting to be able to memory map the IPC > files? > cc [~fsaintjacques] [~bkietz] -- This message was sent by Atlassian Jira (v8.3.4#803005)
