[jira] [Commented] (ARROW-6230) [R] Reading in parquent files are 20x slower than reading fst files in R

2019-08-14 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907360#comment-16907360 ] Wes McKinney commented on ARROW-6230: - Note that the Parquet file is about 5x smaller than the fst

[jira] [Commented] (ARROW-6230) [R] Reading in parquent files are 20x slower than reading fst files in R

2019-08-14 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907359#comment-16907359 ] Wes McKinney commented on ARROW-6230: - On the master branch I have {code} > a <- >

[jira] [Commented] (ARROW-6230) [R] Reading in parquent files are 20x slower than reading fst files in R

2019-08-13 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906835#comment-16906835 ] Wes McKinney commented on ARROW-6230: - Oh, you're running into

[jira] [Commented] (ARROW-6230) [R] Reading in parquent files are 20x slower than reading fst files in R

2019-08-13 Thread Zhuo Jia Dai (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906828#comment-16906828 ] Zhuo Jia Dai commented on ARROW-6230: - Actually, I can't even read it in Python on the same machine

[jira] [Commented] (ARROW-6230) [R] Reading in parquent files are 20x slower than reading fst files in R

2019-08-13 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906826#comment-16906826 ] Wes McKinney commented on ARROW-6230: - cc [~romainfrancois] [~npr] > [R] Reading in parquent files

[jira] [Commented] (ARROW-6230) [R] Reading in parquent files are 20x slower than reading fst files in R

2019-08-13 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906825#comment-16906825 ] Wes McKinney commented on ARROW-6230: - For the record this file takes on the same order of magnitude

[jira] [Commented] (ARROW-6230) [R] Reading in parquent files are 20x slower than reading fst files in R

2019-08-13 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906812#comment-16906812 ] Wes McKinney commented on ARROW-6230: - Thanks for the example. I'm interested to see what the time is