[jira] [Commented] (HIVE-14165) Enable faster S3 Split Computation

[ https://issues.apache.org/jira/browse/HIVE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425825#comment-15425825 ] Abdullah Yousufi commented on HIVE-14165: - Actually, on closer look, FileInputForm

[jira] [Commented] (HIVE-14165) Enable faster S3 Split Computation

[ https://issues.apache.org/jira/browse/HIVE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15423120#comment-15423120 ] Abdullah Yousufi commented on HIVE-14165: - It calls FileSystem.java#listStatus(Pat

[jira] [Commented] (HIVE-14165) Enable faster S3 Split Computation

[ https://issues.apache.org/jira/browse/HIVE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15422796#comment-15422796 ] Steve Loughran commented on HIVE-14165: --- which filesystem list calls does {{listStat

[jira] [Commented] (HIVE-14165) Enable faster S3 Split Computation

[ https://issues.apache.org/jira/browse/HIVE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15421901#comment-15421901 ] Abdullah Yousufi commented on HIVE-14165: - So I did try the listFiles() optimizati

[jira] [Commented] (HIVE-14165) Enable faster S3 Split Computation by listing files in blocks

[ https://issues.apache.org/jira/browse/HIVE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392423#comment-15392423 ] Abdullah Yousufi commented on HIVE-14165: - Thanks for the clarification Steve, loo

[jira] [Commented] (HIVE-14165) Enable faster S3 Split Computation by listing files in blocks

[ https://issues.apache.org/jira/browse/HIVE-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392338#comment-15392338 ] Steve Loughran commented on HIVE-14165: --- If you look at the cost of listing in s3, y