[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654417#comment-16654417 ] Xiao Li commented on SPARK-23390: - Thanks! > Flaky test: FileBasedDataSourceSuite >

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-17 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654413#comment-16654413 ] Dongjoon Hyun commented on SPARK-23390: --- [~zsxwing], [~cloud_fan], and [~smilegator]. Both ORC-416

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646009#comment-16646009 ] Dongjoon Hyun commented on SPARK-23390: --- As a second approach, ORC-419 is created. > Flaky test:

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-10 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645441#comment-16645441 ] Dongjoon Hyun commented on SPARK-23390: --- Yep. Thank you for the guide, [~zsxwing]. > Flaky test:

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-10 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645399#comment-16645399 ] Shixiong Zhu commented on SPARK-23390: -- [~dongjoon] when spark cancels a task, the task thread will

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-10 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645358#comment-16645358 ] Dongjoon Hyun commented on SPARK-23390: --- [~zsxwing]. ORC-416 is a first partial attempt to make

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-10 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644733#comment-16644733 ] Dongjoon Hyun commented on SPARK-23390: --- Thank you, [~zsxwing]. It took some time, but ORC-416 is

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644036#comment-16644036 ] Shixiong Zhu commented on SPARK-23390: -- I didn't look at parquet. It may have a similar issue. >

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644034#comment-16644034 ] Shixiong Zhu commented on SPARK-23390: -- I think the issue is probably in orc. Any exception

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

2018-10-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643960#comment-16643960 ] Dongjoon Hyun commented on SPARK-23390: --- As reported in SPARK-25688 by [~smilegator] , all recent