[jira] [Updated] (SPARK-23358) When the number of partitions is greater than 2^28, it will result in an error result

2018-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23358: -- Affects Version/s: (was: 2.4.0) 2.3.0 Priority: Minor (was: Maj

[jira] [Updated] (SPARK-23358) When the number of partitions is greater than 2^28, it will result in an error result

2018-02-08 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-23358: Description: In the `checkIndexAndDataFile`,the _blocks_ is the  _Int_ type,  when it is greater than 2^28