[GitHub] spark issue #15153: [SPARK-17599] Prevent ListingFileCatalog from failing if...
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15153 @petermaxlee It is true that the parallel version can fail as well, the same kind of race condition can bite people there --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15153: [SPARK-17599] Prevent ListingFileCatalog from failing if...
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/15153 @brkyvz the change here only affects the serial version, and not the parallel version, does it? Wouldn't that be a problem? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15153: [SPARK-17599] Prevent ListingFileCatalog from failing if...
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15153 @cloud-fan Something similar to this already exists in Branch 2.0. In branch 2.0, we're going to need something similar to this: https://github.com/apache/spark/pull/15122 which also does exist. They were all removed by your PR for different reasons, but it turned out that we also needed them for Streaming :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15153: [SPARK-17599] Prevent ListingFileCatalog from failing if...
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15153 LGTM, merging to master! @brkyvz this conflicts with 2.0, can you send a new PR? thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15153: [SPARK-17599] Prevent ListingFileCatalog from failing if...
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15153 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15153: [SPARK-17599] Prevent ListingFileCatalog from failing if...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15153 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65611/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15153: [SPARK-17599] Prevent ListingFileCatalog from failing if...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15153 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15153: [SPARK-17599] Prevent ListingFileCatalog from failing if...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15153 **[Test build #65611 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65611/consoleFull)** for PR 15153 at commit [`e4e8f1a`](https://github.com/apache/spark/commit/e4e8f1a5097a1a90163705a7b99dc33e5f32d925). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15153: [SPARK-17599] Prevent ListingFileCatalog from failing if...
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15153 cc @marmbrus @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15153: [SPARK-17599] Prevent ListingFileCatalog from failing if...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15153 **[Test build #65611 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65611/consoleFull)** for PR 15153 at commit [`e4e8f1a`](https://github.com/apache/spark/commit/e4e8f1a5097a1a90163705a7b99dc33e5f32d925). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
