[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17276 @mridulm @squito Thanks a lot for taking time review this pr. I will close it for now and make another one if there is progress. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76454/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #76454 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76454/testReport)** for PR 17276 at commit [`873129f`](https://github.com/apache/spark/commit/873129f783d154c96803e13b94f8f16c2922cb68). * This patch **fails to generate documentation**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #76454 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76454/testReport)** for PR 17276 at commit [`873129f`](https://github.com/apache/spark/commit/873129f783d154c96803e13b94f8f16c2922cb68). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17276 @squito Thanks a lot for taking time looking into this pr. I updated the pr. Currently just add two metrics: a) the total size of underestimated blocks size, b) the size of blocks shuffled to memory. For a), executor use `maxBytesInFlight` to control the speed of shuffle-read. I agree with your comment `another metric that may be nice to capture here is maximum underestimate`. But think about this scenario: the maximum is small, but thousands of blocks are underestimated, thus `maxBytesInFlight` cannot help avoid the OOM during shuffle-read. That's why I proposed to track the metrics of total size of underestimated blocks size; For b), currently all data are shuffled-read to memory. If we add the feature of shuffling to disk when memory shortage, we need to evaluate the performance. I think another two metrics need to be taken into account: the size of blocks shuffled to disk(to be added in another pr) and task's running time(already exist). The more data shuffled to memory, the better performance; The shorter time cost, the better performance. I also added some log for debug in `ShuffleWriter`, including the num of underestimated blocks and the size distribution. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #75229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75229/testReport)** for PR 17276 at commit [`8801fc6`](https://github.com/apache/spark/commit/8801fc6454fc09d417dea563cd07cc255ae009b9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75220/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #75220 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75220/testReport)** for PR 17276 at commit [`c26ea56`](https://github.com/apache/spark/commit/c26ea561579a76f3370fc2ebc07314e788dc32a1). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #75220 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75220/testReport)** for PR 17276 at commit [`c26ea56`](https://github.com/apache/spark/commit/c26ea561579a76f3370fc2ebc07314e788dc32a1). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #75163 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75163/testReport)** for PR 17276 at commit [`0efa348`](https://github.com/apache/spark/commit/0efa348d1beccf76da702d06ee77c8aac2aebb12). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75163/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #75163 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75163/testReport)** for PR 17276 at commit [`0efa348`](https://github.com/apache/spark/commit/0efa348d1beccf76da702d06ee77c8aac2aebb12). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75146/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #75146 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75146/testReport)** for PR 17276 at commit [`c58cb7e`](https://github.com/apache/spark/commit/c58cb7eefe8915c10090da0a43c74c2582e7d773). * This patch **fails MiMa tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #75145 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75145/testReport)** for PR 17276 at commit [`4f992fc`](https://github.com/apache/spark/commit/4f992fcd363bc7632da71093dfc8f61477d0cd1e). * This patch **fails MiMa tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75145/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #75146 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75146/testReport)** for PR 17276 at commit [`c58cb7e`](https://github.com/apache/spark/commit/c58cb7eefe8915c10090da0a43c74c2582e7d773). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #75145 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75145/testReport)** for PR 17276 at commit [`4f992fc`](https://github.com/apache/spark/commit/4f992fcd363bc7632da71093dfc8f61477d0cd1e). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75098/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #75098 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75098/testReport)** for PR 17276 at commit [`6a96c3b`](https://github.com/apache/spark/commit/6a96c3b2858ee53bad073040217182c19d5e7db0). * This patch **fails MiMa tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #75098 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75098/testReport)** for PR 17276 at commit [`6a96c3b`](https://github.com/apache/spark/commit/6a96c3b2858ee53bad073040217182c19d5e7db0). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17276 You are so kind person. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74665/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74665 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74665/testReport)** for PR 17276 at commit [`7cd290d`](https://github.com/apache/spark/commit/7cd290da23ce85440fb9bdef00ed87c317295a74). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74665 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74665/testReport)** for PR 17276 at commit [`7cd290d`](https://github.com/apache/spark/commit/7cd290da23ce85440fb9bdef00ed87c317295a74). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74607/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74607 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74607/testReport)** for PR 17276 at commit [`91e338b`](https://github.com/apache/spark/commit/91e338b52c911366b9e6cd209c8f09ad04a2acca). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74605/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74605 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74605/testReport)** for PR 17276 at commit [`2ccde1f`](https://github.com/apache/spark/commit/2ccde1f45ffd20cab4760afe5ab43815ce2813f1). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74607 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74607/testReport)** for PR 17276 at commit [`91e338b`](https://github.com/apache/spark/commit/91e338b52c911366b9e6cd209c8f09ad04a2acca). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74605 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74605/testReport)** for PR 17276 at commit [`2ccde1f`](https://github.com/apache/spark/commit/2ccde1f45ffd20cab4760afe5ab43815ce2813f1). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74509/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74509 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74509/testReport)** for PR 17276 at commit [`d0932ed`](https://github.com/apache/spark/commit/d0932ed6ba0dfe463d1e77e9cae79351d233effb). * This patch **fails from timeout after a configured wait of \`250m\`**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74515/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74515 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74515/testReport)** for PR 17276 at commit [`e2e56d3`](https://github.com/apache/spark/commit/e2e56d30319634c0307e4b916f79aa29ed0239a0). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74515 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74515/testReport)** for PR 17276 at commit [`e2e56d3`](https://github.com/apache/spark/commit/e2e56d30319634c0307e4b916f79aa29ed0239a0). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74509 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74509/testReport)** for PR 17276 at commit [`d0932ed`](https://github.com/apache/spark/commit/d0932ed6ba0dfe463d1e77e9cae79351d233effb). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74449/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74448/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17276 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74449/testReport)** for PR 17276 at commit [`648ceaa`](https://github.com/apache/spark/commit/648ceaafc977b442916834960122069237002e89). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17276: [WIP][SPARK-19937] Collect metrics of block sizes when s...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17276 **[Test build #74448 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74448/testReport)** for PR 17276 at commit [`430ec95`](https://github.com/apache/spark/commit/430ec95291393f49096fc07df98c15e700f23e8c). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org