[GitHub] spark pull request: WHITESPACE CHANGE DO NOT MERGE
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5910#issuecomment-99543031 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6812][SparkR] filter() on DataFrame doe...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5938#issuecomment-99659725 @shivaram -- i seriously have no clue as to what's going on... you're an overall GHPRB admin for amplab jenkins, as well as for the spark PRB (as am i). anyways, after the spate of errors over the last week (post-power-outage), i'll schedule an emergency restart for tomorrow morning. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6812][SparkR] filter() on DataFrame doe...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5938#issuecomment-99657929 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6812][SparkR] filter() on DataFrame doe...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5938#issuecomment-99657911 sigh. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6812][SparkR] filter() on DataFrame doe...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5938#issuecomment-99657960 (i think we're due a jenkins restart tomorrow morning) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6812][SparkR] filter() on DataFrame doe...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5938#issuecomment-99660165 @shivaram -- can you try and trigger another build? i've increased the log chattiness and hopefully i can see what's happening now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6841] [SPARKR] add support for mean, me...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5446#issuecomment-99248943 yep. i'll take worker 03 offline until i can get a chance to investigate (i'm OOO this afternoon). Thanks for the catch! @shaneknapp https://github.com/shaneknapp this seems to have hit the same error from maven â Reply to this email directly or view it on GitHub https://github.com/apache/spark/pull/5446#issuecomment-99236952. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: WHITESPACE CHANGE DO NOT MERGE
GitHub user shaneknapp opened a pull request: https://github.com/apache/spark/pull/5910 WHITESPACE CHANGE DO NOT MERGE You can merge this pull request into a Git repository by running: $ git pull https://github.com/shaneknapp/spark whitespace_change Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/5910.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #5910 commit 60b9f0b83b93043eb4daee44d21fef3e24492f88 Author: shane knapp incompl...@gmail.com Date: 2015-05-05T16:05:41Z WHITESPACE CHANGE DO NOT MERGE --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7249] Updated Hadoop dependencies due t...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5786#issuecomment-98434090 ah cool, got it. thanks sean! On Sat, May 2, 2015 at 3:49 AM, Sean Owen notificati...@github.com wrote: @shaneknapp https://github.com/shaneknapp if this goes in, then the essence of the config change is this: anything building for Hadoop 1.x, 2.0, or 2.1 now needs -Phadoop-1 to maintain the same config. Anything that used to specify -Phadoop-2.2 -Dhadoop.version=2.2.0 doesn't need to, as that's the default. Anything that doesn't specify profiles will get Hadoop 2.2. I believe this therefore just affects the Spark-Master-Maven-pre-YARN job in Jenkins, and certainly only affects master. Both of those jobs could use -Phadoop-1. Looks like we don't have a Hadoop 2.2 specific build? that's fine, but then there's nothing along those lines to change. â Reply to this email directly or view it on GitHub https://github.com/apache/spark/pull/5786#issuecomment-98347284. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
Github user shaneknapp commented on a diff in the pull request:
https://github.com/apache/spark/pull/5817#discussion_r29508843
--- Diff: dev/run-tests-jenkins ---
@@ -171,15 +171,14 @@ for t in ${PR_TESTS[@]}; do
# Ensure the test can be found and is a file
if [ -f ${this_test} ]; then
echo Running test: $t
-this_mssg=$(bash ${this_test} ${ghprbActualCommit} ${sha1}
${current_pr_head})
-# Check if this is the merge test as we submit that note *before* and
*after*
-# the tests run
-[ $t == pr_merge_ability ] merge_note=${this_mssg}
+this_mssg=$(bash ${this_test} ${ghprbActualCommit} ${sha1}
${current_pr_head} 2 /dev/null)
+
pr_message=${pr_message}\n${this_mssg}
# Ensure, after each test, that we're back on the current PR
git checkout -f ${current_pr_head} /dev/null
else
echo Cannot find test ${this_test}.
+die 1
--- End diff --
thanks, nice catch. s/die/exit
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5817#issuecomment-98161829 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5817#issuecomment-98179614 jenkins, test this please On Fri, May 1, 2015 at 9:57 AM, UCB AMPLab notificati...@github.com wrote: Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31567/ Test FAILed. â Reply to this email directly or view it on GitHub https://github.com/apache/spark/pull/5817#issuecomment-98177301. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7249] Updated Hadoop dependencies due t...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5786#issuecomment-98219552 what exactly will need to be changed in the build configs? there's a lot of places that hadoop is specified: multi-project axis configs, maven opts (for other projects that use spark), etc. depending on the extent of the config wrangling, i might want to have a brief downtime to ensure i do it right. :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5817#issuecomment-98203869 jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5817#issuecomment-98237474 alright, this looks to be all i can winnow out of the maze of build scripts right now... i'll open up another PR if i find more offending stuff. :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
Github user shaneknapp commented on a diff in the pull request:
https://github.com/apache/spark/pull/5817#discussion_r29533973
--- Diff: dev/run-tests-jenkins ---
@@ -171,15 +171,14 @@ for t in ${PR_TESTS[@]}; do
# Ensure the test can be found and is a file
if [ -f ${this_test} ]; then
echo Running test: $t
-this_mssg=$(bash ${this_test} ${ghprbActualCommit} ${sha1}
${current_pr_head})
-# Check if this is the merge test as we submit that note *before* and
*after*
-# the tests run
-[ $t == pr_merge_ability ] merge_note=${this_mssg}
--- End diff --
note that the merge_note variable isn't used anywhere, and the this_mssg
variable is always applied (below) to pr_message
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5817#issuecomment-98240563 @pwendell -- no worries, this is mostly to just clean up noisy build logs. we can revisit this whenever you're ready. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7017][Build][Project Infra]: Refactor d...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5694#issuecomment-98242052 @nchammas -- totally understood! :) @brennonyork -- i'm looking forward to spending some time digging in to this code next week --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7214] Reserve space for unrolling even ...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5784#issuecomment-97909684 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7214] Reserve space for unrolling even ...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5784#issuecomment-97894913 so, believe it or not, the jenkins bash environment is actually atomic (all machines are identical hardware, same kernel, system updates, package versions, ssh bash environment, etc). you can see the bash environment for the worker this job executed on here (https://amplab.cs.berkeley.edu/jenkins/computer/amp-jenkins-worker-08/log), and it's identical to all of the other ones. regarding sha1, derp. i totally knew that. :p anyways, i'll poke around those shell scripts some more and see if there's anything i can tweak to better report/fail on errors. i'm also going to redir a lot of the git error output to /dev/null as it's been cluttering up the test logs. i know there's a PR to move this stuff to python, but for the time being i'll see if i can't make things better. once the PR is done i'll add you (@brennonyork) as a reviewer. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5817#issuecomment-97927713 @brennonyork --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
GitHub user shaneknapp opened a pull request: https://github.com/apache/spark/pull/5817 redir stderr better, remove unused code, better java exe detection You can merge this pull request into a Git repository by running: $ git pull https://github.com/shaneknapp/spark clean_up_stderr_in_test_infra Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/5817.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #5817 commit 9bae437d424c12e2639e2a13408ede574ea49234 Author: shane knapp incompl...@gmail.com Date: 2015-04-30T18:55:20Z redir stderr better, remove unused code, better java exe detection --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5817#issuecomment-97970305 ok, happened to me, too! investigating... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5817#issuecomment-97927914 i see a couple more spots i could /dev/null stuff... looking again, and another commit or two forthcoming --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: redir stderr better, remove unused code, bette...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5817#issuecomment-98008939 jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7214] Reserve space for unrolling even ...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5784#issuecomment-97610281 @brennonyork -- something seems strange w/the output of pr_public_classes.sh... i checked the jenkins output also, and it's reporting that the SHA1 is SHA1: origin/pr/5784/merge, which seems not right. thoughts? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4897] [PySpark] Python 3 support
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5173#issuecomment-97603182 ignore these comments -- this is me testing on our staging instance --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6856] [R] Make RDD information more use...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5667#issuecomment-96755037 jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6856] [R] Make RDD information more use...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5667#issuecomment-96751693 jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6856] [R] Make RDD information more use...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5667#issuecomment-96766146 ok, fixed On Sat, Apr 25, 2015 at 1:36 PM, shane knapp â incompl...@gmail.com wrote: I'm out of town for the weekend. I can check Sunday night. On Apr 25, 2015 12:17 PM, Shivaram Venkataraman notificati...@github.com wrote: @shaneknapp https://github.com/shaneknapp Jenkins doesn't seem to picking up the re-test request. Is this related to the outages we had yesterday ? â Reply to this email directly or view it on GitHub https://github.com/apache/spark/pull/5667#issuecomment-96264560. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6856] [R] Make RDD information more use...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5667#issuecomment-96275266 I'm out of town for the weekend. I can check Sunday night. On Apr 25, 2015 12:17 PM, Shivaram Venkataraman notificati...@github.com wrote: @shaneknapp https://github.com/shaneknapp Jenkins doesn't seem to picking up the re-test request. Is this related to the outages we had yesterday ? â Reply to this email directly or view it on GitHub https://github.com/apache/spark/pull/5667#issuecomment-96264560. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [minor] [build] Set java options when generati...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5615#issuecomment-94912457 guess i forgot to log myself out of the amplab account. :) lgtm! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4897] [PySpark] Python 3 support
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5173#issuecomment-93862558 woot! On Thu, Apr 16, 2015 at 4:22 PM, Josh Rosen notificati...@github.com wrote: I've merged this into master (1.4.0). Thanks @davies https://github.com/davies, @twneale https://github.com/twneale, @mengxr https://github.com/mengxr, and everyone else who helped to test this patch! â Reply to this email directly or view it on GitHub https://github.com/apache/spark/pull/5173#issuecomment-93861091. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4897] [PySpark] Python 3 support
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5173#issuecomment-91679811 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91358326 so i just grepped through the code and found stuff like this: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala: YarnSparkHadoopUtil.expandEnvironment(Environment.JAVA_HOME) + /bin/java, -server yarn/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnable.scala: YarnSparkHadoopUtil.expandEnvironment(Environment.JAVA_HOME) + /bin/java, i've never explicitly set JAVA_HOME in jenkins' slave user space before, but that's obviously why it's failing. that's pretty bad code imo. solutions: * explicitly set JAVA_HOME in each slave's config (bad, as it ties that slave to whatever is on system java) * if JAVA_HOME isn't set, use whatever java is in the path (good) * explicitly define which java version to test against in the jenkins build's config --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6440][CORE]Handle IPv6 addresses proper...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5424#issuecomment-91322259 whoops, i missed retriggering this build. :) jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91358660 btw i prefer #2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6440][CORE]Handle IPv6 addresses proper...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5424#issuecomment-91274650 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6190][core] create LargeByteBuffer for ...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5400#issuecomment-91274692 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91360942 oh, i just had a thought: i installed a couple of different versions of java through jenkins, and right now the tests are set in the config to use 'Default', which is system level java. i bet this is why JAVA_HOME isn't being set and why the tests are failing. @JoshRosen is going to set JAVA_HOME for us to get the builds green and then we can look a little deeper in to the problem. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91360301 cool. on our systems, at least, the system java we use is /usr/bin/java, which points (through /etc/alternatives), to /usr/java/latest (which itself is a link to /usr/java/jdk1.7.0_71/). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6264] [MLLIB] Support FPGrowth algorith...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5213#issuecomment-91274674 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5654] Integrate SparkR
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5096#issuecomment-91041894 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5654] Integrate SparkR
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5096#issuecomment-91040738 i'll up it to 180, just so we have some headroom. On Wed, Apr 8, 2015 at 2:21 PM, Shivaram Venkataraman notificati...@github.com wrote: @brennonyork https://github.com/brennonyork The overall Jenkins build runner has a timeout of 130 minutes right now (cc @shaneknapp https://github.com/shaneknapp). So all the RAT tests, Mima checks, style checks, new dependencies plus all the unit tests have to run within 130 minutes and this PR seems to be failing that. @shaneknapp https://github.com/shaneknapp can we increase the 130 min timeout to say 140 minutes ? â Reply to this email directly or view it on GitHub https://github.com/apache/spark/pull/5096#issuecomment-91040259. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5654] Integrate SparkR
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5096#issuecomment-91041984 also, i can't believe how long this build is... sad panda etc. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6492][CORE] SparkContext.stop() can dea...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5277#issuecomment-87874009 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6492][CORE] SparkContext.stop() can dea...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5277#issuecomment-87873998 whoops, my bad. didn't mean to kill this job. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6119][SQL] DataFrame support for missin...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5248#issuecomment-87874066 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6119][SQL] DataFrame support for missin...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5248#issuecomment-87874061 whoops, my bad. didn't mean to kill this job. retesting now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6299][CORE] ClassNotFoundException in s...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5046#issuecomment-81802097 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6313] Add config option to disable file...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5036#issuecomment-81804505 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6352] [SQL] Add DirectParquetOutputComm...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5042#issuecomment-81790432 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6299][CORE] ClassNotFoundException in s...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5046#issuecomment-81736014 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6299][CORE] ClassNotFoundException in s...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5046#issuecomment-81752785 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6299][CORE] ClassNotFoundException in s...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5046#issuecomment-81729919 this was me, i'll retrigger the job once maintenance is over. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6299][CORE] ClassNotFoundException in s...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5046#issuecomment-81745711 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5922][GraphX]: Add diff(other: RDD[Vert...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4733#issuecomment-79283689 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4848] Stand-alone cluster: Allow differ...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3699#issuecomment-79274011 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6222][STREAMING] Make sure batches are ...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4964#issuecomment-79375896 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4848] Stand-alone cluster: Allow differ...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3699#issuecomment-79376311 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5987] [MLlib] Save/load for GaussianMix...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4986#issuecomment-79307244 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6222][STREAMING] Make sure batches are ...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4964#issuecomment-79291957 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5987] [MLlib] Save/load for GaussianMix...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4986#issuecomment-79375733 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5922][GraphX]: Add diff(other: RDD[Vert...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4733#issuecomment-79376104 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6325] [core,yarn] Disallow reducing exe...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5018#issuecomment-79376490 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-6182 [BUILD] spark-parent pom needs to b...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4913#issuecomment-77396021 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: Spark-5854 personalized page rank
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4774#issuecomment-77410205 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-6186] [EC2] Make Tachyon version config...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4901#issuecomment-77409790 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: SPARK-6182 [BUILD] spark-parent pom needs to b...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4913#issuecomment-77390948 i will retrigger this test once we're done w/our maintenance. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5436] [MLlib] Validate GradientBoostedT...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4677#issuecomment-74958110 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5436] [MLlib] Validate GradientBoostedT...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4677#issuecomment-74958129 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-71975308 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] Various DataFrame DSL update.
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71975248 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71975286 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4264#issuecomment-71975278 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] Various DataFrame DSL update.
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71975259 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5474][Build]curl should support URL red...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4263#issuecomment-71975294 jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5474][Build]curl should support URL red...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4263#issuecomment-71975044 i will kick this off again once i restart jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5253] [ML] LinearRegression with L1/L2 ...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4259#issuecomment-71975031 i will kick this off again once i restart jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SQL] Various DataFrame DSL update.
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4260#issuecomment-71975104 i will kick this off again once i restart jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5475][CORE] Java 8 tests are like maint...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/4264#issuecomment-71975011 i will kick this off again once i restart jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3798#issuecomment-71975061 i will kick this off again once i restart jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4006] In long running contexts, we enco...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2914#issuecomment-67101629 jenkins, test this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-66796958 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-66797630 testing the numpy version bump now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-66804428 ok, i think we're good on the numpy front -- it's failing now in new and exciting ways. :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [PySpark] Fix tests with Python 2.6 in 1.0 bra...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3668#issuecomment-66835922 woot! :) On Fri, Dec 12, 2014 at 12:47 PM, UCB AMPLab notificati...@github.com wrote: Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24414/ Test PASSed. â Reply to this email directly or view it on GitHub https://github.com/apache/spark/pull/3668#issuecomment-66832650. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-3431] [WIP] Parallelize test execution
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3564#issuecomment-66837976 i'm gonna kill the 22418 build and retrigger. need to restart jenkins really quick. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-3431] [WIP] Parallelize test execution
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3564#issuecomment-66838097 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-3431] [WIP] Parallelize test execution
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3564#issuecomment-66838179 thanks for the patience @nchammas ! :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [PySpark] Fix tests with Python 2.6 in 1.0 bra...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3668#issuecomment-66677019 would you guys be adverse to me upping the numpy version on the workers? currently, we're running numpy-1.4.1-9.el6.x86_64, which is ancient compared to the LG release (1.9.1). anyone know of any backwards-compatibility issues offhand? in the meanwhile, i will set up one of our staging nodes and start testing. i'd rather not to a system-wide update during a release cycle if at all possible... but if i have to do this, i will bring up some new jenkins workers (which i was going to do during tomorrow morning's maintanence anyways) w/an updated numpy specifically for these buids. since i'm not too familiar w/the codebase, i'll leave that part to you guys for now. :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-66677820 https://github.com/apache/spark/pull/3668 looks like a numpy upgrade is coming. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [PySpark] Fix tests with Python 2.6 in 1.0 bra...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3668#issuecomment-66702325 ok, sgtm. since we're not blocking the release, i'll just get everything staged and do the upgrade during the scheduled maintenance tomorrow morning. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-66702369 we'll do the numpy upgrade tomorrow morning during the scheduled outage. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-66375546 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4006] In long running contexts, we enco...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2914#issuecomment-66375507 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-66377357 i'm going to fail this job as i need to restart the jenkins worker that this is on. after that i will retrigger the build. sorry for the inconvenience! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-66379552 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-66392666 all of our worker nodes have numpy-1.4.1-9.el6.x86_64 installed on them, and have had this for months. i'm home for the evening, but we can do git archaeology tomorrow and find out when/where this req changed. On Tue, Dec 9, 2014 at 5:14 PM, andrewor14 notificati...@github.com wrote: Just so we don't lose track of the test failure message again. The PySpark tests are failing with the following. Looks like we need to have the correct version of numpy installed when testing against older branches too. Traceback (most recent call last): File pyspark/mllib/regression.py, line 20, in module from pyspark.mllib._common import \ File /home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/mllib/__init__.py, line 26, in module raise Exception(MLlib requires NumPy 1.7+) Exception: MLlib requires NumPy 1.7+ â Reply to this email directly or view it on GitHub https://github.com/apache/spark/pull/2854#issuecomment-66389265. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4508] [SQL] build native date type to c...
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/3381#issuecomment-64316830 i'll have the time to take a closer look at this tomorrow. On Mon, Nov 24, 2014 at 9:59 PM, Daoyuan Wang notificati...@github.com wrote: @liancheng https://github.com/liancheng can you reproduce the build error locally? I think it is a bug of Jenkins. â Reply to this email directly or view it on GitHub https://github.com/apache/spark/pull/3381#issuecomment-64314147. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
