[jira] [Reopened] (SPARK-28701) add java11 support for spark pull request builds

2019-08-26 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp reopened SPARK-28701: - argh, i broke run-tests.py: https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop

[jira] [Resolved] (SPARK-28701) add java11 support for spark pull request builds

2019-08-26 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp resolved SPARK-28701. - Resolution: Fixed Issue resolved by pull request 25585 [https://github.com/apache/spark/pull/255

[jira] [Commented] (SPARK-28900) Test Pyspark, SparkR on JDK 11 with run-tests

2019-08-28 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917921#comment-16917921 ] shane knapp commented on SPARK-28900: - some quick comments: * this jenkins installat

[jira] [Commented] (SPARK-28900) Test Pyspark, SparkR on JDK 11 with run-tests

2019-08-28 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917932#comment-16917932 ] shane knapp commented on SPARK-28900: - oh yeah, i forgot the most important thing:

[jira] [Commented] (SPARK-28900) Test Pyspark, SparkR on JDK 11 with run-tests

2019-08-28 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917937#comment-16917937 ] shane knapp commented on SPARK-28900: - i don't think we can sever things right now f

[jira] [Commented] (SPARK-28900) Test Pyspark, SparkR on JDK 11 with run-tests

2019-08-28 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917939#comment-16917939 ] shane knapp commented on SPARK-28900: - i kinda think it's time to boil the ocean, tb

[jira] [Commented] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-03 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921691#comment-16921691 ] shane knapp commented on SPARK-28953: - could you link to a build that failed this wa

[jira] [Commented] (SPARK-28900) Test Pyspark, SparkR on JDK 11 with run-tests

2019-09-04 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922681#comment-16922681 ] shane knapp commented on SPARK-28900: - hey everyone, i have to back-burner this issu

[jira] [Commented] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-04 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922684#comment-16922684 ] shane knapp commented on SPARK-28953: - [~skonto] we're currently on minikube v0.34.1

[jira] [Assigned] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-12 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp reassigned SPARK-29066: --- Assignee: shane knapp > Remove old Jenkins jobs for EOL versions or obsolete combinations >

[jira] [Commented] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-12 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928620#comment-16928620 ] shane knapp commented on SPARK-29066: - yep, i can take care of this pretty easily.

[jira] [Commented] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-12 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928816#comment-16928816 ] shane knapp commented on SPARK-29066: - i am currently deleting old jobs w/absolute r

[jira] [Commented] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-12 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928824#comment-16928824 ] shane knapp commented on SPARK-29066: - done! that was quite satisfying. :) > Remo

[jira] [Resolved] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-12 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp resolved SPARK-29066. - Resolution: Fixed > Remove old Jenkins jobs for EOL versions or obsolete combinations >

[jira] [Commented] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-12 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928991#comment-16928991 ] shane knapp commented on SPARK-29066: - done > Remove old Jenkins jobs for EOL versi

[jira] [Commented] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-13 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929396#comment-16929396 ] shane knapp commented on SPARK-29066: - done... this is great! the jenkins build li

[jira] [Commented] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-13 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929493#comment-16929493 ] shane knapp commented on SPARK-29066: - i'm also going through all of the centos and

[jira] [Commented] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-13 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929510#comment-16929510 ] shane knapp commented on SPARK-29066: - well, we weren't actually stressed for space.

[jira] [Commented] (SPARK-29183) Upgrade JDK 11 Installation to 11.0.4

2019-09-19 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933840#comment-16933840 ] shane knapp commented on SPARK-29183: - good point. i won't be able to get started u

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

2019-09-20 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934567#comment-16934567 ] shane knapp commented on SPARK-29129: - this seems reasonable to me given the circums

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

2019-09-20 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934823#comment-16934823 ] shane knapp commented on SPARK-29129: - i will happily continue to delete jobs! and

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

2019-09-20 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934825#comment-16934825 ] shane knapp commented on SPARK-29129: - all three have been deleted. > Test failure:

[jira] [Commented] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination)

2019-09-20 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934828#comment-16934828 ] shane knapp commented on SPARK-29129: - [~dongjoon] especially when it involves delet

[jira] [Commented] (SPARK-29204) Remove `Spark Release` Jenkins tab and its four jobs

2019-09-23 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935946#comment-16935946 ] shane knapp commented on SPARK-29204: - yeah, i'll get around to this later today (as

[jira] [Commented] (SPARK-29204) Remove `Spark Release` Jenkins tab and its four jobs

2019-09-23 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936034#comment-16936034 ] shane knapp commented on SPARK-29204: - today, in order, i will: 1) delete the confi

[jira] [Commented] (SPARK-29204) Remove `Spark Release` Jenkins tab and its four jobs

2019-09-23 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936051#comment-16936051 ] shane knapp commented on SPARK-29204: - for those w/perms to see the JJB databricks r

[jira] [Commented] (SPARK-29204) Remove `Spark Release` Jenkins tab and its four jobs

2019-09-23 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936060#comment-16936060 ] shane knapp commented on SPARK-29204: - PR merged. deleting jobs + views now. thank

[jira] [Commented] (SPARK-29204) Remove `Spark Release` Jenkins tab and its four jobs

2019-09-23 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936066#comment-16936066 ] shane knapp commented on SPARK-29204: - done, done and done. > Remove `Spark Release

[jira] [Resolved] (SPARK-29204) Remove `Spark Release` Jenkins tab and its four jobs

2019-09-23 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp resolved SPARK-29204. - Assignee: shane knapp Resolution: Fixed > Remove `Spark Release` Jenkins tab and its four

[jira] [Commented] (SPARK-29220) Flaky test: org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) [hadoop-3.2][java11]

2019-09-24 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937120#comment-16937120 ] shane knapp commented on SPARK-29220: - for https://amplab.cs.berkeley.edu/jenkins/j

[jira] [Issue Comment Deleted] (SPARK-29220) Flaky test: org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) [hadoop-3.2][java11]

2019-09-24 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-29220: Comment: was deleted (was: for https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[jira] [Commented] (SPARK-29220) Flaky test: org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) [hadoop-3.2][java11]

2019-09-24 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937124#comment-16937124 ] shane knapp commented on SPARK-29220: - ARGH i just messed up and accidentally overwr

[jira] [Commented] (SPARK-29220) Flaky test: org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) [hadoop-3.2][java11]

2019-09-24 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937126#comment-16937126 ] shane knapp commented on SPARK-29220: - hmm, i see that https://github.com/apache/spa

[jira] [Commented] (SPARK-29220) Flaky test: org.apache.spark.deploy.yarn.LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) [hadoop-3.2][java11]

2019-09-24 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937155#comment-16937155 ] shane knapp commented on SPARK-29220: - it's ok... let's try and keep an eye on thes

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

2020-07-06 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152144#comment-17152144 ] Shane Knapp commented on SPARK-31693: - please provide examples or links to examples.

[jira] [Commented] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

2020-07-06 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152175#comment-17152175 ] Shane Knapp commented on SPARK-32153: - i wiped the m2 directory from worker-04 > .m

[jira] [Comment Edited] (SPARK-31693) Investigate AmpLab Jenkins server network issue

2020-07-06 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152144#comment-17152144 ] Shane Knapp edited comment on SPARK-31693 at 7/6/20, 5:25 PM:

[jira] [Resolved] (SPARK-32153) .m2 repository corruption can happen on Jenkins-worker4

2020-07-06 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-32153. - Resolution: Fixed > .m2 repository corruption can happen on Jenkins-worker4 > --

[jira] [Commented] (SPARK-32278) Install PyPy3 on Jenkins to enable PySpark tests with PyPy

2020-07-13 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156842#comment-17156842 ] Shane Knapp commented on SPARK-32278: - which version of pypy3 are we interested in? 

[jira] [Comment Edited] (SPARK-32278) Install PyPy3 on Jenkins to enable PySpark tests with PyPy

2020-07-13 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156842#comment-17156842 ] Shane Knapp edited comment on SPARK-32278 at 7/13/20, 5:03 PM: ---

[jira] [Commented] (SPARK-32279) Install Sphinx in Python 3 on Jenkins machines

2020-07-13 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156846#comment-17156846 ] Shane Knapp commented on SPARK-32279: - any particular version of sphinx  you want in

[jira] [Commented] (SPARK-32279) Install Sphinx in Python 3 on Jenkins machines

2020-07-14 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157571#comment-17157571 ] shane knapp commented on SPARK-32279: - hmm, this is going to be a little bit more co

[jira] [Commented] (SPARK-32279) Install Sphinx in Python 3 on Jenkins machines

2020-07-14 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157573#comment-17157573 ] shane knapp commented on SPARK-32279: - never mind. we're not doing this for pypy.

[jira] [Resolved] (SPARK-32279) Install Sphinx in Python 3 on Jenkins machines

2020-07-14 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-32279. - Resolution: Fixed > Install Sphinx in Python 3 on Jenkins machines > ---

[jira] [Commented] (SPARK-32279) Install Sphinx in Python 3 on Jenkins machines

2020-07-14 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157574#comment-17157574 ] Shane Knapp commented on SPARK-32279: - done > Install Sphinx in Python 3 on Jenkins

[jira] [Commented] (SPARK-32326) R version is too old on Jenkins k8s PRB

2020-07-17 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160182#comment-17160182 ] Shane Knapp commented on SPARK-32326: - {quote}jenkins@research-jenkins-worker-09:~$

[jira] [Resolved] (SPARK-32326) R version is too old on Jenkins k8s PRB

2020-07-17 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-32326. - Resolution: Fixed > R version is too old on Jenkins k8s PRB > --

[jira] [Resolved] (SPARK-25152) Enable Spark on Kubernetes R Integration Tests

2019-10-14 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-25152. - Assignee: Ilan Filonenko Resolution: Fixed merged in to master > Enable Spark on Kubernet

[jira] [Created] (SPARK-29467) dev/merge_spark_pr.py fails on CAPTCHA

2019-10-14 Thread Shane Knapp (Jira)
Shane Knapp created SPARK-29467: --- Summary: dev/merge_spark_pr.py fails on CAPTCHA Key: SPARK-29467 URL: https://issues.apache.org/jira/browse/SPARK-29467 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29467) dev/merge_spark_pr.py fails on CAPTCHA

2019-10-14 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29467: Description: so, i was merging a PR and when i tried to update the associated jira, it failed and

[jira] [Updated] (SPARK-29467) dev/merge_spark_pr.py fails on CAPTCHA

2019-10-14 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29467: Description: so, i was merging a PR and when i tried to update the associated jira, it failed and

[jira] [Commented] (SPARK-27177) Update jenkins locale to en_US.UTF-8

2019-10-16 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953045#comment-16953045 ] Shane Knapp commented on SPARK-27177: - this is done! > Update jenkins locale to en_

[jira] [Resolved] (SPARK-27177) Update jenkins locale to en_US.UTF-8

2019-10-16 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-27177. - Resolution: Fixed > Update jenkins locale to en_US.UTF-8 >

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-17 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953856#comment-16953856 ] Shane Knapp commented on SPARK-29106: - worker is up and sshable from the jenkins mas

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-17 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953878#comment-16953878 ] Shane Knapp commented on SPARK-29106: - this is great. i will think about test strat

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-17 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953896#comment-16953896 ] Shane Knapp commented on SPARK-29106: - first build running: https://amplab.cs.berkel

[jira] [Comment Edited] (SPARK-29106) Add jenkins arm test for spark

2019-10-17 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953896#comment-16953896 ] Shane Knapp edited comment on SPARK-29106 at 10/17/19 5:36 PM: ---

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-17 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954210#comment-16954210 ] Shane Knapp commented on SPARK-29106: - [~bzhaoopenstack] [~huangtianhua] yeah i was

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-18 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954705#comment-16954705 ] Shane Knapp commented on SPARK-29106: - re: real time logging -- yeah i noticed that.

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-18 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954809#comment-16954809 ] Shane Knapp commented on SPARK-29106: - we're definitely going to have an issue w/the

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-18 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954904#comment-16954904 ] Shane Knapp commented on SPARK-29106: - i'm actually not going to use the script – th

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-18 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954912#comment-16954912 ] Shane Knapp commented on SPARK-29106: - also, i will be exploring the purchase of an

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-21 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956298#comment-16956298 ] Shane Knapp commented on SPARK-29106: - > I find the arm job now is triggered by 'SCM

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-23 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16958019#comment-16958019 ] Shane Knapp commented on SPARK-29106: - [~huangtianhua]: > we don't have to download

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-23 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16958056#comment-16958056 ] Shane Knapp commented on SPARK-29106: - > For pyspark test, you mentioned we didn't i

[jira] [Updated] (SPARK-29106) Add jenkins arm test for spark

2019-10-23 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29106: Attachment: R-libs.txt R-ansible.yml > Add jenkins arm test for spark > --

[jira] [Comment Edited] (SPARK-29106) Add jenkins arm test for spark

2019-10-23 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16958056#comment-16958056 ] Shane Knapp edited comment on SPARK-29106 at 10/23/19 5:29 PM: ---

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-24 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959124#comment-16959124 ] Shane Knapp commented on SPARK-29106: - > First I want to share the details what we h

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-24 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959153#comment-16959153 ] Shane Knapp commented on SPARK-29106: - btw the VM is currently experiencing a lot of

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-24 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959204#comment-16959204 ] Shane Knapp commented on SPARK-29106: - i bumped the git timeout to 30mins, which is

[jira] [Commented] (SPARK-29624) Jenkins fails with "Python versions prior to 2.7 are not supported."

2019-10-28 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961290#comment-16961290 ] Shane Knapp commented on SPARK-29624: - nothing changed... the PATH env vars for eac

[jira] [Commented] (SPARK-29624) Jenkins fails with "Python versions prior to 2.7 are not supported."

2019-10-28 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961320#comment-16961320 ] Shane Knapp commented on SPARK-29624: - alright, i triggered a job and checked the co

[jira] [Commented] (SPARK-29624) Jenkins fails with "Python versions prior to 2.7 are not supported."

2019-10-28 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961377#comment-16961377 ] Shane Knapp commented on SPARK-29624: - alright, a pull request build has successfull

[jira] [Resolved] (SPARK-29624) Jenkins fails with "Python versions prior to 2.7 are not supported."

2019-10-28 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-29624. - Resolution: Fixed > Jenkins fails with "Python versions prior to 2.7 are not supported." > -

[jira] [Created] (SPARK-29672) remove python2 test from python/run-tests.py

2019-10-30 Thread Shane Knapp (Jira)
Shane Knapp created SPARK-29672: --- Summary: remove python2 test from python/run-tests.py Key: SPARK-29672 URL: https://issues.apache.org/jira/browse/SPARK-29672 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-29673) upgrade jenkins pypy to PyPy3.6 v7.2.0

2019-10-30 Thread Shane Knapp (Jira)
Shane Knapp created SPARK-29673: --- Summary: upgrade jenkins pypy to PyPy3.6 v7.2.0 Key: SPARK-29673 URL: https://issues.apache.org/jira/browse/SPARK-29673 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-30 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963505#comment-16963505 ] Shane Knapp commented on SPARK-29106: - first pass @ the python tests: https://amplab

[jira] [Commented] (SPARK-29673) upgrade jenkins pypy to PyPy3.6 v7.2.0

2019-10-31 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964359#comment-16964359 ] Shane Knapp commented on SPARK-29673: - pypy3.6-7.2.0-linux_x86_64-portable has been

[jira] [Updated] (SPARK-29106) Add jenkins arm test for spark

2019-11-07 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29106: Attachment: arm-python36.txt > Add jenkins arm test for spark > -- > >

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-11-07 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969615#comment-16969615 ] Shane Knapp commented on SPARK-29106: - just uploaded the pip requirements.txt file t

[jira] [Updated] (SPARK-29672) remove python2 tests and test infra

2019-11-07 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29672: Summary: remove python2 tests and test infra (was: remove python2 test from python/run-tests.py)

[jira] [Updated] (SPARK-29672) remove python2 tests and test infra

2019-11-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29672: Attachment: print_function_list.txt > remove python2 tests and test infra > --

[jira] [Updated] (SPARK-29672) remove python2 tests and test infra

2019-11-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29672: Description: python 2.7 is EOL jan 1st 2020: [https://github.com/python/devguide/pull/344] it's t

[jira] [Commented] (SPARK-29673) upgrade jenkins pypy to PyPy3.6 v7.2.0

2019-11-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970496#comment-16970496 ] Shane Knapp commented on SPARK-29673: - [~hyukjin.kwon] pypy3.6 is available on all j

[jira] [Created] (SPARK-29802) update remaining python scripts in repo to python3 shebang

2019-11-08 Thread Shane Knapp (Jira)
Shane Knapp created SPARK-29802: --- Summary: update remaining python scripts in repo to python3 shebang Key: SPARK-29802 URL: https://issues.apache.org/jira/browse/SPARK-29802 Project: Spark Issu

[jira] [Updated] (SPARK-29672) remove python2 tests and test infra

2019-11-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29672: Attachment: (was: print_function_list.txt) > remove python2 tests and test infra > ---

[jira] [Updated] (SPARK-29672) remove python2 tests and test infra

2019-11-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29672: Description: python 2.7 is EOL jan 1st 2020: [https://github.com/python/devguide/pull/344] it's t

[jira] [Created] (SPARK-29803) remove all instances of 'from __future__ import print_function'

2019-11-08 Thread Shane Knapp (Jira)
Shane Knapp created SPARK-29803: --- Summary: remove all instances of 'from __future__ import print_function' Key: SPARK-29803 URL: https://issues.apache.org/jira/browse/SPARK-29803 Project: Spark

[jira] [Updated] (SPARK-29803) remove all instances of 'from __future__ import print_function'

2019-11-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29803: Attachment: print_function_list.txt > remove all instances of 'from __future__ import print_functi

[jira] [Resolved] (SPARK-29673) upgrade jenkins pypy to PyPy3.6 v7.2.0

2019-11-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-29673. - Resolution: Fixed > upgrade jenkins pypy to PyPy3.6 v7.2.0 > ---

[jira] [Commented] (SPARK-29803) remove all instances of 'from __future__ import print_function'

2019-11-08 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970527#comment-16970527 ] Shane Knapp commented on SPARK-29803: - i actually believe that we can do this at any

[jira] [Commented] (SPARK-29803) remove all instances of 'from __future__ import print_function'

2019-11-11 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971866#comment-16971866 ] Shane Knapp commented on SPARK-29803: - so after reading the python2 EOL roadmap/anno

[jira] [Commented] (SPARK-29672) remove python2 tests and test infra

2019-11-11 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971868#comment-16971868 ] Shane Knapp commented on SPARK-29672: - the PR is complete, all tests pass and i'm wa

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-11-12 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972697#comment-16972697 ] Shane Knapp commented on SPARK-29106: - i would definitely be happy to have a faster

[jira] [Updated] (SPARK-29672) update spark testing framework to use python3

2019-11-14 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29672: Summary: update spark testing framework to use python3 (was: remove python2 tests and test infra)

[jira] [Updated] (SPARK-29672) update spark testing framework to use python3

2019-11-14 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp updated SPARK-29672: Description: python 2.7 is EOL jan 1st 2020: [https://github.com/python/devguide/pull/344] it's t

[jira] [Resolved] (SPARK-29672) update spark testing framework to use python3

2019-11-14 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-29672. - Resolution: Fixed > update spark testing framework to use python3 >

[jira] [Created] (SPARK-29919) remove python2 test execution

2019-11-15 Thread Shane Knapp (Jira)
Shane Knapp created SPARK-29919: --- Summary: remove python2 test execution Key: SPARK-29919 URL: https://issues.apache.org/jira/browse/SPARK-29919 Project: Spark Issue Type: Sub-task Co

[jira] [Commented] (SPARK-29935) Remove `Spark QA Compile` Jenkins Dashboard (and jobs)

2019-11-19 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16977740#comment-16977740 ] Shane Knapp commented on SPARK-29935: - these jobs are actually pretty cheap, resourc

[jira] [Assigned] (SPARK-29935) Remove `Spark QA Compile` Jenkins Dashboard (and jobs)

2019-11-19 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp reassigned SPARK-29935: --- Assignee: Shane Knapp > Remove `Spark QA Compile` Jenkins Dashboard (and jobs) > --

<    1   2   3   4   5   6   7   8   >