shaneknapp commented on issue #23729: [SPARK-7721][INFRA][FOLLOW-UP] Remove 
cloned coverage repo after posting HTMLs
URL: https://github.com/apache/spark/pull/23729#issuecomment-505638904
 
 
   i had to manually clean up all of the workers and remove existing 
`pyspark-coverage-site` dirs to get the build green again.
   
   why `git clean -fdx` isn't actually removing that dir is beyond me.  :\
   
   for an example, see:  
https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.7/6047/console
   
   this is the output of the `git clean -fdx` command:
   ```
   [spark-master-test-sbt-hadoop-2.7] $ /bin/bash 
/tmp/hudson4664062016256370877.sh
   Removing R/lib/
   Removing R/pkg/man/
   Removing dev/sparktestsupport/__init__.pyc
   Removing dev/sparktestsupport/modules.pyc
   Removing dev/sparktestsupport/shellutils.pyc
   Removing dev/sparktestsupport/toposort.pyc
   Removing lib/
   Removing pyspark-coverage-site/
   Removing target/
   ```
   
   great!  `pyspark-coverage-site` removed!  yay!
   
   however:
   ```
   ========================================================================
   Running Apache RAT checks
   ========================================================================
   Attempting to fetch rat
   Could not find Apache license headers in the following files:
    !????? 
/home/jenkins/workspace/spark-master-test-sbt-hadoop-2.7/pyspark-coverage-site/index.html
    !????? 
/home/jenkins/workspace/spark-master-test-sbt-hadoop-2.7/pyspark-coverage-site/jquery.ba-throttle-debounce.min.js
    !????? 
/home/jenkins/workspace/spark-master-test-sbt-hadoop-2.7/pyspark-coverage-site/jquery.hotkeys.js
    !????? 
/home/jenkins/workspace/spark-master-test-sbt-hadoop-2.7/pyspark-coverage-site/jquery.isonscreen.js
    !????? 
/home/jenkins/workspace/spark-master-test-sbt-hadoop-2.7/pyspark-coverage-site/jquery.min.js
    !????? 
/home/jenkins/workspace/spark-master-test-sbt-hadoop-2.7/pyspark-coverage-site/jquery.tablesorter.min.js
    !????? 
/home/jenkins/workspace/spark-master-test-sbt-hadoop-2.7/pyspark-coverage-site/pyspark_cloudpickle_py.html
    !????? 
/home/jenkins/workspace/spark-master-test-sbt-hadoop-2.7/pyspark-coverage-site/pyspark_heapq3_py.html
    !????? 
/home/jenkins/workspace/spark-master-test-sbt-hadoop-2.7/pyspark-coverage-site/pyspark_join_py.html
   ```
   
   so i ran this command to clean stuff up:  `$ pssh -h centos_workers.txt -i 
"rm -rf workspace/spark-master-test-sbt-hadoop-2.7/pyspark-coverage-site/"`
   
   then i launched a build, and it passed the RAT check:
   
https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.7/6056/

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to