Re: R installation broken on ubuntu workers, impacts K8s PRB builds

2020-07-17 Thread shane knapp ☠ 
this is done, except for amp-jenkins-staging-worker-02 which is refusing to
allow me to reinstall R...  i marked that worker offline and will beat on
it later today.

On Fri, Jul 17, 2020 at 11:36 AM shane knapp ☠  wrote:

> starting now...  pausing jenkins so no new builds are launched.
>
> On Thu, Jul 16, 2020 at 3:09 PM Holden Karau  wrote:
>
>> Sounds good, thanks. No rush :)
>>
>> On Thu, Jul 16, 2020 at 3:03 PM shane knapp ☠ 
>> wrote:
>>
>>> i'll get to this tomorrow afternoon, and there will be a short
>>> downtime.  more details to come.
>>>
>>> On Wed, Jul 15, 2020 at 12:17 PM Holden Karau 
>>> wrote:
>>>
 Oh cool, I filed a JIRA for this already and assigned it to you
 (noticed in one of my PRs)-
 https://issues.apache.org/jira/browse/SPARK-32326

 On Wed, Jul 15, 2020 at 12:09 PM shane knapp ☠ 
 wrote:

> i'm not entirely sure when the dep for R got bumped to 3.5+, but it's
> breaking the k8s builds.
>
> i'll need to purge these workers of all previous versions of R +
> packages, then reinstall from scratch.  this isn't a horrible task as i
> have most of it automated but it will still require a ~few hours of
> downtime.
>
> i'll file a JIRA, and figure out when i will be able to get to
> this...  possibly this afternoon.
> --
> Shane Knapp
> Computer Guy / Voice of Reason
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu
>


 --
 Twitter: https://twitter.com/holdenkarau
 Books (Learning Spark, High Performance Spark, etc.):
 https://amzn.to/2MaRAG9  
 YouTube Live Streams: https://www.youtube.com/user/holdenkarau

>>>
>>>
>>> --
>>> Shane Knapp
>>> Computer Guy / Voice of Reason
>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>> https://rise.cs.berkeley.edu
>>>
>> --
>> Twitter: https://twitter.com/holdenkarau
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9  
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>
>
> --
> Shane Knapp
> Computer Guy / Voice of Reason
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu
>


-- 
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

2020-07-17 Thread shane knapp ☠ 
starting now...  pausing jenkins so no new builds are launched.

On Thu, Jul 16, 2020 at 3:09 PM Holden Karau  wrote:

> Sounds good, thanks. No rush :)
>
> On Thu, Jul 16, 2020 at 3:03 PM shane knapp ☠  wrote:
>
>> i'll get to this tomorrow afternoon, and there will be a short downtime.
>> more details to come.
>>
>> On Wed, Jul 15, 2020 at 12:17 PM Holden Karau 
>> wrote:
>>
>>> Oh cool, I filed a JIRA for this already and assigned it to you (noticed
>>> in one of my PRs)- https://issues.apache.org/jira/browse/SPARK-32326
>>>
>>> On Wed, Jul 15, 2020 at 12:09 PM shane knapp ☠ 
>>> wrote:
>>>
 i'm not entirely sure when the dep for R got bumped to 3.5+, but it's
 breaking the k8s builds.

 i'll need to purge these workers of all previous versions of R +
 packages, then reinstall from scratch.  this isn't a horrible task as i
 have most of it automated but it will still require a ~few hours of
 downtime.

 i'll file a JIRA, and figure out when i will be able to get to this...
 possibly this afternoon.
 --
 Shane Knapp
 Computer Guy / Voice of Reason
 UC Berkeley EECS Research / RISELab Staff Technical Lead
 https://rise.cs.berkeley.edu

>>>
>>>
>>> --
>>> Twitter: https://twitter.com/holdenkarau
>>> Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9  
>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>
>>
>>
>> --
>> Shane Knapp
>> Computer Guy / Voice of Reason
>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>> https://rise.cs.berkeley.edu
>>
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9  
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>


-- 
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

2020-07-16 Thread Holden Karau 
Sounds good, thanks. No rush :)

On Thu, Jul 16, 2020 at 3:03 PM shane knapp ☠  wrote:

> i'll get to this tomorrow afternoon, and there will be a short downtime.
> more details to come.
>
> On Wed, Jul 15, 2020 at 12:17 PM Holden Karau 
> wrote:
>
>> Oh cool, I filed a JIRA for this already and assigned it to you (noticed
>> in one of my PRs)- https://issues.apache.org/jira/browse/SPARK-32326
>>
>> On Wed, Jul 15, 2020 at 12:09 PM shane knapp ☠ 
>> wrote:
>>
>>> i'm not entirely sure when the dep for R got bumped to 3.5+, but it's
>>> breaking the k8s builds.
>>>
>>> i'll need to purge these workers of all previous versions of R +
>>> packages, then reinstall from scratch.  this isn't a horrible task as i
>>> have most of it automated but it will still require a ~few hours of
>>> downtime.
>>>
>>> i'll file a JIRA, and figure out when i will be able to get to this...
>>> possibly this afternoon.
>>> --
>>> Shane Knapp
>>> Computer Guy / Voice of Reason
>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>> https://rise.cs.berkeley.edu
>>>
>>
>>
>> --
>> Twitter: https://twitter.com/holdenkarau
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9  
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>
>
> --
> Shane Knapp
> Computer Guy / Voice of Reason
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu
>
-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  
YouTube Live Streams: https://www.youtube.com/user/holdenkarau

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

2020-07-16 Thread shane knapp ☠ 
i'll get to this tomorrow afternoon, and there will be a short downtime.
more details to come.

On Wed, Jul 15, 2020 at 12:17 PM Holden Karau  wrote:

> Oh cool, I filed a JIRA for this already and assigned it to you (noticed
> in one of my PRs)- https://issues.apache.org/jira/browse/SPARK-32326
>
> On Wed, Jul 15, 2020 at 12:09 PM shane knapp ☠ 
> wrote:
>
>> i'm not entirely sure when the dep for R got bumped to 3.5+, but it's
>> breaking the k8s builds.
>>
>> i'll need to purge these workers of all previous versions of R +
>> packages, then reinstall from scratch.  this isn't a horrible task as i
>> have most of it automated but it will still require a ~few hours of
>> downtime.
>>
>> i'll file a JIRA, and figure out when i will be able to get to this...
>> possibly this afternoon.
>> --
>> Shane Knapp
>> Computer Guy / Voice of Reason
>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>> https://rise.cs.berkeley.edu
>>
>
>
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9  
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>


-- 
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

2020-07-15 Thread Holden Karau 
Oh cool, I filed a JIRA for this already and assigned it to you (noticed in
one of my PRs)- https://issues.apache.org/jira/browse/SPARK-32326

On Wed, Jul 15, 2020 at 12:09 PM shane knapp ☠  wrote:

> i'm not entirely sure when the dep for R got bumped to 3.5+, but it's
> breaking the k8s builds.
>
> i'll need to purge these workers of all previous versions of R + packages,
> then reinstall from scratch.  this isn't a horrible task as i have most of
> it automated but it will still require a ~few hours of downtime.
>
> i'll file a JIRA, and figure out when i will be able to get to this...
> possibly this afternoon.
> --
> Shane Knapp
> Computer Guy / Voice of Reason
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu
>


-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  
YouTube Live Streams: https://www.youtube.com/user/holdenkarau

R installation broken on ubuntu workers, impacts K8s PRB builds

2020-07-15 Thread shane knapp ☠ 
i'm not entirely sure when the dep for R got bumped to 3.5+, but it's
breaking the k8s builds.

i'll need to purge these workers of all previous versions of R + packages,
then reinstall from scratch.  this isn't a horrible task as i have most of
it automated but it will still require a ~few hours of downtime.

i'll file a JIRA, and figure out when i will be able to get to this...
possibly this afternoon.
-- 
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu