R installation broken on ubuntu workers, impacts K8s PRB builds

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

R installation broken on ubuntu workers, impacts K8s PRB builds

shane knapp ☠
i'm not entirely sure when the dep for R got bumped to 3.5+, but it's breaking the k8s builds.

i'll need to purge these workers of all previous versions of R + packages, then reinstall from scratch.  this isn't a horrible task as i have most of it automated but it will still require a ~few hours of downtime.

i'll file a JIRA, and figure out when i will be able to get to this...  possibly this afternoon.
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Reply | Threaded
Open this post in threaded view
|

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

Holden Karau
Oh cool, I filed a JIRA for this already and assigned it to you (noticed in one of my PRs)- https://issues.apache.org/jira/browse/SPARK-32326

On Wed, Jul 15, 2020 at 12:09 PM shane knapp ☠ <[hidden email]> wrote:
i'm not entirely sure when the dep for R got bumped to 3.5+, but it's breaking the k8s builds.

i'll need to purge these workers of all previous versions of R + packages, then reinstall from scratch.  this isn't a horrible task as i have most of it automated but it will still require a ~few hours of downtime.

i'll file a JIRA, and figure out when i will be able to get to this...  possibly this afternoon.
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu


--
Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 
Reply | Threaded
Open this post in threaded view
|

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

shane knapp ☠
i'll get to this tomorrow afternoon, and there will be a short downtime.  more details to come.

On Wed, Jul 15, 2020 at 12:17 PM Holden Karau <[hidden email]> wrote:
Oh cool, I filed a JIRA for this already and assigned it to you (noticed in one of my PRs)- https://issues.apache.org/jira/browse/SPARK-32326

On Wed, Jul 15, 2020 at 12:09 PM shane knapp ☠ <[hidden email]> wrote:
i'm not entirely sure when the dep for R got bumped to 3.5+, but it's breaking the k8s builds.

i'll need to purge these workers of all previous versions of R + packages, then reinstall from scratch.  this isn't a horrible task as i have most of it automated but it will still require a ~few hours of downtime.

i'll file a JIRA, and figure out when i will be able to get to this...  possibly this afternoon.
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu


--
Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 


--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Reply | Threaded
Open this post in threaded view
|

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

Holden Karau
Sounds good, thanks. No rush :)

On Thu, Jul 16, 2020 at 3:03 PM shane knapp ☠ <[hidden email]> wrote:
i'll get to this tomorrow afternoon, and there will be a short downtime.  more details to come.

On Wed, Jul 15, 2020 at 12:17 PM Holden Karau <[hidden email]> wrote:
Oh cool, I filed a JIRA for this already and assigned it to you (noticed in one of my PRs)- https://issues.apache.org/jira/browse/SPARK-32326

On Wed, Jul 15, 2020 at 12:09 PM shane knapp ☠ <[hidden email]> wrote:
i'm not entirely sure when the dep for R got bumped to 3.5+, but it's breaking the k8s builds.

i'll need to purge these workers of all previous versions of R + packages, then reinstall from scratch.  this isn't a horrible task as i have most of it automated but it will still require a ~few hours of downtime.

i'll file a JIRA, and figure out when i will be able to get to this...  possibly this afternoon.
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu


--
Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 


--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
--
Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 
Reply | Threaded
Open this post in threaded view
|

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

shane knapp ☠
starting now...  pausing jenkins so no new builds are launched.

On Thu, Jul 16, 2020 at 3:09 PM Holden Karau <[hidden email]> wrote:
Sounds good, thanks. No rush :)

On Thu, Jul 16, 2020 at 3:03 PM shane knapp ☠ <[hidden email]> wrote:
i'll get to this tomorrow afternoon, and there will be a short downtime.  more details to come.

On Wed, Jul 15, 2020 at 12:17 PM Holden Karau <[hidden email]> wrote:
Oh cool, I filed a JIRA for this already and assigned it to you (noticed in one of my PRs)- https://issues.apache.org/jira/browse/SPARK-32326

On Wed, Jul 15, 2020 at 12:09 PM shane knapp ☠ <[hidden email]> wrote:
i'm not entirely sure when the dep for R got bumped to 3.5+, but it's breaking the k8s builds.

i'll need to purge these workers of all previous versions of R + packages, then reinstall from scratch.  this isn't a horrible task as i have most of it automated but it will still require a ~few hours of downtime.

i'll file a JIRA, and figure out when i will be able to get to this...  possibly this afternoon.
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu


--
Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 


--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
--
Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 


--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Reply | Threaded
Open this post in threaded view
|

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

shane knapp ☠
this is done, except for amp-jenkins-staging-worker-02 which is refusing to allow me to reinstall R...  i marked that worker offline and will beat on it later today.

On Fri, Jul 17, 2020 at 11:36 AM shane knapp ☠ <[hidden email]> wrote:
starting now...  pausing jenkins so no new builds are launched.

On Thu, Jul 16, 2020 at 3:09 PM Holden Karau <[hidden email]> wrote:
Sounds good, thanks. No rush :)

On Thu, Jul 16, 2020 at 3:03 PM shane knapp ☠ <[hidden email]> wrote:
i'll get to this tomorrow afternoon, and there will be a short downtime.  more details to come.

On Wed, Jul 15, 2020 at 12:17 PM Holden Karau <[hidden email]> wrote:
Oh cool, I filed a JIRA for this already and assigned it to you (noticed in one of my PRs)- https://issues.apache.org/jira/browse/SPARK-32326

On Wed, Jul 15, 2020 at 12:09 PM shane knapp ☠ <[hidden email]> wrote:
i'm not entirely sure when the dep for R got bumped to 3.5+, but it's breaking the k8s builds.

i'll need to purge these workers of all previous versions of R + packages, then reinstall from scratch.  this isn't a horrible task as i have most of it automated but it will still require a ~few hours of downtime.

i'll file a JIRA, and figure out when i will be able to get to this...  possibly this afternoon.
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu


--
Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 


--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
--
Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 


--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu


--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu