[build system] github fetches timing out

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

[build system] github fetches timing out

shane knapp ☠
it looks like over the past few days the master/branch builds have been timing out...  this hasn't happened in a few years, and honestly the last times this happened there was nothing that either i, or github could do about it.  it cleared up after a number of weeks, and we were never able to pinpoint the root cause.

we're not hitting a github api ratelimit, and i'm able to successfully run the git commands on worker nodes on the command line as the jenkins user.

example:
https://amplab.cs.berkeley.edu/jenkins/job/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/1014/console

i wish i had a more concrete answer or solution for what's going on...  i'll continue to investigate as best i can today, and if this continues, i'll re-open my issue w/github and see if they can shed any light on the situation.

shane
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Reply | Threaded
Open this post in threaded view
|

Re: [build system] github fetches timing out

Nikolas Vanderhoof
Unsubscribe

On Tue, Mar 9, 2021 at 3:32 PM shane knapp ☠ <[hidden email]> wrote:
it looks like over the past few days the master/branch builds have been timing out...  this hasn't happened in a few years, and honestly the last times this happened there was nothing that either i, or github could do about it.  it cleared up after a number of weeks, and we were never able to pinpoint the root cause.

we're not hitting a github api ratelimit, and i'm able to successfully run the git commands on worker nodes on the command line as the jenkins user.

example:
https://amplab.cs.berkeley.edu/jenkins/job/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/1014/console

i wish i had a more concrete answer or solution for what's going on...  i'll continue to investigate as best i can today, and if this continues, i'll re-open my issue w/github and see if they can shed any light on the situation.

shane
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Reply | Threaded
Open this post in threaded view
|

Re: [build system] github fetches timing out

shane knapp ☠
In reply to this post by shane knapp ☠
...and just like that, overnight the builds started successfully git fetching!

On Tue, Mar 9, 2021 at 12:31 PM shane knapp ☠ <[hidden email]> wrote:
it looks like over the past few days the master/branch builds have been timing out...  this hasn't happened in a few years, and honestly the last times this happened there was nothing that either i, or github could do about it.  it cleared up after a number of weeks, and we were never able to pinpoint the root cause.

we're not hitting a github api ratelimit, and i'm able to successfully run the git commands on worker nodes on the command line as the jenkins user.

example:
https://amplab.cs.berkeley.edu/jenkins/job/spark-branch-3.0-test-maven-hadoop-2.7-hive-2.3-jdk-11/1014/console

i wish i had a more concrete answer or solution for what's going on...  i'll continue to investigate as best i can today, and if this continues, i'll re-open my issue w/github and see if they can shed any light on the situation.

shane
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu


--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Reply | Threaded
Open this post in threaded view
|

Re: [build system] github fetches timing out

Liang-Chi Hsieh
Thanks Shane for looking at it!


shane knapp ☠ wrote
> ...and just like that, overnight the builds started successfully git
> fetching!
>
> --
> Shane Knapp
> Computer Guy / Voice of Reason
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu





--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: [build system] github fetches timing out

shane knapp ☠
it's been happening a lot again recently...  i'm investigating.

On Wed, Mar 10, 2021 at 10:23 AM Liang-Chi Hsieh <[hidden email]> wrote:
Thanks Shane for looking at it!


shane knapp ☠ wrote
> ...and just like that, overnight the builds started successfully git
> fetching!
>
> --
> Shane Knapp
> Computer Guy / Voice of Reason
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu





--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]



--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu