ChanServ changed the topic of #freedesktop to: https://www.freedesktop.org infrastructure and online services || for questions about freedesktop.org projects, please see each project's contact || for discussions about specifications, please use https://gitlab.freedesktop.org/xdg or xdg@lists.freedesktop.org
<bentiss>
I guess a server reboot is in order... I see some "ContainerStatusUnknown"
<bentiss>
I'm going to move some pods and reboot the servers over the next couple of hours, so expect some more errors
* bentiss
also wonders if he should not upgrade k3s too
<daniels>
bentiss: oh thankyou, I suspect the PAT page issue might be a red herring as I saw that before everything went red overnight
<bentiss>
yay, the first server rebooted but couldn't get network... another reboot attempt
<bentiss>
FWIW< it rebooted fine after, but the ssh key pair got reset for the host
lynxeye has joined #freedesktop
<lynxeye>
Is marge stuck? Seems it missed to unassign itself after one of the CI timeouts and now doesn't seem to pick up new jobs.
<gkiagia>
there's some kind of permissions issue that may be affecting marge as well... I'm getting "you don't have enough privileges" on a CI pipeline I just started, depsite being owner of the project
<bentiss>
gitlab service is probably getting some hiccups over the next couple of hours (I couldn't get much done this past hour), I need to restart the entire service/servers
<bentiss>
hopefully 2 hours will be enough, the second server had the same "no network" issue after the first reboot
<bentiss>
daniels: looks like marge is having an expired token: marge.gitlab.Unauthorized: (401, {'error': 'invalid_token', 'error_description': 'Token is expired. You can either do re-authorization or token refresh.'})
<daniels>
oh dear
<daniels>
I can reissue that
<bentiss>
IIRC it was one token for all marges
<bentiss>
daniels: thanks! looks like marge is back up!
<bentiss>
on my side I'm rebooting the last server node
gchini has quit [Quit: Leaving]
<bentiss>
everything has rebooted and ceph is HEALTH_OK
<bentiss>
fixing the backups of git who failed to load ATM
<bentiss>
while I'm here, I'm also upgrading rook and then later ceph
<__tim>
what does "re-authorization" mean in the above context (if I rather keep using the existing token)?
<__tim>
seems like more than logging in?
gchini has joined #freedesktop
<daniels>
bentiss: $CI_GATING_TOKEN has also expired ... where did that come from?
<pinchartl>
ah, I should have read the backlog first
<bentiss>
rook-ceph has been upgraded to 1.14.10, and now I'm upgrading ceph itself to 18.2.4 (from 17.2.6)
ndufresne[m] has joined #freedesktop
<daniels>
pinchartl: yeah, I fixed that earlier
<pinchartl>
thanks
alatiera6 has joined #freedesktop
bmodem has quit [Ping timeout: 480 seconds]
Haaninjo has joined #freedesktop
bmodem has joined #freedesktop
balrog_ has joined #freedesktop
balrog has quit [Ping timeout: 480 seconds]
krushia has quit [Quit: Konversation germinated!]
vx has quit [Quit: G-Line: User has been permanently banned from this network.]
vx has joined #freedesktop
Artea has joined #freedesktop
<bentiss>
sigh ackuser bot also got his token expired
<bentiss>
daniels: looking at marge-bot latest token (through impersonation), it seems you set a 4 weeks expiry, was that intentional?
<daniels>
bentiss: oh, that's why I generated another one with a 1y expiry :P
<bentiss>
I missed that one...
AbleBacon has joined #freedesktop
<bentiss>
I wonder if we should not use "Impersonation Tokens" instead of manually impersonating
<daniels>
for mr-label-maker I did use an impersonation token, yeah
<daniels>
there is no reason whatsoever to have done it differently for the two, just that for marge a) I had forgotten that impersonation tokens existed, and b) I was on a train with absolutely terrible connectivity so was trying to minimise clicks by doing the thing I remembered worked
___nick___ has joined #freedesktop
<bentiss>
heh
<bentiss>
whot1: I ǘe bumped ackuser, damspam and bug bot tokens, so we should be fine for another year with those
<bentiss>
*I've
lynxeye has quit [Quit: Leaving.]
___nick___ has quit []
___nick___ has joined #freedesktop
___nick___ has quit []
tzimmermann has quit [Quit: Leaving]
___nick___ has joined #freedesktop
tocrswsoal^ has quit [Ping timeout: 480 seconds]
sersorrel has quit [Remote host closed the connection]
vx has quit [Quit: G-Line: User has been permanently banned from this network.]
vx has joined #freedesktop
lyudess has quit []
Lyude has joined #freedesktop
ximion has joined #freedesktop
bmodem has quit [Ping timeout: 480 seconds]
alanc has quit [Remote host closed the connection]
alanc has joined #freedesktop
<daniels>
thankyou!
___nick___ has quit [Remote host closed the connection]
usermode has joined #freedesktop
ity has joined #freedesktop
usermode has quit []
usermode has joined #freedesktop
usermode has quit [Remote host closed the connection]
usermode has joined #freedesktop
usermode has quit [Remote host closed the connection]
usermode has joined #freedesktop
usermode has quit [Remote host closed the connection]
usermode has joined #freedesktop
usermode has quit []
usermode has joined #freedesktop
usermode has quit [Write error: connection closed]
usermode has joined #freedesktop
usermode has quit [Remote host closed the connection]
usermode has joined #freedesktop
usermode has quit []
usermode has joined #freedesktop
usermode has quit [Remote host closed the connection]
usermode has joined #freedesktop
usermode has quit [Remote host closed the connection]
usermode has joined #freedesktop
usermode has quit [Remote host closed the connection]
usermode has joined #freedesktop
usermode has quit [Remote host closed the connection]
usermode has joined #freedesktop
usermode has quit [Remote host closed the connection]
usermode has joined #freedesktop
usermode has quit [Read error: Connection reset by peer]
usermode has joined #freedesktop
usermode has quit [Remote host closed the connection]
usermode has joined #freedesktop
usermode has quit [Remote host closed the connection]
usermode has joined #freedesktop
usermode has quit [Read error: Connection reset by peer]
ifconfig has joined #freedesktop
ifconfig has quit []
ifconfig has joined #freedesktop
ifconfig has quit []
ifconfig has joined #freedesktop
ifconfig has quit []
ifconfig has joined #freedesktop
ifconfig has quit []
ifconfig has joined #freedesktop
ifconfig has quit []
ifconfig has joined #freedesktop
ifconfig has quit [Write error: connection closed]
ifconfig has joined #freedesktop
ifconfig has quit [Remote host closed the connection]
ifconfig has joined #freedesktop
ifconfig has quit [Remote host closed the connection]
ifconfig has joined #freedesktop
ifconfig has quit [Remote host closed the connection]
ifconfig has joined #freedesktop
ifconfig has quit []
ifconfig has joined #freedesktop
ifconfig has quit []
ifconfig has joined #freedesktop
ifconfig has quit [Remote host closed the connection]
ifconfig has joined #freedesktop
ifconfig has quit [Remote host closed the connection]