daniels changed the topic of #freedesktop to: https://www.freedesktop.org infrastructure and online services || for questions about freedesktop.org projects, please see each project's contact || for discussions about specifications, please use https://gitlab.freedesktop.org/xdg or xdg@lists.freedesktop.org
<alanc> I can't tell why https://gitlab.freedesktop.org/xorg/lib/libxi/-/jobs/50250371 is failing to build the replacement container for the previously cached one from 2021 - any ideas?
<alanc> "cat $buildmnt/etc/apt/sources.list" is reporting "No such file or directory"
krastevm has joined #freedesktop
<whot> anyone else getting 422 on gitlab login?
blu has quit [Ping timeout: 480 seconds]
columbarius has joined #freedesktop
co1umbarius has quit [Ping timeout: 480 seconds]
<whot> "have you tried turning it on and off again?" - oh, that fixed it
mceier has quit [Ping timeout: 480 seconds]
jarthur has quit [Quit: Textual IRC Client: www.textualapp.com]
dcunit3d has joined #freedesktop
jarthur has joined #freedesktop
dcunit3d has quit [Remote host closed the connection]
alanc has quit [Remote host closed the connection]
alanc has joined #freedesktop
blu has joined #freedesktop
shashanks__ has joined #freedesktop
bmodem has joined #freedesktop
krastevm has quit [reticulum.oftc.net liquid.oftc.net]
bbhtt has quit [reticulum.oftc.net liquid.oftc.net]
shashanks_ has quit [reticulum.oftc.net liquid.oftc.net]
kbingham has quit [reticulum.oftc.net liquid.oftc.net]
pixelcluster has quit [reticulum.oftc.net liquid.oftc.net]
vyivel has quit [reticulum.oftc.net liquid.oftc.net]
slomo has quit [reticulum.oftc.net liquid.oftc.net]
kj has quit [reticulum.oftc.net liquid.oftc.net]
italove8 has quit [reticulum.oftc.net liquid.oftc.net]
ndufresne has quit [reticulum.oftc.net liquid.oftc.net]
enunes has quit [reticulum.oftc.net liquid.oftc.net]
zredshift[m] has quit [reticulum.oftc.net liquid.oftc.net]
nirbheek_ has quit [reticulum.oftc.net liquid.oftc.net]
leigh_2valid[m] has quit [reticulum.oftc.net liquid.oftc.net]
mitTengiz[m] has quit [reticulum.oftc.net liquid.oftc.net]
BLumia[m] has quit [reticulum.oftc.net liquid.oftc.net]
cassidy[m] has quit [reticulum.oftc.net liquid.oftc.net]
nee[m] has quit [reticulum.oftc.net liquid.oftc.net]
emersion has quit [reticulum.oftc.net liquid.oftc.net]
Hazematman has quit [reticulum.oftc.net liquid.oftc.net]
nielsdg has quit [reticulum.oftc.net liquid.oftc.net]
ewlsh[m] has quit [reticulum.oftc.net liquid.oftc.net]
msizanoen[m] has quit [reticulum.oftc.net liquid.oftc.net]
marcel203s[m] has quit [reticulum.oftc.net liquid.oftc.net]
nnm has quit [reticulum.oftc.net liquid.oftc.net]
unrznbl[m] has quit [reticulum.oftc.net liquid.oftc.net]
Venemo has quit [reticulum.oftc.net liquid.oftc.net]
vjaquez has quit [reticulum.oftc.net liquid.oftc.net]
r00tobo has quit [reticulum.oftc.net liquid.oftc.net]
dj-death has quit [reticulum.oftc.net liquid.oftc.net]
tpalli has quit [reticulum.oftc.net liquid.oftc.net]
ds` has quit [reticulum.oftc.net liquid.oftc.net]
bentiss has quit [reticulum.oftc.net liquid.oftc.net]
medicalwei_ has quit [reticulum.oftc.net liquid.oftc.net]
wb9688 has quit [reticulum.oftc.net liquid.oftc.net]
Mithrandir has quit [reticulum.oftc.net liquid.oftc.net]
jadahl has quit [reticulum.oftc.net liquid.oftc.net]
shashanks__ has quit [Remote host closed the connection]
shashanks has joined #freedesktop
kj has joined #freedesktop
kbingham has joined #freedesktop
pixelcluster has joined #freedesktop
vyivel has joined #freedesktop
ndufresne has joined #freedesktop
italove8 has joined #freedesktop
slomo has joined #freedesktop
enunes has joined #freedesktop
cassidy[m] has joined #freedesktop
zredshift[m] has joined #freedesktop
nee[m] has joined #freedesktop
nirbheek_ has joined #freedesktop
leigh_2valid[m] has joined #freedesktop
emersion has joined #freedesktop
BLumia[m] has joined #freedesktop
mitTengiz[m] has joined #freedesktop
Hazematman has joined #freedesktop
nielsdg has joined #freedesktop
msizanoen[m] has joined #freedesktop
ewlsh[m] has joined #freedesktop
marcel203s[m] has joined #freedesktop
nnm has joined #freedesktop
unrznbl[m] has joined #freedesktop
Venemo has joined #freedesktop
vjaquez has joined #freedesktop
Mithrandir has joined #freedesktop
wb9688 has joined #freedesktop
r00tobo has joined #freedesktop
tpalli has joined #freedesktop
jadahl has joined #freedesktop
bbhtt has joined #freedesktop
ds` has joined #freedesktop
bentiss has joined #freedesktop
dj-death has joined #freedesktop
medicalwei_ has joined #freedesktop
bmodem has quit [Ping timeout: 480 seconds]
mceier has joined #freedesktop
bmodem has joined #freedesktop
swatish2 has joined #freedesktop
ximion has quit [Quit: Detached from the Matrix]
bmodem has quit [Quit: bmodem]
bozo16 has quit [Remote host closed the connection]
bozo16 has joined #freedesktop
sima has joined #freedesktop
tzimmermann has joined #freedesktop
Kayden has joined #freedesktop
bmodem has joined #freedesktop
kxkamil4 has quit []
bmodem has quit [Ping timeout: 480 seconds]
bmodem has joined #freedesktop
bmodem has quit [Excess Flood]
bmodem has joined #freedesktop
tlwoerner has quit [Ping timeout: 480 seconds]
mvlad has joined #freedesktop
tlwoerner has joined #freedesktop
hikiko has joined #freedesktop
kxkamil has joined #freedesktop
jarthur has quit [Quit: Textual IRC Client: www.textualapp.com]
kxkamil has quit []
kxkamil has joined #freedesktop
i509vcb has quit [Quit: Connection closed for inactivity]
AbleBacon has quit [Read error: Connection reset by peer]
bmodem has quit [Ping timeout: 480 seconds]
dos1 has quit [Ping timeout: 480 seconds]
dos1 has joined #freedesktop
bmodem has joined #freedesktop
bluca has joined #freedesktop
<bluca> hi - we have a contractor working on revamping the systemd documentation, and we need a redirect for https://www.freedesktop.org/software/systemd/man/ set up to be able to make progress, would greatly appreciate if any fdo.org admin had some time to help us out - thanks in advance!
<daniels> alanc: because debian:stable is a newer version of Debian than it was two years ago, and that requires a newer version of ci-templates since they changed some stuff
<daniels> alanc: you can use debian:woody or whatever the actual release codename was (or numeric versions), which pins it in a more predictable way
<MrCooper> haha, woody, nice in-joke there :)
<MrCooper> woody can legally drink booze in the US
<daniels> I figured I might as well give a codename which wasn't available in container form so it was obvious that it'd have to change :P
shashanks has quit [Remote host closed the connection]
<karolherbst> mupuf: kinda looks like the valve navi21 runners are having trouble to keep up with the workload
<mupuf> karolherbst: let me check if anyone is using them too much
<mupuf> karolherbst: pre-merge testing gone wrong. We need to lower our timeouts
<mupuf> https://gitlab.freedesktop.org/mesa/mesa/-/jobs/50264884 --> the machine has been used for 47 minutes
<karolherbst> oh wow
<mupuf> sorry about that :s
<mupuf> I kicked these jobs
<karolherbst> fyi: I canceled the other queued navi21 jobs there to hopefully land other MRs and not run into another error there
<karolherbst> there are 2? MRs waiting on those, one of them mine
<mupuf> 2 MRs? How is it possible?
<mupuf> Marge only runs on one at a time
<mupuf> anyway, it won't make it in time... let's hope there are no other marge jobs in the queue
<mupuf> let's see
<karolherbst> might have been a pipeline actually
<karolherbst> might ahve been the same ...
<karolherbst> just noticed that my MR pipeline waited on 1/2 and had 3/4 active, and vice-versa for a different pipeline
<karolherbst> or vice-versa
<mupuf> the marge queue is too long
<mupuf> As in, there are MRs queued for merging
<mupuf> so... sorry, we'll have to reassign
<karolherbst> yeah, probably
<mupuf> changing anything in the gitlab ci files is a massive pain in the butt :s
<karolherbst> I stoped my pipeline and reassigned
<mupuf> thanks
<karolherbst> was that addressed already?
<karolherbst> `with specified policies [always]: write /var/lib/docker/tmp/GetImageBlob409755917: no space left on device (manager.go:205:92s)`
<daniels> mupuf: 1h40m timeout for pre-merge jobs is _way_ too long
<daniels> just pull it down to like 30m?
<daniels> karolherbst: I've poked the fdno people about it
<mupuf> daniels: indeed :D
<karolherbst> daniels: cool, thanks
bozo16 has quit []
<daniels> mupuf: thankyou!
bmodem has quit [Quit: bmodem]
bmodem has joined #freedesktop
vkareh has joined #freedesktop
bmodem has quit [Ping timeout: 480 seconds]
bozo16 has joined #freedesktop
bmodem has joined #freedesktop
gert31 has joined #freedesktop
<zmike> DavidHeidelberg: why do I have to manually click play on container jobs when using run-n-monitor
<zmike> isn't the point of the script that the script handles everything?
<zmike> I even have to click the same stage play button multiple times?
<zmike> what happened here?
Haaninjo has joined #freedesktop
swatish2 has quit [Quit: Leaving.]
swatish2 has joined #freedesktop
<DavidHeidelberg> zmike: I didn't came with this innovation :(
<DavidHeidelberg> I think I know which commit changed it, so I'll try to test it wirhout and see.
Haaninjo has quit [Quit: Ex-Chat]
bmodem has quit [Ping timeout: 480 seconds]
<zmike> if I run a zink regex in run-n-monitor I should be able to come back in 20 mins or whatever and find the entire thing done
<zmike> not have to click any buttons in the web ui
<zmike> so whatever needs to be done to get back to that is what we need to do
<zmike> robclark: no space left on device for a630? https://gitlab.freedesktop.org/mesa/mesa/-/pipelines/1009466/failures
<zmike> karolherbst: ^
<robclark> zmike: anholt mentioned that disk on the servo NuC (the one controlling the a630 runners) was full.. possibly container images not getting cleaned up? I'll look when I get to the office in a bit (was out yesterday)
<eric_engestrom> zmike: ci_run_n_monitor has `--force-manual`, does it solve your issue?
<DavidHeidelberg> eric_engestrom: nope, I see this problem myself
<eric_engestrom> ok
<eric_engestrom> can you write it down in an issue?
<eric_engestrom> I don't have the spare cycles to think about it much right now, but that's the kind of thing I want to see working so I'll look into it when I can
<DavidHeidelberg> I'll try to look into it today or tomorrow, but cannot promise 100%
<zmike> it used to work until this past week or so
<zmike> also filed this one because zink-tu jobs are no longer created https://gitlab.freedesktop.org/mesa/mesa/-/issues/9992
<zmike> cwabbott: ^
<cwabbott> yup, I've seen both issues too
<cwabbott> fwiw turnip vkcts jobs seem to not be created either
i509vcb has joined #freedesktop
shashanks has joined #freedesktop
<cwabbott> a630_vk was actually created but not a618_vk
shashanks has quit [Remote host closed the connection]
<cwabbott> so effectively all of the turnip jobs on collabora's farm aren't being created
shashanks has joined #freedesktop
mripard has quit [Quit: mripard]
<psykose> bwidawsk: no that's an unused variable
<robclark> zmike: seems to be -ETOOMANYDOCKERIMAGES
<robclark> not sure what is safe to just rm -rf
<daniels> robclark: you need the free-space script from fdo
<eric_engestrom> zmike: I found the issue with having to start container jobs
<eric_engestrom> fix coming in minute for you to try
<zmike> great
<eric_engestrom> zmike, anholt, DavidHeidelberg: https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/25715
<robclark> daniels: for reasons, I had to boot init=/bin/bash so don't really have network access
<DavidHeidelberg> eric_engestrom: does it help you? I had force-manual all the time and joba get canceled anyway due to some issue (the 1-2 week ago regression)
<robclark> daniels: also, where is this script?
<eric_engestrom> DavidHeidelberg: not tested, no, but from looking at the code this was obviously wrong so it fixes _something_ at least ^^
<eric_engestrom> can you check if the script before koike's MR works?
* eric_engestrom ended up not having time to review her MR
<DavidHeidelberg> Helen changes had no impact on this type of problem, I had it before the merge
<zmike> testing
<zmike> eric_engestrom: seems fixed
<eric_engestrom> :)
<eric_engestrom> zmike: mind saying that/approve/ack on the MR?
<eric_engestrom> thanks :)
MrCooper has quit [Remote host closed the connection]
MrCooper has joined #freedesktop
AnuthaDev has joined #freedesktop
<bwidawsk> psykose: hmm wonder if I sent the wrong link
<DavidHeidelberg> eric_engestrom: you're right, nice catch! thanks :)
gert31 has quit [Quit: Leaving]
tzimmermann has quit [Quit: Leaving]
alpernebbi has quit [Ping timeout: 480 seconds]
alpernebbi has joined #freedesktop
jarthur has joined #freedesktop
<bwidawsk> psykose: I meant the cdylib stuff, like here: https://gitlab.freedesktop.org/bwidawsk/sudbury/-/jobs/50258148#L236
AnuthaDev has quit []
<psykose> it's the same thing yea
<bwidawsk> what's missing?
<psykose> the rustflags aren't actually set
<psykose> you see warning: dropping unsupported crate type `cdylib` because it's +crt-static
phire has quit [Remote host closed the connection]
<karolherbst> do we have any plans for the freedreno farm or do we just disable it? It prevents MR from merging
phire has joined #freedesktop
<bwidawsk> psykose:
<bwidawsk> psykose: I was trying to move to CONFIG_HOME/config.toml
<bwidawsk> I can reproduce the issue with RUSTFLAGS, one moment
<daniels> karolherbst: robclark is looking at it
<karolherbst> okay, cool
AnuthaDev has joined #freedesktop
<robclark> daniels, karolherbst: the servo NuC is rebooting now and things should be ok when it comes back
<karolherbst> okay :)
<karolherbst> I've also seen some piglit trace fails, but that one also looked a bit like ENOSPACE related...
<DavidHeidelberg> we're aware :)
<robclark> everything controlled by servo NuC (ie. a630 jobs) would have been unhappy
<robclark> karolherbst, zmike: a630 runners should be back now
<karolherbst> cool
<karolherbst> there is one thing I've noticed with all the fails happening. Often the pipeline keeps running even though it faileds, due to some jobs still being triggered/running/whatever. Could we make sure that marge just stops the entire pipeline on failures?
<zmike> that's sounds bad to me
<zmike> then there's no ability to manually click retry on e.g., network failures
<karolherbst> I mean when marge already moved on to the next MR
<zmike> ah
<karolherbst> we can make marge not do it if there is no other MR queued
<karolherbst> had a a630 job still running even though marge unassigned 58 minutes ago
<daniels> karolherbst: tldr no
<daniels> hmm, actually, maybe yes
<daniels> I think it's fine
<daniels> the complication I was thinking about is that the GitLab API doesn't expose anything about job retries or whatever, so marge can't really reason about the status of individual jobs and whether or not they're terminal to a pipeline
<karolherbst> it could be a "I start processing this MR, let me stop all jobs from the previous one" thing
<daniels> yeah
<daniels> so I think that's ok once the pipeline goes to failed and marge gives up
<karolherbst> yeah
todi has joined #freedesktop
swatish2 has quit [Read error: Connection reset by peer]
AbleBacon has joined #freedesktop
<karolherbst> robclark: there still seem to be a problem with the farm? https://gitlab.freedesktop.org/mesa/mesa/-/jobs/50291466 I've seen that in a few pipelines now, or is that expected?
<karolherbst> but there is also this fail: https://gitlab.freedesktop.org/mesa/mesa/-/jobs/50291476
<karolherbst> which looks like a flake?
<elibrokeit> What's the current logic around how users get permission to run pipelines? https://gitlab.freedesktop.org/cangjie/pycangjie/-/merge_requests/43#note_2127359
<elibrokeit> I've been helping out with their build system and to solve the CI they tried giving me access to the repo, but it is not granting me pipeline start permissions... unless I push to a branch of the project repo instead of my fork
cleetus_garfield has joined #freedesktop
<mupuf> elibrokeit: you need to be added to a ci-OK group somewhere
iNKa is now known as Brocker
<alanc> ideally the person you're working with would add you to the group for cangjie, but I could probably add you to the xorg group if that would help
<robclark> karolherbst: no, not expected.. but not really sure how the mapping from ttyUSB to device is maintained.. wonder if it is possible that cheza-16 has become one of the DUTs that we'd previously taken offline?
<robclark> I guess anholt should know.. but for now seems like we should take that runner out
<karolherbst> yeah please do, it seems to cause some issues.
<karolherbst> the flaky test isn't really critical as it seems that CI rerunning the test gets us past that, still something we might want to address to speed up CI
<DavidHeidelberg> Another one bites the dust :(
<daniels> karolherbst: please marge the flake addition
<robclark> would be nice if we could symbolize the backtrace in a trace crash
vkareh has quit [Quit: WeeChat 4.0.5]
ximion has joined #freedesktop
sima has quit [Ping timeout: 480 seconds]
<DavidHeidelberg> karolherbst: yup
<karolherbst> ehh wait.. wrong job
<karolherbst> now it should be the right one
<karolherbst> looks like all jobs are running now in my MR :)
<karolherbst> robclark: this one seems to hang as well https://gitlab.freedesktop.org/mesa/mesa/-/jobs/50293104
<robclark> that one is in collabora farm
<karolherbst> daniels: ^^
<karolherbst> or uhm.. DavidHeidelberg I guess as well
<psykose> bwidawsk: the issue you see now seems to be rustc itself segfaulting, which isn't related to the output (and so stuff like -C link-self-contained=on doesn't do anything)
<DavidHeidelberg> karolherbst: not nice, for a660 it happens time to time :/
<DavidHeidelberg> this seems to be issue with the magic bootloader I guess
<daniels> yeah, impressive - for the same sharded mesa job, two different 888s (each in different racks with different power/network/serial/etc hosts) have refused to boot that job and only that job because they can't figure out USB
AnuthaDev has quit []
<daniels> karolherbst: buy a lottery ticket and let's split the returns between you + me + DavidHeidelberg
<karolherbst> :D
<karolherbst> sounds like Marge has a bit of a crisis as well https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24839#note_2127424
cleetus_garfield has quit []
<bwidawsk> psykose: here is the original failure before I tried to SO my way out aarch64-alpine-build (#50290359) · Jobs · Ben Widawsky / sudbury · GitLab (https://gitlab.freedesktop.org/bwidawsk/sudbury/-/jobs/50290359)
<psykose> yeah that's the one i'm talking about
<psykose> idk why rustc segfaults but that seems weird
<bwidawsk> hmm okay, I am doing a semi weird thing producing a binary and a library in the same project
<psykose> should be ok
<bwidawsk> yeah, builds locally fine
mvlad has quit [Remote host closed the connection]
<daniels> karolherbst: yeah, that happens once per month or so, so you continue to win the prize
<karolherbst> funky
co1umbarius has joined #freedesktop
columbarius has quit [Ping timeout: 480 seconds]
bozo16 has quit [Remote host closed the connection]
bozo16 has joined #freedesktop
bluca has quit [Quit: Leaving.]
shashanks_ has joined #freedesktop
shashanks has quit [Ping timeout: 480 seconds]
<karolherbst> robclark: did you disable the 630 runner? because another MR hit it again: https://gitlab.freedesktop.org/mesa/mesa/-/jobs/50295726