ChanServ changed the topic of #freedesktop to: https://www.freedesktop.org infrastructure and online services || for questions about freedesktop.org projects, please see each project's contact || for discussions about specifications, please use https://gitlab.freedesktop.org/xdg or xdg@lists.freedesktop.org
megatradeusa[m] has quit [autokilled: Spambot. Mail support@oftc.net if you think this is in error. (2022-08-19 00:04:06)]
ngcortes has quit [Remote host closed the connection]
aswar002 has quit [Read error: Connection reset by peer]
aswar002 has joined #freedesktop
jstein has quit [Ping timeout: 480 seconds]
Consolatis_ has joined #freedesktop
Consolatis is now known as Guest495
Consolatis_ is now known as Consolatis
Guest495 has quit [Ping timeout: 480 seconds]
dcunit3d has joined #freedesktop
alanc has quit [Remote host closed the connection]
alanc has joined #freedesktop
kelvium has joined #freedesktop
aswar002 has quit [Ping timeout: 480 seconds]
random_james has quit [Ping timeout: 480 seconds]
ximion has quit []
Mithrandir has quit [Quit: brb]
Mithrandir has joined #freedesktop
dcunit3d has quit [Ping timeout: 480 seconds]
GNUmoon has quit [Remote host closed the connection]
GNUmoon has joined #freedesktop
dcunit3d has joined #freedesktop
systwi has quit [Ping timeout: 480 seconds]
jarthur has quit [Quit: Textual IRC Client: www.textualapp.com]
pohly has joined #freedesktop
kem has quit [Ping timeout: 480 seconds]
kem has joined #freedesktop
MajorBiscuit has joined #freedesktop
danvet has joined #freedesktop
systwi has joined #freedesktop
i-garrison has quit []
i-garrison has joined #freedesktop
vbenes has joined #freedesktop
pjakobsson has quit [Remote host closed the connection]
MrCooper has quit [Remote host closed the connection]
MrCooper has joined #freedesktop
Major_Biscuit has joined #freedesktop
MajorBiscuit has quit [Ping timeout: 480 seconds]
MajorBiscuit has joined #freedesktop
Major_Biscuit has quit [Ping timeout: 480 seconds]
Haaninjo has joined #freedesktop
kelvium has quit []
vkareh has joined #freedesktop
ximion has joined #freedesktop
<bentiss> FWIW, we had one hdd full, I have rebalanced it and things seem to be better now
<vsyrjala> does that explain patchwork not picking up patches?
<bentiss> vsyrjala: nope, entirely different system, it was for gitlab only
minute has quit []
eroux has quit [Ping timeout: 480 seconds]
<vsyrjala> anyone have ideas why pw is borked?
<emersion> Aug 19 12:09:05 2022 (30268) delivery to XXX failed with code 452: 4.5.3 Error: too many recipients
<emersion> we have some stuff like this in the logs
<emersion> but otherwise nothing seems out of the ordinary
<vsyrjala> looks like a patch i posted to dri-devel got picked up, but not stuff posted to intel-gfx
<bentiss> tanty: looks like we have an issue with your preject settings on tanty/mesa-valve-ci/
<bentiss> tanty: the total amount of artifacts stored is 790.7GB, with artifacts from more than a year ago (when they are supposed to be pruned every 2 weeks
<bentiss> for a general background, we are using 32 TB of artifacts, which is IMO way too much than we can handle
<tanty> bentiss: huh! Did I have the capacity of changing any setting there? I'm not aware I did but my memory may fail
<bentiss> tanty: it looks like in Feb 2022 you managed to reduce the artifacts size, which is a good thing though :)
<tanty> mupuf: I think you have administrative rights to do anything in that project. Maybe you can check (?)
<mupuf> da heck :o
<mupuf> on it
<bentiss> tanty: "Keep artifacts from most recent successful jobs" is checked, and I don't know how you push stuff, but maybe that's the reason (i.e. gitlab considers that all your pushes are HEAD"
<bentiss> tanty: and sorry, you are the biggest user, I need to reverse engineer the others
<bentiss> tanty: mind if I nuke all the big artifacts from before 2022-03-01?
<mupuf> bentiss: no, go ahead.
<bentiss> mupuf: k, thanks.
<tanty> +1
<mupuf> and developers tend to push branches there and artifacts would linger
<bentiss> daniels: FYI, I am using s3 directly, I am not sure the gitlab console wioll help me a lot
<mupuf> I removed the "Keep artifacts from most recent successful jobs"
* mupuf should have seen the "789.2 GB Project Storage"... sorry about this!
<tanty> I set the policy to clean unused image tags older than 2 weeks.
<mupuf> tanty: I think the artifacts bentiss is talking about are the pipeline artifacts, not the container images
* mupuf is also looking at dxvk-ci, which is also using gobs of space
<bentiss> mupuf: yes, exactly
<mupuf> bentiss: is there a way for me to remove old artifacts?
<tanty> Yes, I guessed that much but I thought that probably would be also good to check about the register.
<bentiss> I have 8 base trees with more than 100 GB of used storage
<bentiss> mupuf: I think you need to have the console access for that
<bentiss> so on admins alone
<mupuf> bentiss: arg... ok
<bentiss> sigh, just removing the s3 data is apparently not enough, gitlab is shouting some 404s when attempting to download (which is good), but still show the file lists
* mupuf set to delete artifacts after a week in dxvk-ci, but it does not seem to have worked
<daniels> bentiss: I can do that from the console if that helps
<bentiss> daniels: the more the merrier :)
<mupuf> "These artifacts are the latest. They will not be deleted (even if expired) until newer artifacts are available." even though I always push to master
<mupuf> ... wait, I think I get it: we use a rebasing model...
<mupuf> so, expect a lot of artifacts to expire within the next hour!
<mupuf> like 300GB of it
<bentiss> would be nice :)
<mupuf> I'll check in 1h
<bentiss> daniels: is it just me or the console is really slow?
<daniels> it's fine for me?
<bentiss> k, so must be the requests I am doing
vkareh has left #freedesktop [Leaving]
<daniels> ok, got it now
<daniels> want me to purge all jobs from that project before March?
<bentiss> daniels: I am doing it right now
<bentiss> daniels: in the ceph-tools pods, there is a file with all the disk sizes at `cat ~/sizes.txt | sort -h`, might be useful if you could help me finding the culprits :)
<daniels> heh yeah, that's pretty similar to what I had
<bentiss> next one for me is finding who is in the "532.0G bytes in 119418 objects: s3://fdo-gitlab-artifacts/69/*"
<bentiss> daniels: can you check on 69/fa/69faa6aa09a3c7446c7d3eafbd371d1b8dc8b35586718e49de86bd71a708f8cc please?
<bentiss> that's a 530.7 GB artifacts usage
<bentiss> daniels: 69/fa/... is gfx-ci/igt-ci-tags
<bentiss> mupuf: you're next -> mupuf/dxvk-ci is using 312.4GB :)
<mupuf> bentiss: yeah, that's the one I was talking about
ximion has quit []
<mupuf> mind waiting another 30 minutes to see if the mess will clean itself now that I unticked the "keep the latest pipelines' results"?
<mupuf> not sure when cron job is kicking to remove outdated artifacts
<bentiss> mupuf: OK
<bentiss> just FYI, this creates 771.1M per pipeline apparently :/
<mupuf> I have a timer to check in when 1h has passed
<mupuf> yeah, sounds about right: we generate a lot of images!
vbenes has quit []
<mupuf> we should not have too many pipelines... but, recently, dxvk devs have been pushing like 10 times in a day
<mupuf> I have limited the mirroring to happen every 4 hours, should limit the number of pipelines to 42 max per week
<mupuf> I can reduce the retention time to 3 days
<bentiss> hmm, the 4th on the list is gallo/mesa
<bentiss> daniels:, mupuf: is the install.tar something normal in the mesa ci? -> https://gitlab.freedesktop.org/gallo/mesa/-/jobs/26384209/artifacts/browse/artifacts/
<mupuf> yeah, this is how mesa is passing the build to containers/lava for execution
<bentiss> oh
<bentiss> daniels: I believe we should do a sweep on the server and untick all Keep artifacts from most recent successful jobs
<mupuf> bentiss: assuming it helps, I would tend to agree with that
<mupuf> Just need to send an email about it ahead of time :)
<mupuf> seems like dxvk-ci still has not been purged
Haaninjo has quit [Quit: Ex-Chat]
<bentiss> so it might be that it doesn't change the flags after the fact
<mupuf> oh dear...
pjakobsson has joined #freedesktop
<mupuf> bentiss: mind clearing dxvk-ci then? You can delete everything up to 2022-08-16
<bentiss> mupuf: sure
<bentiss> mupuf: it started
<mupuf> order 66! Kill all the artifacts!
<daniels> bentiss: sigh, the igt thing is ... not great
<daniels> I can try to get that sorted out
<daniels> (call now tho)
<bentiss> daniels: OK, no worries
___nick___ has joined #freedesktop
Satan has quit [Remote host closed the connection]
remyabel2 has joined #freedesktop
<marex> bentiss: daniels: I think I might have a problem with mesa.git artifacts too on local CI
<marex> there is some sort of proxy and when I do
<marex> git fetch -v -f --progress "https://gitlab.freedesktop.org/mesa/mesa.git" refs/*:refs/*
<daniels> marex: don't fetch refs/*
<daniels> unless you want it
<marex> then it eventually ends up with
<marex> error: RPC failed; HTTP 504 curl 22 The requested URL returned error: 504
<marex> daniels: that's what OE bitbake does
sergi8 has quit []
<daniels> ouch
<marex> daniels: lemme double-check that
<marex> yeah
<daniels> yeah, that's super-suboptimal
<marex> daniels: could you elaborate a bit ?
<marex> (pardon my ignorance)
<daniels> well, refs/merge-requests/ contains every MR, refs/keep-around/ keeps a bunch of various interesting points, refs/tags/ all the tags, etc
<daniels> so BitBake is telling it to fetch a huge amount of data
<marex> and this refs/merge-requests thing is a property of gitlab, right ?
<marex> i.e. every git server which is a gitlab instance would have this "problem"/behavior ?
<daniels> yep
<marex> daniels: so what would you suggest to fetch ?
<marex> ( I need to dig into bitbake history on why the refs/* is there in the first place )
<daniels> GitHub also does that for PRs btw
<daniels> just fetch refs/heads/* ...
<marex> daniels: thanks for the hint
<alanc> gitlab won't let me report abuse because the user has already been reported, and I don't see any way to delete the spam comments on https://gitlab.freedesktop.org/-/snippets/6834
eroux has joined #freedesktop
<ajax> alanc: i don't see any comments on that snippet?
<daniels> (that's because I actioned the spam report & binned the user)
<ajax> excellent
<alanc> thanks!
<alanc> there had been 3 or 4 comments that were just lists of URLs
pjakobsson has quit [Remote host closed the connection]
kelvium has joined #freedesktop
MajorBiscuit has quit [Ping timeout: 480 seconds]
kelvium has quit []
ximion has joined #freedesktop
___nick___ has quit []
___nick___ has joined #freedesktop
___nick___ has quit []
___nick___ has joined #freedesktop
remyabel2 has quit [Quit: WeeChat 3.5]
remyabel2 has joined #freedesktop
remyabel2 has quit []
ngcortes has joined #freedesktop
remyabel2 has joined #freedesktop
kisak has joined #freedesktop
<kisak> I'm seeing a minor anomaly over at gitlab.fd.o, the mesa issue tracker has 2,780 issues listed on the sidebar, but there's 2,777 open issues on the right/main section. I'm guessing there's 3 hidden (confidential?) issue reports and this is a trivial info leak.
GNUmoon has quit [Remote host closed the connection]
GNUmoon has joined #freedesktop
ybogdano has joined #freedesktop
___nick___ has quit [Ping timeout: 480 seconds]
swick has joined #freedesktop
pohly has quit []
Haaninjo has joined #freedesktop
jarthur has joined #freedesktop
jarthur has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
lyudess has joined #freedesktop
Lyude has quit [Read error: Connection reset by peer]
lyudess has quit [Read error: Connection reset by peer]
Lyude has joined #freedesktop
jarthur has joined #freedesktop
danvet has quit [Ping timeout: 480 seconds]
MajorBiscuit has joined #freedesktop
GNUmoon has quit [Remote host closed the connection]
GNUmoon has joined #freedesktop
Lyude has quit [Ping timeout: 480 seconds]
dakr has quit [Remote host closed the connection]