Tuesday, 2021-05-04

clarkbianw: ya I dont'00:00
clarkber00:00
clarkbI don't see the exception there so I think that confirms the reason we get the exception is we have the plugin present but don't enable it to do its job00:00
clarkbwhich is fine. Just nice to confirm that is why we get it00:01
ianwi wasn't sure if disablement was intentional.  i guess it's one less thing an admin can do (enable plugins) which is good, and in production we only want what's in the image anyway00:10
*** hamalq_ has quit IRC01:00
*** valleedelisle is now known as _dvd01:14
*** gothicserpent has quit IRC02:28
*** ykarel|away has joined #opendev03:12
*** vishalmanchanda has joined #opendev05:31
*** snapdeal has joined #opendev05:34
*** marios has joined #opendev05:36
*** sboyron has joined #opendev05:46
*** slaweq_ has joined #opendev05:47
*** amoralej has joined #opendev06:08
*** ralonsoh has joined #opendev06:19
*** ysandeep|away is now known as ysandeep06:28
*** slaweq_ has quit IRC06:28
*** ykarel|away is now known as ykarel06:43
ianw2021-05-04 06:13:07.748 | Installing for arm64-efi platform.06:48
ianw2021-05-04 06:13:08.505 | /usr/sbin/grub-install: error: relocation 0x113 is not implemented yet.06:48
ianwclarkb / stevebaker: ^ looks like xenial builds on arm64 are failing with this ...06:49
*** hashar has joined #opendev06:49
ianwi am really quite sick of xenial, i wonder if any arm jobs actually use it06:49
ianwi don't think any actually do from https://codesearch.opendev.org/?q=ubuntu-xenial-arm64&i=nope&files=&excludeFiles=&repos=06:50
ianwonly wheel jobs and node setup06:51
ianwi'll put it on the todo list to remove it, but if you have any thoughts of what this failure is i'm open to suggestions :)06:52
*** lpetrut has joined #opendev06:55
*** rpittau|afk is now known as rpittau07:04
*** dtantsur|afk is now known as dtantsur07:09
*** lbragstad has quit IRC07:12
openstackgerritIan Wienand proposed openstack/project-config master: Remove xenial-arm64 wheel jobs  https://review.opendev.org/c/openstack/project-config/+/78949307:13
ianwok i've started with https://review.opendev.org/q/topic:%22remove-arm64-xenial%22+(status:open%20OR%20status:merged) but i bet i've missed something somewhere; will keep at it later07:19
*** lbragstad has joined #opendev07:27
*** avass has joined #opendev07:29
*** andrewbonney has joined #opendev07:33
*** tosky has joined #opendev07:44
openstackgerritMerged opendev/glean master: Stop requiring /usr/local/bin links for glean.sh  https://review.opendev.org/c/opendev/glean/+/78201007:49
openstackgerritMerged opendev/glean master: Create "legacy" script path  https://review.opendev.org/c/opendev/glean/+/78201607:49
openstackgerritMerged opendev/glean master: Run a glean-early service to mount configdrive  https://review.opendev.org/c/opendev/glean/+/78201707:50
openstackgerritMerged opendev/glean master: Cleanup glean.sh variable names  https://review.opendev.org/c/opendev/glean/+/78235507:50
*** jpenag is now known as jpena07:51
*** whoami-rajat has joined #opendev07:53
*** ysandeep is now known as ysandeep|lunch07:57
*** slaweq_ has joined #opendev08:00
*** fressi has joined #opendev08:08
*** slaweq_ has quit IRC08:12
*** ysandeep|lunch is now known as ysandeep08:24
*** slaweq_ has joined #opendev08:42
*** slaweq_ is now known as slawe08:42
*** slawe is now known as slaweq08:42
hrwianw: xenial for arm64? abandon08:55
hrwianw: it is self-hurting process08:55
*** fressi has quit IRC08:56
*** fressi_ has joined #opendev08:57
*** lbragstad has quit IRC09:02
*** lbragstad has joined #opendev09:07
*** slaweq has quit IRC09:10
*** hrw has quit IRC09:12
*** hrw has joined #opendev09:14
hrwand bullseye nodes work now too ;)09:22
hrw2021-05-04 09:10:37.844146 | localhost | Hostname: debian-bullseye-rax-iad-002454091509:22
openstackgerritdaniel.pawlik proposed opendev/lodgeit master: Add py3.8 support  https://review.opendev.org/c/opendev/lodgeit/+/77347909:41
*** dpawlik has quit IRC09:48
*** dpawlik has joined #opendev09:48
openstackgerritNiklas Borg proposed zuul/zuul-jobs master: Add properties to upload-artifactory  https://review.opendev.org/c/zuul/zuul-jobs/+/78954310:01
openstackgerritNiklas Borg proposed zuul/zuul-jobs master: Add properties to upload-artifactory  https://review.opendev.org/c/zuul/zuul-jobs/+/78954310:10
*** amoralej is now known as amoralej|afk10:28
openstackgerritMerged zuul/zuul-jobs master: Test Debian Buster and Bullseye  https://review.opendev.org/c/zuul/zuul-jobs/+/78940410:34
*** vishalmanchanda has quit IRC10:39
*** CeeMac has joined #opendev10:43
*** amoralej|afk is now known as amoralej10:48
*** slaweq has joined #opendev11:20
mordredhrw: \o/11:25
*** slaweq has quit IRC11:31
*** jpena is now known as jpena|lunch11:33
*** tosky_ has joined #opendev11:56
*** tosky has quit IRC11:57
*** tosky_ is now known as tosky12:04
openstackgerritHervĂ© Beraud proposed opendev/irc-meetings master: Switch the release team meeting to Friday 2pm UTC  https://review.opendev.org/c/opendev/irc-meetings/+/78955612:13
*** amoralej is now known as amoralej|lunch12:22
*** jpena|lunch is now known as jpena12:32
openstackgerritMerged opendev/irc-meetings master: Switch the release team meeting to Friday 2pm UTC  https://review.opendev.org/c/opendev/irc-meetings/+/78955612:33
*** vishalmanchanda has joined #opendev12:44
*** aikema has joined #opendev13:16
*** aikema has left #opendev13:16
*** amoralej|lunch is now known as amoralej13:16
*** avass has quit IRC13:16
*** avass has joined #opendev13:17
*** snapdeal has quit IRC13:26
*** ricksanchez has joined #opendev13:46
*** slaweq has joined #opendev13:55
*** fressi_ has quit IRC13:58
*** mlavalle has joined #opendev13:59
*** lpetrut has quit IRC14:10
*** ysandeep is now known as ysandeep|dinner14:33
*** rick2 has joined #opendev14:41
*** ricksanchez has quit IRC14:44
*** rick2 is now known as rookyboo14:46
*** ysandeep|dinner is now known as ysandeep14:59
*** gothicserpent has joined #opendev15:01
openstackgerritAde Lee proposed zuul/zuul-jobs master: Add role to enable FIPS on a node  https://review.opendev.org/c/zuul/zuul-jobs/+/78877815:03
*** amoralej is now known as amoralej|off15:06
*** rookyboo has quit IRC15:15
openstackgerritClark Boylan proposed opendev/system-config master: Add support for Xenial ESM repos to our base roles  https://review.opendev.org/c/opendev/system-config/+/78959415:47
*** sshnaidm is now known as sshnaidm|afk15:59
*** marios is now known as marios|out16:03
*** ykarel has quit IRC16:04
hrwinfra-root: can we get  https://review.opendev.org/c/openstack/project-config/+/783633 and https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/783629 merged to have wheel cache for bullseye? Nodes are working, we use them in Kolla now16:07
*** marios|out has quit IRC16:10
clarkbhrw: I think fungi has already created the afs volumes for that so ya should just need someone to approve things (I have reviewed both already looks like)16:10
fungii'll double-check16:14
fungii added the distro mirror volumes to afs, but i don't recall adding wheel mirror volumes16:15
clarkbfungi: ah I remember you asking about names for them which is why I thought they had been created16:15
*** dtantsur is now known as dtantsur|afk16:17
fungino, i must have. we have mirror.wheel.deb11a64 and mirror.wheel.deb11x6416:17
fungiright, the distro mirror volume is just mirror.debian16:17
fungiso i guess i did16:17
hrwcool ;)16:18
fungiit's been a busy past few months ;)16:18
hrwyep16:19
openstackgerritDanni Shi proposed openstack/diskimage-builder master: Add a keylime-agent element  https://review.opendev.org/c/openstack/diskimage-builder/+/78960116:20
*** hamalq has joined #opendev16:27
*** hamalq has quit IRC16:35
*** hamalq has joined #opendev16:35
*** rpittau is now known as rpittau|afk16:47
*** hashar has quit IRC16:55
openstackgerritCarlos Gonçalves proposed openstack/diskimage-builder master: WIP: CentOS Stream 9 support  https://review.opendev.org/c/openstack/diskimage-builder/+/78961017:10
*** jpena is now known as jpena|off17:37
*** rookyboo has joined #opendev17:42
*** andrewbonney has quit IRC18:00
*** andrewbonney has joined #opendev18:02
*** sboyron has quit IRC18:08
openstackgerritDanni Shi proposed openstack/diskimage-builder master: Add a keylime-agent element  https://review.opendev.org/c/openstack/diskimage-builder/+/78960118:09
*** rookyboo has quit IRC18:09
*** vishalmanchanda has quit IRC18:18
*** ralonsoh has quit IRC18:25
*** hashar has joined #opendev18:41
openstackgerritClark Boylan proposed opendev/system-config master: Ansible mailman configs  https://review.opendev.org/c/opendev/system-config/+/78962218:56
*** avass has quit IRC19:00
*** rookyboo has joined #opendev19:09
*** dhellmann has quit IRC19:16
*** andrewbonney has quit IRC19:23
*** melwitt is now known as jgwentworth19:25
*** jgwentworth is now known as melwitt19:25
*** whoami-rajat has quit IRC19:42
*** dhellmann has joined #opendev19:47
*** hashar has quit IRC19:56
*** fressi has joined #opendev20:03
ianwclarkb / fungi: speaking of wheels, would you mind a look at  https://review.opendev.org/c/openstack/project-config/+/789493 to remove the xenial-arm64 wheel job from p-c per prior discussions.  i'll continue the cleanup to stop the image builds20:09
fungioh, yep, saw that in scrollback earlier--thanks!20:14
openstackgerritDanni Shi proposed openstack/diskimage-builder master: Add a keylime-agent element  https://review.opendev.org/c/openstack/diskimage-builder/+/78960120:16
openstackgerritMerged openstack/project-config master: Remove xenial-arm64 wheel jobs  https://review.opendev.org/c/openstack/project-config/+/78949320:24
openstackgerritMerged opendev/system-config master: gerrit: enable plugin reload in dev mode  https://review.opendev.org/c/opendev/system-config/+/78913020:27
openstackgerritMerged opendev/system-config master: nodepool clouds: adds stats prefix  https://review.opendev.org/c/opendev/system-config/+/78885720:28
openstackgerritMerged opendev/system-config master: Clean up Gerrit global config documentation  https://review.opendev.org/c/opendev/system-config/+/78938320:28
*** slaweq has quit IRC20:40
ianwnodepool deployment seems stuck, although it's not clear to me why20:46
clarkbianw: is it failing to ssh to a node?20:48
clarkbthis can happen if disks are full iirc20:48
ianwyeah things seem ok afaict20:48
ianwit's the apt update on nb0120:49
ianwroot     23114 23113  0 20:02 ?        00:00:02 /usr/bin/apt-get update ... seems to have started ... 50 minutes ago20:51
clarkbthat is odd20:52
ianwhow weird, i think the disk might be unhappy.  i've logged in and poked around, but now "sudo dmesg" is hung20:53
fungissh is unhappy too20:54
ianwi'll check the console but i think it needs at least a reboot20:55
fungissh finally let me in20:55
fungidmesg works, i expect it's sudo that hangs20:55
fungi[Mon May  3 04:14:11 2021] dracut[32629] *** Creating initramfs image file '/boot/initramfs-3.10.0-1160.25.1.el7.x86_64.img' done ***20:56
fungithat's the last thing dmesg reports20:56
fungialmost 2 days ago20:57
ianwnothing on console, but the host is clearly unhappy21:00
ianwi'm rebooting from console21:01
*** rookyboo has quit IRC21:05
openstackgerritClark Boylan proposed opendev/system-config master: Ansible mailman configs  https://review.opendev.org/c/opendev/system-config/+/78962221:17
clarkbassuming I haven't failed too horribly that should actually try to run tests and do some interesting21:17
clarkbI'm semi worried that like gitea the current implementation might be too slow and it might need to be come python21:18
clarkbbut one thing at a time21:18
openstackgerritClark Boylan proposed opendev/system-config master: Ansible mailman configs  https://review.opendev.org/c/opendev/system-config/+/78962221:33
openstackgerritDanni Shi proposed openstack/diskimage-builder master: Add a keylime-agent element  https://review.opendev.org/c/openstack/diskimage-builder/+/78960121:37
mordredclarkb: we don't have nearly as many mailman sites as gitea repos21:39
clarkbthat is true21:40
fungiin fact, somewhere in the range of 2-3 orders of magnitude difference21:40
clarkbalso I have to say I find ansible really awkward for this sort of configuration (basically nested sets of data)21:40
clarkbI sort of mimic'd what we did with gitea, but then did it in normal ansible for simplicity to start21:40
clarkband it feels like a lot of resetting of values because vars are weird21:41
openstackgerritAde Lee proposed zuul/zuul-jobs master: Add role to enable FIPS on a node  https://review.opendev.org/c/zuul/zuul-jobs/+/78877821:46
openstackgerritClark Boylan proposed opendev/system-config master: Ansible mailman configs  https://review.opendev.org/c/opendev/system-config/+/78962221:51
openstackgerritClark Boylan proposed opendev/system-config master: Ansible mailman configs  https://review.opendev.org/c/opendev/system-config/+/78962222:14
openstackgerritClark Boylan proposed opendev/system-config master: Ansible mailman configs  https://review.opendev.org/c/opendev/system-config/+/78962222:31
openstackgerritClark Boylan proposed opendev/system-config master: Ansible mailman configs  https://review.opendev.org/c/opendev/system-config/+/78962222:54
openstackgerritClark Boylan proposed opendev/system-config master: Ansible mailman configs  https://review.opendev.org/c/opendev/system-config/+/78962223:23
clarkbif that works I really don't grok ansibles jinja magic23:25
*** tosky has quit IRC23:28
*** stephenfin|PTO has quit IRC23:30
*** stephenfin has joined #opendev23:31
*** hamalq has quit IRC23:45
openstackgerritClark Boylan proposed opendev/system-config master: Ansible mailman configs  https://review.opendev.org/c/opendev/system-config/+/78962223:45
openstackgerritIan Wienand proposed opendev/system-config master: Build Python 3.9 python-builder/base containers  https://review.opendev.org/c/opendev/system-config/+/78965023:56

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!