| *** gtema has joined #opendev | 00:10 | |
| *** gtema has quit IRC | 00:14 | |
| *** DSpider has quit IRC | 00:16 | |
| openstackgerrit | melissaml proposed openstack/diskimage-builder master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/732490 | 00:46 |
|---|---|---|
| *** Meiyan has joined #opendev | 00:50 | |
| *** _mlavalle_1 has joined #opendev | 01:07 | |
| *** mlavalle has quit IRC | 01:10 | |
| *** ysandeep|away is now known as ysandeep | 01:38 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] arm64 role tests https://review.opendev.org/733034 | 01:44 |
| *** xiaolin has joined #opendev | 02:11 | |
| *** gtema has joined #opendev | 02:11 | |
| *** gtema has quit IRC | 02:16 | |
| ianw | so something interesting, with_first_found switching on architecture doesn't work, because the lookup is on the local host, not the remote host | 02:29 |
| ianw | i.e. our openafs roles work more by luck than design | 02:30 |
| *** sshnaidm has quit IRC | 02:34 | |
| clarkb | neat | 02:36 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [wip] arm64 role tests https://review.opendev.org/733034 | 02:37 |
| *** diablo_rojo has quit IRC | 02:37 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: openafs-client: arch fixes https://review.opendev.org/733040 | 02:37 |
| *** xiaolin has quit IRC | 02:41 | |
| *** xiaolin has joined #opendev | 03:17 | |
| *** sshnaidm has joined #opendev | 03:33 | |
| *** diablo_rojo has joined #opendev | 03:51 | |
| mordred | ianw: yay for luck? | 04:02 |
| mordred | ianw: oh - jeez re: architecture | 04:03 |
| *** gtema has joined #opendev | 04:12 | |
| *** gtema has quit IRC | 04:17 | |
| *** ykarel|away is now known as ykarel | 04:31 | |
| *** sshnaidm_ has joined #opendev | 04:43 | |
| *** sshnaidm has quit IRC | 04:45 | |
| diablo_rojo | #cinder clean | 04:49 |
| diablo_rojo | #glance clean | 04:49 |
| diablo_rojo | #monasca clean | 04:49 |
| mordred | diablo_rojo: I feel like you're cleaning | 04:51 |
| diablo_rojo | mordred, I am. | 04:51 |
| diablo_rojo | My OCD does not like all the 'end of day see you tomorrow' stuff | 04:51 |
| mordred | diablo_rojo: days end? | 04:52 |
| diablo_rojo | ..except its not cleaning.. | 04:52 |
| diablo_rojo | for certain teams yes.. | 04:53 |
| mordred | neat! | 04:53 |
| diablo_rojo | OMG. | 04:53 |
| diablo_rojo | Wrong channel would do it | 04:53 |
| * diablo_rojo facepalms | 04:53 | |
| mordred | :) | 04:53 |
| diablo_rojo | mordred, my bad .. | 04:55 |
| diablo_rojo | In my defense I only napped for an hour today and I was awake before 7 AM. | 04:56 |
| fungi | yep, i was about to say... | 04:56 |
| fungi | i napped far longer, but not well | 04:56 |
| fungi | at least i have 7 hours between this session and the next | 04:56 |
| ianw | rax cleanup script https://review.opendev.org/#/c/562510/ | 04:56 |
| diablo_rojo | fungi, yeah my hour wasnt awesome | 04:57 |
| diablo_rojo | After I am done on the help desk I will get to sleep.. | 04:58 |
| * diablo_rojo maths | 04:58 | |
| diablo_rojo | About 6 hours? | 04:58 |
| *** sgw has quit IRC | 05:01 | |
| *** _mlavalle_1 has quit IRC | 05:09 | |
| *** _mlavalle_1 has joined #opendev | 05:09 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Remove periodic openafs jobs https://review.opendev.org/733049 | 05:33 |
| clarkb | fwiw monasca and neutron look like they may have been big meetpad users based on logs | 05:47 |
| clarkb | they may be good sources of feedback on how to make clients happy and what could be improved | 05:47 |
| clarkb | diablo_rojo: I told larissa that yesterday it felt like I had jetlag even though I only had to fly to my office across the hallway | 05:48 |
| clarkb | today was much easier for me thankfully | 05:48 |
| diablo_rojo | clarkb, lol did you have early meetings? or stay up late? | 05:49 |
| clarkb | ya I was up super early yesterday then between meetings and kids being crazy beacuse they knew it was a day before their birthday it was a tiring day | 05:50 |
| diablo_rojo | Oh yeah, how was their birthday? | 05:51 |
| clarkb | it was quiet. I think welearned some things about socially dostant kid birthdays | 05:53 |
| diablo_rojo | What did you do? | 05:55 |
| clarkb | made cupcakes and put together lego friends turtle rescue | 05:56 |
| *** Meiyan has quit IRC | 06:08 | |
| *** _mlavalle_1 has quit IRC | 06:14 | |
| *** _mlavalle_1 has joined #opendev | 06:15 | |
| *** gtema has joined #opendev | 06:15 | |
| *** dtantsur|afk is now known as dtantsur | 06:43 | |
| *** tkajinam has quit IRC | 06:56 | |
| *** tkajinam has joined #opendev | 06:56 | |
| *** bolg has joined #opendev | 06:57 | |
| *** gtema has quit IRC | 07:18 | |
| *** tosky has joined #opendev | 07:24 | |
| *** ravsingh has joined #opendev | 07:34 | |
| AJaeger | ianw: do we build dib images with python3? See https://review.opendev.org/#/c/732911/1/nodepool/elements/openstack-repos/extra-data.d/50-create-repo-list - this would break if we use python2 | 07:38 |
| *** ravsingh has quit IRC | 07:44 | |
| *** gtema has joined #opendev | 07:48 | |
| *** olaph has quit IRC | 07:53 | |
| *** DSpider has joined #opendev | 07:55 | |
| *** moppy has quit IRC | 08:01 | |
| *** moppy has joined #opendev | 08:01 | |
| *** diablo_rojo has quit IRC | 08:07 | |
| *** ravsingh has joined #opendev | 08:17 | |
| frickler | AJaeger: seems python is python 3.8.2 in the nodepool-builder container, just checked that on nb01, so this should be fine | 08:24 |
| *** redrobot has quit IRC | 08:35 | |
| *** _mlavalle_1 has quit IRC | 08:38 | |
| *** _mlavalle_1 has joined #opendev | 08:39 | |
| *** ysandeep is now known as ysandeep|lunch | 08:39 | |
| *** roman_g has joined #opendev | 08:41 | |
| *** tkajinam has quit IRC | 08:53 | |
| *** tkajinam has joined #opendev | 08:54 | |
| *** tkajinam has quit IRC | 09:09 | |
| AJaeger | thanks, frickler | 09:17 |
| ianw | AJaeger: yeah, we should, and we just dropped py2 support in dib | 09:26 |
| *** ysandeep|lunch is now known as ysandeep | 09:33 | |
| *** gtema has quit IRC | 10:02 | |
| *** _mlavalle_1 has quit IRC | 10:27 | |
| *** gtema has joined #opendev | 10:37 | |
| *** gtema has quit IRC | 10:43 | |
| *** gtema has joined #opendev | 10:56 | |
| *** priteau has joined #opendev | 10:59 | |
| *** hashar has joined #opendev | 11:26 | |
| *** rpittau|afk is now known as rpittau | 11:57 | |
| *** sgw has joined #opendev | 12:01 | |
| *** ysandeep is now known as ysandeep|afk | 12:06 | |
| *** hashar has quit IRC | 12:24 | |
| *** hashar has joined #opendev | 12:24 | |
| *** ysandeep|afk is now known as ysandeep | 12:55 | |
| *** tkajinam has joined #opendev | 12:57 | |
| *** mlavalle has joined #opendev | 13:02 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Add the namespace in wait-for-pods role https://review.opendev.org/731292 | 13:10 |
| *** gtema has quit IRC | 13:14 | |
| *** gtema has joined #opendev | 13:17 | |
| *** Guest27280 has joined #opendev | 13:22 | |
| *** Guest27280 is now known as redrobot | 13:25 | |
| *** gtema has quit IRC | 13:26 | |
| *** gtema has joined #opendev | 13:26 | |
| *** lpetrut has joined #opendev | 14:10 | |
| *** diablo_rojo has joined #opendev | 14:11 | |
| corvus | clarkb: did you use the native jitsi-meet android app with meetpad? did it open the etherpad on start? | 14:23 |
| *** lpetrut has quit IRC | 14:30 | |
| *** hashar has quit IRC | 14:35 | |
| *** hashar has joined #opendev | 14:35 | |
| openstackgerrit | Thierry Carrez proposed opendev/system-config master: Start meetings with video muted https://review.opendev.org/733159 | 14:51 |
| clarkb | corvus: I havent but I think ttx does/did | 14:55 |
| clarkb | he suggested the mobile vlients after successfully using them with meetpaf | 14:55 |
| corvus | i just tried it, and it's a bit different -- the etherpad takes up the whole screen | 15:01 |
| corvus | clarkb, ttx: was trying to think about the appropriate response to the concern here: https://github.com/jitsi/jitsi-meet/pull/5270 -- what do you think? | 15:01 |
| clarkb | corvus: I think status quo on mobile may be a good idea given that description | 15:04 |
| clarkb | the doc is still there but you can manage the call without being stuck (or feeling that way) in an etherpad | 15:04 |
| corvus | yeah; maybe i'll just update it with a doc comment indicating the behavior difference | 15:05 |
| *** mlavalle has quit IRC | 15:07 | |
| *** gtema has quit IRC | 15:15 | |
| *** mlavalle has joined #opendev | 15:20 | |
| *** gtema has joined #opendev | 15:21 | |
| *** gtema has quit IRC | 15:33 | |
| *** gtema has joined #opendev | 15:36 | |
| openstackgerrit | gugug proposed openstack/project-config master: Retire puppet-congress project - step 1 end project gating https://review.opendev.org/733182 | 15:41 |
| *** gtema has quit IRC | 15:46 | |
| *** jaicaa has quit IRC | 15:50 | |
| fungi | after the fix merged to get our periodic jobs running again, mirror01.ord.rax.opendev.org got a new ssl cert, though graphite01.opendev.org seems not to have yet | 15:50 |
| *** jaicaa has joined #opendev | 15:50 | |
| fungi | i'll take a closer look in a bit | 15:51 |
| corvus | maybe in a few hours if the ptg board is clear of meetpad entries we could land https://review.opendev.org/733022 ? or do we just want to defer that until next week? | 15:53 |
| fungi | i'm fine merging when there are folks around to test/troubleshoot | 15:55 |
| clarkb | ya I think w ecan land that during the break between blocks | 15:55 |
| fungi | i just didn't want to do it and then leave someone else to clean up the mess if something went unexpectedly wrong | 15:55 |
| fungi | corvus: also your opinion on 733159 would be good, maybe we want to put that in at the same time? | 15:56 |
| corvus | fungi: ++ on both | 15:57 |
| *** gtema has joined #opendev | 15:59 | |
| fungi | fwiw, meetpad audio has been rock-solid for me once i realized that low bandwidth mode would turn off receiving video streams | 16:00 |
| fungi | i just lack the cpu horsepower and/or hardware acceleration features necessary to handle video from more than a handful of participants. even on audio-only mode it runs around a load average of 3 | 16:00 |
| fungi | as soon as i turn on video, even low definition, the system becomes starved enough for cpu that the audio starts cutting out | 16:01 |
| fungi | and it's not just a jitsi-meet problem, the html5 client for zoom is similarly resource-hungry for me | 16:02 |
| tosky | an old intel graphic card? | 16:06 |
| *** ykarel is now known as ykarel|away | 16:07 | |
| *** dtantsur is now known as dtantsur|afk | 16:13 | |
| clarkb | mlavalle: it looks like neutron may have been using meetpad yesterday. Is that the case? How many people did you have in those sessions? any other meetpad feedback we should try to incorporate? | 16:16 |
| *** rpittau is now known as rpittau|afk | 16:24 | |
| *** gtema has quit IRC | 16:30 | |
| fungi | tosky: i don't know what counts as "old" but haswell (~2013) and cherrytrail (~2015) based systems with on-board intel video chipsets, yes | 16:31 |
| fungi | i prefer to stick to 100% mainline kernel video drivers. i don't trust the tainted/proprietary out of tree binary blob drivers | 16:32 |
| tosky | I guess it also depends on the browsers blacklisting some cards | 16:32 |
| *** ysandeep is now known as ysandeep|away | 16:33 | |
| *** hashar has quit IRC | 16:34 | |
| *** hashar has joined #opendev | 16:34 | |
| clarkb | fungi: fwiw I don't think there are out of tree intel drivers | 16:39 |
| fungi | right, that's what i meant. i haven't been buying systems which needed out of tree video drivers | 16:39 |
| fungi | which is why i'm using the intel video controllers | 16:39 |
| clarkb | I've checked graphite's acme.sh logs and it shows a cert renewal | 16:43 |
| clarkb | but the cert served by its web server expires July 1 | 16:44 |
| clarkb | I think this is a case of not properly restarting servicesfor some reason | 16:44 |
| openstackgerrit | Pierre Riteau proposed openstack/project-config master: Add Backport-Candidate label for Kolla deliverables https://review.opendev.org/733243 | 16:46 |
| fungi | clarkb: yep, that's where i've gotten to as well | 16:47 |
| fungi | checking apache logs next | 16:47 |
| openstackgerrit | Pierre Riteau proposed openstack/project-config master: Add Backport-Candidate label for Kolla deliverables https://review.opendev.org/733243 | 16:48 |
| clarkb | fungi: looking at the service-letsencrypt logs I think we are running the touch file handler which is noopy for graphite | 16:48 |
| clarkb | oh I remember | 16:48 |
| clarkb | we touch the file which puppet is then supposed to key off of iirc | 16:49 |
| fungi | yeah, /var/log/apache2/error.log shows the last apache reconfig was at 06:25:02 during log rotation | 16:49 |
| clarkb | but I think that we can probably just switch that to restarting apache | 16:49 |
| fungi | but the cert file wasn't updated until 06:34 | 16:49 |
| fungi | so i agree, apache just hasn't done a reload yet | 16:50 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Restart apache on graphite when LE updates certs https://review.opendev.org/733247 | 16:52 |
| clarkb | fungi: ^ I think maybe that is a fix? I can't see nayhting that is supposed to consume that stamp and restart apache (but I think that was one of our really early designs before we realized we could just have ansible do it even if puppet is managingthe apache configs) | 16:52 |
| clarkb | maybe we can get ianw to double check 733247 later today and if there isn't something we are missing land that and manually restart apache | 16:54 |
| *** gtema has joined #opendev | 17:04 | |
| *** gtema has quit IRC | 17:09 | |
| fungi | clarkb: even if that change merges, we'll need an apache reload (graceful restart) to load the new cert before the next time the le role renews it | 17:12 |
| fungi | any objection to me doing a reload now? | 17:12 |
| fungi | it'll be after july 1 before another cert gets issued | 17:13 |
| clarkb | fungi: ya, my only concern us maybe something is supposed to use that stamp file that we touch and it is broken (I cant find where that is fwiw) | 17:14 |
| clarkb | debugging that may be more difficult if we manually reload/restart | 17:14 |
| fungi | fair, there's no hurry, we've got a month still | 17:14 |
| openstackgerrit | Pierre Riteau proposed openstack/project-config master: Propose Review-Difficulty label for Kayobe https://review.opendev.org/733283 | 17:15 |
| clarkb | diablo_rojo: we are in the ptg break time now right? | 17:16 |
| mlavalle | clarkb: the Neutron's team experience with meetpad has been great. In fact, this morning we joined the edge team in their zoom room for a x-project session and I experienced problems with zoom that I haven't had with meetpad | 17:16 |
| clarkb | infra-root I think we can go ahead and approve those two jitsi meet config changes now if we are in the break period | 17:16 |
| mlavalle | clarkb: the only problem mentioned in the session yesterday was that some team members were unable to see the integrated etherpad. I had no problems whatsoever, but other team members mentioned it | 17:17 |
| clarkb | mlavalle: that is great to hear. Do you have a rough idea for peak co current users? | 17:17 |
| corvus | clarkb: done | 17:17 |
| mlavalle | clarkb: the peak has been somewhere 15 to 20 | 17:17 |
| mlavalle | but consistently we have at least 10 | 17:17 |
| diablo_rojo | clarkb, yes we are | 17:17 |
| fungi | mlavalle: awesome feedback, thanks! | 17:17 |
| fungi | mlavalle: and yes, i also have trouble getting the shared document to remain visible. no idea why yet | 17:18 |
| corvus | mlavalle: in the menu on the bottom right, there's an option to "open shared document" which should toggle the etherpad | 17:18 |
| corvus | mlavalle: that might help get it to show up if it doesn't automatically | 17:18 |
| mlavalle | corvus: I am aware of that... but still some team members had trouble with the document | 17:18 |
| corvus | mlavalle: okay, good to know that sometimes there's still trouble even using that | 17:19 |
| mlavalle | corvus: I'll mention it tomorrow and see what feedback we get. we are done for today | 17:19 |
| corvus | mlavalle: thanks! | 17:19 |
| fungi | but like in my case, i have yet to find the necessary magic to get it to stay visible. it goes away again as soon as someone starts talking and the client wants to go back to displaying their "camera" but i'm out of troubleshooting ideas | 17:19 |
| mlavalle | I'll report back here tomorrow | 17:19 |
| corvus | we're about to merge some "tweaks" that we hope might improve things for folks (but no direct fixes for that issue) | 17:19 |
| mlavalle | ok, let's see if with those improvements the doc problem goes away | 17:20 |
| *** ravsingh has quit IRC | 17:20 | |
| corvus | mlavalle: sorry, i mean we don't expect the changes to affect the doc problem; they're all related to video stuff | 17:20 |
| *** ysandeep|away is now known as ysandeep | 17:20 | |
| mlavalle | ah ok | 17:21 |
| mlavalle | ack | 17:21 |
| corvus | (but hey, who knows? it's a complex system :) | 17:21 |
| fungi | so we're clear to merge those now? i can go ahead and approve them if so | 17:21 |
| corvus | fungi: i just did | 17:21 |
| fungi | even better, thanks! | 17:21 |
| *** hashar has quit IRC | 17:22 | |
| *** hashar has joined #opendev | 17:23 | |
| openstackgerrit | Pierre Riteau proposed openstack/project-config master: Propose Review-Difficulty label for Kayobe https://review.opendev.org/733283 | 17:29 |
| *** hashar has quit IRC | 17:35 | |
| openstackgerrit | Merged opendev/system-config master: Start meetings with video muted https://review.opendev.org/733159 | 17:48 |
| openstackgerrit | Merged opendev/system-config master: Indicate firefox is suboptimal in meetpad https://review.opendev.org/733022 | 17:48 |
| clarkb | once those are applied I'll spin up a room on firefox and double check I get the warning | 17:53 |
| clarkb | and I guess we want to confirm that we enter muted too | 17:54 |
| corvus | i'll get my laptop w/ camera ready | 17:54 |
| clarkb | but then I'm long overdue for a bike ride so if jitsi is still happy I'll try to go out on one of those | 17:54 |
| mordred | corvus, mlavalle: re: viewing etherpad, I've had both experiences - I've had moments where I can't get it to show me the etherpad, and moments where it all works as expected with no intervention. I'm *mostly* in the "it just works" camp, but a few times for reasons I don't yet know I joined the other camp | 17:57 |
| corvus | yeah, that's been my experience too | 17:57 |
| corvus | but mostly the 'just works' camp recently | 17:57 |
| mordred | corvus: I had a fun one this morning | 17:58 |
| clarkb | when it happens it seems to be triggered by jitsi trying to show the actively speaking person | 17:58 |
| clarkb | it seems that in some scenarios that overrides the "focus on shared doc" state | 17:58 |
| mordred | a couple fo times gtema disconnected, and every time he did I lost audio and had to reload the browser window | 17:58 |
| mordred | s/disconnected/was unexpectedly disconnected/ | 17:58 |
| corvus | mordred: fascinating | 17:58 |
| clarkb | deploy is done with both of those changes. I'll be hopping on https://meetpad.opendev.org/meetpadtest1 with FF to check the mute state and the warning | 17:59 |
| fungi | i'm outside trying to wrestle the lawn into submission, so no cam handy but can at least double-check dd | 17:59 |
| fungi | er, ff | 17:59 |
| clarkb | FF warning worked I seem to be unmuted | 17:59 |
| * clarkb tries chrome to see if mute state is set there | 17:59 | |
| corvus | muted video btw, not audio :) | 18:01 |
| *** ysandeep is now known as ysandeep|away | 18:01 | |
| clarkb | for those watching here everything seems to work as expected | 18:02 |
| fungi | yeah, that's what i expected from the change (muted video, not audio) | 18:03 |
| corvus | in ff, i saw the etherpad-not-pinned behavior | 18:03 |
| corvus | but in chrome, etherpad-pinned worked as expected | 18:03 |
| fungi | interesting. i saw it not start pinned in chromium | 18:03 |
| fungi | as well as in ff | 18:03 |
| corvus | i wonder if it's a race | 18:03 |
| mordred | I also did not start with a pinned etherpad | 18:04 |
| mordred | althugh - the last meetpad I did before this one I had switched to viewing not-etherpad | 18:04 |
| mordred | I wonder if there is a cookie memory? | 18:04 |
| corvus | maybe some saved state/cookie? | 18:04 |
| mordred | yeah | 18:04 |
| mordred | well - I ujst re-joined the test meetpad and this time I had etherpad | 18:05 |
| mordred | so if it is saving state it's doing a really bad job of it | 18:05 |
| corvus | :/ | 18:05 |
| fungi | could be. i'll try blowing away my chromium profile in a bit and starting fresh. i've only been using it for meetpad so there's nothing to lose | 18:05 |
| corvus | i really want to find out how to watch the xmpp messages; i feel like that could be important to debugging this. | 18:05 |
| mordred | corvus: tcpdump ;) | 18:06 |
| * mordred does not want to watch xmpp messages via tcpdump | 18:06 | |
| corvus | more than that right now, i want to get exercise, so back after lunch | 18:06 |
| clarkb | me too re exercise. | 18:07 |
| fungi | corvus: mordred: also not sure if you've seen, but a couple of nova contributors in prc reported not being able to get audio working, so the nova team switched to zoom presuming meetpad is blocked by the gfwoc | 18:09 |
| fungi | i have my doubts that's really the case, but would love to get to the bottom of it | 18:09 |
| fungi | i suppose it's possible prc considers xmpp traffic "suspicious" | 18:11 |
| openstackgerrit | Ghanshyam Mann proposed opendev/irc-meetings master: Fix the policy popup team meeting id https://review.opendev.org/733298 | 18:22 |
| mnaser | getting 502s in gerrit | 18:32 |
| fungi | looking | 18:34 |
| fungi | my default gerrit dashboard is loading fine for me... any specific urls a problem? | 18:35 |
| fungi | i've pulled up some changes, no problem | 18:35 |
| fungi | also diff views are loading for me | 18:35 |
| fungi | mnaser: did you get any error detail message with the 502? | 18:36 |
| mordred | maybe those are the special 502s I configured just to mess with mnaser | 18:39 |
| mnaser | i just had it when i clicked on a change id | 18:39 |
| mnaser | it was the UI as an error message :X | 18:39 |
| mnaser | i mean, it went back to being ok after, but i figured it may have been the start of osmething | 18:39 |
| fungi | will definitely keep an eye out, but sounds like it may have been an isolated incident | 18:42 |
| fungi | keep in mind the gerrit webui is a monolithic js app, which is making gerrit api calls, so odds are the api returned a 502 to the client on some operation(s) | 18:42 |
| openstackgerrit | Sorin Sbarnea (zbr) proposed zuul/zuul-jobs master: test-playbooks: improved syntax https://review.opendev.org/731591 | 18:48 |
| *** hashar has joined #opendev | 19:05 | |
| *** hashar has quit IRC | 19:13 | |
| *** hashar has joined #opendev | 19:13 | |
| *** sshnaidm_ is now known as sshnaidm | 19:19 | |
| *** gtema has joined #opendev | 19:19 | |
| *** hashar_ has joined #opendev | 19:24 | |
| *** gtema has quit IRC | 19:24 | |
| *** hashar_ has quit IRC | 19:24 | |
| *** hashar has quit IRC | 19:25 | |
| *** hashar has joined #opendev | 19:25 | |
| corvus | mordred: remind me -- we need this to be green before we can do the thing where we set up a gate-specific set of zuul connections, right? https://review.opendev.org/731258 | 19:50 |
| fungi | AJaeger: if you get a few minutes in the coming days, ildiko is trying to work out how to get content searches enabled for docs.starlingx.io, starting with https://review.opendev.org/733116 but there's presumably more to it than just that | 20:10 |
| fungi | i'm guessing their docs repo likely needs to add the search page to the toc as well, but i'm really not sure yet | 20:11 |
| AJaeger | fungi: stephenfin did that work AFAIR, so better to ask him. | 20:11 |
| fungi | AJaeger: perfect, thanks! | 20:11 |
| AJaeger | fungi: but I'll check as well | 20:11 |
| fungi | it's not urgent, just figured you might have deeper understanding of sphinx's search bits | 20:11 |
| fungi | deeper than mine that is | 20:12 |
| AJaeger | fungi: no, not really - there're some areas I avoid ;) | 20:12 |
| *** priteau has quit IRC | 20:12 | |
| fungi | yeah, i completely sympathize. dark magicks | 20:12 |
| clarkb | I'm trickling back in now. Anything ai should check once tacos are consumed? | 20:14 |
| *** prometheanfire has quit IRC | 20:16 | |
| AJaeger | fungi: left a review on the theme, just a shot in the dark ;) | 20:16 |
| *** prometheanfire has joined #opendev | 20:16 | |
| fungi | clarkb: nothing so important as tacos, no | 20:16 |
| fungi | thanks AJaeger! | 20:17 |
| AJaeger | clarkb: want to review https://review.opendev.org/732478 and https://review.opendev.org/#/c/733041 (I think the latter is wrong but didn't find the time to dig deep enough) for wheel building, please? | 20:18 |
| *** smcginnis has quit IRC | 20:18 | |
| *** smcginnis has joined #opendev | 20:19 | |
| mordred | corvus: yes | 20:23 |
| mordred | corvus: I have *NO IDEA* what's wrong with the linter - I tried reproducing locally and can't | 20:25 |
| mordred | corvus: and by linter here - I mean the yaml parser is doing something sort of bonghits | 20:25 |
| corvus | ERROR: InvocationError for command /bin/bash -c 'find roles playbooks -type f -regex '"'"'.*.y[a]?ml'"'"' -print0 | xargs -t -n1 -0 ansible-lint' (exited with code 123) | 20:25 |
| corvus | sigh | 20:25 |
| mordred | corvus: I'm lying to you | 20:25 |
| mordred | we do not need that patch to work | 20:26 |
| corvus | is that really all the error message we get out of that? | 20:26 |
| mordred | (although I still don't understand why it's not woirking | 20:26 |
| mordred | corvus: we got a different error in the previous run of the job | 20:26 |
| mordred | corvus: we need https://review.opendev.org/#/c/730991/ for your thing | 20:26 |
| mordred | corvus: 731258 is just simplifying something using the new ability | 20:26 |
| corvus | mordred: but isn't 258 the one that shows us that 991 really works? :) | 20:26 |
| mordred | yes - that's right - but I think 258 is showing it works, other than the linter derp | 20:27 |
| corvus | i mean, 991 dosen't break, but 258 is the first thing to use the facility, right? | 20:27 |
| corvus | ok | 20:27 |
| mordred | that's right | 20:27 |
| corvus | i agree we could proceed with the info we have. though i would have to put this table i just flipped over back upright and then flip it again if i spend a bunch of time doing that only to see "exit code 123" from ansible-lint. | 20:27 |
| mordred | corvus: https://zuul.opendev.org/t/openstack/build/d5d900a29ea744ba988063034b76d6be/log/job-output.txt#1494 | 20:28 |
| mordred | corvus: that's the error I got on the _previous_ run | 20:28 |
| mordred | which makes less than zero sense | 20:28 |
| corvus | oh that's the same i think | 20:29 |
| mordred | corvus: we're getting the same error in the 123 ... https://zuul.opendev.org/t/openstack/build/2ee7552d4cd042ff91c69d9cfbf00e26/log/job-output.txt#1412 | 20:29 |
| corvus | it's just in a slightly different order | 20:29 |
| mordred | yeah | 20:29 |
| mordred | oh - wait ... | 20:29 |
| mordred | I think the traceback is making slightly more sense ... it's complaining about an undefined varialbe in a really weird way I think? | 20:30 |
| corvus | weird; the only variables removed there are bridge_hostvar* and git grep shows no hits for that | 20:32 |
| clarkb | AJaeger: I'm not an rpm expert but I can definitely review the job stuff | 20:33 |
| corvus | could it be that extra_users isn't available in some context? | 20:33 |
| mordred | corvus: yeah - maybe the linter run isn't picking that up because it doesn't have enough inventory context | 20:33 |
| corvus | oh interesting | 20:34 |
| mordred | corvus: but ... like ... it woudl get no values that way | 20:34 |
| AJaeger | fungi: I was wrong, stephenfin did not work on the search - but still the best contact to ask | 20:34 |
| mordred | so I still don't understand | 20:34 |
| *** hashar has quit IRC | 20:35 | |
| AJaeger | clarkb: the RPM looks ok | 20:35 |
| clarkb | AJaeger: ya looking at the publish side now | 20:36 |
| *** xiaolin has quit IRC | 20:36 | |
| AJaeger | I think the parent is wrong for a promote, this is mixing publish and promote. | 20:37 |
| clarkb | AJaeger: ya I think you may be right | 20:38 |
| clarkb | I want to say we are promoting system config docs via afs now right? so that may be a pattern to hceck /me looks | 20:38 |
| corvus | mordred: thisk seems very likely to impact similar changes; how do you think we should proceed? | 20:40 |
| corvus | mordred: should we try to figure out the ansible-lint bug and fix or work around it? or should we consider removing ansible-lint from system-config (istr we were on the verge of doing that several times in the past already) | 20:41 |
| AJaeger | thanks, clarkb ! Calling it a day now... | 20:41 |
| mordred | corvus: I'd vote for removal for now | 20:42 |
| mordred | corvus: I have failed for the last 2 days to figure it out | 20:42 |
| corvus | mordred: ok. i'll run 'tox -e linters' locally real quick just to get one more data point, then i'll push something up | 20:42 |
| mordred | corvus: ok cool | 20:42 |
| mordred | clarkb: if you get a sec, could you review https://review.opendev.org/#/c/730991/ and its parents? corvus is going to need it for his zuul work | 20:44 |
| mordred | corvus, clarkb: and https://review.opendev.org/#/c/731583/ needs 2 reviews | 20:44 |
| * mordred afk for errand | 20:48 | |
| corvus | mordred: hrm, i'm able to repro locally | 20:48 |
| corvus | mordred: i'm running ansible-lint with python3.6 | 20:49 |
| clarkb | mordred: can you check the comment on https://review.opendev.org/#/c/730999/12 | 20:50 |
| *** roman_g has quit IRC | 20:50 | |
| clarkb | fungi: does openstackid use any of hte php stuff removed in https://review.opendev.org/#/c/731947/1/modules.env ? | 20:52 |
| corvus | mordred: it's the testinfra_extra_data thing. | 20:54 |
| corvus | mordred: i have no idea why your change would trigger that. | 20:54 |
| clarkb | fungi: grepping in puppet-openstackid says no, but I know its got php of some sort in there | 20:55 |
| fungi | clarkb: good question, looking | 20:55 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Override bridge hostvars directly https://review.opendev.org/731258 | 20:56 |
| corvus | mordred: i fixed it there, but i get really unhappy whenever we write incorrect code to satisfy a linter | 20:57 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Stop running ansible-lint on this repo https://review.opendev.org/733406 | 20:59 |
| corvus | so that's there for us to evaluate. | 21:00 |
| clarkb | I guess that our integration testing should be sufficient to catch the mismatch ' in yaml that ansible hates as well as other related problems | 21:01 |
| corvus | probably in most cases? | 21:04 |
| corvus | clarkb: i'm curious why 999 did not fail testing. | 21:04 |
| clarkb | corvus: me too | 21:04 |
| clarkb | corvus: I triple checked my human python parser and ended up deciding that the code there wasn't quite right | 21:05 |
| clarkb | but ya it should've failed I think? | 21:05 |
| clarkb | (I'm trying to get through the stack before sorting that out) | 21:07 |
| corvus | testinfra/test_zuul.py::test_iptables[ansible://ze01.opendev.org] PASSED [ 98%] | 21:07 |
| corvus | sorry, this is the relevant one: | 21:08 |
| corvus | testinfra/test_zuul.py::test_iptables[ansible://zuul01.openstack.org] PASSED [ 99%] | 21:08 |
| corvus | which means this must be false: if host.backend.get_hostname() == 'zuul01.openstack.org': | 21:08 |
| corvus | i don't really understand why that isn't just in its own file | 21:09 |
| corvus | with its own test | 21:09 |
| corvus | that's used in a number of places and seems really dangerous | 21:11 |
| corvus | like, there's no way to tell if that matches or not | 21:11 |
| corvus | i'm working on a patch | 21:17 |
| clarkb | https://review.opendev.org/#/c/730991/24 is quite the change, but I think it looks good now | 21:22 |
| clarkb | corvus: thanks, let me know if I can help, I'm through the bulk of that stack now | 21:23 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Stop using backend hostname in zuul testinfra tests https://review.opendev.org/733409 | 21:23 |
| corvus | clarkb: ^ take a look and see if that makes sense? :) | 21:24 |
| corvus | i'm going through and looking for similar pitfalls | 21:24 |
| corvus | i think the test_backups usage is okay, because it's used to skip entire tests (so we can verify it ran) | 21:26 |
| corvus | same for nodepool | 21:26 |
| corvus | letsencrypt is more complicated, but it's also a case where we know the test either ran (with *one* of the datasets, though we can't confirm which) or was skipped. on balance, it's probably okay too. | 21:27 |
| clarkb | corvus: I like it, but I think I found a bug (noted on the change) | 21:28 |
| corvus | so that was the only usage where we could fail open and not tell from the logs (the others can fail open by skipping, but that's also true by just setting testinfra_hosts wrong) | 21:28 |
| corvus | clarkb: heh i thought i typed that in :) | 21:28 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Stop using backend hostname in zuul testinfra tests https://review.opendev.org/733409 | 21:29 |
| corvus | we could restructure that back into one file, and use the 'skip' approach used in the other files... maybe i'll do that as a followup and we can see which we like better | 21:30 |
| corvus | that's cool, i just lost a file due to git review | 21:38 |
| corvus | i think i see what i did wrong, but man it was really easy to do :( | 21:39 |
| clarkb | hrm its always had a sad when it does the rebasing if there are outstanding edits | 21:40 |
| clarkb | (I use git stash a lot to deal with that) | 21:40 |
| corvus | yeah, i accidentally did a git add before the git rebase abort | 21:40 |
| corvus | poof | 21:40 |
| corvus | i feel like git and i disagree about what should happen when i abort a rebase after doing a git add. | 21:41 |
| *** roman_g has joined #opendev | 21:41 | |
| corvus | it's okay. no big deal. i'll just write the entire change again. i type fast. | 21:41 |
| clarkb | you might be able to get it out of the reflog? | 21:42 |
| clarkb | but no ref would've been created ? | 21:42 |
| clarkb | that is a weird git behavior | 21:42 |
| corvus | correct, there is no commit with my file in it | 21:43 |
| fungi | remind me again why git-review performs a test rebase before pushing? | 21:46 |
| corvus | to see if it's going to merge-conflict after uploading | 21:46 |
| clarkb | fungi: to avoid pushing unmergable commits | 21:46 |
| fungi | yeah, so just to catch that case | 21:46 |
| fungi | which zuul would quickly report on the change anyway in our case | 21:46 |
| corvus | yeah, though i'd never see it :) | 21:46 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Recombine zuul testinfra tests into one file https://review.opendev.org/733413 | 21:46 |
| fungi | you would presumably eventually notice that zuul left a verify -1 on the change, but yeah not necessarily any time soon | 21:47 |
| fungi | it seems like there ought to be a more atomic way of testing locally for potential merge conflicts without leaving the worktree in a dirty mid-rebase state | 21:48 |
| fungi | i guess it could immediately --abort and make the user initiate a git rebase themselves? | 21:49 |
| corvus | i want to say that we thought auto-aborting could be risky? but then we do just tell users to do that, so... :/ | 21:50 |
| fungi | yeah, for me the biggest confusion with that scenario usually comes from mental context, i didn't say rebase, and if i don't read carefully i forget it's left me mid-rebase | 21:51 |
| clarkb | I run with git status stuff in my PS1 and that helps, but git-review doesn't set that up for people (and it probably shouldn't) | 21:51 |
| fungi | i guess we could add a secondary worktree and perform the rebase in that | 21:53 |
| fungi | just as an ephemeral copy | 21:53 |
| clarkb | in a tmpdir maybe | 21:53 |
| fungi | though on a very large repo that might be slow | 21:53 |
| fungi | though maybe not if it's all on the same fs | 21:53 |
| clarkb | it wouldn't be for me if using /tmp | 21:54 |
| clarkb | since i've got my homedir on a separate partition and fs from other things | 21:55 |
| clarkb | and I don't know if we can nest git repos safely? | 21:55 |
| mnaser | are we okay to use the check-arm64 pipeline in our jobs (asking on behalf of osa) | 21:59 |
| clarkb | mnaser: I think so. With annotation that resources are limited and we still run into occasional multi arch issues that challenge our expectations | 22:00 |
| clarkb | mnaser: hrw and ianw are likely the best resources for confirming that though | 22:00 |
| mnaser | clarkb: yeah -- i think the other thing is wheel builds dont seem to happen for arm (yet) | 22:01 |
| mnaser | so that might take a hit on our jobs | 22:01 |
| clarkb | mnaser: its in progress right now iirc | 22:01 |
| clarkb | addingthem I mean | 22:01 |
| mnaser | i almost got excited seeing http://mirror.sjc1.vexxhost.opendev.org/wheel/ :) | 22:01 |
| fungi | i wonder if git review could try to instead do a `git merge --no-ff --no-commit` | 22:03 |
| fungi | mnaser: yeah, it's coming ;) | 22:03 |
| fungi | the latest hangup is that there are lots more wheels we need to build for arm64 than for amd64 | 22:04 |
| fungi | because far fewer projects publish arm64 wheels to pypi | 22:04 |
| fungi | so we need to outfit the build job with a bunch of additional build requirements | 22:05 |
| fungi | and also it will take waaay longer to run, not only because the nodes may be slower, but also just the sheer number of additional builds from sdist it will require | 22:05 |
| fungi | basically our amd64 jobs get to take advantage of the fact that a lot of dependencies which have c extensions get "manylinux1" platform wheels on pypi, but those are still architecture-specific and most are only x86-64/amd64 | 22:07 |
| fungi | very few have aarch64/arm64 manylinux1 wheels, but that's slowly improving and people are finding that, say, travis-ci has the ability to build them | 22:08 |
| clarkb | right there are ~3 types of wheels we deal with. The trivial type that have no c bindings and are all python. These run on any platform and many are already on pypi. The next is those with c bindings. Many are on pypi but only for x86-64. And finally those that aren't built for anything on pypi and we always build them ourselves | 22:09 |
| fungi | and our projects can reach out to upstreams for their dependencies with pull requests adding configuration to build those | 22:09 |
| fungi | but that's going to be a long road | 22:10 |
| clarkb | corvus: fwiw I think I prefer the split out testinfra tests | 22:17 |
| corvus | clarkb: yeah, i think they're more future-proof | 22:17 |
| clarkb | it makes things nice and clear without reading test content super carefully to see what is being tested | 22:17 |
| clarkb | however its still passing without the % ip ? | 22:18 |
| clarkb | the followup has the %ip but not the split out one | 22:18 |
| clarkb | both are +1'd | 22:18 |
| clarkb | is it because we don't run the testinfra tests against that change? | 22:20 |
| clarkb | I think that may be it | 22:20 |
| corvus | yeah, that's why i intentionally did not fix thi bug :) | 22:21 |
| ianw | mnaser/clarkb/fungi : all of https://review.opendev.org/#/c/733040/ https://review.opendev.org/#/c/733041/ https://review.opendev.org/#/c/731401/ would help with arm64 wheels :) | 22:29 |
| ianw | if we get the openafs builds published, i think we have enough to publish the wheel builds with the current code | 22:30 |
| fungi | noted, i'll try to take a look once i finish with my weapons of grass destruction | 22:30 |
| ianw | and i'll work on moving them to afs via the executor after | 22:31 |
| clarkb | ianw: AJaeger and I had a comment on the afs rpm pblishing change but I think it can proably go ahead if that was the intended publishing location | 22:31 |
| fungi | also, ops meetup reports they used meetpad and had essentially zero problems. kept video off most of the time, didn't miss it because most of them had the etherpad up anyway. averaged around 17-20 participants. all very happy with it. success! | 22:32 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Stop using backend hostname in zuul testinfra tests https://review.opendev.org/733409 | 22:32 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Recombine zuul testinfra tests into one file https://review.opendev.org/733413 | 22:32 |
| corvus | fungi: \o/ | 22:32 |
| fungi | ianw: yeah, afs on the executor means adding additional architectures no longer depends on working openafs support for those architectures | 22:33 |
| fungi | which would be awesome | 22:33 |
| ianw | clarkb: yeah, i intended to switch the location in system-config afs-client role once they're in that location. as you say, i think just the consistent location should be ok | 22:33 |
| ianw | fungi: yep, i want to move all the copy and index generation into o-z-j and then we can gate test that portion, and the executor just has to rsync | 22:34 |
| ianw | (notes in https://etherpad.opendev.org/p/Multi-arch-2020-VPTG) | 22:35 |
| fungi | ooh, i missed the multi-arch sig session i guess. meant to hit that one but it probably conflicted with something else for me | 22:36 |
| *** roman_g has quit IRC | 22:38 | |
| ianw | i think that one would have been the night shift for you :) | 22:39 |
| clarkb | ianw: we noticed that graphite.o.o's LE handler was the touch file handler and not restart apache | 22:43 |
| clarkb | ianw: was that intentional? if not can we land https://review.opendev.org/#/c/733247/ ? | 22:43 |
| clarkb | (looks like thatneeds a recheck /me does this) | 22:43 |
| clarkb | the cert has been updated on the server but apache is still serving the old cert hwich expires july 1 | 22:44 |
| clarkb | that change is expected to fix it in the future but we'll manually reload apache this time if this was an oversight | 22:44 |
| *** roman_g has joined #opendev | 22:45 | |
| ianw | oh, no i don't think it was intentional. maybe it had something to do with initial ideas to containerise it | 22:45 |
| openstackgerrit | Merged openstack/project-config master: Move wheel build role/job outside project-config https://review.opendev.org/731401 | 22:46 |
| clarkb | cool fungi ^ I think that means we can do the manual reload now. Did you still want to do it? I can do it if you are calling it a day or otherwise busy | 22:46 |
| *** DSpider has quit IRC | 22:48 | |
| fungi | i can do it, still watching seagulls land on the handle of my mower and answering e-mails | 22:51 |
| fungi | Not After : Sep 1 05:34:35 2020 GMT | 22:52 |
| fungi | #status log manually reloaded apache on graphite.o.o to pick up renewed le cert, https://review.opendev.org/733247 fixes longer term | 22:53 |
| openstackstatus | fungi: finished logging | 22:53 |
| fungi | i almost sent out a search party for statusbot | 22:53 |
| fungi | okay, guess i should scare off the gulls and finish the lawn | 22:54 |
| clarkb | thanks for getting that sorted | 22:55 |
| ianw | other thing on openafs and arm64 etc, there was some interest in having particularly arm64 testing with openafs upstream's gerrit | 22:58 |
| ianw | they currently seem to use buildbot to do a compile test on changes, we could do a end-to-end install and functionality test like we do in system-config gate | 22:59 |
| ianw | we would have to figure out how to build on debuntu from source; https://wiki.openafs.org/devel/HowToBuildOpenAfsRpmPackages/ has some interesting thigns for rpm generation from trunk | 23:00 |
| clarkb | ianw: we could even add their gerrit to zuul potentially | 23:07 |
| clarkb | maybe thats what you meant? | 23:07 |
| *** factor has joined #opendev | 23:09 | |
| fungi | ianw: what specific openafs packages are we looking to build on arm64? debian already builds a bunch they distribute: https://packages.debian.org/search?keywords=openafs | 23:10 |
| fungi | for example, openafs-client 1.8.6~pre1-3 is built for arm64 in sid | 23:11 |
| fungi | as is openafs-fileserver | 23:11 |
| clarkb | fungi: I thinkwe want to avoid the pre packages? | 23:11 |
| clarkb | that was the source of our problems on bionic | 23:11 |
| fungi | right, but we could still likely use the packagING just not the packagES | 23:11 |
| clarkb | we've got a ppa building packages for bionic on a proper release | 23:11 |
| clarkb | fungi: I think we are? | 23:12 |
| clarkb | but via ppa | 23:12 |
| clarkb | (maybe my asumption we can extend the ppa to debian is flawed) | 23:12 |
| fungi | then i'm not clear on what "figure out how to build on debuntu from source" means | 23:12 |
| clarkb | fungi: I think thats for building tip of master | 23:12 |
| fungi | yeah, just saying the packaging for 1.8.6~pre1-3 in debian/sig can likely be used to package tip of master as well | 23:13 |
| fungi | at least it's where i'd start | 23:13 |
| clarkb | gotcha | 23:13 |
| fungi | happy to help with that if there are more specifics on what's needed | 23:14 |
| fungi | i had a zoo of a dozen different major processor architecture representatives running debian i used to use to do ports of packages to less popular architectures, and it's usually pretty straightforward | 23:15 |
| fungi | but in this case most of the porting work is likely already figured out | 23:15 |
| fungi | since debian has packages ported to arm64 from source close to master | 23:16 |
| ianw | yeah, debian is better than bionic/focal that have shipped pre versions | 23:16 |
| ianw | i did mean connect our zuul to their gerrit | 23:16 |
| ianw | currently we install from our ppa -- which i agree it would be better if we had local jobs that built the .debs we install, as having it out-of-band is a bit of an overall anti-pattern | 23:17 |
| ianw | so if we came up with something similar to the rpm build jobs but for the .debs | 23:17 |
| ianw | and if that could build debs not just from releases but from zuul checkouts ... | 23:18 |
| ianw | we'd be 90% of the way there | 23:18 |
| ianw | (to useful testing for upstream gerrit) | 23:18 |
| ianw | one sticking point is that the .spec is part of the openafs source, while the debian/ packaging is maintained separately afaik | 23:19 |
| ianw | there's probably little point if we spend more time dealing with broken packaging than actually testing the packaged source code | 23:20 |
| clarkb | as a heads up I've realized that we've got kid doctor visits on the 12th which is the day we pencilled in for project renaming in gerrit | 23:20 |
| clarkb | I don't have to AFK until about 1800UTC so going earlier is probably best if I'll be helping | 23:21 |
| clarkb | but I'm also not even sure if they'll allow multiple adults in at the same time so it may be a non issue | 23:21 |
| fungi | ianw: to be fair, debian is *why* ubuntu shipped ~pre builds... because debian has been including them in its sid (unstable) suite, which is where ubuntu pulls its packages from | 23:23 |
| fungi | debian's just smart enough not to migrate those to its testing and stable suites | 23:23 |
| fungi | it's more about how ubuntu auto-syncs packages it doesn't care about from debian | 23:23 |
| ianw | yeah, i guess it's the don't care bit because the bionic bug has been open since bionic | 23:24 |
| ianw | as i'm using arm64 more -- the mirror is the most unreliable part : http://paste.openstack.org/show/794337/ | 23:24 |
| openstackgerrit | Guillaume Chauvel proposed zuul/zuul-jobs master: Add python_version for tox27 https://review.opendev.org/733419 | 23:25 |
| ianw | it drops afs connection like that constantly | 23:25 |
| fungi | ianw: are these possibly connectivity/responsiveness problems with that environment? | 23:25 |
| ianw | yeah, i mean i guess it must be, the traceroute from the mirror to rackspace is only 11 steps | 23:27 |
| fungi | do you hit similar errors with proxied files or just afs-served? | 23:28 |
| ianw | i don't really have exposure to jobs that are using a lot of the proxy side of things, only the packages really | 23:28 |
| *** mlavalle has quit IRC | 23:41 | |
| *** mlavalle has joined #opendev | 23:44 | |
| ianw | "I will bump the severity and work on this once I am caught up" : Date: Mon, 11 Apr 2016 | 23:49 |
| ianw | famous last words :) | 23:49 |
| *** tosky has quit IRC | 23:50 | |
| *** factor has quit IRC | 23:52 | |
| *** mlavalle has quit IRC | 23:52 | |
| *** factor has joined #opendev | 23:52 | |
| *** roman_g has quit IRC | 23:57 | |
| *** mlavalle has joined #opendev | 23:57 | |
| ianw | 23:54:56.639157 IP 192.168.1.4 > 104.130.138.161: ICMP host 192.168.1.4 unreachable - admin prohibited, length 102 | 23:57 |
| ianw | i wonder what that means | 23:57 |
| ianw | i can ping between mirror and afs01 just fine, doens't drop a single packet | 23:58 |
| clarkb | admin prohibited is a firewall I think | 23:59 |
| clarkb | likely not ours, but check syslog for iptables logging to rule it out? | 23:59 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!