Monday, 2021-02-01

*** zzzeek has quit IRC00:04
*** zzzeek has joined #openstack-infra00:05
*** jamesmcarthur has quit IRC00:09
*** jamesmcarthur has joined #openstack-infra00:13
*** jamesmcarthur has quit IRC00:18
*** jamesmcarthur has joined #openstack-infra00:36
*** yamamoto has joined #openstack-infra00:37
*** ociuhandu has joined #openstack-infra00:42
*** ociuhandu has quit IRC00:46
*** jamesmcarthur has quit IRC01:23
*** jamesmcarthur has joined #openstack-infra01:30
*** dklyle has joined #openstack-infra01:34
*** jamesmcarthur has quit IRC01:35
*** jamesmcarthur has joined #openstack-infra01:56
*** jamesmcarthur has quit IRC02:13
*** jamesmcarthur has joined #openstack-infra02:18
*** rcernin has quit IRC02:21
*** dychen has joined #openstack-infra02:25
*** dchen has quit IRC02:27
*** ociuhandu has joined #openstack-infra02:30
*** jamesmcarthur has quit IRC02:33
*** jamesmcarthur has joined #openstack-infra02:35
*** ociuhandu has quit IRC02:35
*** jamesmcarthur has quit IRC02:35
*** jamesmcarthur has joined #openstack-infra02:35
*** rcernin has joined #openstack-infra02:36
*** yamamoto has quit IRC02:38
*** yamamoto has joined #openstack-infra02:39
*** rcernin has quit IRC02:45
*** rcernin has joined #openstack-infra02:45
*** yamamoto has quit IRC03:07
*** yamamoto_ has joined #openstack-infra03:07
*** ociuhandu has joined #openstack-infra03:22
*** ociuhandu has quit IRC03:26
*** rcernin has quit IRC04:00
*** rcernin has joined #openstack-infra04:02
*** vishalmanchanda has joined #openstack-infra04:14
*** jfan has joined #openstack-infra04:15
*** jamesmcarthur has quit IRC04:16
*** jamesmcarthur has joined #openstack-infra04:16
*** jamesmcarthur has quit IRC04:21
*** ysandeep|afk is now known as ysandeep04:22
*** ociuhandu has joined #openstack-infra04:23
*** ykarel has joined #openstack-infra04:25
*** rcernin has quit IRC04:27
*** ociuhandu has quit IRC04:29
*** jamesmcarthur has joined #openstack-infra04:32
*** rcernin has joined #openstack-infra04:35
*** jamesmcarthur has quit IRC04:42
*** ociuhandu has joined #openstack-infra05:30
*** yamamoto_ has quit IRC05:33
*** ociuhandu has quit IRC05:34
*** yamamoto has joined #openstack-infra05:36
*** ykarel_ has joined #openstack-infra05:51
*** ykarel has quit IRC05:53
*** dklyle has quit IRC06:27
*** ykarel_ is now known as ykarel06:40
*** jamesmcarthur has joined #openstack-infra06:43
*** masayukig has quit IRC06:44
*** yonglihe has quit IRC06:45
*** gmann has quit IRC06:45
*** gmann has joined #openstack-infra06:47
*** masayukig has joined #openstack-infra06:47
*** yonglihe has joined #openstack-infra06:48
*** jamesmcarthur has quit IRC06:48
*** ysandeep is now known as ysandeep|afk06:58
*** ociuhandu has joined #openstack-infra07:02
*** ociuhandu has quit IRC07:06
*** rcernin has quit IRC07:25
*** ralonsoh has joined #openstack-infra07:26
*** eolivare has joined #openstack-infra07:33
*** jcapitao has joined #openstack-infra07:41
noonedeadpunkfungi: I will check what I can do with this as well thanks!07:51
*** slaweq has joined #openstack-infra07:59
*** jcapitao has quit IRC08:00
*** jcapitao has joined #openstack-infra08:02
*** rcernin has joined #openstack-infra08:07
*** rpittau|afk is now known as rpittau08:11
openstackgerritRiccardo Pittau proposed openstack/project-config master: Remove anachronistic jobs from scciclient  https://review.opendev.org/c/openstack/project-config/+/77290808:13
*** andrewbonney has joined #openstack-infra08:16
*** amoralej has joined #openstack-infra08:16
*** rcernin has quit IRC08:24
*** rcernin has joined #openstack-infra08:26
*** sboyron has joined #openstack-infra08:27
*** rcernin has quit IRC08:31
*** ykarel is now known as ykarel|lunch08:34
*** hberaud has joined #openstack-infra08:35
*** rcernin has joined #openstack-infra08:37
*** gfidente has joined #openstack-infra08:39
*** xek has joined #openstack-infra08:42
*** tosky has joined #openstack-infra08:43
*** ociuhandu has joined #openstack-infra08:45
*** ociuhandu has quit IRC08:45
*** ociuhandu has joined #openstack-infra08:45
*** hashar has joined #openstack-infra08:46
*** ociuhandu has quit IRC08:49
*** lucasagomes has joined #openstack-infra08:50
*** jpena|off is now known as jpena08:58
*** ociuhandu has joined #openstack-infra09:00
*** rcernin has quit IRC09:27
*** benj_ has quit IRC09:28
*** piotrowskim has joined #openstack-infra09:29
*** benj_ has joined #openstack-infra09:30
*** derekh has joined #openstack-infra09:30
*** ociuhandu has quit IRC09:36
*** rcernin has joined #openstack-infra09:39
*** ysandeep|afk is now known as ysandeep09:43
*** ykarel|lunch is now known as ykarel09:44
*** ociuhandu has joined #openstack-infra10:01
*** rcernin has quit IRC10:06
*** sshnaidm|off is now known as sshnaidm|ruck10:35
*** dtantsur|afk is now known as dtantsur10:54
*** dviroel has joined #openstack-infra11:07
*** rcernin has joined #openstack-infra11:16
*** nightmare_unreal has joined #openstack-infra11:20
*** ociuhandu has quit IRC11:30
*** ociuhandu has joined #openstack-infra11:30
*** ociuhandu has quit IRC11:36
*** jamesmcarthur has joined #openstack-infra11:41
*** hashar is now known as hasharLunch11:41
*** jamesmcarthur has quit IRC11:46
*** sboyron has quit IRC11:50
*** sboyron has joined #openstack-infra11:52
*** ysandeep is now known as ysandeep|afk11:56
*** jcapitao is now known as jcapitao_lunch12:03
*** dychen has quit IRC12:03
*** yamamoto has quit IRC12:16
*** rlandy has joined #openstack-infra12:16
*** jpena is now known as jpena|lunch12:30
*** rcernin has quit IRC12:33
*** yamamoto has joined #openstack-infra12:44
*** ociuhandu has joined #openstack-infra12:45
*** ociuhandu has quit IRC12:46
*** ociuhandu has joined #openstack-infra12:47
*** rcernin has joined #openstack-infra12:47
*** ysandeep|afk is now known as ysandeep12:50
*** jcapitao_lunch is now known as jcapitao12:58
openstackgerritDmitriy Rabotyagov proposed openstack/project-config master: Add ansible-role-pki repo  https://review.opendev.org/c/openstack/project-config/+/77338512:58
*** dchen has joined #openstack-infra12:59
*** dchen has quit IRC13:00
*** amoralej is now known as amoralej|lunch13:01
openstackgerritDmitriy Rabotyagov proposed openstack/project-config master: Add ansible-role-pki to zuul  https://review.opendev.org/c/openstack/project-config/+/77338713:01
*** dchen has joined #openstack-infra13:03
*** hasharLunch is now known as hashar13:03
*** EmilienM has joined #openstack-infra13:04
*** dchen has quit IRC13:11
*** yamamoto has quit IRC13:23
*** jpena|lunch is now known as jpena13:24
*** sboyron has quit IRC13:28
*** rcernin has quit IRC13:38
*** zul has joined #openstack-infra13:40
*** sboyron has joined #openstack-infra13:48
*** d34dh0r53 has joined #openstack-infra13:51
*** yamamoto has joined #openstack-infra13:54
*** ociuhandu has quit IRC13:55
*** ociuhandu has joined #openstack-infra13:56
*** __ministry1 has joined #openstack-infra14:02
*** yamamoto has quit IRC14:05
*** amoralej|lunch is now known as amoralej14:08
*** lbragstad has joined #openstack-infra14:09
openstackgerritDmitriy Rabotyagov proposed openstack/project-config master: Add ansible-role-pki repo  https://review.opendev.org/c/openstack/project-config/+/77338514:15
*** lbragstad has quit IRC14:16
*** sboyron has quit IRC14:16
*** ociuhandu has quit IRC14:19
*** ociuhandu has joined #openstack-infra14:19
*** lbragstad has joined #openstack-infra14:22
*** ociuhandu has quit IRC14:29
*** ociuhandu has joined #openstack-infra14:30
*** ociuhandu has quit IRC14:35
*** sboyron has joined #openstack-infra14:36
*** ociuhandu has joined #openstack-infra14:37
*** ociuhandu has quit IRC14:39
*** ociuhandu has joined #openstack-infra14:39
*** hashar is now known as hasharAway15:08
*** jamesmcarthur has joined #openstack-infra15:09
*** jamesmcarthur has quit IRC15:14
*** ykarel has quit IRC15:22
funginoonedeadpunk: just an update, apparently the entire network there is broken for us, ianw tried replacing the floating ip, and even booting an entirely new server instance, nothing is reachable. not sure what spontaneously changed there friday/saturday but we've reached out to our listed contact for it by e-mail and are hoping to hear back15:23
fungiin the meantime we have that region offline in nodepool15:23
noonedeadpunkhm, I know folks were looking into the issue today but haven't found anything weird and things were working atm. Will update them!15:24
funginoonedeadpunk: for the record, the only contact we have on file for that environment is robert tomczyk so that's who ianw e-mailed15:27
fungibut if there's other folks we should be talking to, i'm happy to pass along info to whoever needs it15:27
*** nightmare_unreal has quit IRC15:28
noonedeadpunkIt's contact supposed to be from City?15:29
fungirobert tomczyk seems to be with ericsson software technology, who may be the customer of record for that environment15:29
noonedeadpunkaha, I see. So it's not donated region directly to opendev on paper?15:30
fungii think maybe ericsson is paying the citycloud bill in order to support airship (and other projects in opendev)15:30
fungiwe also don't seem to have a usable dashboard login for citycloud, so no way to open a trouble ticket with their support folks15:30
noonedeadpunkOk, I see. now it's clear. Why I'm asking because all in all I think it will be mine department who will be responsible for fixing stuff. But personally I don't have access to this specific region, but my teammates does...15:31
fungiahh, okay, well whatever you can do is appreciated ;)15:31
noonedeadpunkI already submited ticket regarding this15:31
fungithanks!15:32
funginoonedeadpunk: wondering if maybe there was a live migration friday or early utc saturday (would explain the evidence we saw on the console that the kernel had been externally paused) and the network didn't get wired up correctly again at the end15:33
fungibut then that wouldn't explain why we can't make a new instance reachable either15:34
noonedeadpunkI think there was some network-node related issue so my guess is that netns is stuck but reported as alive or smth like that15:34
fungiahh, okay15:35
*** redrobot8 has joined #openstack-infra15:38
*** redrobot has quit IRC15:42
*** redrobot8 is now known as redrobot15:42
*** dklyle has joined #openstack-infra15:58
*** jamesmcarthur has joined #openstack-infra15:58
fungialso i did double-check our default security group hasn't changed, it still allows everything in/out and the rules were last modified over a year agi16:01
fungiago16:01
zbrwhat should we do about zuul-jobs that fail for very long time? (2mo)16:15
*** __ministry1 has quit IRC16:16
fungiwhich ones? usually we fix or stop running them16:17
zbrhttps://zuul.opendev.org/t/zuul/builds?job_name=zuul-jobs-test-registry-docker-multiarch&project=zuul/zuul-jobs16:19
zbrthe full list is little bit bigger, but that one did affect a change I was working on.16:22
*** ysandeep is now known as ysandeep|away16:28
*** sboyron has quit IRC16:32
*** vishalmanchanda has quit IRC16:32
fungizbr: so it's jobs running for changes to the zuul/zuul-jobs repo? in that case probably better to discuss in #zuul whether the zuul maintainers want to stop running those. it's somewhat off-topic for the openstack tact sig16:34
*** ociuhandu_ has joined #openstack-infra16:36
*** ociuhandu has quit IRC16:39
*** ociuhandu_ has quit IRC16:40
*** sboyron has joined #openstack-infra16:42
*** ociuhandu has joined #openstack-infra16:46
*** ociuhandu has quit IRC16:51
*** dtantsur is now known as dtantsur|afk17:00
*** lucasagomes has quit IRC17:02
*** vishalmanchanda has joined #openstack-infra17:05
*** rpittau is now known as rpittau|afk17:21
*** jcapitao has quit IRC17:24
*** jamesmcarthur has quit IRC17:37
*** jamesmcarthur has joined #openstack-infra17:47
*** ralonsoh has quit IRC17:50
*** derekh has quit IRC17:56
*** yamamoto has joined #openstack-infra18:02
*** jpena is now known as jpena|off18:04
*** andrewbonney has quit IRC18:05
*** yamamoto has quit IRC18:07
*** amoralej is now known as amoralej|off18:10
*** rm_work has quit IRC18:10
*** gfidente is now known as gfidente|afk18:11
*** rm_work has joined #openstack-infra18:23
*** rm_work has joined #openstack-infra18:27
*** hamalq has joined #openstack-infra18:46
*** jamesmcarthur has quit IRC18:50
*** jamesmcarthur has joined #openstack-infra18:52
*** jamesmcarthur has quit IRC18:56
*** jamesmcarthur has joined #openstack-infra18:58
*** rm_work has joined #openstack-infra19:01
*** rm_work has joined #openstack-infra19:15
*** eolivare has quit IRC19:15
*** hasharAway is now known as hashar19:17
*** rm_work has joined #openstack-infra19:22
*** zbr5 has joined #openstack-infra19:46
*** zbr has quit IRC19:47
*** zbr5 is now known as zbr19:47
*** hashar has quit IRC19:52
*** knikolla_ has joined #openstack-infra20:18
*** guilhermesp__ has joined #openstack-infra20:18
*** jrosser_ has joined #openstack-infra20:18
*** rm_work has joined #openstack-infra20:23
*** hberaud has quit IRC20:26
*** jrosser has quit IRC20:26
*** knikolla has quit IRC20:26
*** mtreinish has quit IRC20:26
*** guilhermesp has quit IRC20:26
*** auristor has quit IRC20:26
*** zigo has quit IRC20:26
*** sorrison has quit IRC20:26
*** knikolla_ is now known as knikolla20:26
*** jrosser_ is now known as jrosser20:26
*** guilhermesp__ is now known as guilhermesp20:26
*** sboyron has quit IRC20:31
*** zigo has joined #openstack-infra20:32
*** jamesmcarthur has quit IRC20:42
*** hamalq has quit IRC20:43
*** hamalq has joined #openstack-infra20:43
*** auristor has joined #openstack-infra20:48
*** jamesmcarthur has joined #openstack-infra20:54
*** jamesmcarthur has quit IRC20:54
*** gyee has joined #openstack-infra21:16
*** xek has quit IRC21:17
*** vishalmanchanda has quit IRC21:45
*** yamamoto has joined #openstack-infra22:10
*** yonglihe has quit IRC22:17
*** yamamoto has quit IRC22:17
*** jamesmcarthur has joined #openstack-infra22:18
*** rcernin has joined #openstack-infra22:20
*** jamesmcarthur has quit IRC22:36
*** slaweq has quit IRC23:01
*** piotrowskim has quit IRC23:29
*** dchen has joined #openstack-infra23:32
*** gfidente|afk has quit IRC23:36
*** dchen has quit IRC23:40
*** dchen has joined #openstack-infra23:40
*** tosky has quit IRC23:52

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!