Tuesday, 2018-10-02

*** jcoufal has joined #openstack-infra00:05
*** mriedem has quit IRC00:05
*** jcoufal has quit IRC00:11
*** slaweq has joined #openstack-infra00:11
*** slaweq has quit IRC00:15
*** sthussey has quit IRC00:16
*** rossella_s has quit IRC00:18
*** rossella_s has joined #openstack-infra00:19
*** longkb has joined #openstack-infra00:24
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: fetch-javascript-content-tarball: add create_tarball variable  https://review.openstack.org/60674000:25
*** rossella_s has quit IRC00:36
*** rossella_s has joined #openstack-infra00:37
*** dpawlik has joined #openstack-infra00:45
*** longkb has quit IRC00:48
*** dpawlik has quit IRC00:50
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: WIP: Add API endpoint to get frozen jobs  https://review.openstack.org/60707700:54
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: WIP: Get executor job params  https://review.openstack.org/60707800:54
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: WIP: Separate out executor server from runner  https://review.openstack.org/60707900:54
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: WIP: Move common AnsibleJob prep tasks into a base class  https://review.openstack.org/60708000:54
*** rossella_s has quit IRC00:54
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: WIP: Move prep tasks out of execute into a common method  https://review.openstack.org/60708100:54
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: WIP: Implement a local zuul-runner  https://review.openstack.org/60708200:54
*** rossella_s has joined #openstack-infra00:54
*** jamesmcarthur has joined #openstack-infra00:55
*** dpawlik has joined #openstack-infra01:01
*** jamesmcarthur has quit IRC01:03
*** rossella_s has quit IRC01:03
*** rossella_s has joined #openstack-infra01:04
*** dpawlik has quit IRC01:05
*** efried has joined #openstack-infra01:15
*** ijw has joined #openstack-infra01:16
*** ijw has quit IRC01:21
*** mrsoul has quit IRC01:22
*** hongbin has joined #openstack-infra01:23
*** owalsh_ has joined #openstack-infra01:29
*** rossella_s has quit IRC01:30
*** threestrands_ has joined #openstack-infra01:30
*** rossella_s has joined #openstack-infra01:30
*** owalsh has quit IRC01:33
*** threestrands has quit IRC01:33
*** threestrands_ has quit IRC01:43
*** efried has quit IRC02:10
*** efried1 has joined #openstack-infra02:10
*** efried1 is now known as efried02:12
*** rossella_s has quit IRC02:14
*** rossella_s has joined #openstack-infra02:14
*** roman_g has quit IRC02:17
*** jamesmcarthur has joined #openstack-infra02:23
*** rossella_s has quit IRC02:25
*** rossella_s has joined #openstack-infra02:26
*** yamamoto has quit IRC02:32
*** yamamoto has joined #openstack-infra02:33
*** yamamoto has quit IRC02:37
*** rossella_s has quit IRC02:52
*** rossella_s has joined #openstack-infra02:52
openstackgerritMichael Johnson proposed openstack/diskimage-builder master: Fix DIB ubuntu-minimal running on bionic (18.04)  https://review.openstack.org/60447803:01
*** jamesmcarthur has quit IRC03:01
*** dpawlik has joined #openstack-infra03:02
openstackgerritJohn Studarus proposed openstack-infra/project-config master: a control plane capacity upgrade is planned for later this week  https://review.openstack.org/60702003:03
*** longkb has joined #openstack-infra03:04
*** studarus has joined #openstack-infra03:05
*** yamamoto has joined #openstack-infra03:05
*** dpawlik has quit IRC03:06
*** dave-mccowan has quit IRC03:07
*** jamesmcarthur has joined #openstack-infra03:09
openstackgerritMerged openstack-infra/project-config master: a control plane capacity upgrade is planned for later this week  https://review.openstack.org/60702003:10
*** yamamoto has quit IRC03:12
*** hongbin has quit IRC03:15
*** dpawlik has joined #openstack-infra03:17
*** dpawlik has quit IRC03:22
*** rossella_s has quit IRC03:22
*** rossella_s has joined #openstack-infra03:23
*** diablo_rojo has quit IRC03:27
*** jamesmcarthur has quit IRC03:28
*** rossella_s has quit IRC03:28
*** rossella_s has joined #openstack-infra03:29
*** ijw has joined #openstack-infra03:36
*** studarus has quit IRC03:44
*** yamamoto has joined #openstack-infra03:47
*** annp has joined #openstack-infra04:01
*** rossella_s has quit IRC04:02
*** rossella_s has joined #openstack-infra04:02
*** rossella_s has quit IRC04:12
*** rossella_s has joined #openstack-infra04:14
AJaegerconfig-core, please review: python3-first migrations: https://review.openstack.org/597822 and https://review.openstack.org/597583; a couple of cleanups : https://review.openstack.org/531830 https://review.openstack.org/531829 https://review.openstack.org/604610 ; and also: https://review.openstack.org/606387 https://review.openstack.org/59942904:14
*** rossella_s has quit IRC04:26
*** rossella_s has joined #openstack-infra04:29
*** auristor has quit IRC04:31
*** pcaruana has joined #openstack-infra04:36
*** auristor has joined #openstack-infra04:37
*** pcaruana has quit IRC04:43
*** rossella_s has quit IRC04:44
*** rossella_s has joined #openstack-infra04:45
*** rossella_s has quit IRC05:02
*** rossella_s has joined #openstack-infra05:02
*** e0ne has joined #openstack-infra05:06
*** e0ne has quit IRC05:06
*** rossella_s has quit IRC05:16
*** rossella_s has joined #openstack-infra05:16
*** mtreinish has quit IRC05:17
*** dpawlik has joined #openstack-infra05:18
*** mtreinish has joined #openstack-infra05:21
*** rossella_s has quit IRC05:22
*** dpawlik has quit IRC05:23
*** rossella_s has joined #openstack-infra05:24
*** rossella_s has quit IRC05:34
*** dpawlik has joined #openstack-infra05:34
*** rossella_s has joined #openstack-infra05:34
*** quiquell|off is now known as quiquell05:38
*** dpawlik has quit IRC05:39
*** rossella_s has quit IRC05:44
*** rossella_s has joined #openstack-infra05:50
*** dpawlik has joined #openstack-infra06:00
*** rossella_s has quit IRC06:01
AJaegerfrickler, jhesketh, do you have time for reviews, please? ^06:01
*** rossella_s has joined #openstack-infra06:03
*** Krenair has quit IRC06:04
*** rossella_s has joined #openstack-infra06:04
*** slaweq has joined #openstack-infra06:11
*** slaweq has quit IRC06:16
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Add zuul to the linters tox env  https://review.openstack.org/60702606:16
AJaegersekharvajjula: are you still around?06:19
AJaegersekharvajjula: are you responsible for Nokia Airframe CI?06:19
openstackgerritMerged openstack-infra/project-config master: make pipeline precedence progressively higher  https://review.openstack.org/60612906:21
*** Krenair has joined #openstack-infra06:21
AJaeger#status log We merged change https://review.openstack.org/606129 to change precedence of pipelines and I'm curious to see this in practice.06:24
openstackstatusAJaeger: finished logging06:24
*** yamamoto has quit IRC06:27
*** yamamoto has joined #openstack-infra06:27
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Extract pep8 messages for inline comments  https://review.openstack.org/58963406:32
*** d0ugal has joined #openstack-infra06:32
*** olivierb has quit IRC06:36
*** Emine has quit IRC06:36
*** dims has quit IRC06:38
*** Krenair has quit IRC06:39
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Add role path to JSON result in callback plugin  https://review.openstack.org/60710506:39
*** dims has joined #openstack-infra06:44
*** dims has quit IRC06:48
prometheanfireunable to freeze job depgraph?06:49
AJaegerprometheanfire: broken Nokia Airframe CI ;(06:49
*** kjackal_v2 has joined #openstack-infra06:50
*** dims has joined #openstack-infra06:51
* prometheanfire shrugs06:52
*** Krenair has joined #openstack-infra06:55
*** e0ne has joined #openstack-infra07:00
AJaegerprometheanfire: I tried contacting them without success so far ;(07:00
AJaegerinfra-root, log-stash job queue is growing and growing - anything stuck?07:01
*** rcernin has quit IRC07:01
*** pcaruana has joined #openstack-infra07:01
*** oanson has joined #openstack-infra07:01
*** adriancz has joined #openstack-infra07:03
*** dpawlik has quit IRC07:04
*** shardy has joined #openstack-infra07:04
*** ginopc has joined #openstack-infra07:05
*** olivierb has joined #openstack-infra07:06
*** slaweq has joined #openstack-infra07:07
prometheanfireas long as people know07:07
AJaegerlet's see whether I get an answer later today...07:09
*** ginopc has quit IRC07:10
*** kopecmartin|off is now known as kopecmartin|ruck07:17
*** ginopc has joined #openstack-infra07:19
*** rockyg has quit IRC07:20
*** dpawlik has joined #openstack-infra07:24
AJaegersekharvajjula: the Nokia Airframe CI is broken, it reports on many changes where it should not report07:34
*** psachin has joined #openstack-infra07:35
AJaegersekharvajjula: https://review.openstack.org/607026 is one example where it should not report.07:35
sekharvajjulaAJaeger: Oh Sorry. I am trying to setup a New Thirdparty CI. Need some help on this!07:35
AJaegersekharvajjula: take it down for now, please.07:36
AJaegersekharvajjula: I can only explain what's broken - but cannot help with setup ;(07:36
AJaegersekharvajjula: https://docs.openstack.org/infra/system-config/third_party.html is our reference07:36
AJaegerThat one explains also the wiki - I could not find the Nokia CI in the wiki and thus had no contact point.07:37
sekharvajjulaSure I have pulled it down now.07:37
sekharvajjulaHope it would not create anymore mess!07:37
sekharvajjulaSorry for the disturbance caused.07:38
AJaegersekharvajjula: that URL also includes contact channel (#openstack-third-party or so) - further questions are appropriate here. But I'm not the expert and nobody is around right now, better during US times07:38
*** slaweq has quit IRC07:39
sekharvajjulaOk. I will shout for the help during US time in #openstack-third-party IRC channel. thanks for the help07:40
AJaegersekharvajjula: #openstack-third-party-ci is the name - and if nobody helps there, ask here.07:40
AJaegersekharvajjula: thanks for taking down the CI system. As next step, I suggest you update the wiki pages as explained in the web page I linked.07:41
openstackgerritColleen Murphy proposed openstack-infra/puppet-pip master: [debug] Fix openstack_pip provider for pip 18  https://review.openstack.org/60602107:44
sekharvajjulaAjaeger: I am now updating the contact details for Nokia Airframe CI in the wiki.07:46
*** tosky has joined #openstack-infra07:47
openstackgerritMerged openstack-infra/irc-meetings master: Schedule Neutron Performance meeting  https://review.openstack.org/60687007:49
AJaegersekharvajjula: thanks07:49
*** slaweq has joined #openstack-infra07:49
openstackgerritIldiko Vancsa proposed openstack-infra/project-config master: Create stx-governance repository  https://review.openstack.org/60711707:49
*** jpena|off is now known as jpena07:50
*** priteau has joined #openstack-infra07:50
*** d0ugal has quit IRC07:53
*** jpich has joined #openstack-infra08:01
*** jtomasek has joined #openstack-infra08:03
*** owalsh_ is now known as owalsh08:06
sekharvajjulaAJaeger: Added new page with contact details. https://wiki.openstack.org/wiki/ThirdPartySystems/Nokia_Airframe_CI08:06
openstackgerritColleen Murphy proposed openstack-infra/puppet-pip master: [debug] Fix openstack_pip provider for pip 18  https://review.openstack.org/60602108:08
*** alexchadin has joined #openstack-infra08:11
AJaegerthanks, sekharvajjula08:13
AJaegersekharvajjula: wiki looks fine now...08:14
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Add role path to JSON result in callback plugin  https://review.openstack.org/60710508:16
*** sshnaidm|off is now known as sshnaidm08:30
*** derekh has joined #openstack-infra08:37
*** roman_g has joined #openstack-infra08:39
*** kjackal_v2 is now known as kjackal08:44
*** alexchadin has quit IRC08:45
*** kjackal has quit IRC08:48
*** kjackal has joined #openstack-infra08:49
openstackgerritColleen Murphy proposed openstack-infra/puppet-pip master: [debug] Fix openstack_pip provider for pip 18  https://review.openstack.org/60602108:51
*** ykarel has joined #openstack-infra08:53
*** aojea has joined #openstack-infra08:53
*** alexchadin has joined #openstack-infra08:59
*** slaweq has quit IRC09:19
*** yamamoto has quit IRC09:19
*** yamamoto has joined #openstack-infra09:20
*** slaweq has joined #openstack-infra09:21
*** ykarel is now known as ykarel|away09:22
*** yamamoto has quit IRC09:24
openstackgerritColleen Murphy proposed openstack-infra/puppet-pip master: [debug] Fix openstack_pip provider for pip 18  https://review.openstack.org/60602109:27
*** hamzy has quit IRC09:32
*** hamzy has joined #openstack-infra09:32
*** dtantsur|afk is now known as dtantsur09:33
openstackgerritSorin Sbarnea proposed openstack-infra/project-config master: Add coats project to openstack-infra  https://review.openstack.org/60713609:41
*** yamamoto has joined #openstack-infra09:42
ssbarneaAJaeger: if you could give me some hints on adding new infra project it would be great, preliminary work done as https://review.openstack.org/#/c/607136/ - for example I have no idea where to define the core groups.09:45
*** electrofelix has joined #openstack-infra09:45
openstackgerritColleen Murphy proposed openstack-infra/puppet-pip master: [debug] Fix openstack_pip provider for pip 18  https://review.openstack.org/60602109:52
*** psachin has quit IRC09:59
AJaegerssbarnea: http://docs.openstack.org/infra/manual/creators.html explains everything10:00
*** longkb has quit IRC10:00
ssbarneaAJaeger: following it, still there something undocumented about gerrit "team should be created", but with no hints on how to add gerrit groups.10:10
*** dpawlik has quit IRC10:16
*** dpawlik has joined #openstack-infra10:17
openstackgerritSorin Sbarnea proposed openstack-infra/project-config master: Add coats project to openstack-infra  https://review.openstack.org/60713610:22
*** ykarel|away has quit IRC10:26
*** hamzy has quit IRC10:33
*** hamzy has joined #openstack-infra10:34
*** ykarel|away has joined #openstack-infra10:35
*** gfidente has joined #openstack-infra10:37
AJaegerssbarnea: https://docs.openstack.org/infra/manual/creators.html#update-the-gerrit-group-members is the one paragraph, is that not clear?10:39
*** yamamoto has quit IRC10:40
*** yamamoto has joined #openstack-infra10:40
*** rpittau has joined #openstack-infra10:50
openstackgerritSorin Sbarnea proposed openstack-infra/infra-manual master: Makes documentation easier to read  https://review.openstack.org/60715110:56
ssbarneaAJaeger: thanks, missed it but i raised ^ to improve the doc a little bit.10:58
*** kjackal has quit IRC10:58
*** annp has quit IRC11:01
*** d0ugal has joined #openstack-infra11:01
*** dave-mccowan has joined #openstack-infra11:02
AJaegerssbarnea: thanks11:04
ssbarneaAJaeger: kudos! i could waste a lot of time without your tips. for example i would like to add another improvement to the docs but I don't know what to write about this message: "All projects11:06
ssbarnea  referenced within a Zuul configuration must first be added to the main11:06
ssbarnea  configuration file by the Zuul administrator."11:06
*** jamesmcarthur has joined #openstack-infra11:06
ssbarneanew users are likely to encounter it and it would be better to find it inside the docs.11:07
*** e0ne has quit IRC11:10
*** jamesmcarthur has quit IRC11:11
AJaegerssbarnea: https://docs.openstack.org/infra/manual/creators.html#adding-the-project-to-the-ci-system , see the itemized list11:14
AJaegerSo, it should be covered - question how to improve...11:14
*** jtomasek has quit IRC11:16
*** jtomasek has joined #openstack-infra11:16
*** jaosorior has joined #openstack-infra11:16
*** jtomasek has quit IRC11:17
openstackgerritIldiko Vancsa proposed openstack-infra/project-config master: Create stx-governance repository  https://review.openstack.org/60711711:17
ssbarneaAJaeger: Reason for putting this project under infra is because it is closely11:17
ssbarnearelated to CI zuul, gerrit and build logs, so not really something11:17
ssbarneawe would ever ship with openstack. If you think is still  better/easier to have it under openstack/ -- i have no problem with it.11:17
*** jtomasek has joined #openstack-infra11:18
AJaegerssbarnea: we have other stuff under openstack , like gerrit-dash-creator and gertty, so no worries with that. IF you want to go to openstack-infra, talk to clarkb first.11:20
*** alexchadin has quit IRC11:21
ssbarneaAJaeger: putting under openstack would be easier/faster? if so, I would change it right away.11:22
AJaegerssbarnea: yes easier and faster ;)11:23
*** kjackal has joined #openstack-infra11:25
*** tbarron has joined #openstack-infra11:27
*** hamzy has quit IRC11:32
openstackgerritIldiko Vancsa proposed openstack-infra/project-config master: Create stx-governance repository  https://review.openstack.org/60711711:32
*** hamzy has joined #openstack-infra11:32
openstackgerritSorin Sbarnea proposed openstack-infra/project-config master: Add coats project to openstack-infra  https://review.openstack.org/60713611:34
openstackgerritColleen Murphy proposed openstack-infra/puppet-pip master: [debug] Fix openstack_pip provider for pip 18  https://review.openstack.org/60602111:38
*** jpena is now known as jpena|lunch11:47
*** ykarel|away has quit IRC11:49
*** shardy has quit IRC11:49
*** bobh has joined #openstack-infra11:49
*** e0ne has joined #openstack-infra11:50
*** shardy has joined #openstack-infra11:50
*** ykarel has joined #openstack-infra11:50
*** bobh has quit IRC11:53
aspiersICYMI, the 2018 Gerrit User Summit is Nov 15-16 https://gerrit.googlesource.com/summit/2018/+/master/index.md11:59
aspiersfungi: ^^^11:59
*** rh-jelabarre has joined #openstack-infra12:03
*** ssbarnea|bkp has joined #openstack-infra12:04
*** yamamoto has quit IRC12:07
*** yamamoto has joined #openstack-infra12:08
*** ykarel is now known as ykarel|away12:08
*** boden has joined #openstack-infra12:12
*** yamamoto has quit IRC12:12
*** trown|outtypewww is now known as trown|brb12:16
*** trown|brb is now known as trown12:16
*** beagle is now known as beagles12:16
*** ykarel|away has quit IRC12:19
openstackgerritSorin Sbarnea proposed openstack-infra/project-config master: Add coats project to openstack-infra  https://review.openstack.org/60713612:20
*** Emine has joined #openstack-infra12:23
*** haleyb has quit IRC12:23
*** quiquell is now known as quiquell|lunch12:24
*** ssbarnea|bkp has quit IRC12:26
*** ssbarnea|bkp2 has joined #openstack-infra12:26
*** haleyb has joined #openstack-infra12:27
openstackgerritColleen Murphy proposed openstack-infra/puppet-pip master: [debug] Fix openstack_pip provider for pip 18  https://review.openstack.org/60602112:31
*** rossella_s has quit IRC12:32
*** jcoufal has joined #openstack-infra12:32
*** markvoelker has joined #openstack-infra12:32
*** rossella_s has joined #openstack-infra12:34
*** agopi|brb is now known as agopi12:35
*** Bhujay has joined #openstack-infra12:36
tinwoodhi.  I've got a question re a stale set of docs at https://docs.openstack.org/charm-deployment-guide/latest/  -- the up-to-date docs are at https://docs.openstack.org/project-deploy-guide/charm-deployment-guide/latest/ -- I *think* nothing is now generating them after the recent changes in how deploy docs are generated, and I'm wondering how to remove the former link from the docs.openstack.org site?  Any pointers much12:40
tinwoodappreciated!12:40
*** jamesmcarthur has joined #openstack-infra12:40
tinwoodThe charm-deployment-guide is a project (in it's own right) so they *are* sort-of the docs for the "project".12:41
*** ansmith has joined #openstack-infra12:41
*** jpena|lunch is now known as jpena12:42
AJaegertinwood: an infra-root needs to delete the content manually from the file server. Most are travelling this week, so if nobody does this for you, please ask again next week. But you're at the right place here ;)12:44
*** yolanda has quit IRC12:45
dtroyerclarkb, infra:  I'd like to finish up docs.starlingx.io (https://review.openstack.org/599048 and https://review.openstack.org/599054) soon if possible, we release in 3 weeks and still need to set up publish jobs, etc…it looks like https://review.openstack.org/#/c/601302/ has merged12:45
tinwoodAJaeger, ah thanks very much; I'll make a note to ask next week.  Also, is there maybe a project that a bug could be filed to? (I know it's not a 'bug', but just to track it ...)12:45
*** mriedem has joined #openstack-infra12:46
*** yamamoto has joined #openstack-infra12:51
AJaegertinwood: not really for this kind of process work - an email to openstack-infra would be an option as well.12:55
*** tellesnobrega has joined #openstack-infra12:55
tinwoodAJaeger, ah, yes, that seems reasonable.  Thanks very much.12:56
tellesnobregaclarkb, hi, not sure if you remember, but I talked to you about a work we are doing in sahara to split the plugins code from core project12:56
*** pcaruana has quit IRC12:57
*** kgiusti has joined #openstack-infra12:57
tellesnobregayou suggested using filter-branch but we were wondering if we can just get the sahara code and work on top of it. Remove what we don't need anymore and commit it. It would still keep the same history as sahara itself12:58
*** d0ugal has quit IRC13:00
*** jamesmcarthur has quit IRC13:02
clarkbdtroyer: left a couple +2s with notes. hopefully fungi can help with the cert while I conference. Na dthe jobs can go in now if you remove the depends on13:03
clarkbtellesnobrega: that will work, the repo will be bigger than necessart but maybe also easier to work with and get set up13:03
tellesnobregaclarkb, thanks13:04
AJaegerclarkb: do you have time for two quick reviews - https://review.openstack.org/#/c/597822 and https://review.openstack.org/597583; ? Or shall I wait for fungi?13:04
openstackgerritDean Troyer proposed openstack-infra/project-config master: Set up stx-docs and stx-specs publish jobs  https://review.openstack.org/59905413:05
dtroyerclarkb: thanks, and happy conferencing!13:06
clarkbAJaeger: I can look after breakfast13:06
AJaegerdtroyer, clarkb: I'll take clarkb's +2 on 599054 over to your updated change and will +2A13:07
dtroyerAJaeger: thanks13:07
AJaegerclarkb: thanks - enjoy breakfast!13:07
*** bobh has joined #openstack-infra13:08
openstackgerritColleen Murphy proposed openstack-infra/puppet-pip master: [debug] Fix openstack_pip provider for pip 18  https://review.openstack.org/60602113:10
toskyclarkb, tellesnobrega: our workflow is apparently a bit more complicated, the last workflow that we discussed is:13:14
toskycopy sahara.git; filter-branch removing everything not plugin-related; add a commit which moves stuff around; copy the repo to 6 repositories (one for each plugin); filter-branch for each plugin13:15
toskygiven that we will have 6 repositories in the end, in fact maybe the space argument could make sense13:15
toskynot sure about the last filter-branch step vs add a commit to remove the extra stuff13:15
*** d0ugal has joined #openstack-infra13:21
EmilienMclarkb: hey good morning - would it be possible to hold 68d8018eab564561928cbc4ed1128173 zuul job? We are having issues to reproduce an issue that seems to only happen in infra13:23
*** quiquell|lunch is now known as quiquell|off13:23
EmilienMpatch is https://review.openstack.org/#/c/600517/ and jobname is tripleo-ci-centos-7-undercloud-containers13:24
EmilienMit's currently running now13:24
*** pcaruana has joined #openstack-infra13:27
*** rossella_s has quit IRC13:30
dhellmannI noticed the pipeline priority change merged. Have we observed any change in behavior in zuul?13:32
*** e0ne has quit IRC13:32
*** rossella_s has joined #openstack-infra13:34
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck master: Add query for neutron-fullstack ENOENT bug 1795482  https://review.openstack.org/60718713:35
openstackbug 1795482 in neutron "Deleting network namespaces sometimes fails in check/gate queue with ENOENT" [High,In progress] https://launchpad.net/bugs/1795482 - Assigned to Brian Haley (brian-haley)13:35
*** d0ugal has quit IRC13:36
dhellmannconfig-core: we're ready to approve the zuul cleanup patches for freezer (https://review.openstack.org/#/c/597583) and tripleo (https://review.openstack.org/#/c/597822)13:36
fungiaspiers: thanks for the heads up on the gerrit summit. i don't personally do any upstream work on gerrit and only have a handful of patches accepted to it over the years, but still might be interesting to go to one sometime. the next one is a bit too close to the openstack summit for mr, unfortunately13:38
*** wznoinsk has joined #openstack-infra13:38
aspiersfungi: I've never submitted patches at all, but I found the last one thoroughly useful and enjoyable anyway13:39
*** tpsilva has joined #openstack-infra13:39
aspiersbut hopefully others from the community can go13:39
aspiersclarkb maybe? or corvus?13:39
aspierscorvus should go just to present gertty :-)13:40
haleybis it possible to have two changes depend-on each other and gate together?  or do i need to just squash them together?  https://review.openstack.org/#/c/607093/ and https://review.openstack.org/#/c/607009/ fix two different bugs but both needed to fix neutron gate13:40
fungihaleyb: no, changes always merge in a defined sequence. if there is no clear serial order for all dependent changes zuul is unable to run jobs on them13:41
openstackgerritMerged openstack-infra/project-config master: Set up stx-docs and stx-specs publish jobs  https://review.openstack.org/59905413:41
fungihaleyb: usually the best option, if they're for the same repo and neither can merge on their own, is to squash them into one single change which includes both fixes13:42
haleybfungi: thanks, i'll squash them then, strange how we got in this predicament as they're seemingly unrelated bugs13:43
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck master: Add query for test_legacy_router_lifecycle KeyError bug 1795548  https://review.openstack.org/60719013:45
openstackbug 1795548 in neutron "neutron.tests.functional.agent.l3.test_legacy_router.L3AgentTestCase.test_legacy_router_lifecycle* fail" [High,In progress] https://launchpad.net/bugs/1795548 - Assigned to Brian Haley (brian-haley)13:45
dhellmannfungi : it looks like we are, at least in some cases, still using the legacy API for uploading to PyPI: http://logs.openstack.org/c1/c15e907e95ab5404ed8799cdb60783bcf5947709/release/release-openstack-python/d23159a/ara-report/result/7ccd0bb0-b744-42bb-9707-a7e71ead7a87/13:47
AJaegerdhellmann: haven't seen any side effects of your prio change yet...13:47
dhellmannthat failure seems OK, since it is reporting that the file already exists, but I noticed the URL in the output there13:47
dhellmannAJaeger : yeah, it might be a bit early in the day, yet13:47
*** sthussey has joined #openstack-infra13:48
fungiaspiers: yeah, looks like it might be an easier trip for someone on the usa west coast anyway. it's a haul for me, and opposite the direction i need to go for openstack summit so can't easily combine it into one trip either13:49
aspiersright :-(13:49
aspierswish I could justify a trip to CA ...13:50
*** aidin has joined #openstack-infra13:50
EmilienMfungi: hey good morning, could we please retain a note for a specific patch/job? I've been debugging something that only fails in infra13:51
EmilienMs/note/node/13:51
EmilienMthe patch is https://review.openstack.org/#/c/600517/ and jobname is tripleo-ci-centos-7-undercloud-containers13:52
*** d0ugal has joined #openstack-infra13:54
AJaegerdhellmann: we'Re at capacitiy, so you see already some changes - newest change with jobs running in check is 26mins old; while a post change has jobs that is less than 5 mins. And all gate ones have jobs...13:56
*** fuentess has joined #openstack-infra14:00
*** mriedem has quit IRC14:00
*** e0ne has joined #openstack-infra14:02
fungidhellmann: via codesearch i can't see anywhere we're overriding pypi_info.repository_url, and it looks like twine was correctly installed as the latest release (1.12.1) so i can only conclude it's finding another configuration file besides in addition to the one being passed on the command line... but codesearch is only turning up the pypirc template in system-config which i don't think gets14:03
fungiinstalled into our images (we stopped running puppet in dib to configure them a while back)14:03
hwoaranghello infra-cores. would it be possible to hold an opensuse-150 node so i can debug https://review.openstack.org/#/c/599521/ please?14:03
hwoaranglet me know when it's convenient to recheck the job14:04
fungidhellmann: also what upload url are you expecting it to use? that's not the old pypi.python.org one14:05
fungidocumentation seems to imply that https://upload.pypi.org/legacy/ is the current upload endpoint14:05
*** mriedem has joined #openstack-infra14:05
fungihttps://packaging.python.org/guides/migrating-to-pypi-org/#publishing-releases14:07
fungidhellmann: https://github.com/pypa/twine/blob/master/twine/utils.py#L5314:08
fungiEmilienM: taking a look now that i'm satisfied we don't have a problem with our release job definitions14:09
EmilienMfungi: ack, thx14:09
pandais there a way to abort the run at a pre-run playbook and return a SUCCESS anyway ?14:10
fungiEmilienM: i've added zuul autohold --tenant openstack --project openstack/tripleo-quickstart --job tripleo-ci-centos-7-undercloud-containers --change 600517 --reason "fungi/EmilienM debugging" --count 114:11
EmilienMfungi: ok so I can "recheck" ?14:11
fungiEmilienM: yes14:11
pabelangerpanda: within the playbook, yes. you could use blocks. but playbook would need to complete to return success14:11
EmilienMfungi: thank you.14:11
fungihwoarang: taking a look now14:11
hwoarangthank you fungi14:12
pandapabelanger: but only in the run: playbook, not in the pre-run: playbook. If the pre-run returns success, the execution will continue with the run: playbook.14:13
pabelangerpanda: oh, you only want to run pre-run14:13
fungihwoarang: i see three different opensuse-150 jobs running on that change. which job are you interested in?14:13
pandapabelanger: yep14:14
pandapabelanger: asking if ti's possible, probably not14:14
pabelangerpanda: no, you'd need to redesign your jobs to move pre-run into run.  But too early without coffee to think of better way14:14
fungihwoarang: the one which completed the fastest on the last run was bifrost-integration-dhcp-opensuse-150 will that work for you?14:14
pabelangerno possible right now14:14
pabelangernot*14:14
pandapabelanger: as I suspected. Thanks anyway14:14
clarkbpanda what is thr use case?14:14
*** aidin has quit IRC14:15
*** aidin has joined #openstack-infra14:16
pandaclarkb: very specific use case of running job on a unbranched repo, but for all branches of another project. Probably not worth investigating further.14:17
hwoarangfungi: let me check if that's good for me14:18
hwoarangfungi: yep that's good14:18
*** valleedelisle has quit IRC14:19
fungihwoarang: i've added zuul autohold --tenant openstack --project openstack/bifrost --job bifrost-integration-dhcp-opensuse-150 --change 599521 --reason "fungi/hwoarang debugging" --count 114:19
fungiyou should be able to recheck when you're ready14:19
hwoarangok doing that now14:19
*** aidin has quit IRC14:20
fungii'll be back in a few minutes to add ssh keys to autoheld nodes once their jobs fail14:20
cmurphyI am seeing something wrong with the pypi mirrors, see http://logs.openstack.org/21/606021/11/check/puppet-beaker-rspec-centos-7-infra/b648173/job-output.txt.gz#_2018-10-02_12_49_00_453917 and compare https://review.openstack.org/#/c/606021/10..11/spec/acceptance/openstack_pip_provider_spec.rb (with and without the mirror)14:21
*** aidin has joined #openstack-infra14:21
cmurphyonly happens on centos14:21
*** aidin has quit IRC14:24
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul-jobs master: WIP: Add role to install kubernetes  https://review.openstack.org/60582314:26
clarkbcmurphy: it is talking to pypi.org directly for some reason14:36
cmurphyclarkb: yes in ps10 when i turned off the mirror to see what was going on14:37
cmurphyclarkb: and it passes when it talks directly to pypi.org14:37
cmurphyit fails when it talks to mirrors.*.o.o14:37
clarkbit failed in the log above talking to pypi.or14:38
cmurphyDownloading http://mirror.ord.rax.openstack.org/pypifiles/packages/a2/bc/c8bc9cce8ec064558ae9b8ab2dbea9d5bdfbaf5c50f637a19cb120410b10/os-service-types-1.3.0.tar.gz14:38
clarkbya just a few lines below that14:39
clarkbit is trying ti find pbr at pypi.org/simple/pbr14:39
cmurphyoh i see i guess i dismissed that as a hardcoded message14:39
clarkbthat url does work from here so not a bad url14:39
cmurphyyeah the tests block pypi.org with iptables to make sure the mirror is working14:40
cmurphyso why is it tryin to go to pypi.org instead of the mirror14:40
fungifailing to install the pypirc?14:41
cmurphyfungi: not sure i understand? the mirror is configured in /etc/pip.conf14:43
dhellmannfungi : oh, I guess I assumed from the conversation the other day that "legacy" was wrong, but it sounds like it's not14:43
fungidhellmann: the pypi "legacy" api is the one which still provides upload capability for now, if i recall previous discussions on distutils-sig/pypa-discuss14:45
dhellmannah14:45
openstackgerritMerged openstack-infra/elastic-recheck master: Add query for neutron-fullstack ENOENT bug 1795482  https://review.openstack.org/60718714:45
openstackbug 1795482 in neutron "Deleting network namespaces sometimes fails in check/gate queue with ENOENT" [High,In progress] https://launchpad.net/bugs/1795482 - Assigned to Brian Haley (brian-haley)14:45
dhellmannI guess that part of the twine 1.12.0 debugging experience was wasted, then14:45
openstackgerritSlawek Kaplonski proposed openstack-infra/project-config master: Add tempest-scenario-job to Neutron failure rate dashboard  https://review.openstack.org/58387014:46
*** Emine has quit IRC14:55
*** jamesmcarthur has joined #openstack-infra14:55
toskyclarkb: so... about the sahara split, do you think that the scenario I described above is too complicated?15:00
clarkbtosky: no I think as long as you keep history it will be fine15:01
toskyoki, thanks :)15:01
*** toabctl has joined #openstack-infra15:03
toskyclarkb: btw, do you remember the SSL error when connecting to tarballs.openstack.org that we discussed during the PTG?15:03
toskyI added more debug and it's not really more clear: http://logs.openstack.org/04/602504/5/check/sahara-buildimages-ambari/bba1dbc/job-output.txt.gz#_2018-09-26_22_39_28_36977015:03
clarkbyes and that is unfortunate15:03
toskyit seems that curl works consistently, so I'm just thinking about switching to it15:03
openstackgerritMerged openstack-infra/elastic-recheck master: Add query for test_legacy_router_lifecycle KeyError bug 1795548  https://review.openstack.org/60719015:05
openstackbug 1795548 in neutron "neutron.tests.functional.agent.l3.test_legacy_router.L3AgentTestCase.test_legacy_router_lifecycle* fail" [High,In progress] https://launchpad.net/bugs/1795548 - Assigned to Brian Haley (brian-haley)15:05
*** yamamoto has quit IRC15:10
*** yamamoto has joined #openstack-infra15:10
openstackgerritSlawek Kaplonski proposed openstack-infra/project-config master: Add fullstack-python36 job to Neutron dashboard  https://review.openstack.org/60728515:12
*** d0ugal has quit IRC15:12
*** d0ugal has joined #openstack-infra15:12
*** e0ne has quit IRC15:19
*** dpawlik has quit IRC15:22
openstackgerritSlawek Kaplonski proposed openstack-infra/project-config master: Add tempest-slow to Neutron failure rate dashboard  https://review.openstack.org/58387015:26
*** dave-mccowan has quit IRC15:27
*** dave-mccowan has joined #openstack-infra15:29
*** bobh has quit IRC15:31
*** eernst has joined #openstack-infra15:38
*** hamzy has quit IRC15:40
*** felipemonteiro has joined #openstack-infra15:43
dhellmannis the idea with the new "promote" pipeline to be able to do things like take the results of the documentation test job and publish it, instead of building docs a second time in a post job?15:45
*** gyee has joined #openstack-infra15:49
EmilienMfungi: the job started, 63f42d9e23da46a0a5faffdd29429eb - please let me know how I can get SSH access. Thanks again for your help15:57
fungiEmilienM: once the job fails the node will be held. i just need to know what public ssh key you need granted access to it15:59
*** jcoufal has quit IRC15:59
fungitosky: one possibility is that it's a failure to follow sni and so you're ending up requesting the file from whatever vhost is the default16:00
*** jcoufal has joined #openstack-infra16:03
EmilienMfungi: any of these ones: https://launchpad.net/%7Eemilienm/+sshkeys ( thank you )16:05
*** ginopc has quit IRC16:06
*** aojea has quit IRC16:06
*** agopi has quit IRC16:10
*** Bhujay has quit IRC16:12
*** toabctl has quit IRC16:19
*** Tengu has joined #openstack-infra16:21
*** njohnston has joined #openstack-infra16:22
njohnstonWhat ubuntu versions is Stein targeted to run on?  Given the python 3 goal calling out python 3.6 specifically, are we targeting Bionic, or are we looking at some combination of both Xenial and Bionic?16:23
openstackgerritThierry Carrez proposed openstack/ptgbot master: Handle all schedule in a single table  https://review.openstack.org/60730716:26
openstackgerritThierry Carrez proposed openstack/ptgbot master: No longer load schedule from config  https://review.openstack.org/60730816:26
*** rfolco has quit IRC16:26
funginjohnston: the infra team isn't really in charge of making it happen, but https://governance.openstack.org/tc/reference/project-testing-interface.html#linux-distributions is interpreted to mean that projects should be switching their master branches to use ubuntu-bionic instead of ubuntu-xenial for jobs soon so they work out any remaining kinks before stein releases16:26
njohnstonThanks fungi, that's exactly what I was looking for.16:27
*** jpich has quit IRC16:39
*** agopi has joined #openstack-infra16:45
fungiEmilienM: ssh root@158.69.66.12016:46
Tengufungi: he's out for lunch - I guess only his key is present on the node?16:49
openstackgerritBalazs Gibizer proposed openstack-infra/irc-meetings master: Cancelling nova-notification subteam meeting  https://review.openstack.org/60731416:50
fungiTengu: yes, though if anyone else is debugging this with him i can add their keys as well16:50
Tengufungi: would be great to add my key as well then - ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk16:51
TenguI'm curious about the logs from the docker registry and resources.16:51
fungiTengu: done16:52
Tenguthanks!16:52
*** dtantsur is now known as dtantsur|afk16:52
openstackgerritSorin Sbarnea proposed openstack-infra/zuul master: Assure that status tooltip is displayed on entire row  https://review.openstack.org/60350416:52
Tengufungi: we're allowed to install things on the node right? like tmux..16:52
fungiTengu: yes, it's just going to get deleted as soon as you let us know you're done checking it out16:53
Tenguperfect16:53
*** olivierb has quit IRC16:54
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Fix on speaker serializer  https://review.openstack.org/60731716:55
ssbarneafungi: if you can have a look at https://review.openstack.org/#/c/607136/ it would be great.16:56
openstackgerritMerged openstack-infra/openstackid-resources master: Fix on speaker serializer  https://review.openstack.org/60731716:57
*** derekh has quit IRC17:03
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: WIP: Test using install-kubernetes role  https://review.openstack.org/60580317:04
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul-jobs master: WIP: Add role to install kubernetes  https://review.openstack.org/60582317:06
fungissbarnea: you're adding a custom irc channel for coats?17:06
fungidtroyer: what's left to do for docs.starlingx.io?17:08
fungii guess we need an ssl cert, and you have some reviews pending?17:08
*** rf0lc0 has joined #openstack-infra17:12
*** rossella_s has quit IRC17:12
*** rossella_s has joined #openstack-infra17:12
*** jamesmcarthur has quit IRC17:13
*** jpena is now known as jpena|off17:14
*** jamesmcarthur has joined #openstack-infra17:18
*** aidin has joined #openstack-infra17:23
*** trown is now known as trown|lunch17:24
*** shardy has quit IRC17:26
*** tellesnobrega has left #openstack-infra17:26
*** hamzy has joined #openstack-infra17:27
AJaegerfungi, could please review: python3-first migrations: https://review.openstack.org/597822 and https://review.openstack.org/597583;17:27
*** jamesmcarthur has quit IRC17:27
AJaegerfungi, regarding docs.starlingx.io: ssl cert and https://review.openstack.org/#/c/599048 AFAIK17:27
ssbarneafungi: yes, in fact I already did. ideally I would have reused openstack-infra but it is already very busy.17:30
*** rossella_s has quit IRC17:30
AJaegerssbarnea: is a channel really needed?17:31
ssbarnea|bkp2AJaeger: not sure but I do want to get notified on IRC on new changes, so if you prefer to point it to #openstack-infra i would be glad to update it.17:32
ssbarnea|bkp2i already have too many irc channels myself17:32
EmilienMfungi: back from lunch, thx17:33
AJaegerssbarnea|bkp2: we can always change later - but I prefer not for #openstack-infra. So, will +2A in a bit.17:33
*** rossella_s has joined #openstack-infra17:34
AJaegerfungi, some more I would see reviews on, if you have time: a couple of cleanups : https://review.openstack.org/531830 https://review.openstack.org/531829 https://review.openstack.org/604610 ; and also: https://review.openstack.org/606387 https://review.openstack.org/599429 https://review.openstack.org/#/c/605224/17:36
AJaegerfungi, thanks17:36
EmilienMfungi: we will ping you when we're done with the node.17:40
fungiEmilienM: thanks, and take your time17:40
EmilienMok17:40
fungilet me know if you need anything else17:40
openstackgerritMerged openstack-infra/project-config master: remove job settings for tripleo repositories  https://review.openstack.org/59782217:42
*** Emine has joined #openstack-infra17:43
*** Sukhdev has joined #openstack-infra17:44
openstackgerritMerged openstack-infra/project-config master: remove job settings for freezer repositories  https://review.openstack.org/59758317:44
*** electrofelix has quit IRC17:45
*** priteau has quit IRC17:47
*** dpawlik has joined #openstack-infra17:47
*** diablo_rojo has joined #openstack-infra17:48
openstackgerritMerged openstack-infra/project-config master: Add coats project to openstack-infra  https://review.openstack.org/60713617:49
*** openstackgerrit has quit IRC17:51
*** dpawlik has quit IRC17:53
*** openstackgerrit has joined #openstack-infra17:54
openstackgerritMerged openstack-infra/project-config master: Move openstackdocstheme api-ref job in-tree  https://review.openstack.org/60461017:54
openstackgerritMerged openstack-infra/project-config master: Add template for ansible-role-chrony  https://review.openstack.org/60638717:54
fungiAJaeger: if you have a moment to re-review https://review.openstack.org/607117 the starlingx tsc is eager to start hosting their official governance documents somewhere17:54
*** hamzy has quit IRC17:55
AJaegerfungi: will do in a bit...17:55
fungithanks!17:55
*** aidin has quit IRC17:55
fungii'm digging into their docs site ssl cert needs now17:55
AJaegerfungi, are you around to watch https://review.openstack.org/605583 for nodepool? Then we can merge that one...17:58
*** kgiusti has quit IRC17:58
*** kgiusti has joined #openstack-infra17:59
fungiAJaeger: sure, i'll review it in just a moment18:00
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Create stx-governance repository  https://review.openstack.org/60711718:00
*** ansmith has quit IRC18:00
openstackgerritMerged openstack-infra/project-config master: Add openstack/neutron-interconnection to neutron  https://review.openstack.org/59942918:01
openstackgerritMerged openstack-infra/project-config master: Use storyboard for os-ken project  https://review.openstack.org/60522418:01
*** hamzy has joined #openstack-infra18:02
*** pcaruana has quit IRC18:02
clarkblooks like stackviz hasn't caused any failures over the last 24 hours \o/18:05
AJaeger\o/18:06
fungiclarkb: hmm, i guess i need to do dns-based domain validation for docs.starlingx.io huh?18:07
clarkbfungi: ya I had to do that with the other domains recently18:08
clarkbfungi: it ends up going pretty quickly18:08
fungicool, giving it a shot now18:09
clarkbcorvus: pabelanger http://logs.openstack.org/31/604731/1/gate/tempest-full/68a69ea/job-output.txt#_2018-10-02_12_53_21_302220 is a really interesting pre run git repo setup failure18:09
clarkblooks like we push to the node over ssh from the executor and ssh failed to identify?18:09
*** dpawlik has joined #openstack-infra18:09
clarkbbecuase the remote closed the connection?18:09
clarkbthe subsequent push succeeded too18:11
clarkbshould we consider a retry of like 3 on those pushes?18:11
fungii wonder if opensshd was restarting18:11
clarkbfungi: ya considering the followup push succeeded something like that wouldn't suprise me18:11
*** dpawlik has quit IRC18:14
*** ansmith has joined #openstack-infra18:14
*** Emine has quit IRC18:15
*** gary_perkins has quit IRC18:15
AJaegerconfig-core, https://review.openstack.org/#/c/599890 https://review.openstack.org/583870 https://review.openstack.org/605644 https://review.openstack.org/#/c/607059/ is last round of open changes for these that have already one +2 - reviews welcome, please18:15
pabelangerclarkb: wonder if we should test using use_ssh_args with syncronize, and reuse control master, vs create new ssh connection18:15
pabelangersynchronize*18:16
pabelangerI haven't tried it myself18:16
clarkbpabelanger: does that work with git pushes?18:16
pabelangeroh, that is right. use-cache-repos is git18:17
pabelangernot rsync18:17
clarkbya18:17
clarkbretries might be good enough since we know it works for later repos in that same job18:17
*** bobh has joined #openstack-infra18:18
pabelangeryah18:18
pabelangerhttps://docs.ansible.com/ansible/2.5/modules/git_module.html18:20
fungiAJaeger: i've gone ahead and approved 605583 since ianw_pto likely isn't on hand to respond to clarkb's comments and they seemed fairly minor for now18:20
pabelangerdoes have ssh_opts18:20
pabelangerso, could do some testing there too18:20
*** alishamohanty has quit IRC18:20
AJaegerfungi: ok, thx18:21
*** imacdonn has quit IRC18:21
*** imacdonn has joined #openstack-infra18:21
openstackgerritMerged openstack-infra/project-config master: elements/ndoepool-base: only initially populate ipv4 nameservers  https://review.openstack.org/60558318:29
*** openstackgerrit has quit IRC18:35
*** trown|lunch is now known as trown18:45
fungi#status log manually deleted /afs/.openstack.org/docs/charm-deployment-guide/latest and performed a vos release of the docs volume18:46
openstackstatusfungi: finished logging18:46
fungitinwood: ^18:46
*** olivierb_ has joined #openstack-infra18:48
fungiinfra weekly irc meeting starts in ~7 minutes in #openstack-meeting18:52
*** Sukhdev has quit IRC18:52
fungidid anyone ever volunteer to chair it in clarkb's absence?18:53
fungifs mkmount sure does take a while18:54
*** kgiusti has quit IRC18:56
*** kgiusti has joined #openstack-infra18:57
*** gwhaley has joined #openstack-infra18:59
*** ansmith has quit IRC19:01
*** kgiusti has quit IRC19:01
gwhaleyhi clarkb. I have figured out how to inject my JSON data over filebeat and logstash into elastic for kata metrics (https://github.com/kata-containers/ci/issues/60#issuecomment-425131730)19:01
*** ansmith has joined #openstack-infra19:01
gwhaleyand have confirmed I can extract and view the relevant data inside kibana (including the fun of scripting to process json arrays as kibana doesn't really do those...)19:02
gwhaleyI'm at the point where I can start testing out an elastic index and kibana view on the OSF infra. What do I need to do to move that on?19:03
*** Swami has joined #openstack-infra19:03
gwhaleyIs there somewhere I need to open an Issue or similar?  I'm going to fall off here in about 20 minutes - you can reply direct on that github issue above, and that will get to me in the morning19:03
gwhaleyor, hit me somewhere on kata slack likewise19:03
fungigwhaley: most of the infra team is at ansiblefest, including clarkb19:08
fungiso he likely won't see your question right away19:08
fungigwhaley: you could e-mail the openstack-infra@lists.openstack.org mailing list if you have more detailed questions19:09
fungiasynchronous discussion is likely easier at this stage19:09
*** openstackgerrit has joined #openstack-infra19:12
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy-manila-buildimage-* jobs  https://review.openstack.org/60734819:12
gwhaleyfungi: thx - you guys are always out at some conference or other ;-)  np. I'll aim for the mailing list tomorrow.19:15
*** kgiusti has joined #openstack-infra19:17
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove some legacy-manila jobs  https://review.openstack.org/60734819:21
*** hamzy has quit IRC19:25
*** hamzy has joined #openstack-infra19:26
*** e0ne has joined #openstack-infra19:32
*** gwhaley has quit IRC19:32
*** dave-mccowan has quit IRC19:41
diablo_rojoIs there a template for infra-specs?19:45
* diablo_rojo is looking in the repo and doesn't see one19:45
fungidiablo_rojo: https://git.openstack.org/cgit/openstack-infra/infra-specs/tree/template.rst19:45
* diablo_rojo found it right after she asked19:46
diablo_rojoIts gonna be one of those days apparently19:46
diablo_rojothanks fungi!19:46
funginp19:46
*** diablo_rojo has quit IRC20:00
openstackgerritMerged openstack-infra/system-config master: Add docs.starlingx.io vhost  https://review.openstack.org/59904820:05
fungidtroyer: ^20:07
fungishould hopefully take effect within the next hour20:07
dtroyerfungi: thanks!!20:10
EmilienMfungi: hey, thanks for the node today. We did a little bit of progress in our debug, but not 100% sure of the problem yet. You can release the node now and there is a little chance I ask you the same thing tomorrow if my patch didn't help.20:11
*** mlavalle has joined #openstack-infra20:16
mlavalleis this the best / latest document for 3rd party testing: https://docs.openstack.org/infra/system-config/third_party.html?20:17
fungiEmilienM: thanks, i've deleted that node now. let me know when you need another hold added20:19
EmilienMack20:19
*** kgiusti has left #openstack-infra20:20
fungihwoarang: we caught a opensuse-150 node for you, let us know what ssh key you want authorized to access it20:21
*** olivierb_ has quit IRC20:25
mwhahahadearest infra, where is the unbound configurations kept for the images? it shows being managed via ansible so is that part of the zuul job configs?20:27
*** mlavalle has quit IRC20:29
*** dave-mccowan has joined #openstack-infra20:31
mwhahahato answer my own question, yes it is kept in openstack-zuul-jobs and yes you can configure it via zuul vars20:31
*** dave-mccowan has quit IRC20:36
*** ansmith has quit IRC20:40
*** mlavalle has joined #openstack-infra20:43
*** hamzy has quit IRC20:44
dhellmanndo we have anything that shows the amount of time jobs wait before they start, maybe broken down by pipeline? I'm curious to see if the pipeline precedence change had a significant negative impact on the check pipeline times20:52
dhellmannI don't see that called out in grafana, and am not really familiar enough with it to know if I could make that graph on my own20:53
*** trown is now known as trown|outtypewww20:55
*** aidin has joined #openstack-infra20:56
*** kjackal has quit IRC20:56
*** bobh has quit IRC20:58
fungiyeah, i'm not really sure how we might be expressing that, if we are at all21:00
*** bobh has joined #openstack-infra21:00
fungiand a lot of the people who know are likely busy at ansiblefest right now21:00
*** aidin has quit IRC21:00
*** e0ne has quit IRC21:02
fungidtroyer: looks like https://docs.starlingx.io/ is working now (just empty until someone starts publishing content into /afs/openstack.org/project/starlingx.io/www/ i guess, hence the 403 forbidden response on the nonexistent "www" directory to which the docroot refers)21:04
*** bobh has quit IRC21:04
*** Qiming has quit IRC21:05
dtroyerfungi: thanks.  I have https://review.openstack.org/607339 queued up to do exactly that21:05
fungiawesome, will take a look in a bit21:06
dtroyerfungi:  the publish job will create that dir structure under /project?21:06
fungiit needs to anyway21:08
fungii'll take a look at the publish-stx-docs definition and see what it does exactly21:10
fungihttps://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.d/starlingx-jobs.yaml21:11
*** markmcclain has joined #openstack-infra21:11
fungihttps://git.openstack.org/cgit/openstack-infra/project-config/tree/playbooks/publish/starlingx-afs.yaml21:11
dhellmannpost and gate look pretty happy, so I don't think we've made things significantly worse (if they're worse at all)21:11
fungidtroyer: looks like it will (i hope)21:12
dtroyerfungi: yeah, I wasn't sure if the upload-afs role did that21:12
*** gfidente has quit IRC21:12
*** Qiming has joined #openstack-infra21:16
*** Emine has joined #openstack-infra21:16
fungidhellmann: well, we've got jobs waiting 3 hours for node assignment in the check pipeline, but we seem to be burning down check content steadily and running around 750jph http://grafana.openstack.org/d/T6vSHcSik/zuul-status?orgId=121:17
dhellmannwhere do you get the wait time from?21:18
fungidhellmann: just looking at changes in check at http://zuul.openstack.org/ and seeing how long they've been pending with no node assignments yet21:18
fungithe ones with no color bars seem to start around the 2.5-3 hour mark as you scroll down21:19
dhellmannok, yeah, that's how I was estimating it too21:19
dhellmannI wasn't sure if that was typical21:19
fungithere is no "typical" unfortunately ;)21:19
dhellmannheh21:20
dhellmannmore or less than last week21:20
fungiit's all highly variable based on who's working on what, which bugs they're struggling with and so on21:20
fungiso very hard to draw useful comparisons21:20
openstackgerritMerged openstack-infra/project-config master: Create stx-governance repository  https://review.openstack.org/60711721:20
funginode requests has been floating around 1.5k today21:21
fungicomparing to the last 7 days, it was around 1.25k at peak yesterday, 3.25k on friday, 4.75k on thursday, over 5k on wednesday...21:22
*** diablo_rojo has joined #openstack-infra21:22
fungibut no idea if this week is just a lighter load or whether there's anything else going on21:23
fungigerrit events per hour look a little higher than yesterday, maybe a little lower than last week21:25
fungihard to tell because it's so spiky21:25
fungiif i felt like fiddling with graphite i could summarize on one-day quantization or something to say for sure21:26
*** fuentess has quit IRC21:26
*** bobh has joined #openstack-infra21:31
*** felipemonteiro has quit IRC21:33
*** bobh has quit IRC21:47
*** bobh_ has joined #openstack-infra21:47
*** Emine has quit IRC21:53
*** ijw has quit IRC21:57
openstackgerritKendall Nelson proposed openstack-infra/infra-specs master: [WIP] StoryBoard Story Attachments  https://review.openstack.org/60737722:02
*** mriedem has quit IRC22:03
openstackgerritKendall Nelson proposed openstack-infra/infra-specs master: [WIP] StoryBoard Story Attachments  https://review.openstack.org/60737722:04
*** jesusaur has quit IRC22:06
*** bobh_ has quit IRC22:07
*** rh-jelabarre has quit IRC22:08
*** jesusaur has joined #openstack-infra22:11
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: fetch-javascript-content-tarball: add create_tarball variable  https://review.openstack.org/60674022:12
*** boden has quit IRC22:14
openstackgerritGoutham Pacha Ravi proposed openstack-infra/devstack-gate master: WIP: Allow setting Python3 version  https://review.openstack.org/60737922:31
*** jcoufal has quit IRC22:36
*** tosky has quit IRC22:41
*** sthussey has quit IRC22:42
fungidtroyer: http://git.starlingx.io/cgit/stx-governance exists now too22:49
*** tpsilva has quit IRC22:55
*** pbourke has quit IRC23:02
*** pbourke has joined #openstack-infra23:03
*** ansmith has joined #openstack-infra23:03
*** icey has quit IRC23:05
*** jamesmcarthur has joined #openstack-infra23:05
*** jamesmcarthur has quit IRC23:10
*** icey has joined #openstack-infra23:12
dtroyerfungi: thanks. can you go ahead and add Ildiko to the stx-tech-steering-committee-secretary23:12
dtroyer group?23:12
fungidtroyer: want me to also make the stx-tech-steering-committee group owned by stx-tech-steering-committee-secretary instead of self-managed?23:17
dtroyeryes, please.  I forgot there were two groups23:17
*** njohnston has quit IRC23:17
fungidtroyer: done23:18
dtroyergreat, thanks23:18
* fungi is excited to see all this coming together23:18
*** yamamoto has quit IRC23:21
*** yamamoto has joined #openstack-infra23:22
*** yamamoto has quit IRC23:24
*** yamamoto has joined #openstack-infra23:24
*** mlavalle has quit IRC23:28
*** yamamoto has quit IRC23:29
*** yamamoto has joined #openstack-infra23:30
*** studarus has joined #openstack-infra23:30
*** yamamoto has quit IRC23:34
*** agopi is now known as agopi|off23:41
*** Swami has quit IRC23:42
*** agopi|off has quit IRC23:45
*** eernst has quit IRC23:57
*** rcernin has joined #openstack-infra23:59
studarusis there a way to query nodepool and get the list of nodes it has in the deleting pool?23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!