Tuesday, 2018-03-06

*** rossella_s has joined #openstack-infra00:00
*** esberglu has quit IRC00:02
*** gouthamr has quit IRC00:02
*** danpawlik has quit IRC00:04
*** aeng has quit IRC00:05
*** aeng has joined #openstack-infra00:05
*** eernst has quit IRC00:07
*** eernst has joined #openstack-infra00:07
*** eernst has quit IRC00:09
*** eernst has joined #openstack-infra00:10
*** eernst_ has joined #openstack-infra00:11
*** eernst has quit IRC00:11
*** jcoufal has joined #openstack-infra00:12
*** r-daneel has quit IRC00:12
*** eernst_ has quit IRC00:15
*** eernst has joined #openstack-infra00:15
*** rlandy is now known as rlandy|afk00:15
*** esberglu has joined #openstack-infra00:17
*** dingyichen has joined #openstack-infra00:18
*** eernst has quit IRC00:20
*** HeOS has quit IRC00:21
openstackgerritIan Wienand proposed openstack-infra/project-config master: Remove devstack legacy experimental jobs  https://review.openstack.org/54989700:25
*** slaweq has joined #openstack-infra00:25
*** slaweq has quit IRC00:30
*** smarcet has joined #openstack-infra00:31
*** agopi|out has quit IRC00:32
*** danpawlik has joined #openstack-infra00:34
*** andreas_s has joined #openstack-infra00:37
*** danpawlik has quit IRC00:39
*** rossella_s has quit IRC00:39
*** tosky has quit IRC00:40
*** yamamoto has quit IRC00:40
*** andreas_s has quit IRC00:41
*** yamamoto has joined #openstack-infra00:42
*** rossella_s has joined #openstack-infra00:43
*** jamesmcarthur has joined #openstack-infra00:52
*** lihi has quit IRC00:54
*** oanson has quit IRC00:56
*** jamesmcarthur has quit IRC00:56
*** mihalis68 has joined #openstack-infra00:57
*** jcoufal has quit IRC01:02
*** oanson has joined #openstack-infra01:03
*** lihi has joined #openstack-infra01:03
*** wolverineav has quit IRC01:08
*** camunoz_ has quit IRC01:08
*** danpawlik has joined #openstack-infra01:09
*** olaph1 has joined #openstack-infra01:09
*** wolverineav has joined #openstack-infra01:10
*** aviau has quit IRC01:11
*** aviau has joined #openstack-infra01:11
*** germs has joined #openstack-infra01:11
*** olaph has quit IRC01:11
*** danpawlik has quit IRC01:14
*** wolverineav has quit IRC01:15
openstackgerritAdam Spiers proposed openstack-infra/infra-manual master: Reorder cookiecutter template section  https://review.openstack.org/54990201:19
openstackgerritAdam Spiers proposed openstack-infra/infra-manual master: Make cookiecutter section more concise  https://review.openstack.org/54990301:19
openstackgerritAdam Spiers proposed openstack-infra/infra-manual master: Mention the availability of other cookiecutter templates  https://review.openstack.org/54990401:19
*** yamahata has joined #openstack-infra01:19
*** wolverineav has joined #openstack-infra01:27
*** wolverineav has quit IRC01:28
*** wolverineav has joined #openstack-infra01:29
*** wolverineav has quit IRC01:33
*** olaph has joined #openstack-infra01:38
*** germs has quit IRC01:40
*** olaph1 has quit IRC01:40
*** agopi|out has joined #openstack-infra01:41
persiaianw: Given that the job has limited resources, doesn't work (needs mirrors), and is likely to need many rounds of yak shaving to land, I'm happy to move to experimental for now (along with adding a dependency on https://review.openstack.org/546434, although real recheck is going to depend on new AFS volumes).01:41
aspiershmm, Gerrit's self-healing-sig-core group is empty, so noone can commit to the self-healing-sig repo01:43
ianwpersia: yeah ... really we might be best just having a wip change out, that modifies .zuul.yaml and more or less *only* runs the arm64 job01:43
ianwaspiers: was it just created?  we can add someone01:43
aspiersianw: it was created a while ago, originally only so we could use StoryBoard, but in Dublin we decided to put docs/specs there too01:44
aspiershttps://etherpad.openstack.org/p/self-healing-ptg-rocky01:44
persiaianw: So, leave as is, adding "WIP" to the commit message if it needs update, and plan not to merge until things are in better shape?01:44
persiaI think we can learn most of what needs learning from "recheck" for now.01:44
ianwaspiers: ok, i added you01:44
aspiersianw: thanks!01:44
ianwpersia: yeah, [WIP] or [DNM] work ... we can pull out non-relevant jobs too to prevent them running01:45
*** wolverineav has joined #openstack-infra01:45
persiaOh, I see what you mean.  Yeah, I'll update it to not run most of the other jobs (for faster recheck).01:46
persiaIf we actually want to land something, we can go back to this version.01:46
*** danpawlik has joined #openstack-infra01:47
aspiersianw: is it just me or does https://docs.openstack.org/infra/manual/creators.html#add-gerrit-permissions not actually mention that part of the process (adding the first members into -core) at all?01:47
*** wolverineav has quit IRC01:47
ianwaspiers: it's sort of mentioned under https://docs.openstack.org/infra/manual/creators.html#update-the-gerrit-group-members01:48
ianwit could probably be reworded to be clearer01:49
aspiersianw: oh yeah, I missed that01:49
ianw"ask the infra team" could be expanded to say ping "infra-root" in irc, or send an email if you're avoiding irc for some reason01:49
aspierstrue01:50
aspierswhere would the email go?01:50
ianwi would say the openstack-infra@ list01:51
ianwor an [infra] tag on openstack-dev i guess01:51
aspiersOK I can submit a review for that01:51
ianwhmm, are we making it easier or harder :)01:51
*** danpawlik has quit IRC01:52
*** wolverineav has joined #openstack-infra01:52
persiaI think "ask the infra team" ought be sufficient, as that quickly becomes a core competency to manage a project.  If expanded, the expansion likely belongs in a general "ways to contact infra" doc node, which would be referenced by way of "ask the infra team" being a link.01:57
aspiersWhere would the latter go?01:57
aspiersDoh!01:58
aspiersIt's already in the section immediately preceding.01:58
persiaProbably somewhere under system-config:doc/source , but if you found it, then it's just a link :)01:58
aspiersNot even a link; it's literally right above01:58
aspiershttps://docs.openstack.org/infra/manual/creators.html#wait-here01:59
persiaAnd the "wait here" part specifically says "coordinate with the Infra team", so you're doing the right thing :)02:01
ianwheh, well who ever reads the manual i guess :)02:01
aspiersHrm, infra-manual seems to use "" double-quotes in several places where backticks are recommended02:02
aspiershttps://docs.openstack.org/doc-contrib-guide/rst-conv/inline-markups.html doesn't recommend double-quotes for *anything*02:02
*** imacdonn has quit IRC02:02
*** imacdonn has joined #openstack-infra02:02
aspiersAnyway, now I'm just needlessly avoiding going to bed, so I'll stop here. Night all!02:03
*** wolverineav has quit IRC02:03
*** mriedem has quit IRC02:03
*** slaweq has joined #openstack-infra02:04
*** slaweq_ has joined #openstack-infra02:05
openstackgerritAdam Spiers proposed openstack-infra/infra-manual master: Mention the magic "infra-root" word  https://review.openstack.org/54991802:06
*** agopi|out has quit IRC02:07
*** slaweq has quit IRC02:08
*** slaweq_ has quit IRC02:10
*** gongysh has joined #openstack-infra02:10
*** wolverineav has joined #openstack-infra02:17
*** slaweq has joined #openstack-infra02:17
*** slaweq has quit IRC02:22
*** wolverineav has quit IRC02:23
*** wolverineav has joined #openstack-infra02:23
*** danpawlik has joined #openstack-infra02:25
*** wolverineav has quit IRC02:28
*** bnemec has joined #openstack-infra02:29
*** slaweq has joined #openstack-infra02:30
*** danpawlik has quit IRC02:30
*** kiennt26 has quit IRC02:32
*** wolverineav has joined #openstack-infra02:34
*** liujiong has joined #openstack-infra02:34
*** slaweq has quit IRC02:34
*** gongysh has quit IRC02:35
dmsimardaspiers: infra-root is a superset that includes config-core and should probably be reserved for things that actually do require root attention (or core reviewer on a system configuration repo)02:38
*** wolverineav has quit IRC02:39
dmsimardTo me it doesn't make any difference though, I end up being punged on both anyway :p02:39
*** slaweq has joined #openstack-infra02:42
*** bnemec has quit IRC02:45
*** hongbin has joined #openstack-infra02:46
*** slaweq has quit IRC02:47
*** yamamoto has quit IRC02:49
*** yamamoto has joined #openstack-infra02:49
*** olaph1 has joined #openstack-infra02:53
*** olaph has quit IRC02:53
*** slaweq has joined #openstack-infra02:55
*** danpawlik has joined #openstack-infra02:57
*** salv-orl_ has joined #openstack-infra02:58
*** slaweq has quit IRC02:59
*** jamesmcarthur has joined #openstack-infra03:00
*** salv-orlando has quit IRC03:01
*** bnemec has joined #openstack-infra03:02
*** danpawlik has quit IRC03:02
*** jamesmcarthur has quit IRC03:04
*** zhurong has joined #openstack-infra03:05
openstackgerritMerged openstack-infra/system-config master: Fix apt-puppetlabs update line  https://review.openstack.org/53724803:05
*** bobh has joined #openstack-infra03:07
*** slaweq has joined #openstack-infra03:07
*** slaweq has quit IRC03:12
openstackgerritMerged openstack-infra/system-config master: Add ARM64 Ubuntu mirror  https://review.openstack.org/54646603:16
*** harlowja has quit IRC03:18
*** VW has joined #openstack-infra03:18
*** slaweq has joined #openstack-infra03:19
*** bobh has quit IRC03:23
*** slaweq has quit IRC03:24
*** bnemec has quit IRC03:26
*** suhdood has joined #openstack-infra03:26
*** esberglu has quit IRC03:26
*** auristor has quit IRC03:26
*** danpawlik has joined #openstack-infra03:28
*** slaweq has joined #openstack-infra03:32
*** danpawlik has quit IRC03:33
*** masuberu has quit IRC03:34
*** nicolasbock has quit IRC03:34
*** bobh has joined #openstack-infra03:34
ianwpabelanger / persia : ^ session of this running under screen on mirror-update ... maybe even working?  it's thinking a lot03:36
*** auristor has joined #openstack-infra03:36
*** slaweq has quit IRC03:36
*** germs has joined #openstack-infra03:40
*** germs has quit IRC03:40
*** germs has joined #openstack-infra03:40
*** slaweq has joined #openstack-infra03:44
*** germs has quit IRC03:45
*** wolverineav has joined #openstack-infra03:47
*** slaweq has quit IRC03:49
*** psachin has joined #openstack-infra03:50
*** links has joined #openstack-infra03:51
*** ying_zuo_ is now known as ying_zuo03:51
*** wolverineav has quit IRC03:52
*** slaweq has joined #openstack-infra03:57
*** esberglu has joined #openstack-infra04:00
*** slaweq has quit IRC04:01
*** danpawlik has joined #openstack-infra04:02
*** gyee has quit IRC04:03
*** agopi|out has joined #openstack-infra04:05
*** andreas_s has joined #openstack-infra04:06
*** danpawlik has quit IRC04:07
*** slaweq has joined #openstack-infra04:09
*** sree has joined #openstack-infra04:09
*** bobh has quit IRC04:10
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: Add ubuntu-ports mirror to mirror-info  https://review.openstack.org/54992504:11
*** andreas_s has quit IRC04:11
*** slaweq has quit IRC04:14
*** rlandy|afk is now known as rlandy04:21
*** esberglu has quit IRC04:21
*** slaweq has joined #openstack-infra04:22
*** masber has joined #openstack-infra04:23
*** slaweq has quit IRC04:26
*** VW has quit IRC04:26
*** VW has joined #openstack-infra04:27
*** danpawlik has joined #openstack-infra04:29
*** VW has quit IRC04:32
*** sree has quit IRC04:32
*** ramishra has joined #openstack-infra04:33
*** slaweq has joined #openstack-infra04:34
*** danpawlik has quit IRC04:37
*** hongbin has quit IRC04:38
*** slaweq has quit IRC04:39
*** agopi|out has quit IRC04:41
*** udesale has joined #openstack-infra04:44
*** jlabarre has quit IRC04:44
*** sree has joined #openstack-infra04:46
*** slaweq has joined #openstack-infra04:46
*** zhurong has quit IRC04:48
*** slaweq has quit IRC04:51
*** sree has quit IRC04:52
*** pgadiya has joined #openstack-infra04:57
*** slaweq has joined #openstack-infra04:59
*** chkumar246 is now known as chandankumar04:59
*** bnemec has joined #openstack-infra05:00
*** slaweq has quit IRC05:03
*** mihalis68 has quit IRC05:06
*** slaweq has joined #openstack-infra05:11
*** harlowja has joined #openstack-infra05:12
*** danpawlik has joined #openstack-infra05:13
*** wolverineav has joined #openstack-infra05:15
*** sree has joined #openstack-infra05:16
*** slaweq has quit IRC05:16
*** danpawlik has quit IRC05:18
*** suhdood has quit IRC05:18
*** wolverineav has quit IRC05:19
*** olaph has joined #openstack-infra05:20
*** olaph1 has quit IRC05:21
*** myoung|ruck|bbl is now known as myoung|ruck05:21
*** myoung|ruck is now known as myoung|ruck|off05:22
*** slaweq has joined #openstack-infra05:24
*** markvoelker has quit IRC05:27
*** danpawlik has joined #openstack-infra05:27
*** slaweq has quit IRC05:29
*** sree has quit IRC05:29
*** danpawlik has quit IRC05:31
*** bnemec has quit IRC05:32
*** chrisyang_0660 has joined #openstack-infra05:32
*** bnemec has joined #openstack-infra05:35
*** slaweq has joined #openstack-infra05:36
*** sree has joined #openstack-infra05:40
*** slaweq has quit IRC05:40
*** bnemec has quit IRC05:41
*** ykarel has joined #openstack-infra05:44
*** danpawlik has joined #openstack-infra05:46
*** slaweq has joined #openstack-infra05:48
*** wolverineav has joined #openstack-infra05:50
*** danpawlik has quit IRC05:51
*** slaweq has quit IRC05:53
AJaegeraspiers: no need to add me to any reviews, I review them using our tools and not where I'm added...05:58
*** wolverineav has quit IRC05:58
*** slaweq has joined #openstack-infra06:01
*** aeng has quit IRC06:03
AJaegerpabelanger: thanks for fixing the RETRY snafu06:03
*** cshastri_ has joined #openstack-infra06:05
*** slaweq has quit IRC06:05
openstackgerritMerged openstack-infra/zuul master: Make Info.endpoint a config override  https://review.openstack.org/54757606:07
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/54994606:08
AJaegerianw: http://nl01.openstack.org/dib-image-list shows an arm64 build image *building* since 4 days - is that correct?06:09
AJaegerinfra-root, github sync is still failing and new repos https://github.com/openstack/kayobe and https://github.com/openstack/python-tatuclient are not setup06:10
openstackgerritMerged openstack-infra/zuul master: Use yarn and webpack to manage zuul-web javascript  https://review.openstack.org/54779006:10
chrisyang_0660Hi team, I am now building our third party CI for contributing our code.06:11
chrisyang_0660I found that there are more than one solutions to achieve that.06:11
chrisyang_0660Openstack Third Party CI and Software Factory06:11
chrisyang_0660https://docs.openstack.org/infra/openstackci/third_party_ci.html06:11
chrisyang_0660http://www.softwarefactory-project.io/06:11
chrisyang_0660I want to ask which system do you suggest? which is easier to setup?06:11
chrisyang_0660And If I encounter some issues while building this CI system, who or where can I ask for help?06:11
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Support brew for installing the js tools  https://review.openstack.org/54823506:13
*** slaweq has joined #openstack-infra06:13
*** threestrands has quit IRC06:14
*** pgadiya_ has joined #openstack-infra06:16
*** pgadiya has quit IRC06:18
*** slaweq has quit IRC06:18
*** ykarel has quit IRC06:19
openstackgerritMerged openstack-infra/infra-manual master: Mention the magic "infra-root" word  https://review.openstack.org/54991806:19
*** namnh has joined #openstack-infra06:21
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Add queue size to tenant overview  https://review.openstack.org/54824806:21
*** danpawlik has joined #openstack-infra06:25
*** e0ne has joined #openstack-infra06:25
*** slaweq has joined #openstack-infra06:26
*** markvoelker has joined #openstack-infra06:27
openstackgerritIvan Kolodyazhny proposed openstack-infra/irc-meetings master: Update Horizon meeting chair  https://review.openstack.org/54994906:28
openstackgerritzhurong proposed openstack-infra/irc-meetings master: Update murano meeting to biweekly-odd  https://review.openstack.org/54995006:29
*** harlowja has quit IRC06:29
*** danpawlik has quit IRC06:30
*** slaweq has quit IRC06:30
*** chandankumar has quit IRC06:35
*** chandankumar has joined #openstack-infra06:35
*** slaweq has joined #openstack-infra06:38
*** slaweq has quit IRC06:43
*** pblaho1 has quit IRC06:47
*** andreas_s has joined #openstack-infra06:48
*** olaph1 has joined #openstack-infra06:49
*** liujiong has quit IRC06:50
*** liujiong has joined #openstack-infra06:50
*** liujiong has quit IRC06:50
*** olaph has quit IRC06:50
*** andreas_s has quit IRC06:53
ianwAJaeger: no ... you can correlate the number with the build http://nb03.openstack.org/ubuntu-xenial-arm64-0000000024.log06:53
ianwclearly something is up, if nobody fixes i'll look at tomorrow06:54
ianwAJaeger: nova-specs is stuck and i think everything behind it again06:54
ianwthis is the same as http://lists.openstack.org/pipermail/openstack-infra/2018-March/005842.html06:55
ianwi'll bring it up in the meeting tomorrow.  i think the issue is we want to reindex gerrit after we modify the repo.  so we might just schedule some down-time to do this, outside of the rename process06:55
*** HeOS has joined #openstack-infra06:55
ianwQueue: ReplicateTo-github06:55
ianw4b212728              Mar-05 04:58      (retry 25) [f8b0d870] push git@github.com:openstack/nova-specs.git06:55
ianwc5fbe438 waiting .... Mar-05 05:04      [e5006819] push git@github.com:openstack/puppet-ironic.git06:55
ianwthen 240 other things behind that06:56
ianwchrisyang_0660: i think you found two good options.  following the instructions will mean you craft it more yourself, but maybe that gives you more flexibility.  software-factory should work too, however.  it's really up to you what path you want to take06:57
ianwin terms of asking for help, you can ask here and usually, more in us working hours, people will help.  or mailing list (openstack-infra)06:58
ianwpersia / pabelanger:  the ubuntu-ports mirror appears to be going well; as mentioned running in a screen session ATM for initial sync06:59
ianwi've almost finished the mirror setup and will push that tomorrow.06:59
ianwi'll give an update in the meeting06:59
*** xiexianbin_ has joined #openstack-infra07:03
xiexianbin_is http://zuul.openstack.org/ down? i get 502 from shanghai, China.07:03
*** danpawlik has joined #openstack-infra07:04
*** danpawlik has quit IRC07:09
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Add ozj for ubuntu-bionic  https://review.openstack.org/54964207:09
*** stakeda has joined #openstack-infra07:11
*** rcernin has quit IRC07:14
openstackgerritMerged openstack-infra/infra-manual master: Add instructions for third-party-check  https://review.openstack.org/54507707:15
*** e0ne has quit IRC07:17
*** pgadiya_ has quit IRC07:18
*** janki has joined #openstack-infra07:19
*** pblaho1 has joined #openstack-infra07:21
ianwxiexianbin_: hmm, yes similar07:22
*** andreas_s has joined #openstack-infra07:25
*** Krenair has quit IRC07:26
*** Krenair has joined #openstack-infra07:27
*** e0ne has joined #openstack-infra07:27
*** e0ne has quit IRC07:28
*** felipemonteiro has joined #openstack-infra07:29
*** kjackal has joined #openstack-infra07:29
*** pgadiya_ has joined #openstack-infra07:32
ianwzuul web is failing with07:34
ianwFileNotFoundError: [Errno 2] No such file or directory: '/usr/local/lib/python3.5/dist-packages/zuul/web/static'07:34
*** kjackal has quit IRC07:36
*** kjackal has joined #openstack-infra07:36
*** Krenair has quit IRC07:37
*** Krenair has joined #openstack-infra07:40
*** Krenair has quit IRC07:40
*** Krenair has joined #openstack-infra07:40
*** slaweq has joined #openstack-infra07:40
*** danpawlik has joined #openstack-infra07:43
*** armaan has joined #openstack-infra07:46
*** namnh has quit IRC07:48
*** armaan_ has joined #openstack-infra07:48
*** danpawlik has quit IRC07:48
*** ykarel has joined #openstack-infra07:50
*** armaan has quit IRC07:51
openstackgerritIan Wienand proposed openstack-infra/puppet-zuul master: Update zuul-web install for javascript stack  https://review.openstack.org/54960807:55
ianwAJaeger tristianC tobiash : ^ see how that goes?07:57
tobiashianw: looking07:57
*** armaan_ has quit IRC07:57
ianwthe rather annoying thing is you can't see the status of it :)07:58
ianwi could manually roll back07:59
*** Krenair has quit IRC07:59
tobiashianw: I have no clue about puppet but from a noob point of view that change looks good ;)07:59
*** jpena|off is now known as jpena08:00
*** jpena is now known as jpena|off08:01
*** jpena|off is now known as jpena08:01
tobiashAJaeger, ianw: so can we get that fixed or should I propose a revert?08:04
ianwumm, give me a minute to fiddle08:05
tobiashk08:05
*** Krenair has joined #openstack-infra08:09
*** sshnaidm|ptg has joined #openstack-infra08:10
ttxAJaeger: doing a test release now, will let you know if it completes ok!08:12
AJaegerianw: successful fiddling ;)08:12
AJaegerttx, thanks08:12
AJaegerianw: it was nice for a few seconds...08:12
AJaegerianw: ignore me ;)08:13
*** armaan has joined #openstack-infra08:14
*** jtomasek has joined #openstack-infra08:15
*** eyalb has joined #openstack-infra08:15
*** pgadiya_ has quit IRC08:15
*** pgadiya has joined #openstack-infra08:15
tristanCianw: agreed with tobiash, "RewriteRule ^/(.*)$ <%= @zuul_web_full_url %>/$1 [P]" should do the trick08:16
eyalbhi is there a problem with zuul dashboard I get service unavailable08:16
tobiasheyalb: currently being worked on08:17
eyalbthanks08:17
AJaegereyalb: and it's only the dashboard - jobs run just fine...08:18
AJaegerttx: failed - on it...08:18
*** eyalb has left #openstack-infra08:20
AJaegertobiash, ianw, tristanC, any ideas why http://logs.openstack.org/88/88def4b2f970990735d3148fdabd2ca54cea0e11/release-post/tag-releases/f31b999/job-output.txt.gz#_2018-03-06_08_17_03_916617 copies the file over but http://logs.openstack.org/88/88def4b2f970990735d3148fdabd2ca54cea0e11/release-post/tag-releases/f31b999/job-output.txt.gz#_2018-03-06_08_17_14_013261 misses it?08:20
AJaegerhttp://git.openstack.org/cgit/openstack-infra/project-config/tree/roles/copy-release-tools-scripts/tasks/main.yaml is the code08:20
AJaegeris there a "/" missing for the rsync?08:22
ianw#status log i have applied a manual revert of 4a781a7f8699f5b483f79b1bdface0ba2ba92428 on zuul01.openstack.org and placed it in the emergency file08:24
openstackstatusianw: finished logging08:24
ttxAJaeger: I think so yes08:24
*** hashar has joined #openstack-infra08:24
*** hashar has quit IRC08:24
*** hashar has joined #openstack-infra08:24
ttxhere you copy release-tools directory in release-tools08:25
AJaegertested locally - indeed ;(08:25
*** Krenair has quit IRC08:25
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Fix rsync invocation  https://review.openstack.org/54997008:25
ttxmissing a slash on the src08:25
ianwwe should get https://review.openstack.org/549608 working correctly, and then release puppet on it again under supervision08:25
AJaegerianw: could you +2A, please? ^08:25
*** cshastri_ has quit IRC08:25
AJaegerttx: yes, fixed in 54997008:25
*** cshastri has joined #openstack-infra08:28
openstackgerritIan Wienand proposed openstack-infra/puppet-zuul master: Update zuul-web install for javascript stack  https://review.openstack.org/54960808:28
AJaegerttx, once 549970 is merged, could you test again, please?08:29
*** lewo has quit IRC08:29
ianwtristanC AJaeger tobiash : ^^ i think just having a manual revert until the puppet works as expected is best, rather than doing a full revert in tree; it's a large change so that will mess up the history a bit08:29
ianwmordred: ^08:29
ttxAJaeger: certainly.08:30
*** lewo has joined #openstack-infra08:30
AJaegerianw: your call - manual revert and stopping puppet is fine with me.08:30
*** florianf has joined #openstack-infra08:31
*** slaweq_ has joined #openstack-infra08:31
tristanCAJaeger: adding a "/" at both src and dest may fix it yes08:31
ttxThe dest one is optional.08:32
*** tesseract has joined #openstack-infra08:32
*** dingyichen has quit IRC08:33
AJaegertristanC: yes, fix up - thanks08:34
*** slaweq_ has quit IRC08:36
openstackgerritMerged openstack-infra/project-config master: Fix rsync invocation  https://review.openstack.org/54997008:38
AJaegerttx ^08:38
ttxack08:38
*** felipemonteiro has quit IRC08:39
*** snapiri- has joined #openstack-infra08:39
*** Krenair has joined #openstack-infra08:41
*** oanson has quit IRC08:41
*** snapiri has quit IRC08:42
*** lihi has quit IRC08:42
*** pcaruana has joined #openstack-infra08:44
openstackgerritIan Wienand proposed openstack-infra/puppet-zuul master: Update zuul-web install for javascript stack  https://review.openstack.org/54960808:44
*** electrofelix has joined #openstack-infra08:45
*** zhurong has joined #openstack-infra08:45
*** alexchadin has joined #openstack-infra08:46
*** danpawlik has joined #openstack-infra08:47
*** ralonsoh has joined #openstack-infra08:49
*** alexchadin has quit IRC08:49
*** oanson has joined #openstack-infra08:50
*** alexchadin has joined #openstack-infra08:50
*** lihi has joined #openstack-infra08:50
*** psachin has quit IRC08:52
*** sshnaidm|ptg has quit IRC08:52
*** pcaruana has quit IRC08:54
AJaegerttx, seems to work now - http://logs.openstack.org/e3/e306539b0f2d68518f6c20d75cbf76232e7ea3d6/release-post/tag-releases/8e46f46/job-output.txt.gz#_2018-03-06_08_53_36_50228708:54
ttxAJaeger: yes, will try a "true" release now08:55
*** lucas-afk is now known as lucasagomes08:56
*** pblaho1 has quit IRC08:56
AJaegerack08:58
*** e0ne has joined #openstack-infra09:00
*** janki has quit IRC09:04
*** pgadiya has quit IRC09:04
*** pgadiya has joined #openstack-infra09:04
*** masber has quit IRC09:09
*** psachin has joined #openstack-infra09:09
*** olivierbourdon38 has joined #openstack-infra09:10
openstackgerritIan Wienand proposed openstack-infra/puppet-zuul master: Update zuul-web install for javascript stack  https://review.openstack.org/54960809:10
*** olaph has joined #openstack-infra09:11
*** olaph1 has quit IRC09:12
*** kmARC has quit IRC09:15
AJaegerttx, looks all ok - doesn't it?09:18
*** sree has quit IRC09:19
*** slaweq_ has joined #openstack-infra09:32
*** shardy has joined #openstack-infra09:36
ttxAJaeger: yes!09:37
*** slaweq_ has quit IRC09:37
*** caphrim007 has quit IRC09:40
*** caphrim007 has joined #openstack-infra09:41
*** slaweq_ has joined #openstack-infra09:43
*** rcernin has joined #openstack-infra09:44
*** dims has quit IRC09:45
openstackgerritIan Wienand proposed openstack-infra/puppet-zuul master: Update zuul-web install for javascript stack  https://review.openstack.org/54960809:45
*** derekh has joined #openstack-infra09:46
*** efoley has joined #openstack-infra09:47
*** slaweq_ has quit IRC09:48
*** dims has joined #openstack-infra09:49
*** d0ugal has quit IRC09:50
*** slaweq_ has joined #openstack-infra09:53
*** slaweq_ has quit IRC09:57
*** pblaho has joined #openstack-infra10:01
*** slaweq_ has joined #openstack-infra10:03
*** d0ugal has joined #openstack-infra10:07
*** slaweq_ has quit IRC10:08
openstackgerritIan Wienand proposed openstack-infra/puppet-zuul master: Update zuul-web install for javascript stack  https://review.openstack.org/54960810:08
*** janki has joined #openstack-infra10:08
*** jogo has quit IRC10:11
*** slaweq_ has joined #openstack-infra10:13
*** slaweq_ has quit IRC10:18
*** tosky has joined #openstack-infra10:21
*** slaweq_ has joined #openstack-infra10:23
*** pbourke has quit IRC10:25
*** pbourke has joined #openstack-infra10:25
ianwmordred: ^ so that at least passes ... but i think we want to babysit it10:25
openstackgerritAdam Spiers proposed openstack-infra/project-config master: Add #openstack-self-healing to gerritbot  https://review.openstack.org/55000210:25
*** masber has joined #openstack-infra10:28
*** slaweq_ has quit IRC10:28
*** ralonsoh_ has joined #openstack-infra10:28
*** claudiub has joined #openstack-infra10:29
*** rosmaita has joined #openstack-infra10:29
ianwdmsimard: you might like to see 549608 too, as it modifies the location of the status backups to just be /var/lib/zuul/backups.  not sure it needs to be exported -- if so that change will need a bunch of fiddling (maybe fix redirects to look for files on disk first)10:29
*** alexchadin has quit IRC10:30
*** ralonsoh has quit IRC10:32
*** alexchadin has joined #openstack-infra10:32
*** ralonsoh_ is now known as ralonsoh10:33
*** slaweq_ has joined #openstack-infra10:33
*** alexchadin has quit IRC10:37
*** alexchadin has joined #openstack-infra10:38
*** slaweq_ has quit IRC10:38
*** olaph has quit IRC10:39
*** olaph1 has joined #openstack-infra10:39
*** stakeda has quit IRC10:41
*** slaweq_ has joined #openstack-infra10:44
*** slaweq_ has quit IRC10:49
*** jamesmcarthur has joined #openstack-infra11:01
*** cshastri has quit IRC11:01
openstackgerritJean-Philippe Evrard proposed openstack-infra/project-config master: Add config_template repo base jobs  https://review.openstack.org/54668311:01
openstackgerritMerged openstack-infra/project-config master: Remove legacy centos7, fedora27 & opensuse-423 jobs  https://review.openstack.org/54988811:02
openstackgerritPaul Bourke (pbourke) proposed openstack-infra/bindep master: Add OracleLinux support  https://review.openstack.org/53635511:02
*** janki has quit IRC11:03
*** janki has joined #openstack-infra11:03
*** cshastri has joined #openstack-infra11:03
*** jamesmcarthur has quit IRC11:05
*** jogo has joined #openstack-infra11:08
openstackgerritMerged openstack-infra/irc-meetings master: Update Horizon meeting chair  https://review.openstack.org/54994911:14
openstackgerritMerged openstack-infra/irc-meetings master: Update murano meeting to biweekly-odd  https://review.openstack.org/54995011:14
*** slaweq_ has joined #openstack-infra11:14
*** snapiri- has quit IRC11:18
*** slaweq_ has quit IRC11:19
openstackgerritMerged openstack-infra/irc-meetings master: Add a file for First Contact SIG  https://review.openstack.org/54984911:19
*** alexchadin has quit IRC11:21
*** alexchadin has joined #openstack-infra11:22
*** slaweq_ has joined #openstack-infra11:24
*** xiexianbin_ has quit IRC11:29
*** slaweq_ has quit IRC11:29
*** Roamer` has joined #openstack-infra11:29
*** alexchadin has quit IRC11:31
*** alexchadin has joined #openstack-infra11:33
*** slaweq_ has joined #openstack-infra11:35
*** yamamoto has quit IRC11:39
*** slaweq_ has quit IRC11:39
*** psachin has quit IRC11:46
*** sshnaidm|ptg has joined #openstack-infra11:49
*** ldnunes has joined #openstack-infra11:49
*** janki has quit IRC11:51
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Revert "Revert "Deploy the build ssh key to auth_keys""  https://review.openstack.org/55002711:53
*** olaph has joined #openstack-infra11:54
*** olaph1 has quit IRC11:55
*** efoley has quit IRC11:59
ssbarneaclarkb: 1min bindep review if you don't mind https://review.openstack.org/#/c/546284/ -- already got a +212:00
*** lucasagomes is now known as lucas-hungry12:02
openstackgerritErno Kuvaja proposed openstack-infra/project-config master: Remove constantly failing rally jobs from Glance  https://review.openstack.org/55003312:04
openstackgerriteldad marciano proposed openstack-infra/grafyaml master: Add custom template  https://review.openstack.org/55003712:08
*** jpena is now known as jpena|lunch12:10
*** dhajare has joined #openstack-infra12:13
*** amoralej is now known as amoralej|lunch12:13
openstackgerritFabien Boucher proposed openstack-infra/zuul master: Tenant config can be read from an external script  https://review.openstack.org/53587812:14
*** slaweq_ has joined #openstack-infra12:15
*** dhajare has quit IRC12:17
*** panda|off is now known as panda12:18
*** slaweq_ has quit IRC12:20
openstackgerriteldad marciano proposed openstack-infra/grafyaml master: Support formatting.  https://review.openstack.org/55004512:24
*** nicolasbock has joined #openstack-infra12:25
*** slaweq_ has joined #openstack-infra12:26
*** slaweq_ has quit IRC12:30
*** panda is now known as panda|lunch12:32
*** alexchadin has quit IRC12:33
*** alexchadin has joined #openstack-infra12:34
*** slaweq_ has joined #openstack-infra12:36
*** olivierbourdon38 has quit IRC12:36
*** sshnaidm|ptg has quit IRC12:38
openstackgerritBrian Rosmaita proposed openstack-infra/openstack-zuul-jobs master: Exclude api-ref changes from py checks  https://review.openstack.org/55004812:38
*** janki has joined #openstack-infra12:39
*** yamamoto has joined #openstack-infra12:40
*** dhajare has joined #openstack-infra12:40
*** slaweq_ has quit IRC12:41
*** efoley has joined #openstack-infra12:42
*** chrisyang_0660 has quit IRC12:44
*** yamamoto has quit IRC12:45
*** slaweq_ has joined #openstack-infra12:46
*** olivierbourdon38 has joined #openstack-infra12:49
*** slaweq_ has quit IRC12:50
*** Ok_go_love has joined #openstack-infra12:51
*** Ok_go_love has quit IRC12:51
*** zhurong_ has joined #openstack-infra12:53
*** Goneri has joined #openstack-infra12:55
*** jpena|lunch is now known as jpena12:56
*** slaweq_ has joined #openstack-infra12:56
*** jlabarre has joined #openstack-infra12:58
*** Ok_go_love has joined #openstack-infra12:58
*** lucas-hungry is now known as lucasagomes13:00
*** snapiri has joined #openstack-infra13:00
Ok_go_loveHello everyone. Is python-jenkins is dead? I don't see any work on this project and it's sadly. I would commit some changes into it, but I'm not sure if I commit something, somebody will  check my merge requests.13:00
*** slaweq_ has quit IRC13:01
*** amoralej|lunch is now known as amoralej13:01
*** Ok_go_love has quit IRC13:02
*** zhurong has quit IRC13:02
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Remove XenAPI team meeting  https://review.openstack.org/55005813:02
*** Ok_go_love has joined #openstack-infra13:02
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Remove Valet team meeting  https://review.openstack.org/55005913:03
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Remove Rally team meeting  https://review.openstack.org/55006113:04
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Remove Storlets team meeting  https://review.openstack.org/55006413:05
persiaOk_go_love: I suspect the level of attention to python-jenkins in OpenStack is decreasing steadily as Jenkins is used less (I believe not at all for infra anymore).  I am not authoritative and may be mistaken.13:06
*** slaweq_ has joined #openstack-infra13:06
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Remove OSops meeting  https://review.openstack.org/55006513:07
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Remove Interop Challenge meeting  https://review.openstack.org/55006613:08
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Remove Craton team meeting  https://review.openstack.org/55006713:09
*** trown|outtypewww is now known as trown|rover13:09
*** alexchadin has quit IRC13:11
*** slaweq_ has quit IRC13:11
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Fix the copy-build-sshkey role  https://review.openstack.org/54804913:13
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Revert "Revert "Deploy the build ssh key to auth_keys""  https://review.openstack.org/55002713:13
*** cshastri has quit IRC13:14
andreafpabelanger dmsimard tobiash These two ^^^ I tested locally and they noq succeed in deploying ssh key and authorized keys to different root (I also tested other users) https://review.openstack.org/#/q/topic:copy_build+(status:open+OR+status:merged)13:16
*** slaweq_ has joined #openstack-infra13:17
mtreinishfrickler: :/ that is the same libwebsockets bug we were hitting before (and why we disabled it earlier)13:17
andreafpasswordless ssh however is still not working for me because of incorrect known hosts - I'm not sure why yet I need to check the role that does that13:17
mtreinishif it happens again we'll probably have to disable the websockets access again13:17
*** smarcet has quit IRC13:18
mtreinishpabelanger: I have no idea what that ostestr shim thing is, it looks like they're trying to wrap ostestr and change how arguments are handled13:19
*** eharney has joined #openstack-infra13:20
persiaAm I correct that getting a "permission denied" error trying to cd into an AFS-exported directory without credentials indicates a lack of replicated snapshots?13:20
*** cshastri has joined #openstack-infra13:21
*** slaweq_ has quit IRC13:21
*** alexchadin has joined #openstack-infra13:22
*** tosky has quit IRC13:24
*** markvoelker has quit IRC13:24
*** markvoelker has joined #openstack-infra13:24
*** pgadiya has quit IRC13:25
*** panda|lunch is now known as panda13:25
*** slaweq_ has joined #openstack-infra13:27
*** ldnunes has quit IRC13:27
*** edmondsw has joined #openstack-infra13:27
*** ldnunes has joined #openstack-infra13:27
*** tosky has joined #openstack-infra13:28
*** udesale has quit IRC13:29
*** udesale_ has joined #openstack-infra13:29
*** slaweq_ has quit IRC13:31
*** Ok_go_love has quit IRC13:32
*** pgadiya has joined #openstack-infra13:34
*** rlandy has joined #openstack-infra13:35
*** pgadiya has quit IRC13:35
openstackgerritFabien Boucher proposed openstack-infra/zuul master: Tenant config can be read from an external script  https://review.openstack.org/53587813:36
*** slaweq_ has joined #openstack-infra13:37
*** ociuhandu has joined #openstack-infra13:38
*** gongysh has joined #openstack-infra13:40
*** slaweq_ has quit IRC13:41
*** yamamoto has joined #openstack-infra13:42
*** zhurong_ has quit IRC13:42
*** ociuhandu_ has joined #openstack-infra13:42
*** szaher has quit IRC13:42
*** ociuhandu has quit IRC13:42
*** ociuhandu_ has quit IRC13:45
*** slaweq_ has joined #openstack-infra13:47
*** yamamoto has quit IRC13:47
openstackgerritFabien Boucher proposed openstack-infra/zuul master: Tenant config can be read from an external script  https://review.openstack.org/53587813:47
*** danpawlik has quit IRC13:48
*** jaosorior has quit IRC13:49
*** gfidente has joined #openstack-infra13:49
*** gfidente has joined #openstack-infra13:49
*** szaher has joined #openstack-infra13:49
*** jaosorior has joined #openstack-infra13:49
*** jaosorior has quit IRC13:49
*** VW has joined #openstack-infra13:50
*** dprince has joined #openstack-infra13:51
*** jaosorior has joined #openstack-infra13:51
*** slaweq_ has quit IRC13:52
*** tosky__ has joined #openstack-infra13:54
*** esberglu has joined #openstack-infra13:55
*** tosky has quit IRC13:55
*** tosky__ is now known as tosky13:55
*** bobh has joined #openstack-infra13:57
*** slaweq_ has joined #openstack-infra13:57
tobiashandreaf: regarding passwordless ssh try checking the owner and permissions if .ssh and the authorized_key file13:59
tobiashs/if/of13:59
*** szaher has quit IRC14:00
*** slaweq_ has quit IRC14:02
*** danpawlik has joined #openstack-infra14:02
*** tosky has quit IRC14:03
andreaftobiash: it's definitely the known hosts, if I -o StrictHostKeyCheck=no it works14:04
tobiashah ok14:04
andreaftobiash: but I think it may be my vagrant environment, I was not setting hostnames right, so I'm rebuilding it now and retesting14:04
*** szaher has joined #openstack-infra14:07
*** slaweq_ has joined #openstack-infra14:07
*** gfidente has quit IRC14:09
*** germs has joined #openstack-infra14:11
*** germs has quit IRC14:11
*** germs has joined #openstack-infra14:11
*** slaweq_ has quit IRC14:12
*** myoung|ruck|off is now known as myoung|ruck14:13
*** electrofelix has quit IRC14:14
*** r-daneel has joined #openstack-infra14:16
andreaftobiash: it works now, but I need https://review.openstack.org/#/c/54864214:17
*** slaweq_ has joined #openstack-infra14:18
andreaftobiash: currently we setup known hosts for the zuul user only14:18
andreaftobiash but I need that for root at least14:18
*** gibi has quit IRC14:18
tobiashandreaf: that does the same as the task before except the path right?14:19
andreaftobiash: yes14:19
tobiashso you could in fact just replace the task before?14:19
*** smarcet has joined #openstack-infra14:20
tobiashas the first task should not be needed at all if you do this in /etc/ssh... ?14:20
andreaftobiash no because there is a test in openstack-zuul-jobs that looks for zuul's own known_hosts14:20
andreafso I need first to add this way14:20
tobiashah, ok14:20
andreaftobiash if you want I can change the test then and also remove the extra setup, but I cannot do it in 1 step because it's two repos14:21
tobiashandreaf: yes, that makes sense14:21
tobiash+2 from me14:22
andreaftobiash: btw unit tests on zuul-jobs seem to be broken, any idea what this may be? http://logs.openstack.org/49/548049/7/check/tox-py35-on-zuul/eab4cfa/testr_results.html.gz14:22
*** germs has quit IRC14:22
tobiashandreaf: the zuul web stuff has landed in zuul a bit too early14:23
*** slaweq_ has quit IRC14:23
tobiashthat looks like that's incompatible14:23
tobiashwhat I'm wondering is that zuul is running the same test just fine14:23
*** tosky has joined #openstack-infra14:23
andreafah... fun14:24
tobiashah no, the job is different14:24
tobiashzuul runs zuul-tox-py3514:24
tobiashzuul-jobs runs tox-py35-on-zuul14:24
openstackgerritFabien Boucher proposed openstack-infra/zuul master: Tenant config can be read from an external script  https://review.openstack.org/53587814:25
*** dhajare has quit IRC14:25
*** slaweq_ has joined #openstack-infra14:28
*** jaosorior has quit IRC14:29
*** agopi|out has joined #openstack-infra14:31
openstackgerritTobias Henkel proposed openstack-infra/openstack-zuul-jobs master: Reparent tox-py35-on-zuul to zuul-tox-py35  https://review.openstack.org/55009114:31
tobiashandreaf, AJaeger: this should fix zuul-jobs tests ^14:31
tobiash(hopefully)14:31
*** slaweq_ has quit IRC14:32
andreaftobiash thanks!14:32
tobiashmordred: ^^14:33
*** r-daneel has quit IRC14:33
openstackgerritJeremy Stanley proposed openstack-infra/system-config master: Stop embedding (outated) PTL contact info in docs  https://review.openstack.org/55009214:33
*** sshnaidm|ptg has joined #openstack-infra14:35
*** cshastri has quit IRC14:37
*** gibi has joined #openstack-infra14:38
*** slaweq_ has joined #openstack-infra14:38
*** florianf has quit IRC14:38
*** florianf has joined #openstack-infra14:39
*** claudiub|2 has joined #openstack-infra14:40
*** claudiub has quit IRC14:41
openstackgerritMerged openstack-infra/irc-meetings master: Remove XenAPI team meeting  https://review.openstack.org/55005814:42
openstackgerritMerged openstack-infra/irc-meetings master: Remove Valet team meeting  https://review.openstack.org/55005914:42
*** slaweq_ has quit IRC14:42
*** alexchadin has quit IRC14:43
*** mriedem has joined #openstack-infra14:43
*** yamamoto has joined #openstack-infra14:43
*** sshnaidm|ptg has quit IRC14:44
*** hongbin has joined #openstack-infra14:44
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: Revert "Revert "Deploy the build ssh key to auth_keys""  https://review.openstack.org/55002714:48
tobiashandreaf: I put a depends-on into ^14:48
*** slaweq_ has joined #openstack-infra14:48
*** gongysh has quit IRC14:49
*** yamamoto has quit IRC14:49
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Fix the copy-build-sshkey role  https://review.openstack.org/54804914:50
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Revert "Revert "Deploy the build ssh key to auth_keys""  https://review.openstack.org/55002714:50
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Revert "Revert "Deploy the build ssh key to auth_keys""  https://review.openstack.org/55002714:51
andreaftobiash thanks! I moved it one patch up, since the "parent" patch was failing as well for the same issue14:51
tobiashok14:51
*** slaweq_ has quit IRC14:53
*** caphrim007 has quit IRC14:53
*** r-daneel has joined #openstack-infra14:56
*** aviau has quit IRC14:58
*** aviau has joined #openstack-infra14:58
*** slaweq_ has joined #openstack-infra14:58
*** slaweq_ has quit IRC15:03
*** suhdood has joined #openstack-infra15:03
*** jaosorior has joined #openstack-infra15:04
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Set node version for javascript publish job  https://review.openstack.org/55010615:06
mordredinfra-root: I'm gonna try to get us out of having zuul01 in the emergency file - I'd like to land that ^^ first, as the js publish job for zuul is currently not working and I think step one is figuring out why15:07
tobiashmordred: lgtm15:08
pabelangermordred: wfm15:08
pabelangermtreinish: thanks15:08
mordredthen, if the post-job for that actually works this time, I'll do a puppet run with the puppet change while watching it15:08
*** slaweq_ has joined #openstack-infra15:09
tobiashandreaf, mordred, AJaeger: https://review.openstack.org/#/c/550091/ unbreaks zuul-jobs, tested with https://review.openstack.org/#/c/548049/815:10
mordredtobiash: +215:11
tobiash:)15:11
andreaftobiash nice thanks15:11
andreafmordred feel free to +2 https://review.openstack.org/#/c/548049 as well :D15:12
*** slaweq_ has quit IRC15:13
xgerman_hi, I am trying to do an apt install ins some zuul run playbook but it fails: https://review.openstack.org/#/c/549259/15:14
xgerman_any ideas?15:14
*** dprince has quit IRC15:14
pabelangerxgerman_: become: yes15:15
pabelangerfor the task15:15
pabelangerneeds sudo permissions15:15
xgerman_ok, makes sense15:15
xgerman_thanks a dozen15:15
*** olaph1 has joined #openstack-infra15:18
mtreinishpabelanger: fwiw, we probably should migrate whatever project was using that to stestr per the updated pti and just avoid the problem15:18
*** slaweq_ has joined #openstack-infra15:19
mtreinishpabelanger: also we will still install os-testr (the pypi package) so we can use subunit2html as a post processing step (but I don't really have the context on what the original issue was)15:19
*** olaph has quit IRC15:19
mtreinishbut using ostestr (the command which is part of the os-testr package) is something we should move away from (per the updated pti)15:20
mordredmtreinish: they just had a wrapper script that called ostestr but I don't think they had ostestr in their requirements - I believe their actual plan was to just migrate properly15:20
*** slaweq has quit IRC15:22
*** slaweq has joined #openstack-infra15:22
mtreinishmordred: ah, ok15:22
*** slaweq_ has quit IRC15:23
*** links has quit IRC15:24
*** ramishra has quit IRC15:26
*** slaweq has quit IRC15:27
*** masber has quit IRC15:28
*** smarcet has quit IRC15:29
*** slaweq has joined #openstack-infra15:29
mordredpabelanger: have a sec to plop a +A on https://review.openstack.org/#/c/550106/ ?15:32
openstackgerritWitold Bedyk proposed openstack-infra/project-config master: Add horizon to required-projects  https://review.openstack.org/55013015:34
*** slaweq has quit IRC15:34
pabelangermordred: done15:34
*** claudiub has joined #openstack-infra15:34
mordredpabelanger: thank you15:35
*** claudiub|2 has quit IRC15:36
*** dprince has joined #openstack-infra15:36
*** slaweq has joined #openstack-infra15:39
*** armaan has quit IRC15:40
pabelangerAJaeger: dmsimard: frickler: I did some manual testing of https://review.openstack.org/549185/ yesterday, it looks good. Does somebody want to propose promote to base then we can continue to bring bionic nodes online15:40
pabelangerI can also do it if needed15:40
*** armaan has joined #openstack-infra15:41
*** smarcet has joined #openstack-infra15:42
*** rcernin has quit IRC15:43
AJaegerpabelanger: sorry, busy right now and can't help15:44
*** slaweq has quit IRC15:44
openstackgerritPino de Candia proposed openstack-infra/project-config master: Zuul templates for new project python-tatuclient.  https://review.openstack.org/53830415:44
openstackgerritWitold Bedyk proposed openstack-infra/project-config master: Add horizon to required-projects  https://review.openstack.org/55013015:44
*** yamamoto has joined #openstack-infra15:45
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Base: Add trusted option to apt mirrors  https://review.openstack.org/55013615:47
pabelangerAJaeger: dmsimard: frickler: ^when you have time, promote to base15:48
*** smarcet has quit IRC15:49
*** slaweq has joined #openstack-infra15:49
*** yamamoto has quit IRC15:51
*** smarcet has joined #openstack-infra15:51
sc`is github mirroring okay?15:53
*** slaweq has quit IRC15:53
*** slaweq has joined #openstack-infra15:54
openstackgerritMerged openstack-infra/zuul master: Set node version for javascript publish job  https://review.openstack.org/55010615:54
sc`some changes reflected in gerrit do not appear to be reflected on github. https://review.openstack.org/549342 is an example15:55
*** slaweq_ has joined #openstack-infra15:55
ianychoisc`, seems that github mirroring is not working for many repos, for example, project-config: http://git.openstack.org/cgit/openstack-infra/project-config/log/ vs. https://github.com/openstack-infra/project-config/commits/master15:56
openstackgerritLuigi Toscano proposed openstack-infra/storyboard master: Migration script: optional parameters to filter by tags  https://review.openstack.org/54922215:56
sc`ianychoi: good to know i'm not just losing my mind today :/15:56
fungisc`: no, replication to gh keeps getting wedged behind hung replication events for the corrupted nova-specs repo, and the only way to get them moving again is a gerrit restart15:56
fungiianychoi: ^15:56
*** smarcet has quit IRC15:56
sc`fungi: thanks for the context. i figured something insidious was up15:56
fungiduring today's infra meeting we're going to discuss taking a maintenance soon to repair the nova-specs repo and reindex gerrit15:57
ianychoifungi, thanks too! :)15:57
*** jaosorior has quit IRC15:58
fungiwe were wanting to combine that with an upcoming maintenance to rename some git repos, but that's still a ways out and the situation with replication has become more urgent in the past ~24 hours15:58
*** gouthamr has joined #openstack-infra15:58
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Reparent tox-py35-on-zuul to zuul-tox-py35  https://review.openstack.org/55009115:58
openstackgerritIan Y. Choi proposed openstack-infra/project-config master: [translation] doc generatepot jobs for 3 projects  https://review.openstack.org/54537715:59
fungiluckily it's only gh replication which seems to be impacted, so if you use git.o.o as your remote everything should be up to date15:59
*** jbadiapa has quit IRC15:59
*** ihrachys has joined #openstack-infra16:01
AJaegerfungi: new project creation is also broken16:04
AJaeger new repos https://github.com/openstack/kayobe and https://github.com/openstack/python-tatuclient are not setup (at least not 12 hours ago)16:05
AJaegerbut that might be replication *only* as well...16:05
*** jbadiapa has joined #openstack-infra16:06
fungiyeah, it got created on gh (that's done via the gh rest api) but has no content (depends on having working replication to gh)16:06
fungiso once we solve the gh replication blockage that one should have content show up16:06
mtreinishfungi, frickler: if you get a sec I just wanted to confirm we're running mosquitto 1.4.15 on firehose.o.o the ppa patch merged yesterday when I was on a plane16:13
fungichecking16:13
fungifungi@firehose01:~$ dpkg -l|grep mosquitto16:13
fungiii  mosquitto                        1.4.8-1ubuntu0.16.04.216:13
mtreinishhmm16:14
fungiso 1.4.8 is installed still16:14
fungino 1.4.15 yet16:14
mtreinishmaybe I was missing something from the patch16:14
*** efoley has quit IRC16:14
fungithere is a /etc/apt/sources.list.d/mosquitto-dev-ubuntu-mosquitto-ppa-xenial.list containing:16:14
*** efoley has joined #openstack-infra16:14
fungideb http://ppa.launchpad.net/mosquitto-dev/mosquitto-ppa/ubuntu xenial main16:14
*** lihi has quit IRC16:15
mtreinishah, the package is ensure=> present not latest16:15
*** agopi|out is now known as agopi16:15
*** lihi has joined #openstack-infra16:15
AJaegerfungi: ok, great16:15
fungimanually doing `sudo apt-get install mosquitto` upgraded to 1.4.15-0mosquitto1~xenial116:16
fungii can re-downgrade it if we want to test that it auto-upgrades from universe to the ppa16:16
mtreinishfungi: nah, that should be fine16:17
fungibut i think unattended-upgrades won't do that automagically (though deploying a new server from scratch will pull the ppa version i expect)16:17
openstackgerritMatthew Treinish proposed openstack-infra/puppet-mosquitto master: Ensure we install the newest mosquitto version  https://review.openstack.org/55014416:17
mtreinishfungi: ^^^16:17
mtreinishfungi: we probably should restart mosquitto too to get the latest running16:17
fungii honestly don't know whether ensure=>latest does anything over ensure=>present with distro package provider resources16:18
mtreinishoh, I just assumed it did16:18
*** eernst has joined #openstack-infra16:18
mtreinishI don't really know either16:18
fungithe package manager (via package maintscripts) did it16:18
fungii see the current daemon started at 16:15z16:19
fungiaccording to the process list16:19
mtreinishah ok16:19
mtreinishcool16:19
fungialso worth noting, i don't think unattended-upgrades is likely to upgrade things in a ppa source. it generally expects individual sources to be whitelisted in its config16:20
fungiyeah, the Unattended-Upgrade::Allowed-Origins array in /etc/apt/apt.conf.d/50unattended-upgrades just has stable, ${distro_codename}-security, ${distro_codename}-updates and Puppetlabs:xenial16:21
mtreinishhmm, I wonder if there is puppet magic to get around that16:23
fungithere is, i'm just following the plumbing up from http://git.openstack.org/cgit/openstack-infra/puppet-unattended_upgrades/tree/templates/50unattended-upgrades.erb16:23
*** andreas_s has quit IRC16:23
mtreinishbut we probably should just wait until bionic abd remove the ppa bits16:23
fungilooks like we add it from http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/server.pp#n22416:24
fungiwe can extend that "origins" list as needed16:24
*** dhajare has joined #openstack-infra16:25
*** armaan has quit IRC16:26
*** e0ne has quit IRC16:26
*** VW_ has joined #openstack-infra16:27
*** andreas_s has joined #openstack-infra16:28
*** janki has quit IRC16:29
*** VW has quit IRC16:30
*** smarcet has joined #openstack-infra16:30
*** jamesmcarthur has joined #openstack-infra16:35
mtreinishfungi: if you think it's worth it, I can push another patch for that in a bit16:36
funginah, i'm with you that we should just plan to replace firehose01 with a bionic instance in a couple months and revert the ppa addition16:38
*** caphrim007 has joined #openstack-infra16:38
*** suhdood has quit IRC16:39
*** germs has joined #openstack-infra16:39
*** germs has quit IRC16:39
*** germs has joined #openstack-infra16:39
*** kevinbenton has quit IRC16:41
*** andreas_s has quit IRC16:42
*** germs has quit IRC16:43
*** jamesmcarthur has quit IRC16:43
*** kevinbenton has joined #openstack-infra16:43
*** jamesmcarthur has joined #openstack-infra16:43
*** trown|rover is now known as trown|lunch16:44
*** camunoz has joined #openstack-infra16:44
*** jamesmcarthur has quit IRC16:47
*** yamamoto has joined #openstack-infra16:47
*** jamesmcarthur has joined #openstack-infra16:47
openstackgerritMerged openstack-infra/project-config master: Base: Add trusted option to apt mirrors  https://review.openstack.org/55013616:48
*** myoung|ruck is now known as myoung|ruck|lunc16:48
*** myoung|ruck|lunc is now known as myoung|ruck|food16:48
*** udesale_ has quit IRC16:53
*** yamamoto has quit IRC16:53
*** camunoz has quit IRC16:53
*** camunoz has joined #openstack-infra16:53
iceyhow long is the delay between zuul merging something, and that commit syncing to github?16:54
fricklericey: syncing to github is mostly broken currently. you can use git.openstack.org in the meantime16:56
iceyok thanks frickler16:57
*** jamesmcarthur has quit IRC17:00
fungior, you know, switch to git.openstack.org permanently. it runs on free software17:01
*** jamesmcarthur has joined #openstack-infra17:01
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Normalize hostname for statsd  https://review.openstack.org/54730917:03
*** wolverineav has joined #openstack-infra17:04
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Remove Product WG meeting  https://review.openstack.org/55016417:05
*** lucasagomes is now known as lucas-afk17:06
dmsimardfungi: I appreciate gitweb/cgit but the github/gitlab UI is so much more convenient :/17:06
dmsimardI think mordred had experimented with gitlab17:07
*** manjeets has quit IRC17:07
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add version-from-git role to javascript publish playbook  https://review.openstack.org/55016617:07
mordreddmsimard: in what context?17:07
dmsimardfrickler: has anyone looked at the replication issues yet or is that still outstanding ?17:07
dmsimardmordred: Using gitlab instead of cgit/gitweb ?17:08
fungidmsimard: the webui and git client access are entirely orthogonal. you can use git.o.o as a git remote without ever touching the cgit browser on it17:08
mordreddmsimard: oh - yeah, I haven't looked at gitlab -it's open core17:08
dmsimardmordred: you had a passthrough or you kept something in sync I forget17:08
mordreddmsimard: I *have* looked in to potentially using gogs/notabug - but only breifly17:08
*** manjeets has joined #openstack-infra17:08
dmsimardmordred: yeah I realize gitlab is open core and I actually had a bad experience because of that a few years back now17:08
mordreddmsimard: ++17:08
dmsimardmordred: they wanted to monetize the development of a feature I asked for T_T17:09
mordreddmsimard: of course they did17:09
dmsimardfungi: oh, I didn't realize the person was cloning from github, I thought it was about browsing -- my bad17:09
mordreddmsimard: I've been meaning to write up a proposal for us to consider using either gogs or the notabug fork of gogs as a cgit replacement so that people can have a more enjoyable browsing experience17:10
*** danpawlik has quit IRC17:10
dmsimardmordred: I've seen gogs, never heard about notabug before17:10
dmsimardlove the simplicity of gogs17:10
mordreddmsimard: https://notabug.org/ ... they have a fork of gogs that removes some non-free stuff that's in gogs - or something else, I forget exactly why17:10
dmsimardinteresting17:11
dmsimardmordred: seems like there is the explicit notion of "mirrors", I wonder how that works17:11
mordredah  here we go: https://notabug.org/hp/gogs/issues/11117:12
*** jpena is now known as jpena|off17:12
mordreddmsimard: seems the only salient different with upstream now is references to non-free services17:12
*** armaan has joined #openstack-infra17:13
*** ykarel has quit IRC17:14
*** olivierbourdon38 has quit IRC17:17
mordreddmsimard, pabelanger, AJaeger: https://review.openstack.org/550166 <-- needed to fix http://logs.openstack.org/3d/3d9af04cc20b822542921bf4fb59e1e9e2e33499/post/publish-openstack-javascript-content/5e30754/ara/result/7dbb6372-bf59-4a41-a796-378bad7ccfd2/17:18
*** hashar is now known as hasharDinner17:19
mordredoh - hah. SotK removed it recently in commit 4a6bdbfdd29642f699e7f5b1481198d88219dabf17:20
* mordred digs just a little further17:21
dmsimardmordred: +2, added a comment17:21
dmsimardmordred: oh, and you +2'd the change too eh https://review.openstack.org/#/c/545594/17:22
mordredyah17:23
mordredI think I see a better slution ...17:23
*** tosky has quit IRC17:24
clarkbmorning17:26
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Use zuul.tag in fetch-javascript-tarball  https://review.openstack.org/55017517:26
clarkbI made it home late last night. Will probably be around for the meeting but otherwise need to catch up on stuff around home. Expect to be here properly tomorrow17:26
mordreddmsimard: ^^ how does that look as an alternative to the project-config patch?17:26
mordredclarkb: welcome home!17:26
pabelangerclarkb: ack17:26
mordreddmsimard: OH - wow. SO ... this is a mess ...17:28
dmsimardmordred: go on17:28
mordreddmsimard: there is a publish-openstack-javascript-tarball in openstack-zuul-jobs and a publish-openstack-javascript-content in project-config17:29
dmsimardwhich both mean to do the same thing... differently ?17:29
*** amoralej is now known as amoralej|off17:29
mordredyah - I'm currently looking to see why we have the one in project-config at al - I think it might just be leftover17:29
*** tosky has joined #openstack-infra17:29
dmsimardmordred: ok, can you -W your two changes just so we don't inadvertently merge them while you figure that out ?17:30
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Remove publish-openstack-javascript-content job  https://review.openstack.org/55016617:32
*** gyee has joined #openstack-infra17:33
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Remove version-from-git role from release playbook  https://review.openstack.org/55017717:34
*** rpittau has quit IRC17:34
pabelangerconfig-core: https://review.openstack.org/547108/ cleans up some fedora-26 jobs17:34
openstackgerritMonty Taylor proposed openstack-infra/openstack-zuul-jobs master: Remove version-from-git from post-tarball playbook  https://review.openstack.org/55017817:35
pabelangerhttps://review.openstack.org/549889/ is another fedora-26 clean up, but for bindep17:36
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Switch to publish-openstack-javascript-tarball  https://review.openstack.org/55017917:36
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Remove publish-openstack-javascript-content job  https://review.openstack.org/55016617:37
*** danpawlik has joined #openstack-infra17:38
clarkbdoes anyone else have opinions on bindep supporting os x before I approve the change to add some simple initial support?17:39
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Remove version-from-git role  https://review.openstack.org/55018017:39
mordredclarkb: seems fine to me - I assume it means supporting brew?17:39
clarkbmordred: yes it detects the "darwin" atom and if which brew returns 0 also adds the brew atom17:40
clarkbit doesn't do much more than that yet from what I can tell17:40
mordredyah - wfm17:40
clarkbso won't ask brew for missing packages17:40
clarkb(but probably best to add it step by step anyways)17:41
mordredclarkb: wait - doens't it also look for versions? in the Brew class with the brew list --versions  pkg_name ?17:41
*** suhdood has joined #openstack-infra17:41
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove fedora-26 devstack / tempest testing  https://review.openstack.org/54710817:42
clarkboh derp I hadn't fully scrolled yet17:42
clarkbclearly I shouldn't be reviewing things after being awake for 26 hours flying home17:42
clarkbalso I should make some tea17:42
*** ykarel has joined #openstack-infra17:43
mordredpabelanger, dmsimard: https://review.openstack.org/#/c/550179 will at least fix the zuul-web tarball issue17:43
mordred(or should)17:44
dmsimardclarkb: I could point out http://docs.ansible.com/ansible/latest/homebrew_module.html but we've already had the discussion of bindep vs ansible before so I won't go there again :p17:44
dmsimard(when you have a hammer everything looks like a nail something something)17:44
SamYapleim trying to get the #openstack-loci channel eavesdropped. can i get a few acks? https://review.openstack.org/#/c/549217/17:44
SotKmordred: I recently discovered my removal of it broke the job in a different way17:44
mordredSotK: well - I'm gonna get it fixed today :)17:44
dmsimardmordred: I'm confused, that's for zuul proper ?17:44
SotKmordred: thanks :)17:45
mordreddmsimard: yes. the underlying problem is that the job zuul is currently running is not actually publishing tarballs17:45
mordreddmsimard: but that has uncovered a few things17:45
dmsimardmordred: oh, one of those rabbit holes17:45
mordreddmsimard: yah. I'm having so much fun17:45
mordreddmsimard: also the ansible homebrew module is orthogonal to bindep and what bindep does17:45
dmsimardno doubt17:45
dmsimardmordred: yeah, hence "I don't want to get into that discussion again"17:46
clarkbI've gone ahead with approving the os x bindep patch I've relooked over it because I'm a derp but from what I can tell it shouldn't affect any other systems so worst case os x continues to not completely work but best case we can support them better17:46
mordreddmsimard: nod. I wasn't sure what the discussion was - but will happily drop it17:46
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Normalize hostname for statsd  https://review.openstack.org/54730917:46
dmsimardmordred: the bindep vs ansible one :)17:46
dmsimardI understand very well what bindep and DIB does but being drowned in Ansible all day makes me question "what if" about some things -- and we've already discussed those at length :)17:48
mordreddmsimard: I do not recognize that as a conversation :)17:48
dmsimardmordred: it was $sometimeago17:48
*** yamamoto has joined #openstack-infra17:49
mordreddmsimard: ah - I think I understand where we're missing each other - I *totally* understand a dib vs. ansible conversation - and also a desire to not re-have that conversation17:50
*** panda is now known as panda|off17:50
dmsimard+317:50
mordreddmsimard: speaking of - I should really go fix the unit tests on my ansible bindep module and get it landed17:50
dmsimardmordred: full circle ?17:50
mordreddmsimard: https://github.com/ansible/ansible/pull/2215917:51
*** jjohnson2 has joined #openstack-infra17:53
mordreddmsimard: but also - https://review.openstack.org/#/q/topic:fix-javascript-tarball is the whole stack related to the javascript tarball publication stuffs17:53
mordredI believe I got all the depends-ons correct17:53
*** yamamoto has quit IRC17:54
*** trown|lunch is now known as trown|rover17:54
*** smarcet has left #openstack-infra17:54
*** caphrim007_ has joined #openstack-infra17:55
*** jjohnson2 has quit IRC17:55
mordreddmsimard, pabelanger, clarkb: but https://review.openstack.org/#/c/550179/ is the more immediately relevant one (trying to remove zuul01 from the emergency file)17:55
*** kjackal has quit IRC17:56
clarkbmordred: it fails python35 checking17:56
clarkboh its been rechecked17:56
clarkbI guess thats unrelated since we are just modifying jobs that run17:56
mordredyah17:56
tobiashya, the error looks unrelated17:56
clarkbnot sure I grok how changing a job name to an equivalent job would affect how we ansible/puppet zuul0117:57
mordredclarkb: the javascript patch landed, so the puppet for zuul-web broke. we need to land the puppet-zuul change that's related - but that expects the javascript tarball has been bult and published already17:58
*** gouthamr_ has joined #openstack-infra17:58
*** kjackal has joined #openstack-infra17:58
mordredso in order to land *that* we need to fix the job that publishes the built javascript content17:58
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Retire 2 jenkins base ansible roles  https://review.openstack.org/55018517:58
*** caphrim007 has quit IRC17:58
*** gouthamr has quit IRC17:58
mordredclarkb: it's a fun morning's rabbit hole17:58
mordredclarkb: https://review.openstack.org/#/c/549608/ is the puppet-zuul patch that ianw fixed last night17:59
clarkband the old job doesn't actually publish js?17:59
*** kjackal has quit IRC18:00
*** dtantsur is now known as dtantsur|afk18:00
mordredclarkb: yah. the old job (which only got added with teh javascript patch)  is a broken copy of the other job18:00
*** kjackal has joined #openstack-infra18:00
mordredclarkb: so 'fix it' turned in to 'remove the duplication - but also then improve the currently working job to be less complicated'18:00
openstackgerritMerged openstack-infra/bindep master: add detection of darwin (MacOS/OSX)  https://review.openstack.org/54628418:00
*** derekh has quit IRC18:01
clarkbok I've approved the zuul change which on merging should run the tarball publishing18:01
*** olivierbourdon38 has joined #openstack-infra18:02
mordredcool. OH - actually - lemme go abandon one of those other changes - I see a use-case/reason why it's there18:04
*** bobh has quit IRC18:06
*** efoley has quit IRC18:08
*** ralonsoh has quit IRC18:09
*** olaph has joined #openstack-infra18:13
*** jtomasek_ has joined #openstack-infra18:14
*** zoli is now known as zoli|gone18:14
*** zoli|gone is now known as zoli18:14
*** olaph1 has quit IRC18:14
*** jtomasek has quit IRC18:15
*** rosmaita has quit IRC18:16
*** HeOS has quit IRC18:18
*** ykarel has quit IRC18:18
*** caphrim007_ has quit IRC18:23
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Handle repos with no tags in version-from-git  https://review.openstack.org/55017518:23
*** caphrim007 has joined #openstack-infra18:23
mordredSotK: ^^ I think that might fix you more better18:23
tobiashmordred: is https://review.openstack.org/#/c/550175/2/roles/fetch-javascript-tarball/tasks/main.yaml a drive by change?18:25
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Fix the copy-build-sshkey role  https://review.openstack.org/54804918:25
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Fix the copy-build-sshkey role  https://review.openstack.org/54804918:26
mordredtobiash: oh - that portion should be removed from the new patch ...18:26
SotKmordred: thank you, I was planning to send a similar patch later this week18:27
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Handle repos with no tags in version-from-git  https://review.openstack.org/55017518:27
*** tesseract has quit IRC18:27
mordredtobiash: that ^^ should be a more valid version of that patch18:27
*** jamesdenton has joined #openstack-infra18:27
tobiash:)18:27
tobiashmordred: further do you really want a bool check on stdout? when: commits_since_tag_output.stdout18:28
EmilienMinfra-root: github is really async from git.o.o, do we have ongoing actions?18:28
dmsimardEmilienM: it's been mentioned before, I'm not sure if anyone has looked yet18:29
openstackgerritMerged openstack-infra/zuul master: Switch to publish-openstack-javascript-tarball  https://review.openstack.org/55017918:29
tobiashEmilienM, dmsimard: someone said a gerrit restart is neccessary to fix this18:29
EmilienMoh ok18:29
mordredEmilienM: the nova-specs repo is corrupted so gerrit's github replication breaks when it hits nova-specs changes18:30
*** florianf has quit IRC18:30
dmsimardthere's a thread about it here http://lists.openstack.org/pipermail/openstack-infra/2018-March/005842.html18:30
EmilienMoops ok18:30
fungidmsimard: it's known and there's an agenda item for today's infra meeting to possibly schedule a gerrit outage to address it18:31
fungiEmilienM: ^18:31
fungigit.openstack.org should still be completely up to date though18:31
EmilienMgood18:31
fungiso even if you don't like the cgit webui and prefer gh for code browsing, using git.o.o as your git remote is still highly recommended18:32
fungihttps://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting is the meeting agenda, btw18:32
*** shardy has quit IRC18:32
mordredyah. HIGHLY recommend **NEVER** cloning repos from github vs. git.o.o18:32
* persia wonders if github has a "can't clone this" boolean somewhere18:33
EmilienMyeah I know, but I'm aware about some CI code that does it18:33
mordredEmilienM: that ci code should prioritize not doing that18:33
fungiespecially since we have plans to completely rearrange how/where we do our gh replicas in the near-to-mid-term future18:34
EmilienMmordred: stuffs like https://review.rdoproject.org/r/#/c/12752/18:34
mordredEmilienM: ++18:34
EmilienMmordred: so yeah, i'm trying :-)18:34
mordredEmilienM: that is a more correct and more resilient patch18:34
mordredEmilienM: that CI will be happier as a result... yay!18:35
*** jamesmcarthur has quit IRC18:36
EmilienMmordred: I just found more18:37
EmilienMwith https://codesearch.rdoproject.org/?q=github&i=nope&files=&repos=18:37
EmilienMI'll fix them all18:37
openstackgerritErno Kuvaja proposed openstack-infra/openstack-zuul-jobs master: Remove glance rally job definitions  https://review.openstack.org/55019018:38
tobiashmordred: I've added a comment on https://review.openstack.org/55017518:38
mordredtobiash: thanks! - yah - maybe I should use rc there instead ...18:39
andreafinfra-core ianw frickler there are a few devstack and zuul-jobs patches to complete the devstack multinode work which could use some love https://review.openstack.org/#/q/status:open+topic:multinode_zuulv3+label:Workflow%253D018:39
*** harlowja has joined #openstack-infra18:39
*** germs has joined #openstack-infra18:39
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Handle repos with no tags in version-from-git  https://review.openstack.org/55017518:39
*** germs has quit IRC18:39
*** germs has joined #openstack-infra18:39
mordredtobiash: how's that ^^?18:39
*** shoogz has joined #openstack-infra18:41
tobiashmordred: (almost) beautiful -> +2 with comment18:42
*** shoogz has joined #openstack-infra18:43
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Handle repos with no tags in version-from-git  https://review.openstack.org/55017518:44
mordredtobiash: ooh - I like18:44
*** germs has quit IRC18:44
tobiash+218:45
*** florianf has joined #openstack-infra18:45
openstackgerritErno Kuvaja proposed openstack-infra/openstack-zuul-jobs master: Remove glance rally job definitions  https://review.openstack.org/55019018:46
*** kjackal_ has joined #openstack-infra18:47
*** kjackal has quit IRC18:47
openstackgerritMerged openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/54994618:47
openstackgerritMerged openstack-infra/project-config master: Remove constantly failing rally jobs from Glance  https://review.openstack.org/55003318:49
*** yamamoto has joined #openstack-infra18:50
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Revert "Revert "Deploy the build ssh key to auth_keys""  https://review.openstack.org/55002718:51
AJaegerjokke_: could you help merging https://review.openstack.org/538453 , please?18:53
*** yamamoto has quit IRC18:54
*** kjackal_ has quit IRC18:55
mordreddmsimard: zomg. ok. I've gone ALL the way down the rabbit hole now18:56
*** armaan has quit IRC18:56
mordreddmsimard: and the most important lesson is that one of the things missing here is *documentation* (this is re: the javascript jobs)18:56
dmsimardmordred: did you find baby rabbits or squirrels18:57
mordreddmsimard: rhinocerouses I think18:57
dmsimardin a rabbit hole, that's a huge hole18:57
mordredtell me about it18:57
*** dhajare has quit IRC18:58
mordreddmsimard, AJaeger: there are two different javascript jobs, -output and -tarball - because one is for making a source tarball such as you'd upload to npm ... and the other one is for making a bundle of built output like we do with storyboard-webclient and are trying to do with zuul-web18:58
AJaegerargh18:59
mordredyah18:59
tobiashandreaf: did you test https://review.openstack.org/#/c/550027/6 with a multinode job?18:59
dmsimardclarkb, fungi: you happen to know where the website code would be if it's not in https://github.com/openstack-infra/openstackweb ?18:59
AJaegermordred: is the description of the jobs accurate?18:59
tobiashI don't want to break that again by approving this ;)18:59
dmsimardcurious about something18:59
clarkbdmsimard: its on github, they never transitioned to gerrit19:00
fungidmsimard: much of it is in a content management database19:00
clarkbalso meeting time19:00
mordredAJaeger: well, publish-openstack-javascript-content doesn't have a description19:00
AJaegermordred: let's add one, please19:00
clarkbdmsimard: fungi er its not under openstack-infra, thats just a mirror of our gerrit thing they never switched to19:00
dmsimardclarkb: ok, I'll poke you for a link after the meeting, it's not important19:00
mordredAJaeger: yes. I shall do this19:00
andreaftobiash: yeah I tested it on my local multinode setup19:00
andreaftobiash and it's also running in CI against multinode19:00
fungidmsimard: clarkb: oh, right, different gh org too for the version they're using19:00
fungidmsimard: https://github.com/OpenStackweb/openstack-org/19:01
beisnerhi all - is gh sync back up?19:01
*** VW_ has quit IRC19:01
*** VW has joined #openstack-infra19:02
fungibeisner: we need a gerrit maintenance window to fix it19:02
dmsimardfungi: neat, thanks19:03
mordredbeisner: no - it will require a gerrit restart, which we're likely going to discussn now in the infra meeting. in the meantime, for browsing code, use git.openstack.org ... and for automated scripts it's recommended to not rely on the github replicas in the first place19:03
ianwpabelanger: urgh, so i just checked on the ports reprepro sync and i guess it's run out of quota :/19:03
beisnerah ok fungi mordred - I’ll ++patience.  many thanks.19:03
pabelangerianw: sadface19:03
mordredbeisner: sure nuff!19:03
pabelangerianw: do we need to just bump quota or add more HDD?19:03
ianwi'll have to check into it after meeting, i know things were tight in the volumes too19:04
openstackgerritFabien Boucher proposed openstack-infra/zuul master: Tenant config can be read from an external script  https://review.openstack.org/53587819:10
*** germs has joined #openstack-infra19:13
*** germs has quit IRC19:13
*** germs has joined #openstack-infra19:13
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoint to update summit venue rooms  https://review.openstack.org/55020819:13
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: Handle repos with no tags in version-from-git  https://review.openstack.org/55017519:14
*** myoung|ruck|food is now known as myoung|ruck19:15
tobiashmordred: persia had a comment on ^ and I just fixed that19:15
mtreinishhmm, the windows ci service I'm using on github just announced they're adding support for linux testing19:17
dmsimardmtreinish: windows ci service ?19:18
mtreinishnot sure why someone would pick that over any of the other github ci things out there. They unique draw is the windows support, which is missing in most other things19:18
openstackgerritMerged openstack-infra/zuul-jobs master: Fix the copy-build-sshkey role  https://review.openstack.org/54804919:18
openstackgerritMerged openstack-infra/zuul-jobs master: Revert "Revert "Deploy the build ssh key to auth_keys""  https://review.openstack.org/55002719:18
mtreinishdmsimard: appveyor, it's like a travis thing for testing on windows. I use it for stestr:  https://ci.appveyor.com/project/mtreinish/stestr/19:18
persiaMy comment didn't really need to be fixed :)19:19
dmsimardmtreinish: oh from the sound of it it made me think it was a microsoft thing19:19
mordredtobiash: thanks!19:19
openstackgerritMerged openstack-infra/openstackid-resources master: Added endpoint to update summit venue rooms  https://review.openstack.org/55020819:19
mtreinishdmsimard: ah that was prolly my bad. I had the context in my head assumed19:19
mtreinishI just read the email and was thinking in channel :p19:20
dmsimardmtreinish: never heard about appveyor before, guess I'm not in that bubble19:20
fungimtreinish: i hope it's testing linux environments on windows. that would be a unique service at least19:20
*** rosmaita has joined #openstack-infra19:20
dmsimardwonder what's the differentiator vs say, travis19:20
fungithe ability to run tests on windows is one, apparently19:21
tobiashpersia: well comments and code diverge too often...19:21
fungisounds like travis doesn't have windows testing19:21
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Revert "Switch to publish-openstack-javascript-tarball"  https://review.openstack.org/55021719:21
dmsimardfungi: that implies knowing that travis doesn't support windows in the first place (I don't actually know travis that well :))19:22
tobiashand if there is even a comment we should fix that ;)19:22
*** rosmaita has quit IRC19:23
mtreinishfungi: from the email it's an ubuntu vm instead of a windows one19:23
mtreinishfungi: https://www.appveyor.com/blog/2018/03/06/appveyor-for-linux/19:24
fungiahh, too bad19:25
fungiif it was the "run ubuntu natively on windows without a vm" thing, that would have been more amusing19:26
mtreinishalthough I bet you probably could play with the ubuntu userspace stuff. They give you a place to write powershell in the config dsl for windows19:29
mtreinishwhich I expect would be enough to do any setup necessary and then test against it19:29
persiaWSL is surprisingly capable19:29
persia(and Debian-flavoured WSL is now available, if people have platforms that can experiment with that sort of thing)19:30
fungioh, yeah i saw that mentioned in the latest update-from-the-dpl19:32
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add role for fetching javascript built content  https://review.openstack.org/55022319:33
*** eharney has quit IRC19:34
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Use fetch-javascript-content-tarball role  https://review.openstack.org/55022519:37
mordredAJaeger, pabelanger, tobiash, dmsimard: ok. I think fix-javascript-tarball topichas the whole story now19:39
*** zul has quit IRC19:41
*** portdirect has quit IRC19:41
*** ggherdov- has quit IRC19:41
*** zul has joined #openstack-infra19:41
*** mrmartin has quit IRC19:41
*** portdirect has joined #openstack-infra19:42
openstackgerritMonty Taylor proposed openstack-infra/openstack-zuul-jobs master: Install yarn in javascript pre playbook  https://review.openstack.org/55023019:42
*** mrmartin has joined #openstack-infra19:42
*** tosky has quit IRC19:42
*** tomhambleton_ has quit IRC19:42
*** ggherdov- has joined #openstack-infra19:42
*** tomhambleton_ has joined #openstack-infra19:42
*** germs has quit IRC19:45
*** tosky has joined #openstack-infra19:45
*** yamamoto has joined #openstack-infra19:50
*** yamamoto has quit IRC19:56
mordreddmsimard, pabelanger, ianw: if you get a sec, https://review.openstack.org/#/c/550223/ then https://review.openstack.org/#/c/550225 then https://review.openstack.org/#/c/550217/19:56
mordredand that shouldhave us back on track19:57
*** salv-orl_ has quit IRC19:58
dmsimardfungi: (continuing here) you can selectively replicate things (or not), example here: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/gerrit/replication.config#L42-L4519:58
*** salv-orlando has joined #openstack-infra19:59
dmsimardfungi: however I'm not familiar with OpenStack's gerrit replication config19:59
dmsimardso this might or might not be easy19:59
*** florianf has quit IRC20:00
persiaianw: When you have a moment, I'd like to discuss https://review.openstack.org/546434 vs. https://review.openstack.org/549925 . No particular rush (as you noted, there are other things to do before either lands), but I feel like either I don't understand or you have a different plan than I previously understood.20:03
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Use fetch-javascript-content-tarball role  https://review.openstack.org/55022520:03
AJaegermordred: fixed nit ^20:03
*** salv-orlando has quit IRC20:03
fungidmsimard: we plumb the replication array at http://git.openstack.org/cgit/openstack-infra/puppet-gerrit/tree/templates/replication.config.erb from http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/review.pp#n21520:04
fungidmsimard: so if projects can take a regex with a negative lookahead or something, that might work?20:05
ianwpersia: hmm, no good point, i think probably your idea is better20:05
mordredAJaeger: thanks!20:06
*** caphrim007 has quit IRC20:06
dmsimardfungi: should accept negative lookahead -- i.e, https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/gerrit/replication.config#L3620:06
persiaianw: My memory was that I wrote that based on your comments in this channel, so I think you get credit for the idea, but if you're happy with 546434, then I am unconfused.20:06
clarkbdmsimard: thats a positive matching regex if I am reading it correctly20:07
dmsimardclarkb: yeah, I'm just saying it seems like it should be possible20:08
*** david-lyle has joined #openstack-infra20:08
clarkbdmsimard: it will depend on the regex implementation since negative lookahead is not in all impleentations20:08
clarkbfwiw I think a timeout and a max retries is probably also a valid thing to do for nova-specs workarounding20:09
dmsimardclarkb: ah, right -- I'm spoiled by working within the same supported boundaries :)20:09
dmsimardI haven't done java since.... college ?20:10
fungii haven't done java since the last time i patched gerrit20:10
*** olivierbourdon3- has joined #openstack-infra20:13
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Bring wheel builder for ubuntu-bionic online  https://review.openstack.org/55023520:13
clarkbdmsimard: fungi https://docs.oracle.com/javase/7/docs/api/java/util/regex/Pattern.html that seems to support negative lookahead20:14
ianwseems like we'll be ok to do the nova-specs fixup soon anyway20:15
clarkbno guaruntee that gerrit uses that regex implementation but its a good sign at least :)20:15
pabelangerconfig-core: ^ is our wheel-build jobs for ubuntu-bionic, I don't expect them to work but gives us the ability to start debugging them20:15
*** david-lyle has quit IRC20:15
dmsimardclarkb: it's good to keep it in mind if we need a backup plan20:16
AJaegerpabelanger: there's also persia's https://review.openstack.org/54964420:16
persiaThat's not complete.20:16
AJaegerpersia, pabelanger, let'S abandon one of them, please20:17
persiaMy plan was to wait a bit more, then follow the bionic work for arm6420:17
fungiclarkb: dmsimard: also looking at the replication plugin config examples, it _appears_ that we could make git.openstack.org one mirror with five urls instead of five separate mirrors. see the example at the top of https://gerrit.googlesource.com/plugins/replication/+/stable-2.13/src/main/resources/Documentation/config.md20:17
persiaAJaeger: Must I abandon?  I'd rather rebase later.20:17
fungithough that would require some refactoring of the puppet module/template20:17
*** olivierbourdon3- has quit IRC20:17
*** olivierbourdon3- has joined #openstack-infra20:18
*** olivierbourdon38 has quit IRC20:18
*** eharney has joined #openstack-infra20:18
pabelangerAJaeger: persia: sure, left -1 as that setup won't actually work20:18
dmsimardfungi: oh, interesting20:19
*** olivierbourdon38 has joined #openstack-infra20:19
persiapabelanger: I was hoping the job would run on different clouds for different nodesets.  Thanks for the clarification.20:20
pabelangerpersia: yah, today all multinode jobs run in a single cloud. As we don't want networking to traverse the interwebs20:20
persiaThat makes sense.20:20
pabelangerhowever, these jobs don't internetwork between each other.20:21
*** olivierbourdon38 has quit IRC20:21
persiaStill, it complicates things needlessly to need to introspect a job to determine if there is internetworking happening when scheduling it.20:21
AJaegerpersia: if those are not doing the same thing, then leave them - from description I thought they are duplicates...20:21
AJaegerpersia: didn't review yours again20:21
* AJaeger calls it a day and waves good night20:22
persiaAJaeger: pabelanger's is for Ubuntu Bionic.  Mine was an incorrect implementation for Ubuntu Xenial ARM64.  My update (to be rebased over pabelanger's) will be Ubuntu Xenial+Bionic for ARM64.20:22
AJaegerpersia: ah! Sorry! Confirms that I really should sign off...20:23
persiaNo worries :)20:23
openstackgerritMerged openstack-infra/zuul master: Revert "Switch to publish-openstack-javascript-tarball"  https://review.openstack.org/55021720:24
*** jamesmcarthur has joined #openstack-infra20:26
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Install yarn in javascript pre playbook  https://review.openstack.org/55023020:30
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Fix typo with OpenStack in zuul jobs  https://review.openstack.org/55024720:33
*** david-lyle has joined #openstack-infra20:39
clarkbmordred: http://paste.openstack.org/show/693452/20:40
*** ihrachys_ has joined #openstack-infra20:41
*** e0ne has joined #openstack-infra20:42
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Bring wheel builder for ubuntu-bionic online  https://review.openstack.org/55023520:43
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Fix typo with OpenStack in zuul jobs  https://review.openstack.org/55024720:43
*** ihrachys has quit IRC20:43
*** hasharDinner is now known as hashar20:44
fungipabelanger: persia: _if_ nodes in a job don't communicate with each other, odds are they would be more efficiently turned into separate single-node jobs anyway20:44
fungii may lack imagination, but the only good reasons i can come up with for multi-node jobs all involve some sort of communication between the nodes20:44
*** jamesmcarthur has quit IRC20:45
persiafungi: An example of the class of job is at http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.d/jobs.yaml#n93620:46
persiaI think it is just avoiding retyping the template that makes it seem convenient to run python2 and python3 on two nodes as part of the same job.20:46
fungipersia: looks like it proves my point. shouldn't we be able to make those separate jobs and then they can get scheduled independently20:47
persiaHeh, yes.20:47
* persia will look at refactoring if someone else doesn't get to it sooner20:47
fungithe main upsell on multi-node jobs is that you're guaranteed n count nodes in close proximity (topology-wise) so that they can communicate more effectively20:48
bkero-Hi, I'm using nodepool and trying to adjust the flavor that nodepool-launcher is using. I changed it in labels.mylabel.flavor-name, although that is complaining 'Client Error for url: https://api:8774/v2/bde7e527fd964f2da5b841cf40c47f25/servers Invalid flavorRef provided'.20:49
persiaIn this case, that is only meaningful in terms of the file cache on the mirror servers.  In practice, it likely hardly matters at all.20:49
bkero-Is there someplace that I need to adjust flavors, like in zuul config?20:49
fungibkero-: that error looks like your cloud is saying it has no such flavor20:50
pabelangerconfig-core: https://review.openstack.org/550235 should be ready for review now, ubuntu-bionic wheel build jobs20:50
pabelangerplan is to use https://review.openstack.org/550254/ to test them20:50
bkero-fungi: that does seem to be the case, although I've double-checked that the flavor name does exist and is exposed to the project20:51
ianwi think we're all good for gerrit fixups.  i just have a guy here removing some a/c units, so may lose power.  once that's done i'll do the fixup, based on review.o.o:~gerrit2/ianw/nova-specs/fix.sh20:51
fungibkero-: as far as i know, nodepool is the only component which should care about your nova flavors20:51
*** david-lyle has quit IRC20:52
clarkbshade may be caching flavors and not seeing new flavors?20:52
*** yamamoto has joined #openstack-infra20:52
bkero-fungi: is labels.'label'.flavor-name the only place a flavor name is specified?20:52
fungithat's the only place i'm aware of20:53
pabelangerunder pools right?20:53
bkero-clarkb: I'm kicking nodepool-launcher when I change the nodepool.yaml20:53
*** dprince has quit IRC20:54
clarkblabels take a flavor?20:54
clarkbshould be a pool config like pabelanger says20:54
* fungi checks ours20:54
clarkbsince it varies by cloud (potentially)20:54
pabelangerprovider.pools.labels20:54
bkero-Oh, this is top-level 'labels'20:54
clarkbianw: that script looks fine except that I think it modifies a copied git repo rather than the one gerrit uses20:54
bkero-That would be why ._.20:54
pabelangeryah20:54
fungiyeah, example: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/nl01.openstack.org.yaml#n6320:55
bkero-i'm guessing that top-level labels: has been ignored all along20:55
fungibkero-: how was it previously working for you?20:55
bkero-fungi: Things just launched20:55
clarkbbkero-: https://docs.openstack.org/infra/nodepool/configuration.html#labels20:55
bkero-I have a single cloud specified in providers, some disk images, and labels20:55
fungiproviders.pools.labels.<label>.flavor_name is what we're using20:56
pabelangerbkero-: also, shouldn't need to kick nodepool-launcher after you modify nodepool.yaml, the process will detect changes every time it pools20:56
pabelangerchanges to clouds.yaml, however you need to restart nodepool-launcher20:56
bkero-clarkb: Yeah, The 'labels:' at the top of that section confused me since it wasn't wrapped in the provider.pools'20:56
bkero-I guess patches welcome20:56
clarkbya should probably be moved under pools20:57
bkero-I don't even have a pools entry O_O20:57
*** jamesmcarthur has joined #openstack-infra20:57
clarkbthat implies you are running "old" nodepool20:57
fungiwe seem to just use a single pool named "main"20:57
clarkbwhich didn't have the pools concept20:57
*** yamamoto has quit IRC20:57
clarkbjust providers20:58
bkero-Oh yeah. This is older nodepool.20:58
bkero-I guess I'd better go dig up that code and compile some docs to read.20:58
bkero-0.4.120:59
clarkbbkero-: for 0.4.1 I think the same concepts apply there is just no pool20:59
notmynamea few of us have noticed that swift's github mirror hasn't been updating after stuff merges. has there been a change somewhere?20:59
clarkbso flavor name goes under provider.images.$image20:59
*** salv-orlando has joined #openstack-infra20:59
clarkbnotmyname: nova-specs repo is/has been corrupt for a long time. This hasn't been an issue for anything but nova-specs until recently but recently it started preventing other repos from replicating to github properly21:00
clarkbnotmyname: plan is to try and clean up nova-specs and unblock replication to github today when ianw is ready to do that21:00
notmynamehmm...ok21:00
mnasermaybe #status or #notice this?21:00
notmynameclarkb: ok, cool. thanks21:00
bkero-Huh, no 0.4.1 git tag21:00
clarkbmnaser: we've sent email to the list (and by we I mean ianw)21:00
notmynameah yeah. I missed that21:01
*** jtomasek_ has quit IRC21:01
clarkbgithub recently changed a bunch of stuff around their ssh implementation which I wouldn't be surprised to learn is the ultimate underlying change that caused this21:02
fungibkero-: there was no 0.4.1... perhaps you're running 0.4.0 with some patches?21:02
bkero-fungi: that could be21:02
dmsimardinfra-root: Should we do a #status about github ? It's been coming up a lot.21:02
fungibkero-: if it's installed with pip, you should be able to run `pbr freeze|grep nodepool` and find out21:03
dmsimardoh, mnaser beat me to it21:03
mnaser:P21:03
fungibkero-: note that's `pbr freeze` not `pip freeze`21:03
mordredbkero-, clarkb: https://review.openstack.org/#/c/441215/ <-- that's the patch for nodepool v3 that invalidates the flavor cache on 400 errors21:03
bkero-fungi: nodepool==0.4.1.dev53  # git sha c1db43b21:03
fungipbr will annotate with the git commit hash21:03
bkero-mordred: thanks, will check it out21:04
*** salv-orlando has quit IRC21:04
fungiyep, so that's "0.4.0 with some additional commits"21:04
bkero-ah, ok21:04
clarkbmordred: did you see my paste above? I think js jobs are still broken21:04
mordredit should be straightforward to apply to old nodepool, although it won't be a cherry-pick21:04
fungi(53 additional commits, looks like)21:04
*** e0ne has quit IRC21:04
mordredclarkb: I didn't - just ran out to do voting21:04
clarkbmordred: http://paste.openstack.org/show/693452/21:05
mordredclarkb: yah - I think that was a race - I should have put in a depends-on to the zuul patch21:05
bkero-mordred: that seems easy to apply if not cleanly21:05
dmsimardinfra-root: an attempt: #status notice The infrastructure team is aware of replication issues between review.openstack.org and github.com repositories. We're planning a maintenance to try and address the issue. We recommend using https://git.openstack.org which is up to date.21:06
mordredbkero-: ++21:07
notmynameclarkb: if I go to http://git.openstack.org/cgit/openstack/swift/ I don't see any link or text anywhere that tells me what to use as the remote url in my local git repo (this is why I use github as "origin"). what should I use?21:07
*** r-daneel_ has joined #openstack-infra21:07
notmynameclarkb: or maybe it's there and I'm blind?21:07
clarkbnotmyname: that is the url21:08
persianotmyname: I use sources of the form git://git.openstack.org/openstack/swift21:08
notmynameclarkb: what persia said or what I said?21:08
*** r-daneel has quit IRC21:08
*** r-daneel_ is now known as r-daneel21:08
persianotmyname: Also, from the URL you posted, scroll to the bottom and look to the left.21:08
clarkbnotmyname: both. It supports git:// http:// and https:// only the http(s) with the cgit/ path21:08
persia(under "Clone")21:08
notmynamepersia: ah! the "I'm blind" part is the answer :-)21:09
notmynamepersia: clarkb: thanks21:09
persianotmyname: Or maybe, like me, your browser doesn't automatically show that bit because it imposes a scrollbar :)21:09
mordredfwiw - I recommend the https:// form instead of the git:// form21:09
notmynamemordred: oh? why?21:10
*** prometheanfire has quit IRC21:10
persiamordred: Why?  I thought I'd get a git smart server via git://21:10
clarkbgit:// doesn't ssl is a big one21:10
mordredgit:// doesn't have any ssl verification, so someone could mitm you21:10
pabelangerdmsimard: fine by me21:10
clarkband git updated the http serving method a while back to be much smarter21:10
clarkb(I think spearce implemented that actually)21:11
mordredyah - that's the other thing- http gets you a smart server these days too21:11
persiaAh, if http is smart now, then I'll use that in the future.  Thanks for the guidance.21:11
*** hashar is now known as hasharL4D221:11
*** tosky has quit IRC21:11
dmsimardclarkb, fungi, ianw: okay with my #status above ?21:12
clarkbdmsimard: we might even be more forceful on "use git.openstack.org" but that sounds fine to me21:13
mordreddmsimard: if I were to wordsmith, "We recommend using... " ... yah21:13
mordredit makes it sound like we're only recommending that in this moment21:13
fungidmsimard: go for it21:13
dmsimardyeah I actually rephrased it from "git.o.o in the meantime"21:13
mordredbut I think what you have is great21:13
mordreddmsimard: ++21:14
dmsimardhappy to take any more forceful suggestions21:14
clarkb"we recommend using our official supported mirrors instead, git.openstack.org" ?21:14
fungipersia: specifically, we have apache rewriting to the git smart http backend21:14
*** olaph has quit IRC21:15
*** ldnunes has quit IRC21:15
ianw++21:15
persiadmsimard: Given the parallel discussion, perhaps even https://git.openstack.org/21:15
persiaAh, you have that.  Never mind :)21:15
*** olaph has joined #openstack-infra21:15
dmsimardclarkb: sure21:15
*** tosky has joined #openstack-infra21:16
fungipersia: details for how that works can be found at http://git.openstack.org/cgit/openstack-infra/puppet-cgit/tree/templates/git.vhost.erb#n2121:16
dmsimard#status notice The infrastructure team is aware of replication issues between review.openstack.org and github.com repositories. We're planning a maintenance to try and address the issue. We recommend using our official supported mirrors instead located at https://git.openstack.org.21:16
openstackstatusdmsimard: sending notice21:16
dmsimardstepping away for a while, be back later21:17
-openstackstatus- NOTICE: The infrastructure team is aware of replication issues between review.openstack.org and github.com repositories. We're planning a maintenance to try and address the issue. We recommend using our official supported mirrors instead located at https://git.openstack.org.21:18
openstackgerritLance Bragstad proposed openstack-infra/irc-meetings master: Propose a new time for weekly keystone meeting  https://review.openstack.org/55026021:18
notmynameclarkb: corvus: for the third-party zuul testing, is it possible (or appropriate) to have third party project tests run on an openstack project commit?21:19
openstackstatusdmsimard: finished sending notice21:19
notmynameclarkb: corvus: or should that be done in the "traditional" third party testing framework of having eg some jenkins server listening to gerrit21:20
*** VW has quit IRC21:20
*** VW has joined #openstack-infra21:20
clarkbnotmyname: it is possible, it would probably only be appropriate if it is consuming openstack directly and openstack (the project) expect those tests, know who to talk to if they start failing21:20
clarkbI don't know that anyone is doing anything like that yet though, its all the other direciton currently I Think21:20
notmynameclarkb: ah, so they'd have to be described in -infra repositories21:21
clarkbnotmyname: currently yes21:21
ianwpabelanger: ~1tb free on afs volumes.  i've bumped ubuntu-ports quota to same as ubuntu (500gb) and started a new run21:23
ianwin other news, reprepro configuration remains as inscrutable as ever21:23
clarkbianw: ++21:23
pabelangerianw: ack21:23
ianwin /etc/reprepro/ubuntu-ports/updates it specifies amd64 ... i'm not sure i think the puppet is generating that?21:24
*** david-lyle has joined #openstack-infra21:24
*** VW has quit IRC21:24
ianwoh no, we've got both arm64 & amd64 in there.  it seems to just correctly ignore archs it doesn't know about21:25
notmynameclarkb: but last week your were describing the other direction and having those tests described in -infra too. so that part isn't any different21:26
clarkbnotmyname: ya it should work both directions. Currently they way we are set up (which is largely to protect zuul from rogue configs) we have to host the configs that are loaded into the server21:27
pabelangerianw: both where?21:27
notmynameclarkb: makes sense21:28
*** prometheanfire has joined #openstack-infra21:28
clarkbpabelanger: looks like modules/openstack_project/files/reprepro/debuntu-updates21:28
pabelangerclarkb: oh, we didn't create one specific ports.ubuntu.com21:28
pabelangerhmm21:28
pabelangeryah, http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/reprepro21:29
pabelangerwe usually split that part out21:29
pabelangernot sure how that affects the different arches21:29
*** e0ne has joined #openstack-infra21:29
lbragstadclarkb: kick started the thread - v21:30
* lbragstad is really failing with paste today21:30
lbragstadhttp://lists.openstack.org/pipermail/openstack-dev/2018-March/127972.html21:30
*** germs has joined #openstack-infra21:31
*** germs has quit IRC21:31
*** germs has joined #openstack-infra21:31
clarkbpabelanger: ianw ya I think that is ok21:32
clarkbbecause of the convoluted way reprepro works21:32
pabelangeryah, as long as they are in different afs paths, then each have their own database21:32
openstackgerritMatthew Treinish proposed openstack-infra/system-config master: Remove note about disabled websockets  https://review.openstack.org/55026621:33
andreafclarkb is there something you wanted to talk about?21:34
clarkbandreaf: oh ya it was AJaeger wanted to get filled in on the irrelevant files discussion21:35
mtreinishclarkb, fungi: ^^^ if you get a sec that doc patch should be a quick review21:35
clarkbandreaf: iirc that happened when I was doingsomething else in the helpfroom21:35
*** germs has quit IRC21:35
fungimtreinish: oh, yep! that's no longer correct ;)21:36
andreafclarkb AJaeger yeah ok that's a complicated one :)21:36
andreafclarkb AJaeger in short we had some ideas about things we may implement in zuul to be able to use templates and matchers for files together21:36
andreafclarkb AJaeger but corvus wanted to think about those some more and in any case it will take time implementing21:37
andreafclarkb AJaeger so meanwhile we need a workaround - the only one we could come up with this not using templates (for integration gate only)21:38
andreafI'm not very happy about that option tbh but we couldn't find a better alternative yet21:38
clarkbandreaf: thanks for filling us in21:39
*** afred312 has quit IRC21:41
*** david-lyle has quit IRC21:41
andreafclarkb sure np21:42
andreafclarkb that said no-one really took the ownership of replacing integration-gate with the corresponding jobs in all affected projects - but I guess it doesn't have to be done everywhere, only projects that want to21:43
*** salv-orlando has joined #openstack-infra21:43
persiaianw: pabelanger: clarkb: The debuntu stuff is likely to make more sense if it is all in one file.  The trick is keeping everything in separate repositories on-disk.  If more deb-format distros are added in the future, I'd recommend putting them in the same place.21:45
persiaBut if new architectures are added from the same archive, those would just be added architectures in each stanza (the Ubuntu case is special because of the different mirror host paths)21:46
clarkblbragstad: responded, thanks21:46
persia(or, at least I can't see any reason to run separate reprepo jobs for different architectures: the contents don't care which arch is used to copy the files)21:47
*** dave-mccowan has quit IRC21:49
*** david-lyle has joined #openstack-infra21:51
*** VW has joined #openstack-infra21:51
clarkbya, I think ubuntu is mostly weird here which amplifies the reprepro weirdness21:53
*** yamamoto has joined #openstack-infra21:54
*** threestrands has joined #openstack-infra21:54
*** trown|rover is now known as trown|outtypewww21:55
*** VW has quit IRC21:56
*** camunoz has quit IRC21:56
*** jamesmcarthur has quit IRC21:57
openstackgerritMerged openstack-infra/zuul-jobs master: Add role for fetching javascript built content  https://review.openstack.org/55022321:58
persiaThe underlying implementation is that the Ubuntu master repository is mirrored with architecture-specific mirroring (I think it is still ubumirror), to the two separate archive servers, which are then subsequently mirrored out.  Because of the differing paths, it isn't possible to reconstruct an all-architecture mirror of Ubuntu easily.21:59
*** VW has joined #openstack-infra21:59
*** yamamoto has quit IRC21:59
*** owalsh has quit IRC22:03
*** hasharL4D2 is now known as hashar22:03
*** r-daneel_ has joined #openstack-infra22:03
*** r-daneel has quit IRC22:04
*** r-daneel_ is now known as r-daneel22:04
*** jamesmcarthur has joined #openstack-infra22:05
*** owalsh has joined #openstack-infra22:07
openstackgerritMerged openstack-infra/system-config master: Remove note about disabled websockets  https://review.openstack.org/55026622:08
clarkbmordred: so if that was just a race do we need to retrigger the job then we can enable puppet again?22:08
notmynamelol @ the mtreinish cloud provider ;-)22:08
clarkbnotmyname: he keeps telling me he wants to do it :)22:10
mordredclarkb: as soon as the 550225 lands, yeah22:10
*** ykarel has joined #openstack-infra22:10
openstackgerritMerged openstack-infra/project-config master: Use fetch-javascript-content-tarball role  https://review.openstack.org/55022522:10
mordredclarkb: or - we can just land ...22:10
mordredclarkb: https://review.openstack.org/#/c/548235/22:10
mordredclarkb: which would retrigger the post job22:11
mordredclarkb: what do you think?22:11
* clarkb looks22:11
openstackgerritChris Hoge proposed openstack-infra/project-config master: Remove k8s-openstack-provider jobs for repo refresh.  https://review.openstack.org/55027122:11
mtreinishclarkb, notmyname: I totally do. I think it'd be cool to have my name on the infra donors list22:12
clarkbmordred: done22:12
mordredclarkb: woot22:12
mordredclarkb: fingers crossed we got all the pieces this time22:12
*** owalsh has quit IRC22:13
*** david-lyle has quit IRC22:13
*** owalsh has joined #openstack-infra22:13
*** esberglu has quit IRC22:13
*** kjackal has joined #openstack-infra22:14
ianwmmm, i guess reprepo managed to corrupt itself when it ran out of quota, it seems stuck.  time to pull out the recovery stuff22:14
hogepodgeclarkb: first two patches to clear out the old k8s-cloud-provider repo are up. One stops zuul gating, the other clears out the repository. https://review.openstack.org/#/c/548319/1 https://review.openstack.org/#/c/550271/22:20
*** rcernin has joined #openstack-infra22:20
*** claudiub has quit IRC22:20
*** claudiub has joined #openstack-infra22:21
wolverineavhey! i'm seeing an error tox-py27 in networking-bigswitch project which seems to be a non-code issue. review request here: https://review.openstack.org/#/c/550197/ and excerpt of the log here: http://paste.openstack.org/show/693470/22:22
wolverineavwould be glad if someone can point me where to look at. this is the error message seen: Error when trying to get requirement for VCS system Command "git config --get-regexp remote\..*\.url" failed with error code 122:22
ianwwolverineav: i think the root cause is  "tools/pretty_tox.sh: 6: tools/pretty_tox.sh: subunit-trace: not found"22:23
wolverineavianw: ah, i see. that's kinda strange, since subunit-trace is not a requirement or test-requirement for the project. let me try to "trace" it :)22:25
mordredianw, wolverineav I'd suggest just updating the repo to use stestr at this point ...22:25
ianwwhy is it running on trusty?22:25
hogepodgeclarkb: whoops meant these two https://review.openstack.org/#/c/550271/ https://review.openstack.org/#/c/550267/22:25
mordredmtreinish: is there a good guide/doc somewhere about that migration?22:25
mordredoh - you already have an .stestr config ...22:27
hogepodgeclarkb: dims is planning on getting the changed merged upstream, and once he's ready I'll create a github project from the original openstack project, do a "git merge --allow-unrelated-histories" to pull in the full history of the new project, then you should be able to load it in from my github account with the full old and new histories intact.22:27
clarkbhogepodge: reivewed the project-config chnage22:28
*** suhdood has quit IRC22:29
mordredwolverineav: https://review.openstack.org/550280 Migrate to stestr22:29
wolverineavhmm..i'm probably out of loop on some major shift in the zuul test in past fortnight. it was working before that.22:30
*** david-lyle has joined #openstack-infra22:30
openstackgerritChris Hoge proposed openstack-infra/project-config master: Remove k8s-openstack-provider jobs for repo refresh.  https://review.openstack.org/55027122:30
mordredwolverineav: I'm not sure what specifically would cause this ... potentially a transitive dependency change22:30
openstackgerritMerged openstack-infra/zuul master: Support brew for installing the js tools  https://review.openstack.org/54823522:31
mordredwolverineav: but, in this case, rather than figuring that out, I think it's just easier to go ahead and finish your stestr transition22:31
*** camunoz has joined #openstack-infra22:33
wolverineavmordred: yep, that makes sense. let me try the change you suggested and fix whatever breaks after that in stestr, since that is the way forward :)22:33
*** kjackal has quit IRC22:33
mordredwolverineav: cool - I've got a followup for it real quick - I left somethig out...22:33
wolverineavappreciate the help! ianw, mordred22:33
wolverineavyeah, no worries - i'll first try it out for all branches locally and then merge it in the repo.22:34
mordredwolverineav: updated - let's see if it worksw22:34
*** suhdood has joined #openstack-infra22:34
ianwclarkb: so "gerrit index changes" ?22:36
*** germs has joined #openstack-infra22:36
*** germs has quit IRC22:36
*** germs has joined #openstack-infra22:36
clarkbianw: ya probably start with ^ then use something like https://review.openstack.org/Documentation/cmd-index-start.html#_examples if that isn't sufficient22:38
ianwok, well i'm going to go for it now22:38
*** owalsh has quit IRC22:39
ianwi'll back up /home/gerrit2/review_site/index22:39
clarkb++22:39
*** david-lyle has quit IRC22:40
*** andreas_s has joined #openstack-infra22:41
*** mriedem is now known as mriedem_afk22:41
*** felipemonteiro has joined #openstack-infra22:42
*** owalsh has joined #openstack-infra22:44
mtreinishmordred: it's just creating a .stestr.conf (which normally only needs a test-path entry) and then updating the command in the tox.ini22:46
*** andreas_s has quit IRC22:46
clarkbianw: looks like gerrit is back up again?22:46
ianwyep22:47
*** jrist has quit IRC22:47
ianw[iwienand@fedora19 diary (master)]$ ssh iwienand@review.openstack.org -p 29418 gerrit index start changes22:48
ianwNothing to reindex, index is already the latest version22:48
*** jrist has joined #openstack-infra22:48
clarkbmaybe it is happy ignoring that the nova-specs repo has changed?22:48
clarkbalso have you upgraded from fedora19 thorugh to 27 on a single install? that is impressive22:48
ianwoh yeah, it's just been rolling along :)22:50
*** masber has joined #openstack-infra22:50
ianwnot sure what else to try on gerrit ...22:50
aspiersjust me or did git-review get wayyyy slower for submissions in the last ~6 months?22:51
clarkbianw: maybe open that specific change in gerrit and see that it is browsable?22:51
clarkbaspiers: its related to the size of the project aiui. Nova is slow most other things are not22:51
*** suhdood has quit IRC22:51
aspiersclarkb: I'm seeing it across all projects AFAICS22:51
clarkbI've not noticed anything across all the projects22:51
*** myoung|ruck is now known as myoung|ruck|off22:52
aspiersI'll wrap it in time(1) from now on and try to quantify22:52
clarkbaspiers: you might double check that you don't have broken ipv6 that is having to fall back on ipv4 or something like that22:52
aspiersthat's entirely possible22:52
clarkbianw: and that you cna search for the change?22:53
clarkbianw: but if gerrit is happy with the change then its probably fine22:53
wolverineavmordred, ianw: that worked :D thanks again!22:54
ianwhttps://review.openstack.org/#/c/463526/ ... so it seems like maybe the only issue is that you can't do a diff between revisions [2-9]22:54
mordredwolverineav: woot!22:54
clarkbianw: which makes sense becuase those refs were deleted. And chances are you couldn't do the diffs before because the refs were corrupted22:55
mtreinishmordred: fwiw there is a script in the stestr repo: https://github.com/mtreinish/stestr/blob/master/tools/testr_to_stestr.py22:55
*** masuberu has joined #openstack-infra22:55
*** yamamoto has joined #openstack-infra22:56
ianwclarkb: yeah, looks like it puts an error into error_log, but otherwise continues on22:56
clarkbianw: and now we wait to see if replication is working again? thats it I suppose22:56
*** e0ne has quit IRC22:57
*** hashar has quit IRC22:57
*** masber has quit IRC22:59
clarkbianw: task queue count is slowly going down so that seems to be working too23:01
*** hashar has joined #openstack-infra23:02
*** yamamoto has quit IRC23:02
ianwyep, i'm watching it, going through "p" for puppet's23:05
*** danpawlik has quit IRC23:05
*** germs has quit IRC23:05
*** yamamoto has joined #openstack-infra23:06
*** ykarel has quit IRC23:07
ianwhang on, i have a lot on my mind right now, n actually comes before p ...23:09
ianw[2018-03-06 22:44:19,036] [cd0b85f9] Replication to file:///opt/lib/git/openstack/nova-specs.git completed in 6410ms, 15864ms delay, 0 retries23:09
ianwok, ignore me.  "openstack-infra/" comes before "openstack/", and that's the fs sync.  so it's not done yet23:12
clarkbgerrit show-queue -w | grep nova-spec is roughly what I have running now23:13
*** slaweq has quit IRC23:13
ianwcool, just tailing the replication log | grep github23:15
openstackgerritMonty Taylor proposed openstack-infra/puppet-zuul master: Update zuul-web install for javascript stack  https://review.openstack.org/54960823:16
mordredianw, clarkb: WOOT: http://tarballs.openstack.org/zuul/zuul-content-latest.tar.gz exists and has the correct content23:16
mordredianw, clarkb: (fwiw, it's an unrooted tarball, so be careful untarring it anywhere)23:17
clarkbmordred: can we fix that? or is that the right way to do js?23:17
mordredclarkb: it's just the way the webpack ArchivePlugin does things - I've got it using -C in the untar command in the puppet change23:17
clarkbthats annoying. tarbombs are evil23:18
mordredyah. I agree23:18
mordredclarkb: so - now that that's there - I was planning on taking the puppet-zuul patch above, pulling it down on to zuul01, running puppet apply by hand and watching the output23:20
pabelangerclarkb: ianw: mordred: mind a +3 on https://review.openstack.org/550235/ to start testing wheel bulids on bionic23:20
mordredclarkb: does that seem like a reasonable next step? or do you think we should do something else?23:20
clarkbmordred: seems resonable and if that works we remove it from the emergency file ya?23:20
*** hashar has quit IRC23:21
*** agopi has quit IRC23:21
pabelangerianw: thanks23:21
ianw++23:23
ianwyou also want to reset /opt/zuul to HEAD^ and pip3 re-install it.  although, i should remove yarn etc first so the setup hooks don't run23:24
clarkbnova specs has replicated to some of our git.o.o hosts at this point23:25
mordredclarkb: yah23:26
*** david-lyle has joined #openstack-infra23:26
openstackgerritMerged openstack-infra/project-config master: Bring wheel builder for ubuntu-bionic online  https://review.openstack.org/55023523:27
ianwok, nodejs & yarn & .repo files removed from zuul0123:27
mordredwoot23:27
*** felipemonteiro has quit IRC23:27
*** aeng has joined #openstack-infra23:27
*** stakeda has joined #openstack-infra23:29
mordredianw, clarkb: I guess replication to git.o.o should be expected to be behind atm yeah?23:29
clarkbmordred: yes ~6k replication events remaining23:29
mordredkk23:30
mordredjustmaking sure :)23:30
clarkbdown from 12k when I first started checking23:30
clarkbso its moving23:30
clarkbgithub sycning is doing the charm repos23:33
pabelangerhmm23:35
pabelangerstream.html is giving proxy error23:35
pabelangerhttps://zuul.openstack.org/stream.html?uuid=0af2c211eed8412a89af0aea3b2573ed&logfile=console.log23:35
pabelangerokay, guess we are doing something on zuul.o.o23:35
mordredsorry - that's me23:36
pabelangernp, just seen backscroll23:36
clarkbgithub syncing lags behind the rest of it (which isn't surprising) makes me impatient23:36
*** tosky has quit IRC23:37
*** gouthamr_ has quit IRC23:38
mordredhrm. I think something is wrong with teh rewrite rules :23:38
mordredok. I'm going to revert and figureout out somewhere that isn't production23:40
*** r-daneel has quit IRC23:40
*** david-lyle has quit IRC23:42
clarkbone advantage to renaming projects we retire is we could stop replicating them too. Unfortunately the cost of renaming is so high23:43
clarkbgithub syncing now past charms23:45
*** eernst has quit IRC23:45
*** hongbin has quit IRC23:45
*** eernst has joined #openstack-infra23:45
*** jamesmcarthur has quit IRC23:46
*** eernst_ has joined #openstack-infra23:48
*** eernst has quit IRC23:48
mordredclarkb: ok. zuul-web reverted to previous working state23:50
ianwpabelanger: i think i'm just going to restart the ubuntu-ports mirror.  my recovery steps aren't working and i dont' want to sink more time on it23:51
ianwit'll clone faster than me keeping fiddling23:51
mordredclarkb: I'm going to need to do some more digging to figure out why it was unhappy - I'm 99% sure it was something off with the rewrite rules23:51
openstackgerritMonty Taylor proposed openstack-infra/puppet-zuul master: Update zuul-web install for javascript stack  https://review.openstack.org/54960823:51
mordredI did find one bug in the puppet - which is fixed there ^^23:52
pabelangerianw: wfm23:52
mordredother than that - the puppet did the things we want it to do - so once rewrite rules are fixed, it *should* be good to go23:52
*** caphrim007 has joined #openstack-infra23:53
*** eernst_ has quit IRC23:53
clarkbnow syncing all the deb repos23:53
*** eernst has joined #openstack-infra23:55
*** pahuang has joined #openstack-infra23:55
*** eernst has quit IRC23:56
*** eernst has joined #openstack-infra23:56
openstackgerritJohn Dickinson proposed openstack-infra/project-config master: added swiftstack/ProxyFS project to zuul config to enable testing  https://review.openstack.org/54890923:57
openstackgerritMatt Riedemann proposed openstack-infra/project-config master: Remove legacy-tempest-dsvm-cells job usage  https://review.openstack.org/54978523:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!