Saturday, 2019-08-03

*** aaronsheffield has quit IRC00:01
*** Goneri has quit IRC00:01
*** roman_g has quit IRC00:02
*** mattw4 has quit IRC00:06
*** betherly has joined #openstack-infra00:07
*** betherly has quit IRC00:12
*** igordc has quit IRC00:28
*** markvoelker has joined #openstack-infra00:28
*** markvoelker has quit IRC00:32
*** jamesmcarthur has joined #openstack-infra00:34
*** betherly has joined #openstack-infra00:38
*** igordc has joined #openstack-infra00:41
*** betherly has quit IRC00:43
*** jamesmcarthur has quit IRC00:46
*** gyee has quit IRC00:55
*** michael-beaver has quit IRC00:55
*** rh-jelabarre has joined #openstack-infra01:09
*** jamesmcarthur has joined #openstack-infra01:11
*** slaweq has joined #openstack-infra01:11
*** yamamoto has joined #openstack-infra01:14
*** slaweq has quit IRC01:15
*** betherly has joined #openstack-infra01:20
*** betherly has quit IRC01:24
*** yamamoto has quit IRC01:25
*** yamamoto has joined #openstack-infra01:27
*** betherly has joined #openstack-infra01:30
*** betherly has quit IRC01:35
*** jamesmcarthur has quit IRC01:35
*** logan- has quit IRC01:43
*** logan- has joined #openstack-infra01:46
*** igordc has quit IRC01:50
*** kjackal has joined #openstack-infra01:51
*** happyhemant has quit IRC01:52
*** kjackal has quit IRC01:59
*** lseki has quit IRC01:59
*** betherly has joined #openstack-infra02:01
*** markvoelker has joined #openstack-infra02:02
*** betherly has quit IRC02:06
*** markvoelker has quit IRC02:07
*** apetrich has quit IRC02:08
*** Lucas_Gray has quit IRC02:10
*** rascasoft has quit IRC02:10
*** rascasoft has joined #openstack-infra02:14
*** yamamoto has quit IRC02:18
*** betherly has joined #openstack-infra02:21
*** owalsh has quit IRC02:24
*** betherly has quit IRC02:26
*** jamesmcarthur has joined #openstack-infra02:34
*** yamamoto has joined #openstack-infra02:34
*** rh-jelabarre has quit IRC02:36
*** armax has quit IRC02:39
*** yamamoto has quit IRC02:40
*** yamamoto has joined #openstack-infra02:41
*** betherly has joined #openstack-infra02:42
*** yamamoto has quit IRC02:42
*** yamamoto has joined #openstack-infra02:43
*** betherly has quit IRC02:47
*** yamamoto has quit IRC02:49
*** yamamoto has joined #openstack-infra03:02
*** betherly has joined #openstack-infra03:02
*** jistr has quit IRC03:04
*** rfolco|ruck has quit IRC03:06
*** betherly has quit IRC03:08
*** slaweq has joined #openstack-infra03:11
*** yamamoto has quit IRC03:12
*** yamamoto has joined #openstack-infra03:14
*** slaweq has quit IRC03:16
*** jistr has joined #openstack-infra03:19
*** betherly has joined #openstack-infra03:23
*** guoqiao has joined #openstack-infra03:27
*** betherly has quit IRC03:28
clarkbthe vos release is still running03:32
clarkbI'll have to check it in the morning03:32
*** markvoelker has joined #openstack-infra03:32
*** yamamoto has quit IRC03:34
*** markvoelker has quit IRC03:37
*** yamamoto has joined #openstack-infra03:39
*** michael-beaver has joined #openstack-infra03:53
*** jamesmcarthur has quit IRC04:00
*** markvoelker has joined #openstack-infra04:36
*** ricolin has joined #openstack-infra04:36
*** yamamoto has quit IRC04:39
*** owalsh has joined #openstack-infra04:42
*** ricolin has quit IRC04:56
*** markvoelker has quit IRC04:59
*** slaweq has joined #openstack-infra05:11
*** whoami-rajat has joined #openstack-infra05:13
*** slaweq has quit IRC05:15
*** yamamoto has joined #openstack-infra05:24
*** Lucas_Gray has joined #openstack-infra05:24
*** owalsh_ has joined #openstack-infra05:26
*** owalsh has quit IRC05:27
*** owalsh_ has quit IRC05:31
*** owalsh has joined #openstack-infra05:33
*** yamamoto has quit IRC05:38
*** yamamoto has joined #openstack-infra05:38
*** yamamoto has quit IRC06:02
*** michael-beaver has quit IRC06:03
*** yamamoto has joined #openstack-infra06:04
*** slaweq has joined #openstack-infra06:11
*** slaweq has quit IRC06:16
*** yamamoto has quit IRC06:27
*** yamamoto has joined #openstack-infra06:29
*** guoqiao has quit IRC06:36
*** yamamoto has quit IRC06:48
*** yamamoto has joined #openstack-infra06:52
*** markvoelker has joined #openstack-infra07:02
*** markvoelker has quit IRC07:07
*** yamamoto has quit IRC07:15
*** whoami-rajat has quit IRC07:23
*** Lucas_Gray has quit IRC07:30
*** Lucas_Gray has joined #openstack-infra07:31
*** yamamoto has joined #openstack-infra07:37
*** yamamoto has quit IRC07:38
*** yamamoto has joined #openstack-infra07:45
*** markvoelker has joined #openstack-infra07:52
*** yamamoto has quit IRC07:52
*** markvoelker has quit IRC07:56
*** slaweq has joined #openstack-infra08:11
*** e0ne has joined #openstack-infra08:37
*** e0ne has quit IRC08:39
*** dciabrin_ has joined #openstack-infra08:42
hrwfungi: thanks for 'buster-backports' repo. 'buster-updates' is still missing (it is empty for now but 'debian-buster' nodes have it in apt config)08:50
*** yamamoto has joined #openstack-infra08:57
*** markvoelker has joined #openstack-infra08:57
*** yamamoto has quit IRC09:05
*** guoqiao has joined #openstack-infra09:06
*** Lucas_Gray has quit IRC09:10
*** yamamoto has joined #openstack-infra09:13
*** yamamoto has quit IRC09:15
*** yamamoto has joined #openstack-infra09:22
*** yamamoto has quit IRC09:25
*** yamamoto has joined #openstack-infra09:26
*** markvoelker has quit IRC09:26
*** slaweq has quit IRC09:37
*** yamamoto has quit IRC09:38
*** gsantomaggio has quit IRC09:43
*** sparkycollier has quit IRC09:43
*** crodriguez has quit IRC09:43
*** gsantomaggio has joined #openstack-infra09:43
*** sparkycollier has joined #openstack-infra09:43
*** crodriguez has joined #openstack-infra09:43
*** serverascode has quit IRC09:43
*** rajinir has quit IRC09:43
*** seyeongkim has quit IRC09:43
*** zxiiro has quit IRC09:44
*** mnaser has quit IRC09:44
*** jroll has quit IRC09:44
*** guilhermesp has quit IRC09:44
*** ildikov has quit IRC09:44
*** fnordahl has quit IRC09:44
*** tonyb[m] has quit IRC09:44
*** clayg has quit IRC09:44
*** Ng has quit IRC09:44
*** cmurphy has quit IRC09:44
*** guilhermesp has joined #openstack-infra09:47
*** clayg has joined #openstack-infra09:47
*** zxiiro has joined #openstack-infra09:48
*** fnordahl has joined #openstack-infra09:53
*** jroll has joined #openstack-infra09:59
*** rajinir has joined #openstack-infra09:59
*** seyeongkim has joined #openstack-infra09:59
*** Ng has joined #openstack-infra09:59
*** serverascode has joined #openstack-infra09:59
*** yamamoto has joined #openstack-infra09:59
*** mnaser has joined #openstack-infra09:59
*** ildikov has joined #openstack-infra09:59
*** yamamoto has quit IRC10:00
*** yamamoto has joined #openstack-infra10:02
*** yamamoto has quit IRC10:07
*** guoqiao has quit IRC10:14
*** yamamoto has joined #openstack-infra10:20
*** yamamoto has quit IRC10:21
*** yamamoto has joined #openstack-infra10:24
*** whoami-rajat has joined #openstack-infra10:29
*** yamamoto has quit IRC10:52
*** e0ne has joined #openstack-infra10:56
*** slaweq has joined #openstack-infra11:02
*** aedc has quit IRC11:04
*** yamamoto has joined #openstack-infra11:05
*** slaweq has quit IRC11:07
*** slaweq has joined #openstack-infra11:19
*** tosky has joined #openstack-infra11:20
*** markvoelker has joined #openstack-infra11:23
*** e0ne has quit IRC11:23
*** slaweq has quit IRC11:23
*** markvoelker has quit IRC11:27
*** slaweq has joined #openstack-infra11:44
*** Lucas_Gray has joined #openstack-infra12:02
*** slaweq has quit IRC12:04
*** markvoelker has joined #openstack-infra12:09
*** aedc has joined #openstack-infra12:10
*** aedc has quit IRC12:10
*** aedc has joined #openstack-infra12:10
*** Lucas_Gray has quit IRC12:15
*** Lucas_Gray has joined #openstack-infra12:23
*** e0ne has joined #openstack-infra12:29
*** markvoelker has quit IRC12:32
*** e0ne has quit IRC12:34
*** e0ne has joined #openstack-infra12:34
*** e0ne has quit IRC12:35
*** whoami-rajat has quit IRC12:43
fungii'll see if there's something we need to either add to the mirrors or subtract from the node configs12:53
fungiyeah, looks like it's populated but unused so far on official debian mirrors, so we should be able to add it now12:56
*** yamamoto has quit IRC12:58
*** yamamoto has joined #openstack-infra13:02
*** bobh has joined #openstack-infra13:06
fungioh, i see the problem13:09
fungibecause reprepro is designed for partial mirroring it uses the official packages lists to decide what to mirror and then builds its own package lists13:13
fungibut on the upstream mirrors, buster-updates has no packages in it yet13:13
fungii wonder if reprepro has an option to create empty suites13:13
*** bobh has quit IRC13:15
*** betherly has joined #openstack-infra13:18
*** Lucas_Gray has quit IRC13:25
*** Lucas_Gray has joined #openstack-infra13:28
*** whoami-rajat has joined #openstack-infra13:35
*** slaweq has joined #openstack-infra13:35
*** roman_g has joined #openstack-infra13:35
donnydfungi: So I got glance-cinder working this morning, and I am wondering where I change the value to upload in raw format. I was looking for a way to just have glance convert it for me to save bw, but I don't have time to dig into it today13:38
*** cmurphy has joined #openstack-infra13:38
*** betherly has quit IRC13:52
*** betherly has joined #openstack-infra13:53
*** jtomasek has joined #openstack-infra13:53
*** betherly has quit IRC13:57
*** roman_g has quit IRC13:58
*** yamamoto has quit IRC14:02
*** yamamoto has joined #openstack-infra14:02
fungidonnyd: https://opendev.org/opendev/system-config/src/branch/master/playbooks/templates/clouds/nodepool_builder_clouds.yaml.j2#L19114:04
*** jhesketh has quit IRC14:06
donnydthanks fungi14:08
donnydI was looking in bridge_all_clouds, and then saw a squirrel14:08
openstackgerritDonny Davis proposed opendev/system-config master: Swap FN image to raw for glance-cinder backend  https://review.opendev.org/67445714:11
fungikeep in mind that's going to mean longer upload times compared to qcow2 (due to lack of compression)14:18
*** jtomasek has quit IRC14:21
donnydIt will, however it should translate to better performance for instance launch times. File store performance is very poor14:23
donnydand this should allow for very fast cloning like ceph does14:24
donnydand my fix yesterday setting the max_cocurrent_builds in nova surely fixed a major issue when nodepool decides it wants to launch 60 vms at the same time.14:25
donnydit just did that, and everything went off without a hitch14:25
donnydit seems that it only pukes up errors when new images are uploaded, so the hope is that this request will fix the issue.14:28
*** markvoelker has joined #openstack-infra14:29
*** betherly has joined #openstack-infra14:29
fungisound reasonable14:30
fungier, sounds14:30
donnydThis method should allow me to pay for the upload once, and then have very fast launch times14:33
*** betherly has quit IRC14:34
rm_workis the docs job freaking out? https://logs.opendev.org/87/673687/5/check/openstack-tox-docs/7310a39/job-output.txt.gz#_2019-08-03_14_35_06_60718914:40
rm_workA) that file (octavia/api/drivers/amphora_driver/v1/driver.py) isn't in our patch14:41
rm_workB) there IS no docstring for that method, so it isn't possible for it to be indented wrong: https://review.opendev.org/gitweb?p=openstack/octavia.git;a=blob;f=octavia/api/drivers/amphora_driver/v1/driver.py;h=6eb43530b3fffae4805bf991060ee6941fbde89a;hb=fb5d7d1120e3d92b5a52f53fcac9e0c30f3b0ddc#l5314:41
rm_worksome bad sphinx release maybe? will have to dive in and start checking older ones14:42
*** aedc has quit IRC14:48
*** altlogbot_3 has quit IRC14:48
*** aedc has joined #openstack-infra14:50
fungii agree with your assessment, am trying to reproduce locally on my workstation now in hopes of narrowing it down14:50
*** altlogbot_2 has joined #openstack-infra14:51
fungirm_work: yeah, it reproduces locally for me with `tox -e docs` on master branch tip of openstack/octavia14:52
rm_workso yeah14:53
rm_worknot ideal T_T14:53
rm_worktrying older versions of sphinx14:53
rm_workneed to look and see if it recently had a release14:53
rm_workwish there was a "releases for package versions I have installed that happened in the last <x> days" script :D14:54
fungisdague wrote one for devstack, ages ago14:54
rm_workyeah i guess i could write one14:54
rm_workgrab all deps, query pypi for info for that version, compare date14:54
AJaegersphinx 2.1.2 is out since mid-June14:55
rm_workyeah it's not that14:55
AJaegerdo you know when it worked last time?14:55
rm_worktested with a much older one too14:55
rm_workerm, let me find out14:55
AJaegeryou could compare log files, they include versions (just difficult to parse)14:55
fungiso... actually we basically do have what you're asking about, except it's not a script, it's the git history of the upper-constraints.txt file in openstack/requirements (because this job is using constraints)14:56
rm_workproven working on Aug 2 7:51 AM14:56
fungiit's just not filtered down to octavia's transitive requirements set14:56
* AJaeger can reproduce as well14:56
rm_workso like, the last one day14:56
rm_workyeah i was just going to go look at that14:56
fungibut if all you need to look at is 1.5 days of constraints patches, that may be fast14:56
rm_workyes, there's two14:57
rm_workbut they don't look especially relevant14:57
AJaegeroctavia-lib was the most recent change ;)14:57
rm_workyes14:57
rm_workbut that shouldn't affect docs?14:58
rm_worki can ratchet it down and see14:58
AJaegerwe released openstackdocstheme on Monday14:58
rm_worktesting with older octavia-lib14:58
AJaegerhttp://zuul.opendev.org/t/openstack/builds?job_name=openstack-tox-docs&project=openstack%2Foctavia14:59
AJaegershows that only the most recent run fails14:59
rm_workah neat14:59
AJaegereverything before that passed...14:59
AJaegerrm_work: that should give you two times for disection quickly ;)14:59
rm_workso, with octavia-lib downgraded, it passes -- wtf? how is that possible?15:00
rm_workthe error is with a file in the main octavia project15:00
*** betherly has joined #openstack-infra15:00
rm_workand octavia-lib itself has a docs job, which passes15:01
rm_workO_o15:01
AJaegerrm_work: but it gets includes into your build via requirements, so could effect it in strange ways...15:01
openstackgerritJames E. Blair proposed opendev/base-jobs master: Add zuul manifest role to swift base job  https://review.opendev.org/67445915:02
fungicould the module in octavia be getting shadowed?15:02
rm_workhmmmm15:02
rm_workthat's possible15:02
AJaegerthere's octavia_lib/api/drivers/provider_base.py which has the same function15:03
AJaegercreate_vip_port15:03
*** markvoelker has quit IRC15:03
fungiindeed15:04
fungiit has a docstring15:04
AJaegerrm_work: let's try reverting https://review.opendev.org/#/c/664510/15:04
fungiand line 10 of that docstring is indented15:04
fungiwhich aligns with the error15:04
*** betherly has quit IRC15:04
rm_workwait what? line 10 is? THAT I'm not seeing15:05
AJaegerrm_work: octavia_lib/api/drivers/provider_base.py15:05
rm_workyeah i'm there15:05
fungihttps://opendev.org/openstack/octavia-lib/src/branch/master/octavia_lib/api/drivers/provider_base.py#L3715:05
fungithat's line 10 of the docstring for that method15:05
* AJaeger removes the docstring from octavia_lib/api/drivers/provider_base.py now and will intall in my venv - and the nrun sphinx-build again...15:05
rm_workoh what, that's totally different than what I have locally, lol, sec15:06
rm_worki thought this was up to date15:06
rm_workok now i see it, yeah15:07
rm_workhmmm15:07
fungiwell, technically we should check the state of that docstring as of the most recent tag that got updated in constraints, but i'm surmising (without confirming) that it's basically the same as master15:07
AJaegeryep, that fixes it15:07
rm_workyeah it most likely is15:07
*** Lucas_Gray has quit IRC15:07
rm_workso why doesn't that fail the docs job *in that repo*15:08
AJaegerrm_work: so, look at the docstring in ocatavia_lib and figure out what's happening ;)15:08
fungidoes the docs job in that repo build autodoc content?15:08
* AJaeger runs tox -e docs in octavia-lib now15:08
rm_workyeah i am too it just takes a min, my VPN is slow15:08
AJaegerfungi: good question15:08
rm_workif not, it needs to be sync'd to the same settings as the main repo so this never happens again15:09
fungiyeah, i recommend diffing the doc/source/conf.py to be sure15:09
AJaegerthere's quite a diff for autodoc...15:09
rm_workyeah there is15:10
AJaegeroctavia uses sphinxcontrib.apidoc, octava-lib not15:10
AJaegerthat might be the difference...15:10
fungithat's almost guaranteed to be what happened then15:11
fungibroken docstring merged to octavia-lib untested (due to lack of autodoc extension in octavia-lib's sphinx config), octavia-lib released, requirements updates constraints, octavia docs builds start importing new octavia-lib shadowing local methods, sphinx autodoc asplodes15:12
rm_worktesting15:12
rm_workok yeah15:15
rm_workadded that module, added the config for it, now it fails with the "correct" error15:15
fungiyep, and locally editing that docstring under .tox/docs/lib/python?.?/site-packages/octavia_lib/api/drivers/provider_base.py to unindent gets octavia docs builds succeeding for me15:17
fungiso at least the patch to octavia-lib should be just adding autodoc extension and cleaning up that one docstring15:17
fungibut you'll need another point release tagged and constraints bumped again15:18
AJaegerrm_work: want to do the change or sohuld fungi or myself do it and you review? ;)15:18
AJaegerI think we're all at the same place with our group debugging ;)15:18
rm_worki've got most of it15:19
rm_workbut15:19
fungii expect rm_work can also just propose it and self-approve as an emergency fix (i have no idea what octavia's conventions are around that)15:19
rm_worknow i ran into -- if i add that module, it creates a thing, and then complains that it isn't used, lol15:19
AJaegerrm_work: I'm past that - you need to add to toctree somewhere15:20
rm_workk15:20
rm_workthen maybe just do yours15:20
rm_workmine looks like this:15:20
fungiyep, it can be a hidden toctree entry too if you need15:20
rm_workhttp://paste.openstack.org/show/755354/15:20
rm_workthat's how far i'd gotten15:20
rm_workassuming you have everything there (or possibly even a more correct version), go ahead and post it :D15:21
rm_workthen I'll feel better about a direct +A :)15:21
AJaegerrm_work: give me 5 mins ;)15:21
rm_workno worries15:22
AJaegerpasses for me - now cleanup and commit message15:22
rm_workugh now we need to merge this -> do another release -> do another u-c change15:23
rm_worksuch a long pipeline T_T15:23
rm_workoctavia-lib 1.3.1 here we come15:23
*** snierodz has quit IRC15:23
*** clarkb has quit IRC15:23
*** paladox has quit IRC15:24
*** roman_g has joined #openstack-infra15:26
AJaegerrm_work, fungi , https://review.opendev.org/67446015:27
* AJaeger declared it as team work ;)15:27
rm_worklol15:28
*** paladox has joined #openstack-infra15:28
* AJaeger changed two lines to many, update coming15:29
AJaegerrm_work: I'll send a followup with cleanup, I noticed a few problems, you might want to check your other repos for that followup as well...15:29
rm_workhmmm k15:29
rm_workI doubt anyone has looked at the docs stuff for longer than absolutely necessary to make them "function" in a way that seemed to produce readable docfiles15:31
*** betherly has joined #openstack-infra15:31
AJaegerrm_work: you use storyboad but the "report a bug URL" still points to launchpad, I'll update...15:31
rm_workhah15:31
rm_workeugh, i kinda wish we did just still use launchpad... <_<15:31
rm_workwe considered un-migrating :(15:31
*** snierodz has joined #openstack-infra15:32
rm_workin denver we got some good discussion time in with the storyboard folks and i came out of it hopeful but actually trying to implement those suggestions dashed my hopes for now15:32
AJaeger;(15:33
AJaegerhttps://review.opendev.org/674461 is followup, other repos might need that kind of change as well (not checked - I leave that to you ;)15:33
rm_workyeah, thanks, I will try to remember to do that :D15:33
rm_workwill probably +A this once tests pass15:34
rm_workand propose a release...15:35
rm_workdon't suppose one of you are on the releases team :D15:35
AJaegernope15:35
*** betherly has quit IRC15:35
funginot really, no15:35
rm_workk, then i'll just let that sit for the weekend I guess15:36
fungiwell, some of them may be around in #openstack-release when you're ready15:36
AJaegerfungi: do you still have time for a boring review? Just remove some jobs that are in-tree now, please? https://review.opendev.org/67434015:37
*** clarkb has joined #openstack-infra15:37
AJaegerrm_work: 674460 passed tests15:37
fungisure, i've got a sec before my wife notices i'm working ;)15:37
rm_workyep15:37
rm_work+A'd15:37
AJaegerfungi, then wait until Monday ;)15:38
rm_worklol15:38
rm_workyeah was wondering what ya'll are doing working on a weekend ;)15:38
fungiit's approved, was simple enough15:38
AJaegerrm_work: want to take the storyboard URL fix as well?15:38
AJaegerthanks, fungi15:38
AJaegerhiding ;)15:38
rm_workyes but it's less urgent15:38
rm_workI guess including it in the release wouldn't be bad tho15:38
rm_workbut i do see it works, so15:39
rm_workyeah why not15:39
AJaegerthat was my thinking - bu wait - we publish docs after each release, so can wait...15:39
* AJaeger was too slow ;)15:40
fungiyep, the draft for that one checks out15:40
AJaegerfungi, rm_work, hae a great weekend!15:40
rm_workyep you too :)15:40
fungithanks, you too AJaeger!15:40
AJaegerthanks15:41
*** hamzy has quit IRC15:41
corvusmnaser: how do i determine the access_key / secret_key to use with the vexxhost s3 api?15:42
*** roman_g has quit IRC15:42
*** tosky has quit IRC15:43
openstackgerritMerged openstack/project-config master: Remove in-tree jobs for neutron-classifier  https://review.opendev.org/67434015:44
AJaegerrm_work: have a look at https://docs.openstack.org/octavia/latest/contributor/modules/octavia.api.drivers.amphora_driver.v1.html15:46
AJaegerthat is the create_vip_port documentation - taken from octavia-lib ;(15:46
AJaegerso, that's still a problem for you to figure out, mayboe stephenfin has an idea why the docstring from octavia-lib shows up in octavia15:47
*** rkukura has quit IRC15:47
rm_workyeah I'm not getting it -- the function name is the same, but the file/class is totally different?15:48
rm_workI feel like having similar function names is not a new thing <_<15:49
rm_workah hmm maybe the class is the same15:49
rm_workoh15:49
rm_workmaybe that's SUPPOSED to happen15:49
rm_workit's the base class :D15:49
rm_workso it inherits the docstrings15:49
rm_workthat makes sense to me15:50
rm_worksomehow didn't catch that at first15:50
*** betherly has joined #openstack-infra15:51
AJaegerAh! "Bases: octavia_lib.api.drivers.provider_base.ProviderDriver"15:53
AJaegerso, all fine ;)15:53
*** paladox has quit IRC15:54
*** paladox has joined #openstack-infra15:54
*** whoami-rajat has quit IRC15:54
*** armax has joined #openstack-infra15:56
*** betherly has quit IRC15:56
*** jamesmcarthur has joined #openstack-infra16:01
rm_workugh this patch is STUCK >_<16:03
rm_workbeen sitting here just waiting for it to merge so i can hit enter on the review for the release...16:03
rm_workit's stuck in "waiting" T_T16:03
*** jamesmcarthur has quit IRC16:06
corvusrm_work: what do you mean?  where do you see "waiting"?16:07
rm_workof course it finally kicks off :)16:07
*** hamzy has joined #openstack-infra16:07
rm_workit was the pep8 job16:07
rm_workthe other two had finished already16:07
fungiahh, pep8 was waiting for a node allocation i guess. possible something happened to its initial build and it had to be requeued16:08
rm_workjust took ... 27 minutes to start16:08
rm_workT_T16:08
fungilooks like it merged now16:08
rm_workyep :)16:09
rm_workand kicked the release patch16:09
rm_workhttps://review.opendev.org/#/c/674463/16:09
fungiyeah, saw it pop up in #openstack-release16:10
rm_workI miss the little graphs at the bottom of the zuul status page that showed the queues16:11
rm_worki assume they still exist somewhere else16:12
*** betherly has joined #openstack-infra16:12
*** armax has quit IRC16:13
corvushttp://grafana.openstack.org/d/T6vSHcSik/zuul-status?orgId=116:13
*** markvoelker has joined #openstack-infra16:15
*** yamamoto has quit IRC16:16
*** yamamoto has joined #openstack-infra16:17
*** betherly has quit IRC16:17
rm_worknice16:17
rm_workthe display on the status page was really convenient tho :D but maybe too much extra load on something somewhere?16:18
* rm_work shrugs16:18
rm_workwell, since the release team prolly won't get to that for a bit, i'm gonna crash. thanks ya'll for the help :)16:19
*** yamamoto has quit IRC16:22
fungihave a good rest of your weekend rm_work!16:25
*** markvoelker has quit IRC16:26
rm_workyou too o/16:26
*** markvoelker has joined #openstack-infra16:32
*** betherly has joined #openstack-infra16:33
*** jtomasek has joined #openstack-infra16:34
*** markvoelker has quit IRC16:37
*** betherly has quit IRC16:38
*** factor has quit IRC16:42
donnydfungi: is there a way to get nodepool to have one of each image type always in ready (or at least mostly)16:49
*** betherly has joined #openstack-infra16:53
corvusdonnyd: there is, but it applies to the whole system, so it may end up on any provider (ie, if there's a ready node in rax, then nodepool won't make one in fn).  depending on what you want to accomplish, we could add a new label that's only on fn.  that would let us have one ready node all the time (but these nodes wouldn't actually get used by zuul because of the unique label)16:53
*** hamzy has quit IRC16:54
*** hamzy has joined #openstack-infra16:54
*** betherly has quit IRC16:58
*** roman_g has joined #openstack-infra17:13
*** whoami-rajat has joined #openstack-infra17:13
*** betherly has joined #openstack-infra17:14
*** hamzy has quit IRC17:16
*** rascasoft has quit IRC17:17
*** betherly has quit IRC17:18
*** rascasoft has joined #openstack-infra17:19
*** roman_g has quit IRC17:21
donnydI c, so there is no way to get nodes ready in advance for zuul to speed up job start times because of the labels17:22
*** yolanda has quit IRC17:22
fungilike to prime nova or cinder image caching?17:26
donnydwell with the cinder backend for glance, the image caching should happen at image load time17:30
donnydbut i haven't gotten that far to see what it does yet.17:31
donnydmy last hypervisor just showed up, so i am running that through its battery of testing before putting it in system17:31
donnydbut if images are still cached it would be super helpful to prime the pump17:32
*** Goneri has joined #openstack-infra17:33
donnydif anyone else has time to review https://review.opendev.org/#/c/674457/ so I can make sure its running well before monday that would be super helpful17:34
donnydI guess i will check out the cinder backend for glane and make sure nova actually boots17:35
*** Goneri has quit IRC17:38
*** ricolin has joined #openstack-infra17:43
*** betherly has joined #openstack-infra17:45
*** betherly has quit IRC17:49
*** Lucas_Gray has joined #openstack-infra17:52
*** hamzy has joined #openstack-infra18:00
donnydok, so that is not how the cinder backend works at all. the image is still downloaded to be put in the cache18:01
*** hamzy has quit IRC18:05
fungiand then re-written out to cinder to create the boot volume?18:05
fungior is the cache also being stored on cinder? so nova is fetching the reference image from cinder and then re-writing it somewhere else in cinder without doing copy-on-write?18:06
*** ricolin has quit IRC18:10
donnydSo with a cinder backed for glance and caching turned on it still downloads the image in a separate volume and then uses that image for caching. at a 6x penalty in download speed18:13
donnydyea, I am going to go ahead and leave the images qcow for now and figure out a faster glance backend18:14
donnydI thought I understood what was happening, but clearly i misread18:14
*** Lucas_Gray has quit IRC18:29
*** Lucas_Gray has joined #openstack-infra18:30
paladoxhttps://github.com/dburm/pg-test-result-plugin in case anyone is interested (looks like https://phabricator.wikimedia.org/F29947221)18:35
*** hamzy has joined #openstack-infra18:39
*** betherly has joined #openstack-infra18:46
*** betherly has quit IRC18:52
*** yamamoto has joined #openstack-infra19:03
*** markvoelker has joined #openstack-infra19:07
*** betherly has joined #openstack-infra19:07
*** yamamoto has quit IRC19:07
*** markvoelker has quit IRC19:12
*** betherly has quit IRC19:12
clarkbthe fedora mirror vos release did eventually succeed (though the timestamp file in the volume doesn't reflect this)19:14
clarkbI'm going to hold the mirror.fedora lock file over the weekend and rerun through that with the script updates so I can do another manual vos release that should clean up a bunch of the images we don't need19:14
clarkbianw: ^ probably an fyi for you since your week starts before ours19:15
fungialso as hrw pointed out earlier we're still not mirroring debian buster-updates, which i think i've narrowed down to a (presumably intentional) behavior in reprepro where it won't generate indices for repositories that have no packages (buster-updates is still packageless officially because there's been no buster stable point release yet)19:18
*** whoami-rajat has quit IRC19:24
*** tosky has joined #openstack-infra19:25
*** betherly has joined #openstack-infra19:28
*** pcaruana has joined #openstack-infra19:30
*** betherly has quit IRC19:33
*** jamesmcarthur has joined #openstack-infra19:46
*** jamesmcarthur has quit IRC19:46
*** jamesmcarthur has joined #openstack-infra19:46
*** betherly has joined #openstack-infra19:59
*** betherly has quit IRC20:03
*** markvoelker has joined #openstack-infra20:07
*** markvoelker has quit IRC20:12
*** pcaruana has quit IRC20:14
*** betherly has joined #openstack-infra20:19
*** Lucas_Gray has quit IRC20:22
*** betherly has quit IRC20:24
*** rtjure has quit IRC20:25
mnaserwould anyone know by any chance why https://logs.opendev.org/56/627756/4/check/magnum-functional-k8s/f35b0ed/job-output.txt.gz fails to use the stestr inside venv ?20:42
*** markvoelker has joined #openstack-infra20:46
*** diablo_rojo has joined #openstack-infra20:49
*** jamesmcarthur has quit IRC20:51
mnaserfigured it out.. https://review.opendev.org/67447420:52
*** jamesmcarthur has joined #openstack-infra20:55
*** betherly has joined #openstack-infra21:00
*** betherly has quit IRC21:05
*** markvoelker has quit IRC21:11
*** betherly has joined #openstack-infra21:21
*** betherly has quit IRC21:26
*** jamesmcarthur has quit IRC21:34
*** slaweq has quit IRC21:47
*** diablo_rojo has quit IRC22:07
*** betherly has joined #openstack-infra22:12
*** betherly has quit IRC22:17
*** rfolco|ruck has joined #openstack-infra22:23
*** Goneri has joined #openstack-infra22:24
*** betherly has joined #openstack-infra22:33
*** jamesmcarthur has joined #openstack-infra22:34
*** jamesmcarthur has quit IRC22:37
*** betherly has quit IRC22:38
*** jamesmcarthur has joined #openstack-infra22:41
*** betherly has joined #openstack-infra22:54
*** jamesmcarthur has quit IRC22:57
*** betherly has quit IRC22:59
*** slaweq has joined #openstack-infra23:11
*** slaweq has quit IRC23:15
*** jtomasek has quit IRC23:27
*** tosky has quit IRC23:27
*** betherly has joined #openstack-infra23:46
*** Goneri has quit IRC23:49
*** betherly has quit IRC23:50
*** jamesmcarthur has joined #openstack-infra23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!