Monday, 2020-01-20

*** ociuhandu has joined #openstack-infra00:10
*** ociuhandu has quit IRC00:12
*** ociuhandu has joined #openstack-infra00:14
*** ociuhandu has quit IRC00:19
*** tetsuro has joined #openstack-infra00:31
*** dave-mccowan has joined #openstack-infra00:37
*** yamamoto has joined #openstack-infra01:15
*** auristor has quit IRC01:40
*** Lucas_Gray has quit IRC01:40
*** dave-mccowan has quit IRC01:45
kevinzianw: new  arm64 cluster is ready, I'd like to configure projects for openstack-infra01:50
*** stephenfin has quit IRC01:50
*** dosaboy has quit IRC01:50
*** stephenfin has joined #openstack-infra01:50
kevinzianw: so you need os-control and os-jobs right? we just have less than 20 IPV4 public IP, others are all IPV6 ips01:50
*** smcginnis|PTO has quit IRC01:51
*** exsdev0 has joined #openstack-infra01:51
*** exsdev has quit IRC01:51
*** exsdev0 is now known as exsdev01:51
*** smcginnis|PTO has joined #openstack-infra01:52
*** dosaboy has joined #openstack-infra01:59
*** yamamoto has quit IRC02:18
*** prometheanfire has quit IRC02:39
*** diablo_rojo has joined #openstack-infra02:43
*** prometheanfire has joined #openstack-infra03:03
*** yamamoto has joined #openstack-infra03:15
*** yamamoto has quit IRC03:59
*** ramishra has joined #openstack-infra03:59
*** yamamoto has joined #openstack-infra04:01
*** udesale has joined #openstack-infra04:18
*** raukadah is now known as chandankumar04:51
*** rcernin_ has joined #openstack-infra04:56
*** lxkong has joined #openstack-infra04:58
*** udesale_ has joined #openstack-infra04:58
*** ociuhandu has joined #openstack-infra04:59
*** rcernin has quit IRC04:59
*** udesale has quit IRC05:02
*** ociuhandu has quit IRC05:04
*** surpatil has joined #openstack-infra05:07
*** ramishra has quit IRC05:14
*** ramishra has joined #openstack-infra05:21
*** ramishra has quit IRC05:32
*** evrardjp has quit IRC05:34
*** evrardjp has joined #openstack-infra05:34
*** tkajinam has quit IRC05:52
*** tkajinam has joined #openstack-infra05:53
openstackgerritSimon Westphahl proposed zuul/nodepool master: Cleanup exception logging in static provider  https://review.opendev.org/70282806:14
*** ramishra has joined #openstack-infra06:30
*** ykarel|away is now known as ykarel06:32
openstackgerritRico Lin proposed openstack/project-config master: Add ircbot and repo for Multi-Arch SIG  https://review.opendev.org/70332306:32
openstackgerritRico Lin proposed opendev/system-config master: Add irc bots for Multi-Arch SIG  https://review.opendev.org/70332506:36
*** ramishra has quit IRC06:49
*** lmiccini has joined #openstack-infra06:51
*** ramishra has joined #openstack-infra07:05
*** ramishra has quit IRC07:09
*** rcernin_ has quit IRC07:14
*** ramishra has joined #openstack-infra07:17
*** pgaxatte has joined #openstack-infra07:27
*** piotrowskim has joined #openstack-infra07:36
*** ramishra has quit IRC07:44
*** ramishra has joined #openstack-infra07:47
*** rpittau|afk is now known as rpittau07:51
*** ykarel is now known as ykarel|lunch07:51
*** diablo_rojo has quit IRC07:55
*** slaweq has joined #openstack-infra08:00
*** ociuhandu has joined #openstack-infra08:02
*** ociuhandu has quit IRC08:02
*** ociuhandu has joined #openstack-infra08:03
*** ociuhandu has quit IRC08:05
*** slaweq has quit IRC08:05
*** ociuhandu has joined #openstack-infra08:05
*** jtomasek has joined #openstack-infra08:07
*** dchen has quit IRC08:08
*** ociuhandu has quit IRC08:11
*** ociuhandu has joined #openstack-infra08:12
*** tesseract has joined #openstack-infra08:16
*** tosky has joined #openstack-infra08:17
*** ociuhandu has quit IRC08:18
*** ociuhandu has joined #openstack-infra08:19
*** ociuhandu has quit IRC08:22
*** ociuhandu has joined #openstack-infra08:23
*** slaweq has joined #openstack-infra08:24
*** ralonsoh has joined #openstack-infra08:26
*** ociuhandu has quit IRC08:27
*** tkajinam has quit IRC08:28
*** ociuhandu has joined #openstack-infra08:29
*** pkopec has joined #openstack-infra08:29
*** ociuhandu has quit IRC08:30
*** ociuhandu has joined #openstack-infra08:30
*** gfidente has joined #openstack-infra08:31
*** xek_ has joined #openstack-infra08:33
*** xek has quit IRC08:36
*** dpawlik has joined #openstack-infra08:37
*** iurygregory has quit IRC08:49
*** jpena|off is now known as jpena08:50
*** jaosorior has joined #openstack-infra08:51
*** ociuhandu has quit IRC08:51
*** ociuhandu has joined #openstack-infra08:52
*** ociuhandu has quit IRC08:53
*** ociuhandu has joined #openstack-infra08:54
*** lucasagomes has joined #openstack-infra08:54
*** ociuhandu has quit IRC08:55
*** ociuhandu has joined #openstack-infra08:58
*** ykarel|lunch is now known as ykarel09:00
*** apetrich has joined #openstack-infra09:01
openstackgerritCarlos Goncalves proposed openstack/diskimage-builder master: Add CentOS 8 support  https://review.opendev.org/68430809:01
*** ociuhandu has quit IRC09:03
*** ricolin has quit IRC09:04
*** yamamoto has quit IRC09:06
*** yamamoto has joined #openstack-infra09:08
*** iurygregory has joined #openstack-infra09:09
*** ociuhandu has joined #openstack-infra09:10
*** ociuhandu has quit IRC09:14
*** ricolin has joined #openstack-infra09:15
*** arxcruz|off is now known as arxcruz09:22
*** jhesketh has quit IRC09:32
*** jhesketh has joined #openstack-infra09:34
*** david-lyle has joined #openstack-infra09:38
*** dklyle has quit IRC09:41
*** derekh has joined #openstack-infra09:47
*** yamamoto has quit IRC09:59
*** surpatil has quit IRC09:59
openstackgerritCarlos Goncalves proposed openstack/diskimage-builder master: Add CentOS 8 support  https://review.opendev.org/68430810:01
*** xek_ has quit IRC10:01
*** yamamoto has joined #openstack-infra10:05
*** yamamoto has quit IRC10:05
*** AJaeger has quit IRC10:05
*** jaosorior has quit IRC10:17
openstackgerritMiklos Vajna proposed opendev/git-review master: Make it possible to specify who is notified  https://review.opendev.org/70286110:36
*** gfidente has quit IRC10:38
openstackgerritMiklos Vajna proposed opendev/git-review master: Make it possible to specify who is notified  https://review.opendev.org/70286110:38
openstackgerritAntoine Musso proposed zuul/zuul master: doc: add links to components documentation  https://review.opendev.org/70310510:40
*** gfidente has joined #openstack-infra10:41
openstackgerritAntoine Musso proposed openstack/diskimage-builder master: dib-lint: test elements have README.rst file  https://review.opendev.org/17783210:48
*** ociuhandu has joined #openstack-infra10:51
*** ricolin has quit IRC10:55
*** udesale_ has quit IRC11:02
openstackgerritMiklos Vajna proposed opendev/git-review master: Make it possible to specify who is notified  https://review.opendev.org/70286111:03
*** ociuhandu has quit IRC11:08
*** ociuhandu has joined #openstack-infra11:09
*** dtantsur|afk is now known as dtantsur11:13
*** ociuhandu has quit IRC11:14
*** ociuhandu has joined #openstack-infra11:17
*** rpittau is now known as rpittau|bbl11:20
*** dpawlik has quit IRC11:22
openstackgerritMiklos Vajna proposed opendev/git-review master: Make it possible to specify who is notified  https://review.opendev.org/70286111:24
*** ociuhandu has quit IRC11:24
*** dpawlik has joined #openstack-infra11:34
openstackgerritSorin Sbarnea proposed zuul/zuul master: WIP: docs: improve job.role documentation  https://review.opendev.org/70337211:39
*** ykarel is now known as ykarel|afk11:40
*** AJaeger has joined #openstack-infra11:56
openstackgerritSorin Sbarnea proposed zuul/zuul master: docs: improve job.role documentation  https://review.opendev.org/70337212:00
*** ociuhandu has joined #openstack-infra12:02
*** Lucas_Gray has joined #openstack-infra12:04
*** rosmaita has joined #openstack-infra12:05
*** roman_g has joined #openstack-infra12:06
*** ociuhandu has quit IRC12:08
AJaegerconfig-core, please review https://review.opendev.org/702818 and https://review.opendev.org/703189 to retire Ubuntu Trusty testing. Once those are in, we need an infra-root to delete the AFS volume mirror.wheel.trustyx64 .12:17
*** ykarel|afk is now known as ykarel12:24
*** mnaser has quit IRC12:27
*** adam_g has quit IRC12:27
*** mnaser has joined #openstack-infra12:27
*** adam_g has joined #openstack-infra12:28
*** rfolco has joined #openstack-infra12:29
*** jpena is now known as jpena|lunch12:35
*** yamamoto has joined #openstack-infra12:37
*** yamamoto has quit IRC12:37
*** lxkong has quit IRC12:38
*** xek has joined #openstack-infra12:41
openstackgerritMiklos Vajna proposed opendev/git-review master: Make it possible to specify who is notified  https://review.opendev.org/70286112:42
*** yamamoto has joined #openstack-infra12:42
openstackgerritMerged opendev/base-jobs master: Remove ubuntu-trusty nodeset  https://review.opendev.org/70281812:46
*** slaweq has quit IRC12:48
*** slaweq has joined #openstack-infra12:51
*** rfolco is now known as rfolco|bbl12:56
*** rh-jelabarre has joined #openstack-infra12:58
*** rlandy has joined #openstack-infra13:00
*** ykarel is now known as ykarel|afk13:01
*** electrofelix has joined #openstack-infra13:01
*** electrofelix has quit IRC13:01
*** Lucas_Gray has quit IRC13:02
*** jaosorior has joined #openstack-infra13:04
*** yamamoto has quit IRC13:04
*** Lucas_Gray has joined #openstack-infra13:06
*** smcginnis|PTO is now known as smcginnis13:09
*** yamamoto has joined #openstack-infra13:09
openstackgerritRodolfo Alonso Hernandez proposed openstack/openstack-zuul-jobs master: Increase openstack-tox-py3{6,7} timeout to 3600 seconds  https://review.opendev.org/70338613:11
*** Lucas_Gray has quit IRC13:11
*** rpittau|bbl is now known as rpittau13:11
*** yamamoto has quit IRC13:14
*** Lucas_Gray has joined #openstack-infra13:15
*** jaosorior has quit IRC13:26
*** jpena|lunch is now known as jpena13:30
*** dpawlik has quit IRC13:34
*** dpawlik has joined #openstack-infra13:35
*** kjackal has joined #openstack-infra13:36
*** ociuhandu has joined #openstack-infra13:39
*** yamamoto has joined #openstack-infra13:41
*** yamamoto has quit IRC13:42
*** yamamoto has joined #openstack-infra13:42
*** yamamoto has quit IRC13:43
*** yamamoto has joined #openstack-infra13:43
*** ociuhandu has quit IRC13:44
openstackgerritMerged openstack/project-config master: Bye, Bye, Trusty  https://review.opendev.org/70318913:50
AJaegerinfra-root, please delete the AFS volume mirror.wheel.trustyx64 . We just removed ubuntu-trusty images from OpenDev ^13:52
AJaeger#success Ubuntu Trusty images have been removed13:52
openstackstatusAJaeger: Added success to Success page (https://wiki.openstack.org/wiki/Successes)13:52
AJaeger#status log Ubuntu Trusty images have been removed13:53
openstackstatusAJaeger: finished logging13:53
*** kjackal has quit IRC13:55
*** ykarel|afk is now known as ykarel13:56
*** ricolin has joined #openstack-infra13:57
*** jaosorior has joined #openstack-infra13:58
*** dciabrin_ is now known as dciabrin13:58
*** ricolin has quit IRC14:07
*** Lucas_Gray has quit IRC14:09
*** ricolin has joined #openstack-infra14:11
*** ociuhandu has joined #openstack-infra14:11
*** rfolco|bbl is now known as rfolco14:16
*** ociuhandu has quit IRC14:18
*** ricolin_ has joined #openstack-infra14:24
*** ricolin_ has quit IRC14:26
*** ricolin has quit IRC14:26
*** ricolin has joined #openstack-infra14:26
*** ab-a has joined #openstack-infra14:27
openstackgerritMerged openstack/reviewstats master: Update ironic subprojects  https://review.opendev.org/70089014:29
openstackgerritRico Lin proposed openstack/project-config master: Add ircbot and repo for Multi-Arch SIG  https://review.opendev.org/70332314:29
openstackgerritSorin Sbarnea proposed zuul/zuul master: bindep: fixed wrong dep names on rpm platform  https://review.opendev.org/70340314:30
ricolinAJaeger, https://review.opendev.org/703323 updated14:31
ricolindo you have more background information about governance/reference/programs.yaml14:32
ricolinI can't find it in current governance repo now14:33
*** zxiiro has joined #openstack-infra14:36
*** udesale has joined #openstack-infra14:42
openstackgerritSimon Westphahl proposed zuul/nodepool master: Handle event id in node requests  https://review.opendev.org/70340614:46
openstackgerritSimon Westphahl proposed zuul/nodepool master: Centralize logging adapters  https://review.opendev.org/70340714:46
AJaegerricolin: let me update that part...14:53
ricolinAJaeger, thx14:54
openstackgerritSimon Westphahl proposed zuul/nodepool master: Make flake8 config compatible with latest version  https://review.opendev.org/70341014:58
*** jaosorior has quit IRC15:05
*** ykarel is now known as ykarel|away15:05
fricklerdansmith: mugsie: (cc infra-root) do you still have interest in using #openstack-merges ? the project list seems pretty outdated, also it looks broken since openstackgerrit doesn't have a voice there15:06
*** yamamoto has quit IRC15:07
openstackgerritSorin Sbarnea proposed zuul/zuul master: Unlock urllib pinning  https://review.opendev.org/70341415:07
openstackgerritAndreas Jaeger proposed openstack/project-config master: Update list for #openstack-merges  https://review.opendev.org/70341615:08
AJaegerfrickler: this updates the list ^15:08
fricklerAJaeger: I'm thinking whether we can instead discard that channel. with at most two subscribers, that setup doesn't seem too effective to me15:10
fricklerif we decide to continue it, updates should be automated IMO15:10
openstackgerritSorin Sbarnea proposed zuul/zuul master: Unpin urllib  https://review.opendev.org/70341415:11
*** artom has joined #openstack-infra15:12
openstackgerritSorin Sbarnea proposed opendev/gear master: tox: enable extra python versions  https://review.opendev.org/70341815:14
*** chandankumar is now known as raukadah15:15
AJaegerfrickler: good point, happy to abandon ;)15:17
AJaegerfrickler: let me propose an alternative as well15:18
openstackgerritAndreas Jaeger proposed openstack/project-config master: Disable #openstack-merges  https://review.opendev.org/70342115:20
AJaegerfrickler, mugsie, dansmith ^15:20
*** eharney has joined #openstack-infra15:21
openstackgerritSorin Sbarnea proposed opendev/gear master: packaging: updated project urls  https://review.opendev.org/70342215:21
fricklerAJaeger: Dan and Graham were the only subscribers before, waiting for their feedback. the channel setup does actually seem to work, though, seems I was misinterpreting the flags15:21
AJaegerfrickler: I added both to the review, let's wait for them...15:22
*** kjackal has joined #openstack-infra15:22
ricolinAJaeger, fungi it will be nice if we can get this patch (https://review.opendev.org/#/c/703323) and our storyboard created for SIG soon, so I can start add tasks in storyboard :)15:23
AJaegerricolin: please add a "needed-By"to that one15:23
AJaegerI really like to see the link to the government change in the review as stated in the infra-manual15:23
openstackgerritRico Lin proposed openstack/project-config master: Add ircbot and repo for Multi-Arch SIG  https://review.opendev.org/70332315:24
ricolinAJaeger, thx for the reminding and~ done!^^^15:25
*** ociuhandu has joined #openstack-infra15:27
openstackgerritSorin Sbarnea proposed opendev/gear master: WIP: test extra jobs  https://review.opendev.org/70342515:29
*** ociuhandu has quit IRC15:32
openstackgerritAndreas Jaeger proposed openstack/project-config master: Update list for #openstack-merges  https://review.opendev.org/70341615:35
*** bauzas has quit IRC15:43
*** jaosorior has joined #openstack-infra15:43
*** yamamoto has joined #openstack-infra15:45
clarkbfrickler: if no one is using it then turning it off is probably best15:51
AJaegerclarkb: only mugsie and dansmith - and mugsie gave a +1 already on https://review.opendev.org/70342115:52
AJaegerinfra-root, please delete the AFS volume mirror.wheel.trustyx64 . We removed ubuntu-trusty images from OpenDev15:53
*** yamamoto has quit IRC15:55
AJaegerconfig-core, two small reviews for openstack-zuul-jobs to update testing, please: https://review.opendev.org/703297 and https://review.opendev.org/70329815:58
openstackgerritAndreas Jaeger proposed opendev/system-config master: Remove #openstack-merges  https://review.opendev.org/70343415:58
*** diablo_rojo has joined #openstack-infra15:58
openstackgerritMerged openstack/project-config master: Add ircbot and repo for Multi-Arch SIG  https://review.opendev.org/70332316:01
*** ociuhandu has joined #openstack-infra16:03
openstackgerritMerged openstack/openstack-zuul-jobs master: Update docs building  https://review.opendev.org/70329716:08
*** udesale has quit IRC16:09
openstackgerritMerged openstack/openstack-zuul-jobs master: Increase hacking version  https://review.opendev.org/70329816:11
*** openstackgerrit has quit IRC16:13
*** lpetrut has quit IRC16:20
*** KeithMnemonic has joined #openstack-infra16:21
*** ociuhandu has quit IRC16:21
*** ociuhandu has joined #openstack-infra16:22
*** piotrowskim has quit IRC16:22
*** pgaxatte has quit IRC16:22
*** tosky has quit IRC16:23
*** slaweq has quit IRC16:24
*** iurygregory has quit IRC16:29
jrosserwhat was the outcome of the required python version metadata stuff for the infra wheel mirrors?16:31
fungijrosser: step 1 was we blacklisted setuptools, pip and virtualenv from our wheel cache16:32
fungi(and deleted setuptools 45.0.0 from it)16:32
clarkbstep 2 was discover all the way it is difficult to write the metadata on those packages ourselves16:32
fungiyeah. i've worked out how to mostly make wheel builds reproducible, and also how to filter out wheels we didn't build ourselves by parsing pip's log16:33
jrosserah ok, becasue i was just looking into OSA tempest fails on stable/stein because it pulls in a py3 neutron-lib out of the wheel mirror16:33
jrosserbut an idential job on debian stretch works becasue it hits upstream pypi and i assume the correct metadata is present there16:34
clarkbwe are not writing that metadata16:34
fungii think with those we have the ability to perform index generation locally on the build node, and only write a relatively small amount of data into afs (which is a bottleneck)16:34
clarkbjrosser: openstack produced wheels should specify if they are python2, python3 or both  though16:34
clarkbif neutron-lib doesn't do that properly we likely have a bug in package config or possibly pbr16:34
*** lmiccini has quit IRC16:35
jrosseroh hmm http://mirror.ord.rax.opendev.org/wheel/ubuntu-18.04-x86_64/neutron-lib/16:36
jrosserneutron_lib-2.0.0-py2.py3-none-any.whl <- suspicious16:36
clarkbyes that is a bug if it can't run under python216:36
jrosserwhen i look here its >=3.6 https://pypi.org/project/neutron-lib/2.0.0/16:37
clarkbmetadata is probably getting set properly then. Possible this is a pbr wheel generation bug16:38
jrosserneutron-lib appears to do something sensible https://github.com/openstack/neutron-lib/blob/master/setup.cfg#L916:41
jrosserwhere do i look next, not super familiar with how this works16:41
clarkbjrosser: in openstack/pbr I think16:43
clarkbsince that is what works with setuptools to generate the wheel16:43
*** rpittau is now known as rpittau|afk16:44
*** bdodd_ has quit IRC16:45
*** bauzas has joined #openstack-infra16:50
*** bdodd has joined #openstack-infra16:52
*** jaosorior has quit IRC16:55
*** ricolin has quit IRC16:55
jrosseri am wondering if this is a similar situation to setuptools - becasue pip(2) takes neutron-lib 2.0.0 as a valid installation candidate from the wheel mirror due to lack of metadata but does not deem it a candidate when using upstream pypi16:56
clarkbjrosser: it is, except since we control our own wheel generation we should be able to properly create a py3 only wheel16:57
clarkbwhich would avoid this problem16:57
jrosserthe METADATA inside the .py2.py3 file looks OK, "Requires-Python: >=3.6" and is likely what causes the install to fail ultimately16:57
clarkbalso we tightly control all our deps using requirements and constraints16:57
clarkbwe shoudl exclude versions that are not valid there16:57
jrosserwell, "tempest" :(16:57
fungiyeah, gmann is working on this problem16:57
clarkbnot sure why tempest matters. We should have requirements lines with env marker16:58
prometheanfireit seems like the requirements bot is failing16:58
clarkbneutron-lib<2.0.0 ; python_version<3.616:58
fungibasically tempest is branchless but we install it in a virtualenv on xenial where python3 is 3.5, but it has dependencies which claim to only work on 3.6 and later16:58
clarkbneutron-lib>=2.0.0 ; python_version>=3.616:58
clarkbthose two requirements lines should fix it16:59
fungiso, yeah, adding something like that in requirements could solve it16:59
jrosserand OSA rocky and stein are unchangeably py2 only16:59
gmannyeah, we can cap in requirement also but that will be needed for all such dependency.16:59
fungijrosser: that part is addressed by installing tempest under python316:59
clarkbgmann: we already do it for all dependencies16:59
gmanni am trying to install py3.6 interpreter for tempest venv16:59
clarkbwe've just not had problems with most of them yet16:59
fungi(it has its own virtualenv separate from the system context)17:00
*** lucasagomes has quit IRC17:00
*** tesseract has quit IRC17:00
*** openstackgerrit has joined #openstack-infra17:03
openstackgerritJames E. Blair proposed zuul/zuul-website master: Update redirects  https://review.opendev.org/70345417:03
clarkbjrosser: fungi: pip wheel seems to respect requires python by default https://pip.pypa.io/en/stable/reference/pip_wheel/#cmdoption-ignore-requires-python we use python setup.py bdist_wheel though17:04
clarkbsetuptools docs imply that it respects requires-python too17:05
clarkbhttps://packaging.python.org/tutorials/packaging-projects/ note that project has requiers python set to >=3.6 and the bdist_wheel result is python3 only17:06
fungiwe do use `pip wheel` to build platform-specific wheels for our wheel cache, but yeah pbr uses the old way17:07
clarkbif I build the wheel locally I get neutron_lib-2.0.0-py3-none-any.whl17:07
clarkbusing python setup.py bdist_wheel17:07
clarkbthat implies to me that pbr is working as is setuptools so the issue is at a higher level17:08
clarkb(possibly in the wheel mirror generation script)17:08
fungihttps://pypi.org/project/neutron-lib/#files17:08
fungithe job building the wheel for release is making it universal17:09
clarkbah so that may be a problem there too17:09
fungiprobably worth digging up the build log from the release pipeline17:09
openstackgerritJames E. Blair proposed zuul/zuul-website master: Update redirects  https://review.opendev.org/70345617:09
fungipypi does pep 530 metadata in its simple index, which is why it's only a problem for pip fetching from our wheel cache17:09
clarkbd9a0ce5d7273ed9414d3d6a2127ac4b6a983523e removed the unviersal flag from setup.cfg and that change is included in 2.0.017:11
openstackgerritJames E. Blair proposed zuul/zuul-website master: Update redirects  https://review.opendev.org/70345617:13
openstackgerritJames E. Blair proposed zuul/zuul-website master: Remove some redirects  https://review.opendev.org/70345717:13
*** tobiash has quit IRC17:14
*** kjackal has quit IRC17:14
clarkbhttp://zuul.openstack.org/build/9d6ee88b51514ca4a96d8278ed434327/console#2/0/0/ubuntu-bionic our release jobs set --universal17:16
clarkbhttps://opendev.org/openstack/project-config/src/branch/master/zuul.d/jobs.yaml#L97-L114 is the issue17:16
clarkbfor our uploads to pypi at least17:16
gmannclarkb: prometheanfire not sure if u-c of ussuri should be removing the py3.4, py3.5 versions cap also along with py2.7 as they are not supported version for ussuri releases. only cap the compatibility of py3.6, 3.7 and any other supported py version.17:17
clarkbthe wheel builder just grabs from pypi if the wheel exists there I think17:17
clarkbgmann: I think you have to wait for everything to have fully transitioned to make that change since global requirements are global17:18
clarkbgmann: so maybe at the end of the cycle do the older python removal17:18
clarkbbut until then people may be transitioning?17:18
gmannyeah, at the end we should. that is why i was concern on doing neutron-lib cap for < or > = py3.617:19
smcginnisWe need to keep swift's py2 needs too.17:20
gmannand instead fix the Tempest installation way to either create py3.6 venv or pin Tempest py2 compatible version and so does u-c too.17:20
clarkbgmann: env markers allow us to have different caps for different python versions17:20
fungiclarkb: if memory serves, the reason we added --universal (years ago) was that projects were not getting around to adding it consistently to their setup.cfg files. now that's coming back to bite us i guess17:21
*** kjackal has joined #openstack-infra17:21
clarkbgmann: neutron-lib<2.0.0 ; python_version<3.6 and neutron-lib>2.0.0 ; python_version>=3.617:21
clarkbfungi: ya its going to make this a giant pain to work around I expect17:21
gmannclarkb: yeah but my question is do we really need to do that when ussuri release do not support <py3.617:22
fungiwell, we need to drop the --universal from the job asap17:22
gmannclarkb: on ussuri u-c.17:22
clarkbgmann: yes, because usurri is still in a state of transition17:22
clarkbfungi: ya I've taken the wheel conversation to the releases channel17:22
gmannclarkb: ohk, for transition it make sense.17:23
*** tobiash has joined #openstack-infra17:23
AJaegerspeaking about wheels: infra-root, please delete the AFS volume mirror.wheel.trustyx64 . We removed ubuntu-trusty images from OpenDev17:24
*** ociuhandu_ has joined #openstack-infra17:26
corvusAJaeger, infra-root: i'll delete that volume17:26
fungithanks corvus!17:27
clarkbtyty17:27
AJaegerthanks!17:27
jrossergmann: from an openstack-ansible perspective it is not possible to deploy tempest in py3 for either rocky or stein17:28
fungiwhy?17:29
fungidoes openstack-ansible not deploy tempest in a virtualenv like devstack does?17:29
*** ociuhandu has quit IRC17:29
fungitempest will inevitably have dependency version conflicts with the installed openstack services so they need separate environments regardless17:30
*** ociuhandu_ has quit IRC17:30
gmannyeah, otherwise you would not be able use tempest master with stable u-c17:30
AJaegerconfig-core, here's an update for gerritbot to use two new flags, please review: https://review.opendev.org/69809117:33
*** dtantsur is now known as dtantsur|afk17:33
jrosserfungi: yes it does, but the entire setup is py2 only until train which is our py2/p3 transition release17:33
*** evrardjp has quit IRC17:34
jrosserthere was massive work needed to bring py3 in and is inconcievable to backport17:34
openstackgerritSean McGinnis proposed openstack/project-config master: Stop forcing universal wheel releases  https://review.opendev.org/70346417:34
*** evrardjp has joined #openstack-infra17:34
clarkbjrosser: I think you'd need to install stable tempest then?17:35
clarkbon those older stable branches17:35
jrosseryes, i'm just looking at that now17:35
fungithere is no stable tempest17:36
fungiyou'd have to install tempest from an old tag17:36
gmannjrosser: you can use the Tempest tag in that case like we did for ocata and pike- https://review.opendev.org/#/c/681950/17:36
clarkbfungi: right that17:37
gmannwe have Tempest tag for each release wise compatibility if master cannot be used for any rason17:37
fungijrosser: by "work needed to bring py3 in" you mean installing the interpreter? because that should in theory be all tempest needs for a py3 virtualenv17:37
gmannand for all Tempest plugins also17:37
jrosserwe have an ansible role that build python venv <- patches17:38
jrosserand our own wheel building <- patches17:38
jrosserand centos7 <- difficult17:38
clarkbcentos7 actually has python3 in the main distro no17:38
clarkb*now17:39
jrosserand ubuntu/debian/suse/centos to work universally17:39
fungiahh, yeah, doing it on centos7 was tough until the latest centos7 release17:39
jrosserwhilst deploy fro either source code or distro packages17:39
jrosser"switch to py3" is a big deal for deployment tooling17:39
jrosserand upgrades must still work and so on17:39
clarkbya I think using old tempest is probably simplest17:39
fungiagreed17:40
clarkbjrosser: https://review.opendev.org/703464 is the fix for the wheel problem fwiw17:40
openstackgerritTristan Cacqueray proposed zuul/zuul master: docs: remove generated toc from the main index  https://review.opendev.org/70346817:40
clarkbwe'll stop generating python2 compat wheels for python3 only projects17:40
clarkb(we'll only make python3 wheels actually, but thats ok python2 can simply use the sdists)17:41
jrosserclarkb: is there a behaviour where something uses the py2.py3 from the filename rather than the metadata in the wheel?17:41
clarkbjrosser: yes pip checks both17:41
jrosserah right17:41
clarkbI believe the filename was the original method for addressing this problem17:41
jrosserit's interesting that my debian job which doesnt use the infra wheel works fine17:42
clarkbthen they realized python3.4 and 3.7 aren't necessarily compat17:42
clarkbso added the more expressive thing?17:42
fungipip won't install a py3 wheel on python2.x nor a py2 wheel on python3.x, but will install a py2.py3 wheel on both17:42
clarkbjrosser: your debian job is using the metadata from pypi17:42
jrosseryes, that was my conclusion17:42
fungijrosser: that's because it's hitting pypi's simple index, which additionally has pep 530 metadata about supported python versions17:42
corvus#status log deleted afs volume mirror.wheel.trustyx6417:42
openstackstatuscorvus: finished logging17:42
clarkbfungi: any idea if setuptools itself fixed their wheel name?17:43
clarkbor if we filed a bug on that?17:43
fungithey said "open a new issue if you want universal=1 removed"17:43
openstackgerritJames E. Blair proposed opendev/system-config master: Add docs for deleting an AFS volume  https://review.opendev.org/70347017:43
fungiclarkb: and i don't believe anyone has17:43
fungihttps://github.com/pypa/setuptools/issues/196417:44
clarkbhttps://github.com/pypa/setuptools/pull/197817:44
clarkbcool I guess setuptools 46 will also be fixed17:44
fungiahh, nice17:44
fungianyway, i think if we started stripping wheels we've downloaded from pypi our of our wheel cache, this would also be a non-issue (though we would have taken a lot longer to notice we're incorrectly setting --universal all the time)17:45
*** Goneri has quit IRC17:47
*** gouthamr_ has joined #openstack-infra17:47
*** jpena is now known as jpena|off17:48
openstackgerritJames E. Blair proposed zuul/zuul master: Docs: change "config" title  https://review.opendev.org/70347117:51
*** dpawlik has quit IRC17:52
*** bnemec has joined #openstack-infra17:52
openstackgerritMerged openstack/project-config master: Stop forcing universal wheel releases  https://review.opendev.org/70346417:57
openstackgerritTristan Cacqueray proposed zuul/zuul master: docs: remove generated toc from the main index  https://review.opendev.org/70346817:58
*** derekh has quit IRC18:01
*** jamesmcarthur has joined #openstack-infra18:03
*** gfidente is now known as gfidente|afk18:08
*** bnemec has quit IRC18:08
*** gouthamr_ has quit IRC18:10
*** sdoran has quit IRC18:11
*** nickv1985 has quit IRC18:11
*** Shrews has quit IRC18:11
*** sdoran has joined #openstack-infra18:11
*** Shrews has joined #openstack-infra18:11
*** nickv1985 has joined #openstack-infra18:12
clarkbseems like the openstack TC would like a formalized opendev governance document. Does opendev/system-config/doc seem like a good place for that?18:22
clarkbalso linaro has their new arm64 cloud up and running. If someone else would like to help bootstrap that let me know. I'm going to try and get the connection details up on bridge in the near future18:23
* clarkb is juggling a bunch of administrivia today as well as family going "isn't it a holiday?" :)18:23
fungiyeah, i'm still trying to catch up on e-mail. today has been crazier than anticipated18:34
*** jamesmcarthur has quit IRC18:36
corvusclarkb: re opendev governance, where was that feedback?18:40
corvus(i didn't see a reply to your friday email)18:40
fungicorvus: it was in review comments on on https://review.opendev.org/70313418:40
corvusah thx18:41
corvusclarkb: yeah, that seems like a good place.  https://docs.openstack.org/infra/system-config/project.html  is essentially our current governance.18:43
fungimakes sense to me too18:43
clarkbalright I'll get the distilled thread version pushed up there18:44
clarkbthen maybe we don't approve it until TC governance is no longer a conflict18:44
*** tosky has joined #openstack-infra18:50
*** kjackal has quit IRC18:54
*** hamzy__ has joined #openstack-infra18:55
*** david-lyle has quit IRC18:56
*** lpetrut has joined #openstack-infra18:56
*** eharney has quit IRC18:56
*** hamzy_ has quit IRC18:57
*** ralonsoh has quit IRC19:00
*** eharney has joined #openstack-infra19:09
*** addyess has quit IRC19:09
*** addyess has joined #openstack-infra19:11
fungiclarkb: slight improvement on the wheel filtering plan... i can parse the filenames out of the per-branch logs we're already generating... looks like for publish-wheel-mirror-ubuntu-bionic as an example we're stashing 1669 unique wheels which were downloaded directly from pypi19:20
fungino need for a separate appending log since we retain them all individually19:21
*** igordc has joined #openstack-infra19:23
*** stevebaker has joined #openstack-infra19:26
*** adam_g has quit IRC19:28
openstackgerritJeremy Stanley proposed openstack/project-config master: Don't cache downloaded wheels in our wheels mirror  https://review.opendev.org/70348719:33
fungiclarkb: jrosser: smcginnis: ^19:33
*** goldyfruit has joined #openstack-infra19:35
fungiyou can also play the home game, by downloading a build-logs.tar.gz from a recent run like http://zuul.opendev.org/t/openstack/build/f2e33b555c704628ad9a434dc216d66e/logs19:36
openstackgerritClark Boylan proposed opendev/system-config master: Update project doc to reflect OpenDev changes  https://review.opendev.org/70348819:38
clarkbfungi: corvus ^ and all other infra-root config-core and infra folks I think that is the next step ish in the oepndev split proposal19:39
clarkbI don't think we want to merge that until the split happens so I will go ahead and WIP it now19:39
*** goldyfruit has quit IRC19:39
clarkbfungi: looking19:39
*** goldyfruit has joined #openstack-infra19:40
clarkbfungi: one note on the change. Also I realized if we stop building universal wheels those jobs will end up building python2 wheels19:47
clarkbso we won't delete everything as expected. But I think that is fine as we'll get wheels for python2 of versions that work with python2 aiui19:47
openstackgerritMerged zuul/zuul-helm master: Added support for configuring disk_limit_per_job  https://review.opendev.org/70296319:48
openstackgerritMerged zuul/zuul-helm master: Add extra files for secret  https://review.opendev.org/70296519:48
fungiwell, we won't build wheels if they can be downloaded from pypi, and we'll still avoid saving those into the cache at the end19:49
clarkbfungi: right but there won't by python2 wheels on pypi anymore but we'll build python2 wheels in our jobs19:49
clarkbin the subset of cases where requires-python isn't set19:49
clarkbI don't expect it to be a problem19:50
fungibut yeah, if we stop publishing wheels which support python2 and something claims to need those versions, we'll build and cache python2-supporing versions of them... but that should hopefully be a dwindling set19:50
fungiand projects whose releases properly support python2 (it will mostly be stable branch point releases) can set universal=1 in setup.cfg and things happen as expected then19:51
clarkbyup setting universal=1 is definitely the best fix here19:51
fungibut i don't think 703487 changes any of that anyway19:51
fungiit would happen regardless19:51
clarkbya mostly just pointing out there maybe straggler wheels we don't expect to stick around as a result of this19:52
clarkbmore than lxml, libvirt-python, numpy, cryptography, etc19:52
AJaegerfungi, want to update your change (or followup) with the sanity check that clarkb proposes? Or is that not needed?19:54
clarkbfwiw my concern there is we'll stop deleting things if the pip log format changes and we won't notice19:54
clarkbI figure higher chance of noticing if the job starts failing19:54
fungioh, sure19:56
*** hashar has joined #openstack-infra19:58
AJaegerclarkb: you still left the OpenStack Infra project team in governance - do we need a governing document for them? Your change updates the governing document for these...20:01
clarkbAJaeger: ya, its a bit awkward because we put that content in opendev/system-config so I think the content there should be opendev specific. But it is likely that openstack infra team may want a separate doc (maybe in openstack/project-config?) to document anything different there20:02
clarkbAJaeger: fwiw I don't think a lot of the infra governance/teams stuff applies much to what will remain in openstack. refstack, health, dib don't really necessarily need a cohesive service perspective20:03
clarkbthats a long way to say I think the openstack infra team that remains can get away with lightweight default openstack governance?20:03
clarkbmore similar to other openstack projects that way20:03
clarkbAJaeger: does that make sense?20:04
AJaegerclarkb: yes, makes sense - and I agree, something lightweight might be enough... That's why I formulated it as question ;)20:04
clarkbI think my preference would be to start with default openstack as the assumption and if any of that changes due to need we can add a new doc, likely in project-config20:05
AJaegerworks for me20:05
AJaegerclarkb: you might want to add that to the commit message20:06
AJaeger(something along the lines above)20:06
clarkbcan do20:06
clarkbI'll incorporate that with edits from yall's feedback20:07
*** apetrich has quit IRC20:07
openstackgerritJeremy Stanley proposed openstack/project-config master: Don't cache downloaded wheels in our wheels mirror  https://review.opendev.org/70348720:07
fungiclarkb: AJaeger: done ^20:07
fungii had originally not done that so that the job won't fail due to unexpected parsing errors which didn't show up locally for me (since we can't easily test this without merging) but i suppose the worst that happens is our wheel mirrors stop updating until we fix it20:08
clarkbfungi: ya and I think that will help us notice vs the other situation where things mostly work until 9 months later when a random package python version interaction causes it to fail20:10
*** exsdev has quit IRC20:10
*** icey has quit IRC20:10
fungii'll also go ahead and push up my reproducibility fixes too before i forget what they were20:11
*** Lucas_Gray has joined #openstack-infra20:11
*** slaweq has joined #openstack-infra20:12
*** dosaboy has quit IRC20:12
*** rfarr has joined #openstack-infra20:14
*** Lucas_Gray has quit IRC20:14
AJaegerfungi: +2A20:14
*** Lucas_Gray has joined #openstack-infra20:16
*** lxkong has joined #openstack-infra20:21
openstackgerritJeremy Stanley proposed openstack/project-config master: Build reproducible wheels for our wheel cache  https://review.opendev.org/70349520:21
fungithere's the hacks to make many of our wheels consistent between builds20:21
*** kjackal has joined #openstack-infra20:22
*** adam_g has joined #openstack-infra20:23
fungithe other thing we can consider doing is removing wheels from the cache which aren't in the list of wheels we built, so that these caches don't grow unbounded20:25
AJaegerfungi, CFLAGS=-g0 means also no optimization, what about saying "CFLAGS=-g0 -O2"?20:25
openstackgerritSorin Sbarnea proposed opendev/gear master: Add extra python jobs  https://review.opendev.org/70342520:26
fungiAJaeger: yeah, i'm seeing some examples of pairing it with -O3 as well20:28
openstackgerritMerged openstack/project-config master: Don't cache downloaded wheels in our wheels mirror  https://review.opendev.org/70348720:28
AJaegerAFAIR -O2 has only safe optimizatoins, so would use that one for everything20:30
*** kjackal has quit IRC20:30
openstackgerritSorin Sbarnea proposed opendev/gear master: Add extra python jobs  https://review.opendev.org/70342520:34
fungiAJaeger: where are you seeing -g0 negate optimizations? the gcc docs don't seem to mention that anywhere i can find20:36
openstackgerritClark Boylan proposed opendev/system-config master: Update project doc to reflect OpenDev changes  https://review.opendev.org/70348820:36
clarkbAJaeger: fungi ^ thank you for the review.s I think I got it all there20:36
fungiAJaeger: neither https://gcc.gnu.org/onlinedocs/gcc/Debugging-Options.html#Debugging-Options nor https://gcc.gnu.org/onlinedocs/gcc/Optimize-Options.html#Optimize-Options seem to mention any interaction between -g and -O20:38
fungi(it's not that i don't believe you, i just want to know precisely what the interaction is between them)20:39
*** goldyfruit has quit IRC20:40
*** goldyfruit has joined #openstack-infra20:40
AJaegerfungi: what I mean is: You have default CFLAGS for a project like "-O2 -g". If you set CFLAGS=-g0, then you *remove* the -O2 and the code is not optimized.20:40
fungioh!20:40
AJaegerThere's no interaction between those two - the default is -O0 (last time I looked).20:41
fungii get you, i should instead export CFLAGS="-g0 $CFLAGS"20:41
AJaegerI guess that won't work, since CFLAGS are overwritten.20:41
AJaegerBut that needs experimentation...20:42
AJaegerAnd I would use "$CFLAGS -g0", the latter overwrite...20:42
fungido we assume this script might run somewhere that CFLAGS is already set in the calling environment?20:42
openstackgerritSorin Sbarnea proposed opendev/gear master: Add extra python jobs  https://review.opendev.org/70342520:43
AJaegerfungi: My understanding is that the script *calls* pip wheel building, and thus you pass in from outside the CFLAGS.20:44
AJaegerso, no way to override - you replace. But please check it on an example build20:45
fungiyeah, when pip wheel ends up running gcc to compile extensions, the CFLAGS exported by the script get used (unless the package overwrites CFLAGS itself, but generally that's where they should be prepending or appending the existing CFLAGS var instead of overwriting)20:45
AJaegerdo you have some packages that compile?20:46
fungibasically if a package doesn't obey CFLAGS from the calling environment, that would be a bug worth filing against the package's source repositories20:46
AJaegeryep20:46
fungii was using pyyaml as a test case since it was mentioned in https://github.com/pypa/pip/issues/650520:48
*** eharney has quit IRC20:48
AJaegerinteresting, default compile vs. CFLAGS=-g0: http://paste.openstack.org/show/788616/20:55
AJaegerthat seems to duplicate CFLAGS if you don't pass them in...20:55
*** exsdev has joined #openstack-infra20:56
AJaegerSorry, no idea how wheel building handles flags - in this case it looks ok with external CFLAGS, but less so without20:56
*** rfarr has quit IRC20:58
fungiyeah, i suspect there's some error in their makefile where cflags is being set conditionally20:59
*** dosaboy has joined #openstack-infra21:01
fungii'm not finding it though21:02
fungimight be something in how setuptools works21:03
fungiit does do some handling of cflags, looks like: https://github.com/pypa/setuptools/blob/master/setuptools/command/build_clib.py#L19-L2021:04
*** Wryhder has joined #openstack-infra21:11
*** Lucas_Gray has quit IRC21:11
*** Wryhder is now known as Lucas_Gray21:12
*** lpetrut has quit IRC21:12
*** slaweq_ has joined #openstack-infra21:14
*** gfidente|afk has quit IRC21:15
*** slaweq has quit IRC21:15
*** slaweq_ is now known as slaweq21:15
ianwhello21:33
*** Wryhder has joined #openstack-infra21:38
*** Lucas_Gray has quit IRC21:39
*** Wryhder is now known as Lucas_Gray21:39
ianwsorry, catching up.21:41
ianwclarkb: i can look at new arm64 cloud if you like21:41
ianwahh, i see i got the details via mail, will look at21:42
ianwfungi: looks like you've made good progress on modernising our wheel infra a bit ... still think we want a small spec?  i have that on my todo21:43
openstackgerritAntoine Musso proposed opendev/gear master: inline helps for interactive commands  https://review.opendev.org/6659121:45
fungiianw: mainly hitting incremental improvements which are independent of the indexing problem but can also make indexing easier21:45
ianwAJaeger: thanks for pushing on the trusty removal!  i think we can purge all that from dib now too21:45
fungispec could probably be limited to the indexing implementation?21:45
ianwfungi: ok, yep i think still useful so we can get feedback from everyone in a more formal manner21:46
*** rcernin has joined #openstack-infra21:49
ianwp.s. just like to note that as i prediced @ http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2020-01-15.log.html#t2020-01-15T23:48:47 the cable provider was unable to figure out how to provide a cable21:50
*** eharney has joined #openstack-infra21:50
fungiwell, providing cables is far from what i would expect from a cable provider21:52
*** xek has quit IRC22:03
hasharfungi: ""we're out of zuul stickers"" in french that is:  "nous n'avons plus d'autocollants Zuul" ;]22:06
*** jamesmcarthur has joined #openstack-infra22:16
*** Lucas_Gray has quit IRC22:20
*** Lucas_Gray has joined #openstack-infra22:22
fungihashar: perfect! i'm all set for fosdem now22:25
hasharfungi: ah fosdem, that is a good even though overwheelming.  If you get 10k stickers, you would be set22:30
hasharis there a Zuul booth there?22:31
fungiopenstack foundation will have a community table for all osf projects, including zuul22:31
fungiit's on the second level, so may have less traffic, but it's both days of the conference22:31
fungiif anybody's planning to be there and wants to help, see https://etherpad.openstack.org/p/fosdem-2020 where we're starting to coordinate22:32
*** pkopec has quit IRC22:33
hasharI was supposedly in the us at that time but change of plan ..22:34
hasharit is a bit too late to find a hotel / travel there though ;D22:35
hasharit is definitely a great conference anyway22:35
hasharhave fun there :]22:35
fungithere's always next year!22:35
fungithanks, i hope to!22:35
hasharyeah 2021 surely22:35
*** slaweq has quit IRC22:36
*** adam_g has quit IRC22:40
*** adam_g has joined #openstack-infra22:43
*** apetrich has joined #openstack-infra22:43
openstackgerritSorin Sbarnea proposed opendev/gear master: packaging: updated project urls  https://review.opendev.org/70342222:44
openstackgerritSorin Sbarnea proposed opendev/gear master: Add extra python jobs  https://review.opendev.org/70342522:46
openstackgerritSorin Sbarnea proposed opendev/gear master: packaging: updated project urls  https://review.opendev.org/70342222:47
*** tkajinam has joined #openstack-infra22:51
*** jtomasek has quit IRC22:53
*** hashar has quit IRC23:14
clarkbianw: cool thanks23:15
* clarkb is back from a long bike ride and realizes that he probably won't catch up on all the backlog items23:40
clarkbfeel free to ping me if I can help with anything urgent23:40
* clarkb gets infra meeting agenda out23:40
*** dchen has joined #openstack-infra23:48
*** tosky has quit IRC23:51
openstackgerritClark Boylan proposed opendev/system-config master: Update project doc to reflect OpenDev changes  https://review.opendev.org/70348823:58
clarkbianw: ^ thank you for the feedback. Does that read better now?23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!