Wednesday, 2019-05-22

*** altlogbot_1 has quit IRC00:10
*** altlogbot_1 has joined #openstack-requirements00:12
openstackgerritTony Breeds proposed openstack/requirements master: update warlock due to bug on 1.3.1  https://review.opendev.org/66052900:28
*** dangtrinhnt has quit IRC02:21
*** dangtrinhnt has joined #openstack-requirements02:22
*** dangtrinhnt has quit IRC02:23
*** udesale has joined #openstack-requirements04:11
prometheanfiretonyb: so, one of the items on my todo is to write out what happened, are we talking about having to place caps on py2 stuff or other things?04:39
tonybprometheanfire: Why we need it, why there was a sudden rash of them rather than at release time how the timing of the bandit change didn't help04:40
tonybto restore faith in teh team and identify things we can chnage to avoid it happenign again04:41
tonybprometheanfire: I wrote a thing: http://lists.openstack.org/pipermail/openstack-discuss/2019-May/006478.html04:42
* tonyb really hopes it makes sense04:42
prometheanfireoh, nice04:44
* tonyb has done abot 20% of the "fix lc env" work but once they're submitted we'll see that nearly all projects have broken lower-constraints04:50
tonybWe should document the best way to setup tox.ini04:51
tonyband the right way to deal with service dependancies04:51
tonybthere is some real cruft out there04:52
prometheanfiretonyb: heh, pgp could not be verified, I thought we cross signed at some point04:54
tonybprometheanfire: I don't think so04:55
tonybprometheanfire: I know we talked about doing after the last Vancouver summit but I don't think we ever did04:55
tonybprometheanfire: We should do it at the next North American summit04:56
prometheanfireah04:56
prometheanfireya04:56
prometheanfireI always have my pgp slips for keysigning in my bag04:56
tonybhehe04:59
* tonyb is not that organised04:59
* tonyb also pretty much never has a pssport on him 05:00
prometheanfirewell, I know I should check but a regular ID would work well enough, feel like I know you somehow05:02
prometheanfirecross glance failed on the uc update :|05:19
*** mwhahaha has quit IRC05:30
*** rm_work has quit IRC05:31
*** dustinc has quit IRC05:31
*** mwhahaha has joined #openstack-requirements05:33
dirkSo wer don't run a python3 devstack on our uc changes?05:34
*** dustinc has joined #openstack-requirements05:34
*** rm_work has joined #openstack-requirements05:34
dirktonyb: that email is missing the UPPER/TOX constraints file change that I suggested to do at the same time to not have two sets of 600 patches to propose05:39
dirktonyb: should I be replying?05:40
tonybdirk: I thought that got pushback from infra so I figured it was shelved05:40
prometheanfireUSE_PYTHON3 is false05:40
prometheanfiredirk: looks like our tempest-full is py205:41
dirktonyb: did it? There were some comments from AJ which I addressed05:41
tonybYeah we probably do more with py2 than we should but that's a cycle goal for train to switch tp py3 so ... we can do that :)05:41
dirkprometheanfire: we should add a py3 job05:42
prometheanfiredirk: indeed05:42
prometheanfireI still wonder why pip was pulling in py3 packages for some things05:43
tonybprometheanfire: why wouldn't it?05:43
tonybdirk: I don't see a +2 there05:46
tonybdirk: I'd rather not hold up the constraints stuff as we're getting more and more "bogus" changes05:47
tonybdirk: https://review.opendev.org/#/q/owner:zhangyuan1%2540chinaunicom.cn05:47
prometheanfiretonyb: I just expect it to be smarter, if it's metadata says  Requires: Python >=3.5, that info should be used, I guess05:47
prometheanfirethough I guess it's not used05:48
tonybYeah clearly not used and pip can't use it ... until it gets a depsolver05:49
prometheanfireyep05:49
* prometheanfire is used to gentoo too much05:51
prometheanfireseems like the only fix would be to fix constraints usage (or non-usage)05:52
* prometheanfire shouldn't have taken that nap, will be up all night05:54
dirktonyb: well, a -1 can be put on stuff now that the email is out05:55
dirkLet me see if I can lobby for reviews05:56
tonybprometheanfire: constraints get us a long way but we still need the py2 caps05:56
prometheanfireya, it's a two pronged thing05:57
prometheanfirehttps://etherpad.openstack.org/p/reqs-py2-caps05:58
prometheanfirethat's my email (more or less)05:58
tonybprometheanfire: I'm not sure that adds any value :/05:59
tonybprometheanfire: it doesn't discuss or mention that we weer using older wheels unil May 10 and that's why we didn't hit the sphinx thing until then06:00
prometheanfireI didn't really think it does, it's more a small tag on to your email06:00
prometheanfireI didn't know that06:00
prometheanfireI don't have all the context as to what was fixed06:00
tonybprometheanfire: okay don't worry then06:01
prometheanfiresorry, it's a starting point at least06:01
tonybI think there is still value but it's nearly 2 weeks since things went bang06:01
prometheanfireso it was an issue with mirroring?06:01
prometheanfireas well06:01
tonybAFS wouldn't release and it wasn't noticed06:01
tonybonce that was fixed we suddenly tarted building/using new wheels06:02
tonybthere *may* be some work to do around NOT building py2.py3 wheels for things that are py3 only but I don't understand most of that06:02
tonybI think we really need py2 and py3 integration job so we have a chance of detecting this next time06:03
prometheanfireadded    * AFS was locked (and not noticed), causing wheel builds / mirroring issues infra side06:03
tonybcool06:03
tonybI s'psoe we can flesh it out tomorrow06:03
prometheanfireya, I agree (about py3 job)06:03
prometheanfirefor some reason I thought dirk already proposed the py3 tempest change06:04
openstackgerritOpenStack Proposal Bot proposed openstack/requirements master: Updated from generate-constraints  https://review.opendev.org/66056606:13
*** dtantsur|afk is now known as dtantsur06:28
*** e0ne has joined #openstack-requirements06:29
dirkprometheanfire: we used to have a tempest-full-py3 on opensuse job but it seems it got removed from the checks06:48
dirkno idea why06:48
openstackgerritDirk Mueller proposed openstack/requirements master: Add tempest-python3 job  https://review.opendev.org/66058006:54
openstackgerritDirk Mueller proposed openstack/requirements master: Updated from generate-constraints  https://review.opendev.org/66056606:54
*** e0ne has quit IRC06:57
*** tosky has joined #openstack-requirements07:21
*** hberaud|gone is now known as hberaud07:44
*** e0ne has joined #openstack-requirements08:12
evrardjphey08:20
evrardjpconsider me john snow here ... I have a problem with latest bump of M2Crypto, for which the pip wheel doesnt' seem to build08:21
evrardjphttps://github.com/openstack/requirements/commit/d2699d3a8de1a24a2358d1dc360de2ae15d056c008:22
evrardjpThere are two things I want to discuss: 1) Can we make sure, before we merge things, to have a job to build requirements with pip wheel?08:22
evrardjp2) Where does this M2Crypto bump come from?08:23
*** ccamacho has joined #openstack-requirements08:23
evrardjpI can understand that 3 days ago docker bump was triggered, and from that, a few things were bumped, but none of those have M2Crypto in their dependency chain.08:24
evrardjpOh I guess it comes from pywbem on the same day08:26
evrardjplet me dig deeper... (question 1 still stands)08:26
evrardjpLOCI has a build wheel job if you like08:33
evrardjpbut this can also be a one liner thing in some new job08:33
tonyb[m]evrardjp: I'll look tomorrow at the wheel thing but we shouldn't be able to land anything that doesn't fundamentally exist and install09:28
tonyb[m]evrardjp: in terms of where bit came from it may be as simple at it was published to pypi so we added it09:29
tonyb[m]evrardjp: can you explain the error you're seeing in a little more detail?09:29
openstackgerritMerged openstack/requirements master: update constraint for oslo.log to new release 3.44.0  https://review.opendev.org/66046909:31
openstackgerritMerged openstack/requirements master: update constraint for oslo.rootwrap to new release 5.16.0  https://review.opendev.org/66046809:31
openstackgerritMerged openstack/requirements master: update constraint for oslo.cache to new release 1.35.0  https://review.opendev.org/66046709:31
openstackgerritMerged openstack/requirements master: update constraint for oslo.service to new release 1.39.0  https://review.opendev.org/66046609:37
openstackgerritMerged openstack/requirements master: update constraint for taskflow to new release 3.6.0  https://review.opendev.org/66046509:37
evrardjpevrardjp: sure thing, we have two issues in loci right now.09:37
evrardjpThe first one will be solved here: https://review.opendev.org/#/c/660254 -- basically warlock fails to `pip wheel` in 1.3.1. That code was just a broken thing, which was fixed in 1.3.3, so let's skip that for now. (However if we had a test to ensure wheels can be built, then that would have been fine, as 1.3.1 would not have been bumped, and issue would have been fixed earlier upstream)09:38
evrardjpthe second is more complex. By adding pywbem https://github.com/openstack/requirements/commit/1970ac7a9234fa095d82d432fda4857f565de545 we basically pulled its requirements https://github.com/openstack/requirements/commit/d2699d3a8de1a24a2358d1dc360de2ae15d056c009:40
evrardjpthat's fine, except that M2Crypto fails to build its wheels under centos/ubuntu in LOCI, because we are using the distro provided openssl-devel libraries09:40
evrardjp(first log here, let me create a cleaner log for you: http://logs.openstack.org/93/660493/1/check/loci-requirements/e217427/job-output.txt.gz#_2019-05-21_19_08_34_839694 )09:42
openstackgerritMerged openstack/requirements master: update constraint for metalsmith to new release 0.12.0  https://review.opendev.org/66047009:52
openstackgerritMerged openstack/requirements master: update constraint for ironic-lib to new release 2.17.0  https://review.opendev.org/66047609:52
openstackgerritMerged openstack/requirements master: update constraint for oslo.messaging to new release 9.7.0  https://review.opendev.org/66047509:52
evrardjphttps://gist.github.com/evrardjp/1b6b52aef5b68b04abe09ce080a31d4809:59
openstackgerritMerged openstack/requirements master: update constraint for oslo.db to new release 5.0.0  https://review.opendev.org/66048010:05
openstackgerritMerged openstack/requirements master: Updated from generate-constraints  https://review.opendev.org/66025410:05
*** hberaud is now known as hberaud|lunch10:13
openstackgerritMatthew Thode proposed openstack/requirements master: Add tempest-python3 job  https://review.opendev.org/66058010:24
openstackgerritMatthew Thode proposed openstack/requirements master: Updated from generate-constraints  https://review.opendev.org/66056610:24
*** toabctl has joined #openstack-requirements10:58
*** hberaud|lunch is now known as hberaud11:10
*** udesale has quit IRC11:30
*** udesale has joined #openstack-requirements11:31
openstackgerritDirk Mueller proposed openstack/requirements master: Add tempest-python3 job  https://review.opendev.org/66058012:10
*** zul has joined #openstack-requirements13:01
*** dtantsur is now known as dtantsur|brb13:29
*** dtantsur|brb is now known as dtantsur14:29
*** udesale has quit IRC14:44
*** udesale has joined #openstack-requirements14:44
*** tosky has quit IRC14:45
*** tosky has joined #openstack-requirements14:46
*** udesale has quit IRC16:38
*** udesale has joined #openstack-requirements16:43
*** e0ne has quit IRC16:51
*** udesale has quit IRC17:12
openstackgerritDirk Mueller proposed openstack/requirements master: Updated from generate-constraints  https://review.opendev.org/66056617:32
*** samueldmq has joined #openstack-requirements17:51
*** hberaud is now known as hberaud|gone17:58
*** tosky has quit IRC18:30
*** tosky has joined #openstack-requirements18:30
openstackgerritDouglas Mendizábal proposed openstack/requirements master: Stop Requirements Sync for castellan-ui  https://review.opendev.org/66080719:13
*** e0ne has joined #openstack-requirements19:15
tonyb[m]evrardjp:  thanks I understand now.20:30
tonyb[m]prometheanfire: I'll start the meeting from my phone until I can make coffee20:30
prometheanfiretonyb[m]: kk20:31
prometheanfire#startmeeting requirements20:31
openstackMeeting started Wed May 22 20:31:35 2019 UTC and is due to finish in 60 minutes.  The chair is prometheanfire. Information about MeetBot at http://wiki.debian.org/MeetBot.20:31
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.20:31
*** openstack changes topic to " (Meeting topic: requirements)"20:31
openstackThe meeting name has been set to 'requirements'20:31
tonyb[m]O/20:31
prometheanfire#topic rollcall20:31
*** openstack changes topic to "rollcall (Meeting topic: requirements)"20:31
prometheanfire tonyb, prometheanfire, number80, dirk, coolsvap, toabctl, smcginnis, dhellmann ping20:32
prometheanfireo/20:32
tonyb[m]smcginnis: is in Barcelona ATM so probably won't be here20:32
tonyb[m]... as is dhellmann20:32
prometheanfireyep20:32
prometheanfire#topic controversies in the queue20:34
*** openstack changes topic to "controversies in the queue (Meeting topic: requirements)"20:34
*** e0ne has quit IRC20:34
prometheanfireI think we are generally fine here20:35
tonybYeah20:36
prometheanfire#topic email the list for issues we had a couple of weeks ago20:36
*** openstack changes topic to "email the list for issues we had a couple of weeks ago (Meeting topic: requirements)"20:36
prometheanfire#link https://etherpad.openstack.org/p/reqs-py2-caps20:36
tonybI'll make time to add my thoughtts today.20:38
prometheanfireok, thanks20:38
prometheanfire#topic open floor20:38
*** openstack changes topic to "open floor (Meeting topic: requirements)"20:38
* tonyb has 2 things20:39
tonyb1) ... following on from the courtesy pings discussion on the m/l20:39
tonybI think we should clean out our list20:39
*** e0ne has joined #openstack-requirements20:40
prometheanfireour list?20:40
tonybI suggest we update the wiki with "ping list started Jun15" and opt in again20:40
tonybthen from Jun 15 we stop pinging the existing list20:40
prometheanfireoh, for roll call, ya20:40
tonybas I don't see number80, tobctl or coolsvap at all20:40
prometheanfire:D20:41
tonybShall I do a picard ... and make it so?20:41
*** e0ne has quit IRC20:41
prometheanfireplease do20:42
prometheanfirethe other item?20:42
tonybsorry multitasking20:43
prometheanfirenp20:43
tonybevrardjp: brought up that our 'check-uc' jobs install things but don't build wheels20:43
smcginnistonyb[m]: Actually not in Barcelona. Plans were changed for me.20:43
tonyb(which I need to investigate but assuming that's right)20:43
tonybsmcginnis: Oh dear!20:43
smcginnisYeah, it's been an interesting few days.20:44
tonybso do we feel about adding a LOCI job or similar to build the wheels in our check and gate pipelines?20:44
dirko/20:44
prometheanfiretonyb: is it our job to build/ship wheels?20:45
prometheanfireI understand we may want to check if they are available20:45
tonybprometheanfire: no but it is our job to ensure things work and are installable20:45
prometheanfireright, adding a job for checking that makes sense20:45
tonybIMO adding a job like this will have our consumers pain so it's something we shoudl consider20:46
dirkso the issue was that  osh got a constraints update where the wheels was not buildable?20:46
dirkon some distribution?20:46
dirkor on any distribution? I guess I'm missing some detail20:46
tonybdirk: Yeah, it looks like perhaps only centos was/is broken20:46
tonyb... evrardjp says: M2Crypto fails to build its wheels under centos/ubuntu in LOCI20:47
prometheanfiretonyb: so would we be building wheels (I assume so) and if so would we be shipping them (that's releases / infra's job right?)20:48
tonybso it's worth looking at why (and he provides a log) and if it's LOCI specific20:48
prometheanfireif we ship them how do we not become the mirror everyone uses20:48
tonybprometheanfire: we'd just build them and discard them20:48
tonybprometheanfire: infra will do the building for our internal mirrors20:48
smcginnisSeems a little outside our scope.20:48
dirkI guess I'm not following why we'd care about that20:49
dirkdo we want to avoid that the infra build-wheels job gets broken?20:49
prometheanfiretonyb: ok, build only makes more sense20:49
tonybsmcginnis: I see it as a completion of what check-uc* does20:49
prometheanfireya, co-installability extension20:50
tonybsmcginnis: to be completely open I *thought* that check-uc did build wheels as part of the install process20:50
prometheanfireI think it's worth doing, possibly in the same job as check-uc (since it has time and it's an extension)20:52
dirkhmm, I thought I've seen bindep related issues there as well in the past20:52
tonybSo it sounds like if I do some research and then write up the plan we can discuss it again noone is *hard* against it20:53
prometheanfiresgtm20:53
prometheanfiretonyb: so, three action items then20:53
prometheanfireetherpad, pings and wheels20:54
tonybit could be a corner case where what we do in check-uc is fine but slightly diffeent to what LOCI needs/does in which case it might just be we add them as a cross job like nova or keystone20:54
prometheanfireyep20:55
tonybhuzzah20:55
prometheanfireanyone have anything else?20:55
dirkyeah20:55
dirkI've seen the requests CVE bump abandoned, what did I miss again?20:55
prometheanfireI didn't abandon it iirc20:56
prometheanfireyou have links to the reviews? abandon reason should be there20:57
dirkhttps://review.opendev.org/#/c/640727/20:57
prometheanfireugh20:57
prometheanfiregertty was being stupid20:57
dirkI am not sure I understand what "python is dumb" means20:57
prometheanfireI was trying to abandon my 'test python intel' patch20:58
prometheanfireno clue why it selected those20:58
dirkI guess mistakes happen20:58
prometheanfireya20:58
dirkcan you unabandon it? I forgot to follow the mailthread, I'll do so20:58
prometheanfireya20:59
prometheanfirejust did20:59
dirkthere was some other ping that you sent me a week ago or so, but I wasn't able to reread it as I lost the irc history (was migrating bouncer implementation)20:59
dirkwhat was the action item for me?20:59
tonybhttps://review.opendev.org/#/c/640710/ ?20:59
prometheanfireso, I'm not sure we are any further for being able to do security patches20:59
prometheanfirethat one too, thanks21:00
prometheanfireok, all restored now (there were a couple of others)21:01
tonybokay21:01
tonyblooks like https://review.opendev.org/#/q/topic:tox_constraints+is:open is moving along21:02
prometheanfireanything else?21:02
tonybso I'll include that in the updates I do21:02
prometheanfirethanks21:03
tonybdirk: do you mind if I add some Depends-On to you changes so we can things up safely?21:03
dirktonyb: the comment about django upper-constraints.. I think horizon installs unconstraint, so I guess changing upper-constraints is mostly a documentation exercise21:04
dirkI'll add a link to the review, I wanted to double check things and maybe see if a fix can be done first21:05
tonybdirk: okay21:05
dirktonyb: you mean the tox_constraings part? yes, sure, go ahead21:05
dirktonyb: I wanted to lobby on -infra for a 2nd core review, but it seems people are distracted with some infra issue21:05
dirkor rather, I didn't want to distract them from fixing the outage21:06
tonybdirk: yeah basially make sure we can't land things in a breaking order21:06
tonybdirk: cool beans21:06
tonybdirk: I can +1 the release update21:06
prometheanfireok, gonna end it here21:08
tonyb+121:08
prometheanfire#endmeeting21:09
*** openstack changes topic to "OpenStack Requirements - IRC meetngs on Wednesdays @ 07:00 UTC in here in #openstack-requirements - See agenda @ http://tinyurl.com/h44ryuw - IRC channel is *LOGGED* @ http://tinyurl.com/j38rk24"21:09
openstackMeeting ended Wed May 22 21:09:25 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:09
openstackMinutes:        http://eavesdrop.openstack.org/meetings/requirements/2019/requirements.2019-05-22-20.31.html21:09
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/requirements/2019/requirements.2019-05-22-20.31.txt21:09
openstackLog:            http://eavesdrop.openstack.org/meetings/requirements/2019/requirements.2019-05-22-20.31.log.html21:09
dirktonyb: I would hope the TOX_CONSTRAINTS rename is finished relatively quickly, and then we can include that cleanup in one go, that was my main concern21:17
tonyb[m]Yeah it they merge I can do it in a single change if not we can do it at the same time21:37
tonyb[m]We need to look at branches and zuul jobs21:37
prometheanfiredirk: nice replies :D22:16
*** hberaud|gone has quit IRC22:36
*** tosky has quit IRC23:11
*** tosky has joined #openstack-requirements23:11
prometheanfiredirk: I'll review them tonight hopefully (D&D may interfere)23:29
*** tosky has quit IRC23:34
openstackgerritDirk Mueller proposed openstack/requirements stable/ocata: Cap keyring and scikit-learn on python2  https://review.opendev.org/66086023:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!