Monday, 2018-01-29

*** bobh has joined #openstack-release00:01
*** bobh has quit IRC00:06
*** lbragstad has joined #openstack-release00:14
*** bobh has joined #openstack-release00:20
*** bobh has quit IRC00:24
*** bobh has joined #openstack-release00:31
*** bobh has quit IRC00:35
*** bobh has joined #openstack-release00:40
*** bobh has quit IRC00:45
*** gcb has joined #openstack-release00:53
openstackgerritAkihiro Motoki proposed openstack/releases master: Release django-openstack-auth 4.0.0 for project retirement  https://review.openstack.org/53870900:58
*** gcb has quit IRC01:21
*** mriedem has quit IRC01:37
*** ricolin has joined #openstack-release01:55
*** hongbin has joined #openstack-release02:06
*** armax has joined #openstack-release02:14
*** yamamoto has joined #openstack-release02:58
*** harlowja has joined #openstack-release03:11
*** harlowja has quit IRC03:18
*** dave-mccowan has quit IRC03:20
*** jgwentworth is now known as melwitt03:26
*** hongbin has quit IRC04:04
*** kumarmn_ has joined #openstack-release04:07
*** kumarmn has quit IRC04:11
*** sree has joined #openstack-release04:19
openstackgerritBrian Rosmaita proposed openstack/releases master: DNM: Release Glance Q-3  https://review.openstack.org/53828804:20
*** ykarel has joined #openstack-release04:21
*** rosmaita has quit IRC04:26
*** armax has quit IRC04:49
*** claudiub|2 has joined #openstack-release05:07
*** hongbin has joined #openstack-release05:09
prometheanfiremordred: looks like it's still failing05:23
*** hongbin has quit IRC05:28
*** wolverineav has joined #openstack-release05:49
*** ykarel is now known as ykarel|lunch07:35
*** gcb has joined #openstack-release07:39
*** pcaruana has joined #openstack-release07:44
*** jtomasek has joined #openstack-release08:01
*** zhenguo has joined #openstack-release08:16
*** d0ugal has quit IRC08:22
*** alexchadin has joined #openstack-release08:25
*** d0ugal has joined #openstack-release08:28
*** ykarel|lunch is now known as ykarel08:37
openstackgerritChristophe Sauthier proposed openstack/releases master: Release python-cloudkittyclient 1.2.0 for Queens  https://review.openstack.org/53882908:37
huatsdhellmann: thnanks for the example, I'll have a look to know how to use that next time...08:39
huatsdhellmann: I haven't been able to push the release before the weekend (and I got some personal issue the last 2 days...). SOrry for the delay then...08:39
*** jpich has joined #openstack-release08:41
*** amoralej|off is now known as amoralej08:53
*** alexchadin has quit IRC08:58
openstackgerritChandan Kumar proposed openstack/releases master: Release python-tempestconf-1.1.4  https://review.openstack.org/53884008:58
*** alexchadin has joined #openstack-release08:58
*** d0ugal has quit IRC09:00
*** finucannot is now known as sfinucan09:12
*** sfinucan is now known as stephenfin09:12
*** d0ugal has joined #openstack-release09:20
*** yamahata has quit IRC09:28
*** yamamoto has quit IRC09:30
openstackgerritMasahito Muroi proposed openstack/releases master: Release blazar-dashboard 1.0.0 for Queens  https://review.openstack.org/53817509:39
*** shardy has joined #openstack-release09:43
*** yamamoto has joined #openstack-release09:47
openstackgerritMasahito Muroi proposed openstack/releases master: Release blazar-nova for queens  https://review.openstack.org/53813909:51
*** sree has quit IRC10:01
*** sree has joined #openstack-release10:02
*** sree has quit IRC10:11
*** gcb has quit IRC10:29
*** lucas-afk is now known as lucasagomes10:37
openstackgerritRenat Akhmerov proposed openstack/releases master: Release python-mistralclient 3.1.5 for Queens  https://review.openstack.org/53843810:47
*** gcb has joined #openstack-release10:53
*** alexchadin has quit IRC10:55
*** alexchadin has joined #openstack-release10:55
*** gcb has quit IRC10:59
*** alexchadin has quit IRC10:59
-openstackstatus- NOTICE: Zuul is currently under heavy load. Do not *recheck* or *approve* any changes.11:03
*** alexchadin has joined #openstack-release11:04
*** electrofelix has joined #openstack-release11:06
*** alexchadin has quit IRC11:07
*** gcb has joined #openstack-release11:17
*** gcb has quit IRC11:18
*** alexchadin has joined #openstack-release11:30
*** alexchadin has quit IRC11:33
*** alexchadin has joined #openstack-release11:41
*** alexchadin has quit IRC11:43
*** alexchadin has joined #openstack-release12:02
*** sree has joined #openstack-release12:10
*** pkovar has joined #openstack-release12:12
*** sree_ has joined #openstack-release12:27
*** sree_ is now known as Guest4021512:27
openstackgerritGabriele Cerami proposed openstack/reno master: Add option to pass a yaml data file to be used when rendering the template  https://review.openstack.org/53823312:29
*** pkovar has quit IRC12:30
*** sree has quit IRC12:30
*** rosmaita has joined #openstack-release13:06
*** amoralej is now known as amoralej|lunch13:07
*** pkovar has joined #openstack-release13:11
*** Guest40215 has quit IRC13:13
*** alexchad_ has joined #openstack-release13:22
*** alexchadin has quit IRC13:24
-openstackstatus- NOTICE: Zuul is currently under heavy load. Do not *recheck* or *approve* any changes until we give the go ahead.13:33
*** ChanServ changes topic to "Zuul is currently under heavy load. Do not *recheck* or *approve* any changes until we give the go ahead."13:33
*** alexchadin has joined #openstack-release13:34
*** alexchad_ has quit IRC13:37
*** d0ugal has quit IRC13:38
*** d0ugal has joined #openstack-release13:38
*** edmondsw has joined #openstack-release13:41
*** alexchadin has quit IRC13:43
smcginnisdhellmann: I saw we had a release job failure Sunday. Do you know what that was?13:44
*** tellesnobrega has quit IRC13:44
*** tellesnobrega has joined #openstack-release13:45
* ttx looks13:46
*** alexchadin has joined #openstack-release13:47
ttxbeh, that finger URL doesn't help13:48
smcginnisttx: Yeah, I don't know what to do with those.13:49
huatsIf someone has an idea why https://review.openstack.org/#/c/538829 fail ?13:51
huatsI'll be happy to hear it :)13:51
ttxsmcginnis: so it's probably the post-job after http://git.openstack.org/cgit/openstack/releases/commit/?id=ceeb3cea0d72f37ef7493f507156f172053b7595 merged13:52
ttxalthough the tag was pushed there13:52
ttxSo the only issue is that the publish static job failed to rnu afterwards13:53
ttxso that 0.11.0 release doesn;t show on https://releases.openstack.org/queens/index.html#python-openstacksdk13:53
ttxBut it will on the next run of teh job13:53
ttxSo that Sunday fail was safe. No idea what happened though13:55
ttxhuats: let me have a look13:55
ttxMERGER_FAILURE -- that's a new one13:56
ttxProbably a failure due to zuul's heavy load13:56
huatsok13:57
*** sree has joined #openstack-release13:58
*** ykarel is now known as ykarel|away14:00
*** yamamoto has quit IRC14:01
*** mriedem has joined #openstack-release14:03
*** sree has quit IRC14:03
*** kumarmn_ has quit IRC14:04
*** kumarmn has joined #openstack-release14:05
*** zhenguo has quit IRC14:05
*** ykarel|away has quit IRC14:06
huatsso I just wait a bit and ask for a recheck ttx ?14:06
ttxI'd wait until infra says it's ok to recheck14:07
huatsok14:07
ttxsince they are in the process of restarting it14:07
huatsI can wait :)14:07
huatsthanks14:07
dhellmanno/14:08
*** kumarmn has quit IRC14:09
dhellmannttx: did the python-openstacksdk release make it to pypi?14:10
ttxchecking14:10
ttxyes14:10
dhellmannI dont' see 0.11.0 in https://pypi.python.org/pypi/python-openstacksdk/json14:10
ttxhttps://pypi.python.org/pypi/openstacksdk14:11
dhellmannah14:11
dhellmannwrong name14:11
*** yamamoto has joined #openstack-release14:18
*** kumarmn has joined #openstack-release14:24
*** edmondsw has quit IRC14:25
*** superdan is now known as dansmith14:28
*** edmondsw has joined #openstack-release14:28
-openstackstatus- NOTICE: we've been able to restart zuul, and re-enqueue changes for gate. Please hold off on recheck or approves, we are still recovering. More info shortly.14:30
mordreddhellmann, ttx: yah - that naming split is on the list to fix (need to do a repo rename)14:31
*** ykarel|away has joined #openstack-release14:34
*** dave-mccowan has joined #openstack-release14:34
*** pkovar has quit IRC14:41
*** amoralej|lunch is now known as amoralej14:42
*** gcb has joined #openstack-release14:52
*** ykarel|away has quit IRC14:53
*** pkovar has joined #openstack-release14:58
*** lucasagomes is now known as lucas-hungry15:01
*** pkovar has quit IRC15:04
*** pkovar has joined #openstack-release15:06
*** yamahata has joined #openstack-release15:10
*** hongbin has joined #openstack-release15:12
openstackgerritDoug Hellmann proposed openstack/releases master: extend missing-releases to look at pypi  https://review.openstack.org/53894315:14
openstackgerritDoug Hellmann proposed openstack/releases master: set up local variable 'version'  https://review.openstack.org/53894415:14
openstackgerritDoug Hellmann proposed openstack/releases master: extend missing-releases to look for specific package types on PyPI  https://review.openstack.org/53894515:14
dhellmannsmcginnis , ttx: ^^ should help with future job failure debugging15:14
smcginnisNice!15:15
*** bobh_ has joined #openstack-release15:26
ttxnice indeed!15:27
dhellmanntfw you go to write a tool and discover it already exists15:27
dhellmannI updated the plan for next cycle to write that command so it just includes the details currently missing from the command that already exists :-)15:28
smcginnisI think we've had that happen a couple times now in the last few months. :)15:28
ttxI did not approve anything this morning to not overload broken gate15:28
* ttx checks current situation15:28
dhellmannthat's a sure sign I need to move on to a new project ;-)15:28
*** bobh_ has quit IRC15:28
smcginnisttx: I just checked.15:28
smcginnisInfra would still like us to hold off.15:29
ttxWe should prioritize q3 tags later today I guess15:29
smcginnis++15:29
dhellmannthere are a few libs up for release that prometheanfire didn't mention in his email. are those not in g-r?15:31
smcginnisdhellmann: neutron-vpnaas?15:32
dhellmannpython-cloudkittyclient15:34
dhellmannswiftclient15:34
dhellmannpython-zaqarclient15:35
dhellmannwe really can't freeze requirements until we can get those releases done15:35
smcginnisOh, client libs. Yeah, those need to get through.15:35
cmurphystill hoping https://review.openstack.org/#/c/537645/ will make it through too :/15:36
*** alexchadin has quit IRC15:37
dhellmannsmcginnis : we need to be careful about branching libs now. If we branch with a new release, that more or less requires us to make that release work with the u-c list15:37
dhellmannin fact it is probably safer for us to update our process to say that the release team will create branches for the libs based on the most current release in u-c after the freeze15:38
*** sree has joined #openstack-release15:43
*** claudiub has joined #openstack-release15:46
*** gcb has quit IRC15:47
*** claudiub|3 has joined #openstack-release15:48
*** claudiub|2 has quit IRC15:49
smcginnisdhellmann: client and non-client libs?15:50
smcginnisdhellmann: That does make sense.15:51
*** claudiub has quit IRC15:51
smcginnisThough we can still do "stable" releases off of the branch if really needed, it would make it simpler for us to just run the script and branch them all at freeze.15:51
*** bswartz has quit IRC15:53
prometheanfiredhellmann: at this point reqs isn't freezing on time, gate was restarted again...15:55
*** inc0 has joined #openstack-release15:56
*** sree_ has joined #openstack-release15:57
prometheanfiredhellmann: as far as freezing goes, it's gr mainly that we need to be concerned about though15:57
*** sree_ is now known as Guest6445615:57
*** sree has quit IRC15:59
*** lucas-hungry is now known as lucasagomes15:59
dhellmannok, I thought we froze constraints, too16:01
prometheanfirewe do16:02
dhellmannsmcginnis : I guess once we release a bug fix version we have to make the branch there, otherwise there are no version numbers available for more bug fixes16:02
smcginnisdhellmann, prometheanfire: Did you both see the ML post about django-openstack-auth? Sounds like it might be easier if we get that through before freeze as well.16:02
dhellmannunless we did something like skip a version on the stable branch16:02
dhellmannsmcginnis : did you see my comment on that release request?16:02
prometheanfirefor d-j-a, I thought that was removed from requirements16:03
smcginnisdhellmann: No, I haven't looked at the actual patch yet.16:03
dhellmannwe still have a few projects that use it16:03
dhellmannso it's not clear what releasing a breaking version is going to do to those projects16:03
prometheanfireya, d-o-a is not in upper-constraints16:03
smcginnisdhellmann: Akihiro responded on there.16:03
dhellmannah, I just saw that16:04
amotokiprometheanfire: yes, I dropped d-o-a a while ago, but considering the suggestion of transition package, if horizon adds a dependency of the transition package of d-o-a, we need to re-add it to g-r. otherwise the check-req job complains.16:07
prometheanfireamotoki: ah, so that's the reason16:08
dhellmannsmcginnis , ttx: what do you want to do with neutron-vpnaas? https://review.openstack.org/#/c/538295/1 has it as a b3 tag but there were not other tags this cycle16:10
dhellmannwe usually leave the deadline for new deliverables as the 2nd milestone16:11
smcginnisI think that was an oversight in Neutron. Not sure.16:11
dhellmannyes, well16:11
smcginnisOther option is to have them do it as independent for now, then get them on cycle milestones in Rocky, right?16:12
dhellmannit's not a new-new project, there are older releases16:12
dhellmannjust not for queens16:12
dhellmannactually it hasn't been released since newton16:12
smcginnisI seem to recall a discussion about it going away, then some folks jumping in to support it.16:13
dhellmannyeah, looking at the repo they do have an 1116:13
smcginnisdhellmann: They've been doing their own releases?16:13
dhellmannit looks like it16:14
dhellmannwe should probably check the permissions16:14
smcginnisHmm, yeah. September 4th.16:14
smcginnisWith just an 11.0.0.0rc1 on Aug 10.16:14
smcginnisZuul is back.16:19
dhellmannshall we approve some of these releases?16:20
smcginnisStart with the libs?16:20
dhellmannyeah16:20
smcginnisShould we meter it out?16:21
dhellmannsmcginnis, how stable is zuul? how many do we want going at once?16:21
dhellmannjust what I was thinking16:21
dhellmannmaybe even 1 at a time16:21
smcginnisThat's one of life's great questions.16:21
smcginnisI just did swiftclient.16:22
dhellmannk16:22
smcginnisLet's let that go a bit and make sure nothing looks odd.16:22
*** ChanServ changes topic to "OpenStack Release Managers office - Where weekly 1:1 sync points between release manager and PTLs happen - Logged at http://eavesdrop.openstack.org/irclogs/%23openstack-release/"16:22
-openstackstatus- NOTICE: zuul.o.o is back online, feel free to recheck / approve patches.16:22
EmilienMdhellmann: I'm taking care of reno issues in os-net-config and we're clear to release, hope I can make it this morning16:23
smcginnisWe should probably change our channel topic to get rid of the "where weekly 1:1 sync points between release manager and PTLs happen" part.16:23
EmilienMthe zuul queue is insane at this time16:23
dhellmannEmilienM : ok. get your release patch lined up and we'll process it. we're taking it slow to minimize any manual recovery work so it may be a while.16:24
smcginnisEmilienM: I was really hoping it would be better this week.16:24
EmilienMok16:24
*** pcaruana has quit IRC16:25
*** yamamoto has quit IRC16:28
*** armstrong has joined #openstack-release16:31
smcginnisdhellmann: So still recovering from the availability fiasco of mine last week. Are there still jobs on here we need to rerun? https://etherpad.openstack.org/p/6GloEgik8b16:31
dhellmannsmcginnis : no, I think we got that straightened out16:32
smcginnisdhellmann: OK, great. Thanks for holding down the fort and then some last week.16:32
dhellmannno worries16:33
dhellmannamotoki, smcginnis, prometheanfire : regarding the django-openstack-auth release: http://lists.openstack.org/pipermail/openstack-dev/2018-January/126682.html16:38
openstackgerritMerged openstack/releases master: swiftclient 3.5.0 release  https://review.openstack.org/53804616:40
*** yamamoto has joined #openstack-release16:43
openstackgerritMichael Johnson proposed openstack/releases master: Add the release notes link to python-octaviaclient  https://review.openstack.org/53896716:46
smcginnisJust waiting for tag-releases to pass on swiftclient, then going to send another one through.16:47
dhellmann++16:47
prometheanfiredhellmann: I guess the question is if we are fine delaying or not16:47
smcginnisprometheanfire: I think I saw something that the "/#/c" format of the URLs don't work for the new Depends-on syntax.16:48
*** yamamoto has quit IRC16:48
dhellmannprometheanfire : delaying what?16:48
prometheanfiresmcginnis: lol, woo16:48
prometheanfiredhellmann: the requirements freeze16:48
dhellmannprometheanfire : I'm missing too much context16:48
dhellmannsorry, I'm doing 3 things at once16:49
prometheanfiredhellmann: just reading your d-o-a thread reply16:49
dhellmannok, for that we don't need a requirements change at all16:49
dhellmannwe need d-o-a to depend on horizon, and then release that as 4.0.016:49
*** ykarel|away has joined #openstack-release16:49
dhellmannanything that depends on d-o-a will therefore get the code it needs installed16:49
prometheanfirelooks like we are still waiting on a reply from amotoki?16:49
dhellmannwe have already removed d-o-a from the requirements list so nothing new should use it16:49
prometheanfireoh, did he confirm that'd work?16:50
amotokiah, I misunderstood fungi's suggestion.16:50
dhellmannit's confusing to think about16:51
amotokiwe have no horizon queens PyPI package yet, so I wonder what is the thing we should do.16:51
dhellmannamotoki : I think if you add a requirements.txt entry with horizon and then tag that for d-o-a we can proceed without regard for the requirements freeze16:51
*** yamamoto has joined #openstack-release16:51
*** yamamoto has quit IRC16:51
dhellmannamotoki : which version of horizon has d-o-a in it?16:52
dhellmannmaybe we do have to wait until after horizon is released16:52
amotokidhellmann: horizon queens include openstack_auth. pike version does not.16:52
dhellmannah16:52
dhellmannthat's unfortunate16:52
dhellmannhow far is horizon from being ready for release?16:52
*** Guest64456 has quit IRC16:53
dhellmannoh, and horizon doesn't appear in the global requirements16:53
prometheanfireit isn't, (it's an end project, not a lib)16:53
amotokiwe need to wait translation imports around horizon RC216:53
dhellmannprometheanfire : well, now it's apparently both16:53
prometheanfire:|16:53
dhellmannyeah16:53
prometheanfireI don't think that'd be good16:53
dhellmannamotoki : why was d-o-a incorporated into horizon in this way?16:54
dhellmannwhat was the goal?16:54
prometheanfireI REALLY don't think adding all of horizon's deps to upper-constraints is a good idea16:54
amotokidhellmann: the main motivation is to reduce dev and maintenace burden in horizon team https://blueprints.launchpad.net/horizon/+spec/merge-openstack-auth16:55
dhellmannamotoki : ok. except now you're going to have to treat horizon like a library, not a milestone project, which is going to make your work harder.16:56
dhellmannbecause you can no longer release backwards-incompatible versions of horizon16:56
ttxand hinder translations16:56
smcginnisWhich would mean, horizon is past deadline and done for Queens.16:57
amotokiactually horizon is the only consumer of d-o-a, so from POV of horizon plugins I don't think the change is backward-incompatible.16:57
smcginnisamotoki: I thought there were several other projects using d-o-a?16:57
prometheanfiresmcginnis: we wouldn't remove it from reqs if other projects needed it16:58
amotokismcginnis: actually there is no need for them to have d-o-a in their requirements16:58
* dhellmann wishes we had a monorepo16:58
prometheanfiredhellmann: if you want to propose that, have fun :P16:58
amotokimost of them copied and pasted horizon requiremets.txt without careful considerations.16:58
amotoki:(16:58
dhellmannif nothing uses d-o-a then I suppose there is no need for that 4.0.0 release at all16:58
prometheanfirenot against it, just against the bikeshedding that'd happen16:58
dhellmannyeah, that wasn't a serious suggestion16:58
ttxopenstack / rpm-packaging has it in requirements, but might be leftover16:59
*** jpich has quit IRC16:59
smcginnisdhellmann: That's why I'm confused. If no one is using it, we should need that.16:59
smcginnisWe should just make sure they clean up their requirements.16:59
dhellmannit sounds like at least a couple of those projects are dead (or stale) anyway16:59
amotokithere is one tricky thing during upgrade. a user need to uninsstall d-o-a first and then upgrade horizon when using pip directly16:59
dhellmannah16:59
amotokiso I think null package of d-o-a is useful.16:59
dhellmannso the directory name for the contents of django_openstack_auth collide with the directory name for the version placed into the horizon repo?17:00
dhellmannwe don't usually support deploying from pip, so I'm not sure we need to care about that case17:01
dhellmannbut I want to make sure I understand exactly what the problem is first17:01
amotokiyeah, that's a fair point.17:01
prometheanfireya, that sounds like a namespace colision to me17:01
dhellmannah, yeah17:02
dhellmannamotoki : can you rename the package inside of horizon?17:02
dhellmanninstead of using the same directory name, rename it to be part of the horizon package?17:02
amotokiactually, when we install d-o-a 3.5.0 and then install horizon queens, it seems both pip information has openstack_auth module.17:02
dhellmannor openstack_dashboard or whatever the right name is17:02
dhellmannright, the problem is caused by using the same name in 2 different distributions17:03
amotokirenaming openstack_auth module to other names seems more troublesome.17:03
dhellmannwhy?17:03
amotokiit forces settings changes of current deployments. it also needs a lot code changes17:03
dhellmann183 lines17:03
dhellmannbut ok17:03
amotoki"settings" means django settings.py file17:04
dhellmannhow are you going to communicate to distributors like canonical, suse, and red hat that they should not package django-openstack-auth for queens?17:04
dhellmannI guess the null package at least avoids shipping conflicting files17:04
dhellmannalthough having an empty package is probably going to break some downstream packaging tests17:05
amotokiI haven't directly communicated with the packaing team. on RDO, radomir on horizon team works on packaging as well.17:05
prometheanfireya, what would a null package install?17:05
amotokiprometheanfire: that's what d-o-a 4.0.0 tries to do.17:05
prometheanfireI'm not sure about other distros, but we (gentoo) allow conflicting paths, iirc others do too17:06
dhellmannit looks like it's just packaging metadata and a readme17:06
prometheanfirehorizon would have a !dev-python/django-openstack-auth17:06
prometheanfireto ensure both are not installed at the same time17:06
dhellmannthe trick is knowing when to do that, though, right?17:06
prometheanfireya17:06
dhellmannand communicating that is the thing I'm worried about17:06
dhellmannmaybe the fact that d-o-a isn't in the requirements list for horizon any more is good enough?17:07
prometheanfirenormally I'd rely on GR for that, but since d.o.a was removed it's more dificult17:07
ttxSounds like this warrants a therad and making sure various distro packagers see it17:07
prometheanfireno, packagers would need some active knowlege that those are not co-installable imo17:07
dhellmannif they're packaging from master as part of their ci, things have already broken because until recently the repo was empty17:07
ttxthread*17:07
dhellmannbut not everyone does that, I guess17:08
dhellmannis the null package going to help, hurt, or have no real effect?17:08
prometheanfireI don't lol, still waiting a week or two before I do my packaging run17:08
amotokiI thought it is okay just to drop it before, but I now think that was a mistake. null package is less confusing17:08
prometheanfiremight help in that packagers may think 'hey that's odd', but that's it17:08
dhellmannamotoki : if I found a package that had no files in it I would think something in my build pipeline had broken down17:09
*** wolverineav has quit IRC17:10
dhellmannI'm starting to think we should not release 4.0.0 and should rely on documentation and mailing list threads instead17:10
amotokihmm.... fair enough17:10
ttxThe advice in the current email thread is not comprehensive -- packagers should know they need to exclude co-installation of new horiwon and d-o-a17:10
dhellmannif we had consumers of d-o-a and horizon had a release that included the content we could do the reverse dependency thing, but since we do not have a situation where that is possible I think we just want to leave it alone17:11
dhellmannttx: good point17:11
prometheanfiredo we have a list of contacts for the various distros to communicate this directly or do we have to rely on the mailing list?17:11
ttxi.e. horizon needs to depend on !d-o-a like prometheanfire said17:11
ttxAll packaging systems have support for exclusions like that17:11
amotokittx: I sent this last week http://lists.openstack.org/pipermail/openstack-dev/2018-January/126428.html17:12
openstackgerritRenat Akhmerov proposed openstack/releases master: Release Mistral Queens 3  https://review.openstack.org/53844217:12
amotokiwith [packaing] tag17:12
amotoki*packaging*17:12
ttxamotoki: yes, but I think there is a gap between "not installing" and explicitly create a packaging exclusion.17:12
amotokii see.17:13
ttxIt's one thing to remove the horizon->doa dependency17:13
ttxIt's another to make sure that doa gets uninstalled if you upgrade horizon17:13
*** armax has joined #openstack-release17:14
ttxI just fear that packagers may have missed how far they need to go :)17:14
ttxOh and it should be added to horizon release notes if you haven't already. Need to inform those who are not following ML and just consuming release too17:15
prometheanfireI would not have known unless I was in this channel17:15
*** ykarel|away has quit IRC17:16
ttxprometheanfire: arguably the subtlety between the two forms is only clear to people with a pdistro ackaging past17:16
ttxor a distro packaging past even17:16
prometheanfirettx: ya, devs tend to think the world is rebuilt on each release :P17:16
amotokithe current horizon relnote on this is https://docs.openstack.org/releasenotes/horizon/unreleased.html#id217:16
amotokiit looks better to mention "you need to uninstall d-o-a" explicitly17:17
smcginnisWell, "you no longer need to install" but also - "you need to make sure you uninstall".17:17
prometheanfireamotoki: yep17:17
ttxyes, the same specific advice will need to be added there17:18
ttxalthough if you read between thye lines it's implied17:18
prometheanfireI wouldn't assume that on reading17:18
ttxsmcginnis: do you need me for anything before I close the shop?17:19
prometheanfirebut I tend to not read between the lines much17:19
smcginnisttx: No, I think we are good. dhellmann reviewed most of the outstanding patches, now I've been slowly feeding them to the queue.17:20
openstackgerritMerged openstack/releases master: Release python-zaqarclient Queens-3  https://review.openstack.org/53810417:20
smcginnisttx: Have a good evening.17:20
amotokiso, regarding d-o-a, is the conclusion we don't need a new release, horizon relnote should mention that d-o-a needs to be uninstalled clearly.17:22
dhellmannamotoki : yes17:22
amotokion packaging, I think modern packaging system can detect file collision among packages.17:22
dhellmanndetecting them isn't the issue; it's understanding what to do when the collision is encountered17:23
amotokiyes, agree, but detecting them gives packagers a chance to notice this.17:24
amotokianyway, I will update the relnote.17:24
amotokiI'll make a followup tomorrow morning.17:26
amotokithanks for clarification and useful advises.17:26
dhellmannamotoki : thanks for working through the details with us17:29
*** ricolin has quit IRC17:34
*** ykarel|away has joined #openstack-release17:38
smcginnisRelease job failure. :/17:40
openstackgerritMerged openstack/releases master: python-blazarclient 1.0.1  https://review.openstack.org/53834717:47
*** sree has joined #openstack-release17:51
*** yamamoto has joined #openstack-release17:52
*** sree has quit IRC17:55
*** wolverineav has joined #openstack-release18:00
*** yamamoto has quit IRC18:01
*** sree has joined #openstack-release18:04
*** sree has quit IRC18:09
*** wolverineav has quit IRC18:10
*** yamahata has quit IRC18:10
*** pkovar has quit IRC18:15
*** ykarel|away has quit IRC18:16
*** pkovar has joined #openstack-release18:17
jrollreposting from the ironic channel, curious if someone has time to help me debug this:18:35
jrollrelease notes for 4.3.0 - 5.0.x are missing here (or under the wrong release, possibly?) https://docs.openstack.org/releasenotes/ironic/mitaka.html18:35
jrollditto for 6.0.0 - 6.1.x: https://docs.openstack.org/releasenotes/ironic/newton.html18:35
jrollall other releases look fine18:35
openstackgerritEmilien Macchi proposed openstack/releases master: TripleO queens milestone 3 release  https://review.openstack.org/53775218:36
*** spzala has joined #openstack-release18:37
*** spzala has quit IRC18:37
dhellmannpabelanger , smcginnis : I'll queue up a test release18:40
EmilienMdhellmann: https://review.openstack.org/#/c/537752/ is updated (os-net-config reno fixed) - it'll probably be ready for review18:40
pabelangerdhellmann: thanks18:40
EmilienMsmcginnis: if you can review https://review.openstack.org/#/c/537764/ - please18:41
openstackgerritDoug Hellmann proposed openstack/releases master: release-test 0.11.1  https://review.openstack.org/53899818:41
dhellmannEmilienM : things are still broken. Please just submit the release requests and don't ask for reviews today. We promise we'll get to them.18:42
dhellmannsmcginnis , pabelanger : https://review.openstack.org/53899818:42
EmilienMdhellmann: ok I stop asking, sorry - wasn't sure about state of things18:43
pabelangerdhellmann: ack18:43
dhellmannEmilienM : np18:43
* jroll realizes it's busy season here, retracts his reno debugging request, considers mailing the list instead. sorry!18:44
*** armstrong has quit IRC18:44
dhellmannjroll : no worries. Please do post to the ML and I'll try to help you with it18:44
jrollthanks dhellmann18:45
jrollno big rush, of course18:45
dhellmannjroll : you can try using "reno report" with its verbose option to understand why individual notes show up where they do18:45
jrollwill do18:45
smcginnisjroll: Were release notes backported?18:49
jrollsmcginnis: I'm sure some were at some point, probably none of the missing ones18:50
smcginnisjroll: OK, just making sure you are aware of how release notes work with stable branches: https://docs.openstack.org/reno/latest/user/usage.html#updating-stable-branch-release-notes18:50
jrollsmcginnis: ah right, could be related. though I hope that situation wouldn't apply for two major releases :)18:52
jrollthanks18:52
*** yamahata has joined #openstack-release18:53
dhellmannjroll : if you can reproduce the problem locally, try removing "origin/" from the branch name prefixes in the files in releasenotes/source18:53
dhellmannalthough that doesn't seem to help for me18:55
*** shardy has quit IRC18:56
dhellmannjroll : I think this is a bug in reno's scanner and the way we handle -eol branches19:00
dhellmannjroll : you can work around it by setting "earliest-version" in those rst files on master19:00
dhellmannjroll : bug please do file a bug on launchpad19:01
jrolldhellmann: yeah, I was just tracking it picking up the wrong earliest version19:01
smcginnisThat release-test job is going to take quite a while to make it through the check queue.19:07
*** lucasagomes is now known as lucas-afk19:08
jrolldhellmann: filed https://bugs.launchpad.net/reno/+bug/1746076, earliest-version does help. thanks :)19:08
openstackLaunchpad bug 1746076 in reno "Reno does not choose correct earliest version" [Undecided,New]19:08
dhellmannjroll : I'm not sure this is really fixable. Reno is being told "scan this branch back to the point before the previous branch was made" but the previous branch doesn't exist19:13
jrolldhellmann: ahhh, yeah that makes sense, good point19:15
smcginnisSo the "fix" might just be to use earliest-version?19:16
jrollyep, looks like it19:17
* jroll puts it in ironic's "what to do when cutting a stable branch" docs19:18
*** edmondsw has quit IRC19:23
*** pkovar has quit IRC19:24
*** harlowja has joined #openstack-release19:25
*** kumarmn has quit IRC19:31
*** kumarmn has joined #openstack-release19:37
*** kumarmn has quit IRC19:39
*** kumarmn has joined #openstack-release19:39
*** kumarmn has quit IRC19:40
openstackgerritDoug Hellmann proposed openstack/reno master: support scanning closed stable branches  https://review.openstack.org/53900919:40
*** kumarmn has joined #openstack-release19:40
dhellmannjroll : give that a try ^^19:40
smcginnisdhellmann: Do we still want to wait on that release-test patch? I have a feeling that means today is written off as far as processing releases.19:40
dhellmannsmcginnis, pabelanger : which part of the series of jobs are we trying to test? should we just push a tag, or do we want to test the tag-releases job that runs when something merges?19:41
*** kumarmn has quit IRC19:41
dhellmanncan we promote our test patch to the front of our queue? we have a separate gate queue for that repo, so it shouldn't affect anyone else19:41
*** kumarmn has joined #openstack-release19:42
*** kumarmn has quit IRC19:42
*** kumarmn has joined #openstack-release19:42
smcginnisThat would be good. We're an hour in to waiting in the check queue, and likely a couple more hours to go.19:42
*** kumarmn has quit IRC19:44
*** kumarmn has joined #openstack-release19:45
pabelangerdhellmann: mostly wanted to test the logs for release jobs were working again, or if something else for permissions needed updating19:46
smcginnispabelanger: Is it possible to bypass check and send that one right through gate?19:46
pabelangerdhellmann: I think ansible is setup the properly permissions now, but didn't know how to best test19:46
pabelangeryah, we can enqueue it into gate19:47
pabelanger1 sec19:47
pabelangeractually, we need it to run in release pipeline19:47
pabelangerso, that means a tag of the test-release19:48
pabelangerso ya, let me enqueue19:48
*** kumarmn has quit IRC19:48
smcginnisEven better then.19:48
*** kumarmn has joined #openstack-release19:48
jrolldhellmann: that fixes my reproductions of that bug, thank you19:50
*** mriedem1 has joined #openstack-release19:52
*** mriedem has quit IRC19:52
openstackgerritDoug Hellmann proposed openstack/reno master: support scanning closed stable branches  https://review.openstack.org/53900919:53
dhellmannjroll : let's hope we can land and release that soon :-)19:54
jroll:)19:54
*** mriedem1 is now known as mriedem19:57
dhellmannsmcginnis : I have to drop offline for a bit. I'll try to check back in around the end of the day19:58
*** kumarmn has quit IRC19:58
*** kumarmn has joined #openstack-release19:58
smcginnisOK, thanks dhellmann.20:00
*** kumarmn has quit IRC20:00
*** kumarmn has joined #openstack-release20:01
pabelangerokay, enqueued. Took some time because zuul still catching up on some things20:05
smcginnisLooks like it just restarted.20:13
*** pkovar has joined #openstack-release20:14
*** pkovar has quit IRC20:14
*** kumarmn has quit IRC20:18
*** kumarmn has joined #openstack-release20:18
*** kumarmn has quit IRC20:19
*** kumarmn has joined #openstack-release20:20
*** kumarmn has quit IRC20:21
*** kumarmn has joined #openstack-release20:22
openstackgerritGabriele Cerami proposed openstack/reno master: Add option to pass a yaml data file to be used when rendering the template  https://review.openstack.org/53823320:24
*** amoralej is now known as amoralej|off20:26
*** kumarmn has quit IRC20:26
*** kumarmn has joined #openstack-release20:28
*** edmondsw has joined #openstack-release20:30
openstackgerritMerged openstack/releases master: release-test 0.11.1  https://review.openstack.org/53899820:30
*** kumarmn has quit IRC20:31
*** kumarmn has joined #openstack-release20:31
*** edmondsw has quit IRC20:32
*** edmondsw_ has joined #openstack-release20:32
smcginnispabelanger: I may have missed it, but I didn't see that go on to the release and post-release queue. ^20:39
rosmaitasmcginnis really doubtful we'll be able to release Q-3 today ... the 2 glance patches that have to merge are sitting at positions 29 & 30 in the 'integrated' queue20:39
smcginnisrosmaita: OK, thanks. I'll try to watch for them too and help with rechecks if needed.20:40
pabelangersmcginnis: don't think it has been added to pipeline yet, zuul still processing20:40
smcginnisrosmaita: With the current rate, we will not be able to process all releases until tomorrow anyway.20:40
*** kumarmn has quit IRC20:40
rosmaitai guess that's good news :P20:41
*** kumarmn has joined #openstack-release20:41
smcginnisGood bad news? :)20:41
rosmaitathe patches are https://review.openstack.org/538694 and https://review.openstack.org/#/c/536630/ ; problem is that there's another one ahead of them in the queue, so i think at least one will require a merge commit, and hence the hash in the glance release patch is probably incorrect20:43
prometheanfiresend my final pre-freeze email20:44
*** kumarmn_ has joined #openstack-release20:44
*** kumarmn has quit IRC20:45
*** kumarmn has joined #openstack-release20:47
*** kumarmn_ has quit IRC20:49
smcginnisprometheanfire: Famous last words.20:50
prometheanfiresmcginnis: eh, ya20:51
*** pbandark has joined #openstack-release21:05
dhellmannsmcginnis , pabelanger : I see tag-releases passed and the release-test jobs are pending now21:50
smcginnisdhellmann: Very slow going yet.21:54
dhellmannyeah, is that a zuul load issue?21:54
dhellmannor just the number of jobs21:55
dhellmannor maybe the number of gate resets21:55
smcginnisThere was some talk of a lot of dynamic reconfigs happening, but I'm not clear what is affecting these and what's not. There are a lot of jobs, but that seems mostly the fact that it is taking 6+ hours for those jobs to make it through.21:55
dhellmannshould we try to approve some more releases? are we confident of having fixed whatever was broken before?21:57
dhellmannor at least of being able to recover if something fails, I guess21:58
pabelangerI'd like to see release pipeline jobs finish, there is a chance for logs.o.o issue, but think it has been fixed21:59
dhellmannok21:59
dhellmannI guess the only one that is hard to recover manually is the actual release build and upload21:59
dhellmannthe announce and constraints jobs we have scripted and the release team can deal with those failures21:59
openstackgerritJean-Philippe Evrard proposed openstack/releases master: Release OpenStack-Ansible queens/17.0.0.0b3  https://review.openstack.org/53902822:07
smcginnisNo console on the release job.22:16
*** stevebaker has quit IRC22:17
*** stevebaker has joined #openstack-release22:18
pabelangeris anybody looking into cross-keystone-py35 timeouts?22:18
pabelangerI've seen it a few times reset the gate22:18
pabelangerbut haven't debugged why22:18
smcginnisI haven't head of anything.22:19
pabelangerhttp://logs.openstack.org/a8/a8f7c710b5bfeec3291aedfcb7fa58d80016dfac/release/release-openstack-python/44dc1ee/22:21
pabelangerlooks to have worked22:21
smcginnisdhellmann: release-openstack-python finished, so now it's just the announce and propose-update-constraints jobs.22:24
smcginnisdhellmann: Should we send through another?22:24
dhellmannI suggest we make a list of failures in the announce and constraint jobs and focus on the release jobs for now22:24
dhellmannso yes22:24
smcginnis++22:24
dhellmannI can run the tools to fix problems with announcements and constraints as we go22:24
smcginnisGreat. Just approved ceilometer-powervm.22:25
smcginnisHopefully the need to manually take care of problems is minimal.22:25
dhellmann++22:25
dhellmannpabelanger : is the nature of the failure we keep having with the log volume something that means we should do one release at a time? or does load on that not really matter?22:26
*** edmondsw_ is now known as edmondsw22:26
pabelangerdhellmann: the recently logs.o.o issue was a permission issue, we incorrectly set root:root to directories on the volume, so some jobs couldn't write new logs. We have a chown process running, but it will just take time to get everything.22:28
pabelangerthat said, there is a small chance for issue but release-test looks to be working22:29
dhellmannso if we approved a bunch of releases all together that wouldn't make any of them more or less likely to fail22:29
pabelangerright, it would just mean more possible manually work to enqueue them again22:29
dhellmannI'm wondering what's more efficient. Approving them all and redoing some that fail or doing them one at a time and watching them as they go.22:30
dhellmannI feel like the latter is more cautious, but is going to take more human time.22:30
smcginnisWe could probably batch a handful at a time, just to keep things moving.22:30
dhellmannyeah22:30
pabelangeryah, I think batch a few if good, ramp up22:30
dhellmannwe only have ~7 that are candidates to approve at this point22:31
*** dave-mccowan has quit IRC22:31
pabelangerthe other issue now is related to zuul, we seem to be having node capacity issues, that's really the reason for slowdown today. However, until jeblair is back online and can review just helping keep the system running22:31
pabelangerhttps://review.openstack.org/539016/ is about to land, and will also help integrated gate from resetting22:32
dhellmannok, I approved 2 more22:35
openstackgerritMerged openstack/releases master: Release ceilometer-powervm for Queens-3  https://review.openstack.org/53803022:55
*** edmondsw has quit IRC23:06
*** ekcs has joined #openstack-release23:07
*** claudiub|3 has quit IRC23:10
openstackgerritMerged openstack/releases master: Release zaqar-ui Queens-3  https://review.openstack.org/53810723:16
openstackgerritMerged openstack/releases master: Request Sahara Queens 3  https://review.openstack.org/53813323:16
openstackgerritMerged openstack/releases master: Add the release notes link to python-octaviaclient  https://review.openstack.org/53896723:16
*** edmondsw has joined #openstack-release23:20
dhellmannapproved 3 more23:31
*** kumarmn has quit IRC23:31
*** kumarmn has joined #openstack-release23:32
*** kumarmn has quit IRC23:36
*** pbandark has quit IRC23:42
*** jlvillal has quit IRC23:45
*** honza has quit IRC23:45
*** dtantsur|afk has quit IRC23:45
*** edmondsw has quit IRC23:46
*** edmondsw has joined #openstack-release23:47
*** freerunner has quit IRC23:48
*** kumarmn has joined #openstack-release23:49
*** freerunner has joined #openstack-release23:51
*** jlvillal has joined #openstack-release23:51
*** honza has joined #openstack-release23:51
*** dtantsur|afk has joined #openstack-release23:51
*** edmondsw has quit IRC23:51
*** dave-mccowan has joined #openstack-release23:53
*** kumarmn has quit IRC23:54
*** hongbin has quit IRC23:57
pabelangerdhellmann: ack23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!