Wednesday, 2016-07-27

fungi	no?	00:00
anteaya	groundhog/woodchuck is the same	00:00
jroll	clarkb: I haven't fully reviewed it, I mostly trust it but I can review it first thing tomorrow too	00:00
anteaya	beaver is a whole different thing	00:00
*** rossella_s has joined #openstack-infra		00:00
mordred	anteaya: maybe if that wins we'll need to do a runoff election?	00:00
fungi	anteaya: oh, le sigh. you are correct	00:00
pleia2	the canadian knows about such things	00:00
pleia2	:)	00:00
*** baoli has joined #openstack-infra		00:00
anteaya	note the flat beaver tail: https://en.wikipedia.org/wiki/Beaver	00:00
* fungi misremembered		00:00
clarkb	jroll: I guess I am more wanting to make sure we don't approve that change and ironic freaks out beacuse you weren't ready	00:00
anteaya	the canadian knows, ineede	00:00
clarkb	jroll: its up to you if you want to review it first	00:00
mordred	or maybe we just communicate to the illustrator "beaver or woodchuck"	00:00
jroll	clarkb: it should just be a refactor	00:00
anteaya	one of the few things I can remember	00:01
pleia2	anteaya: haha	00:01
mordred	or "beaver/woodchuck, the hybrid animals	00:01
anteaya	mordred: ha ha ha	00:01
fungi	beachuck	00:01
mordred	I would vote differently if I had been voting for a beaverwoodchuck	00:01
jroll	clarkb: I'm not sure the best way to verify that it's the same though	00:01
*** pvaneck has quit IRC		00:01
*** rbuzatu has quit IRC		00:01
anteaya	fungi: ha ha ha	00:01
clarkb	jroll: I don't think there is a good way other than reading the xml diff which is painful	00:01
clarkb	its tempting to vote for oort cloud just to see how they illustrate that	00:01
fungi	woodchuck from algonquian (possibly narragansett) "wuchak" sayeth the 'pedia	00:02
* jlk would have preferred marmot to woodchuck. http://image.shutterstock.com/z/stock-photo-ground-hog-marmot-day-close-up-portrait-while-yawning-343813481.jpg		00:02
*** gildub has joined #openstack-infra		00:02
fungi	jlk: yes, marmots are cool too	00:02
fungi	also nobody suggested nutria... that would have been an interesting one	00:03
jroll	clarkb: then maybe we approve it and ironic folks verify tomorrow, I'm not sure my eyes on the patch can do better than actually putting it in action	00:03
anteaya	Coelacanths were thought to have become extinct in the Late Cretaceous, around 66 million years ago, but were rediscovered in 1938 off the coast of South Africa.	00:03
clarkb	fungi: I once lived in prime nutria country would not recommend	00:03
anteaya	I don't even know what to say to that	00:03
clarkb	jroll: ok I can go ahead and approve it now then	00:03
fungi	clarkb: too gamey?	00:03
jroll	clarkb: I'm happy with how it's refactored, go for it	00:03
clarkb	fungi: they are 50lb rats	00:03
clarkb	fungi: with no fear	00:03
jlk	https://www.youtube.com/watch?v=G9m8O-7J5NM could have been us.	00:03
fungi	clarkb: rous	00:04
*** pvaneck has joined #openstack-infra		00:04
jlk	or https://www.youtube.com/watch?v=Loi-cTSQy2Q	00:04
pabelanger	clarkb: question, why does rally-docs still exist in our post pipeline? I would expect that to be rally-docs-ubuntu-xenial	00:04
anteaya	jlk: ha ha ha	00:04
clarkb	fungi: when I was working at garmin the office was next to the airport whcih was in a swamp which had large ditches alongside the roadway. More than once I came face to face with the largest nutria I had ever seen. Its like htey grow exponentially	00:04
clarkb	pabelanger: its because I haven't updated the post jobs yet. they are different jobs since they publish	00:05
*** yuanying has quit IRC		00:05
clarkb	bkero: ^ those would be another simple one to update	00:05
*** sarob has joined #openstack-infra		00:05
clarkb	pabelanger: the check/gate jobs build and publish to the docs draft site. The post job publishes to the actual hosting location	00:06
pabelanger	clarkb: okay, but I'm not seeing where is JJB where they are defined?	00:06
*** yuanying has joined #openstack-infra		00:06
clarkb	pabelanger: openstack-publish jobs	00:06
bkero	clarkb: docs or post-using jobs?	00:06
clarkb	er openstack-publish-jobs.yaml	00:06
bkero	doesnt wheel also use them?	00:06
pabelanger	clarkb: ah, perfect. Thanks	00:06
clarkb	bkero: the {name}-docs template in openstack-publish-jobs.yaml specifically	00:07
clarkb	bkero: but we will need to do those other ones too	00:07
anteaya	clarkb: wikipedia says don't eat it: As a food fish it is almost worthless, as its tissues exude oils that give the flesh a foul flavor	00:07
aspiers	corvus / mtreinish / fungi: https://build.opensuse.org/request/show/415342	00:07
clarkb	anteaya: no wonder they have survived for millions of years	00:07
*** rbuzatu has joined #openstack-infra		00:07
clarkb	how to survive: don't be tasty to things bigger than you	00:07
aspiers	once that is accepted, 1.4.0 will become available via the URL already listed in the README	00:08
aspiers	and so to bed ...	00:08
anteaya	sounding more and more like me all the time: The coelacanth braincase is 98.5% filled with fat; only 1.5% of the braincase contains brain tissue	00:08
mtreinish	aspiers: nice	00:08
*** rdx_matt has joined #openstack-infra		00:08
* mtreinish makes a mental note to add the man page to the arch package too		00:08
mtreinish	assuming I didn't already do that	00:09
mtreinish	which I did not: https://aur.archlinux.org/cgit/aur.git/tree/PKGBUILD?h=python2-gertty	00:10
clarkb	hrm logstash is still cranky, I was hoping it would've levelled out by now. I will have to look more tomorrow morning	00:10
*** baoli has quit IRC		00:11
anteaya	Due to the abundance of its fins, the coelacanth has high maneuverability and can orient its body in almost any direction in the water. They have been seen doing headstands as well as swimming belly up. It is thought that the rostral organ helps give the coelacanth electroperception, which aids in movement around obstacles.	00:11
pleia2	sounds like us	00:11
*** rbuzatu has quit IRC		00:12
*** jamielennox is now known as jamielennox\|away		00:12
*** baoli has joined #openstack-infra		00:13
anteaya	yeah	00:14
anteaya	and they are lazy	00:14
anteaya	they just drift around and eat whatever is near them	00:14
anteaya	and they hide in caves	00:14
pleia2	just like us!	00:14
pleia2	haha	00:14
anteaya	and they don't like body contact	00:14
anteaya	sounds like a great mascot	00:14
anteaya	pleia2: did you put it on the list?	00:15
pleia2	nope	00:15
*** signed8bit is now known as signed8bit_Zzz		00:15
fungi	that was one of the random ones i threw in after last week's meeting	00:15
*** sdague has quit IRC		00:16
fungi	i didn't really think much about stuff i picked other than cool factor, and figured people could just read whatever they want into it	00:16
anteaya	fungi: it is a great random one	00:16
anteaya	it has some wonderful qualities	00:16
anteaya	lasting 60 million years is just one of them	00:16
*** gouthamr has joined #openstack-infra		00:17
*** rbuzatu has joined #openstack-infra		00:17
anteaya	didn't keystone take turtle?	00:17
anteaya	stevemar: notmorgan ^^	00:17
anteaya	I just think circulatory system as a mascot is a tough one	00:18
openstackgerrit	Merged openstack-infra/project-config: Refactor Ironic job macro https://review.openstack.org/340567	00:18
*** rbuzatu_ has joined #openstack-infra		00:18
*** jpr has quit IRC		00:18
fungi	i attempted to faithfully represent the list we had from the etherpad, including things that other teams may have picked	00:19
anteaya	okay	00:19
fungi	condorcet lends itself to eliminating options after ranking	00:19
*** yuanying has quit IRC		00:19
*** dimtruck is now known as zz_dimtruck		00:19
fungi	since you're basically saying "i really want the turtle, but the tanuki would be great if we can't	00:20
*** yuanying has joined #openstack-infra		00:20
fungi	et cetera	00:20
fungi	and then it's taking that into account across everyone's votes	00:20
*** shashank_hegde has joined #openstack-infra		00:20
anteaya	yeah that is true	00:20
anteaya	pink fairy armadillo does have a lot of merit	00:20
fungi	so the first in the final ranking is the least contentious option, the second is the second least contentious option, and so on down the line	00:21
*** caowei has quit IRC		00:21
fungi	and in theory if the poll were re-run with the exact same ordering in everyone's ballots but some options were removed then the results should also be the same just with those options removed	00:21
fungi	basically same outcome whether you remove options before or after voting	00:22
*** rbuzatu has quit IRC		00:22
*** rbuzatu_ has quit IRC		00:23
*** baoli has quit IRC		00:23
* anteaya reads up on taxons: https://en.wikipedia.org/wiki/Elvis_taxon		00:24
anteaya	I will put beaver in my rankings but I am voting beaver not woodchuck	00:27
*** zz_dimtruck is now known as dimtruck		00:28
fungi	noted. i think beaver was the spirit of the original suggestion anyway	00:28
*** adrian_otto has quit IRC		00:28
anteaya	thanks	00:28
anteaya	okay voted	00:28
*** erlon has joined #openstack-infra		00:29
fungi	i had suggested woodchuck as an alternative in case the english slang concerns someone else raised on that option turned out to be a problem	00:29
anteaya	I understand, but I think most of the crowd didn't feel it would be misconstrued	00:29
*** armax has quit IRC		00:29
*** rbuzatu has joined #openstack-infra		00:29
anteaya	that was my take on the conversations I took part in	00:29
anteaya	but thanks for considering it	00:30
fungi	thinking back, otter would have been a closer alternative	00:30
anteaya	and unfortunately beaver doesnt' have a second name like woodchuck/groundhog	00:30
anteaya	otter also would have been an interesting choice	00:30
anteaya	I can look up first nations words for beaver	00:30
fungi	most animals are interesting if you stop and dwell on them for a moment	00:30
*** Swami has quit IRC		00:31
fungi	apparently "beaver" is also one of the first nations languages?	00:32
fungi	"Beaver is an Athabaskan language, related to other languages like Carrier and Dene." http://www.native-languages.org/beaver_words.htm	00:32
anteaya	that I did not know	00:32
ianw	I wonder if i should report "http://mirror.dfw.rax.openstack.org/pypi/simple/" as a DOS attack? my firefox chokes on it :(	00:33
fungi	ianw: there are plenty of job console logs that can get you the same effect if you're enjoying it that much	00:33
anteaya	in mohawk it is tsyenni:tonh	00:33
ianw	fungi: yeah, and "ctrl-f" in the new gerrit change screen is pretty much a DOS attack too	00:34
*** esberglu has joined #openstack-infra		00:34
*** Goneri has quit IRC		00:34
anteaya	and tsáá' is beaver in Beaver	00:34
fungi	ianw: s/"ctrl-f" in //	00:34
*** rbuzatu has quit IRC		00:34
*** armax has joined #openstack-infra		00:34
fungi	anteaya: that's seriously meta	00:34
anteaya	I like it	00:35
anteaya	those accents on the a's will be tricky though	00:35
fungi	that's why i have a compose key	00:35
fungi	compose+'+a	00:35
anteaya	a compose key	00:35
fungi	https://en.wikipedia.org/wiki/Compose_key#Linux	00:36
*** thorst has joined #openstack-infra		00:36
anteaya	thanks	00:37
* anteaya reads		00:37
zxiiro	The infra mascot vote. Is there a drawing of all of the proposed mascots or do I need to use my imagination?	00:37
anteaya	zxiiro: imagination	00:37
zxiiro	doh, i'm not much of the creative type	00:37
zxiiro	heh	00:38
fungi	zxiiro: this is so we have something to tell the illustrator being selected by the foundation	00:38
anteaya	the point of the exerices is a foundation selected illustrator will be providing drawings of the mascots	00:38
fungi	zxiiro: http://lists.openstack.org/pipermail/openstack-dev/2016-July/099046.html	00:38
zxiiro	thanks	00:39
fungi	i just set keycode 133 and 134 (the logo keys on my keyboard) to Multi_key in my ~/.Xmodmap and call `xmodmap ~/.Xmodmap` from my ~/.xinitrc	00:39
fungi	anteaya: ^	00:39
anteaya	hmmmmm	00:39
fungi	though some windowing environments may have other ways of accomplishing teh same	00:39
ianw	jhesketh: hmm, well it doesn't seem like our pypi mirrors have fixed up the "dot to dash" issue from so long ago ... i wonder if bandersnatch is to blame	00:39
anteaya	well holding down control and the key with a window on it did something interesting	00:40
anteaya	I may have to play with this a bit, thank you	00:40
*** rbuzatu has joined #openstack-infra		00:40
fungi	anteaya: xorg has a lot of intuitive compose mappings, for example compose+8+8 is ∞	00:41
*** rdx_matt has quit IRC		00:41
fungi	and compose+^+2 is ²	00:41
fungi	compose +>+> is »	00:42
fungi	et cetera	00:42
anteaya	nice	00:42
*** thorst has quit IRC		00:42
fungi	you can either chord them or, if not convenient (because of needing other modifiers to generate some of the symbols) strike them in series	00:43
*** thorst has joined #openstack-infra		00:43
anteaya	sounds like fun	00:43
anteaya	looks like it too	00:43
fungi	it comes in really handy if you want your 104-key keyboard to be a 1004-key keyboard ;)	00:43
anteaya	he he he	00:43
anteaya	clarkb: we are missing a job definition it appears: https://review.openstack.org/#/c/347567/1	00:45
*** rbuzatu has quit IRC		00:45
*** sdake_ has quit IRC		00:45
anteaya	fungi: I've never spent time thinking that my keyboard just doesn't have enough keys on it to suit me	00:45
anteaya	such a sheltered life I have lived	00:45
*** sdake has joined #openstack-infra		00:47
*** tonytan4ever has joined #openstack-infra		00:47
*** mtanin___ has quit IRC		00:48
jascott1	lxc-attach -n infra01_utility_container-a839c616	00:49
jascott1	haha	00:49
fungi	oh, hey, i didn't know you could type “smartquotes” with compose+<+" and compose+>+"	00:49
*** ddieterly has joined #openstack-infra		00:49
*** rbuzatu has joined #openstack-infra		00:51
*** Sukhdev has quit IRC		00:52
*** tonytan4ever has quit IRC		00:53
anteaya	how interesting	00:54
*** nwkarsten has joined #openstack-infra		00:55
*** tqtran has quit IRC		00:56
*** moravec has joined #openstack-infra		00:56
*** rbuzatu has quit IRC		00:56
*** yuanying has quit IRC		00:58
*** esberglu has quit IRC		00:59
*** jrist has quit IRC		00:59
*** nwkarsten has quit IRC		00:59
*** caowei has joined #openstack-infra		00:59
anteaya	“	01:00
anteaya	yay	01:00
anteaya	∞	01:00
anteaya	²	01:00
anteaya	thank you fungi	01:00
anteaya	á	01:00
fungi	don't spend it all in one place	01:00
anteaya	ha ha ha	01:00
anteaya	»	01:01
anteaya	»»	01:01
anteaya	â	01:01
*** pvaneck has quit IRC		01:01
anteaya	how to do the spanish fish hook accent	01:02
anteaya	compose+5+a is not it	01:02
*** yuanying has joined #openstack-infra		01:02
anteaya	a	01:02
fungi	use ,	01:02
fungi	compose+,+a ą	01:03
anteaya	thanks	01:03
*** rbuzatu has joined #openstack-infra		01:03
anteaya	ą	01:03
fungi	; instead of , also seems to work for that	01:03
anteaya	yay	01:03
anteaya	ą	01:03
fungi	you're a little too excited by this	01:04
anteaya	I am so	01:04
anteaya	something I never knew I was missing	01:04
anteaya	you're a bad influence	01:04
anteaya	:)	01:04
*** sdake has quit IRC		01:04
openstackgerrit	Matthew Treinish proposed openstack-infra/system-config: Add firehose.o.o config to system-config https://review.openstack.org/347575	01:05
anteaya	í	01:05
anteaya	hmmm, not what I was going for	01:05
anteaya	it has to lean to the left	01:05
*** kaisers_ has joined #openstack-infra		01:06
anteaya	ï	01:06
fungi	you want ` for accents in the other direction	01:06
openstackgerrit	Merged openstack-infra/project-config: Increase xenial max servers to 10 https://review.openstack.org/347573	01:06
fungi	(backtick)	01:07
anteaya	ah thanks, actually it is two dots	01:07
anteaya	they are just lined up to the left	01:07
*** caowei has quit IRC		01:07
anteaya	ì	01:07
*** rbuzatu has quit IRC		01:07
fungi	oh, you wanted an umlaut?	01:08
ianw	phschwartz / nibalizer : how come in https://review.openstack.org/#/c/330590/ this does "require => [ Class['pip' ]" for the openstack_pip provider ? most others do?	01:08
anteaya	no it isn't an umlaut	01:08
anteaya	I haven't seen it before, I don't know what it is called	01:08
ianw	^ i mean this does not have ...	01:08
fungi	ï is i-umlaut for me	01:08
openstackgerrit	Merged openstack-infra/project-config: Add pabelanger as channel operator https://review.openstack.org/347431	01:09
anteaya	fungi: https://www.youtube.com/watch?v=q9TBa3NClp4&t=0m40s	01:09
phschwartz	ianw: I am confused as to what you mean not is doing the requires for openstack_pip which is correct.	01:10
phschwartz	*it	01:10
*** zhurong has joined #openstack-infra		01:10
anteaya	fungi: so I can go with ì as close	01:10
fungi	anteaya: yeah, i-grave then (ì)	01:10
anteaya	fungi: but it does look like two lined up dots to me	01:10
ianw	phschwartz: so compare to say https://github.com/openstack-infra/puppet-diskimage_builder/blob/master/manifests/init.pp#L62	01:10
phschwartz	fungi: did you just go Star Trek on us. Lol	01:10
*** kaisers_ has quit IRC		01:11
clarkb	anteaya: huh I ran tox -ezuul locally	01:11
*** jrist has joined #openstack-infra		01:11
*** jrist has quit IRC		01:11
*** jrist has joined #openstack-infra		01:11
anteaya	clarkb: it didnt' like it	01:11
anteaya	:(	01:11
anteaya	clarkb: there must be a job in there somewhere we missed	01:12
ianw	phschwarz: compared to https://github.com/openstack-infra/puppet-bandersnatch/blob/master/manifests/init.pp#L29	01:12
ianw	phschwartz: ^	01:12
*** Goneri has joined #openstack-infra		01:13
anteaya	clarkb: apparently it is still in zuul/layout.yaml according to my grepping	01:13
phschwartz	ianw: it is a normal puppet stylization. The first case in my review is using the provider right then, the require is not explicitly needed.	01:13
clarkb	anteaya: I will figure it out in the morning	01:14
*** rbuzatu has joined #openstack-infra		01:14
anteaya	clarkb: I can do it now if you like	01:14
anteaya	or happy to wait for you tomorrow, your choice	01:14
openstackgerrit	Merged openstack-infra/project-config: Add germqtt project https://review.openstack.org/344495	01:14
fungi	okay, i'm going to knock off for the night. later everybody	01:15
anteaya	fungi: night	01:15
phschwartz	ianw: and for most uses of the provider there is no use of a require. I modified close to 25 of them in a chain of reviews.	01:15
ianw	phschwartz: ok, yeah, so i guess i'm asking when the require is needed an when it isn't?	01:15
phschwartz	fungi: later	01:15
clarkb	anteaya: oh sure if you want to go for it	01:16
anteaya	clarkb: okay I will take one try and then call it a night too	01:16
phschwartz	ianw: when using the provider directly there is no time it is ever really required unless it is being run on a system that won't have pip installed. Pip is part of our base system template so it will always be there.	01:16
*** sarob has quit IRC		01:16
phschwartz	Grr. No need not no time. Stupid phone.	01:17
*** yanyanhu has joined #openstack-infra		01:17
*** sarob has joined #openstack-infra		01:17
clarkb	anteaya: I wonder if that test only works if I commit first	01:18
*** Apoorva has quit IRC		01:18
phschwartz	In short beyond that autocorrect mess. It is only needed if you know pip will not be installed on the system before that configure step.	01:18
*** rbuzatu has quit IRC		01:18
anteaya	ah I will try to commit first	01:18
anteaya	thanks was about to run the test	01:19
anteaya	or perhaps I should run both, before commiting and after	01:19
*** dimtruck is now known as zz_dimtruck		01:19
anteaya	I'll run tests before commiting	01:19
ianw	phschwartz: so given the sort of general idea of reusability -- it would be just a bit better to have the require bits in say, puppet-bandersnatch ... just so it can stand alone?	01:19
ianw	even though, i guess in practice it probably won't	01:19
*** xarses has joined #openstack-infra		01:20
anteaya	my tests failed before commiting: ImportError: No module named stevedore	01:20
*** ddieterly is now known as ddieterly[away]		01:20
*** shashank_hegde has quit IRC		01:20
phschwartz	ianw: depends on if it is ever going to be used on a base system where no other configuration is done.	01:20
anteaya	clarkb: any idea who is wanting stevedore and why it didn't get it?	01:20
*** ddieterly[away] is now known as ddieterly		01:20
anteaya	I guess I could just pip install stevedore	01:21
ianw	phschwartz: i guess i'm just getting at we should code defensively to allow that in the various puppet-* modules? I just need to update puppet-bandersnatch to ensure=>latest so we get the new release of it, so will do this too	01:21
*** sarob has quit IRC		01:21
anteaya	I had it	01:22
phschwartz	ianw: that would most likely get a -1. Those are not changes for the same thing and shouldn't be in a single review.	01:22
anteaya	I had stevedore already according to pip, I upgraded, I still have an error, something can't find stevedore on my local system	01:23
phschwartz	ianw: I also don't think that much defensiveness is needed in a module that has a very very very low likelihood to be used outside of openstack_project	01:23
clarkb	anteaya: stevedore is a dhellmann thing maybe we just need to update the job for it	01:23
anteaya	okay	01:23
clarkb	oh sorry your local tests dont have it	01:23
clarkb	I dunno	01:24
anteaya	I dunno either	01:24
anteaya	tired now, will submit my patch and worry about stevedore later	01:24
phschwartz	anteaya: was the stevedore error from a tox run?	01:25
openstackgerrit	Anita Kuno proposed openstack-infra/project-config: Remove unused devstack-gate job https://review.openstack.org/347567	01:25
anteaya	yes	01:25
*** rbuzatu has joined #openstack-infra		01:25
anteaya	tox -ezuul	01:25
phschwartz	is it in the reqs or reqs-dev file?	01:25
phschwartz	You have it local, but maybe tox is not pulling it into the venv it builds on run.	01:26
anteaya	good question	01:26
anteaya	I also wondered that	01:26
ianw	phschwartz: ok, np. for me it's actually mostly just consistency	01:27
anteaya	phschwartz: I don't see stevedore listed in test-requirements or other-requirements: http://git.openstack.org/cgit/openstack-infra/project-config/tree/	01:27
phschwartz	I do know with the newer zuul changes it is needed to load modules that do work for ansible.	01:27
anteaya	phschwartz: so I don't know what is wanting it and failing to pull it in	01:27
anteaya	phschwartz: thanks for sharing that	01:27
anteaya	I appreciate it	01:27
phschwartz	ianw: it wouldn't be a consistency thing as most of our modules don't have the require.	01:28
anteaya	I think I am going offline now	01:28
anteaya	g'night	01:28
phschwartz	anteaya: with out being at my keyboard it is hard to help out more then conjecture. If I get a chance to look later, I will let you know.	01:28
phschwartz	Night.	01:28
*** rbuzatu has quit IRC		01:30
*** TaylorHuang has joined #openstack-infra		01:31
prometheanfire	huh	01:32
prometheanfire	fatal: remote error: access denied or repository not exported: /openstack-infra/germqtt.git	01:32
prometheanfire	Caching germqtt from git://git.openstack.org/openstack-infra/germqtt.git in /root/.cache/image-create/source-repositories/germqtt_7c3981e33bd90e80e4332e4bae9ea13a29159a89	01:32
prometheanfire	anyone else having that problem?	01:33
*** openstackgerrit has quit IRC		01:33
*** openstackgerrit has joined #openstack-infra		01:33
*** gouthamr_ has joined #openstack-infra		01:34
*** TaylorH has quit IRC		01:34
ianw	yeah, empty : warning: You appear to have cloned an empty repository.	01:34
*** rbuzatu has joined #openstack-infra		01:34
prometheanfire	seems better now	01:34
*** TaylorH has joined #openstack-infra		01:35
*** rbuzatu_ has joined #openstack-infra		01:36
*** gouthamr has quit IRC		01:37
*** rdx_matt has joined #openstack-infra		01:38
*** TaylorHuang has quit IRC		01:38
*** Srinu_ has joined #openstack-infra		01:38
Srinu_	Hi	01:38
openstackgerrit	Ian Wienand proposed openstack-infra/puppet-bandersnatch: Ensure pip updates to latest release https://review.openstack.org/347587	01:39
*** rbuzatu has quit IRC		01:39
*** TaylorH has quit IRC		01:39
*** woodster_ has quit IRC		01:39
Srinu_	In jenkins openstack ci.. slave is killing the sshd connection automatically	01:39
Srinu_	Did any one face this issue any time	01:40
*** rbuzatu_ has quit IRC		01:40
*** baoli has joined #openstack-infra		01:41
ianw	Srinu_: might need more details on what's happening to make suggestions. you never get a connection?	01:41
Srinu_	I am using two jobs in check pipeline and i have two slaves. They are ruunning parallel and if any one of the finished first.it will add another node. At the time of adding node to jenkins. Another one going offline	01:44
openstackgerrit	Kien Ha proposed openstack-infra/jenkins-job-builder: Add support for FTP-Publisher plugin https://review.openstack.org/347589	01:45
Srinu_	Ianw: in the jenkins/computer tab. In response time for the first try only the jenkins making the node offline	01:47
*** rbuzatu has joined #openstack-infra		01:47
*** zz_dimtruck is now known as dimtruck		01:47
*** thorst has quit IRC		01:48
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement basic undercloud sanity checks https://review.openstack.org/346551	01:48
*** thorst has joined #openstack-infra		01:48
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement a new job for undercloud testing only https://review.openstack.org/346147	01:49
*** tonytan4ever has joined #openstack-infra		01:49
openstackgerrit	Merged openstack-infra/tripleo-ci: Temporary fix for nodejs/libuv conflict https://review.openstack.org/347565	01:49
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement undercloud upgrade job - Mitaka -> Newton https://review.openstack.org/346995	01:49
*** rbuzatu has quit IRC		01:52
openstackgerrit	Ian Wienand proposed openstack-infra/system-config: Revert "Work around bandersnatch not supporting pep503" https://review.openstack.org/321339	01:53
*** tonytan4ever has quit IRC		01:53
*** shashank_hegde has joined #openstack-infra		01:54
Srinu_	In jenkins computer information..in response time information timeout for 1 try making the node offline.	01:55
Srinu_	Did any one face this issue	01:56
*** thorst has quit IRC		01:57
*** ddieterly has quit IRC		01:57
*** tphummel has quit IRC		01:58
*** Srinu_ has quit IRC		01:58
*** rbuzatu has joined #openstack-infra		01:58
*** shashank_hegde has quit IRC		02:00
*** rbuzatu has quit IRC		02:03
*** coolsvap_ has joined #openstack-infra		02:04
*** julim has joined #openstack-infra		02:05
*** thorst has joined #openstack-infra		02:06
*** thorst has quit IRC		02:06
*** shashank_hegde has joined #openstack-infra		02:09
*** rbuzatu has joined #openstack-infra		02:09
*** armax has quit IRC		02:10
*** rdx_matt has quit IRC		02:11
*** sdake has joined #openstack-infra		02:12
*** eliqiao has quit IRC		02:12
*** eliqiao has joined #openstack-infra		02:12
*** rbuzatu has quit IRC		02:14
openstackgerrit	Matthew Thode proposed openstack-infra/project-config: Add Gentoo support to nodepool https://review.openstack.org/310865	02:15
prometheanfire	so	02:15
prometheanfire	from testing it seems like I need at least https://review.openstack.org/#/c/307553/ to continue to work on gentoo	02:16
*** signed8bit_Zzz is now known as signed8bit		02:16
prometheanfire	without it, it will try to pull in graphviz which fails	02:16
*** shashank_hegde has quit IRC		02:16
prometheanfire	because it's pulling from git, not local	02:16
*** signed8bit is now known as signed8bit_Zzz		02:16
*** signed8bit_Zzz is now known as signed8bit		02:17
*** baoli has quit IRC		02:17
*** rlandy has quit IRC		02:19
*** rbuzatu has joined #openstack-infra		02:20
*** salv-orl_ has quit IRC		02:21
*** StevenK has joined #openstack-infra		02:22
prometheanfire	so, if people could review that'd be helpful	02:23
prometheanfire	at least the other one edits elements which dib can handle correctly	02:24
*** roxanaghe has joined #openstack-infra		02:24
*** rbuzatu has quit IRC		02:25
*** Jeffrey4l has joined #openstack-infra		02:26
*** nwkarsten has joined #openstack-infra		02:29
*** rbuzatu has joined #openstack-infra		02:30
prometheanfire	anyway, going to sleep now, but it'd be nice to not ignore https://review.openstack.org/310865	02:30
*** rbuzatu_ has joined #openstack-infra		02:31
*** signed8bit is now known as signed8bit_Zzz		02:32
*** baoli has joined #openstack-infra		02:32
timrc	Dear lazyweb, what in the world is a tanuki?	02:33
openstackgerrit	Merged openstack-infra/groups-static-pages: Add a section about groups over large areas https://review.openstack.org/346610	02:33
mgagne	a Japanese raccoon dog ?	02:34
*** rbuzatu has quit IRC		02:34
mgagne	google helped me ^^'	02:34
*** yamahata has quit IRC		02:34
*** tonytan4ever has joined #openstack-infra		02:35
*** rbuzatu_ has quit IRC		02:37
*** Goneri has quit IRC		02:39
*** jamielennox\|away is now known as jamielennox		02:41
*** rbuzatu has joined #openstack-infra		02:42
*** rbuzatu has quit IRC		02:47
*** shashank_hegde has joined #openstack-infra		02:48
*** Krenair has joined #openstack-infra		02:49
Krenair	https://review.openstack.org/gitweb?p=openstack-infra/puppet-mediawiki.git;a=blob;f=manifests/app.pp seems to imply mediawiki will be at origin/master (which is probably a bad idea for production :)), but https://wiki.openstack.org/w/index.php/Special:Version shows it hasn't been updated in... a long while	02:52
timrc	mgagne: ++	02:52
*** baoli has quit IRC		02:52
pleia2	hi Krenair, our mediawiki puppet module (and our entire wiki) is very much a work in progress	02:53
*** sdake has quit IRC		02:53
pleia2	Krenair: how'd you find us? :)	02:53
*** rbuzatu has joined #openstack-infra		02:53
timrc	I should have googled before I cast my vote :P Oh well... I'm fine with a fly pink armadillo :P	02:53
timrc	flying*	02:54
*** gouthamr_ has quit IRC		02:54
Krenair	pleia2, I've been working on openstack-related things for Wikimedia Labs, ran into the wiki	02:54
*** yuanying has quit IRC		02:54
pleia2	Krenair: cool, this may be of interest to you http://specs.openstack.org/openstack-infra/infra-specs/specs/wiki_modernization.html	02:54
Krenair	I also found the header at the top of templates/apache/mediawiki.erb :D	02:55
pleia2	Krenair: we have a few folks working on this spec to get a modern version, and we'd absolutely love the help from an expert	02:55
*** tqtran has joined #openstack-infra		02:55
*** kaisers_ has joined #openstack-infra		02:55
*** ddieterly has joined #openstack-infra		02:56
pleia2	fungi and jpmaxman here are the core drivers right now	02:56
pleia2	as you can read from the spec, our puppet module is incomplete and so some updates will need to be made there as we move toward a more fully automated deployment	02:58
*** rbuzatu has quit IRC		02:58
*** tqtran has quit IRC		02:59
jpmaxman	Hi Krenair any suggestions you have are welcome :)	02:59
*** kaisers_ has quit IRC		02:59
Krenair	just reading it now	03:00
pleia2	hey jpmaxman :)	03:00
jpmaxman	Hi :)	03:00
Krenair	Strictly speaking, MW 1.26 is still getting security fixes until November and should run with the current PHP version on there	03:02
Krenair	(1.25 (EOL) and 1.26 require PHP 5.3.3, you have 5.3.10)	03:03
*** gyee has quit IRC		03:03
Krenair	But I'm guessing you're thinking longer term than November, which means MW 1.27 which means PHP 5.5.9 or HHVM 3.1	03:04
*** rbuzatu has joined #openstack-infra		03:04
*** yamamoto_ has joined #openstack-infra		03:05
Krenair	I notice this suggests using Ubuntu 14.04, not 16.04	03:05
Krenair	Was it written before release?	03:05
pleia2	no, we don't have any 16.04 servers in our permanent fleet yet	03:05
Krenair	Or do you use other OSes now? I know Wikimedia servers are moving towards Debian Jessie instead of continuing on Ubuntu	03:06
Krenair	ok	03:06
pleia2	so we're still aiming at 14.04	03:06
*** thorst has joined #openstack-infra		03:07
*** ddieterly has quit IRC		03:08
Krenair	I think there was some progress re. the debian mediawiki package recently	03:08
pleia2	I think it was unclear whether we'd be using the packages (which as you probably know, were dropped from Debian and Ubuntu) or source	03:08
*** rdx_matt has joined #openstack-infra		03:09
Krenair	the guy working on that says MW 1.27 is in Debian unstable	03:09
*** rbuzatu has quit IRC		03:09
Krenair	It has a few issues, but then he's hoping to get it into testing... and eventually jessie-backports	03:10
Krenair	I don't know how it'd get from there to Ubuntu	03:10
pleia2	yeah, I don't think there are any plans to run Debian rather than Ubuntu for our servers	03:10
*** baoli has joined #openstack-infra		03:10
Krenair	You're 100% Ubuntu?	03:10
pleia2	once it gets into testing, it'll be pulled into an Ubuntu release, but that's likely not until the 18.04 LTS at this point	03:10
pleia2	we have some CentOS systems too	03:10
openstackgerrit	Kien Ha proposed openstack-infra/jenkins-job-builder: Fix link to findbugs minimal example https://review.openstack.org/347602	03:12
*** sdake has joined #openstack-infra		03:12
Krenair	it'll have to be source based install then, for now at least	03:12
* pleia2 nods		03:12
openstackgerrit	Kien Ha proposed openstack-infra/jenkins-job-builder: Fix link to findbugs minimal example https://review.openstack.org/347602	03:14
stevemar	anteaya: fungi yes we did take turtle :)	03:15
*** thorst has quit IRC		03:16
*** rbuzatu has joined #openstack-infra		03:16
Krenair	I'm not really familiar with existing puppet modules for mediawiki	03:16
pabelanger	ianw: just popping on to see how we are making out with fedora-24? I know we are building and uploading images with nodepool. Have you had a chance to run any jobs on them yet?	03:17
Krenair	Beyond Wikimedia's of course... which is probably overkill	03:17
*** baoli has quit IRC		03:17
pabelanger	ianw: I might have some time tomorrow to look at them help migrate	03:17
pleia2	Krenair: I'd say that part of the spec are done, the ones we found on puppet forge weren't maintained	03:19
pleia2	Krenair: so I think we're going to focus on continuing to improve our own	03:19
Krenair	Okay.	03:19
pleia2	Krenair: although, is the one wikimedia is using open source somewhere?	03:20
*** rbuzatu has quit IRC		03:20
pleia2	even if we don't use it directly, it may offer us some guidance	03:20
pabelanger	pleia2: do you mind helping land 347579? Temp removing bluebox from nodepool so we reduce exception warnings in the debug logs	03:20
Krenair	wikimedia's whole main puppet repo is open source (obviously it doesn't include secrets, private parts, etc.)	03:20
pleia2	pabelanger: sure thing, looking now	03:20
pleia2	pabelanger: done	03:21
pabelanger	pleia2: danke	03:21
Krenair	it can be found at https://github.com/wikimedia/operations-puppet - be aware the vast majority of it is for the various misc. services running, not MW	03:21
*** salv-orlando has joined #openstack-infra		03:22
pleia2	Krenair: great, so probably need to poke around https://github.com/wikimedia/operations-puppet/tree/production/modules/mediawiki	03:22
Krenair	right	03:22
Krenair	https://github.com/wikimedia/operations-puppet/tree/production/modules/role/manifests/mediawiki also	03:22
pleia2	ah good, a role too	03:23
Krenair	yeah, well... not just one. as you can see there are various different types of servers in the wikimedia cluster running mediawiki	03:23
pleia2	makes sense	03:23
Krenair	dedicated machines for running jobs, image scaling, video scaling, etc.	03:23
Krenair	can't run wikipedia on a single node :)	03:23
pleia2	hah, indeed :)	03:24
Krenair	and we manually maintain the mediawiki files themselves on the deployment host	03:24
Krenair	it's not intended for openstack's use case at all	03:25
*** Liuqing has joined #openstack-infra		03:25
pleia2	yeah, our wiki is pretty simple	03:25
*** rbuzatu has joined #openstack-infra		03:25
Krenair	there may be reusable puppet code somewhere under https://www.mediawiki.org/wiki/MediaWiki-Vagrant	03:26
Krenair	but it's for development	03:26
pleia2	noted	03:26
*** erlon has quit IRC		03:26
Srinu	hi. i jenkins openstack ci the jenkins slave is kiiling ssd by itself making the slave offline. how can we stop that	03:27
*** rbuzatu_ has joined #openstack-infra		03:27
pleia2	Krenair: I need to step away for the evening, but please feel welcome to stick around, we'd definitely appreciate your expertise as we work through this	03:27
*** salv-orlando has quit IRC		03:28
Krenair	okay	03:28
*** kushal has joined #openstack-infra		03:28
Krenair	is there some way I can set up a local VM to test the current puppet module?	03:29
*** eliqiao has quit IRC		03:29
pleia2	Krenair: we have docs for how we use our puppet stuff here: http://docs.openstack.org/infra/system-config/sysadmin.html#making-a-change-in-puppet	03:29
pabelanger	pleia2: sorry, can you quickly get 347525 too before you drop for the night	03:29
pabelanger	pleia2: a dependency for 347579	03:29
*** rbuzatu has quit IRC		03:29
pleia2	Krenair: the local.pp would likely be something like what we have in https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/wiki.pp	03:30
pleia2	pabelanger: sure	03:30
pleia2	sorted	03:30
*** eliqiao has joined #openstack-infra		03:31
*** tphummel has joined #openstack-infra		03:31
*** adrian_otto has joined #openstack-infra		03:31
*** rbuzatu_ has quit IRC		03:31
pleia2	Krenair: I expect it won't fully deploy since I think we're missing some things, there is a bit too much manual stuff going on in production still	03:32
Srinu	pleia2: hi. i have jenkins openstack ci step. the jenkins slave is kiling sshd by itself making the slave offline. in jenkins computer info tab, the response time field, time out for 1 try and making slave offline.how can we stop that	03:35
*** dingyichen has quit IRC		03:36
*** dingyichen has joined #openstack-infra		03:37
*** rbuzatu has joined #openstack-infra		03:38
*** oanson has joined #openstack-infra		03:40
openstackgerrit	Merged openstack-infra/project-config: Turn bluebox max servers to -1 https://review.openstack.org/347525	03:40
*** rdx_matt has quit IRC		03:41
openstackgerrit	Kien Ha proposed openstack-infra/jenkins-job-builder: Update HTML Publisher plugin to use convert xml https://review.openstack.org/347605	03:41
*** rbuzatu has quit IRC		03:42
*** shashank_hegde has quit IRC		03:44
openstackgerrit	Merged openstack-infra/project-config: Remove bluebox https://review.openstack.org/347579	03:48
*** rbuzatu has joined #openstack-infra		03:49
*** Nikolay_St has joined #openstack-infra		03:50
*** adrian_otto has quit IRC		03:52
*** yuanying has joined #openstack-infra		03:52
*** harlowja_at_home has joined #openstack-infra		03:52
*** rbuzatu has quit IRC		03:53
*** links has joined #openstack-infra		03:54
*** dimtruck is now known as zz_dimtruck		03:59
ianw	pabelanger: sorry, just popped out for lunch	03:59
*** rossella_s has quit IRC		03:59
ianw	pabelanger: anyway, i haven't got back to it, other things keep coming up, will try to make some time	04:00
pabelanger	ianw: np, was just about to wrap up for the night. So have a few more mins	04:00
*** rbuzatu has joined #openstack-infra		04:00
pabelanger	ianw: okay, np. I can give some jobs a spin in the morning see how they preform	04:00
*** rossella_s has joined #openstack-infra		04:00
*** oanson has quit IRC		04:00
ianw	pabelanger: last thing that happened was ansible wasn't connecting, let me kick one off..	04:02
ianw	192.237.253.92 19885	04:03
ianw	yeah, same thing -> http://logs.openstack.org/66/347566/1/experimental/gate-tempest-dsvm-platform-fedora24/07356fc/_zuul_ansible/ansible_log.txt	04:03
pabelanger	Oh right	04:04
pabelanger	hmm	04:04
pabelanger	okay, I'll dig into that in the morning	04:04
ianw	there was some suggestion about locales? i do have a fix out for locale setting, but not sure if it's related	04:04
pabelanger	I think that was the locales issue	04:04
pabelanger	ya	04:04
pabelanger	I can confirm in the morning	04:04
*** rbuzatu has quit IRC		04:04
pabelanger	we can have nodepool auto hold the node to debug it	04:04
ianw	pabelanger: ok, i'll get https://review.openstack.org/#/c/342544/ going too	04:05
pabelanger	nodepool job-create I think	04:05
pabelanger	ianw: cool, okay. Out for the night, will follow up with you tomorrow	04:05
ianw	pabelanger: np, i'll jump on early to catch you and we'll focus on it	04:06
*** kaisers_ has joined #openstack-infra		04:07
*** kaisers_ has quit IRC		04:07
*** dingyichen has quit IRC		04:08
*** sandanar has joined #openstack-infra		04:09
*** links has quit IRC		04:09
*** rbuzatu has joined #openstack-infra		04:11
*** wcriswelc has joined #openstack-infra		04:11
*** stewie925 has quit IRC		04:12
*** eeiden has quit IRC		04:12
sdake	AJaeger reading that project-config review for fuel-ccp from you was kind of hilarious :)	04:12
*** links has joined #openstack-infra		04:12
*** skipp_ has quit IRC		04:12
*** wcriswell has quit IRC		04:14
*** thorst has joined #openstack-infra		04:15
*** rbuzatu has quit IRC		04:16
*** shashank_hegde has joined #openstack-infra		04:17
Srinu	pabelanger:hi. i have jenkins openstack ci step. the jenkins slave is kiling sshd by itself making the slave offline. in jenkins computer info tab, the response time field, time out for 1 try and making slave offline.how can we stop that	04:18
*** rwsu has quit IRC		04:18
pabelanger	#status log gate-tempest-dsvm-platform-fedora24 added to nodepool auto-hold to debug ansible failures	04:19
openstackstatus	pabelanger: finished logging	04:19
pabelanger	Srinu: sorry, logging off for the night	04:19
Srinu	pabelanger: ok good night	04:20
pabelanger	ianw: if you run the job again, nodepool will keep the node online to debug	04:20
pabelanger	ianw: I'll continue debugging in the morning	04:20
*** sree has joined #openstack-infra		04:20
ianw	pabelanger: ok ... let's see here	04:21
*** thorst has quit IRC		04:21
*** harlowja_at_home has quit IRC		04:22
*** Nikolay_St has quit IRC		04:22
*** rbuzatu has joined #openstack-infra		04:22
ianw	104.239.174.204 19885	04:22
ianw	cool yep it's held	04:23
openstackgerrit	Joshua Hesketh proposed openstack-infra/zuul: Add support for sqlalchemy reporter https://review.openstack.org/223333	04:23
*** javeriak has joined #openstack-infra		04:24
*** salv-orlando has joined #openstack-infra		04:24
*** asettle has joined #openstack-infra		04:26
*** shashank_hegde has quit IRC		04:26
Srinu	ianw: did you saw my questions. can you please help me	04:26
*** rbuzatu has quit IRC		04:26
*** stewie925 has joined #openstack-infra		04:27
*** timl0101 has quit IRC		04:27
*** salv-orlando has quit IRC		04:28
ianw	Srinu: sorry, not sure i have any insight into your issues.	04:28
openstackgerrit	Kien Ha proposed openstack-infra/jenkins-job-builder: gitlab trigger: Support new "trigger-open-merge-request-push" options https://review.openstack.org/312121	04:29
*** javeriak has quit IRC		04:29
*** skipp has joined #openstack-infra		04:29
*** javeriak has joined #openstack-infra		04:29
*** jamielennox is now known as jamielennox\|away		04:30
*** timl0101 has joined #openstack-infra		04:30
*** yamamoto_ has quit IRC		04:31
*** asettle has quit IRC		04:31
*** rwsu has joined #openstack-infra		04:32
*** dingyichen has joined #openstack-infra		04:33
*** rbuzatu has joined #openstack-infra		04:33
*** shashank_hegde has joined #openstack-infra		04:34
*** garyk has joined #openstack-infra		04:36
openstackgerrit	Matthew Treinish proposed openstack-infra/germqtt: Add missing .gitreview file https://review.openstack.org/347616	04:36
openstackgerrit	Matthew Treinish proposed openstack-infra/germqtt: Add MQTT auth support https://review.openstack.org/347617	04:36
openstackgerrit	Matthew Treinish proposed openstack-infra/germqtt: Add docs explaining mqtt topic layout https://review.openstack.org/347618	04:36
*** garyk has quit IRC		04:36
*** garyk has joined #openstack-infra		04:37
*** rbuzatu has quit IRC		04:37
*** rdx_matt has joined #openstack-infra		04:39
*** jtomasek has quit IRC		04:41
*** garyk has quit IRC		04:42
*** sandanar has quit IRC		04:44
*** rbuzatu has joined #openstack-infra		04:44
*** rbuzatu has quit IRC		04:49
*** jamielennox\|away is now known as jamielennox		04:51
*** psachin has joined #openstack-infra		04:52
*** rbuzatu has joined #openstack-infra		04:54
*** rbuzatu_ has joined #openstack-infra		04:55
*** eeiden has joined #openstack-infra		04:57
*** rbuzatu has quit IRC		04:58
*** yamahata has joined #openstack-infra		05:00
*** rbuzatu_ has quit IRC		05:00
*** garyk has joined #openstack-infra		05:02
openstackgerrit	Matthew Treinish proposed openstack-infra/germqtt: Add missing .gitreview file https://review.openstack.org/347616	05:06
openstackgerrit	Matthew Treinish proposed openstack-infra/germqtt: Add MQTT auth support https://review.openstack.org/347617	05:06
openstackgerrit	Matthew Treinish proposed openstack-infra/germqtt: Add docs explaining mqtt topic layout https://review.openstack.org/347618	05:06
openstackgerrit	Matthew Treinish proposed openstack-infra/germqtt: Fix all things tox https://review.openstack.org/347623	05:06
*** rbuzatu has joined #openstack-infra		05:06
*** roxanaghe has quit IRC		05:11
*** rbuzatu has quit IRC		05:11
*** abregman has joined #openstack-infra		05:12
*** rdx_matt has quit IRC		05:12
*** roxanaghe has joined #openstack-infra		05:12
*** salv-orlando has joined #openstack-infra		05:14
*** roxanaghe has quit IRC		05:17
*** rbuzatu has joined #openstack-infra		05:18
*** thorst has joined #openstack-infra		05:20
*** yamamot__ has joined #openstack-infra		05:22
*** rbuzatu has quit IRC		05:22
*** nwkarsten has quit IRC		05:23
*** oanson has joined #openstack-infra		05:24
ianw	pabelanger: ok, so i debugged this a bit ... i can replicate with a local ansible. it is definitely the lack of locale. actually i think the root cause is forgetting to install en langpack as fixed by https://review.openstack.org/#/c/342544	05:25
*** thorst has quit IRC		05:26
*** rbuzatu has joined #openstack-infra		05:27
ianw	greghaynes: i might try to get a point release out for that when it goes in. there's only small stuff since last release	05:28
*** rbuzatu_ has joined #openstack-infra		05:29
*** rbuzatu has quit IRC		05:33
*** rbuzatu_ has quit IRC		05:33
*** pgadiya has joined #openstack-infra		05:34
*** jianghuaw has joined #openstack-infra		05:37
*** rbuzatu has joined #openstack-infra		05:40
jianghuaw	hi, my zuul ran into dead loop again due to there are dependent Unknown project - openstack-infra/puppet-germqtt. This project was new added in the upstream layout several days ago.	05:41
jianghuaw	Isn't it a bug within zuul?	05:41
jianghuaw	in my opinion, it shouldn't run into dead loop even the project is unknown. right?	05:42
jianghuaw	Without fixing it, it seems difficult to avoid similar CI broken. in case new project to be added sometime in the future.	05:44
*** sputnik13 has quit IRC		05:44
*** rbuzatu has quit IRC		05:44
jianghuaw	Any thought or advice?	05:45
*** KaitoDaumoto has quit IRC		05:50
*** weshay has quit IRC		05:50
*** rbuzatu has joined #openstack-infra		05:51
*** bhavik has joined #openstack-infra		05:51
*** sandanar has joined #openstack-infra		05:53
*** rbuzatu has quit IRC		05:55
*** coolsvap_ is now known as coolsvap		05:56
*** r-mibu has quit IRC		05:56
*** r-mibu has joined #openstack-infra		05:57
*** tqtran has joined #openstack-infra		05:58
*** javeriak has quit IRC		06:00
*** thorst has joined #openstack-infra		06:01
*** rbuzatu has joined #openstack-infra		06:02
*** tqtran has quit IRC		06:02
*** rbuzatu has quit IRC		06:07
*** thorst has quit IRC		06:08
*** garyk has quit IRC		06:09
openstackgerrit	Ben Kero proposed openstack-infra/project-config: Run chef jobs on xenial https://review.openstack.org/347633	06:09
bkero	clarkb: ^	06:09
*** rdx_matt has joined #openstack-infra		06:10
*** rbuzatu has joined #openstack-infra		06:11
*** Liuqing has quit IRC		06:12
*** rbuzatu_ has joined #openstack-infra		06:13
*** roxanaghe has joined #openstack-infra		06:13
*** Liuqing has joined #openstack-infra		06:13
*** rbuzatu has quit IRC		06:16
*** sdake has quit IRC		06:16
*** rbuzatu_ has quit IRC		06:17
*** roxanaghe has quit IRC		06:18
*** Nikolay_St has joined #openstack-infra		06:19
openstackgerrit	Andreas Jaeger proposed openstack-infra/project-config: Remove unused trusty jobs https://review.openstack.org/347147	06:20
openstackgerrit	Kien Ha proposed openstack-infra/jenkins-job-builder: Update EnvInject plugin https://review.openstack.org/324140	06:20
*** rbuzatu has joined #openstack-infra		06:24
*** rbuzatu has quit IRC		06:28
*** salv-orl_ has joined #openstack-infra		06:28
*** Ravikiran_K has joined #openstack-infra		06:30
*** shashank_hegde has quit IRC		06:31
*** salv-orlando has quit IRC		06:31
openstackgerrit	Tatiana Ovchinnikova proposed openstack-infra/project-config: Add Django 1.9 and 1.10 tests to Manila UI https://review.openstack.org/346678	06:33
*** amitkqed has joined #openstack-infra		06:35
*** rbuzatu has joined #openstack-infra		06:35
*** amitkqed has quit IRC		06:36
openstackgerrit	Kien Ha proposed openstack-infra/jenkins-job-builder: Update EnvInject plugin https://review.openstack.org/324140	06:36
*** amitkqed has joined #openstack-infra		06:37
*** asettle has joined #openstack-infra		06:39
*** rbuzatu has quit IRC		06:40
*** rdx_matt has quit IRC		06:42
*** asettle has quit IRC		06:43
*** tesseract- has joined #openstack-infra		06:44
*** kien-ha has quit IRC		06:44
*** sdake has joined #openstack-infra		06:45
*** rbuzatu has joined #openstack-infra		06:46
yolanda	good morning	06:47
*** rcernin has joined #openstack-infra		06:47
bkero	Good morning!	06:47
*** ameade has quit IRC		06:49
*** igorbelikov has quit IRC		06:49
*** derekjhyang has quit IRC		06:49
*** asaprykin has quit IRC		06:49
*** dham1 has quit IRC		06:49
*** jraim has quit IRC		06:49
*** zhiyan has quit IRC		06:49
*** mattfarina has quit IRC		06:49
*** briancurtin has quit IRC		06:49
*** shashank_hegde has joined #openstack-infra		06:49
*** amit213 has quit IRC		06:50
*** monester has quit IRC		06:50
*** cargonza has quit IRC		06:50
*** jamesmcarthur has quit IRC		06:50
*** ildikov has quit IRC		06:50
*** asaprykin has joined #openstack-infra		06:51
*** mattfarina has joined #openstack-infra		06:51
*** igorbelikov has joined #openstack-infra		06:51
*** jamesmcarthur has joined #openstack-infra		06:51
*** monester has joined #openstack-infra		06:51
*** cargonza has joined #openstack-infra		06:51
*** ildikov has joined #openstack-infra		06:51
*** amit213 has joined #openstack-infra		06:51
openstackgerrit	Craige McWhirter proposed openstack-infra/puppet-phabricator: Patches Required to Deliver Pholio https://review.openstack.org/342481	06:51
*** rbuzatu has quit IRC		06:51
*** dham1 has joined #openstack-infra		06:51
*** derekjhyang has joined #openstack-infra		06:52
*** jraim has joined #openstack-infra		06:52
*** briancurtin has joined #openstack-infra		06:52
*** ameade has joined #openstack-infra		06:52
*** zhiyan has joined #openstack-infra		06:52
*** larainema has quit IRC		06:52
*** larainema has joined #openstack-infra		06:55
*** rbuzatu has joined #openstack-infra		06:57
*** nmagnezi has joined #openstack-infra		06:58
*** nmagnezi has quit IRC		07:01
*** sdake has quit IRC		07:01
*** nmagnezi has joined #openstack-infra		07:01
*** rbuzatu has quit IRC		07:02
*** ramishra has quit IRC		07:02
*** ramishra has joined #openstack-infra		07:03
*** esikachev has joined #openstack-infra		07:05
*** kushal has quit IRC		07:05
*** thorst has joined #openstack-infra		07:08
*** rbuzatu has joined #openstack-infra		07:08
*** r-mibu has quit IRC		07:09
*** ramishra has quit IRC		07:13
*** rbuzatu has quit IRC		07:13
*** thorst has quit IRC		07:14
*** ramishra has joined #openstack-infra		07:14
openstackgerrit	Merged openstack-infra/project-config: Remove unused devstack-gate job https://review.openstack.org/347567	07:15
openstackgerrit	Andreas Jaeger proposed openstack-infra/project-config: Add some debug output for release-note test https://review.openstack.org/347663	07:16
*** Nikolay_St has left #openstack-infra		07:17
*** rdx_matt has joined #openstack-infra		07:17
*** rbuzatu has joined #openstack-infra		07:18
*** dizquierdo has joined #openstack-infra		07:18
openstackgerrit	Andreas Jaeger proposed openstack-infra/project-config: Add some debug output for release-note test, add further job https://review.openstack.org/347663	07:19
AJaeger	fungi, first release-note test job with zuul-cloner works fine on master but I'd like some more debug output - and wait for stable changes to merge. Also, added openstack-manuals ^	07:19
*** amotoki has joined #openstack-infra		07:19
*** jordanP has joined #openstack-infra		07:19
*** jordanP has quit IRC		07:19
*** rbuzatu_ has joined #openstack-infra		07:19
*** e0ne has joined #openstack-infra		07:20
*** asettle has joined #openstack-infra		07:21
*** vdrok has quit IRC		07:22
*** rbuzatu has quit IRC		07:22
*** vdrok has joined #openstack-infra		07:23
*** rbuzatu_ has quit IRC		07:24
*** ramishra has quit IRC		07:24
*** ramishra has joined #openstack-infra		07:25
*** salv-orlando has joined #openstack-infra		07:25
*** flepied has quit IRC		07:25
*** kushal has joined #openstack-infra		07:25
*** salv-orl_ has quit IRC		07:25
*** asettle has quit IRC		07:26
*** kzaitsev_mb has joined #openstack-infra		07:29
*** andreas_s has joined #openstack-infra		07:29
*** rbuzatu has joined #openstack-infra		07:31
openstackgerrit	Merged openstack-infra/project-config: Remove the check tox env from irc-meetings https://review.openstack.org/347510	07:32
*** itisha has joined #openstack-infra		07:33
*** sc68cal has quit IRC		07:33
*** jpich has joined #openstack-infra		07:33
*** sc68cal has joined #openstack-infra		07:33
*** jlanoux has joined #openstack-infra		07:34
*** isq_ has quit IRC		07:34
*** vponomaryov1 has joined #openstack-infra		07:34
*** isq_ has joined #openstack-infra		07:34
*** ajmiller_ has quit IRC		07:35
*** adreznec has quit IRC		07:35
*** ajmiller_ has joined #openstack-infra		07:35
*** aviau has quit IRC		07:35
*** aviau has joined #openstack-infra		07:35
*** rbuzatu has quit IRC		07:35
*** mtreinish has quit IRC		07:36
*** timl0101 has quit IRC		07:36
*** mtreinish has joined #openstack-infra		07:36
*** shashank_hegde has quit IRC		07:37
*** timl0101 has joined #openstack-infra		07:37
*** jogo has quit IRC		07:38
*** shardy has joined #openstack-infra		07:38
*** qb_ has quit IRC		07:39
*** qb_ has joined #openstack-infra		07:39
*** ramishra has quit IRC		07:39
*** adreznec has joined #openstack-infra		07:39
*** lennyb has quit IRC		07:40
*** ramishra has joined #openstack-infra		07:40
*** rbuzatu has joined #openstack-infra		07:40
*** jogo has joined #openstack-infra		07:40
openstackgerrit	Merged openstack-infra/system-config: Add documentation about Chanserv's auto-kick list https://review.openstack.org/347432	07:41
*** lennyb has joined #openstack-infra		07:41
*** ifarkas_afk is now known as ifarkas		07:41
*** acoles_ is now known as acoles		07:41
*** rbuzatu_ has joined #openstack-infra		07:42
*** gildub has quit IRC		07:43
*** rbuzatu has quit IRC		07:44
openstackgerrit	Merged openstack-infra/project-config: [murano-apps] add 'gate-murano-apps-linters' job https://review.openstack.org/344838	07:45
*** florianf has joined #openstack-infra		07:46
*** mhickey has joined #openstack-infra		07:46
*** rbuzatu_ has quit IRC		07:47
*** e0ne has quit IRC		07:48
*** atom_ has joined #openstack-infra		07:49
*** ramishra has quit IRC		07:50
*** jtomasek has joined #openstack-infra		07:50
*** ramishra has joined #openstack-infra		07:50
openstackgerrit	Merged openstack-infra/project-config: Add python-don https://review.openstack.org/346394	07:51
openstackgerrit	Merged openstack-infra/project-config: Make py35 voting for Heat https://review.openstack.org/346602	07:51
openstackgerrit	Merged openstack-infra/project-config: [Manila] Move dummy driver job to check pipeline https://review.openstack.org/347223	07:52
openstackgerrit	Merged openstack-infra/project-config: tempest/CLI tests for Sahara require also console-log https://review.openstack.org/347197	07:52
*** rbuzatu has joined #openstack-infra		07:53
*** javeriak has joined #openstack-infra		07:55
*** kzaitsev_mb has quit IRC		07:55
openstackgerrit	Kota Tsuyuzaki proposed openstack-infra/project-config: Add python jobs to pyeclib project https://review.openstack.org/317672	07:56
*** rbuzatu has quit IRC		07:57
*** tonytan4ever has quit IRC		07:58
*** tonytan4ever has joined #openstack-infra		07:59
*** zzzeek has quit IRC		08:00
*** rossella_s has quit IRC		08:00
*** zzzeek has joined #openstack-infra		08:00
*** dingyichen has quit IRC		08:00
*** rossella_s has joined #openstack-infra		08:00
*** ramishra has quit IRC		08:00
*** flepied has joined #openstack-infra		08:01
*** ramishra has joined #openstack-infra		08:01
*** roxanaghe has joined #openstack-infra		08:01
*** derekh has joined #openstack-infra		08:03
*** rbuzatu has joined #openstack-infra		08:04
*** wewe0901 has joined #openstack-infra		08:04
vgridnev	can someone from infra team review https://review.openstack.org/#/c/346457/ ?	08:04
*** Apsu has joined #openstack-infra		08:05
*** roxanaghe has quit IRC		08:06
*** hashar has joined #openstack-infra		08:07
*** snarwade has quit IRC		08:07
*** sflanigan has quit IRC		08:07
*** phschwartz has quit IRC		08:08
*** phschwartz has joined #openstack-infra		08:08
*** rbuzatu has quit IRC		08:08
openstackgerrit	OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/347683	08:08
*** jogo has quit IRC		08:09
*** ramishra has quit IRC		08:09
*** ihrachys has joined #openstack-infra		08:09
*** salv-orlando has quit IRC		08:10
*** ramishra has joined #openstack-infra		08:10
*** tonytan4ever has quit IRC		08:11
*** thorst has joined #openstack-infra		08:11
*** snarwade has joined #openstack-infra		08:11
*** ramishra has quit IRC		08:11
*** ramishra has joined #openstack-infra		08:11
*** jogo has joined #openstack-infra		08:11
*** jogo has joined #openstack-infra		08:11
*** salv-orlando has joined #openstack-infra		08:12
*** kzaitsev_mb has joined #openstack-infra		08:12
*** Na3iL has joined #openstack-infra		08:12
*** rbuzatu has joined #openstack-infra		08:15
*** jlanoux has quit IRC		08:16
*** jlanoux has joined #openstack-infra		08:16
*** asettle has joined #openstack-infra		08:17
*** salv-orlando has quit IRC		08:17
*** thorst has quit IRC		08:18
*** acruz has joined #openstack-infra		08:19
*** rbuzatu has quit IRC		08:20
*** asettle has quit IRC		08:21
*** ramishra has quit IRC		08:21
*** ramishra has joined #openstack-infra		08:22
*** ramishra has quit IRC		08:22
*** ramishra has joined #openstack-infra		08:22
*** weshay has joined #openstack-infra		08:22
*** rbuzatu has joined #openstack-infra		08:24
*** lucas-dinner is now known as lucasagomes		08:24
*** abregman has quit IRC		08:25
*** abregman has joined #openstack-infra		08:25
openstackgerrit	Yaroslav Lobankov proposed openstack-infra/project-config: Add openstack/pipe-report project https://review.openstack.org/339549	08:25
*** tosky has joined #openstack-infra		08:25
*** rbuzatu_ has joined #openstack-infra		08:26
*** kzaitsev_mb has quit IRC		08:26
*** Na3iL has quit IRC		08:27
*** ramishra has quit IRC		08:27
*** ramishra has joined #openstack-infra		08:28
*** rbuzatu has quit IRC		08:29
*** ramishra has quit IRC		08:29
*** ramishra has joined #openstack-infra		08:29
*** rbuzatu_ has quit IRC		08:31
*** r-mibu has joined #openstack-infra		08:31
*** acoles is now known as acoles_		08:31
*** tphummel has quit IRC		08:35
*** acoles_ is now known as acoles		08:35
*** ramishra has quit IRC		08:37
*** rbuzatu has joined #openstack-infra		08:37
*** e0ne has joined #openstack-infra		08:40
*** ramishra_ has joined #openstack-infra		08:40
*** ramishra_ has quit IRC		08:41
*** ramishra_ has joined #openstack-infra		08:41
*** Na3iL has joined #openstack-infra		08:42
*** rbuzatu has quit IRC		08:42
*** priteau has joined #openstack-infra		08:43
*** kzaitsev_mb has joined #openstack-infra		08:47
*** javeriak has quit IRC		08:48
*** rbuzatu has joined #openstack-infra		08:48
*** savihou has joined #openstack-infra		08:50
*** apetrich has quit IRC		08:51
openstackgerrit	Merged openstack/diskimage-builder: yum-minimal: set locale.conf and tz in chroot https://review.openstack.org/342544	08:52
*** rbuzatu has quit IRC		08:52
*** Goneri has joined #openstack-infra		08:55
*** priteau has quit IRC		08:57
*** moravec has quit IRC		09:00
*** rbuzatu has joined #openstack-infra		09:00
*** moravec has joined #openstack-infra		09:00
*** roxanaghe has joined #openstack-infra		09:00
*** rbuzatu has quit IRC		09:00
*** rbuzatu has joined #openstack-infra		09:01
*** tonytan4ever has joined #openstack-infra		09:01
ianw	pabelanger: ^ pushed 1.18.2 with this change. ergo i think f24 should work after tomorrows build & upload. we can still root cause it & see if we can get ansible to be more helpful...	09:01
ianw	greghaynes: ^ fyi ... all just little bug fixes since 1.18.1	09:02
*** tonytan4ever has quit IRC		09:05
*** roxanaghe has quit IRC		09:06
*** apetrich has joined #openstack-infra		09:10
*** asettle has joined #openstack-infra		09:13
openstackgerrit	Merged openstack-infra/puppet-subunit2sql: Make sure global worker defs only done once https://review.openstack.org/347530	09:13
*** thorst has joined #openstack-infra		09:16
*** kzaitsev_mb has quit IRC		09:16
*** asettle has quit IRC		09:18
*** thorst has quit IRC		09:23
openstackgerrit	Merged openstack-infra/puppet-bandersnatch: Ensure pip updates to latest release https://review.openstack.org/347587	09:27
openstackgerrit	yolanda.robla proposed openstack-infra/shade: Forklift in YamlJsonSerializer https://review.openstack.org/343615	09:27
*** mikelk has joined #openstack-infra		09:29
*** nherciu has joined #openstack-infra		09:31
*** asettle has joined #openstack-infra		09:31
*** dansmith has quit IRC		09:33
rcarrillocruz	ianw: i've approved https://review.openstack.org/#/c/321339/3 , depends on merged	09:33
*** dizquierdo has quit IRC		09:34
*** dansmith has joined #openstack-infra		09:35
*** dansmith is now known as Guest41069		09:35
*** asettle has quit IRC		09:36
*** rbuzatu has quit IRC		09:38
openstackgerrit	Merged openstack-infra/system-config: Revert "Work around bandersnatch not supporting pep503" https://review.openstack.org/321339	09:40
*** rbuzatu has joined #openstack-infra		09:43
*** ccamacho has joined #openstack-infra		09:44
*** electrofelix has joined #openstack-infra		09:46
*** rbuzatu has quit IRC		09:47
*** liusheng has quit IRC		09:47
openstackgerrit	Merged openstack-infra/puppet-infracloud: Update trust certificates for Redhat https://review.openstack.org/335047	09:53
*** rbuzatu has joined #openstack-infra		09:53
*** rbuzatu has quit IRC		09:56
*** rbuzatu has joined #openstack-infra		09:57
*** chlong_POffice has quit IRC		09:57
*** zhurong has quit IRC		10:01
sulo	hi, anyone around to give https://review.openstack.org/#/c/345453/ a quick look please	10:01
*** Liuqing has quit IRC		10:03
*** LinuxJedi has left #openstack-infra		10:03
*** hwcomcn has joined #openstack-infra		10:06
*** acoles is now known as acoles_		10:07
*** chlong_POffice has joined #openstack-infra		10:11
*** yanyanhu has quit IRC		10:13
lennyb	fatal: unable to connect to git.openstack.org	10:15
lennyb	is git OK?	10:15
*** furlongm has quit IRC		10:15
*** furlongm has joined #openstack-infra		10:16
*** dizquierdo has joined #openstack-infra		10:17
*** john-davidge has joined #openstack-infra		10:18
*** john-dav_ has joined #openstack-infra		10:20
openstackgerrit	Tom Fifield proposed openstack-infra/groups-static-pages: Syntax fix for organiser docs https://review.openstack.org/347747	10:22
*** john-davidge has quit IRC		10:22
*** thorst has joined #openstack-infra		10:23
openstackgerrit	Merged openstack-infra/groups-static-pages: Syntax fix for organiser docs https://review.openstack.org/347747	10:24
*** thorst has quit IRC		10:29
*** ociuhandu has joined #openstack-infra		10:30
*** yamamot__ has quit IRC		10:31
*** GheRivero has left #openstack-infra		10:33
*** john-dav_ is now known as john-davidge		10:34
openstackgerrit	Dong Ma proposed openstack-infra/subunit2sql: Fix the subunit2sql migration error with mysql 5.7 https://review.openstack.org/347752	10:37
*** javeriak has joined #openstack-infra		10:37
rcarrillocruz	lennyb: i can clone fine, must have been a transient issue or your end?	10:40
openstackgerrit	Ihar Hrachyshka proposed openstack-infra/project-config: grafana: split neutron integrated gate dashboard https://review.openstack.org/346953	10:42
*** yamahata has quit IRC		10:48
openstackgerrit	vinay kumar muddu proposed openstack/diskimage-builder: Build wholedisk images capable of UEFI secure boot https://review.openstack.org/333888	10:51
openstackgerrit	vinay kumar muddu proposed openstack/diskimage-builder: Add support for building images capable of UEFI https://review.openstack.org/287784	10:51
lennyb	rcarrillocruz: it looks ok now. thanks	10:52
*** ylobankov has joined #openstack-infra		10:55
ylobankov	Hi everybody. yolanda, AJaeger, rcarrillocruz, clarkb, could you please take a look at https://review.openstack.org/#/c/339549/ ? Thanks in advance!	11:01
*** tpsilva has joined #openstack-infra		11:05
*** apetrich has quit IRC		11:08
*** salv-orlando has joined #openstack-infra		11:09
*** vincentll has joined #openstack-infra		11:09
*** Na3iL has quit IRC		11:10
*** gnuoy has quit IRC		11:13
*** yamamoto has joined #openstack-infra		11:13
*** lucasagomes is now known as lucas-hungry		11:13
*** gouthamr has joined #openstack-infra		11:14
*** yamamoto_ has joined #openstack-infra		11:14
*** bhavik has quit IRC		11:14
*** gnuoy has joined #openstack-infra		11:15
*** yamamoto has quit IRC		11:18
openstackgerrit	Beth Elwell proposed openstack-infra/project-config: Added publish jobs to js-openstack-lib project https://review.openstack.org/347766	11:20
*** csomerville has quit IRC		11:20
*** gouthamr_ has joined #openstack-infra		11:21
*** cody-somerville has joined #openstack-infra		11:21
*** cody-somerville has joined #openstack-infra		11:21
*** Ahharu has quit IRC		11:24
*** gouthamr has quit IRC		11:24
*** thorst has joined #openstack-infra		11:26
*** bookwar has joined #openstack-infra		11:27
bookwar	hi, is it possible to trigger gerrit ref-updated event manually via zuul client?	11:28
bookwar	zuul enqueue command requires change-id parameter, which doesn't exist in case of ref-updated event afaik	11:29
*** javeriak has quit IRC		11:30
*** javeriak has joined #openstack-infra		11:30
*** sdague has joined #openstack-infra		11:30
*** gouthamr_ is now known as gouthamr		11:30
*** thorst has quit IRC		11:31
*** ociuhandu has quit IRC		11:33
*** ociuhandu has joined #openstack-infra		11:35
sebian	corvus: oh neat! thx! let's update the Debian package :)	11:38
*** jkilpatr has joined #openstack-infra		11:41
*** shardy is now known as shardy_lunch		11:43
*** rhallisey has joined #openstack-infra		11:44
*** Sukhdev has joined #openstack-infra		11:45
*** yamamoto_ has quit IRC		11:46
*** gordc has joined #openstack-infra		11:46
*** mhickey_ has joined #openstack-infra		11:47
*** gildub has joined #openstack-infra		11:48
*** mhickey_ has quit IRC		11:48
*** thorst has joined #openstack-infra		11:49
*** erlon has joined #openstack-infra		11:51
*** savihou has quit IRC		11:52
*** savihou has joined #openstack-infra		11:53
*** markusry has joined #openstack-infra		11:56
*** thorst has quit IRC		11:56
*** Na3iL has joined #openstack-infra		11:59
*** rossella_s has quit IRC		11:59
*** asettle has joined #openstack-infra		11:59
*** esikachev has quit IRC		12:00
openstackgerrit	Derek Higgins proposed openstack-infra/tripleo-ci: Update the link to the current-tripleo repository https://review.openstack.org/347796	12:00
openstackgerrit	Derek Higgins proposed openstack-infra/tripleo-ci: Add details for rh1 deployments https://review.openstack.org/347797	12:00
*** rfolco has joined #openstack-infra		12:00
prometheanfire	any chance someone can look at https://review.openstack.org/#/c/307553/ for a second +2/+W :D	12:00
*** bhavik has joined #openstack-infra		12:00
*** rossella_s has joined #openstack-infra		12:00
*** moravec has quit IRC		12:01
*** thorst has joined #openstack-infra		12:02
*** sree has quit IRC		12:04
*** yamamoto has joined #openstack-infra		12:07
*** psilvad has joined #openstack-infra		12:09
*** rodrigods has quit IRC		12:09
*** rodrigods has joined #openstack-infra		12:09
*** javeriak has quit IRC		12:10
*** signed8bit_Zzz is now known as signed8bit		12:10
*** andymaier has joined #openstack-infra		12:12
*** pradk has joined #openstack-infra		12:12
*** aysyd has joined #openstack-infra		12:12
openstackgerrit	Craige McWhirter proposed openstack-infra/puppet-phabricator: Patches Required to Deliver Pholio https://review.openstack.org/342481	12:13
*** savihou has quit IRC		12:14
*** psilvad has quit IRC		12:16
*** esikachev has joined #openstack-infra		12:16
*** moravec has joined #openstack-infra		12:16
*** lucas-hungry is now known as lucasagomes		12:17
*** tonytan4ever has joined #openstack-infra		12:17
*** ddieterly has joined #openstack-infra		12:19
*** signed8bit has quit IRC		12:19
*** javeriak has joined #openstack-infra		12:20
*** chlong_POffice has quit IRC		12:21
*** tonytan4ever has quit IRC		12:22
*** ddieterly has quit IRC		12:22
*** claudiub has joined #openstack-infra		12:22
*** trown\|outtypewww is now known as trown		12:23
*** sdake has joined #openstack-infra		12:23
*** yamamoto has quit IRC		12:23
*** gouthamr has quit IRC		12:24
*** hwcomcn has quit IRC		12:25
*** psilvad has joined #openstack-infra		12:27
*** gildub has quit IRC		12:27
*** chlong has joined #openstack-infra		12:29
*** yamamoto has joined #openstack-infra		12:30
*** moravec has quit IRC		12:31
*** e0ne has quit IRC		12:31
*** yamamoto has quit IRC		12:33
pabelanger	ianw: okay	12:34
*** apetrich has joined #openstack-infra		12:35
*** gouthamr has joined #openstack-infra		12:36
Srinu	pabelanger: hi, when i am running two jobs in check pipeline. if one job finished and if another job is in tempest test. and the finished job slave vm will deleted and added a new node. while it is deleting finished job slave vm. it is deleting slave.jar process in another slave which is running tempest. this is causing slave went offline issue	12:37
*** tphummel has joined #openstack-infra		12:38
*** ddieterly has joined #openstack-infra		12:39
*** claudiub\|2 has joined #openstack-infra		12:39
*** rlandy has joined #openstack-infra		12:40
*** jkilpatr has quit IRC		12:40
tlbr	pabelanger, hi, could you please review https://review.openstack.org/#/c/307742 ?	12:41
openstackgerrit	James Slagle proposed openstack-infra/tripleo-ci: Set undercloud_hostname in multinode jobs https://review.openstack.org/347490	12:42
*** ganso has left #openstack-infra		12:42
*** tphummel has quit IRC		12:43
*** claudiub has quit IRC		12:43
Srinu	any one know the issue that i ping to pabelanger. please help me	12:43
Srinu	hi, when i am running two jobs in check pipeline. if one job finished and if another job is in tempest test. and the finished job slave vm will deleted and added a new node. while it is deleting finished job slave vm. it is deleting slave.jar process in another slave which is running tempest. this is causing slave went offline issue	12:43
*** ddieterly has quit IRC		12:44
pabelanger	tlbr: how does spice-html5 relate to openstack?	12:44
*** ccamacho is now known as ccamacho\|hungry		12:45
tlbr	pabelanger, actually Thomas described why we need it. But anyway, yes, it is a dependency of nova-consoleproxy package https://anonscm.debian.org/cgit/openstack/nova.git/tree/debian/control#n618	12:46
pabelanger	tlbr: okay, let some other comments	12:47
*** baoli has joined #openstack-infra		12:49
abregman	question about zuul. which service uses the "GerritWatcher" class, is it the zuul-server? can't find the reference	12:49
*** woodster_ has joined #openstack-infra		12:49
*** baoli_ has joined #openstack-infra		12:50
aspiers	fungi: wondering what you meant yesterday when you talked about hacking "an improvement to pbr so that sdist (and maybe bdist_wheel) can call build_sphinx doc/man"	12:51
aspiers	fungi: since it turns out that with gertty, python setup.py build_sphinx already works fine	12:51
aspiers	fungi: and it doesn't even require setting PBR_VERSION	12:51
*** yamamoto has joined #openstack-infra		12:52
*** javeriak has quit IRC		12:52
openstackgerrit	yolanda.robla proposed openstack-infra/shade: Forklift in YamlJsonSerializer https://review.openstack.org/343615	12:53
*** jkilpatr has joined #openstack-infra		12:53
pabelanger	clarkb: do we have any projects running python 2.7 on xenial?	12:53
*** matt-borland has joined #openstack-infra		12:54
*** baoli has quit IRC		12:55
pabelanger	AJaeger: you might know too^	12:55
*** pfallenop has quit IRC		12:55
openstackgerrit	Zara proposed openstack-infra/python-storyboardclient: Add 'restricted' field to branches https://review.openstack.org/347809	12:55
jroll	clarkb: happy to have that chat about reducing ironic jobs when you're around, I've had some thoughts on that lately as well	12:56
*** pt_15 has joined #openstack-infra		12:56
zigo	pabelanger: I don't understand your comment here: https://review.openstack.org/#/c/307742/8/zuul/layout.yaml	13:00
openstackgerrit	Witold Bedyk proposed openstack-infra/project-config: Fix Monasca Log API tempest gate config https://review.openstack.org/347813	13:00
zigo	pabelanger: Isn't the git repo available when the job executes?	13:00
pabelanger	zigo: blargs, yes. I missed the gerrit-git-prep macro in deb-build-pkg.yaml. You can ignore that comment	13:01
openstackgerrit	Zara proposed openstack-infra/python-storyboardclient: Add system info https://review.openstack.org/347405	13:01
*** shardy_lunch is now known as shardy		13:01
* pabelanger runs off to get some coffee		13:01
zigo	pabelanger: I should also ignore this comment? https://review.openstack.org/#/c/307742/8/jenkins/jobs/deb-build-pkg.yaml	13:02
zigo	I'm not sure if I understand this either ... :(	13:02
*** oanson has quit IRC		13:04
*** Liuqing has joined #openstack-infra		13:06
*** coolsvap is now known as coolsvap_		13:07
*** kgiusti has joined #openstack-infra		13:07
*** links has quit IRC		13:08
*** mdrabe has joined #openstack-infra		13:11
*** jsavak has joined #openstack-infra		13:12
pabelanger	zigo: so, what if you need to write a patch to openstack-pkg-tools for some reason? If you install it from the package, you'll have to wait for that build to be uploads to our AFS mirrors. If you use the zuul-cloner builder you can use the Depends-On header in your commit messages to pull in the patch you depend on	13:14
zigo	pabelanger: If we need a new version of openstack-pkg-tools, then we will do that through build-depends, to enforce it also at the distro level.	13:15
zigo	pabelanger: So here, unfortunately, we cannot only rely on git commits...	13:15
Srinu	asselin_ asselin: hi	13:15
pabelanger	zigo: okay, if you are fine with that	13:15
zigo	pabelanger: Also, I don't intend to often fix/change the build system once it's online.	13:15
pabelanger	zigo: okay, +2	13:16
zigo	:)	13:16
zigo	pabelanger: Can you also look at https://review.openstack.org/#/c/346095/ ?	13:16
zigo	These are the last 2 patches that are needed to get the fully working build system.	13:17
*** edmondsw has joined #openstack-infra		13:17
zigo	Then we'll only add new repos.	13:17
*** yamamoto has quit IRC		13:17
*** matrohon has joined #openstack-infra		13:18
pabelanger	zigo: I was thinking about this last night, why can't these be added into jessie-backports? I'm guess a policy issue and potentially breaking other packages?	13:18
zigo	pabelanger: What's in jessie-backporst is the last release (ie: Mitaka right now).	13:19
zigo	pabelanger: I don't want to break what the final users are consuming, just to be able to build the current master.	13:19
zigo	As much as possible, jessie-backports should stay untouched after a stable release upload.	13:19
zigo	Hopefully, we'll have bikesheds to play with, and then this will be over.	13:20
pabelanger	zigo: right, so I guess that means we need to create something like jessie-backports-newton right?	13:20
pabelanger	so we don't break things when O release happens	13:20
zigo	(bikeshed == the Debian way to do PPA, which IMO is the "right" (tm) way)	13:20
zigo	pabelanger: That's exactly what I've been doing on my jenkins, yes.	13:20
*** akshai has joined #openstack-infra		13:21
pabelanger	zigo: okay, so we need to update reprepro for that, which is fine. But we'll also need to update the JJB jobs to account for this. Let me get started on patches	13:21
zigo	pabelanger: Though I'm not sure how this translates at the infra level (ie: to distinguish with 2 repos)	13:21
zigo	Thanks so much.	13:21
*** gouthamr has quit IRC		13:22
*** gouthamr has joined #openstack-infra		13:23
*** pgadiya has quit IRC		13:23
*** szaher has joined #openstack-infra		13:23
*** xyang1 has joined #openstack-infra		13:24
*** amitgandhinz has quit IRC		13:25
*** weshay has quit IRC		13:27
*** ccamacho\|hungry is now known as ccamacho		13:28
*** moravec has joined #openstack-infra		13:29
*** acoles_ is now known as acoles		13:30
*** mriedem has joined #openstack-infra		13:31
*** david-lyle_ has joined #openstack-infra		13:31
*** david-lyle_ has quit IRC		13:31
*** amitgandhinz has joined #openstack-infra		13:31
*** roxanaghe has joined #openstack-infra		13:32
*** moravec has quit IRC		13:32
*** david-lyle has quit IRC		13:34
*** eliqiao has quit IRC		13:34
timrc	Broken doc links make me sad :(	13:34
timrc	re: http://docs.openstack.org/user-guide/content/cli_openrc.html the latest sadness. Linked to from rally's readthedocs tutorial.	13:35
*** moravec has joined #openstack-infra		13:35
*** roxanaghe has quit IRC		13:37
*** amitgandhinz has quit IRC		13:37
*** amitgandhinz has joined #openstack-infra		13:37
*** yamamoto has joined #openstack-infra		13:37
*** tphummel has joined #openstack-infra		13:39
EmilienM	Gerrit it slower than usual for me, and I have random 502 errors this morning (location: east canada)	13:40
openstackgerrit	afazekas proposed openstack/os-testr: Simplify logic in _get_test_list https://review.openstack.org/347836	13:40
sc`	ditto as EmilienM - california here	13:40
timrc	I remember the update to the new guide breaking Google search links too, though. In the future, landing pages for retired links that redirect to the new hotness would be better.	13:40
sc`	had just switched to this window to mention the gerrit slowness. EmilienM beat me to it :)	13:41
*** javeriak has joined #openstack-infra		13:41
*** ayoung has joined #openstack-infra		13:41
EmilienM	I have 0% packet loss so it doesn't sound networking this time	13:42
*** nwkarsten has joined #openstack-infra		13:42
*** eliqiao has joined #openstack-infra		13:43
openstackgerrit	Paul Belanger proposed openstack-infra/system-config: Add jessie-newton-backports repo https://review.openstack.org/347839	13:43
pabelanger	zigo: ^	13:43
smcginnis	Is gerrit having issues again, or is it just me?	13:43
*** nwkarste_ has joined #openstack-infra		13:43
*** tphummel has quit IRC		13:43
jroll	slow for me	13:44
smcginnis	jroll: OK good. Just want to make sure I'm not suffering along. ;)	13:44
smcginnis	*alone	13:44
jroll	I feel your pain :)	13:44
smcginnis	hehe	13:44
jroll	oh, 502 now, yay	13:44
smcginnis	Yep, got some of those as well.	13:44
fungi	aspiers: what i meant was making it so that a copy of the manpage ends up in the sdist tarball so that people installing from sdist don't need to manually regenerate the manpage (that was before i realized you weren't trying to pip install gertty but rather trying to repackage it for a different distribution channel)	13:45
jroll	pabelanger: ^ when you have a few minutes	13:45
aspiers	fungi: ahhh ok	13:45
pabelanger	yes, looking for the commands again to confirm memory usage in gerrit	13:45
pabelanger	fungi: mind helping with the URL again?	13:45
wznoinsk	review.o.o down?	13:46
fungi	pabelanger: /monitoring	13:46
*** nwkarsten has quit IRC		13:46
wznoinsk	https://review.openstack.org/#/q/project:openstack/networking-ovs-dpdk	13:46
pabelanger	fungi: thanks	13:46
smcginnis	wznoinsk: Yes, seems to be issues right now.	13:46
wznoinsk	Server Unavailable	13:46
wznoinsk	502 Proxy Error	13:46
*** jsavak has quit IRC		13:46
smcginnis	wznoinsk: Slowness and proxy errors on my end as well.	13:47
fungi	pabelanger: and yeah, the garbage collector time graph does seem to have just spiked up in recent minutes	13:47
EmilienM	wznoinsk, smcginnis: they're working on it, wait a minute, or go for a coffee	13:47
*** jsavak has joined #openstack-infra		13:47
sc`	my first thought was gc. not sure why	13:47
AJaeger	pabelanger: I doubt that we have python2.7 running on xenial	13:47
wznoinsk	EmilienM: nah, coffee in progress already	13:47
smcginnis	EmilienM: Mmmm, coffee.	13:48
pabelanger	fungi: ya, I see that.	13:48
fungi	based on the graph, i think gerrit began spending a lot of time garbage collecting around 13:15 utc	13:48
*** Guest41069 is now known as dansmith		13:48
AJaeger	pabelanger: Sorry, misready - gate-{name}-python27-ubuntu-xenial exists now, so most projects run on xenial now	13:48
pabelanger	AJaeger: Ah, okay. Good	13:48
*** rbrndt has joined #openstack-infra		13:49
pabelanger	fungi: Do we ride out the GC usually? I cannot remember at what stage we restart gerrit	13:49
fungi	wow, zuul did (very briefly) catch up on job load between 03:00-06:00 utc	13:49
pabelanger	load is 7.58 with 379 threads	13:49
fungi	pabelanger: it generally never recovers once it ends up in a gc spiral	13:50
fungi	and we restart gerrit	13:50
pabelanger	fungi: okay, I can restart gerrit is we are ready	13:50
fungi	#status notice Gerrit is being restarted now to relieve performance degradation	13:51
openstackstatus	fungi: sending notice	13:51
fungi	go for it	13:51
*** pfallenop has joined #openstack-infra		13:51
fungi	gate changes all look at least a few minutes out from reporting anyway	13:51
AJaeger	project-config zuul-layout changes fail "No matching distribution found for oslo.config>=3.10.0 " ;(	13:52
-openstackstatus- NOTICE: Gerrit is being restarted now to relieve performance degradation		13:52
pabelanger	okay, stopped and started again	13:52
AJaeger	thanks, pabelanger	13:54
openstackstatus	fungi: finished sending notice	13:54
pabelanger	fungi: you might also be interested in 347839. This adds a jessie-newton-backports repo that zigo requested in 346095 (which you have commented on)	13:54
fungi	there's a gate-glance-pep8-ubuntu-xenial job reporting POST_FAILURE on that glance change at the top of the gate	13:56
fungi	seems it didn't upload any logs	13:56
dhellmann	is there some sort of issue with our pypi cache/mirror? I have a couple of release jobs failing because they can't install lazr.restfulclient -- http://logs.openstack.org/08/347808/1/check/gate-releases-pep8-ubuntu-xenial/977dcc6/console.html#_2016-07-27_13_26_31_264690	13:57
pabelanger	ya, doesn't seem to exist in our mirrors. Let me check our wheel-build jobs	13:59
dhellmann	pabelanger : thanks	13:59
dhellmann	I don't know if there was a new release or something. I don't think we've changed our spec for the dependency	13:59
dhellmann	my local virtualenv has 0.13.1 which is older than the latest on pypi 0.13.3	14:00
AJaeger	pabelanger: see above for my comment as well - oslo.config not found ;(	14:01
AJaeger	http://logs.openstack.org/83/347683/1/gate/gate-project-config-layout/10af4a1/console.html#_2016-07-27_13_03_11_480221	14:01
*** pilgrimstack has joined #openstack-infra		14:02
*** trown is now known as trown\|brb		14:02
*** moravec1 has joined #openstack-infra		14:02
*** azvyagintsev_h has joined #openstack-infra		14:02
*** yamamoto has quit IRC		14:03
*** pilgrimstack1 has quit IRC		14:04
*** yamamoto has joined #openstack-infra		14:04
*** yamamoto has quit IRC		14:04
*** moravec has quit IRC		14:04
*** trown\|brb is now known as trown		14:05
fungi	http://mirror.iad.rax.openstack.org/pypi/simple/lazr.restfulclient/ seems to match https://pypi.python.org/simple/lazr.restfulclient/	14:06
*** weshay has joined #openstack-infra		14:06
*** eliqiao has quit IRC		14:06
*** raildo has joined #openstack-infra		14:06
pabelanger	odd	14:06
pabelanger	I didn't see it	14:06
tlbr	fungi, hi could you please merge https://review.openstack.org/#/c/307742/ ?	14:06
fungi	and i can download lazr.restfulclient-0.13.1.tar.gz from the mirror just fine	14:07
*** Swami has joined #openstack-infra		14:07
*** zhurong has joined #openstack-infra		14:07
fungi	dhellmann: the pypi simple api doesn't seem to have a 0.13.3	14:08
dhellmann	and yet https://pypi.python.org/pypi/lazr.restfulclient	14:08
dhellmann	oh, fun, there's no package there	14:08
fungi	dhellmann: and what files do you see associated with it there? ;)	14:08
* dhellmann swears at canonical		14:08
fungi	it's a fileless release (so possibly deleted from pypi after upload or maybe never uploaded)	14:08
dhellmann	let me try pinning	14:09
pabelanger	fungi: thanks for looking. I missed it first pass	14:09
*** eliqiao has joined #openstack-infra		14:09
*** Swami has quit IRC		14:09
*** chem\|off has quit IRC		14:09
*** chem\|off has joined #openstack-infra		14:10
*** Swami has joined #openstack-infra		14:10
fungi	dhellmann: i suspect they never uploaded any files for that, because i don't see any deletions mentioned in our bandersnatch log going back at least a week	14:10
dhellmann	figures	14:10
fungi	oh, though their changelog says 0.13.3 (2013-03-22)	14:11
AJaeger	pabelanger, can you check oslo.config as well, please? " No matching distribution found for oslo.utils>=3.14.0" in http://logs.openstack.org/13/347813/1/check/gate-project-config-layout/567129b/console.html#_2016-07-27_13_11_43_469655 -	14:11
fungi	dhellmann: did we just recently grow a dependency on uncapped lazr.restfulclient?	14:11
pabelanger	AJaeger: sure, looking	14:11
AJaeger	http://mirror.iad.rax.openstack.org/pypi/simple/oslo.config/ has no oslo.3.14	14:11
AJaeger	and https://pypi.python.org/pypi/oslo.config has 3.13 as latest. Strange ;(	14:12
dhellmann	fungi : it's not a direct dependency, so I'm not sure	14:12
*** javeriak has quit IRC		14:12
AJaeger	Wrong requirement in python-keystoneclient>=0.4.2 ?	14:12
fungi	dhellmann: oh! launchpadlib 1.10.3 requires lazr.restfulclient>=0.9.19	14:12
dhellmann	yeah, I'm working on a pin in https://review.openstack.org/347861	14:13
*** jcoufal has joined #openstack-infra		14:14
pabelanger	AJaeger: ya, I don't know what is happening there. dhellmann is oslo.config 3.14.0 in the release pipeline?	14:14
fungi	dhellmann: strangely the launchpadlib changelog says 1.10.3 (2014-12-05)	14:14
fungi	so also old	14:14
AJaeger	oh, that's olso.utils 3.14, not oslo.config	14:15
pabelanger	Ya, I just see that	14:15
AJaeger	and oslo.config 3.10 as well in different log	14:15
AJaeger	http://logs.openstack.org/83/347683/1/gate/gate-project-config-layout/10af4a1/console.html#_2016-07-27_13_03_11_480221 and http://logs.openstack.org/13/347813/1/check/gate-project-config-layout/567129b/console.html#_2016-07-27_13_11_43_469655	14:15
pabelanger	AJaeger: okay, I'd recheck that job	14:16
pabelanger	AJaeger: oslo.utils 3.16.0 exists	14:16
*** zz_dimtruck is now known as dimtruck		14:16
AJaeger	pabelanger: I did already - the two project-config jobs in the queue both fail - looking at zuul status	14:17
*** tonytan4ever has joined #openstack-infra		14:17
*** rhallisey has left #openstack-infra		14:17
*** rhallisey has joined #openstack-infra		14:18
AJaeger	pabelanger: you approved https://review.openstack.org/#/c/347683/1 - but not everything is setup ;(	14:20
AJaeger	pabelanger: https://github.com/openstack-infra/puppet-germqtt does not exist yet.	14:20
AJaeger	could any infra-root please check github on why the repo above is stuck? ^	14:21
fungi	AJaeger: pabelanger: i see oslo.config-3.13.0.tar.gz and oslo.config-3.13.0-py2.py3-none-any.whl at http://mirror.iad.rax.openstack.org/pypi/simple/oslo.config/	14:21
pabelanger	fungi: ya, I see them too	14:22
*** rdx_matt has quit IRC		14:22
*** rdx_matt has joined #openstack-infra		14:22
phschwartz	fungi: I vote we add another mascott to the voting list. The Gozer dogs from Ghostbusters 1. "There is only ZUUL!"	14:23
AJaeger	fungi, pabelanger http://logs.openstack.org/47/347147/4/check/gate-project-config-layout/9ed8259/console.html#_2016-07-27_14_03_02_605495 run on ubuntu-precise-rax-ord-2953365 - but fails with oslo.config ;(	14:23
fungi	phschwartz: their names were zuul and vinz, but also they are non-natural creatures	14:23
AJaeger	So, I'm puzzled	14:23
phschwartz	fungi: ;)	14:23
pabelanger	AJaeger: fungi: I think we are missing the python2.7 version?	14:23
fungi	phschwartz: (hellhounds, hounds of tindalos, something along those lines)	14:24
*** claudiub\|2 has quit IRC		14:24
pabelanger	AJaeger: fungi: I am not sure honestly.	14:24
fungi	pabelanger: missing where?	14:24
fungi	AJaeger: looks like it was the typical github api brokenness adding write access for gerrit. i've fixed it manually and https://github.com/openstack-infra/puppet-germqtt seems to have synced successfully now	14:24
*** tosky has quit IRC		14:24
*** andymaier has quit IRC		14:25
AJaeger	fungi, thanks.	14:26
pabelanger	fungi: I see some packages using: http://mirror.iad.rax.openstack.org/pypi/packages/3.4/ as the url	14:26
pabelanger	and others http://mirror.iad.rax.openstack.org/pypi/packages/py2.py3/	14:27
*** jsavak has quit IRC		14:27
pabelanger	so, trying to understand which URL oslo.config would use	14:27
fungi	pabelanger: might need to hold an ubuntu-precise node and test (these failures are all on precise, right?)	14:27
*** rdx_matt has quit IRC		14:27
fungi	maybe we've screwed up the pip config on them	14:27
pabelanger	fungi: good idea	14:27
pabelanger	oh right	14:27
pabelanger	we have new configure_mirror.sh in place too	14:27
fungi	did my refactor merge?	14:28
pabelanger	fungi: yes	14:28
fungi	then likely my fault	14:28
pabelanger	okay, let get setup auto-hold	14:28
fungi	we had/have some precise-specific logic in there, though i think that was for ubuntu mirrors not pypi mirrors	14:28
honza	krotscheck: pabelanger: any chance you could vote on this again? https://review.openstack.org/#/c/343834/ (it's only been rebased due to recent renames)	14:28
AJaeger	NOw "No matching distribution found for oslo.i18n>=2.1.0" ;(	14:28
dmsimard	I'm trying to understand the weighting/rate in the nodepool provider configuration, let's pretend I have two providers and only want to use the second provider if the capacity from the first provider is full. Can I do that ?	14:28
pabelanger	AJaeger: okay, we have a theory, it is possible we broke our configure_mirror.sh script	14:29
AJaeger	log is http://logs.openstack.org/83/347683/1/check/gate-project-config-layout/57b1b79/	14:29
fungi	dmsimard: not with the current load scheduling logic, no. it would likely require adding some new options for scheduling in nodepool	14:29
AJaeger	pabelanger: I see, missed those lines while pasting ;)	14:30
krotscheck	honza: Sec, in a meeting	14:30
pabelanger	AJaeger: okay, please recheck one	14:30
pabelanger	AJaeger: nodepool will hold the node	14:30
fungi	dmsimard: right now it attempts to spread the load out proportional to quota in each provider	14:30
dmsimard	fungi: okay, so what's the rate setting for then ?	14:30
dmsimard	oh I know what's it for, nevermind that	14:30
AJaeger	pabelanger: recheck for 346953	14:30
fungi	dmsimard: that's to slow down api calls so that we don't run afoul of rate limits/throttles in some providers	14:30
pabelanger	#status log auto-hold added to nodepool.o.o for gate-project-config-layout while we debug pypi mirror failures	14:31
openstackstatus	pabelanger: finished logging	14:31
openstackgerrit	James Slagle proposed openstack-infra/tripleo-ci: Set undercloud_hostname in multinode jobs https://review.openstack.org/347490	14:31
pabelanger	AJaeger: fungi: if the theory holds, the jobs will pass on ovh-bhs1 and rax-ord, they are old images	14:32
*** tosky has joined #openstack-infra		14:32
fungi	pabelanger: AJaeger: it would be nice if we collected the .tox/log/*.log files from these jobs. would better be able to see what it's actually trying to do where	14:32
pabelanger	Ya, we can quickly land a JJB fix for that	14:32
*** bhavik has quit IRC		14:32
fungi	most of our tox-based jobs already do it	14:32
fungi	(for this reason, among others)	14:33
pabelanger	ya	14:33
pabelanger	let me write the patch	14:33
*** PollyZ has joined #openstack-infra		14:34
*** shashank_hegde has joined #openstack-infra		14:34
dhellmann	fungi : pinning didn't fix it, since 0.13.1 can't be found either? http://logs.openstack.org/61/347861/1/check/gate-releases-pep8-ubuntu-xenial/934a97e/console.html#_2016-07-27_14_28_53_274309 -- it does appear to exist upstream still https://pypi.python.org/pypi/lazr.restfulclient/0.13.1	14:35
* dhellmann can't wait to get rid of launchpad		14:35
fungi	pabelanger: we do have directories for oslo libs appearing under http://mirror.nyj01.internap.openstack.org/pypi/packages/py2.py3/o/ but i they're empty, i think because we get proper wheels of them from the normal pypi mirror already and so don't need to build them in the wheel mirror?	14:38
*** cgalan has joined #openstack-infra		14:39
*** aysyd has quit IRC		14:39
pabelanger	fungi: I'm not sure of the top of my head. I'd have to dig into that	14:39
*** tphummel has joined #openstack-infra		14:39
fungi	dhellmann: looks like we're not collecting tox logs from gate-releases-pep8-ubuntu-xenial either. i thought our pep8 jobs did that, but maybe we missed adding the option to do it even on job failure and not just on success	14:40
pabelanger	fungi: dhellmann: not, test-results is missing	14:41
pabelanger	fungi: dhellmann: I'll add it now	14:41
fungi	indeed	14:41
fungi	just got there myself. thanks!	14:41
*** moravec1 has quit IRC		14:42
fungi	we _do_ specify copy-after-failure: true for source: '.tox//log/' in the test-results publisher macro at least	14:42
*** jsavak has joined #openstack-infra		14:42
pabelanger	ya, that is good	14:42
pabelanger	just waiting for tox to run locally here	14:42
pabelanger	then will push up	14:42
dhellmann	pabelanger, fungi : is that some sort of project-config thing I left out?	14:42
fungi	dhellmann: no, our gate-{name}-pep8-{node} job-template is missing test-results from the publishers list	14:43
fungi	only has console-log	14:43
*** claudiub\|2 has joined #openstack-infra		14:43
*** Liuqing has quit IRC		14:43
*** aysyd has joined #openstack-infra		14:43
dhellmann	ah	14:43
*** tphummel has quit IRC		14:44
*** EricGonczer_ has joined #openstack-infra		14:44
*** Liuqing has joined #openstack-infra		14:44
fungi	coverage and pylint templates are also missing it	14:44
*** moravec has joined #openstack-infra		14:45
fungi	looks like we were really only doing it consistently in unit test jobs	14:45
fungi	pabelanger: docs jobs are also missing test-results	14:45
fungi	and tarballs too	14:46
pabelanger	fungi: yup, adding them for all python-jobs that need it	14:46
fungi	thanks!	14:47
AJaeger	thanks, pabelanger !	14:47
openstackgerrit	Paul Belanger proposed openstack-infra/project-config: Add test-results publisher to infra projects https://review.openstack.org/347878	14:48
openstackgerrit	Paul Belanger proposed openstack-infra/project-config: Add test-requires publisher to python-jobs https://review.openstack.org/347879	14:48
*** yamahata has joined #openstack-infra		14:49
pabelanger	AJaeger: fungi: ^	14:49
*** chem\|off is now known as chem		14:49
openstackgerrit	Paul Belanger proposed openstack-infra/project-config: Add test-results publisher to python-jobs https://review.openstack.org/347879	14:49
openstackgerrit	Merged openstack-infra/tripleo-ci: Update the link to the current-tripleo repository https://review.openstack.org/347796	14:50
AJaeger	pabelanger: thanks!	14:51
*** bhavik has joined #openstack-infra		14:52
*** oanson has joined #openstack-infra		14:53
thiagop	Folks, QQ: my nodepool is building vm's only for one label. What could be happening?	14:53
*** Ravikiran_K has quit IRC		14:53
pabelanger	AJaeger: maybe fungi can enqueue them right into the gate queue to help our debugging efforts	14:53
*** ddieterly has joined #openstack-infra		14:54
AJaeger	pabelanger, fungi: I doubt they will pass the layout check and need manual push to merge from an admin	14:54
pabelanger	AJaeger: oh, that is true	14:54
*** Teresita-Warrior has joined #openstack-infra		14:54
*** abregman has quit IRC		14:55
pabelanger	AJaeger: fungi: dhellmann: http://paste.openstack.org/show/542609/ is the pip.conf from a failed job	14:55
fungi	pabelanger: was that node in rax-ord?	14:55
pabelanger	fungi: yes	14:56
fungi	worth noting, http://mirror.ord.rax.openstack.org/wheel/ubuntu-12.04-x86_64 dne	14:56
pabelanger	so that is an old image	14:56
pabelanger	let me check the other node in internap	14:56
fungi	but as that's an extra-index-utl it shouldn't need to exist as long as the necessary wheels/sdists can be found in indices at http://mirror.ord.rax.openstack.org/pypi/simple	14:57
pabelanger	http://paste.openstack.org/show/542610/ from internap	14:57
fungi	er, an extra-index-url	14:57
*** mdrabe has quit IRC		14:57
mtreinish	fungi, yolanda, rcarrillocruz: if you get a sec can you add me to the core groups on germqtt, puppet-germqtt, and puppet-mosquitto we neglected to add anything when we created those yesterday	14:57
pabelanger	fungi: oh, right, because we don't have a precise wheel-build worker	14:58
mtreinish	although it looks like the puppet ones had the infra groups added already. germqtt doesn't have anything set though	14:58
*** zhurong has quit IRC		14:58
fungi	mtreinish: yeah, i ran our group magagement script between when those merged	14:58
fungi	i'll rerun it and then add you to the core group on germqtt	14:59
*** coolsvap_ is now known as coolsvap		14:59
*** zhurong has joined #openstack-infra		14:59
*** esberglu has joined #openstack-infra		14:59
fungi	mtreinish: we can have some further discussion on core groups for puppet-germqtt and puppet-mosquitto, generally we only have our infra-puppet-core approving changes to puppet modules, for better consistency across modules	15:00
*** jistr is now known as jistr\|call		15:00
jroll	fungi: got a sec? allah is doing in -ironic	15:01
pabelanger	fungi: AJaeger: since we only have 2 jobs running on precise, is it worth it to consider removing pip.conf all together from precise?	15:01
jroll	fungi: relatedly, curious how I might get ops in that channel, if PTLs are allowed to do so :)	15:02
mtreinish	fungi: I have +2 on the other puppet modules I wrote like puppet-subunit2sql and puppet-openstack_health (I didn't write that one, just made it work)	15:02
*** caowei has joined #openstack-infra		15:03
*** zhurong has quit IRC		15:03
*** shashank_hegde has quit IRC		15:03
clarkb	pabelanger: all the projects shouod be doing python27 unittests on xenial now.	15:03
yolanda	fungi, mtreinish , i manually added infra-core and infra-puppet-core today, i was reviewing and i found mysel with +1 powers only	15:03
yolanda	are those projects different?	15:03
*** shashank_hegde has joined #openstack-infra		15:04
clarkb	jroll was mostly noticing things like jobs for multiple ramdisks but we really shpuldnt care right? if we have one rdisk that works thats sufficient?	15:04
pabelanger	clarkb: great, thanks	15:04
rcarrillocruz	mtreinish: sure	15:04
rcarrillocruz	give me a sec	15:04
pabelanger	fungi: AJaeger: re-running tox with extra-index-url removed now	15:05
*** yamamoto has joined #openstack-infra		15:05
*** Liuqing has quit IRC		15:05
fungi	yolanda: they're not different, the governance change for them simply hasn't merged yet	15:05
jroll	clarkb: we publish a couple different ramdisk builds as artifacts, because people get religious about their OS choices. and we've had successful builds that didn't work in practice due to kernel modules or missing binaries or whatever, so we test them	15:05
*** nmagnezi has quit IRC		15:05
*** mdrabe has joined #openstack-infra		15:05
*** zhurong has joined #openstack-infra		15:06
clarkb	jroll: but you dont have to is ejat I am saying. publish one that works and test with it	15:06
fungi	mtreinish: seems like sufficient precedent to me ;)	15:06
*** shashank_hegde has quit IRC		15:06
jroll	clarkb: I mean, we ship code to build these things, I think that code should be tested no?	15:06
*** javeriak has joined #openstack-infra		15:07
rcarrillocruz	mtreinish: done	15:07
clarkb	jroll then delete the extra unneeded stuff?	15:07
clarkb	jroll you really only need one ram disk if I understand how this works correctly	15:07
jroll	clarkb: it's not unneeded, people use these	15:07
mtreinish	fungi, rcarrillocruz: thanks	15:07
clarkb	jroll: I get that, what U am saying is you (being ironic) need only support one functional tested ramdisk	15:08
jroll	clarkb: some prefer coreos, some prefer ubuntu/fedora via DIB, some prefer tinyipa because it's fast	15:08
clarkb	er s/U/I/ yay phone typing	15:08
jroll	clarkb: right, we only strictly need one, the community prefers more	15:08
clarkb	the problem here is ramdisk is not user facing nor api impacting	15:09
*** psachin has quit IRC		15:09
JayF	It /is/ operator facing	15:09
clarkb	so we are testing all the things for no benefit to understanding if ironic functions	15:09
*** apetrich has quit IRC		15:09
jroll	clarkb: we only test multiple ramdisks against IPA (where the builder code is), not against ironic, fwiw	15:09
jroll	clarkb: ironic CI only tests one ramdisk	15:09
clarkb	jroll we made 83 jobs	15:09
openstackgerrit	Matthew Treinish proposed openstack-infra/system-config: Add firehose.o.o config to system-config https://review.openstack.org/347575	15:10
*** abregman has joined #openstack-infra		15:10
clarkb	part of that is the matrix multiplication with all the inputs, ramdisk is one input	15:10
fungi	clarkb: jroll: sounds like preference would be tinyipa but there are religious wars over distro deployers not wanting to "support" someone else's distro which you don't want to step into the middle of?	15:10
JayF	fungi: actually no	15:10
mtreinish	pabelanger: ^^^ that includes the rename, let me know what you want to do about xenial	15:10
JayF	fungi: TinyIPA is great for CI, not great for production	15:10
fungi	aha	15:10
JayF	fungi: one reason being we can't download TinyIPA artifacts over https, no gpg verification, etc	15:10
*** hashar_ has joined #openstack-infra		15:10
*** rbuzatu has quit IRC		15:10
clarkb	jroll jayf so I am going why does ironic meed 83 jobs?	15:11
clarkb	thats more than any other project I think	15:11
JayF	fungi: we're basically going to end up with 3 ramdisks: DIB, CoreOS (which is likely going to be deprecated soonish), and TinyIPA	15:11
pabelanger	fungi: AJaeger: So, we just landed a change to bandersnatch this morning: https://review.openstack.org/#/c/321339/ I'm starting to wonder if this is the reason for our failure	15:11
JayF	clarkb: Ironic does not run 83 jobs on every change though?	15:11
fungi	JayF: the tinyipa community is opposed to tls and signing builds? or just needs someone to help them?	15:11
clarkb	and the first thing that pops up is we have unnecessary mulyiplication for rdisks	15:11
jroll	clarkb: I agree we have too many jobs, I agree we need to reduce them, I have some thoughts on that but I think we need to test all of the ramdisks	15:11
*** yamamoto has quit IRC		15:11
clarkb	JayF: nope but you create 83 tempest jobs in jjb	15:11
jroll	the ipmitool vs ssh power driver multiplication is much of the explosion to me	15:12
*** abregman has quit IRC		15:12
fungi	JayF: also, in theory, https is irrelevant if they sign the builds with a key we trust	15:12
jroll	and is a transitional thing, we hope	15:12
*** hashar has quit IRC		15:12
*** abregman has joined #openstack-infra		15:12
fungi	JayF: or even just sign a list of strong checksums of their builds for that matter	15:12
JayF	fungi: Sambetts is the guy to ask; AIUI they inquired with TinyCoreLinux and it was denied because of mirror cpu usage or something of the like	15:12
JayF	fungi: but there's an open bug for it, let me find it for you	15:12
clarkb	jroll I am sure there are other bits we can simplify too, I just fail to understamd why ironic cares in its testing if there is >1 option for the ramdisk	15:13
clarkb	its not user/api facing and they all do the same thing	15:13
clarkb	seems like wasted effort	15:13
fungi	JayF: serving precomputer signatures from builds shouldn't impact mirror performance at all, but https _could_ (if extremely high volume or extremely tiny servers i guess)	15:13
*** hashar_ is now known as hashar		15:13
fungi	s/precomputer/precomputed/	15:13
jroll	clarkb: it's code we ship, we believe it should be tested	15:13
*** nwkarste_ has quit IRC		15:13
JayF	fungi: https://bugs.launchpad.net/ironic-python-agent/+bug/1581112 and lesser so https://bugs.launchpad.net/ironic-python-agent/+bug/1589609	15:13
openstack	Launchpad bug 1581112 in ironic-python-agent "TinyIPA build is subject to MITM due to lack of HTTPS for mirrors" [High,Triaged]	15:13
openstack	Launchpad bug 1589609 in ironic-python-agent "Building TinyIPA depends on repo.tinycorelinux.net being up" [Medium,In progress] - Assigned to Mathieu Mitchell (mat128)	15:13
clarkb	jroll then stop shipping it :)	15:13
JayF	fungi: that first bug has a link to the chat in the forums about it	15:14
clarkb	jroll ship one that works	15:14
*** mtanino has joined #openstack-infra		15:14
clarkb	drop the others	15:14
fungi	JayF: cool, thanks! will read	15:14
JayF	And pick which third of our community to screw by dropping their code?	15:14
*** nwkarsten has joined #openstack-infra		15:14
JayF	TinyIPA is not production quality, some folks use CoreOS, some folks use DIB	15:14
JayF	and there are good technical reasons in many cases for going a different path	15:14
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-germqtt: Clean up stray whitespace https://review.openstack.org/347892	15:14
jroll	(but tinyipa is needed to make CI jobs run in a reasonable timeframe)	15:14
JayF	TinyIPA would not exist if the gate had unlimited ram. It exists almost solely for CI.	15:14
clarkb	jayf one image cant meet the needs of a reasonable user?	15:14
jroll	clarkb: you assume users are reasonable :)	15:15
*** solumuser__ has joined #openstack-infra		15:15
fungi	JayF: there are also good technical reasons to condense your supported options (see endless threads on dropping postgres support over the years, for example)	15:15
jroll	clarkb: for example, people added DIB support because red hat requires their product all run on rhel-based distros	15:15
AJaeger	pabelanger: Sorry, can't help further with debugging the issue.	15:15
fungi	jroll: that's what i meant by "religious wars over distro deployers not wanting to 'support' someone else's distro"	15:16
clarkb	ya I dont care about that	15:16
jroll	clarkb: I do want to reduce the number of jobs we run. I've been thinking about it a lot. I don't want to drop support for our ramdisks.	15:16
fungi	it's petty	15:16
jroll	fungi: indeed	15:16
JayF	fungi: oh absolutely; but in this case today we have a good reason for both we support. TinyIPA is smaller, and allows gates to run faster (and is used exclusively for CI aganist Ironic), CoreOS is a more production-quality ramdisk. Once we support DIB ramdisks properly (with testing), I anticipate within 12 months we'll deprecate the CoreOS ramdisk.	15:16
clarkb	I think ironic should have the ability to build a functioning image that is tested and works for reasonable humans	15:16
*** rbuzatu has joined #openstack-infra		15:16
JayF	fungi: and all that work is ongoing	15:16
fungi	and counterproductive bickering between distros that they need to all just get over and suck it up	15:16
clarkb	I dont think it needs to have mulyiple options	15:16
tlbr	AJaeger, hi, may be you have time to merge https://review.openstack.org/#/c/307742/ , please?	15:16
*** pcaruana has quit IRC		15:17
AJaeger	tlbr: what is the change about?	15:17
jroll	clarkb: so, I do somewhat agree, I'd like to get there - that said, a reasonable ramdisk that works in production for reasonable people slows down the gate by a ton, and makes running grenade or expanding our tempest coverage impossible (which is why we have tinyipa)	15:17
clarkb	if this were user facing then it would be different	15:17
tlbr	AJaeger, adding job with simple package, to finally test its build	15:17
*** caowei has quit IRC		15:18
clarkb	but this is basically just a "function" in ironic you are executing remotely	15:18
JayF	clarkb: As Ironic is an admin API, Operators are the users of Ironic	15:18
clarkb	jayf but the ramdisk doesnt chamge their api right?	15:18
fungi	JayF: how odten do operators log into the ramdisk boot?	15:18
JayF	clarkb: I disagree vehemently with the idea that an IPA ramdisk isn't something an operator should care about. Hell, I have a talk proposed for the summit about how to leverage it to do more stuff	15:18
JayF	fungi: as an operator, I do a hell of a lot	15:18
fungi	s/odten/often/	15:18
AJaeger	tlbr: I read it "Adding new project" - and that's not done as documented...	15:18
*** nwkarsten has quit IRC		15:18
tlbr	AJaeger, ah, sorry, just updated the page	15:19
tlbr	AJaeger, could you please help with, what should we adjust ?	15:20
JayF	This is basically a technical decision of the Ironic/Bare Metal project. Ironic python agent is the only place we test the additional ramdisks, and that has an incredibly low churn compared to other projects. I'm not sure this conversation is productive :/	15:20
*** akscram has quit IRC		15:20
clarkb	jayf thats fair, but neither is having 83 jobs	15:20
tlbr	AJaeger, you mean add it to reference/projects.yaml ?	15:20
*** roxanaghe has joined #openstack-infra		15:20
JayF	clarkb: Is the objection actually number of jobs, or gate resources used?	15:20
clarkb	because you cant reasonably understand and debug and care for 83 massive integration tests	15:20
*** rbuzatu has quit IRC		15:21
clarkb	its the scale of it resulting in no one understanding what is going on making it very hard for infra to eg run your tests on xenial instead of truaty	15:21
clarkb	I am not worried about gate resources	15:21
AJaeger	tlbr: yes, add it to that file in governance repo and link the changes - it's all documented in the link I gave.	15:22
jroll	clarkb: honestly, most of these jobs are basically deployment/config scenarios and overall not much different. which is why I agree it's too many, and I'd like to find a way to reduce it	15:22
tlbr	AJaeger, ok, thanks, will do	15:22
fungi	pabelanger: any chance you can dig into the apache access/error logs on a mirror host and identify which current 404 pattern(s) were previously being solved by one of those rewrites? then we can try a simplified version of the revert while we determine what's still not fully solved bandersnatch-side	15:22
*** armax has joined #openstack-infra		15:22
clarkb	jayf I am going to double that count to 166	15:22
clarkb	juggling that change is not easy	15:22
*** javeriak has quit IRC		15:22
JayF	to be clear though; if we reduced down to 1 ramdisk supported, it's only remove 4 jobs total.	15:22
JayF	I think your concern about # of jobs is legitimate, but the prescription is off :)	15:23
clarkb	jayf on the zuul side yes I think it reduces the coutn abit in jjb	15:23
pabelanger	fungi: that's what I am looking at now: http://paste.openstack.org/show/542613/	15:23
fungi	pabelanger: perfect	15:23
clarkb	we arent using 83 jobs in zuul but we make 83 jobs in jjb	15:23
pabelanger	fungi: if I am understanding the revert in system-config, we don't replace - with . any more	15:23
pabelanger	https://review.openstack.org/#/c/321339/	15:23
JayF	clarkb: I'm not sure I grok the difference, honestly	15:23
clarkb	jayf all zuul does is say run job with name foo	15:24
clarkb	jayf then in jjb we make foo foo1..foo83	15:24
*** rcernin has quit IRC		15:24
pabelanger	which causes http://mirror.dfw.rax.openstack.org/pypi/simple/oslo-config/ to fail	15:24
fungi	pabelanger: okay, so pip is trying to get oslo-config and bandersnatch is still creating oslo.config on disk?	15:24
clarkb	jayf one side is configurations for jobs that can be run amd the other is triggers to run those jobs	15:25
*** roxanaghe has quit IRC		15:25
JayF	clarkb: is it possible (I suspect it is) that we're defining jobs in JJB that Zuul never triggers?	15:25
fungi	pabelanger: are we maybe not running new enough bandersnatch to have that fix implemented? or do we need to do a full bandersnatch mirror rebuild?	15:25
* JayF has an 8:30am meeting as a 5 minute warning to this chat		15:25
clarkb	jayf we should not be configuring more jobs than we need to trigger but I am prefty sure we are doing that here	15:25
fungi	pabelanger: oh! wait. this isn't bandersnatch, no	15:25
clarkb	yes I think that us happening	15:25
clarkb	and part of that is the cross mulyiplication with all the parameters involved	15:26
fungi	pabelanger: that workaround was also dealing with the fact that our wheel mirror builder is also not pep-503 conformant	15:26
pabelanger	fungi: okay, that must be it	15:26
*** rbuzatu has joined #openstack-infra		15:27
clarkb	jayf then on top of that its possible we can be smarter about what jobs are triggered	15:27
pabelanger	fungi: should we revert and discuss this again with ianw	15:27
fungi	pabelanger: hrm, no though that get request 404 you pasted wasn't to the wheel mirror, it weas to the bandersnatch simple index	15:27
fungi	pabelanger: yes, let's revert that revert for now	15:27
fungi	i'll skip it past the gate to save some time	15:28
JayF	clarkb: like if we had, for instance, a deploy of a partition image and a deploy of a whole disk image in one job, we could reduce one of those pivots	15:28
openstackgerrit	Paul Belanger proposed openstack-infra/system-config: Revert "Revert "Work around bandersnatch not supporting pep503"" https://review.openstack.org/347902	15:28
pabelanger	fungi: ^	15:28
clarkb	jroll another thing that popped out was ssh vs pxe vs ipmi, and wondering if we need all the jobs for those options at all times or if maybe typical testing uses one for exercising apis and integration with other projects and then you have a functional test to cover all the backend hardware stuff	15:28
JayF	clarkb: ssh is being deprecated this cycle	15:28
*** solumuser__ has quit IRC		15:28
JayF	clarkb: ipmitool is the replacement	15:28
jroll	yeah, that's a transition	15:28
JayF	clarkb: so that's just a transition in progress	15:29
jroll	we've delayed it with reliability concerns but it's being worked on	15:29
*** andreas_s has quit IRC		15:29
openstackgerrit	Merged openstack-infra/system-config: Revert "Revert "Work around bandersnatch not supporting pep503"" https://review.openstack.org/347902	15:29
fungi	pabelanger: ^	15:29
*** Goneri has quit IRC		15:30
*** psilvad has quit IRC		15:30
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement basic undercloud sanity checks https://review.openstack.org/346551	15:30
*** vincentll has quit IRC		15:30
JayF	jroll: wondering if we could just nuke the _ssh job now, feel the reliability pain of the ipmitool job, and fix it :/	15:30
pabelanger	fungi: hehe	15:30
*** bhunter71 has joined #openstack-infra		15:30
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement a new job for undercloud testing only https://review.openstack.org/346147	15:31
clarkb	jayf at this point in cycle probably better not to	15:31
clarkb	but maybe we can run ipmi in more places as default and push it that way?	15:31
JayF	jroll: aren't we supposed to have ssh drivers out of tree by end of cycle?	15:31
jroll	yes	15:31
jroll	I think it's worth investing a bit of time and see if we can improve it over the next few weeks, before we cut it all over	15:32
jroll	or make one voting now	15:32
JayF	My concern is that I don't think anyone is working on it at all.	15:32
jroll	having all of them voting is going to add up	15:32
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement a new job for undercloud testing only https://review.openstack.org/346147	15:32
jroll	well, let's get people on it :)	15:32
timrc	Oh blah the vote for presentations software really needs static/permalink capability.	15:32
*** dizquierdo has quit IRC		15:32
JayF	timrc: aiui it was an explicit omission to prevent people promoting their own talks	15:32
timrc	Seems like a pretty big omission.. so by design?	15:32
timrc	JayF: Ah :P	15:32
timrc	I guess I don't see why promoting specific presentations -- yours or others -- is a bad thing? shrug	15:33
JayF	timrc: imagine large company X, CEO sends out email saying "vote for our presentations!"	15:34
*** aysyd has quit IRC		15:34
*** aysyd has joined #openstack-infra		15:35
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton https://review.openstack.org/346995	15:35
openstackgerrit	Paul Belanger proposed openstack-infra/project-config: Run gate-infra-puppet-apply-ubuntu-trusty on master https://review.openstack.org/347906	15:35
pabelanger	clarkb: AJaeger: ^ adds ubuntu-trusty back to system-config	15:35
AJaeger	fungi: could you review https://review.openstack.org/347663 for project-config later - it helps with checking the constraints wit hthe post release job. First jobs look fine but are all from master.	15:35
*** jistr\|call is now known as jistr		15:35
clarkb	jayf jroll and so the background on where I am coming from is clear, I am trying to do the split trusty for stable xenial for master/newton testing setup amd that involves a job config for tristy and a job config for xenial. Effectively doubling the existing job configs. Its easier to handle that when we already have a more precise jjb to zuul lineup that doesnt result in even more unused jobs. Let	15:35
clarkb	me try and do the "diff" between jjb and zuul amd see if I canreduce the jjb side down to minimal. Are you aware of any jobs in jjb that zuul is not running that it should run or can I trim all of the extra?	15:35
AJaeger	pabelanger: Thanks!	15:36
clarkb	pabelanger: should it be branch ^.*$ ?	15:37
JayF	clarkb: I'm not aware of any that should be kept, but if you'll put me on the review and ping me in here I'll give it a look	15:37
*** cmspence has joined #openstack-infra		15:37
clarkb	I guess we only use master so master is fine	15:37
*** cmspence has left #openstack-infra		15:37
*** tqtran has joined #openstack-infra		15:38
pabelanger	mtreinish: regarding 347575, can we use ubuntu-trusty over xenial?	15:38
*** PollyZ has quit IRC		15:38
pabelanger	mtreinish: we don't have any xenial control plane servers yet, and not sure how our puppet manifests will work currently	15:38
*** ifarkas is now known as ifarkas_away		15:39
*** oanson has quit IRC		15:39
*** rbuzatu has quit IRC		15:39
clarkb	pabelanger: at least the template bits work to build test images so hopefully not too crazy on new things (but until precise is gone trusty is probably sanest)	15:39
*** rdx_matt has joined #openstack-infra		15:40
pabelanger	mtreinish: actually, reading your comments now	15:40
*** tphummel has joined #openstack-infra		15:40
*** rdx_matt has quit IRC		15:40
zigo	AJaeger: If I understand you well, I should remove modification to projects.yaml in https://review.openstack.org/346095 ?	15:40
*** rdx_matt has joined #openstack-infra		15:40
mtreinish	clarkb, pabelanger: yeah, the problem is the packaged version of mosquitto in trusty is really old	15:41
mtreinish	and it's missing the websocket support which is one of the things we need	15:41
pabelanger	clarkb: ya, I mean, we can roll the dice and bring up the server. Looks like minimal puppet changes.	15:41
timrc	JayF: they do that anyway... they just give you abstract titles to search. So maybe you don't get as many votes, but it doesn't prevent companies from getting employees to vote. Oh well :)	15:41
mtreinish	I can pull it in from a ppa on trusty, but the version on xenial is new enough	15:41
clarkb	I am impressed that mqtt has changed that much in ~2 ywars	15:42
pabelanger	mtreinish: moving to xenial just means there might be issue with our puppet modules, which we many need to work through first.	15:42
*** zhurong has quit IRC		15:42
*** agentleweb has joined #openstack-infra		15:42
*** xarses has quit IRC		15:42
openstackgerrit	Thomas Goirand proposed openstack-infra/project-config: Add automatic backports https://review.openstack.org/346095	15:42
mtreinish	clarkb: the version in trusty was >4 years old	15:42
zigo	I hope that's what was needed.	15:43
fungi	timrc: it was mostly because the twitterspam leading up to talk selection was giving our community a negative public reputation. people have grown weary of all the politicking on social media and we don't want them associating openstack with that sort of noise	15:43
mtreinish	clarkb: I don't think mqtt has changed much at all, but mosquitto is still actively developed	15:43
*** mikelk has quit IRC		15:43
clarkb	mtreinish: is that protocol vs server?	15:43
fungi	timrc: if we got rid of voting completely (which was the original proposal) we could likely turn direct linking back on again	15:43
mtreinish	clarkb: yeah	15:43
*** david-lyle has joined #openstack-infra		15:43
mtreinish	pabelanger: sure, I wasn't expecting anything to work on the first try anyway :)	15:43
clarkb	gotcha	15:43
AJaeger	zigo, see my comment to tlbr above	15:43
timrc	fungi: Ah. Okay	15:44
agentleweb	hiya, did we get any next steps after the wiki use case collection? http://lists.openstack.org/pipermail/openstack/2016-May/016154.html are all wiki logins disabled?	15:44
agentleweb	inquiring minds and all that (it's annegentle, not fast enough for nickserv today)	15:44
*** tphummel has quit IRC		15:45
*** adrian_otto has joined #openstack-infra		15:46
*** rbuzatu has joined #openstack-infra		15:46
pabelanger	fungi: timrc: agreed, removing the direct linking to a speakers talk and forcing people to navigate the openstack.org site to vote is painful (along with not user friendly). People are likely to get frustrated and no longer vote.	15:46
*** hongbin has joined #openstack-infra		15:47
timrc	Maybe that's the intent... shape the data... "Look no one is evening voting anyway, might as well get rid of it" :)	15:47
timrc	even*	15:47
pabelanger	yup, I think that's what will happen	15:47
pabelanger	which, I am fine with	15:48
timrc	If only we had some sort of committee in OpenStack that represented the industry at large that could decide on what presentations would deliver the most value to attendees and the project as a whole...	15:48
*** adrian_otto has quit IRC		15:49
dhellmann	fungi , pabelanger : based on the scrollback it looks like the issue with installing those libs was related to rewrite rules on the mirror?	15:49
*** jlanoux has quit IRC		15:50
pabelanger	dhellmann: We think so, an apache vhost change landed about 6 hours ago. So we've reverted that for now to see if that address the problems	15:50
pabelanger	should be applied here in the next 15mins	15:50
dhellmann	pabelanger : I'm seeing passing jobs where I had failures before	15:50
dhellmann	http://logs.openstack.org/91/347891/2/check/gate-releases-pep8-ubuntu-xenial/4f540af/	15:50
*** rbuzatu has quit IRC		15:50
dhellmann	maybe those jobs are running in the future? :-)	15:50
pabelanger	dhellmann: Ya, looks like the revert already applied	15:51
pabelanger	so, that is good it fixed things	15:51
dhellmann	cool, thank you	15:51
pabelanger	AJaeger: did you want to recheck project-config again?	15:51
* dhellmann heads off to recheck some changes		15:51
*** PollyZ has joined #openstack-infra		15:52
*** rbuzatu has joined #openstack-infra		15:52
clarkb	timrc track chairs never used votes as the sole input at least I dont think any of them did	15:53
openstackgerrit	Thomas Goirand proposed openstack-infra/project-config: Add job to build generic debian packages https://review.openstack.org/307742	15:53
*** rbuzatu has quit IRC		15:53
dulek	Hi, can I get some review attention for https://review.openstack.org/#/c/327619/ ? It's hanging with single +2 for some time.	15:53
*** nwkarsten has joined #openstack-infra		15:54
openstackgerrit	Derek Higgins proposed openstack-infra/tripleo-ci: Stop running dstat twice https://review.openstack.org/347917	15:56
openstackgerrit	Derek Higgins proposed openstack-infra/tripleo-ci: Remove support for legacy rh1 https://review.openstack.org/347918	15:56
*** matrohon has quit IRC		15:56
*** cgalan has quit IRC		15:57
*** adrian_otto has joined #openstack-infra		15:57
*** rbuzatu has joined #openstack-infra		15:57
AJaeger	pabelanger: let me go for it...	15:58
openstackgerrit	Merged openstack-infra/tripleo-ci: Use scp to copy deploy.env to subnodes https://review.openstack.org/346998	15:58
*** abregman has quit IRC		15:58
agentleweb	fungi: are wiki logins still disabled? Do you mind answering https://ask.openstack.org/en/question/92666/unable-to-login-to-wikiopenstackorg-with-my-openstack-id/ -- I would but I don't have a login there righ tnow	15:58
fungi	anteaya: we reenabled them a week or so ago	15:59
AJaeger	pabelanger: http://logs.openstack.org/06/347906/1/check/gate-project-config-layout/51476d1/ just passed	15:59
openstackgerrit	yolanda.robla proposed openstack-infra/shade: Forklift in YamlJsonSerializer https://review.openstack.org/343615	15:59
pabelanger	AJaeger: great	15:59
openstackgerrit	Derek Higgins proposed openstack-infra/tripleo-ci: Remove support for legacy rh1 https://review.openstack.org/347918	15:59
fungi	anteaya: we've disabled file uploads entirely which cut down on a lot of the spam volume, and i'm manually finding, blocking and cleaning up any other spammers now instead	15:59
*** rossella_s has quit IRC		15:59
fungi	er, agentleweb ^	15:59
fungi	(sorry anteaya!)	16:00
*** psilvad has joined #openstack-infra		16:00
fungi	i'm used to tab-completing annegentle as a nick not agentleweb	16:00
*** rossella_s has joined #openstack-infra		16:00
timrc	clarkb: Right. I'm fine with just removing community voting and re-establishing direct links so people can advertise their talks and solicit feedback from @POTUS and all their other Twitter followers.	16:00
agentleweb	fungi: hee sorry	16:00
agentleweb	fungi: thanks	16:00
* AJaeger leaver for dinner and waves good-bye		16:01
*** weshay is now known as weshay_food		16:01
*** thorst is now known as thorst_afk		16:01
*** e0ne has joined #openstack-infra		16:01
*** trown is now known as trown\|lunch		16:02
fungi	agentleweb: i'll take a poke at that question	16:02
*** apetrich has joined #openstack-infra		16:02
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement basic undercloud sanity checks https://review.openstack.org/346551	16:03
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement a new job for undercloud testing only https://review.openstack.org/346147	16:03
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement basic undercloud sanity checks https://review.openstack.org/346551	16:03
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement a new job for undercloud testing only https://review.openstack.org/346147	16:03
*** claudiub\|2 has quit IRC		16:04
*** armax has quit IRC		16:04
*** jsavak has quit IRC		16:04
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-mosquitto: Remove unused config.pp manifest https://review.openstack.org/347922	16:05
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-mosquitto: Add basic permissions and security https://review.openstack.org/347923	16:05
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-mosquitto: Add websocket listner to mosquitto https://review.openstack.org/347924	16:05
openstackgerrit	Andrey Nikitin proposed openstack-infra/puppet-zuul: Order of the classes parameters is refactored https://review.openstack.org/295385	16:05
mtreinish	fungi: ^^^ I still need to test those, but that's the starting point for making it a bit more sane of a deployment	16:05
*** jsavak has joined #openstack-infra		16:05
*** rbuzatu has quit IRC		16:05
*** mmandel has joined #openstack-infra		16:06
mtreinish	with websockets enabled, and without global anon. write access	16:06
*** acruz has quit IRC		16:06
openstackgerrit	Andrey Nikitin proposed openstack-infra/puppet-zuul: Order of the classes parameters is refactored https://review.openstack.org/295385	16:06
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement a new job for undercloud testing only https://review.openstack.org/346147	16:07
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton https://review.openstack.org/346995	16:07
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Add facter output to host_info.txt https://review.openstack.org/347460	16:07
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement basic undercloud sanity checks https://review.openstack.org/346551	16:07
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Set undercloud_hostname in multinode jobs https://review.openstack.org/347490	16:07
*** csomerville has joined #openstack-infra		16:07
pabelanger	fungi: clarkb: mind helping land https://review.openstack.org/#/c/347058/ for our debian afs mirror	16:07
fungi	agentleweb: thanks for the heads up. i've answered https://ask.openstack.org/question/92666 now	16:08
openstackgerrit	Merged openstack-infra/project-config: Run gate-infra-puppet-apply-ubuntu-trusty on master https://review.openstack.org/347906	16:08
zaro	morning	16:08
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: Implement a new job for undercloud testing only https://review.openstack.org/346147	16:10
*** cody-somerville has quit IRC		16:10
dmsimard	hah, no direct links to the summit presentation submissions anymore ?	16:10
Zara	hi, zaro	16:11
dmsimard	nevermind, just saw the discussion in scrollback	16:11
openstackgerrit	Andrey Nikitin proposed openstack-infra/puppet-openstackci: Order of the classes parameters is refactored https://review.openstack.org/295309	16:11
odyssey4me	clarkb it looks like the tightening of the regex for the openstack-ansible docs job wasn't good enough... I'm still seeing both trusty and xenial docs jobs running	16:11
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton https://review.openstack.org/346995	16:11
*** rwsu has quit IRC		16:11
odyssey4me	clarkb examples: gate-openstack-ansible-plugins-docs-ubuntu-trusty / gate-openstack-ansible-lxc_container_create-docs-ubuntu-trusty / gate-openstack-ansible-os_nova-docs-ubuntu-trusty	16:12
clarkb	odyssey4me: ok will have to look later if no one else can figure it out first.I am packing up familu for trip to visit doctor such fun	16:12
*** esikachev has quit IRC		16:12
*** armax has joined #openstack-infra		16:13
odyssey4me	clarkb ah, it looks like the .* needs be to moved to before the negative lookahead? https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L2872	16:13
jogo	random pbr question: Can I use it (for versioning etc) without making it a deploy time dependency?	16:13
*** rbuzatu has joined #openstack-infra		16:13
*** rdx_matt has quit IRC		16:14
clarkb	jogo what is deploy time? you mean install dep?	16:14
clarkb	odyssey4me: you should be able to test the regex in a python inyerpeter locally using re.match	16:14
clarkb	which I thought I did but maybe I was 3.5ing again without noticing or something	16:14
fungi	jogo: you'll want to speak in terms of setup_requires vs install_requires	16:14
jogo	clarkb: ahh yes, can I keep it as a setup_requires only dependency?	16:15
*** rbuzatu_ has joined #openstack-infra		16:15
fungi	jogo: basically yes, if you copy the version function it provides into your own package	16:16
*** EricGonczer_ has quit IRC		16:17
*** roxanaghe has joined #openstack-infra		16:17
fungi	jogo: basically include whatever relevant portions of http://git.openstack.org/cgit/openstack-dev/pbr/tree/pbr/version.py you want into your project and then you can reference the version data pbr stores without needing to install all of pbr	16:17
*** EricGonczer_ has joined #openstack-infra		16:17
*** rbuzatu has quit IRC		16:18
*** ldnunes has joined #openstack-infra		16:18
fungi	jogo: though you might want to be wary of whether pbr provides any api contracts around the parts you're reimplementing, in case the data it's storing changes in incompatible ways in the future	16:19
jogo	fungi: thanks, and I would only need that to have my package print out what version it is running	16:20
fungi	jogo: right	16:20
*** rbuzatu_ has quit IRC		16:20
fungi	you could probably get away with just pkg_resources.get_provider(pkg_resources.Requirement.parse(self.package)).version	16:21
*** cgalan has joined #openstack-infra		16:21
*** roxanaghe has quit IRC		16:21
fungi	not sure if that's too bare-bones for your needs, or whether you need some of the additional SemanticVersion class bits	16:22
*** jtomasek has quit IRC		16:22
fungi	jogo: ^	16:22
*** tphummel has joined #openstack-infra		16:22
*** asettle has quit IRC		16:23
fungi	er, s/self.package/'my-package-name'/ of course	16:23
*** atom_ has quit IRC		16:25
jogo	https://github.com/openstack/swift/blob/f2e344a4d98606385f34d3633a90c24aa32fc43d/swift/__init__.py#L21	16:25
*** Apoorva has joined #openstack-infra		16:25
jogo	yeah that should work	16:26
*** PollyZ has quit IRC		16:26
*** tphummel has quit IRC		16:26
*** asettle has joined #openstack-infra		16:27
fungi	yep, so looks like they also implement the pkg_resources.DistributionNotFound case by falling back on importing pbr	16:27
*** rbuzatu has joined #openstack-infra		16:27
*** apetrich has quit IRC		16:27
*** thorst_afk is now known as thorst		16:27
fungi	which is not entirely what you wanted i guess, but maybe that's only happening during setup anyway	16:27
fungi	and hitting DistributionNotFound is unlikely outside of setup time, or something	16:28
*** david-lyle has quit IRC		16:28
*** rwsu has joined #openstack-infra		16:30
*** ddieterly is now known as ddieterly[away]		16:30
*** xarses has joined #openstack-infra		16:31
*** rbuzatu has quit IRC		16:31
*** roxanaghe has joined #openstack-infra		16:32
*** mhickey has quit IRC		16:33
*** hurgleburgler has joined #openstack-infra		16:33
mtreinish	fungi: well I screwed something up on those patches, mosquitto is rejecting all connections on my test instance now...	16:33
mtreinish	I guess that means it's more secure :)	16:33
mtreinish	s/rejecting/not listening on any port	16:33
krotscheck	....pink...fairy...armadillo?	16:34
openstackgerrit	Paul Belanger proposed openstack-infra/project-config: Move gate-{name}-linters to ubuntu-xenial https://review.openstack.org/347939	16:34
thiagop	folks, why all providers from the puppet projects were changed to openstack_pip?	16:35
thiagop	When I run my CI script, it's downloading dev packages from openstack_pip and some of these changes syntax of the commands that are run on the puppet scripts	16:35
Zara	krotscheck: it's living sushi! https://upload.wikimedia.org/wikipedia/commons/1/1e/Pink_Fairy_Armadillo_%28Chlamyphorus_truncatus%29_%28cropped%29.jpg	16:36
*** rbuzatu has joined #openstack-infra		16:36
krotscheck	Zara: OMG it actually exists	16:36
Zara	:D	16:36
openstackgerrit	Paul Belanger proposed openstack-infra/project-config: Move gate-{name}-docs to ubuntu-xenial https://review.openstack.org/347941	16:37
*** yamahata has quit IRC		16:37
fungi	krotscheck: yeah, all of the mascots listed in the ballot should come up in web searches as real things	16:37
*** rbuzatu_ has joined #openstack-infra		16:38
*** roxanaghe has quit IRC		16:39
*** javeriak has joined #openstack-infra		16:39
*** rbuzatu has quit IRC		16:40
*** jpich has quit IRC		16:41
*** derekh has quit IRC		16:42
*** rbuzatu_ has quit IRC		16:42
*** tphummel has joined #openstack-infra		16:42
clarkb	thiagop: because built in puppet pip stopped working with current pip	16:43
thiagop	clarkb: is there a reason to these dev builds are on openstack_pip?	16:44
*** Sukhdev has quit IRC		16:44
thiagop	clarkb: they are kinda messing with my life since I need to build a new CI host here...	16:45
jogo	fungi: yeah I can't seem to trigger DistributionNotFound	16:45
*** roxanaghe has joined #openstack-infra		16:45
clarkb	thiagop: no pip should not install dev packages unless explicitly told to	16:45
clarkb	thiagop: make sure you arw running current version of pip	16:45
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: cleanup resolv.conf https://review.openstack.org/347942	16:46
EmilienM	I am wondering if there is something I can do with glean ^	16:46
jogo	fungi: maybe on old pip version?	16:46
*** piet_ has joined #openstack-infra		16:47
thiagop	clarkb jogo: pip 8.1.2 here	16:47
clarkb	EmilienM: its likely a dhcp config that we need to set	16:48
fungi	jogo: maybe with editable install from a local source tree, or somehow using not-installed source	16:48
*** ddieterly[away] is now known as ddieterly		16:48
EmilienM	clarkb: where?	16:48
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: cleanup resolv.conf https://review.openstack.org/347942	16:48
clarkb	EmilienM: dhclient.conf for something to ignore search domain	16:48
jogo	fungi: I tried python setup.py develop	16:48
EmilienM	clarkb: in glean?	16:48
clarkb	EmilienM: in the image build	16:49
*** rbuzatu has joined #openstack-infra		16:49
EmilienM	ah	16:49
clarkb	thiagop: do you have a specific example of what is happening?	16:49
EmilienM	clarkb: thx	16:49
EmilienM	will do	16:49
thiagop	clarkb: I run puppet-openstackci to re-build my CI in a new VM. Zuul, nodepool and jjb were installed in dev versions	16:50
clarkb	thiagop: that is expected since we install all of them from sourve	16:50
clarkb	I dont think it has anything to do with openstack_pip	16:51
thiagop	clarkb: is it? I thought it should install from source only when "[zuul\|nodepool]_revision" and "[zuul\|nodepool]_git_source_repo" were uncommented on the common.yaml	16:52
*** weshay_food is now known as weshay		16:52
openstackgerrit	Ivan Udovichenko proposed openstack-infra/project-config: Add job to build generic debian packages https://review.openstack.org/307742	16:52
thiagop	it would*	16:52
clarkb	it instlls from source always and you can control what version from source uaing those params.default is master iirc	16:52
*** Apoorva_ has joined #openstack-infra		16:53
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: cleanup resolv.conf https://review.openstack.org/347942	16:53
thiagop	clarkb: understood	16:54
*** rbuzatu has quit IRC		16:54
pabelanger	clarkb: EmilienM: I can look into that, if that is something we want to add.	16:54
EmilienM	pabelanger: ok thanks	16:54
*** csomerville has quit IRC		16:54
clarkb	pabelanger: I think it would be ok to control that more tightly. Maybe set the value we want everywhere too	16:54
clarkb	test-foo1.oortcloud	16:55
*** trown\|lunch is now known as trown		16:55
*** lucasagomes is now known as lucas-dinner		16:55
nikhil	hi, should I be rechecking https://review.openstack.org/#/c/347621/ as it's related to https://review.openstack.org/#/c/347902/ ?	16:55
*** roxanaghe has quit IRC		16:55
nikhil	the above release is sorta urgent	16:55
clarkb	ince this is another way clouds differ we should try to handle it	16:56
openstackgerrit	Ivan Udovichenko proposed openstack-infra/project-config: Add job to build generic debian packages https://review.openstack.org/307742	16:56
clarkb	nikhil: I think the issues from earlier with the mirrors were corrected	16:56
*** Apoorva has quit IRC		16:56
nikhil	clarkb: thanks much!	16:57
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: cleanup resolv.conf https://review.openstack.org/347942	16:57
*** nwkarsten has quit IRC		16:58
*** e0ne has quit IRC		16:58
tlbr	AJaeger, we've added change to governance repository with Needed-By tag https://review.openstack.org/#/c/307742	16:59
pabelanger	clarkb: I think something like supersede domain-name ""; disables it	16:59
jogo	fungi: thanks for the help	17:00
*** hashar has quit IRC		17:00
*** rbuzatu has joined #openstack-infra		17:00
*** nherciu has quit IRC		17:00
openstackgerrit	Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Tighten the trusty job filter for OpenStack-Ansible properly https://review.openstack.org/347952	17:01
odyssey4me	clarkb ^ that seems to do it	17:02
*** gyee has joined #openstack-infra		17:03
*** jsavak has quit IRC		17:03
*** rbuzatu has quit IRC		17:04
*** jsavak has joined #openstack-infra		17:04
*** Swami has quit IRC		17:05
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: cleanup resolv.conf https://review.openstack.org/347942	17:05
*** jcoufal_ has joined #openstack-infra		17:05
*** cody-somerville has joined #openstack-infra		17:05
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: CI run do not review https://review.openstack.org/347957	17:06
*** tphummel has quit IRC		17:06
*** BobBall is now known as BobBall_AWOL		17:06
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: CI test https://review.openstack.org/347958	17:06
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: CI run https://review.openstack.org/347959	17:07
* devananda catches up on the discussion of ironic zuul / jjb testing		17:08
*** john-davidge has quit IRC		17:08
*** jcoufal has quit IRC		17:08
*** rbuzatu has joined #openstack-infra		17:09
*** rdx_matt has joined #openstack-infra		17:10
*** rdx_matt has quit IRC		17:11
*** rbuzatu_ has joined #openstack-infra		17:11
*** rdx_matt has joined #openstack-infra		17:11
devananda	clarkb: your assertion that a single ramdisk should work for all users does not match my experience. nearly every deployment of ironic involves a custom ramdisk for that hardware / environment. testing the ramdisk-build-process with different inputs is very important, and right now, the only way we have to functionally test the output of that is to run ironic with the resulting ramdisk.	17:11
*** tphummel has joined #openstack-infra		17:12
*** ddieterly is now known as ddieterly[away]		17:13
*** tesseract- has quit IRC		17:13
*** sputnik13 has joined #openstack-infra		17:13
clarkb	wait if users are customizing anyways thats even less reason to test all combos	17:13
clarkb	test thst ironic functions not thst every users random demands are met	17:14
*** rbuzatu has quit IRC		17:14
devananda	clarkb: that's what we are doing -- testing the build methods	17:14
devananda	not testing every possible combination of output	17:14
devananda	we have, currently, 3 supported methods to build the ramdisk. it's not distro specific. DIB can build a ramdisk based on several distros -- we only test the output of that with one distro	17:15
*** roxanaghe has joined #openstack-infra		17:15
*** links has joined #openstack-infra		17:15
*** sdake has quit IRC		17:15
devananda	we can also biuld a ramdisk using coreos -- it's not a distro difference, it's a completely different build toolchain	17:15
*** asettle has quit IRC		17:15
clarkb	right but why is one not sufficient	17:15
*** rbuzatu_ has quit IRC		17:15
clarkb	you dont need tinycorelinux or coreos or red hst	17:16
clarkb	you need a ramdisk	17:16
devananda	we're in the process of migrating away from the coreos build pipeline	17:16
clarkb	just one	17:16
devananda	the goal is to have two pipelines we test	17:16
devananda	if we could test in VMs that had 2x more RAM in the gate, we wouldn't need two pipelines	17:16
devananda	but the production-quality ramdisk is just too big to test in the gate env	17:16
*** sandanar has quit IRC		17:16
devananda	so we have had to develop a second ramdisk (and supporting build pipeline) to be able to meet openstack's requirements for testing	17:17
devananda	like parallel execution runs from tempest IN the gate	17:17
devananda	it's not that ironic can't do those things with the production-quality ramdisk -- we just can't do them in small VMs	17:17
clarkb	why not make the trstable one production wuality?	17:17
devananda	I hope that is more clear	17:18
devananda	huh?	17:18
devananda	it CANT be	17:18
clarkb	you are saying you must have two because one is testablr amd onr is ptod quality	17:18
clarkb	why noy?	17:18
devananda	a tinycorelinux ramdisk is simply too small to actually have all the hardware device drivers	17:18
devananda	and other things	17:18
*** agentleweb has quit IRC		17:18
clarkb	then use a different kernel that does?	17:18
openstackgerrit	Emilien Macchi proposed openstack-infra/project-config: zuul/layout/puppet: switch ovb to multinode for some modules https://review.openstack.org/347964	17:18
devananda	then it take too much RAM and we can't test it in the gate	17:18
devananda	I feel like I'm talking in a circle now	17:19
clarkb	this seems like a totally solvable problm if you look at goals vs tools	17:19
devananda	clarkb: if we had more RAM we wouldn't need to create a limited-functionality small ramdisk to test	17:19
devananda	the requrements (run parallel test jobs in a small VM) result in the tools (build a small ramdisk)	17:19
devananda	that we've had to develop to meet those requirements	17:20
*** akscram has joined #openstack-infra		17:20
*** david-lyle has joined #openstack-infra		17:20
devananda	the ironic community has spent effort over the last year to build this smaller ramdisk, and associated tooling, specifically because that is what infra and qa teams have told us we needed to do, because it wasn't possible to allocate more RAM in the gate environments	17:21
devananda	so we've been working to have most of our CI jobs start using the smaller ramdisk, and then retain one job (that doens't do parallel testing, doesn't do full tempest, etc) that continues to validate that the production-quality ramdisk actually functions at all	17:22
*** rbuzatu has joined #openstack-infra		17:22
devananda	right now, we're midway through that transition	17:22
devananda	and still have more jobs than we'd like to have	17:22
phschwartz	So, it looks like there is a pretty big problem with a recent commit to JJB	17:22
phschwartz	It ignores configs in the default locations. you have to manually pass a config to not get the generic template config	17:23
*** david-lyle has quit IRC		17:23
*** david-lyle_ has joined #openstack-infra		17:23
*** david-lyle_ is now known as david-lyle		17:24
*** electrofelix has quit IRC		17:25
*** david-lyle_ has joined #openstack-infra		17:25
phschwartz	https://review.openstack.org/#/c/319609/	17:25
phschwartz	It is related to that review	17:26
nikhil	clarkb: seems like the issue still persists https://review.openstack.org/#/c/347621/ (not sure if mirrors or otherwise)	17:26
pabelanger	clarkb: EmilienM: http://paste.openstack.org/show/542672/ appears to be the fix	17:26
*** rbuzatu has quit IRC		17:26
pabelanger	clarkb: EmilienM: tested that on centos-7	17:27
EmilienM	pabelanger: cool	17:27
pabelanger	now to see what is managing dhclient	17:27
pabelanger	cool, ubound	17:27
openstackgerrit	Michael Krotscheck proposed openstack-infra/project-config: Created jobs for nodejs version 6 https://review.openstack.org/344501	17:28
*** david-lyle has quit IRC		17:29
EmilienM	I found a weird thing with zuul-cloner	17:30
*** Apoorva_ has quit IRC		17:30
EmilienM	http://logs.openstack.org/16/344916/7/check/gate-puppet-openstack-libraries-puppet-lint-centos-7/7371a23/console.html#_2016-07-27_16_38_18_327016	17:30
EmilienM	15b9572dd8a8395c42a20112a5ddbdac2719fcba is not master	17:30
EmilienM	zuul-cloner thinks it clones from master but it's not master	17:30
*** Apoorva has joined #openstack-infra		17:30
*** shardy has quit IRC		17:32
*** sjmc7 has joined #openstack-infra		17:32
sjmc7	hi all. does anyone know if there’s a problem with commits that have multiple “depends-on” footer lines? https://review.openstack.org/#/c/308582/ has two that have merged, and is approved but isn’t merging, and i’m not sure why	17:33
*** rbuzatu has joined #openstack-infra		17:33
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: cleanup resolv.conf https://review.openstack.org/347942	17:34
openstackgerrit	Paul Belanger proposed openstack-infra/puppet-unbound: Update dhclient-eth0.conf for redhat images https://review.openstack.org/347970	17:34
pabelanger	EmilienM: clarkb: ^	17:34
*** david-lyle_ has quit IRC		17:34
*** david-lyle_ has joined #openstack-infra		17:34
EmilienM	pabelanger: thanks	17:34
EmilienM	pabelanger: you sure for domain-name-servers ?	17:34
pabelanger	yup, we run unbound locally	17:35
pabelanger	and it was already set	17:35
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: cleanup resolv.conf https://review.openstack.org/347942	17:35
EmilienM	k	17:35
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: CI run do not review https://review.openstack.org/347957	17:35
*** tonytan_brb has joined #openstack-infra		17:36
pabelanger	EmilienM: if you want to update your patch in tripleo, we can quickly confirm that is the fix for you	17:36
EmilienM	pabelanger: have you seen my issue with zuul-cloner?	17:36
EmilienM	pabelanger: ok I'm updating the patch	17:36
pabelanger	EmilienM: looking now	17:37
*** rbuzatu has quit IRC		17:37
*** tonytan4ever has quit IRC		17:38
*** piet_ has quit IRC		17:38
*** yamahata has joined #openstack-infra		17:39
*** tosky has quit IRC		17:39
pabelanger	EmilienM: it is master, just not the tip: http://git.openstack.org/cgit/openstack/puppet-openstack-cookiecutter/commit/?id=15b9572dd8a8395c42a20112a5ddbdac2719fcba	17:40
*** hashar has joined #openstack-infra		17:41
EmilienM	pabelanger: it's not master, look http://git.openstack.org/cgit/openstack/puppet-openstack-cookiecutter/log/	17:41
pabelanger	EmilienM: checking JJB	17:41
*** david-lyle_ has quit IRC		17:42
*** vponomaryov1 has quit IRC		17:42
pabelanger	EmilienM: 3 commit from top is what it is using	17:42
pabelanger	EmilienM: which is master	17:42
pabelanger	but not the latest commit	17:42
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: cleanup resolv.conf https://review.openstack.org/347942	17:42
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: CI run do not review https://review.openstack.org/347957	17:42
EmilienM	pabelanger: right, it's not using latest commit	17:43
mtreinish	fungi: http://i.imgur.com/v48R5TW.png \o/ websockets over port 80 work	17:44
*** rbuzatu has joined #openstack-infra		17:44
*** rdx_matt has quit IRC		17:44
mtreinish	now to figure out what I changed locally to fix the broken review	17:44
*** ihrachys has quit IRC		17:44
fungi	mtreinish: woah. what distro/release?	17:45
mtreinish	fungi: xenial	17:45
EmilienM	pabelanger: something is wrong in git or?	17:45
fungi	mtreinish: got it. yeah the websocket challenge for the zuul-launcher log streams is waiting for xenial aiui	17:45
*** sdague has quit IRC		17:46
clarkb	devananda: so I understand all that. What I dont underatand is why you cant have both things.	17:46
mtreinish	fungi: we need mosquitto>=1.4.0 for the websocket broker support. The packaged version on trusty is 0.15	17:47
clarkb	I havent heard ehy it is impossible to have a ramdisk that works in production and testing	17:47
mtreinish	fungi: I listed on the details on: https://review.openstack.org/#/c/347575/	17:47
mtreinish	in a comment	17:47
clarkb	it maynoy be possible if using ubuntu or red hat but that isnt a requirement under the goals	17:47
*** sabari has quit IRC		17:47
fungi	mtreinish: wfm. we've decided we're cool turning up new services (especially experimental ones) on xenial, just not moving existing production systems from trusty to xenial yet	17:47
pabelanger	EmilienM: no, I think it is failing back to the cached version of the repo in /opt/git for some reason	17:48
mordred	clarkb: drivers	17:48
mordred	clarkb: to make a production quality ramdisk, you need drivers	17:48
mordred	clarkb: to make a ramdisk that works in the gate, you need less drivers	17:48
*** sabari has joined #openstack-infra		17:48
clarkb	mordred: drivers are tiny	17:48
fungi	clarkb: we've also moved the "securing tinycore linux's package management chain" discussion to #openstack-ironic	17:48
pabelanger	EmilienM: which make sense if the image is out of date	17:48
*** rbuzatu has quit IRC		17:48
fungi	clarkb: makes for an entertaining read	17:48
clarkb	and if it really was an issur have two kernels	17:49
clarkb	one for test one for prod and test the prod one in ONE job	17:49
mordred	individuall. but if you need a produciton quality ramdisk that can handle all the things, you need all of the drivers - drivers are usually why most people build their own ramdisk as part of ironicing things	17:49
*** flepied has quit IRC		17:49
EmilienM	pabelanger: ah, ok	17:49
*** lezbar__ has quit IRC		17:49
*** sjmc7 has left #openstack-infra		17:50
jroll	17:49:19 clarkb \| one for test one for prod and test the prod one in ONE job	17:50
JayF	And we've worked to make sure that those extra ramdisks don't slurp up large amounts of gate resources; we only test all the ramdisks against IPA; then use the prebuilt ones in Ironic/Nova/etc jobs	17:50
jroll	that's exactly the goal	17:50
*** pblaho has quit IRC		17:50
fungi	clarkb: the concern with tinycore, apparently, is that not only is there no means of validating the authenticity of the tinycore base image, but also the tinyipa image build process needs to download and install some additional packages inside the base image, and the tcz package manager is entirely without any mechanism for authenticating packages at all	17:50
clarkb	jroll great	17:50
*** lezbar has joined #openstack-infra		17:50
EmilienM	pabelanger: ok so there is nothing I can do, right?	17:50
jroll	clarkb: maybe a couple jobs for the prod one, to cover some different deployment methods, but yeah minimizing that is the goal	17:50
*** trown is now known as trown\|brb		17:51
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: cleanup resolv.conf https://review.openstack.org/347942	17:51
fungi	clarkb: though i also discovered that if you try to hit https://tinycorelinux.net/ (or send anything to that ip address besides an http request from what i can tell) then you get blacklisted from http://tinycorelinux.net/ for 5 minutes or so	17:51
* pleia2 facepalm		17:51
pabelanger	clarkb: corvus: What is the condition that zuul-cloner will "fall back to branch master": http://logs.openstack.org/16/344916/7/check/gate-puppet-openstack-libraries-puppet-lint-centos-7/7371a23/console.html#_2016-07-27_16_38_18_311521	17:52
clarkb	it just seems like we do a ton of testing for something no one is usimg amyways and it doesnt give us extra coverage	17:52
fungi	pleia2: yeah, it's hilarious	17:52
clarkb	fungi neat	17:52
pleia2	fungi: so much irony here	17:52
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: CI run do not review https://review.openstack.org/347957	17:52
pleia2	(tiny core distros are touted as the core of a lot of solid HA stuff, but their own website..?)	17:52
clarkb	so we should use one thing that works for teatingmake that work and move on with life	17:53
dmsimard	I have nothing against Allah but have you guys figured out a way to prevent those spammers from spamming ? :)	17:53
jroll	clarkb: I can assure you that people use the other ramdisk builders	17:53
pleia2	dmsimard: no, there isn't any blockable pattern really, we just have to kill on site	17:53
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-mosquitto: Add websocket listner to mosquitto https://review.openstack.org/347924	17:53
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-mosquitto: Add basic permissions and security https://review.openstack.org/347923	17:53
dmsimard	pleia2: figured so as well, oh well	17:53
mtreinish	fungi: ^^^ I think that should do it	17:53
clarkb	jroll ok the story I keep hearing is everyone makes a custom one	17:54
*** sdague has joined #openstack-infra		17:54
*** links has quit IRC		17:54
mtreinish	I need to update the puppet-germqtt side to configuring auth also	17:54
jroll	clarkb: they add things (like drivers) to the builder code we ship	17:54
devananda	clarkb: we (the ironic team) have two differing requirements that ew need to meet with this. 1) produce build automation and a built artefact that is tested with ironic and suitable for production environments, 2) run tempest full parallel tests against ironic and lots of other openstack services	17:54
corvus	pabelanger: i'm at the ansible contributor summit today, so limited attention span. you may want to check the comments in the zuul cloner code though -- it might help explain	17:54
*** lezbar has quit IRC		17:55
pabelanger	corvus: Ya, nice. Enjoy yourself	17:55
corvus	pabelanger: check zuul/lib/cloner.py prepareRepo	17:55
pabelanger	corvus: will do, thanks	17:55
*** rbuzatu has joined #openstack-infra		17:55
devananda	clarkb: the output of (1) isn't suitable for use in (2) because of resource limitations in the gate env	17:56
jroll	clarkb: if/when nodepool has some baremetal, that eliminates all performance concerns with every MB added to the ramdisk, and we could go down to one	17:56
jroll	currently the tinycorelinux version takes minutes to boot	17:56
clarkb	devananda: right I am daying making the output of 2 suitable for 1	17:57
clarkb	I think that is doable	17:57
devananda	clarkb: that doesnt make sense. 92) doesnt produce a ramdisk	17:57
clarkb	build kernel with drivers add busybox and ipa done	17:57
jroll	and python...	17:57
jroll	and iscsi, and so on and so forth	17:57
clarkb	jroll: busybox has python iirc	17:57
jroll	tinycore is basically as minimal as we've been able to get things, with year(s?) of work	17:57
devananda	clarkb: we've been working on this. trying ot make it smaller	17:58
devananda	and this is what we've got	17:58
jroll	the tinycore version is 38MB	17:58
*** acoles is now known as acoles_		17:58
*** nwkarsten has joined #openstack-infra		17:59
clarkb	cool could you tinycore in production assuming security issies were addressed?	17:59
*** nwkarsten has quit IRC		17:59
jroll	it takes 24 seconds to boot, looking at a random gate run	17:59
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-germqtt: Add auth config to germqtt https://review.openstack.org/347977	17:59
jroll	no, we'd need to add things like sshd and other utilities	17:59
*** nwkarsten has joined #openstack-infra		17:59
devananda	clarkb: no... tinycore isn't going to boot on most hardware, and the build process we're using removes a lot of utility functions that any actual operator is oging to need	17:59
jroll	oh 24 seconds was cirros, oops	18:00
*** rbuzatu has quit IRC		18:00
clarkb	sshd is easy with dropbear fwie I dunno what oyher tools you need	18:00
*** hashar is now known as hasharAway		18:01
clarkb	but It would be trivial to address that need for composition with dib	18:01
clarkb	test the minimal srt for ironic then let ops add in $editor or whatever they want	18:02
jroll	right, so coreos is totally prod-ready	18:02
jroll	it takes 4m30s to boot in CI	18:02
openstackgerrit	Diana Clarke proposed openstack-infra/project-config: Add nova-coverage-db to experimental queue https://review.openstack.org/343922	18:02
jroll	there's surely a middle ground here but it's a question of how much time we spend on it	18:02
openstackgerrit	Matthew Treinish proposed openstack-infra/system-config: Add firehose.o.o config to system-config https://review.openstack.org/347575	18:03
jroll	I don't have DIB numbers, unfortunately, as we don't test that in the gate	18:03
mordred	are we trying to find a middle ground of creating a thing so that we can keep job counts down?	18:03
devananda	clarkb: so if we use a prod-suitable ramdisk in all of our tempest-dsvm jobs, last time I looked at this, the runtime of those jobs more than doubles	18:03
openstackgerrit	xiaodongwang991481 proposed openstack-infra/project-config: fix the issue that networking-sfc repo is not installed in $BASE/new https://review.openstack.org/347979	18:03
clarkb	devananda: but only bcause you are trying to go the wrong direction	18:03
jroll	mordred: seems job count is the primary objection to multiple ramdisks, yes	18:03
clarkb	make a testable thing functional for prod	18:03
clarkb	mordred: there are 83 jobs	18:03
clarkb	I have to convert all to xenial + truaty	18:04
devananda	clarkb: the testable thing is fast enough for CI specifically because we removed all the things one would need in prod	18:04
*** nwkarsten has quit IRC		18:04
clarkb	no other project comea close to needing 83 tempest jobs from what I can see	18:04
JayF	So the real problem is number of tempest jobs	18:04
devananda	mordred: clarkb is unhappy that hte ironic project defines 83 jjb jobs	18:04
JayF	not number of ramdisks supported	18:04
clarkb	devananda: like what? I hward drivers but those are cheap	18:04
clarkb	sshd is also cheap if you dropbear	18:04
JayF	We should address that directly; I don't believe changing number of ramdisks would have a major impact on job numbers	18:04
jroll	nothing is cheap in nested virt, honestly	18:05
JayF	UNLESS there's some inefficiency in how we're generating jobs	18:05
JayF	and if that's the case, we should fix that inefficiency before spending time and effort trying to solve a likely-impossible problem (production-quality + CI-small ramdisk)	18:05
devananda	clarkb: if you don't believe we've been working on this, despite what we're ALL telling you....	18:05
clarkb	devananda: I don't disbleieve it	18:05
krotscheck	I'm trying to run the devstack-gate project on a prviate vm, and I'm getting "with_timeout: command not found" - is there something I'm not including?	18:05
clarkb	I am challenging the assertions thats all	18:05
clarkb	I challenge the assertion that you can't make a ramdisk that works for testing and produiction use	18:06
*** darvon has quit IRC		18:06
mordred	clarkb: right. but they are saying that they have worked on that for multiple years to no avail	18:06
clarkb	which seems to be the basis for "we must have 3 images"	18:06
devananda	clarkb: we must have two images	18:06
devananda	that's what we've said	18:06
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: CI run do not review https://review.openstack.org/347957	18:06
jroll	clarkb: do you challenge the assertion that nested virt is horrifically slow? to the point where every megabyte matters	18:06
clarkb	devananda: ok bnut you have 3 right now	18:06
devananda	we're in the middl eof pivoting from 3 to 2	18:06
jroll	we don't test 3 right now	18:06
devananda	as a migration	18:06
*** rbuzatu has joined #openstack-infra		18:06
jroll	we really don't	18:06
devananda	i've said that already mltiple times	18:06
jroll	unless DIB runs CI on the DIB ramdisk, but we do not	18:07
mtreinish	fungi: https://review.openstack.org/#/q/topic:firehose+status:open I think I should stop pushing things for a while :)	18:07
*** darvon has joined #openstack-infra		18:07
clarkb	JayF: yes I think we are generating jobs very inefficiently due to jjbs cross producting	18:07
clarkb	I am about to ask jjb to generate the list for me	18:07
JayF	clarkb: so lets find a good way to fix that, and go from there. I think that's probably more productive.	18:07
JayF	clarkb: feel free to attach me to any related bugs + reviews and I'll help whereever I can, this is the sort of thing I've helped out Ironic w/a bunch	18:08
devananda	clarkb: requirements for tetsing: kernel boots very quickly in nested virt, total size is as amall as possible	18:08
jroll	I would love to see that list, the only perspective I have is the list of jobs run on each patch	18:08
*** eric_lopez has quit IRC		18:08
JayF	clarkb: and bluntly if I never knew it was an issue, I doubt anyone else in the project did. We know now, and we can help make it suck less as a result	18:08
devananda	clarkb: requirements for prod: kernel is secure,, boots over secure mechanism, contains all the drivers I might need in my fleet, ramdisk has various utilities that my ops folks need. size and boot speed (basically) dont matter	18:08
devananda	clarkb: I do not believe one can create a ramdisk that meets these OPPOSITE requirements	18:09
krotscheck	mtreinish: I find it hilarious that the topic is firehose.	18:09
clarkb	devananda: secure boot vs not should be doable in one kernel right? so tahts just noise. Having all the drivers you need does add size but not a crazy amount my desktops kernel which I am sure has all the things is 7MB. Utilities can be composed in with dib	18:10
*** jamielennox is now known as jamielennox\|away		18:10
Krenair	I'm trying http://docs.openstack.org/infra/system-config/sysadmin.html#making-a-change-in-puppet - puppet apply seems to be silently stuck though	18:10
bkero	clarkb: the kernel itself is, although /lib/modules/`uname -r` is quite bigger	18:10
pabelanger	clarkb: fungi: any objections to https://review.openstack.org/#/c/347158/ needed to add tripleo AFS mirror server into our ansible runs	18:10
devananda	clarkb: right. then I invite you to come solve this problem ... because we've been working on it	18:10
JayF	clarkb: DIB is not a supported IPA ramdisk. The smallest DIB ramdisk anyone has ever managed to build takes 6x as much ram as the TinyIPA ramdisk.	18:10
JayF	clarkb: which is why it's not tested/ci'd today (among other reasons)	18:11
*** rbuzatu has quit IRC		18:11
jroll	s/not/not currently/	18:11
clarkb	JayF: thats a function of the distro though not dib right? eg you can build tinycore with dib if you wanted	18:11
fungi	Krenair: it's possible we need to update those instructions since we went masterless. i'm rereading now	18:11
clarkb	and should get the same rough results	18:11
phschwartz	Where should issues for JJB be filed?	18:11
clarkb	phschwartz: on storyboard against jjb	18:11
phschwartz	I want to file an issue before I push up this review so it is tracked.	18:11
phschwartz	clarkb: ty	18:11
*** adrian_otto has quit IRC		18:11
JayF	clarkb: I honestly don't know the answer to that, but I do know this isn't some new thing. We've been working on this for years, posting about it on the list, etc	18:11
krotscheck	fungi: I'm trying to run a manual dsvm-gate script, but for some reason it's telling me that "with_timeout" is not found. Any idea where that's declared? Grepping doesn't come up with anything useful.	18:11
odyssey4me	clarkb if you have a moment, a review of https://review.openstack.org/347952 would be appreciated	18:11
fungi	krotscheck: you'll find the name of the server/service equally hilarious then http://specs.openstack.org/openstack-infra/infra-specs/specs/firehose.html	18:11
clarkb	odyssey4me: looking	18:12
rcarrillocruz	phschwartz: i would also ping electrofelix and waynr so they have it in their radar	18:12
JayF	clarkb: a little upsetting to have it all challenged and crap-talked 18m+ into the effort to make this stuff better	18:12
krotscheck	fungi: ++	18:12
mtreinish	krotscheck: heh, fungi picked the name. It's the spec title	18:12
*** PollyZ has joined #openstack-infra		18:12
clarkb	JayF: basically its important to decouple dib from the output. dib is more of a framework that allows you to compose images. It isn't in charge of the packaging or distros thats up to well the distros	18:12
mtreinish	oh, fungi beat me to it :)	18:12
clarkb	JayF: I am not trying to crap talk anyone...	18:12
krotscheck	mtreinish: Firehose name + you saying you've been pushing too many patches (creating a firehose)....	18:12
clarkb	JayF: I asked if ironic needs to have 3 images	18:12
clarkb	JayF: sounds like it needs maybe 2	18:12
devananda	clarkb: you're stating that the work we've all been doing is not good enough	18:13
jroll	I still assert that we have two in ironic's CI, not 3	18:13
clarkb	devananda: I am asking if we can do better	18:13
*** ddieterly[away] has quit IRC		18:13
JayF	clarkb: and our response has generally been that "doing it better" has been a priority for months and months, and we're travelling down the path	18:13
jroll	so I'd like to see the list of jobs (without digging through xml), so we can identify the third	18:13
devananda	clarkb: I've been telling you that we've been working on exactly this problem, and what answer we have come up with, and yet you contiune to disbelieve it	18:13
mtreinish	krotscheck: heh, yeah	18:13
JayF	clarkb: but again, lets address the real issue: the list of jobs being bloated invalidly, and I think any additional issues will become clear quickly	18:13
fungi	krotscheck: looks like it's defined in functions.sh according to http://codesearch.openstack.org/?q=function%20with_timeout	18:13
devananda	clarkb: reducing the total number of jobs is great - we all agree and wnat to help there	18:13
devananda	clarkb: asserting that we don't understand the problem space that we work in every day is, frankly, insulting	18:14
JayF	also when we kill the set of _ssh jobs in favor of the _ipmitool jobs, we should nuke about half the jobs as well	18:14
clarkb	JayF: devananda yes definitely. As an outsider looking in having extra ramdisks seemed unnecessary for testing purposes	18:14
clarkb	which is why I asked about that...	18:14
devananda	clarkb: this conversation has felt incredibly insulting to me	18:14
* jroll would like to keep in mind that good image-building is not our primary mission, merely a necessary evil, and many ironic contributors are not experts on that		18:14
clarkb	devananda: I am sorry I have never intended to insult anyone	18:14
clarkb	I merely asked if it was necessary...	18:14
mmandel	Hi, I'm trying to enable the noVNC service so that a tempest test will get ran in the devstack gate jobs. Can someone please point me to where I would do this? I already added n-novnc in devstack-gate/features.yaml, wondering if the next change would need to be adding noVNC to project-config/projects.yaml	18:15
devananda	clarkb: even after multiple people tell you "yes" you continue to tell us we're wrong	18:15
clarkb	odyssey4me: the splitting of the second .* seems suspect to me	18:15
clarkb	odyssey4me: that means match one char with . then have zero or more negative matches?	18:15
*** Teresita-Warrior has quit IRC		18:16
krotscheck	fungi: Ah, I didn't have $WORKSPACE defined. Thanks :)	18:16
clarkb	devananda: I am trying to understand. Its not sufficient to say we need two images one for prod and test. I want to udnerstand why	18:16
clarkb	devananda: that has since been clarified and has to do with boot times and ram consumption with qemu in the gate	18:16
clarkb	odyssey4me: was that an intentional change in the regex? I am not sure it will do what we awnt but maybe my regex foo is misparsing it	18:17
JayF	clarkb: fwiw we are moving towards having DIB being the canonical builder of the production-quality images for us, that work is ongoing, at that point we'll likely (I only say likely b/c it's not just my call) deprecate the CoreOS image	18:17
*** rbuzatu has joined #openstack-infra		18:18
odyssey4me	clarkb so I mucked around with a ton of testing, and that's the only one that seemed to work... I don't really understand why the other options I tried did not work	18:18
odyssey4me	I tried with the .* outside, and it didn't work	18:18
*** baoli_ has quit IRC		18:18
JayF	clarkb: then if we get the ability to build an "embedded" style DIB image, you start moving towards a vision of having a single ramdisk be possible at all... but right now we're at least 3-4 steps away from that even being on the rader	18:18
JayF	*radar	18:18
odyssey4me	clarkb I'm happy to leave the patch for a time when you have more testing opportunities and can suggest something better	18:18
clarkb	JayF: gotcha	18:19
*** cgalan_ has joined #openstack-infra		18:19
odyssey4me	clarkb my only concern at this stage is the waste of trusty nodes	18:19
fungi	Krenair: nothing jumps out at me as especially wrong with the steps in that doc... can you look at `ps afuxww` and see what child process is stuck? that may give more of a clue	18:19
clarkb	odyssey4me: I can test it in a few minutes. Just cleaning up this list of jobs so I can share with ironic	18:19
odyssey4me	clarkb cool, thanks - I'm out for the evening so please feel free to adapt if you find something better... I've included a bunch of names to test with	18:20
openstackgerrit	Philip Marc Schwartz proposed openstack-infra/jenkins-job-builder: Correct configuration file usage. https://review.openstack.org/347984	18:20
phschwartz	electrofelix: waynr: SpamapS: nibalizer: https://review.openstack.org/347984	18:20
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: CI run do not review https://review.openstack.org/347957	18:20
clarkb	odyssey4me: ya see the names in the commit message, were we failing on the repo_build ones or both?	18:21
phschwartz	clarkb: Is there a special tag to link storyboard items to a review? Closes links to launchpad	18:21
*** ociuhandu has quit IRC		18:21
Krenair	fungi, oh, it's a download: https://paste.ubuntu.com/21171494/	18:22
*** ddieterly has joined #openstack-infra		18:22
*** Swami has joined #openstack-infra		18:22
*** rbuzatu has quit IRC		18:22
rcarrillocruz	SB Gerrit integration I think is not there yet	18:23
odyssey4me	clarkb the repo build ones	18:24
phschwartz	rcarrillocruz: ah, k	18:24
fungi	mmandel: it looks like n-novnc is already in the default ENABLED_SERVICES list in devstack. are you sure it's not starting?	18:24
*** zul_ has joined #openstack-infra		18:25
*** zul has quit IRC		18:25
*** ayoung has quit IRC		18:25
mmandel	fungi: the test only runs if vnc_console is true in tempest.conf -- I made that change, but the test is still getting skipped. Thought it was because the service wasn't enabled in the gate	18:26
fungi	Krenair: that wget completed for me locally in 4.6 seconds, so maybe it's stuck? you might want to kill that wget pid and then retry the apply once it fails through and returns control of your terminal	18:26
*** cgalan_ has quit IRC		18:26
fungi	mmandel: you might want to start by asking the tempest/devstack contributors in #openstack-qa	18:26
Krenair	fungi, yeah but you probably have an okay internet connection... having just moved house I have to wait until tuesday to get a proper connection, until then I'm stuck mobile tethering	18:27
Krenair	still it should've been done in 4 minutes	18:27
fungi	Krenair: yeah, my guess it it got stuck somehow	18:27
waynr	phschwartz: thanks! i'll try to take a look at your patch soonish	18:27
*** nwkarsten has joined #openstack-infra		18:27
fungi	Krenair: you could look at the tempfile it's writing to and see if it's growing at all i guess	18:27
fungi	(the one listed after -O in your ps)	18:28
*** trown\|brb is now known as trown		18:28
*** rbuzatu has joined #openstack-infra		18:29
Krenair	it's growing	18:29
Krenair	fungi, it took about 35 minutes in the end, but it completed	18:30
mmandel	fungi: thanks!	18:31
clarkb	jroll: JayF devananda http://paste.openstack.org/show/542680/ there is the semi organized job list	18:31
clarkb	looks like the final count for integration tests is over 100	18:31
prometheanfire	so, does someone mind reviwing this, it seems to be blocking more work (gentoo nodepool) https://review.openstack.org/#/c/307553/	18:32
JayF	jeeze, we're generating a lot of -nv jobs that aren't needed	18:32
clarkb	oh I think the image build jobs snuck into that count so may be a little lower, but if we can take that list and trim it down so that we don't have to manage that it would be awesome	18:32
Krenair	ugh... it's going to be running git clone forever...	18:32
JayF	and trading out the _ssh jobs for all the _ipmitool jobs will shrink that quite a bit too	18:33
JayF	I think we can cut 20+ jobs off that list just by nuking -nv jobs that don't need to be generated as -nv	18:33
*** ganesan has joined #openstack-infra		18:33
*** rbuzatu has quit IRC		18:33
jroll	yeah, +1	18:33
JayF	after I get back from lunch, I'll put that in an etherpad and do some annotation on it to figure out which ones can go, then from there we can make the generation smart enough to not do it anymore	18:33
jroll	I still only see two ramdisks fwiw	18:34
clarkb	JayF: is that a change you want to write? You are going to have to fiddle with how the cross product is done. Either by using some job groups to restrict where you cross product or applying more things to the exclude list (this is all in jenkins/jobs/projects.yaml)	18:34
mtreinish	corvus, fungi: have you seen this happen before? http://logs.openstack.org/92/347892/1/check/gate-infra-puppet-apply-ubuntu-xenial/a30da6a/console.html#_2016-07-27_15_44_03_120947	18:34
fungi	Krenair: wow. 25.68MiB in 35min is ~63Kbps	18:34
*** jsavak has quit IRC		18:34
clarkb	jroll: ya looks like there isn't a dib one, its coreos and tinyipa	18:34
clarkb	jroll: which if we removed one would almost halve the job count fwiw	18:34
*** sarob has joined #openstack-infra		18:34
*** baoli has joined #openstack-infra		18:34
JayF	clarkb: I will certainly look at it and take a stab at it	18:35
jroll	clarkb: right, I don't believe we can do that as we discussed already :/	18:35
clarkb	jroll: yup	18:35
*** jsavak has joined #openstack-infra		18:35
clarkb	jroll: but tahts why I approached with that idea	18:35
jroll	clarkb: we will be removing ssh by the end of this cycle, so that will help a ton	18:35
JayF	clarkb: qq though, Do we know if it was this bad before we merged that refactoring change/	18:35
jroll	clarkb: yeah fair	18:35
JayF	clarkb: I'm wondering if that is part of what made these baloon	18:35
corvus	mtreinish, fungi: that is not familiar to me. is it persistent? could it be related to the gc?	18:35
clarkb	JayF: I don't, but I think it was. I did general perusing and found a few classes of jobs that werent run at all	18:35
clarkb	JayF: the total count may have shifted as part of the refactor though	18:35
JayF	Yeah; I'll take a look at it	18:36
JayF	not sure I have the skill to completely knock out that change	18:36
JayF	but I'll definately take a stab at it	18:36
JayF	and absolutely document which ones are used vs extranneous	18:36
* JayF suspects 50% of those are extranneous		18:36
openstackgerrit	Merged openstack-infra/project-config: Remove unused trusty jobs https://review.openstack.org/347147	18:36
clarkb	JayF: thank you, let me know if tyou have jjb questions. Also you can run `tox -ezuul` in that repo then look in .test/job-list.txt to get a complete listing which you can filter like I did for more ironicy things	18:36
jroll	JayF: don't forget to look at other projects, e.g. grenade -nv runs on grenade afaik	18:37
openstackgerrit	Emilien Macchi proposed openstack-infra/tripleo-ci: CI run do not review https://review.openstack.org/347957	18:37
JayF	jroll: ayup. I'm mainly thinking about all the -src-nv jobs. We shouldn't have any -src-nv jobs anymore, I think	18:37
fungi	corvus: mtreinish: that is indeed a very strange error	18:37
clarkb	JayF: jroll I also wonder if those experiemntal jobs are still in use? those might be easiest ones to knock out at the start if not	18:37
jroll	JayF: mostly agree, I think e.g. ipmitool -src jobs are nv right now	18:37
EmilienM	pabelanger: can you review the workaround please ? https://review.openstack.org/#/c/347942/9/scripts/deploy.sh	18:37
osnexus	So I'm attempting to set up my 3rd party CI and am having issues connecting to nova nodes from my CI server, it seems the IPs aren't being exposed properly. I'm following this guide http://docs.openstack.org/ops-guide/ops_network_troubleshooting.html	18:38
jroll	clarkb: yeah that's a good question	18:38
osnexus	And am getting the errro	18:38
fungi	corvus: mtreinish: web searches for "refs/remotes/origin/HEAD will become dangling" also turn up no exact matches for me	18:38
osnexus	public endpoint for network service in RegionOne region not found	18:38
jroll	clarkb: basically JayF can compare this to zuul/layout to see what's unused, yeah?	18:38
JayF	that's what I was planning on doing	18:38
clarkb	jroll: JayF yup that would be the way to do it	18:38
jroll	cool	18:38
clarkb	jroll: jroll note the second half of that list with the standard python job things you probably won't be able to edit much since that covers your linting, docs, unittestson multiple pythons, release notes, etc	18:39
*** rbuzatu has joined #openstack-infra		18:40
clarkb	but those are less of a concern because we have those pretty well standardized across all projects so overhead is low	18:40
mtreinish	corvus: I dunno, I just hit it on one of my patches	18:40
JayF	clarkb: yeah, I'm going to just completely ignore that section	18:40
clarkb	its really more the ~100 integration type tests there that bug me	18:40
mtreinish	corvus: I'll try a recheck and see what happens	18:40
*** rdx_matt has joined #openstack-infra		18:41
*** rdx_matt has quit IRC		18:41
*** rdx_matt has joined #openstack-infra		18:42
*** ericksonsantos has quit IRC		18:44
*** rbuzatu has quit IRC		18:44
*** tonytan_brb has quit IRC		18:44
*** e0ne has joined #openstack-infra		18:45
clarkb	odyssey4me: also why do you have non voting docs jobs? those should always be voting imo (its trivial to make them work if they don't work)	18:46
*** e0ne has quit IRC		18:47
*** shashank_hegde has joined #openstack-infra		18:47
openstackgerrit	Matthew Treinish proposed openstack-infra/zuul: WIP: Add germqtt listening support https://review.openstack.org/347997	18:48
mtreinish	corvus: ^^^ I have no idea if that's the right track or not. I haven't even tried to run it	18:48
mtreinish	but I think that's the basic idea for when firehose is up and running	18:48
clarkb	ya ok its repo_build one matches	18:48
corvus	mtreinish: i didn't think we were doing any zuul stuff for starters?	18:50
*** rbuzatu has joined #openstack-infra		18:51
mtreinish	it wasn't part of the spec, but I figured it wouldn't hurt to have poc up	18:51
corvus	mtreinish: ok. i would like to defer this until after zuulv3 if that's okay?	18:51
clarkb	odyssey4me: ok I understand the problem, we have multiple foo-docs and bar-docs and so on and if we put the .* before the negative lookahead it seems to greedily match before the negative lookahead and then matches everything. The regex as is doesn't work for all the foo-docs and bar-docs out there	18:52
devananda	JayF: I'm starting on it here https://etherpad.openstack.org/p/ironic-jjb-matrix	18:52
mtreinish	corvus: that's fine, I wasn't expecting to land it anytime soon. I don't know much about zuul internals. That was just kinda a shot in the dark	18:52
*** dimtruck is now known as zz_dimtruck		18:53
*** flepied has joined #openstack-infra		18:54
*** rbuzatu has quit IRC		18:55
*** david-lyle_ has joined #openstack-infra		18:57
*** zz_dimtruck is now known as dimtruck		18:57
mtreinish	corvus, fungi: saw it again this time on a different job for a different repo: http://logs.openstack.org/23/347923/2/check/gate-infra-puppet-apply-centos-7/8dd7b24/console.html#_2016-07-27_17_59_11_869642	18:58
mtreinish	well it's still a puppet apply job, just a different distro	18:59
clarkb	odyssey4me: and I think I understand why that works. The * is modifying your not docs but allwo . multiple times. So we can repeat the . * times as long as we don't end up with docs	18:59
clarkb	odyssey4me: so that looks good to me	18:59
fungi	mtreinish: yeah, being cross-platform (and so different git versions) does have me worried we've subtly broken something	18:59
*** javeriak_ has joined #openstack-infra		19:00
openstackgerrit	Philip Marc Schwartz proposed openstack-infra/jenkins-job-builder: Correct configuration file usage. https://review.openstack.org/347984	19:00
fungi	mtreinish: also different providers (rax-ord and ovh-bhs1)	19:00
*** javeriak has quit IRC		19:00
fungi	mtreinish: however, same repo both times	19:01
*** rbuzatu has joined #openstack-infra		19:02
fungi	mtreinish: also if i clone git://git.openstack.org/openstack-infra/puppet-openstackid and then do a `git remote prune origin` in it, i don't get that error	19:03
*** shashank_hegde has quit IRC		19:04
clarkb	jroll: JayF fungi fwiw if package security is a concern alpine linux does sign their packages (and its another make a small install distro)	19:04
fungi	mtreinish: oh, cloning from git04 i get an empty repo...	19:05
clarkb	and suppsoedly it is designed to run from ram which may be helpful? I dunno what specialness they do to make that better	19:05
pabelanger	EmilienM: looks right, lets see what ansible says	19:05
fungi	mtreinish: the rest seem fine. i'll see what's going on with that repo on git04 and then see if i can come up with a way to scan for the same issue across all of the repos on all our git servers to see if it's more widespread	19:06
*** rbuzatu has quit IRC		19:06
clarkb	their published iso is not 38MB small though. It is 93MB	19:07
*** david-lyle_ is now known as david-lyle		19:07
clarkb	thats still much smaller than the "minimal" images we make for centos, fedora, and ubuntu	19:07
*** fifieldt has quit IRC		19:08
clarkb	(also why do people continue to publish isos?)	19:09
*** ganesan has quit IRC		19:10
fungi	clarkb: for install from usb stick?	19:10
fungi	you can just `cp some.iso /dev/yourusbstick` and then boot from it	19:11
*** HeOS has quit IRC		19:11
clarkb	sometimes :) archwiki has a whole section on how to make that work iirc	19:11
fungi	iso filesystems are usable for more than just cds	19:11
clarkb	something to do with device labels and such	19:11
fungi	yeah, it _can_ get tricky, agreed	19:11
pabelanger	fungi: clarkb: mind reviewing: https://review.openstack.org/#/c/347970/ Updates our dhclient.conf settings in CentOS / Fedora ignoring domain / search settings from dhcp. Seems osic and ovh are providing them	19:12
clarkb	pabelanger: why not ubuntu?	19:12
fungi	clarkb: but as long as that works, i expect some distros to still make iso images since there are parts of the world where people do still want to be able to reinstall systems from cd	19:12
clarkb	fungi: ya I guess its flexible in supprting old hardware and new	19:13
*** rbuzatu has joined #openstack-infra		19:13
pabelanger	clarkb: mostly cause I didn't see a failure on Ubuntu. And dhclient.conf on ubuntu is more elaborate	19:14
pabelanger	clarkb: I could add it there too	19:14
*** jsavak has quit IRC		19:14
clarkb	pabelanger: I think we should so that we don't further confuse ourselves with different behavior on different images on different clouds	19:14
clarkb	pabelanger: reading the comments in the .pp the supercede nameserver stuff isn't strictly necessary but the other bits I think are	19:15
*** rdx_matt has quit IRC		19:15
pabelanger	clarkb: okay, let me also update ubuntu dhclient	19:16
clarkb	pabelanger: its easy to check by logging into a host on osic, I can do that real quick	19:16
clarkb	yup domain and search are set to openstacklocal on osic	19:17
clarkb	this is the trusty image	19:17
*** tonytan4ever has joined #openstack-infra		19:17
*** rbuzatu has quit IRC		19:17
pabelanger	clarkb: oddly we request domain-name and domain-search in ubuntu. Adding supersede will cause dhclient to ignore them	19:17
fungi	also you could test it by updating the dhclient.conf and releasing/renewing your lease on that machine	19:18
fungi	pabelanger: clarkb: agreed, we should avoid requesting them entirely	19:18
fungi	we really only want ip address and default route	19:18
clarkb	ya we shouldn't request them but we likely need to supercede it if cloud provides it anyways.	19:18
fungi	everything else is unnecessary	19:18
*** fifieldt has joined #openstack-infra		19:18
pabelanger	fungi: clarkb: okay, I'd clean that up in a follow patch	19:19
fungi	righth, superseding them is fine, but not requesting them is also preferred as well	19:19
openstackgerrit	Paul Belanger proposed openstack-infra/puppet-unbound: Update dhclient.conf to ignore domain and search https://review.openstack.org/347970	19:19
fungi	is it also providing search, or just domain-search?	19:20
pabelanger	fungi: EmilienM is reporting both domain and search in some cases	19:20
clarkb	fungi: I think 'domain-search' is what /etc/resolv.conf calls search	19:20
*** IlyaG has joined #openstack-infra		19:20
clarkb	and domain-name is domain	19:20
fungi	we likely want to supersede hostname as well but maybe we only do that when we run into a provider that is feeding us one	19:21
*** coolsvap has quit IRC		19:21
clarkb	I worry about superseding hostname as I don't know if glean will touch hostname when dhcp is in use	19:21
pabelanger	I'm starting to think think dhclient.conf needs to be updated so all our images are in sync	19:21
clarkb	I would have to go read gleans handling of the dhcp case and if it does anything with teh config drive there	19:22
*** ddieterly is now known as ddieterly[away]		19:22
fungi	it would be awesome if glean configured dhclient	19:23
fungi	assuming we can't or don't want to trust dhcp provided values for the hostname anyway	19:24
*** rbuzatu has joined #openstack-infra		19:24
fungi	and domain/search et cetera	19:24
fungi	only private clouds get that right	19:24
fungi	public clouds shouldn't try to set it for you	19:24
pabelanger	we've only see it on ovh and osic right now, for centos-7	19:25
*** shashank_hegde has joined #openstack-infra		19:25
*** sdake has joined #openstack-infra		19:25
pabelanger	fungi: let me know what you think of lines 1-8 in https://review.openstack.org/#/c/347970/2/files/dhclient.conf.debian and I'll make sure redhat and debian files are both in sync for next patchset	19:26
*** jcoufal_ has quit IRC		19:26
timrc	phschwartz: "Create method, "do_magical_things""......... ........ ;-)	19:26
fungi	clarkb: and confirmed, dhcp-options(5) only lists a domain-search option, there is not also a "search" option separate from it	19:26
fungi	i was misremembering	19:26
*** rbuzatu has quit IRC		19:27
*** jsavak has joined #openstack-infra		19:27
mtreinish	fungi: oh, that's a good catch	19:27
*** rbuzatu has joined #openstack-infra		19:27
clarkb	oh neat alpine has a VM iso thats 36MB	19:27
clarkb	and then the "standard" image is 93MB. Also both are smaller if you 32bit	19:28
*** kzaitsev_mb has joined #openstack-infra		19:28
clarkb	24MB and 75MB which may not be useful in the ironic case not sure if they need processes to address more than 4GB of memory for anything	19:28
devananda	clarkb: for production use, yes, we do. in the infra gate, maybe not	19:29
devananda	clarkb: without touching the ramdisk, I think we can reduce the jjb count by about 60 jobs	19:29
devananda	if we can consolidate our test matrix by exercising multiple drivers and multiple deploy methods in a single job run	19:31
clarkb	devananda: fwiw the major reason I am looking at alpine was the security issue that fungi pointed out with tinycore. I think functionally they will end up being pretty similar otherwise	19:31
devananda	clarkb: ah, I see. that sounds useful in and of itself :)	19:31
*** PollyZ has quit IRC		19:32
clarkb	devananda: alpine tldr is signed packages. built with busybox and mlibc	19:32
*** jsavak has quit IRC		19:32
fungi	yeah, tinycore seems to be relatively laissez-faire about the security of their package management chain	19:32
clarkb	tinycore appears to also do similar things but doesn't have the security bits	19:32
fungi	with the assertion that securing their package management will make their images too large or something	19:33
fungi	(because they'd need to include ssl and or pgp libraries)	19:33
clarkb	ya alpine does appear to be a little bigger and i bet some of that is in the verification process	19:33
mtreinish	fungi: do you know of a quick example off the top of your head for setting up x509 certs in puppet? The next step I can think of for puppet-mosquitto is enabling tls encrypted ports (assuming that's something we actually want to bother with, it probably isn't worth the effort)	19:33
pabelanger	fungi: do we want to also set these values up for redhat?	19:34
fungi	mtreinish: i overhauled a lot of it in our modules. let me see if i can find a flexible one	19:34
fungi	pabelanger: i'm betting we could just drop the request statement entirely... but either way if we're already tweaking dhclient.conf on some platforms we should probably try to just make them all identical if that works	19:35
*** kzaitsev_mb has quit IRC		19:36
openstackgerrit	Paul Belanger proposed openstack-infra/puppet-unbound: Update dhclient.conf to be in sync across all OSes https://review.openstack.org/347970	19:37
pabelanger	fungi: clarkb: ^ okay, sync'd the files based on fungi's comments	19:37
fungi	mtreinish: see http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/static.pp#n62 and http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/static-https-redirect.vhost.erb	19:38
*** bhunter71 has quit IRC		19:38
mtreinish	fungi: ok cool, thanks	19:39
fungi	mtreinish: example there is assuming you might also want to do websockets over https through apache	19:39
*** mctaylor has joined #openstack-infra		19:39
*** roxanaghe has quit IRC		19:39
clarkb	the alpine virt 32bit install uses about 40MB of disk and 17MB of ram. I haven't installed any packages or anything fun like that but it appears to be pretty small	19:40
fungi	mtreinish: the puppet manifest is an example of flexible fallback logic for relying on the local snakeoil or being able to manually supply certs/keys and chain as existing files or with the content in variables (e.g., fed from hiera when instantiating teh class)	19:40
clarkb	so ya if you find you need better security that may be a viable alternative	19:40
mtreinish	fungi: I wasn't actually planning on doing that. I mean I can, but I was assuming just set the cert file opts in the mosquitto.conf for a websocket port	19:40
* jroll sees a super successful nerd-snipe		19:40
clarkb	oh didn't add in /boot. its closer to 50MB of disks	19:40
mtreinish	and probably on an mqtt port too	19:41
*** asettle has joined #openstack-infra		19:41
*** gordc has quit IRC		19:41
fungi	mtreinish: in that case feel free to ignore the apache-specific parts	19:41
fungi	clarkb: wonder if it can work from a read-only compressed image with a ramdisk overlay? ;)	19:42
*** sdake has quit IRC		19:43
phschwartz	timrc: yeah, I was shocked that name made it in when I was looking at the code.	19:43
clarkb	I also know that dtroyer has used openwrt for this sort of thing in the past	19:43
clarkb	this is how openwrt ended up in the nova git history	19:43
clarkb	jroll: ^	19:43
jroll	oh god	19:43
jroll	lol	19:44
clarkb	there is an 8MB openwrt image in nova :)	19:44
jroll	clarkb: that makes me super curious to play with an openwrt deploy ramdisk	19:44
mordred	jroll: it's likely it would have good networking :)	19:44
jroll	I would hope so :D	19:45
jkilpatr	taking 'virtual routers' very literally.	19:45
clarkb	openwrt verifies signatures on packages too fwiw	19:45
clarkb	with its opkg manager	19:46
fungi	jkilpatr: openwrt is virtually a router, yes!	19:46
*** ddieterly[away] is now known as ddieterly		19:47
bkero	openwrt++	19:47
fungi	though it's certainly no netbsd	19:47
bkero	opkg is pretty nice	19:47
bkero	additionally the menuconfig interface they stole from the kernel is a good system	19:47
bkero	super composable	19:47
fungi	yep, the make menuconfig interface is remarkably convenient and lightweight	19:47
*** kzaitsev_mb has joined #openstack-infra		19:47
bkero	the resulting binaries can be pretty small too. Usable kernel + filesystems have gotten down to around 2.2mb.	19:48
bkero	and that has to support more hardware than virtio	19:48
clarkb	bkero: yup thats why dtroyer was using it iirc. didn't need routing just wanted small images	19:48
bkero	You might want to look at Yocto as well. I'm pretty sure you're familiar with it, clarkb :)	19:48
bkero	Can generate openwrt images from yocto	19:49
clarkb	huh I hadn't run into that. My familiarity with alpine is its the image they shipped with a really old beagleboard iirc	19:49
openstackgerrit	Merged openstack-infra/germqtt: Fix all things tox https://review.openstack.org/347623	19:50
clarkb	so I have an alpine floating around on a 2GB sd card that I used once upon a time	19:50
openstackgerrit	Merged openstack-infra/germqtt: Add missing .gitreview file https://review.openstack.org/347616	19:50
bkero	clarkb: Yocto is intel's image generation thing from their meego/maemo/tizen/whatever days. It's generic though, and uses openwrt as the default target.	19:50
mordred	bkero: yah. I don't think we want another image generation tool	19:51
bkero	agreed	19:51
bkero	mordred: can always use it as a DIB base element though.	19:51
bkero	If you're grumpy about using a questionable tarball	19:52
mordred	I'm grumpy about everything	19:52
anteaya	mordred: it is part of your charm	19:52
*** sdake has joined #openstack-infra		19:53
bkero	if only we were building grump as a service	19:53
clarkb	(and now docker uses alpine so its hip and cool)	19:53
*** jsavak has joined #openstack-infra		19:54
*** javeriak_ has quit IRC		19:55
* clarkb is sad that lgostash is still sadness		19:55
clarkb	elasticsearch claims to be happy	19:56
anteaya	:(	19:56
clarkb	and I bounced the unhappy worker/indexer daemons	19:56
openstackgerrit	Ivan Udovichenko proposed openstack-infra/project-config: Add automatic backports https://review.openstack.org/346095	19:56
mtreinish	clarkb: yeah, it's still sawtoothing	19:56
*** afred312 has joined #openstack-infra		19:56
*** rbuzatu has quit IRC		19:57
anteaya	mtreinish: nice, I was going to go with erratic	19:57
anteaya	sawtooth I think is more descriptive here	19:57
*** florianf has quit IRC		19:57
fungi	at least it's not triangle, square or shudder pulse train	19:57
mtreinish	anteaya: https://en.wikipedia.org/wiki/Sawtooth_wave	19:58
*** hasharAway is now known as hashar		19:59
clarkb	when I try to stop the logstash pid it refuses to go away without kill -9 so I think whatever is unhappy is in there somewhere	19:59
* fungi hopes he's not getting moog geeks too excited		19:59
*** jsavak has quit IRC		19:59
*** kzaitsev_mb has quit IRC		19:59
*** jsavak has joined #openstack-infra		19:59
* mtreinish flashbacks to taking tracings of waveforms on the old scopes in college		20:00
fungi	indeed	20:00
fungi	after trying to focus them to a standing wave	20:00
pabelanger	EmilienM: any objections moving gate-{name}-puppet-syntax to ubuntu-xenial?	20:01
pabelanger	EmilienM: since -puppet-lint is already running on xenial	20:01
EmilienM	pabelanger: from centos7?	20:01
anteaya	mtreinish: thank you	20:01
EmilienM	yeah if you want	20:01
anteaya	the things I'm learning	20:02
pabelanger	EmilienM: ubuntu-trusty	20:02
anteaya	fungi: I found out about moog, very interesting	20:02
anteaya	jim told me about them	20:02
EmilienM	pabelanger: oh really	20:02
bkero	EmilienM: it's upgrade-tests-to-xenial season	20:02
EmilienM	pabelanger: move them all	20:02
pabelanger	EmilienM: ya, this is the last one	20:02
EmilienM	bkero: yeah, we already gate on xenial jobs for functional tests	20:02
*** PollyZ has joined #openstack-infra		20:02
EmilienM	so no objection.	20:02
clarkb	pabelanger: none from me	20:03
pabelanger	clarkb: thanks	20:03
openstackgerrit	Paul Belanger proposed openstack-infra/project-config: Move gate-{name}-puppet-syntax to ubuntu-xenial https://review.openstack.org/348016	20:03
clarkb	pabelanger: I think the only puppet jobs on our side that we need to worry about underlying distro are the noop and beaker rspec apply ones	20:03
pabelanger	clarkb: are you using a topic for xenial changes for JJB?	20:03
*** rbuzatu has joined #openstack-infra		20:03
pabelanger	clarkb: Ya, I haven't looked at our infra jobs yet	20:03
clarkb	pabelanger: yup 'newton-xenial'	20:03
clarkb	ok on logstash-worker01 I stopped all the logstash daemons	20:04
clarkb	started the logstash indexer first, let it get running and start to listen on tcp 9999. then started the workers and they seem happy. I am going to do the others this way and see if it lasts	20:04
*** nwkarsten has quit IRC		20:05
clarkb	something appears to make the logstash indexer very unhappy	20:05
*** yamamoto has joined #openstack-infra		20:06
bkero	pabelanger: there's also an etherpad with a list of jobs that need to be ported.	20:07
pabelanger	bkero: oh, where is that?	20:07
clarkb	https://etherpad.openstack.org/p/xenial-newton-tasks	20:07
bkero	pabelanger: http://etherpad.openstack.org/p/xenial-newton-tasks	20:07
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-mosquitto: Add support for configuring tls ports https://review.openstack.org/348019	20:08
*** rbuzatu has quit IRC		20:08
mtreinish	fungi: ^^^ first 1/2 of that, now to do the system-config side actually making the cert files	20:08
fungi	mtreinish: so the openstack-infra/puppet-openstackid repo on git04.o.o has no master branch for some reason. i've automated a search across all our repos on all our git servers and it really is just this one repo on this one server	20:08
*** nwkarsten has joined #openstack-infra		20:08
*** nwkarsten has quit IRC		20:08
fungi	corvus: ^ (zuul-cloner issue from earlier)	20:08
*** nwkarsten has joined #openstack-infra		20:09
*** Apoorva has quit IRC		20:09
*** roxanaghe has joined #openstack-infra		20:09
pabelanger	fungi: I think we are seeing the same error in DIBs: http://nodepool.openstack.org/dib.ubuntu-xenial.log	20:11
*** mctaylor has quit IRC		20:11
pabelanger	openstack-infra/log_processor.git	20:11
clarkb	JayF: jroll devananda another thing to maybe look at is instead of having a bunch of jobs per project consolidate into a shared job for each class of job for ironic, client, ipa, and inspector	20:11
*** rdx_matt has joined #openstack-infra		20:12
pabelanger	2016-07-26 17:19:53,799 INFO nodepool.image.build.ubuntu-xenial: warning: remote HEAD refers to nonexistent ref, unable to checkout.	20:12
fungi	i'm going to move it to my homedir for post-mortem review and then rerun create-cgitrepos	20:12
*** rdx_matt has quit IRC		20:12
clarkb	fungi: are we using zuul cloner with create-cgitrepos?	20:12
*** rdx_matt has joined #openstack-infra		20:12
fungi	clarkb: doubtful. why would we?	20:13
clarkb	fungi: you metnioend zuul-cloner issue	20:13
clarkb	and pointed at the git mirror problem.	20:13
fungi	clarkb: some of our apply jobs showed zuul-cloner complaining about git remote prune origin failing on that repo	20:14
*** Teresita-Warrior has joined #openstack-infra		20:14
clarkb	oh gotcha its the job side z-c complaining	20:14
fungi	tracked down to corruption on one git mirror backend	20:14
fungi	for just one repo	20:14
*** akshai has quit IRC		20:15
*** bhavik has quit IRC		20:15
clarkb	we didn't try removing the master branch on that repo did we?	20:15
clarkb	via gerrit	20:15
fungi	if we did, no idea why it would only affect git04 and not the others	20:16
clarkb	well removing HEAD is always weird but yes I agree that should've affected all of them	20:16
*** ihrachys has joined #openstack-infra		20:17
*** EricGonczer_ has quit IRC		20:17
openstackgerrit	Merged openstack-infra/project-config: Add test-results publisher to infra projects https://review.openstack.org/347878	20:18
*** EricGonczer_ has joined #openstack-infra		20:20
*** Na3iL has quit IRC		20:20
*** ericksonsantos has joined #openstack-infra		20:20
fungi	okay, after running `env PATH=/bin:/usr/bin:/usr/local/bin SCRATCH_SUBPATH=zuul SCRATCH_OWNER=zuul SCRATCH_GROUP=zuul create-cgitrepos` as root on git04.0.0 and then `ssh -p 29418 review.openstack.org replication start openstack-infra/puppet-openstackid` i'm now seeing a master branch in that repo again	20:20
pabelanger	first time in a while I've see 520+ nodes online in nodepool	20:21
pabelanger	we usually hover around 480 or so	20:21
openstackgerrit	Merged openstack-infra/project-config: Add test-results publisher to python-jobs https://review.openstack.org/347879	20:21
*** EricGonczer_ has quit IRC		20:24
*** mctaylor has joined #openstack-infra		20:25
corvus	fungi: wow. weird.	20:25
*** mminesh has quit IRC		20:27
openstackgerrit	Morgan Fainberg proposed openstack-infra/nodepool: Add alembic migration support https://review.openstack.org/136589	20:28
pabelanger	clarkb: I'm also hoping the puppet-unbound patch will fix: connection timed out; no servers could be reached we sometimes see in ovh when running the ready-script	20:28
cinerama	greghaynes: could you please approve https://review.openstack.org/#/c/337918/ (if appropriate)? just noticed it's still hanging about with 2 +2	20:29
clarkb	pabelanger: by preventing it from doing bad dns lookups?	20:30
*** mminesh has joined #openstack-infra		20:30
pabelanger	clarkb: ya, I think when it fails, its appending domain / search to the host	20:30
*** tphummel has quit IRC		20:32
*** PollyZ has quit IRC		20:33
ianw	pabelanger: hmm, it's as i feared that the new bandersnatch hasn't quite fixed things. i'll check out mirror-update.o.o and see what's going on today	20:33
*** markusry has quit IRC		20:33
*** adrian_otto has joined #openstack-infra		20:33
clarkb	oh neat looking at ES logs it apepars that when things got unhappy yesterday it had run out of memory in ES	20:34
pabelanger	ianw: ya, we had issues with oslo.config specifically. ubuntu-precise was still using oslo-config	20:34
clarkb	still don't know why restarting the processes hasn't made them hapyp again but at least that is a likely cause of the issues	20:34
*** tphummel has joined #openstack-infra		20:34
ianw	cinerama: sorry, that probably should have made it into the bugfix	20:37
*** nwkarsten has quit IRC		20:37
openstackgerrit	Tony Breeds proposed openstack-infra/release-tools: Update the UPPER_CONSTRAINTS_FILE url to include the new branch https://review.openstack.org/348027	20:38
*** nwkarsten has joined #openstack-infra		20:38
*** yamamoto has quit IRC		20:39
cinerama	thanks ianw	20:39
ianw	pabelanger: i've missed scrollback ... did you kick off a f24 build with the new dib?	20:40
openstackgerrit	Matthew Treinish proposed openstack-infra/system-config: WIP: Add tls support to firehose https://review.openstack.org/348030	20:40
pabelanger	ianw: dibs failed today	20:40
ianw	pabelanger: ohhh, didn't check the date in nodechecker :)	20:40
pabelanger	ianw: I was going to do some rebuilds today once we landed 347970	20:40
ianw	hmmm, this log looks coorect http://nodepool.openstack.org/dib.fedora-24.log.2016-07-27_04	20:41
*** roxanaghe has quit IRC		20:41
ianw	correct even	20:41
mtreinish	fungi: ^^^ I always get the different files confused, that literally just copy and pasted what you shared before and tried to pass the right paths to puppet-mosquitto	20:41
mtreinish	but it's all wrong, I didn't even try to run it	20:42
*** nwkarsten has quit IRC		20:42
clarkb	looking at elasticsaerch head and bigdesk ES itself seems happy	20:42
mtreinish	I'm gonna hold off on the tls stuff until we get everything running anyway. It's not really needed	20:42
clarkb	so I think that when it was unhappy ti must have pushed the unhappyness upstream	20:42
clarkb	and upsteram didn't recover as gracefully as ES itself	20:43
pabelanger	ianw: Hmm, ya. They should have been uploaded	20:43
*** nwkarsten has joined #openstack-infra		20:44
*** EricGonczer_ has joined #openstack-infra		20:44
pabelanger	ianw: okay, manually uploading fedora-24 now	20:45
*** Apoorva has joined #openstack-infra		20:45
clarkb	pabelanger: did all the uplaods fail? or maybe we restarted the service and cut those uploads off	20:45
pabelanger	clarkb: ya, did nodepool get restarted?	20:45
fungi	mtreinish: yeah, it can stay wip for now. focus on bare minimums is a good place to start i agree	20:45
*** adrian_otto has quit IRC		20:45
clarkb	pabelanger: it did on monday iirc	20:45
ianw	i think it must have, because it wasn't using fedora-24.log when i was looking yesterday afternoon	20:46
pabelanger	ya, I restarted nodepool-builder last night	20:46
ianw	i.e. builder hadn't reread the config file	20:46
*** rdx_matt has quit IRC		20:46
pabelanger	but that was way before builds started	20:46
*** sdake has quit IRC		20:46
pabelanger	I'll check nodepool logs for today	20:46
*** adrian_otto has joined #openstack-infra		20:46
*** inc0 has joined #openstack-infra		20:47
ianw	pabelanger: did you unhold the nodes from yesterday?	20:48
Krenair	pleia2, I think I broke my VM I was trying to set up for the wiki	20:48
pabelanger	ianw: not yet	20:48
Krenair	might try again next week	20:48
pabelanger	ianw: you can do that now if you want	20:48
ianw	pabelanger: yeah, i can clean that up	20:48
*** nwkarsten has quit IRC		20:49
pabelanger	fungi: clarkb: mind revisiting puppet-unbound again? https://review.openstack.org/#/c/347970/	20:49
openstackgerrit	Thiago Paiva Brito proposed openstack-infra/puppet-openstackci: Pinning JJB and Zuul for 3rd party CI https://review.openstack.org/348035	20:50
*** EricGonczer_ has quit IRC		20:50
jroll	clarkb: are you interested in xenial coverage jobs failing in our check queue? http://logs.openstack.org/80/345080/4/check/python-ironicclient-coverage-ubuntu-xenial/2f1fd72/console.html	20:51
jroll	seems like coverage just decided not to work	20:51
*** EricGonczer_ has joined #openstack-infra		20:51
pleia2	Krenair: sorry to hear!	20:51
pleia2	Krenair: good luck next week, let us know if we can help	20:51
*** PollyZ has joined #openstack-infra		20:52
fungi	mtreinish: it's possible that on xenial /etc/ssl/certs/ssl-cert-snakeoil.pem and /etc/ssl/private/ssl-cert-snakeoil.key don't exist by default (needs ssl-cert package installed, and may need `make-ssl-cert generate-default-snakeoil` run if its post-install scripts don't do that for you)	20:52
clarkb	jroll: neat, seems to be unhappy about the no data to report status	20:52
jroll	clarkb: yeah, odd there's no data	20:52
mtreinish	fungi: that very well might be the case. I haven't even tried to run that patch yet, so I hadn't even gotten that far	20:53
clarkb	jroll: I can try to reproduce locally in a sec	20:53
fungi	mtreinish: oh, i may have misunderstood what you meant by "it's all wrong"	20:54
jroll	clarkb: okay, I pushed an updated patch so it should run again as well - fwiw, I've seen stuff landing today so maybe not a constant problem?	20:54
pabelanger	Got to love osic-cloud1, images uploads are so fast!	20:54
*** ayoung has joined #openstack-infra		20:55
clarkb	jroll: oh if its passed earlier today that is extra interesting. Suggests it may not be a xenial problem?	20:55
pabelanger	8mins	20:55
*** thorst has quit IRC		20:55
clarkb	pabelanger: qcow2 + relatively local networking	20:55
jroll	clarkb: yeah, let me verify that	20:55
*** asettle has quit IRC		20:55
pabelanger	clarkb: ya	20:55
*** bhunter71 has joined #openstack-infra		20:55
mtreinish	fungi: I was referring to the chunk at L130: https://review.openstack.org/#/c/348030/1/modules/openstack_project/manifests/firehose.pp	20:56
*** moravec has quit IRC		20:56
*** inc0 has quit IRC		20:56
mtreinish	but it's not important, we can revisit it after the other ~10 patches to get things running are landed :)	20:56
jroll	clarkb: oh, it's only in our client, seems to be always failing. ironic itself is fine	20:57
fungi	mtreinish: oh, right presumably this should perhaps go into the mosquitto module instead of system-config anyway	20:57
fungi	mtreinish: the example i gave you was in system-config because that particular class was very environment-specific and so never got split out into its own module	20:57
clarkb	jroll: gotcha, ironic's coverage job is also voting?	20:58
jroll	clarkb: yeah	20:58
clarkb	I can replicate locally with a single cpu so its not related to the multiple.runners at least	20:58
jroll	example: https://review.openstack.org/#/c/286192/	20:58
mtreinish	fungi: sure, I wasn't 100% on how I split things either. But, it seemed easier to just pass the file path to the mosquitto module and let something else handle the actual cert creation	20:58
fungi	mtreinish: but for the openstack_project::firehose class we would probably just carry the file/content classvars through to mosquitto::server or something and put all the file handling logic in there instead	20:58
clarkb	and if I inspect the html its got stuff and percentages that are non zero	20:59
mtreinish	fungi: ok, I'll leave myself a note about that, and when I get back to the patches I can do it that way	20:59
fungi	mtreinish: for most classes in openstack_project we really just want them to be very lightweight wrappers around other puppet modules, only including very bits very specific to our particular server environment	21:00
fungi	s/very/bits/bits/	21:00
fungi	meh	21:00
* fungi gives up on typing		21:00
mtreinish	fungi: right, I had assumed there was just a give me the certs module I could call :)	21:00
*** roxanaghe has joined #openstack-infra		21:00
mtreinish	but despite having written a lot of puppet, I still am not very good at using it	21:01
fungi	mtreinish: we've discussed splitting that logic out into its own module too, yes	21:02
ianw	pabelanger / jeblair : http://paste.openstack.org/show/542695/ <- the "No JSON object could be decoded" is not I presume somewhat synchronous with the output above ... i.e. the last "rm" command hasn't triggered this error, has it?	21:02
fungi	right now it's been copied around between modules	21:02
clarkb	jroll: the coverage combine step is what tramples the .coverage file	21:03
clarkb	jroll: I wonder if that is not necessary because pbr	21:03
clarkb	jroll: ya ironic's cover target is different	21:03
clarkb	jroll: let me test a fix	21:04
*** rbuzatu has joined #openstack-infra		21:04
jroll	clarkb: huh, ok thanks	21:04
*** nwkarsten has joined #openstack-infra		21:05
*** nwkarsten has quit IRC		21:05
*** nwkarsten has joined #openstack-infra		21:06
openstackgerrit	Paul Belanger proposed openstack-infra/project-config: Add debian-openstack source.list to debian https://review.openstack.org/341856	21:07
*** HeOS has joined #openstack-infra		21:08
*** clenimar has quit IRC		21:08
pabelanger	ianw: right, that is getting returned from the async_wrapper code in ansible	21:09
*** psilvad has quit IRC		21:09
*** raildo has quit IRC		21:09
*** rbuzatu has quit IRC		21:09
ianw	pabelanger: i think ,at the very least, if ansible said "no json object detected" and then said "but i did detect ..." it would go a long way in helping debug such a thing	21:10
pabelanger	ianw: if I remember right, ansible 2.2.0.0 changes this code path because of this error. I'd have to find the PR in github.com that does it	21:11
pabelanger	So, I didn't spend too much time debugging it in ansible, as the code is already different in their master branch	21:11
*** roxanaghe has quit IRC		21:12
ianw	pabelanger: ahh, good to know. i might try it on master and see if it gives something more useful	21:12
pabelanger	ianw: Ya, that would be a good test	21:12
clarkb	jroll: https://review.openstack.org/348043 seems to do the right thing for me locally on xenial	21:12
pabelanger	okay, stepping away for some food. If I could get some +2 on https://review.openstack.org/#/c/347970/ I'd like to rebuild centos-7 tonight and give the patch a run on OVH and OSIC	21:13
*** moravec has joined #openstack-infra		21:13
jroll	clarkb: thanks so much :)	21:14
clarkb	I think it was mordred's PR that changed the handling of the async wrapper stuff too	21:14
openstackgerrit	Merged openstack-infra/nodepool: Add diskimage-builder from git to dsvm job https://review.openstack.org/345814	21:15
*** roxanaghe has joined #openstack-infra		21:15
*** rbuzatu has joined #openstack-infra		21:15
mordred	clarkb: what did I do?	21:15
*** ldnunes has quit IRC		21:16
clarkb	mordred: hacked on ansible asnyc wrapper things	21:16
*** moravec has quit IRC		21:17
*** jamielennox\|away is now known as jamielennox		21:17
clarkb	since it was failign to parse the json	21:17
mordred	oh yah. yay!	21:17
mordred	that was fun	21:17
clarkb	or was it yaml?	21:17
mordred	json	21:17
*** matt-borland has quit IRC		21:18
openstackgerrit	Merged openstack/diskimage-builder: Fix proliant-tools dependencies https://review.openstack.org/337918	21:19
*** rbuzatu has quit IRC		21:20
thiagop	Can I ask for approval on this-> https://review.openstack.org/#/c/334400/	21:21
mordred	clarkb: did it break?	21:21
thiagop	It's a workaround for the bug where jenkins isn't receiving parameters on builds	21:22
thiagop	Would help very much	21:22
ianw	pabelanger: well there you go, same thing "just works" with git master.	21:23
ianw	it was silly that we didn't have en_* locales on the host, so we'll just call it mystery solved on that one and move on	21:24
*** jkilpatr has quit IRC		21:24
clarkb	mordred: I am not sure, pabelanger was talking about how thigns had changed in master and was just pointing out mordred changed them	21:25
*** david-lyle has quit IRC		21:25
clarkb	mordred: I think he was suggesting we don't worry too much about it because your fixes should fix it?	21:25
openstackgerrit	Thiago Paiva Brito proposed openstack-infra/puppet-openstackci: Pinning JJB and Zuul for 3rd party CI https://review.openstack.org/348035	21:26
clarkb	#status log more carefully restarted logstash daemons again. Bigdesk reports significantly higher data transport rates indicating maybe it is happy now.	21:26
openstackstatus	clarkb: finished logging	21:26
*** rbuzatu has joined #openstack-infra		21:27
*** dizquierdo has joined #openstack-infra		21:27
*** pvaneck has joined #openstack-infra		21:27
*** kushal has quit IRC		21:28
*** kgiusti has left #openstack-infra		21:30
mordred	clarkb: well, that fix should be in the ansible we're using in the gate	21:31
*** rbuzatu has quit IRC		21:31
pabelanger	ianw: mordred: clarkb: https://github.com/ansible/ansible/pull/16534 changes the code path, I think anything after that could be the fix.	21:33
pabelanger	ianw: mordred: clarkb: the good news, that patch is in the stable-2.1 branch. We should check when 2.1.1.0 is landing	21:36
pabelanger	or use stable-2.1 branch	21:36
mordred	I can ask - sitting in the room now	21:36
pabelanger	neat	21:36
*** rbuzatu has joined #openstack-infra		21:38
*** yamamoto has joined #openstack-infra		21:39
ianw	well that explains it "This eliminates problems with non-JSON data before module output causing async tasks to fail, when a non-async version of the task would succeed."	21:40
ianw	i.e. screaming at you "I HAVE NO LOCALES"	21:40
*** EricGonczer_ has quit IRC		21:40
*** rbuzatu has quit IRC		21:42
*** rdx_matt has joined #openstack-infra		21:42
*** rdx_matt has quit IRC		21:43
*** rdx_matt has joined #openstack-infra		21:43
*** yamamoto has quit IRC		21:45
mriedem	AJaeger: tox -e venv should support constraints now right? https://github.com/openstack/glance/blob/master/tox.ini#L57	21:46
*** tphummel has quit IRC		21:48
*** rbuzatu has joined #openstack-infra		21:49
ianw	cinerama: do you need a point release for 337918 ?	21:49
*** hashar has quit IRC		21:50
openstackgerrit	Michael Krotscheck proposed openstack-infra/project-config: Added documentation draft jobs for nodejs-based projects https://review.openstack.org/346130	21:50
openstackgerrit	Michael Krotscheck proposed openstack-infra/project-config: Added documentation publish jobs for the JavaScript SDK https://review.openstack.org/346131	21:50
openstackgerrit	Michael Krotscheck proposed openstack-infra/project-config: Created DSVM Job for NPM Projects https://review.openstack.org/348056	21:50
*** rfolco has quit IRC		21:50
*** tonytan4ever has quit IRC		21:51
krotscheck	I don't suppose an expert in devstack gate can look over https://review.openstack.org/#/c/348056/1/jenkins/jobs/macros.yaml for me and tell me that I'm not crazy?	21:52
*** rbuzatu has quit IRC		21:53
*** nwkarsten has quit IRC		21:54
*** esberglu has quit IRC		21:55
openstackgerrit	Michael Krotscheck proposed openstack-infra/project-config: Created DSVM Job for NPM Projects https://review.openstack.org/348056	21:55
ianw	krotscheck: crazy how?	21:55
krotscheck	ianw: .... well, ok, no more crazy than normal.	21:56
*** tphummel has joined #openstack-infra		21:56
krotscheck	ianw: Really it's a question of whether I'm doing too much in that macro, what with cd $WORKSPACE and/or others.	21:56
* krotscheck doesn't _quite_ understand how to get a devstack VM running so couldn't end-to-end test		21:57
*** shashank_hegde has quit IRC		21:59
ianw	krotscheck: things like "npm configure-devstack \|\| true" sort of put up my "defensive programming" flag ... how do you tell the difference between it missing and actually failing for some reason	22:00
*** rbuzatu has joined #openstack-infra		22:00
pabelanger	ianw: telnet://104.130.204.14:19885	22:00
pabelanger	ianw: should be the latest fedora-24 dib	22:00
pabelanger	or maybe not	22:01
ianw	pabelanger: yeah, looks unhappy	22:01
*** ddieterly is now known as ddieterly[away]		22:01
mgagne	So I found some people complaining about the mirror at internap: http://logs.openstack.org/61/325361/7/gate/gate-nova-python27-db-ubuntu-xenial/8121e0a/console.html	22:01
ianw	pabelanger: yeah, it's not, glibc-langpack-en not installed there	22:01
mgagne	We have monitoring in place to detect downtime and so far, none was detected and I'm having a hard time understanding what's failing. According to logs, mirror stops to accept connection (refuse them) in the middle of downloading debian packages.	22:02
*** mdrabe has quit IRC		22:03
*** rbuzatu has quit IRC		22:04
pabelanger	mgagne: I wonder if apache might have restarted during that time	22:05
pabelanger	mgagne: I can check the logs	22:05
mgagne	pabelanger: I just happen to have the impression it's only happening at internap. it's a problem I've been aware about for several months but never found an explanation.	22:06
*** adrian_otto1 has joined #openstack-infra		22:06
*** mmandel has quit IRC		22:07
pabelanger	mgagne: http://paste.openstack.org/show/542713/	22:07
*** adrian_otto1 has quit IRC		22:07
pabelanger	timestamps match up	22:07
mgagne	ok, so it's just very bad luck	22:07
pabelanger	ya, we had to revert something in apache today	22:07
*** adrian_otto has quit IRC		22:07
*** tobiash has quit IRC		22:07
*** apetrich has joined #openstack-infra		22:07
pabelanger	so, likely bad timing in this case	22:07
mgagne	so I suspect all the previous occurrence were due to apache reload too	22:08
fungi	specifically apache configuration for our mirrors	22:08
pabelanger	mgagne: I would think so. Personally, I find internap our most stable cloud.	22:08
fungi	how long ago was "previous"?	22:08
mgagne	a long time ago? :D	22:08
fungi	indeed	22:08
*** tobiash has joined #openstack-infra		22:09
mgagne	I just happen to check once in a while irc logs and find people mentioning internap or I'm lucky and someone complains, I check logs and it's internap :D	22:09
pabelanger	mgagne: where was that?	22:09
fungi	seems like it's a selection bias on your part ;)	22:09
mgagne	fungi: surely is =)	22:09
mgagne	pabelanger: on #openstack-nova	22:09
*** shashank_hegde has joined #openstack-infra		22:10
mgagne	pabelanger: but it was a generic complain about how the world hates him so internap wasn't mentioned =)	22:10
*** rbuzatu has joined #openstack-infra		22:11
pabelanger	mgagne: ya, I see almost zero things wrong with internap. Just powers on during the day	22:11
*** IlyaG has quit IRC		22:11
pabelanger	ianw: telnet://23.253.205.160:19885	22:12
pabelanger	ianw: much better	22:12
*** mriedem has quit IRC		22:12
ianw	pabelanger: cool! let's see if devstack explodes now	22:12
pabelanger	:)	22:12
*** xyang1 has quit IRC		22:13
ianw	i don't think so though, f24 has been fairly minor compared to some previous efforts	22:13
*** salv-orlando has quit IRC		22:13
ianw	should we setup puppet to up /proc/sys/fs/inotify/max_user_instances in puppet-nodepool? i noticed tail -f complains	22:14
*** rbuzatu has quit IRC		22:15
mtreinish	pabelanger: any idea what's going on with this failure: http://logs.openstack.org/75/347575/4/check/gate-infra-puppet-apply-ubuntu-xenial/09fc93c/console.html#_2016-07-27_20_32_51_350610	22:16
fungi	at roughly the 24-hour mark, we have 166 out of 798 ballots cast on an infra mascot	22:16
mtreinish	pabelanger: I read that as it's not cloning the puppet-mosquitto module	22:16
*** rdx_matt has quit IRC		22:17
krotscheck	ianw: Yeah, I'm a bit questionable about that one myself. I suppose we can force the convention to say: "Hey, if you want to use devstack, you need to at least have an exit code 0 here.	22:17
*** salv-orlando has joined #openstack-infra		22:17
ianw	krotscheck: yeah, dummy functions are probably more robust	22:18
*** thiagop has quit IRC		22:19
*** jsavak has quit IRC		22:20
ianw	fungi: so ... many ... mascots	22:20
ianw	even the "favourite start wars character" poll it keeps directing me to had less :)	22:20
*** rbuzatu has joined #openstack-infra		22:22
*** kzaitsev_mb has joined #openstack-infra		22:22
*** david-lyle has joined #openstack-infra		22:22
*** salv-orlando has quit IRC		22:23
*** weshay has quit IRC		22:24
*** moravec has joined #openstack-infra		22:24
*** edmondsw has quit IRC		22:25
*** david-lyle has quit IRC		22:25
*** david-lyle has joined #openstack-infra		22:25
jhesketh	Morning	22:25
pleia2	morning jhesketh	22:25
pabelanger	mtreinish: Oh, we need to add puppet-mosquitto into modules.env in system-config	22:25
*** ddieterly[away] is now known as ddieterly		22:25
pabelanger	mtreinish: otherwise, we don't install it	22:25
mtreinish	oh, ok. I'll add that to the patch right now then	22:26
fungi	too bad thiagop disappeared before i could tell him i'm opposed to 334400	22:26
*** rbuzatu has quit IRC		22:27
fungi	i guess he'll see my -1 and review comments	22:27
corvus	fungi: i agree the approach in your comment is probably best	22:27
fungi	i mainly have an aversion to general recommendations of disabling some upstream's security measures	22:28
corvus	yup	22:28
openstackgerrit	Matthew Treinish proposed openstack-infra/system-config: Add firehose.o.o config to system-config https://review.openstack.org/347575	22:28
mtreinish	pabelanger: ^^^	22:28
openstackgerrit	Clark Boylan proposed openstack-infra/project-config: Remove unused dibtest jobs https://review.openstack.org/348067	22:29
clarkb	pabelanger: fungi anteaya ianw bkero ^ is more cleanup of unneeded job configs	22:29
pabelanger	mtreinish: ya, that should fix it	22:29
clarkb	oh I didn't set the topic /me fixes that	22:30
anteaya	clarkb: yay	22:31
openstackgerrit	Tony Breeds proposed openstack-infra/irc-meetings: Remove the check target https://review.openstack.org/347512	22:32
*** mctaylor has quit IRC		22:32
*** rbuzatu has joined #openstack-infra		22:33
*** timl0101 has quit IRC		22:33
*** ddieterly has quit IRC		22:34
*** gildub has joined #openstack-infra		22:34
pabelanger	puppet-unbound is green now: https://review.openstack.org/#/c/347970/ could use a few +2 to fix some DHCP issue in OVH and OSIC	22:36
*** rbuzatu has quit IRC		22:38
*** tpsilva has quit IRC		22:38
pleia2	pabelanger: nice, looks like all fungi's notes were addressed, lgtm	22:41
*** rbuzatu has joined #openstack-infra		22:43
fungi	pabelanger: oh ouch, you had to manually define option 121 huh?	22:43
bkero	clarkb: yay	22:43
bkero	pabelanger: you have the puppet xenial tests handled?	22:44
fungi	pabelanger: i wonder why that's in the ubuntu/debian dhclient.conf we were using if it's not an iana-standard option	22:44
anteaya	who is samuel cassiba?	22:44
pabelanger	fungi: I am unsure, that was already there.	22:44
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-mosquitto: Add websocket listner to mosquitto https://review.openstack.org/347924	22:44
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-mosquitto: Add basic permissions and security https://review.openstack.org/347923	22:44
*** IlyaG has joined #openstack-infra		22:44
clarkb	bkero: pabelanger I am trying to get the integrated get tempest/dsvm change written now	22:44
*** gouthamr has quit IRC		22:44
mtreinish	pabelanger: yep, that did the tick. Now it's catching typos in my open patches :)	22:44
*** rbuzatu_ has joined #openstack-infra		22:44
mtreinish	http://logs.openstack.org/75/347575/5/check/gate-infra-puppet-apply-ubuntu-xenial/a521c12/console.html#_2016-07-27_22_33_24_197326	22:44
*** jamielennox is now known as jamielennox\|away		22:45
pabelanger	bkero: https://review.openstack.org/#/q/status:open+topic:newton-xenial should have my patches	22:45
pabelanger	mtreinish: great	22:46
pabelanger	fungi: ya, this code is pretty old. Ready for a refresh for sure	22:46
*** asettle has joined #openstack-infra		22:46
bkero	pabelanger: awesome	22:46
*** rbuzatu has quit IRC		22:47
*** thorst_ has joined #openstack-infra		22:47
craige	o/	22:48
*** trown is now known as trown\|outtypewww		22:49
*** IlyaG has quit IRC		22:49
*** rbuzatu_ has quit IRC		22:49
*** david-lyle has quit IRC		22:50
*** david-lyle_ has joined #openstack-infra		22:50
*** asettle has quit IRC		22:51
mtreinish	craige: https://review.openstack.org/#/c/347923/ adds the missing security from yesterday :)	22:52
openstackgerrit	Ivan Udovichenko proposed openstack-infra/project-config: Add new projects https://review.openstack.org/347047	22:52
craige	\o/	22:53
*** aysyd has quit IRC		22:54
*** tobiash has quit IRC		22:54
clarkb	bkero: did you end up getting tox -ezuul to go faster?	22:54
clarkb	bkero: I am currently waiting on it and wondering if faster cpu was your solution or something else	22:54
bkero	clarkb: i got 4m30s on my desktop	22:55
openstackgerrit	Merged openstack-infra/puppet-unbound: Update dhclient.conf to be in sync across all OSes https://review.openstack.org/347970	22:55
*** tobiash has joined #openstack-infra		22:55
bkero	I have an overclocked Core i7 6700k running at 4.9GHz	22:55
*** thorst_ has quit IRC		22:55
bkero	Threading the process would be appreciated	22:56
*** rbuzatu has joined #openstack-infra		22:56
bkero	and I submitted the chef xenial patches passing tox -e zuul too btw	22:56
*** thorst_ has joined #openstack-infra		22:56
clarkb	cool will try to review all the patches taht are up as soon as I get this one for the integrated gate jobs sorted out	22:56
*** dizquierdo has quit IRC		22:56
*** Teresita-Warrior has quit IRC		22:57
bkero	I'll work on the docs jobs bext	22:58
bkero	next*	22:58
*** dimtruck is now known as zz_dimtruck		22:58
* bkero down at Oregon Brewer's Festival, trying to finish up before it becomes Oregon Bros Festival		22:58
*** rbrndt has quit IRC		22:58
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-germqtt: Add auth config to germqtt https://review.openstack.org/347977	22:59
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-germqtt: Clean up stray whitespace https://review.openstack.org/347892	22:59
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-germqtt: Ensure ssh keys are all setup https://review.openstack.org/347574	22:59
clarkb	bkero: they started on a wednesday?	22:59
bkero	They did	22:59
bkero	going through the weekend	23:00
*** PollyZ has quit IRC		23:00
bkero	New Holland brought what might be the best big beer I've ever had.	23:00
*** rbuzatu has quit IRC		23:00
bkero	https://untappd.com/b/new-holland-brewing-company-dragon-s-milk-reserve-mexican-spice-cake/1443626	23:00
*** david-lyle_ has quit IRC		23:01
*** kzaitsev_mb has quit IRC		23:02
*** rhallisey has quit IRC		23:02
prometheanfire	so, does someone mind reviwing this, it seems to be blocking more work (gentoo nodepool) https://review.openstack.org/#/c/307553/	23:02
clarkb	prometheanfire: that shouldn't be a blocker until we have images building	23:03
openstackgerrit	Ivan Udovichenko proposed openstack-infra/project-config: Add new projects https://review.openstack.org/347047	23:03
clarkb	prometheanfire: since that is a job runtime dep and not a build dep	23:03
clarkb	prometheanfire: are we tripping over the cahcing or something?	23:03
*** mriedem has joined #openstack-infra		23:03
clarkb	(I don't even know how that would work on gentoo, cache the source the build? something?)	23:03
prometheanfire	clarkb: it's blocking be building images, because it's pulling from git	23:04
openstackgerrit	Matthew Treinish proposed openstack-infra/puppet-mosquitto: Add websocket listner to mosquitto https://review.openstack.org/347924	23:04
prometheanfire	ya, emerge --fetchonly	23:04
fungi	clarkb: bkero: i've gone to the obf a couple times now and quite enjoyed myself	23:04
*** thorst_ has quit IRC		23:04
clarkb	gotcha so its failing to get the list to run emerge --fetchonly against?	23:04
clarkb	or maybe it is getting a list with invalid stuff in it	23:05
prometheanfire	clarkb: yep	23:05
prometheanfire	invalid	23:05
bkero	fungi: you should let me know nect time you come! I quite enjoy it.	23:05
bkero	Next*	23:05
prometheanfire	the bindep work has been done already, but it's pulling in the wrong bindep-fallback	23:05
openstackgerrit	Matthew Treinish proposed openstack-infra/system-config: Add firehose.o.o config to system-config https://review.openstack.org/347575	23:06
prometheanfire	I have the bindep-fallback fixed locally, but it's not being respected :\|	23:06
fungi	bkero: both times it was the end of oscon and i was on my way to pdx to fly home but had a late-departing flight and lots of time on my hands	23:06
*** rbuzatu has joined #openstack-infra		23:07
clarkb	prometheanfire: there is a dib flag you can set (let me find it because it will likely be handy for other stuff)	23:07
fungi	bkero: so stopped off at the park to kill time and spent a few hours wandering around in the sun drinking small portions of beer and unhealthy fried things	23:07
bkero	fungi: that sounds like the perfect scenario	23:07
prometheanfire	oh, that'd be nice	23:07
clarkb	prometheanfire: CONFIG_SOURCE is a url/path to your repo and CONFIG_REF the name of a tag/branch in that source that you want to use if you don't want project-config to be cloned from the git mirrors	23:08
fungi	bkero: yep, great way to start out a series of cross-country flights	23:08
bkero	alas oscon is not her3	23:08
bkero	here	23:08
clarkb	er sorry thats system-config	23:08
clarkb	maybe we don't have one for project-config	23:08
bkero	fungi: portland is still worth visiting for osbridge and other confs	23:08
clarkb	prometheanfire: so it won't help this particular case but if you edit things in system-config they may be useful	23:08
bkero	fungi: also the airport has 2 breweries to fill growlers and go home.	23:09
openstackgerrit	Clark Boylan proposed openstack-infra/project-config: Run integrated gate on xenial https://review.openstack.org/348078	23:09
clarkb	ok ^ thats the fun one	23:09
TheJulia	two in-airport breweries?!?	23:09
prometheanfire	clarkb: so what do I have to change?	23:09
clarkb	prometheanfire: if you export CONFIG_SOURCE and CONFIG_REF those specify wehere to get system-config for the image build	23:10
bkero	TheJulia: Yes. Rogue and Laurelwood. Would recommend.	23:10
prometheanfire	when working on system-config those will be nice though (since system-config includes puppet)	23:10
clarkb	prometheanfire: bindep fallback is in project-cofnig so not useful here (I am reviewing the hcange to get things moving)	23:10
prometheanfire	but since this is project-config...	23:10
* TheJulia ponders way to visit that area		23:10
prometheanfire	clarkb: thankyou	23:10
fungi	bkero: yep, i've enjoyed both brewpubs in pdx. though i can also just fill growlers at my local breweries when i get home if i want and not have o bring them on the plane ;)	23:11
clarkb	prometheanfire: I approved it, I didn't check all the gentoo packages (assuming you got those right) and doesn't look like anything has changed for debian,ubuntu,centos,fedora so should be fine	23:11
*** rbuzatu has quit IRC		23:11
fungi	bkero: but i definitely should plan to submit a talk to one of the conferences there. would be a good excuse to come visit good people and drink good beer	23:11
clarkb	portland is basically swimming in beer	23:12
prometheanfire	clarkb: cool, thanks	23:12
clarkb	its great because I can go to the grocery store and get better beer than almost anywhere in the world :)	23:12
fungi	TheJulia: ^ talk submissions to portland-area tech conferences would be the easy way ;)	23:12
mtreinish	\o/ finally got the apply job working on xenial: http://logs.openstack.org/75/347575/6/check/gate-infra-puppet-apply-ubuntu-xenial/dd76b83/console.html	23:12
anteaya	yay	23:12
*** rdx_matt has joined #openstack-infra		23:12
*** rdx_matt has quit IRC		23:13
*** rdx_matt has joined #openstack-infra		23:13
TheJulia	fungi: I have very little desire to give talks due to personal safety concerns :(	23:14
*** shashank_hegde has quit IRC		23:14
fungi	TheJulia: unfortunate, but fair enough	23:15
fungi	well, actually entirely unfair	23:15
clarkb	TheJulia: also if you do plan any travel for airport drinking reasons keep in mind you can't be served alcohol between 2am and 7am in the state of oregon	23:15
fungi	but understandable	23:15
bkero	fungi: I agree! I think that osbridge, pycon, and monitorama could be bettered from your wisdom. :)	23:15
fungi	clarkb: what about in the state of inebriation?	23:15
TheJulia	clarkb: note taken :)	23:16
*** sdake has joined #openstack-infra		23:17
clarkb	bkero: I think we should go ahead with AJaeger's comments just add -{node} to the job names instaed of putting it in the middle	23:17
*** rbuzatu has joined #openstack-infra		23:18
clarkb	bkero: also the regex thing done at https://review.openstack.org/#/c/347633/1/zuul/layout.yaml will be treated as literals not regex	23:18
*** shashank_hegde has joined #openstack-infra		23:18
clarkb	bkero: only {foo} substitutions are done there	23:18
clarkb	so you'll unfortunately have to spell out ubuntu-trusty and ubuntu-xenial	23:18
bkero	clarkb: okay I can fix that. And I agree about node name placement.	23:19
bkero	ziI found another job that used that format so i cribbed it	23:20
bkero	can fix though	23:20
clarkb	bkero: I am leaving comments ont he change to avoid confusion too	23:20
bkero	thanks	23:20
*** rbuzatu has quit IRC		23:22
clarkb	pabelanger: comments on your changes as well	23:25
*** sdake has quit IRC		23:25
clarkb	pabelanger: for the docs job we need to make sure that things all match up in check/gate/post/release which means we need those to be node specific and support trusty and xenial	23:25
clarkb	similar thing with linters since its aim is to replace pep8 aiui. (comments on the cahnges directly too)	23:26
openstackgerrit	Merged openstack-infra/project-config: add gentoo support to bindep-fallback.txt https://review.openstack.org/307553	23:26
prometheanfire	clarkb: testing now, thanks :D	23:27
*** rbuzatu has joined #openstack-infra		23:29
pabelanger	clarkb: sure, I can do that	23:29
*** lezbar has joined #openstack-infra		23:31
*** EricGonczer_ has joined #openstack-infra		23:33
*** rbuzatu has quit IRC		23:34
*** sflanigan has joined #openstack-infra		23:34
*** sflanigan has joined #openstack-infra		23:34
openstackgerrit	Merged openstack-infra/project-config: Move gate-{name}-puppet-syntax to ubuntu-xenial https://review.openstack.org/348016	23:34
ianw	pabelanger: erg, so it failed and has now dropped of the network i guess	23:35
*** lezbar has quit IRC		23:36
*** Sukhdev has joined #openstack-infra		23:36
*** mtanino has quit IRC		23:37
*** sflanigan has quit IRC		23:38
*** chlong has quit IRC		23:38
pabelanger	ianw: ack	23:39
*** rbuzatu has joined #openstack-infra		23:40
*** ddieterly has joined #openstack-infra		23:42
*** ddieterly has quit IRC		23:42
*** salv-orlando has joined #openstack-infra		23:42
*** rbuzatu has quit IRC		23:45
*** ddieterly has joined #openstack-infra		23:45
*** rdx_matt has quit IRC		23:47
*** salv-orlando has quit IRC		23:47
*** sflanigan has joined #openstack-infra		23:48
*** Apoorva_ has joined #openstack-infra		23:49
*** rbuzatu has joined #openstack-infra		23:49
*** rbuzatu_ has joined #openstack-infra		23:51
*** Apoorva has quit IRC		23:52
openstackgerrit	Merged openstack-infra/project-config: Remove unused dibtest jobs https://review.openstack.org/348067	23:52
*** Apoorva_ has quit IRC		23:53
prometheanfire	I need to figure out why puppet is trying to do emaint sync --check	23:53
*** rbuzatu has quit IRC		23:54
*** rbuzatu_ has quit IRC		23:55
osnexus	So uh, I have a devstack setup seemingly properly. I can log in through horizon and see things working fine and sey the keystone service running but...	23:55
osnexus	The program 'keystone' is currently not installed. You can install it by typing:	23:56
osnexus	sudo apt-get install python-keystoneclient	23:56
*** ajmiller_ has quit IRC		23:56
clarkb	osnexus: yup, `keystone` the command is actually the keystoneclient. So having a running keystone service doesn't necessarily mean you ahve the client installed (though typically nova and friends would pull it in)	23:56
*** dingyichen has joined #openstack-infra		23:57
osnexus	that's what I thought clarkb	23:57
osnexus	but pip also says I have it	23:58
osnexus	do i need the actual apt-get as well	23:58
osnexus	?	23:58
*** asettle has joined #openstack-infra		23:58
clarkb	no, if pip says you have it then it should be available within that env	23:59
osnexus	then I am confuzzled	23:59
*** EricGonczer_ has quit IRC		23:59
clarkb	oh I know what it is	23:59
*** rossella_s has quit IRC		23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!