Thursday, 2016-07-21

*** mengxd has quit IRC00:10
*** eharney has joined #rdo00:20
*** crazyraven has joined #rdo00:23
*** limao has joined #rdo00:24
*** jerrygb has joined #rdo00:36
*** saneax is now known as saneax_AFK00:37
*** mbound has joined #rdo00:38
*** jerrygb has quit IRC00:41
*** shivrao has quit IRC00:41
*** mbound has quit IRC00:43
*** Liuqing has joined #rdo00:45
*** Amita has quit IRC00:48
*** beagles_l8r is now known as beagles00:49
*** gildub has joined #rdo00:51
*** rhallisey has quit IRC00:54
*** Amita has joined #rdo01:01
*** wfoster has quit IRC01:03
*** Guest49585 has quit IRC01:03
*** Son_Goku has joined #rdo01:07
*** bfournie has joined #rdo01:09
*** wfoster has joined #rdo01:10
*** rook_ has joined #rdo01:10
*** flepied has joined #rdo01:13
*** Son_Goku has quit IRC01:15
*** shivrao has joined #rdo01:37
*** jerrygb has joined #rdo01:37
*** jerrygb has quit IRC01:42
*** mlammon has quit IRC01:46
*** mlammon has joined #rdo01:47
*** pilasguru has joined #rdo01:49
*** Son_Goku has joined #rdo01:50
*** pilasguru has quit IRC01:54
*** pilasguru has joined #rdo01:58
*** egafford has quit IRC02:03
*** priteau has joined #rdo02:13
*** priteau has quit IRC02:18
*** jerrygb has joined #rdo02:21
*** shivrao has quit IRC02:22
*** jhershbe__ has joined #rdo02:32
*** ashw has joined #rdo02:32
*** crossbuilder has joined #rdo02:34
*** crossbuilder_ has quit IRC02:35
*** weshay has quit IRC02:40
*** paragan has joined #rdo02:56
*** saneax_AFK is now known as saneax02:59
*** livelace has joined #rdo03:07
*** livelace has quit IRC03:16
*** julim has quit IRC03:31
*** Alex_Stef has joined #rdo03:41
*** vimal has joined #rdo03:43
*** julim has joined #rdo03:44
*** Amita has quit IRC03:57
*** Amita has joined #rdo03:57
*** saneax is now known as saneax_AFK04:00
*** richm has quit IRC04:04
*** imcleod_ has quit IRC04:04
*** julim has quit IRC04:05
*** jhershbe__ has quit IRC04:13
*** rdas has joined #rdo04:15
*** yfried has joined #rdo04:20
*** vimal has quit IRC04:22
*** Liuqing has quit IRC04:36
*** Liuqing has joined #rdo04:36
*** vimal has joined #rdo04:41
*** zodbot_ has joined #rdo04:44
*** zodbot has quit IRC04:44
*** zodbot_ is now known as zodbot04:45
*** nehar has joined #rdo04:46
*** chandankumar has joined #rdo04:47
*** jhershbe__ has joined #rdo04:48
*** yfried has quit IRC04:50
*** yfried has joined #rdo04:53
*** ashw has quit IRC04:55
*** d0ugal has quit IRC04:56
*** d0ugal has joined #rdo04:57
*** pilasguru has quit IRC05:00
*** jaosorior has joined #rdo05:01
*** gkadam has joined #rdo05:07
*** hynekm has joined #rdo05:07
*** ekuris has joined #rdo05:07
*** shivrao has joined #rdo05:09
*** jerrygb has quit IRC05:09
*** shivrao_ has joined #rdo05:11
*** kaminohana has joined #rdo05:11
*** shivrao has quit IRC05:14
*** shivrao_ is now known as shivrao05:14
*** hynekm has quit IRC05:14
*** pgadiya has joined #rdo05:16
*** yfried has quit IRC05:17
*** jprovazn has joined #rdo05:22
*** yfried has joined #rdo05:31
*** afazekas|dentist is now known as afazekas05:32
*** Poornima has joined #rdo05:45
*** Amita has quit IRC05:49
*** gkadam has quit IRC05:50
*** oshvartz has joined #rdo05:51
*** mosulica has joined #rdo05:53
*** satya4ever has joined #rdo05:55
*** pilasguru has joined #rdo05:57
rdogerritzaitcev proposed openstack/swift-distgit: Consolidate the code in the main package python-swift
*** lkuchlan has joined #rdo05:57
*** Amita has joined #rdo06:00
*** nehar has quit IRC06:03
*** nehar has joined #rdo06:04
*** Amita has quit IRC06:06
*** Amita has joined #rdo06:07
*** nehar has quit IRC06:09
*** pilasguru has quit IRC06:12
*** yfried has quit IRC06:14
*** dtantsur|afk is now known as dtantsur06:15
*** ccamacho has joined #rdo06:15
*** gkadam has joined #rdo06:18
*** gkadam is now known as Guest6836606:18
*** saneax_AFK is now known as saneax06:18
*** florianf has joined #rdo06:18
*** anilvenkata has joined #rdo06:19
*** Amita has quit IRC06:20
*** Guest68366 is now known as gkadam06:20
*** edannon has joined #rdo06:21
*** gkadam has quit IRC06:24
*** lkuchlan has quit IRC06:25
*** ganesh has joined #rdo06:26
*** ganesh has quit IRC06:26
*** gildub has joined #rdo06:27
*** nehar has joined #rdo06:27
*** ganesh has joined #rdo06:28
*** ganesh is now known as Guest9265406:28
*** Guest92654 is now known as gkadam06:28
*** mcornea has joined #rdo06:30
*** devvesa has joined #rdo06:30
*** smeyer has joined #rdo06:33
*** tesseract- has joined #rdo06:39
*** ccamacho is now known as ccamacho|afk06:44
*** hynekm has joined #rdo06:46
*** iranzo has joined #rdo06:53
*** iranzo has quit IRC06:53
*** iranzo has joined #rdo06:53
*** shivrao has quit IRC06:54
*** tshefi has joined #rdo06:55
*** Alex_Stef has quit IRC06:56
*** jubapa has joined #rdo06:57
*** ohamada has joined #rdo06:57
*** karimb has joined #rdo06:58
*** nyechiel has joined #rdo06:59
*** eliska has joined #rdo07:00
*** edannon has quit IRC07:01
*** gildub_ has joined #rdo07:01
flaper87number80: w000h000! Thanks a lot :)07:02
*** iranzo has quit IRC07:02
*** kaminohana has quit IRC07:03
*** iranzo has joined #rdo07:03
*** iranzo has quit IRC07:03
*** iranzo has joined #rdo07:03
*** pcaruana has joined #rdo07:03
*** athomas has joined #rdo07:05
*** leanderthal|afk is now known as leanderthal07:05
*** nmagnezi has joined #rdo07:06
*** rcernin has joined #rdo07:07
*** rcernin has quit IRC07:10
*** rcernin has joined #rdo07:10
*** Alex_Stef has joined #rdo07:11
*** fzdarsky has joined #rdo07:12
*** egallen has joined #rdo07:12
*** karimb has quit IRC07:15
*** ifarkas_afk is now known as ifarkas07:17
*** dgurtner has joined #rdo07:18
*** dgurtner has joined #rdo07:18
*** jhershbe__ has quit IRC07:22
*** fzdarsky has quit IRC07:22
*** karimb has joined #rdo07:29
*** Alex_Stef has quit IRC07:29
*** KarlchenK has joined #rdo07:30
*** lkuchlan has joined #rdo07:30
*** zoli_gone-proxy is now known as zoliXXL07:33
*** fzdarsky has joined #rdo07:36
*** d0ugal has quit IRC07:37
*** Alex_Stef has joined #rdo07:40
*** Son_Goku has quit IRC07:42
*** p01nt3r75 has joined #rdo07:42
*** jpich has joined #rdo07:47
*** edannon has joined #rdo07:47
*** yfried has joined #rdo07:48
*** garrett has joined #rdo07:51
*** nehar has quit IRC07:56
*** fzdarsky has quit IRC07:57
*** shardy has joined #rdo07:59
*** Son_Goku has joined #rdo08:02
*** mvk has quit IRC08:02
*** dtantsur is now known as dtantsur|bbl08:05
*** ccamacho|afk is now known as ccamacho08:08
*** ohamada has quit IRC08:08
*** ushkalim has joined #rdo08:09
openstackgerritMarcus Furlong proposed openstack/packstack: add workers for trove::conductor
openstackgerritMarcus Furlong proposed openstack/packstack: add number of workers for nova::conductor
openstackgerritMarcus Furlong proposed openstack/packstack: add workers for trove::conductor
openstackgerritMarcus Furlong proposed openstack/packstack: add workers for heat::api and heat::engine
*** derekh has joined #rdo08:18
openstackgerritMarcus Furlong proposed openstack/packstack: add wsgi threads for gnocchi::api
*** jlibosva has joined #rdo08:20
*** rdo has quit IRC08:21
hewbroccaMorning folks08:21
*** ohamada has joined #rdo08:22
hewbroccaI see we still have no promote of master08:22
*** zoliXXL is now known as zoli|wfh08:23
*** Son_Goku has quit IRC08:23
*** arnewiebalck_ has joined #rdo08:23
*** priteau has joined #rdo08:23
*** gildub_ has quit IRC08:24
*** rdo has joined #rdo08:24
*** sshnaidm|afk is now known as sshnaidm08:24
*** gildub has quit IRC08:24
*** arnewiebalck has quit IRC08:25
*** arnewiebalck_ is now known as arnewiebalck08:25
*** gildub has joined #rdo08:25
*** priteau has quit IRC08:28
*** rdo has quit IRC08:28
*** rdo has joined #rdo08:30
*** gfidente|afk has joined #rdo08:34
*** rdo has quit IRC08:34
*** rdo has joined #rdo08:35
*** pilasguru has joined #rdo08:37
*** pilasguru has quit IRC08:42
*** jubapa has quit IRC08:46
*** Son_Goku has joined #rdo08:48
*** Son_Goku has quit IRC08:49
*** paramite has joined #rdo08:49
*** aufi has joined #rdo08:50
*** paragan has quit IRC08:50
*** fzdarsky has joined #rdo08:51
*** paragan has joined #rdo08:53
*** paragan has joined #rdo08:53
*** Son_Goku has joined #rdo08:54
*** edannon has quit IRC08:56
*** priteau has joined #rdo08:57
*** jhershbe__ has joined #rdo08:58
*** priteau has quit IRC08:58
*** jaosorior has quit IRC08:59
*** jaosorior has joined #rdo08:59
*** crazyraven has quit IRC09:00
*** paramite is now known as paramite|afk09:01
*** mvk has joined #rdo09:03
*** gfidente|afk is now known as gfidente09:03
*** nehar has joined #rdo09:07
*** edannon has joined #rdo09:09
*** d0ugal has joined #rdo09:10
*** zoli|wfh is now known as zoli|brb09:12
*** jerrygb has joined #rdo09:13
*** paramite|afk is now known as paramite09:16
*** jerrygb has quit IRC09:18
*** d0ugal has quit IRC09:22
*** zoli|brb is now known as zoli|wfh09:29
*** d0ugal has joined #rdo09:29
*** fzdarsky has quit IRC09:30
*** jubapa has joined #rdo09:30
*** jubapa has quit IRC09:31
*** karimb has quit IRC09:40
*** akrivoka has joined #rdo09:43
*** paragan has quit IRC09:43
*** fzdarsky has joined #rdo09:44
*** jubapa has joined #rdo09:45
*** _degorenko|afk is now known as degorenko09:47
*** apetrich has quit IRC09:49
*** karimb has joined #rdo09:53
*** d0ugal has quit IRC09:56
*** gszasz has joined #rdo09:58
*** Poornima has quit IRC10:01
*** d0ugal has joined #rdo10:02
*** d0ugal has quit IRC10:03
*** d0ugal has joined #rdo10:04
*** Liuqing has quit IRC10:08
*** Liuqing has joined #rdo10:09
*** Poornima has joined #rdo10:13
*** jerrygb has joined #rdo10:14
*** ihrachys has joined #rdo10:15
*** mlammon has quit IRC10:18
*** mlammon has joined #rdo10:18
*** jerrygb has quit IRC10:20
*** rgogunskiy has joined #rdo10:20
*** jubapa has quit IRC10:21
*** rgogunskiy has quit IRC10:23
*** limao has quit IRC10:24
*** apevec has joined #rdo10:24
*** apevec has quit IRC10:24
*** apevec has joined #rdo10:24
*** garrett has quit IRC10:25
*** mbound has joined #rdo10:26
jschlueterimcsk8: checking the patch you posted yesterday for packstack10:27
*** gildub has quit IRC10:28
*** apetrich has joined #rdo10:30
*** iberezovskiy|off is now known as iberezovskiy10:30
*** d0ugal has quit IRC10:31
*** dtantsur|bbl is now known as dtantsur10:32
*** jubapa has joined #rdo10:33
*** aortega has joined #rdo10:35
*** jpich has quit IRC10:36
*** ihrachys has quit IRC10:36
*** jlibosva has quit IRC10:36
*** ihrachys has joined #rdo10:37
*** tosky has joined #rdo10:37
*** jlibosva has joined #rdo10:38
*** aufi has quit IRC10:40
*** aufi has joined #rdo10:40
*** garrett has joined #rdo10:43
*** rodrigods has quit IRC10:43
*** rodrigods has joined #rdo10:44
*** jpich has joined #rdo10:45
*** rhallisey has joined #rdo10:50
*** chopmann has joined #rdo10:56
*** rdas has quit IRC10:57
*** xb_ has quit IRC10:58
*** paramite has quit IRC10:58
*** pkovar has joined #rdo11:00
*** Son_Goku has quit IRC11:01
*** milan has joined #rdo11:06
*** xb_ has joined #rdo11:07
*** dpeacock has joined #rdo11:13
*** jerrygb has joined #rdo11:16
*** Poornima has quit IRC11:17
hewbroccanumber80: shardy and dtantsur have found the ipxe problem we think11:18
dtantsurthat's our tradition. every couple of months we curse the ipxe11:19
hewbroccashort answer, old ipxe rpm lurking somewhere11:19
*** Liuqing has quit IRC11:19
*** abregman has joined #rdo11:19
hewbroccanumber80: probably if we update to the right one the promote will finally pass11:19
*** jerrygb has quit IRC11:21
apevecdtantsur, hewbrocca, can I have more details?11:21
apevecwhat is old11:21
apevecand what is new11:21
*** abregman has quit IRC11:21
dtantsurapevec, new is ipxe-roms-qemu-20160127-1.git6366fa7a.el7.noarch11:22
dtantsureverything with year < 2016 is old11:22
apevecwe have that in the repo
apevecwhere do you see old one popping up?11:22
apevecdtantsur, ^11:24
dtantsurapevec, shardy does, not me11:24
apevecshardy, do you have link to logs?11:25
shardyapevec: has details, I had to get the version by screenshot of the VM primary console11:26
openstackLaunchpad bug 1604770 in tripleo "introspection hangs due to broken ipxe config" [Critical,Fix released] - Assigned to Dmitry Tantsur (divius)11:26
shardyI'm not sure if it's logged anywhere tbh11:26
shardyapevec: In my case the underlying host had a wrong old version of ipxe-roms-qemu because of some yum priorities problems11:27
number80apevec: do you remember that Goneri asked us late april to update ipxe?11:27
apevecnumber80, it was updated, see cbs link above11:27
*** ade_b has joined #rdo11:27
hewbroccabut probably not on *all* the hosts11:27
hewbroccathis is the problem11:27
apevecwe need to see which repos are included in the image build11:27
hewbroccashardy: so, yum priorities, at the end of the day11:28
apevecdtantsur, shardy - how is the image built?11:28
*** ade_b has quit IRC11:28
*** ade_b has joined #rdo11:28
*** Son_Goku has joined #rdo11:29
*** Son_Goku has quit IRC11:29
shardyapevec: My comment about the image was a mistake, I thought the error was coming from the deploy kernel image11:30
shardythe actual fix was updating the host (not undercloud) ipxe-roms-qemu to the delorean version11:30
shardyhewbrocca: it was actually my fault tbh - I had things set up to prioritize a local yum mirror server11:30
* shardy sighs11:31
shardythe version in centos updates doesn't work for us, as it turns out11:31
apevecah so you got baseos version11:31
shardywe need the bleeding edge delorean one11:31
shardy"Introspection completed."11:32
hewbroccashardy: blearrgh11:32
shardyhooray :)11:32
hewbroccawoop woop11:32
shardythat only took an entire morning, now for some lunch11:32
hewbroccanow how do we fix the promote job?11:32
number80then, in this case, you don't need yum priorities, it's RDO base repository11:32
apevecnumber80, it is in testing which is used by CI11:34
*** Son_Goku has joined #rdo11:34
shardyYeah in CI we juggle priorities pointing to 4 different delorean repos :\11:34
*** ohamada has quit IRC11:35
apevecdtantsur, ^ so promotion should be using it, let's check rpm-qa  list ?11:35
jschlueterimcsk8: yep that fixes it11:35
*** ohamada has joined #rdo11:35
apevecjschlueter, yay!11:35
*** Poornima has joined #rdo11:35
*** ohamada has quit IRC11:35
jschlueterapevec: yep11:36
* jschlueter learned something about puppet and fixing ordering stuff this week11:36
apevecEmilienM, please sanity check
hewbroccaapevec: that sounds right11:38
jschlueterI abandoned the puppet-nova change as this one is better11:38
*** Son_Goku has quit IRC11:38
*** lucasagomes is now known as lucas-hungry11:42
apevecso last promotion run this morning passed all weirdo puppet/packstack jobs11:43
apevecbut tripleo min and ha failed11:43
apevecI've symlinked with that hash11:44
hewbroccaapevec: right, and we believe the problem with tripleo jobs is this ipxe version thing11:44
*** zoli|wfh is now known as zoli|lunch11:44
hewbroccaif the error is a timeout on introspection, that's almost certainly what it is11:44
apevechewbrocca, ok, I'm looking at the logs11:44
*** dprince has joined #rdo11:45
*** ade_b has quit IRC11:45
apevecInstalled: ipxe-roms-qemu-20130517-8.gitc4bce43.el7_2.1.noarch11:45
apevecso repo setup is not right on the virthost ?11:46
apevecit doesn't have any RDO repos ??11:46
*** jubapa has left #rdo11:46
*** jubapa has joined #rdo11:46
apevecshardy, trown ^11:47
hewbroccathat sounds like the problem, all right11:47
* hewbrocca facepalm11:47
hewbroccaneed this one: ipxe-roms-qemu-20160127-1.git6366fa7a.el7.noarch11:48
apevecon undercloud: Installed: ipxe-roms-qemu-20160127-1.git6366fa7a.el7.noarch11:48
hewbroccathat's the right one, but it doesn't help in the undercloud11:48
rbowenSo ... what's the vector, victor?11:48
hewbroccathat means we need to update repos on the virt host?11:49
rbowenQuote from an old movie. Airplane. Never mind. :-)11:49
rbowenDo we have M2 yet this morning?11:49
apevecrbowen, not yet fully11:49
*** Son_Goku has joined #rdo11:50
apevecrbowen, we could run packstack part, but tripleo is part of our definition-of-done, resolving one remaining issue now11:50
apevechewbrocca, yeah, I'm not sure how we didn't hit this before11:50
hewbroccame neither, but shardy hit it on his local setup as well11:51
*** bfournie has quit IRC11:51
apevecdid we just feel lucky all this time??11:52
hewbroccadtantsur: you have any insight here?11:52
*** gildub has joined #rdo11:52
hewbroccaapevec: I mean I guess what it comes down to is we're shipping a later ipxe in RDO, for good reasons11:52
apevecok, so which of CI roles is setting up virthost?11:53
hewbroccabut the physical host needs to have that ipxe version11:53
hewbrocca(I'm not sure why)11:53
apevechewbrocca, hopefully next RHEL will rebase ipxe in baseos11:53
hewbroccaIf they release one that works, then yeah, we can stop worrying about this11:53
dtantsursorry, just got back after unexpected firmware update for my laptop >_<11:54
hewbroccadtantsur: it didn't come up?11:55
hewbroccadtantsur: so, yes, virt host for the promote job has wrong ipxe version11:55
*** jubapa_ has joined #rdo11:55
hewbroccaOut of curiosity, why does it matter what version is on the host?11:55
dtantsurhewbrocca, this is the one actually used :)11:55
dtantsura bit longer answer:11:56
hewbroccaI guess I assumed that :)11:56
dtantsurwe try to use iPXE from the machine itself, then fall back to iPXE shipped on the undercloud11:56
dtantsuron virtual environment "iPXE from the machine itself" means "iPXE from the virtual host"11:56
dtantsurI hope it makes the thing a bit clearer11:56
hewbroccaYeah I think I get it11:56
hewbroccaapevec: can you fix it?11:59
*** jubapa_ has quit IRC11:59
*** jayg|g0n3 is now known as jayg12:00
*** amuller has joined #rdo12:02
*** weshay has joined #rdo12:02
*** dgurtner has quit IRC12:03
weshayapevec, greetings.. I was just briefed on the ipxe issue12:09
weshayapevec, sounds like we need to blacklist ipxe on the virthost centos repos12:09
*** paragan has joined #rdo12:10
*** paragan has joined #rdo12:10
hewbroccadtantsur: ^^^ this should work, right?12:11
*** d0ugal has joined #rdo12:11
dtantsurI don't quite get it, blacklist what exactly?12:12
hewbroccaweshay: ^^^12:13
*** King_InuYasha has joined #rdo12:13
weshayso what hewbrocca was saying was that the ipxe rpm in centos is the incorrect rpm to use.. the virthost should use ipxe from delorean12:14
weshayso we just need to blacklist the ipxe rpm in the centos yum repo conf and it will be pulled from delorean.12:14
*** Son_Goku has quit IRC12:16
*** ohochman has joined #rdo12:17
hewbroccathat seems like the right result to me12:17
*** jerrygb has joined #rdo12:17
*** ohochman has left #rdo12:17
hewbroccadtantsur: ^^^12:17
* weshay finds a blacklist example12:17
*** trown|outtypewww is now known as trown12:19
weshaytrown, morning sunshine12:19
dtantsursounds correct12:19
weshayhewbrocca, dtantsur may have found the reason introspection works for me locally, but fails in ci.centos12:20
weshayintrospection is apparently using the virthost to execute ipxe, and the centos rpm version of ipxe is not working correctly.. we need to use ipxe from delorean12:21
*** pilasguru has joined #rdo12:21
*** jerrygb has quit IRC12:21
weshaytrown, one possible solution is to blacklist ipxe in the centos repos
trownwhat if we just `yum remove -y ipxe` from the virthost?12:22
*** paragan has quit IRC12:22
weshaysounds like it *needs* to be installed to me12:22
*** Poornima has quit IRC12:22
trownthen ironic will use the undercloud ipxe12:22
trowndtantsur: is that right ^12:22
trownweshay: we dont put dlrn repos on the virthost currently12:23
dtantsurtrown, I don't know if qemu depends on it12:23
weshaymeh.. we could12:23
trownright, just saying we dont12:23
trownit also then creates issues for cleaning up, as you now need to make sure the virthost has the right repos12:24
trownin the current state, we try to do as little as possible on the virthost, and even less as root12:24
*** unclemarc has joined #rdo12:25
dtantsurtrown, removing it removes libguestfs for me12:26
*** athomas has quit IRC12:27
* shardy returns from lunch12:28
shardyYeah the only solution I found was to configure the delorean repos on the virt host and ensure they had priorities set above centos-updates12:29
trownit is only one package ya?12:29
*** cpg is now known as cpg|away12:29 --repo-setup is run on the virthost for tripleO CI which is why we don't see this I think12:29
shardytrown: Yeah ipxe-roms-qemu12:29
dtantsurI think we should converge to a bit less scripts to setup the environment :/12:30
dtantsurlike, for example, one12:30
trowndtantsur: maybe respond to my proposal on openstack-dev about that :P12:30
*** newuser_rdo has joined #rdo12:30
shardydtantsur: Yeah, we've been trying to do that for a while12:30
dtantsurtrown, I don't have a strong voice in TripleO anyway :)12:30
* shardy will use whatever we use in CI12:31
weshayshardy, I think introspection is off in tripleo-ci based on
weshayif I'm reading that correctly12:32
*** Alex_Stef has quit IRC12:32
*** King_InuYasha is now known as Son_Goku12:33
*** flepied has quit IRC12:33
trownya there is also that12:33
trownwhen we moved to a single job for tripleo-ci, we lost introspection testing12:33
dtantsurweshay, you're right. and that's the reason we're having so many problems (not this one, the 2-3 previous ones)12:34
trownevidenced by the multiple patches to instack-undercloud to fix the ipxe port12:34
*** bfournie has joined #rdo12:34
weshaytrown, so are you thinking a yum install http://foo/ipxe ?12:34
weshayon the virthost12:34
*** athomas has joined #rdo12:34
* dtantsur shakes his fist at people disabling important bits in gate12:34
trownweshay: ya I am testing adding a direct http link to
trownputting dlrn repos on the virthost is not really a great idea12:35
*** zoli|lunch is now known as zoli|wfh12:35
newuser_rdoI want to integrate my OpenStack rdo with my microsoft active directory.12:35
newuser_rdowhich option is better: use packstack with the parameters of the keystone + ldap, or install with packstack and after setup ldap configurations?12:35
rbowennewuser_rdo: The expert on this is Adam Young, and he appears to not be here at the moment. It's still early in his time zone.12:36
*** paragan has joined #rdo12:37
newuser_rdorbowen, thank you. I'll try talk to him later12:38
*** egafford has joined #rdo12:38
trownwhat dlrn repo is the ipxe package in? I dont see it in
*** vimal has quit IRC12:39
dtantsurtrown, something "common" iirc12:39
apevectrown, in deps12:39
*** laron has joined #rdo12:40
dtantsuroh, deps, right12:40
trownoh, so I can get it off buildogs even12:40
*** laron has quit IRC12:40
trownapevec++ thanks12:40
zodbottrown: Karma for apevec changed to 1 (for the f24 release cycle):
*** laron has joined #rdo12:41
weshayhow is it apevec just has one karma point in #rdo.. new f24 cycle.. I guess12:41
zodbotweshay: Karma for apevec changed to 2 (for the f24 release cycle):
weshayjust cause12:41
rbowenHmm. It doesn't like me.12:41
trownlol, must not link to your FAS account12:42
number80rbowen: only one cookie per cycle :)12:42
zodbotnumber80: Karma for apevec changed to 3 (for the f24 release cycle):
rbowenMy FAS account is rcb12:42
rbowenIs that why?12:43
number80.fasinfo rcb12:43
zodbotnumber80: User: rcb, Name: Rich Bowen, email:, Creation: 2013-08-01, IRC Nick: None, Timezone: UTC, Locale: C, GPG key ID: None, Status: active12:43
zodbotnumber80: Approved Groups: cla_fpca cla_done12:43
*** jcoufal has joined #rdo12:43
*** aufi_ has joined #rdo12:43
number80rbowen: you need to add your irc nick in your FAS profile, so zodbot can do the mapping12:43
*** rlandy has joined #rdo12:43
trownweshay: ok adding that http link to the list of packages for libvirt "just worked" for me12:44
trownwill find out shortly if that fixes introspection12:45
weshaycool.. trown I think this does explain why it worked locally for me.. my virthosts are rhel12:45
rbowennumber80: I don't see where to do that.12:45
rbowennumber80: I'm looking at ... is there another place?12:46
* misc search the url12:47
*** karimb has quit IRC12:47
*** dneary has joined #rdo12:48
*** lucas-hungry is now known as lucasagomes12:49
rbowenOh, well, I tried. :-)12:49
number80ping EmilienM, trown, see jjoyce request ^12:50
number80.fasinfo rbowen12:50
zodbotnumber80: User "rbowen" doesn't exist12:50
number80.fasinfo rcb12:51
zodbotnumber80: User: rcb, Name: Rich Bowen, email:, Creation: 2013-08-01, IRC Nick: rbowen, Timezone: UTC, Locale: en, GPG key ID: None, Status: active12:51
zodbotnumber80: Approved Groups: cla_fpca cla_done12:51
number80zodbot: naughty bot!12:51
trownjjoyce: could you repeat the request? I dont see it in scrollback12:52
jjoycetrown: trying to get that guy moving12:53
jjoycetrown: I had to find it in my scroll back :)12:53
*** Amita has joined #rdo12:53
*** _elmiko is now known as elmiko12:53
*** jmelvin has joined #rdo12:55
trownjjoyce: k looks like it is not passing CI yet12:55
jjoycetrown: Yeah it looks like a new patch was added since I made the last request.12:57
*** jeckersb is now known as jeckersb_gone12:57
*** ashw has joined #rdo13:00
*** aufi has quit IRC13:01
weshaymatbu, are you running 3rd party on
socialnumber80: O.o13:01
trownweshay: put up for introspection fix13:01
*** julim has joined #rdo13:01
number80social: typing too fast13:01
*** jubapa_ has joined #rdo13:01
number80(it was actually an irc client shortcut to switch buffer)13:02
* weshay looks13:02
*** flepied has joined #rdo13:02
matbuweshay: no not this one13:03
weshaytrown, added comment13:03
trownweshay: why only master?13:04
trowniPXE out of date is a problem everywhere, it is only a blocking problem on master13:04
weshaythat specific rpm is for newton no?13:04
trownwe have been having issues with out of date iPXE since kilo though13:04
*** karimb has joined #rdo13:04
trownnah it is not an openstack package13:04
*** paragan has quit IRC13:05
weshayah ok13:05
trownthe version of iPXE that ships with CentOS is very old13:05
*** ddmitriev has quit IRC13:06
matbuweshay: i don't because it's already tested in the role itself and it's for mitaka upgrade, not newton13:06
*** sgotliv has joined #rdo13:11
*** jpich has quit IRC13:12
*** anilvenkata has quit IRC13:13
*** READ10 has joined #rdo13:15
*** jerrygb has joined #rdo13:18
*** dustins has joined #rdo13:18
*** akshai has joined #rdo13:20
newuser_rdoone question...  anyone knows any doc about how to add a blockstorage node into my lab? I have one compute node at my lab13:21
*** tshefi has quit IRC13:21
*** vaneldik has joined #rdo13:22
*** jpich has joined #rdo13:22
*** jerrygb has quit IRC13:22
*** akshai_ has joined #rdo13:22
*** egallen has quit IRC13:24
dmsimardtrown: everything is green except ooo-q :(
trowndmsimard: wow really?13:24
hewbroccaalmost there13:25
hewbroccatrown: are the oooq failures because of the bad ipxe rom? Has that change gone in yet?13:25
*** akshai has quit IRC13:26
*** vaneldik has quit IRC13:26
hewbroccaahh, it has not13:27
dmsimardhmm, CI isn't happy about that patch13:27
hewbroccawell that's probably why oooq isn't working13:27
*** milan has quit IRC13:27
*** milan has joined #rdo13:27
*** jeckersb_gone is now known as jeckersb13:28
trownya, that patch needed a fix13:28
apevecweshay, I guess you have more than just base RHEL 7.2 repos enabled if you don't see this internally?
*** ddmitriev has joined #rdo13:33
*** milan has quit IRC13:34
*** jerrygb has joined #rdo13:34
*** milan has joined #rdo13:35
*** richm has joined #rdo13:35
*** trown is now known as trown|mtg13:37
*** dgurtner has joined #rdo13:37
*** dgurtner has joined #rdo13:37
*** pgadiya has quit IRC13:39
*** Liuqing has joined #rdo13:40
*** Liuqing has quit IRC13:41
*** milan has quit IRC13:41
*** vaneldik has joined #rdo13:41
*** paragan has joined #rdo13:41
*** milan has joined #rdo13:43
*** jubapa_ has quit IRC13:44
*** fultonj has joined #rdo13:45
*** tosky has quit IRC13:52
*** ebalduf has joined #rdo13:52
*** ekuris has quit IRC13:55
*** livelace has joined #rdo13:56
*** laron has quit IRC13:57
*** dtantsur is now known as dtantsur|pto13:57
*** laron has joined #rdo13:57
*** vaneldik has quit IRC13:58
*** chandankumar has quit IRC13:58
*** imcleod has joined #rdo14:00
*** gildub has quit IRC14:01
*** eliska has quit IRC14:05
*** ushkalim has quit IRC14:05
*** eliska has joined #rdo14:06
*** eliska is now known as eliska-mtg14:06
*** kgiusti has joined #rdo14:06
mcorneatrown|mtg: hi, for rdo test day should we use the stable repos or trunk?14:07
trown|mtgmcornea: I think both are valid to test14:10
mcorneatrown|mtg: ok, so even stable points to Netwon mileston 2?14:11
trown|mtgmcornea: trunk is a couple weeks old14:11
trown|mtgoh I think I misundertood what you mean by trunk14:11
*** rbowen has quit IRC14:11
trown|mtgI read as mitaka vs newton14:11
trown|mtgtesting the repos that are not passing CI is unlikely to be successful :)14:12
mcorneatrown|mtg: right :) so I'm following the docs and I have 2 options: stable or "latest RDO Trunk Delorean repository"14:12
trown|mtgah upstream docs...14:13
mcorneatrown|mtg: yep14:13
trown|mtgthe repos there are not valid for RDO14:13
*** tumble has joined #rdo14:13
trown|mtgthey are meant to test latest tripleo with a pinned version of everything else14:13
trown|mtgfor RDO we want to test everything together at the same point in time14:14
*** Ryjedo has joined #rdo14:15
*** eharney has quit IRC14:15
mcorneatrown|mtg: ok, I misunderstood it then. So where can I get the RDO repos from?14:15
*** vaneldik has joined #rdo14:15
*** milan has quit IRC14:16
*** milan has joined #rdo14:16
trown|mtgmcornea: is the repos that get installed in the quickstart image14:17
*** dustins has quit IRC14:20
apevectrown|mtg, hmm, is not merged yet? So current run will not pass?14:21
trown|mtgapevec: right14:22
*** edannon has quit IRC14:23
*** lpabon has joined #rdo14:23
*** rbowen has joined #rdo14:23
*** rbowen has quit IRC14:23
*** rbowen has joined #rdo14:23
*** ChanServ sets mode: +o rbowen14:23
*** eliska-mtg is now known as eliska14:25
*** sgotliv has quit IRC14:25
*** Amita has quit IRC14:27
*** jlibosva has quit IRC14:29
*** nmagnezi has quit IRC14:29
*** jlibosva has joined #rdo14:29
*** eliska has quit IRC14:29
*** apetrich has quit IRC14:30
*** nehar has quit IRC14:31
*** lkuchlan has quit IRC14:31
*** lpabon has quit IRC14:32
*** laron has quit IRC14:38
*** fzdarsky is now known as fzdarsky|afk14:38
*** laron has joined #rdo14:39
*** michchap has quit IRC14:40
*** rbowen has quit IRC14:40
*** fzdarsky|afk has quit IRC14:42
*** vaneldik1 has joined #rdo14:44
*** michchap has joined #rdo14:45
*** vaneldik has quit IRC14:45
apevectrown|mtg, is there only noop CI on ?14:49
trown|mtgapevec: no other CI is running14:50
*** saneax is now known as saneax_AFK14:50
*** anilvenkata has joined #rdo14:51
*** rbowen has joined #rdo14:53
*** ChanServ sets mode: +o rbowen14:53
*** READ10 has quit IRC14:54
rbowenAny news on ooo-q while my network was down?14:55
*** vaneldik1 has quit IRC14:55
*** ebalduf has quit IRC14:57
*** bswartz is now known as bswartz_14:57
apevecrbowen, is running in CI14:58
apeveconce it's merged we can retrigger promotion pipeline14:58
rbowenexcellent. Thanks for the update.14:58
apevectrown|mtg, let's disable pipeline until that?14:58
apevecit's just wasting resources now14:58
*** yfried has quit IRC14:59
apevectrown|mtg, dmsimard - rdo-delorean-promote-master disabled15:00
*** dyasny has quit IRC15:01
*** d0ugal has quit IRC15:02
*** gkadam has quit IRC15:02
*** pcaruana has quit IRC15:02
*** d0ugal has joined #rdo15:05
*** lpabon has joined #rdo15:05
*** hynekm has quit IRC15:06
*** READ10 has joined #rdo15:08
*** ebalduf has joined #rdo15:09
*** mengxd has joined #rdo15:11
*** dyasny has joined #rdo15:13
*** sdake has joined #rdo15:13
jschlueterapevec, EmilienM: what's next for getting this merged?
*** eharney has joined #rdo15:14
jschlueterare we waiting on another review of the change or not?15:14
jschlueterimcsk8: ^^15:14
apevecin theory one more +215:14
*** satya4ever has quit IRC15:15
*** karimb has quit IRC15:15
EmilienMapevec: I'm not core on packstack.15:15
apevecbut with folks on pto ...15:15
number80apevec, pabelanger, dmsimard: let's sync next week about post-commit jobs15:15
EmilienMapevec: you can +A it15:15
EmilienMwho cares15:15
*** trown|mtg is now known as trown15:15
*** panda|zZ is now known as panda15:15
apevecnumber80, let's15:16
number80apevec: as you have the busiest schedule, I'll let you choose the timeslot15:16
*** jlibosva1 has joined #rdo15:17
*** sdake_ has joined #rdo15:17
*** apetrich has joined #rdo15:17
apevecdmsimard, social - +2 anyone ?
*** jlibosva has quit IRC15:17
apevecimcsk8, ^15:17
pabelangernumber80: sure, feel free to send out an invite15:18
dmsimardnumber80: sure15:18
*** sdake has quit IRC15:19
hewbroccaappears to have passed CI15:21
hewbroccaneeds a workflow +1...15:21
jschlueterdmsimard: thanks!15:21
hewbroccatrown: ^^^15:23
trownlarsks: mind a quick review of
larskstrown: sure thing.15:25
* hewbrocca waits anxiously15:25
trownhewbrocca: something else is broken after that now... investigating15:26
hewbroccasigh... shocking...15:26
trownhewbrocca: and tripleo is set on merging a patch I have said 100% breaks RDO, so we will likely have a second issue shortly15:26
hewbroccanah, they're not gonna merge it15:26
hewbroccadon't worry :)15:26
*** mengxd has quit IRC15:27
hewbroccatrown: Speaking of fun things, do we know why the mitaka promote job is failing?15:28
*** hrw has quit IRC15:28
*** paragan has quit IRC15:29
trownhewbrocca: seems to be httpd failing to start only on the minimal job, but I can't reproduce it locally15:31
trown seems relevant, but that is only in the upgrades script15:31
*** dustins has joined #rdo15:32
trownhewbrocca: I am comandeering a CI node though to investigate15:32
hewbroccawell, excellent15:32
hewbroccawe're getting there...15:32
* larsks wonders how many times gerrit will require him to log in today.15:33
dmsimardtrown: why would a tripleo patch break RDO ?15:33
dmsimardtripleo *uses* RDO15:33
dmsimardnot the other way around15:33
trowndmsimard: a tripleo-heat-templates patch breaks on quickstart, but so far nobody has reproduced it outside of quickstart15:34
dmsimardah so it breaks quickstart :p15:34
trowndmsimard: the thing is it is clearly the patch, because I can remove it and tripleo deploys fine15:34
trowndmsimard: right I meant it breaks RDO promote15:34
larskstrown: which patch?15:34
rdogerritDavid Moreau Simard proposed config: WIP: Implement weirdo-dlrn integration matrix for distgit projects
*** pilasguru has quit IRC15:38
*** pilasguru has joined #rdo15:38
weshaytrown, not seeing that undercloud issue in tripleo15:38
weshay2016-07-21 06:38:40.000 | + touch /opt/stack/.undercloud-setup15:38
*** laron has quit IRC15:39
trownweshay: ya I am hoping something weird happened in the last image, just kicked a run to get a new image at least15:39
weshayk.. will pull that image when it's ready15:39
trownweshay: that touch has not changed recently either15:39
*** laron has joined #rdo15:39
*** leanderthal is now known as leanderthal|afk15:40
*** paragan has joined #rdo15:41
*** paragan has joined #rdo15:41
*** sshnaidm has quit IRC15:42
*** pilasguru has quit IRC15:42
*** zodbot_ has joined #rdo15:43
*** zodbot has quit IRC15:43
*** zodbot_ is now known as zodbot15:44
*** adarazs has quit IRC15:45
*** cschwede has quit IRC15:45
*** slagle has quit IRC15:45
*** dgurtner has quit IRC15:46
*** zoli|wfh has quit IRC15:46
*** jschlueter has quit IRC15:46
*** smeyer has quit IRC15:46
*** jjoyce has quit IRC15:46
*** jjoyce has joined #rdo15:46
*** psanchez has quit IRC15:46
*** psanchez has joined #rdo15:47
*** slagle has joined #rdo15:47
*** jschlueter has joined #rdo15:47
*** adarazs has joined #rdo15:48
*** maeca1 has joined #rdo15:48
*** zoliXXL has joined #rdo15:48
*** cschwede has joined #rdo15:49
*** fultonj has quit IRC15:51
*** jubapa has quit IRC15:52
openstackgerritMerged openstack/packstack: Fix user creation for nova network
*** hynekm has joined #rdo15:57
*** paragan has quit IRC15:58
*** nmagnezi has joined #rdo15:59
*** paragan has joined #rdo16:01
*** paragan has joined #rdo16:01
hewbroccaMerged! Huzzah!16:01
hewbroccatrown: now what about this other thing16:01
*** aufi_ has quit IRC16:02
*** d0ugal has quit IRC16:04
*** Son_Goku has quit IRC16:04
*** Son_Goku has joined #rdo16:05
*** fzdarsky|afk has joined #rdo16:09
trownhewbrocca: ya waiting on a new image to see if that is actually an issue or not
hewbroccago job go!16:11
*** tesseract- has quit IRC16:15
*** Son_Goku has quit IRC16:16
*** rcernin has quit IRC16:19
*** jhershbe__ has quit IRC16:20
*** fultonj has joined #rdo16:21
*** ayoung has joined #rdo16:24
*** ifarkas is now known as ifarkas_afk16:24
*** ayoung has quit IRC16:25
*** ayoung has joined #rdo16:25
*** derekh has quit IRC16:27
*** garrett has quit IRC16:27
trownWTF... just ran the minimal job that has been failing promote for days (in a way I cant reproduce locally) manually on a cico node... fails to fail16:27
*** dyasny has quit IRC16:27
*** julim has quit IRC16:28
trownoh right... because it landed on the fast chassis16:29
*** jpich has quit IRC16:32
*** mvk has quit IRC16:32
apevectrown, so we have gambling included16:33
trownya and similar to casinos the odds are not in our favor16:33
trownit is 1/416:34
*** lucasagomes is now known as lucas-afk16:35
trownI am a bit lost on what our options are with this at this point16:36
trownwe cant magically make the 3 slow chassis faster16:36
*** mcornea has quit IRC16:36
apevecso it's just CPU not RAM?16:37
trownya only difference is CPU16:37
apevecso increasing timeouts?16:37
trownall of them have the same RAM and SSDs16:37
trownya, I suppose for mitaka it is exposing a race condition that is likely fixable... just not reproducible on a decent CPU16:38
rdogerritDavid Moreau Simard proposed config: WIP: Implement weirdo-dlrn integration matrix for distgit projects
*** pilasguru has joined #rdo16:39
trownbeing able to request nodes on dusty (fast chassis) would be pretty nice though16:39
apevecdmsimard, ^ is that possible?16:39
dmsimardnot sure what you mean16:40
dmsimardyou mean requesting a node from a particular chassis ?16:40
dmsimardIt's not possible right now, duffy doesn't have an API for that, no.16:40
trowndmsimard: ya, tripleo jobs are just not passing much on the other chassis' now16:40
dmsimardKhaleesi used to request nodes (and release them) until it got one of the kind it wanted and I'm really against that kind of implementation16:40
trownwell I did that ;P16:41
apevecwow that was evil :)16:41
dmsimardWe can ask KB if they can provide a feature to have something like that16:41
trownand it was actually only throwing back nodes with 16G of RAM16:41
dmsimardWould need to file a bug16:41
*** gszasz has quit IRC16:41
trownso it was 1/5 chassis getting thrown back, not 3/4 like this would require16:41
dmsimardI will file a bug and poke the team about it16:42
trownbut cico resolved that by decomissioning the 16G chassis (RIP hufty)16:42
*** d0ugal has joined #rdo16:45
*** mcornea has joined #rdo16:45
*** sdake_ has quit IRC16:46
dmsimardwhich is a shame because that chassis can be useful to every other job16:46
trownof course when I am trying to reproduce the issue it is all dusty
*** mosulica has quit IRC16:49
* trown gets lunch16:49
*** sdake has joined #rdo16:49
*** fultonj has quit IRC16:49
*** trown is now known as trown|lunch16:49
imcsk8jschlueter: hello, sorry i wasn't around16:50
dmsimardapevec, trown|lunch:
imcsk8jschlueter: i worked until very late and i overslept16:51
*** paramite has joined #rdo16:53
*** p01nt3r75 has quit IRC16:54
*** jargonmonk has joined #rdo16:55
apevecimcsk8, thanks for chasing that nova-net fix, it's now merged!16:55
rdogerritDavid Moreau Simard proposed config: WIP: Implement weirdo-dlrn integration matrix for distgit projects
imcsk8apevec: np, it took me while because there where other errors arund it and puppet had misleading outputs16:57
*** laron has quit IRC16:57
*** laron has joined #rdo16:58
*** jaosorior has quit IRC16:59
*** zoliXXL is now known as zoli|gone16:59
*** jaosorior has joined #rdo16:59
*** zoli|gone is now known as zoli_gone-proxy17:00
*** choirboy has joined #rdo17:00
*** florianf has quit IRC17:01
*** pkovar has quit IRC17:02
*** pilasguru has quit IRC17:03
jschlueterimcsk8: no problems, thank you much answering my questions as well along the way, I learned a bit about puppet and trying to resolve the issue17:06
imcsk8jschlueter: yeah i actually want to dig why puppet was showing that the user was created but in reality it was not17:08
*** chopmann has quit IRC17:08
imcsk8(if you can call database information reality :P )17:08
*** hynekm has quit IRC17:09
*** jlibosva1 has quit IRC17:09
*** cpg|away is now known as cpg17:12
*** paragan has quit IRC17:15
*** amuller is now known as amuller_afk17:18
*** athomas has quit IRC17:19
*** anilvenkata has quit IRC17:24
*** trown|lunch is now known as trown17:27
*** laron has quit IRC17:27
*** laron has joined #rdo17:28
openstackgerritMerged openstack/packstack: add number of workers for nova::conductor
*** athomas has joined #rdo17:30
*** ihrachys has quit IRC17:30
openstackgerritMerged openstack/packstack: add workers for heat::api and heat::engine
*** julim has joined #rdo17:34
*** oshvartz has quit IRC17:34
apevecdmsimard, trown, bad:
apevecha and packstack 003 failed17:35
*** jcoufal has quit IRC17:36
imcsk8apevec: checking...17:39
*** iberezovskiy is now known as iberezovskiy|off17:41
apevecimcsk8, looks like cirros image d/l failed17:41
*** degorenko is now known as _degorenko|afk17:41
*** Goneri has quit IRC17:41
imcsk8it's the warning osc_lib warning output17:42
apevecwarning doesn't break it17:42
imcsk8let me try to confirm it, some puppet modules are not prepared to deal with extra output from the commands17:44
*** fzdarsky|afk has quit IRC17:44
*** mvk has joined #rdo17:45
*** ebalduf has quit IRC17:45
apevecimcsk8, but right, EmilienM said when using osc puppet modules are doing retries, which puppet module is packstack using?17:49
imcsk8apevec: glance17:50
imcsk8i'm checking if it's inheriting from puppet-openstacklib17:51
imcsk8apevec: this is the output i get:
*** nyechiel has quit IRC17:52
jschlueterimcsk8: it could be one of 2 issues I can think of, one is nova network-list was not relying on nova but nova@service, the other is the puppet logic is open loop and doesn't verify the identity is actually created/propagated before moving on17:54
jschlueterthe propagation part might be the bit we got hit with17:54
EmilienMapevec: only providers that use osc17:55
EmilienMapevec: not all do, ie: nova network afik17:55
imcsk8jschlueter: might be the second one17:58
apevecright, so warning is ignored17:58
*** aortega has quit IRC17:59
*** julim_ has joined #rdo18:01
imcsk8i tested and the warning is not ignored18:01
*** mcornea has quit IRC18:02
trownweshay: fixes undercloud install issue18:02
weshaytrown, lolz18:03
weshayI assume there was some puppet change?18:03
weshayand why is tripleo not hitting that?18:03
weshayyou don't need to answer18:03
weshaypinche ci18:04
trownweshay: because there is an opt/stack dir on the nodepool nodes18:04
*** julim has quit IRC18:04
trownit would be hit by anyone outside of CI not just quickstart18:04
trown seems unrelated, but it the element it removes was creating that dir18:05
apevecwhy is that  folder included in nodepol image?18:05
apevecoh devstack?18:06
trownalso, puppet modules from source get put there18:06
weshaytrown, I'll open a bug18:08
weshaywas about to18:08
weshaykeep gettting intrupted18:09
apevecimcsk8, I see some 'Retrying' in the log18:09
trownk thanks18:09
apevece.g. openstack image list  was retried18:09
apevecbut openstack image create was not retired18:10
apevecin Packstack::Provision::Glance/Glance_image[cirros-uec-ramdisk]18:10
weshaytrown, adding to it now..
openstackLaunchpad bug 1605349 in tripleo "instack-undercloud fails to install, w/ touch: cannot touch ‘/opt/stack/.undercloud-setup’: No such file or directory" [Undecided,New]18:11
*** xinwu has joined #rdo18:14
imcsk8apevec: i'm trying to reproduce the error to confirm if it's related to the warning18:15
*** anilvenkata has joined #rdo18:15
*** anilvenkata has quit IRC18:16
trownweshay: there is yet another issue after the one I just put a patch up for :(18:22
trownException registering nodes: The requested action "provide" can not be performed on node "70104ab2-0414-4b49-b15f-7aa139ea074c" while it is in state "enroll".18:22
trownmust be an Ironic change since tripleo-ci doesnt see it18:23
*** amuller_afk is now known as amuller18:25
*** sasha2 has quit IRC18:26
*** shaunm has quit IRC18:26
* weshay pulls the latest image18:26
trownweshay: well you will have to get past the unmerged patch to get an undercloud install at all, but even with that there is another major issue18:27
weshayok... /me going to let the important folks know18:27
*** jaosorior has quit IRC18:27
dprinceEmilienM: Httpd fails to start due to a horizon issue in my dev environment.
dprinceEmilienM: just wondering if you've seen it? you were poking at Horizon today or yesterday right?18:28
*** eggmaster has quit IRC18:28
EmilienMdprince: with current master?18:28
dprinceEmilienM: master18:28
weshaytrown, apetrich is oddly hitting a bug w/ mitaka current passed ci18:29
EmilienMdprince: the only work I'm doing is and
apetrichtrown, here is the same thing but more readable
weshayapetrich, thinks it may be
apetrichbut it might be related to something else missing18:30
EmilienMdprince: see my question on
*** mcornea has joined #rdo18:30
*** jcoufal has joined #rdo18:30
EmilienMdprince: both patches are ready for review18:30
*** ihrachys has joined #rdo18:31
*** cwolferh has quit IRC18:32
dprinceEmilienM: +2 on your patch, also commented per your question18:33
dmsimardnumber80: I'm working on a gate job for the config repo that'll sanity check that every project in gerrit gerrit matches a pattern in gerrit replication.config, the gerritbot and the zuul layout18:33
dmsimardnumber80: There's a lot of problems :/18:34
EmilienMdprince: ack, I hope it help to fix horizon, otherwise I'll try it again18:35
dmsimardnumber80: this is just replication:
*** mcornea has quit IRC18:40
*** visbits has quit IRC18:40
*** devvesa has quit IRC18:40
*** jcoufal_ has joined #rdo18:44
*** jcoufal has quit IRC18:46
EmilienMhey, can someone review please?18:49
*** cwolferh has joined #rdo18:49
EmilienMoh I see number80 already reviewed it18:49
dmsimardEmilienM: sounds odd to me that it'd come up just now18:49
dmsimardlive migration over ssh/rsync is a common use case18:50
EmilienMdmsimard: michchap is actually fixing a bug18:50
dmsimardno one complained about that until now ?18:50
EmilienMdmsimard: yes it's currently not working afik18:50
dmsimardwth ?18:50
EmilienMthere is a workaround in doc18:50
EmilienMbelieve me or not18:50
michchapdmsimard: bug 1221776 in rhel-osp-director "nova migrate fails with ssh command failure" [High,Assigned] - Assigned to emacchi18:50
*** ihrachys has quit IRC18:51
dmsimardmichchap: I'm well aware nova should have a shell, I'm wondering why until now no one complained about that18:51
dmsimardmind boggling18:51
*** sasha2 has joined #rdo18:51
*** ihrachys has joined #rdo18:51
michchapdmsimard: hah, yep. I was also surprised. It's only for compute, right?18:52
*** maeca1 has quit IRC18:53
*** xinwu has quit IRC18:54
*** apevec_ has joined #rdo18:54
*** apevec_ has quit IRC18:54
*** apevec_ has joined #rdo18:54
*** apevec has quit IRC18:58
number80that's a bit in the gray area of packaging but not a bad compromise19:01
*** dpeacock has quit IRC19:01
*** laron has quit IRC19:01
*** laron has joined #rdo19:02
larsksdmsimard: that sounds familiar.  Oh, right:;a=commitdiff;h=7bbef2f8886e2ba5225825dea1b9ad6bf9cde94a19:02
dmsimardlarsks: 2014 :o19:03
michchaplarsks: and then we removed all the user mgmt code from puppet19:03
*** vaneldik has joined #rdo19:04
dmsimardnumber80: hang on for that nova change, I -3'd19:05
dmsimardI talked to dansmith about it, he has a good point19:05
dmsimardit's something that should be configured by the user -- if he's going to be doing live migrations over SSH, he's going to need to set up SSH keys and other things anyway19:06
dmsimardlive migrations can be done over libvirt/tcp as well19:06
michchapdmsimard: that means we're back to putting it in puppet19:07
dmsimardmichchap: but there is already a manifest to configure ssh live migrations iirc, no ?19:07
michchapdmsimard: yes but puppet won't touch the user at all, so it won't have a shell.19:07
michchapdmsimard: so to get it to work today, you pass in the keypair to puppet, and add this or equivalent:
michchapdmsimard: but what I have there is really hacky, and I want to fix it properly in tripleo19:09
mlammonsasha: ohochman: trown:  just finished deploying the RDO newton N2 overcloud successfully.  however, i see some failed actions..
dmsimardmichchap: yeah I understand all that, but I don't believe it's reasonable to default to a shell in packaging because puppet doesn't want to touch the user. I don't feel it's that much of a hack to have a nova user resource in puppet to set the shell.19:10
dmsimardmichchap: we removed POSIX users/permissions from most modules because we were managing too many things like /etc/nova and stuff19:11
larsksmichchap: that grep -q \$node is going to cause problems probably19:11
trownmlammon: nice one... the ceilometer issue is known... missing python-redis package on the overcloud images19:12
michchaplarsks: it's not idempotent atm. it doesn't need to be for opnfv because it's only for PoC19:12
larsksit could lead to nodes not getting added to the known_hosts file.19:12
larsksE.g., if you have node10 already in the file, then grep -q node1 will return true, so node1 wouldn't get added...19:12
michchaplarsks: it won't ever refresh19:12
michchaplarsks: it has refreshonly triggered from a file resource so it will only run once19:13
* larsks remains suspicious19:13
michchaplarsks: so node addition/removal isn't covered. For PoC this is fine, but I will write a native type for puppet-tripleo hopefully next week to do it properly19:13
*** ihrachys has quit IRC19:14
*** ashw has quit IRC19:14
*** ihrachys has joined #rdo19:16
michchapdmsimard: do you remember why the user resources were removed from puppet? iirc it was mainly because of uid/gid issues. Was there anything else?19:16
dmsimardmichchap: I have the bug nearby19:17
openstackLaunchpad bug 1458915 in puppet-swift "remove POSIX users, groups and file modes" [Medium,In progress] - Assigned to Emilien Macchi (emilienm)19:17
mlammontrown: thanks, is there a bug id i can reference?19:17
*** nmagnezi has quit IRC19:18
dmsimardmichchap: for the actual background/context of the removal, I forget.. so long ago19:18
number80dmsimard: well, at some point, I want nova people to interact with the damn reviews19:19
dmsimardnumber80: I interacted with a nova people on IRC :p19:20
number80if we keep pulling them, we're just spending time doing things and then reverting19:20
apevec_dmsimard, have them leave comments in review.rdo19:20
number80they're as much responsible of the package as we are19:21
apevec_really, w/o component teams starting to care about their rpm-master, dist isn't going to work19:22
number80dmsimard: not against you, you did right19:22
apevec_we have good examples w/ telemetry (pradk) and neutron (ihar et co)19:22
*** akrivoka has quit IRC19:22
number80egafford and tosky does their fair share w/ sahara19:22
number80(QE people have also their say as they tend to have good expertise on running services)19:23
trownmlammon: I am not finding it... it is a specific issue with the image build in RDO
trownmlammon: filing an issue there would make sense19:25
number80anyone contributing upstream is welcome to work on packaging (submitting/reviewing/commenting patchset)19:25
number80I mean anyone19:25
*** READ10 has quit IRC19:27
*** ihrachys has quit IRC19:27
number80the very core of good packaging is to know well the software you package19:29
number80if people keep relying solely on few individuals, then it's no good as we can't have expertise on all components19:30
*** choirboy is now known as choirboy|lunch19:30
mlammontrown: okay , thanks19:30
*** beagles is now known as beagles_biab19:30
*** jerrygb has quit IRC19:32
mlammonsasha: ohochmanlook at trown response ^^    do we need to try and resolve this or safe to move on with some tests?19:33
*** ihrachys has joined #rdo19:33
trownmlammon: `yum install -y python-redis` on overcloud controllers fixes it19:33
mlammontrown: ah, ok  thanks.19:36
dmsimardnumber80, apevec: any idea why puppet modules don't have repositories in rdo-packages ?19:38
dmsimardapevec_: ^19:38
rdogerritDavid Moreau Simard proposed config: WIP: Implement weirdo-dlrn integration matrix for distgit projects
*** sdake_ has joined #rdo19:39
*** sdake has quit IRC19:40
*** jerrygb has joined #rdo19:40
number80dmsimard: because they're puppet modules. Joke aside, no idea19:41
rdogerritDavid Moreau Simard created config: Add a sanity-check script to validate the config repository
dmsimardnumber80, tristanC:
dmsimardsee my comment for example output19:43
rdogerritDavid Moreau Simard proposed config: Add a sanity-check script to validate the config repository
*** shardy has quit IRC19:45
*** maeca1 has joined #rdo19:47
apevec_dmsimard, replication?19:47
apevec_distgit or patches?19:47
dmsimardapevec_: both19:47
apevec_we don't replicate any patches19:47
dmsimardapevec_: neither are in rdo-packages19:47
apevec_that doesn't make sense b/c patches are left unmerged19:47
apevec_and since puppet specs are generated, I don't think it's interesting to replicated them either19:48
dmsimardthey were generated originally, they're maintained afterwards ?19:49
dmsimardI don't care (that much) tbh, just looking at the output of my new script to detect inconsistencies in config
*** ihrachys has quit IRC19:50
tristanCdmsimard: reviewing now, shouldn't this be used by the config-check job ?19:50
dmsimardtristanC: yes, that's the point19:51
*** vaneldik has quit IRC19:51
dmsimardIt looks like we might want some level of freedom over what is replicated and isn't, though, so I need to bake that in19:51
tristanCdmsimard: running it locally, you need to add whitelist for project such as All-User19:52
dmsimardtristanC: yeah..19:54
dmsimardtristanC: the script is a safety net for me for the upcoming changes with the integrated jobs -- quite a refactor19:55
dmsimardthe fact that the config-check job passes doesn't mean that I didn't screw up :)19:55
*** lpabon has quit IRC19:56
*** flepied has quit IRC19:58
number80dmsimard: small changes here and there, including py3 compat20:03
number80we should prepare for that20:03
dmsimardsure, ty20:03
*** jprovazn has quit IRC20:04
*** laron has quit IRC20:04
zodbotnumber80: Karma for dmsimard changed to 4 (for the f24 release cycle):
*** brault has quit IRC20:05
*** hrww has joined #rdo20:09
*** gfidente is now known as gfidente|afk20:11
*** shardy has joined #rdo20:12
number80 <-- do not be surprised by the changes, I just made it future-proof20:12
*** iranzo has quit IRC20:13
* number80 wishes that RPM supported regular expressions rather than globbing20:13
*** newuser_rdo has quit IRC20:13
*** DaveJ__ has joined #rdo20:17
*** jeckersb is now known as jeckersb_gone20:19
rdogerritDavid Moreau Simard proposed config: Add a sanity-check script to validate the config repository
dmsimardnumber80, tristanC ^20:20
dmsimardand I'll even submit a follow-up patch to fix the detected errors :)20:20
number80dmsimard: good enough to be merged for me20:23
number80You even fixed the StringIO moves that I forgot20:24
*** akshai_ has quit IRC20:24
rdogerritDavid Moreau Simard created config: Add missing projects to gerritbot and alpha sort
dmsimardnumber80: now, what this script doesn't tell us, though, is if there are stale projects20:25
dmsimardi.e, projects configured in zuul that have been deleted from gerrit20:25
dmsimardI thought one-way verification with the gerrit project list being the source of truth was a good start20:25
dmsimardwe can iterate on that later20:25
*** ashw has joined #rdo20:25
*** pilasguru has joined #rdo20:26
number80dmsimard: that's still better than nothing20:26
number80can't wait to be at flock, I'll have plenty of time to hack :)20:27
dmsimardflock ?20:28
number80the fedora conference20:29
dmsimardtristanC: the sfmanager CLI is a bit tricky20:29
dmsimardsfmanager --url <url> command works20:30
* number80 does background tasks during conferences as he gets less interrupted20:30
*** egafford has quit IRC20:30
dmsimardbut not sfmanager command --url <url>20:30
*** egafford has joined #rdo20:31
number80argparse limitation20:31
dmsimardnumber80: so are these projects legit ?
dmsimardI guess qpid and tuskar could be deleted from gerrit20:31
dmsimardEmilienM: right? ^20:31
number80tuskar yes20:31
number80qpid wait for it, someone is working toward reintroducing them20:32
rdogerritDavid Moreau Simard proposed config: Add missing projects to gerritbot and alpha sort
apevec_trown, EmilienM is ready for +W now?20:35
*** laron has joined #rdo20:35
apevec_number80, not qpid20:35
trownapevec_: nope it is waiting on ovb job20:36
*** akshai has joined #rdo20:36
EmilienMapevec_: not yet, waiting for the job that deploys ovb undercloud20:36
apevec_how do you tell?20:36
*** shaunm has joined #rdo20:36
EmilienMtrown: feel free to +A it when green20:36
trownapevec_: in any case there is another issue preventing registering nodes in ironic, that does not even have a patch up20:36
trownI was trying to work on it, but the way mistral loads actions is befuddling me20:37
trownmy local hacks on the code seem to have no effect20:37
apevec_it's a wind, so blows your mind!20:37
richm"The answer my friends, is blowin' in the wind . . ."20:38
tristanCdmsimard: note that we are adding project listing, api_key authentication mechanism and sfmanager configuration file, cli usage should be improved soon20:40
*** abregman has joined #rdo20:42
tristanCthough in the meantime, what you propose sounds good to me20:42
*** dprince has quit IRC20:44
rdogerritDavid Moreau Simard created config: Add projects that are missing in the Zuul layout
*** maeca1 has quit IRC20:50
*** jeckersb_gone is now known as jeckersb20:51
*** pilasguru has quit IRC20:53
rdogerritDavid Moreau Simard proposed config: Add a sanity-check script to validate the config repository
*** pilasguru has joined #rdo20:53
rdogerritDavid Moreau Simard proposed config: Add a sanity-check script to validate the config repository
rdogerritDavid Moreau Simard proposed config: Add missing projects to gerritbot and alpha sort
rdogerritDavid Moreau Simard proposed config: Add projects that are missing in the Zuul layout
rdogerritDavid Moreau Simard proposed config: Add projects that are missing in the Zuul layout
*** shaunm has quit IRC20:55
apevec_trown, so we should pin ironic, to n2 tag ?20:58
apevec_when mistral was introduced in ironic?20:58
*** bfournie1 has joined #rdo20:59
rdogerritDavid Moreau Simard proposed config: Add projects that are missing in the Zuul layout
trownapevec_: it is not ironic problem, they have had current behavior since mitaka or liberty, it is tripleo/mistral issue21:00
rdogerritDavid Moreau Simard proposed config: Add missing projects to gerritbot and alpha sort
rdogerritDavid Moreau Simard proposed config: Add projects that are missing in the Zuul layout
trownapevec_: prior to the switch to mistral for node registration, tripleo pinned to a specific microversion of ironic api (1.11), but mistral does not have that pin21:00
apevec_ah microversion api, not version of ironic21:01
dmsimardapevec_: re: sanity-check and rdoinfo, yes .. maybe, in another iteration. Have to take into consideration review.rdo hosts projects that aren't involved with rdoinfo (easy example: weirdo and puppet-dlrn)21:01
*** bfournie has quit IRC21:01
apevec_tristanC, ^ dmsimard, right, we'd need to somehow mark which projects are imported from rdoinfo21:01
dmsimardapevec_: I can reverse check rdoinfo -> gerrit21:02
apevec_tristanC, is there something in SF datamodel for that?21:02
dmsimardinstead of gerrit -> rdoinfo21:02
apevec_ah yes, that will work21:02
dmsimardright now gerrit is the source of truth21:02
*** ccamacho has quit IRC21:02
apevec_but you would miss projects removed from rdoinfo like puppet-qpid21:02
dmsimarddefinitely want to do it, eventually :)21:03
rdogerritDavid Moreau Simard proposed config: Add projects that are missing in the Zuul layout
rdogerritDavid Moreau Simard created config: Add a config-sanity-check job to the config repository
dmsimard ready for review :)21:08
dmsimardIt's a pre-requisite to the ongoing work I've been doing to refactor the pipeline with integrated dlrn/weirdo jobs21:09
larsksAnybody around who is familiar with pbr?21:09
larsksActually, belay that, have to go pick up kids...21:09
*** unclemarc has quit IRC21:12
*** dustins has quit IRC21:13
*** julim_ has quit IRC21:14
number80I'm wondering if it's good idea or not to send internal DFG reports on the rdo-list21:18
*** trown is now known as trown|outtypewww21:19
*** bandini has quit IRC21:22
rdogerritMerged openstack/swift-distgit: Consolidate the code in the main package python-swift
*** laron has quit IRC21:24
*** ihrachys has joined #rdo21:25
*** laron has joined #rdo21:25
*** jlabocki has quit IRC21:28
*** ihrachys has quit IRC21:29
*** laron has quit IRC21:34
*** shardy has quit IRC21:39
*** Son_Goku has joined #rdo21:40
*** bfournie1 has quit IRC21:43
*** akshai has quit IRC21:51
*** dtrainor_ has joined #rdo21:53
*** dtrainor has quit IRC21:53
*** Son_Goku has quit IRC21:56
*** ihrachys has joined #rdo21:57
*** jmelvin has quit IRC21:59
*** dtrainor_ has quit IRC22:11
*** jayg is now known as jayg|g0n322:15
*** paramite has quit IRC22:16
*** apevec_ has quit IRC22:18
*** jeckersb is now known as jeckersb_gone22:19
*** mlammon has quit IRC22:21
*** sdake_ has quit IRC22:24
*** jeckersb_gone is now known as jeckersb22:27
*** dtrainor_ has joined #rdo22:29
*** eharney has quit IRC22:30
*** gfidente|afk has quit IRC22:38
*** KarlchenK has quit IRC22:39
*** imcleod has quit IRC22:42
*** kgiusti has left #rdo22:43
*** sdake has joined #rdo22:49
*** morazi has quit IRC22:51
*** ashw has quit IRC22:54
*** jargonmonk has quit IRC22:54
*** kaminohana has joined #rdo22:55
*** jerrygb has quit IRC22:55
*** akshai has joined #rdo22:57
*** ihrachys has quit IRC23:00
*** ashw has joined #rdo23:03
*** pilasguru has quit IRC23:04
*** ashw has quit IRC23:20
*** elmiko is now known as _elmiko23:21
*** chopmann has joined #rdo23:25
*** akshai has quit IRC23:26
*** pilasguru has joined #rdo23:33
*** saneax_AFK is now known as saneax23:33
*** zodbot has quit IRC23:44
*** zodbot_ has joined #rdo23:44
*** zodbot_ is now known as zodbot23:45
*** gildub has joined #rdo23:48
pabelangerdmsimard: number80: who do we need to talk to to enable rsync on
pabelangerno easy way to mirror the cloud images23:49
pabelangerbetter yet, adding them into mirror.centos.org23:50
*** danofsatx has joined #rdo23:51
*** jeckersb is now known as jeckersb_gone23:53
*** cpg is now known as cpg|away23:58

Generated by 2.14.0 by Marius Gedminas - find it at!