Tuesday, 2016-01-05

*** penick has quit IRC00:01
*** penick_ has joined #tripleo00:01
*** shivrao has quit IRC00:04
*** jrist has joined #tripleo00:04
*** penick_ has quit IRC00:45
*** penick has joined #tripleo00:56
*** eil397 has quit IRC00:57
*** shivrao has joined #tripleo01:00
*** penick has quit IRC01:09
*** shivrao has quit IRC01:12
*** weshay has quit IRC01:36
*** shivrao has joined #tripleo01:57
*** masco has joined #tripleo02:08
*** lazy_prince has joined #tripleo02:08
*** Goneri has joined #tripleo02:09
*** masco has quit IRC02:18
*** lazy_prince has quit IRC02:22
*** Goneri has quit IRC02:24
*** trozet has joined #tripleo02:28
*** lazy_prince has joined #tripleo02:29
*** cwolferh has quit IRC02:30
*** tzumainn has quit IRC02:53
openstackgerritMerged openstack/tripleo-heat-templates: Allow a user to specify a comma separated list of ntp servers  https://review.openstack.org/26101703:04
openstackgerritMerged openstack/tripleo-heat-templates: Introduce domain configuration through parameter  https://review.openstack.org/26101803:04
*** cwolferh has joined #tripleo03:04
openstackgerritMerged openstack/tripleo-heat-templates: Align some defaults with with ControllerCount default  https://review.openstack.org/26101903:04
openstackgerritMerged openstack/tripleo-heat-templates: Rename overcloud-without-mergepy to overcloud.  https://review.openstack.org/26015703:05
*** lazy_prince has quit IRC03:28
*** yamahata has quit IRC03:33
*** olap_ has quit IRC03:36
*** sthillma has quit IRC03:39
*** sthillma has joined #tripleo03:51
*** links has joined #tripleo03:52
*** lazy_prince has joined #tripleo03:52
*** sthillma has quit IRC03:52
*** anande has joined #tripleo03:57
*** anande has quit IRC03:58
*** yamahata has joined #tripleo04:01
*** trozet has quit IRC04:05
*** rook has quit IRC04:06
*** rook has joined #tripleo04:09
*** shivrao has quit IRC04:21
*** sthillma has joined #tripleo04:51
*** lazy_prince has quit IRC04:52
*** stendulker has joined #tripleo04:54
*** sthillma_ has joined #tripleo04:55
*** sthillma has quit IRC04:56
*** sthillma_ is now known as sthillma04:56
*** sthillma has quit IRC05:13
*** penick has joined #tripleo05:16
*** julim has joined #tripleo05:24
*** masco has joined #tripleo05:24
*** jaosorior has joined #tripleo05:37
*** coolsvap|away is now known as coolsvap06:02
*** jaosorior has quit IRC06:05
*** coolsvap is now known as coolsvap|away06:17
*** coolsvap|away is now known as coolsvap06:20
*** jaosorior has joined #tripleo06:26
*** shivrao has joined #tripleo06:50
*** shivrao has quit IRC06:58
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/tuskar: Replace deprecated LOG.warn with warning  https://review.openstack.org/26359607:05
*** ukalifon has joined #tripleo07:11
*** devvesa has joined #tripleo07:18
*** devvesa has quit IRC07:29
*** tremble has joined #tripleo07:36
*** tremble has joined #tripleo07:36
*** sthillma has joined #tripleo07:43
*** devvesa has joined #tripleo07:44
*** devvesa has quit IRC07:51
*** jprovazn has joined #tripleo07:53
*** jprovazn has quit IRC07:55
*** jprovazn has joined #tripleo07:56
*** coolsvap is now known as coolsvap|away08:00
*** jtomasek has joined #tripleo08:02
*** ifarkas has joined #tripleo08:07
*** bvandenh has joined #tripleo08:13
*** liverpooler has joined #tripleo08:13
*** tremble has quit IRC08:23
*** aufi has joined #tripleo08:24
*** shardy has joined #tripleo08:33
*** mcornea has joined #tripleo08:34
*** sthillma has quit IRC08:38
*** nico_auv has joined #tripleo08:48
*** devvesa has joined #tripleo08:50
*** sthillma has joined #tripleo08:54
*** sthillma has quit IRC09:13
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/tripleo-common: Replace deprecated LOG.warn with LOG.warning  https://review.openstack.org/26333009:15
*** coolsvap|away is now known as coolsvap09:17
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/tuskar: Replace deprecated LOG.warn with LOG.warning  https://review.openstack.org/26359609:19
*** jistr has joined #tripleo09:21
*** jcoufal has joined #tripleo09:22
*** athomas has joined #tripleo09:25
*** Marga_ has joined #tripleo09:38
*** akrivoka has joined #tripleo09:40
*** paramite has joined #tripleo09:41
*** jaosorior has quit IRC09:44
*** jaosorior has joined #tripleo09:44
jistrshardy: hi, just noticed your comment about the StructuredDeployments deprecation https://review.openstack.org/#/c/245314/8/puppet/swift-storage-post.yaml -- looks like a patch for this isn't yet submitted, can i submit it right now? should be a simple search & replace. (I'd do SoftwareDeployments rename too, according to http://docs.openstack.org/developer/heat/template_guide/unsupported.html)09:46
shardyjistr: Hi, no please don't yet - I was planning to but then I realized there's a heat bug, ref:09:47
openstackLaunchpad bug 1528958 in heat "SoftwareDeployments -> SoftwareDeploymentGroup update is destructive" [High,New] - Assigned to Rico Lin (rico-lin)09:47
shardyjistr: In reality, it will probably work OK, but it'll be safer to wait until that is fixed09:48
jistrshardy: ack, thanks for the info09:48
*** mkovacik has joined #tripleo09:50
*** mgould has joined #tripleo09:52
*** penick has quit IRC09:55
*** Marga_ has quit IRC09:55
*** jaosorior has quit IRC09:56
*** jaosorior has joined #tripleo09:56
*** oshvartz_ has joined #tripleo09:56
*** oshvartz_ is now known as oshvartz09:57
*** oshvartz has quit IRC09:57
*** oshvartz has joined #tripleo09:58
*** krickwix has quit IRC09:58
*** Marga_ has joined #tripleo10:06
*** paramite is now known as paramite|afk10:07
*** Marga_ has quit IRC10:09
*** yamahata has quit IRC10:10
*** bvandenh has quit IRC10:11
*** yuanying has quit IRC10:11
*** yuanying has joined #tripleo10:11
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Initial add of gentoo support for diskimage-builder  https://review.openstack.org/26334910:14
openstackgerritMerged openstack/tripleo-heat-templates: Wait for cluster to settle in yum_update.sh  https://review.openstack.org/25900910:19
*** dtantsur|afk is now known as dtantsur10:28
*** yuanying has quit IRC10:28
*** yuanying has joined #tripleo10:29
shardySimple stable review needs +A if anyone has a moment: https://review.openstack.org/#/c/263356/10:43
openstackgerritJaume Devesa proposed openstack/tripleo-heat-templates: Adding ManagementIpSubnet to linux bridge net conf  https://review.openstack.org/26366910:43
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Wait for cluster to settle in yum_update.sh  https://review.openstack.org/26367310:53
openstackgerritMerged openstack/tripleo-puppet-elements: controller: install python-redis  https://review.openstack.org/26335611:02
*** penick has joined #tripleo11:02
*** lucas-dinner is now known as lucasagomes11:03
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Add option to add metadata for the overcloud nodes  https://review.openstack.org/26015911:07
openstackgerritJaume Devesa proposed openstack/tripleo-heat-templates: Add a default proxy shared secret on MidoNet env  https://review.openstack.org/26367911:10
*** penick has quit IRC11:10
*** yuanying has quit IRC11:15
openstackgerritJaume Devesa proposed openstack/tripleo-puppet-elements: Use a stable version of MidoNet Neutron Plugin  https://review.openstack.org/26368111:19
*** paramite|afk is now known as paramite11:19
openstackgerritJaume Devesa proposed openstack/tripleo-puppet-elements: Update deric-zookeeper reference in midonet image  https://review.openstack.org/26368411:26
*** stendulker has quit IRC11:26
*** mbound has joined #tripleo11:29
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Pacemaker maintenance mode for the duration of Puppet run on update  https://review.openstack.org/25797611:48
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Add fixup for pcs order constraints after update to new templates  https://review.openstack.org/25849511:48
*** coolsvap is now known as coolsvap|away11:54
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Pacemaker maintenance mode for the duration of Puppet run on update  https://review.openstack.org/25797611:57
*** mbound_ has joined #tripleo12:01
*** mbound has quit IRC12:02
*** rhallisey has joined #tripleo12:11
openstackgerritDmitry Tantsur proposed openstack/os-cloud-config: [WIP] Rewrite node creating and updating code  https://review.openstack.org/26330912:12
*** olap_ has joined #tripleo12:15
*** Marga_ has joined #tripleo12:27
*** devvesa has quit IRC12:32
*** Marga_ has quit IRC12:33
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Allow for usage of pre-allocated IPs for the controller nodes  https://review.openstack.org/26016012:33
hewbroccamarios: while you're in there... have you seen bandini latest on systemd timeouts?12:36
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Add TimeZone parameter for all node types  https://review.openstack.org/24988612:36
marioshewbrocca: hi, have not ... mail thread? looking12:37
*** slagle has quit IRC12:38
bandinihewbrocca, marios: I will file bugs this afternoon and will reply to the thread with the BZ numbers12:41
* bandini off to lunch12:41
hewbroccabandini: thank you sir12:41
*** trown|outttypeww is now known as trown12:43
marioshewbrocca: bandini ok thanks12:45
*** thrash|g0ne is now known as thrash12:45
*** gfidente has joined #tripleo12:45
*** gfidente has quit IRC12:45
*** gfidente has joined #tripleo12:45
hewbroccamarios: I'm just thinking as long as you're working on the upstream patches, let's use the latest timeout numbers12:45
hewbroccathen at least we'll have it right in future versions12:45
marioshewbrocca: sure no problem, i haven't seen/checked the timeouts (up/down) for a while (am looking at stable/liberty branch cherry picks atm) but can have a look - the timeouts my michele seem sound and beekhof agrees so...12:48
*** devvesa has joined #tripleo12:51
*** dprince has joined #tripleo12:54
*** devvesa has quit IRC12:59
*** akrivoka has quit IRC13:07
*** bvandenh has joined #tripleo13:07
*** fandrieu_ has joined #tripleo13:07
*** links has quit IRC13:10
*** Marga_ has joined #tripleo13:10
openstackgerritMerged openstack/tripleo-heat-templates: Network Isolation support for containerized compute  https://review.openstack.org/25430413:10
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Add resources for major upgrade in Pacemaker scenario  https://review.openstack.org/25327613:11
jistrgfidente: ^ that could fix it13:11
*** Marga_ has quit IRC13:12
*** masco has quit IRC13:12
*** Marga_ has joined #tripleo13:12
gfidentejistr, I think we have to use OS::Heat::SoftwareDeployments13:13
gfidentejistr, appending just the trailing s13:14
jistryeah, though that's just deprecated name for the same thing (which i just learned this morning), the new name is SoftwareDeploymentGroup13:14
jistrwe should eventually switch all our instances of SoftwareDeployments into SoftwareDeploymentGroup13:15
gfidenteah right, just seen it, great thanks13:15
gfidenteso let me try a recheck on the one which triggers13:15
jistrbut there's a bug that if it's done with an existing SoftwareDeployments, it can be destructive13:15
jistrgfidente: one sec, i'll just rebase the top patch, i left it out13:16
*** rbrady has quit IRC13:16
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: TEST: this will help testing major upgrades  https://review.openstack.org/26045613:16
jistrgfidente: ^ alright, done13:16
gfidenteok takes a while but looks like we're on to something13:17
*** akrivoka has joined #tripleo13:19
*** rbrady has joined #tripleo13:20
*** aufi has quit IRC13:22
openstackgerritRyan Hallisey proposed openstack/tripleo-heat-templates: Use new heat-docker-agents images  https://review.openstack.org/25351513:24
*** Marga_ has quit IRC13:25
*** pradk has joined #tripleo13:27
gfidentejistr, thinking about it, the upstream test might hit a timeout during upgrade13:28
gfidenteassuming it gets that far13:29
jistrgfidente: yeah i thought of that too. Initially i thought the upgrade test would be a separate job.13:29
*** mbound_ has quit IRC13:30
jaosoriorjistr: Hey man, is this workaround still needed? https://github.com/jistr/inlunch/blob/master/answers.yml.example#L7013:31
jistrjaosorior: hm good question, i'm not sure. /me looks if there was a stable delorean bump for tripleo13:32
openstackgerritMerged openstack/tripleo-heat-templates: Add option to add metadata for the overcloud nodes  https://review.openstack.org/26015913:33
*** morazi has joined #tripleo13:33
*** weshay_xchat has joined #tripleo13:34
*** jayg|g0n3 is now known as jayg13:34
jistrjaosorior: yeah http://trunk.rdoproject.org/centos7/current-tripleo/ still has openstack-ironic-4.2.1-dev242.el7 so i think the workaround is still needed13:34
*** weshay_xchat is now known as weshay13:34
*** slagle has joined #tripleo13:35
jaosoriorjistr: alright. Though it's pretty strange, for some reason inlunch seems to get stuck there13:35
*** mbound has joined #tripleo13:38
*** ukalifon has quit IRC13:38
jistrjaosorior: hmm though without the workaround i don't think ironic would work. Can you try executing those by hand and see what's the scoop? https://github.com/jistr/inlunch/blob/master/answers.yml.example#L72-L7813:39
jistrjaosorior: btw did you run it first time or re-run it? i think i didn't make that workaround in an idempotent manner for re-execution (i surely didn't test for it). The whole step would get skipped if undercloud install succeeded, but if it didn't succeed and you'd re-run inlunch, that could be an issue.13:41
jaosoriorfunky, gets stuck in13:41
jaosoriorsudo patch -r /tmp/ironic-pxe-fix.rej -p2 /tmp/ironic-pxe-fix.patch13:41
jaosoriorfirst time13:41
jistrjaosorior: does rpm -q openstack-ironic print the version i pasted above?13:42
*** Goneri has joined #tripleo13:42
jaosoriorfor a very weird reason13:43
jaosoriorpackage openstack-ironic is not installed13:43
openstackgerritRyan Brady proposed openstack/tripleo-common: Organizes Swift exceptions into Swift Storage Backend  https://review.openstack.org/25851613:43
jistruhm that's probably just src package / meta package, sorry. Try openstack-ironic-common13:43
jistrjaosorior: ^13:43
openstackgerritMerged openstack/tripleo-heat-templates: Pacemaker maintenance mode for the duration of Puppet run on update  https://review.openstack.org/25797613:44
jistrhmm funky indeed13:44
jistrjaosorior: could you see if /usr/lib/python2.7/site-packages/ironic looks like this patch has already been applied? https://review.openstack.org/gitweb?p=openstack/ironic.git;a=patch;h=f968e1a22d3ed928278a04f0da9124678474ff0a13:45
*** miles has joined #tripleo13:46
*** aufi has joined #tripleo13:46
*** shardy has quit IRC13:47
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo: Haproxy has non-working Horizon session persistence.  https://review.openstack.org/25848313:47
jaosoriorjistr: it hasn't13:47
*** chem has joined #tripleo13:49
*** shardy has joined #tripleo13:49
chemhi cores, if you have 2 min to review a very simple one https://review.openstack.org/#/c/258483/13:50
chemit fixes bug https://launchpad.net/bugs/152678613:50
openstackLaunchpad bug 1526786 in tripleo "Haproxy has non-working Horizon session persistence." [Undecided,New]13:50
jistrjaosorior: oh my... my bad /o\13:50
jistrjaosorior: try   sudo patch -r /tmp/ironic-pxe-fix.rej -p2 < /tmp/ironic-pxe-fix.patch13:51
jistrmissing '<'13:51
jaosoriorjistr: that worked, thanks dude :D13:52
jistrjaosorior: cool, no problem :) so i think you can restart the ironic services, comment out the whole workaround in the answer file and re-run inlunch13:53
jaosoriorjistr: actually re-running inlunch had some problems with the setting of the repos13:53
jaosoriorlast time I tried13:53
*** dtantsur is now known as dtantsur|brb13:54
*** trozet has joined #tripleo13:54
jistrthat does ring a bell too13:55
jistrhmm i thought i fixed that but apparently i didn't13:55
jistrone sec13:55
jistrjaosorior: perhaps this, though i didn't test yet https://github.com/jistr/inlunch/commit/8ec18ea22faa7459c9c0ae8f4c612ce8b3c8652e13:57
jistrgit fails when the destination already exists, so that would surely prevent a re-run. Not sure if there's another idempotency problems somewhere13:58
jaosoriorI'll try that in a bit13:58
jaosorioralthough I whiped the environment already :P13:58
dprincemeeting time in 1 minute13:59
*** lucasagomes is now known as lucas-hungry14:00
*** miles has quit IRC14:01
*** mgould has quit IRC14:01
*** b3nt_pin is now known as beagles14:01
gfidentechem, thanks!14:03
*** mgould has joined #tripleo14:03
*** eggmaster has joined #tripleo14:03
chemgfidente: you're welcome14:03
*** trozet has quit IRC14:10
*** trozet_ has joined #tripleo14:12
*** oshvartz has quit IRC14:12
*** devvesa has joined #tripleo14:13
gfidentejistr, how about reusing timeout= here https://review.openstack.org/#/c/247014/5/extraconfig/tasks/pacemaker_resource_restart.sh ?14:20
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Add fixup for pcs order constraints after update to new templates  https://review.openstack.org/25849514:20
*** rpothier has joined #tripleo14:22
*** links has joined #tripleo14:24
*** oshvartz has joined #tripleo14:28
openstackgerritRyan Brady proposed openstack/tripleo-common: Organizes Swift exceptions into Swift Storage Backend  https://review.openstack.org/25851614:31
*** cmyster has quit IRC14:31
jistrgfidente: nah that's too strict for keystone14:32
gfidentejistr, well it gets is as argument14:33
jistrgfidente: crm_resource --wait in the "start keystone" phase will probably only exit when all resources are up, and the timeout for keystone starting is 300 secs14:33
*** kbyrne has quit IRC14:33
*** masco has joined #tripleo14:34
jistrgfidente: ok alternatively we could do it, but we'd have to bump the timeouts a notch up. (the keystone timeout bump shoul be significant then, e.g. 1800 or so)14:35
gfidenteit's getting weird because if we use 1800 in the function then the outer 300 would not be honored14:35
*** masco has quit IRC14:37
*** masco has joined #tripleo14:37
*** cmyster has joined #tripleo14:38
*** cmyster has quit IRC14:38
*** cmyster has joined #tripleo14:38
jistrgfidente: yeah i meant use a single value for both and make it 1800... i don't think it's likely that both the timeouts would be excercised to their full value, totalling an hour. Either everything's going to be fine, or keystone will not start -> using the first timeout mechanism and failing without going through the 2nd one, or something post-keystone will not start -> using the 2nd timeout mechanism while the 1st one probably passed14:39
jistrthrough relatively quickly.14:39
*** kbyrne has joined #tripleo14:40
jistrgfidente: but perhaps it would be best to use the solution from the other patch anyway14:40
jistrand not merge those two timeouts?14:40
gfidenteI vote for single14:40
gfidenteseems to represent better the caller expectations14:42
jistrsingle value used in both timeout mechanisms? or getting rid of the `pcs status | grep` entirely and only using crm_resource --wait? The added benefit of the grep is that it actually checks that the resource really is running, not sure if crm_resource does that too (maybe it would exit even if the start up failed, as failed cluster is a 'stabilized' cluster too? i don't know :) )14:43
jistrgfidente: ^14:43
*** dtantsur|brb is now known as dtantsur14:44
gfidenteyeah we need the grep14:44
gfidentesame timeout for both14:44
*** lblanchard has joined #tripleo14:44
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Bump the pacemaker service op_params to 185s for start and stop  https://review.openstack.org/26375114:45
marioshewbrocca: ^^14:46
jistrgfidente: alright, fine with me. Regardless of how many timeouts we have in the deployments, only one of them will trigger a deployment failure (or at least one per machine, unless we made a mistake somewhere), so i'm not concerned very much that the timeout for the grep mechanism is perhaps a bit longer than it needs to be. WFM14:46
hewbroccamarios: well done14:49
*** links has quit IRC14:49
mariosgfidente: jistr hmm we also need to bump those timeouts in yum_update.sh too seems we set 100s there explicitly14:49
gfidentemarios, right!14:49
hewbroccamarios: do the HA guys agree that it should be 185s for all services, or do we have to pick and choose or something?14:49
marioshewbrocca: well i just go tthe review out for now, we can tweak as necessary14:50
hewbroccamarios: excelent14:50
marioshewbrocca: didn't get a bz/upstream bug out yet or whatever14:50
hewbroccamarios: cool, can do that once bandini gets it filed14:50
gfidentemarios, also see my comment about mongodb14:51
marioshewbrocca: yeah thatn's the plan14:51
mariosgfidente: thanks14:51
*** tzumainn has joined #tripleo14:51
gfidentemarios, actually I think the start timeout for mongodb is even higher than 18514:51
* jistr would gladly accept a greater difference between pcmk vs. systemd than 5 seconds (say 15 or so)14:52
*** trozet_ has quit IRC14:52
* jistr is a bit skeptical after bumping the timeouts so many times :D14:52
*** kbyrne has quit IRC14:52
hewbroccajistr: +1 :)14:53
*** trozet_ has joined #tripleo14:53
*** kbyrne has joined #tripleo14:53
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Ensure cluster remains stable during services restarts  https://review.openstack.org/24701414:54
gfidente^^ some more timeouts, getting out of control :(14:54
*** kbyrne has quit IRC14:55
*** sbadia has left #tripleo14:57
* marios errand biab14:58
*** kbyrne has joined #tripleo15:00
*** kbyrne has quit IRC15:01
*** kbyrne has joined #tripleo15:02
*** slagle has quit IRC15:02
trowndprince: dtantsur, I tested https://review.openstack.org/#/c/263351 and modulo the commit message it worked for me15:02
dprincetrown: cool, sound like we can move forwards then15:02
trowndprince: I wonder if it would be possible to publish the rpms we create in CI in the job artifacts... would make local testing much easier15:03
openstackgerritDmitry Tantsur proposed openstack/python-tripleoclient: Allow to use the old deploy ramdisk  https://review.openstack.org/26335115:03
dtantsurtrown, dprince ^^15:04
bnemectrown: I'm actually publishing rpms for some of the projects: https://repos.fedorapeople.org/repos/openstack-m/jenkins/rpm-build/15:04
dprincetrown: it is probably possible, but I don't think we have anywhere setup currently to store these RPMs15:04
bandinihewbrocca, marios: https://bugzilla.redhat.com/show_bug.cgi?id=129583015:04
openstackbugzilla.redhat.com bug 1295830 in openstack-tripleo-heat-templates "Increase timeout defaults for pacemaker" [High,New] - Assigned to jason.dobies15:04
bnemecStrangely this is the second time in the past hour this has come up.15:04
bandinihewbrocca: do I just clone it for 7.x ?15:04
bnemecI don't think I'm building tripleoclient right now though.15:04
trownbnemec: really?15:04
dtantsurI do wonder why we should rerun the whole CI on the commit message change >_<15:04
bnemecdtantsur: If it passed CI before the commit message change we can just merge it as soon as the check jobs come back.15:04
bnemecThis very much falls under the expedited approval rules.15:05
dtantsurok :)15:05
trownthanks dtantsur for the quick patch15:05
*** lucas-hungry is now known as lucasagomes15:05
bnemectrown: I can add tripleoclient easily.15:06
trownbnemec: cool, so I would just look up the change-id there... pretty neat15:07
bnemectrown: Yeah.  On gerrithub I had a bot account that actually left a link on the review, but I haven't gotten around to figuring out how to make that happen in upstream gerrit.15:08
*** sthillma has joined #tripleo15:09
trownbnemec: cool, manually finding it (now that I know it exists) is still way easier than installing/setting up delorean for a single package build15:10
bnemectrown: Yeah, that was pretty much my reasoning too. :-)15:11
bnemecIt should be building on future patch sets now: https://repos.fedorapeople.org/repos/openstack-m/jenkins/rpm-build/263351-2/15:11
trownbnemec: awesome, thanks!15:11
*** mbound has quit IRC15:12
*** paramite is now known as paramite|afk15:19
*** trozet_ is now known as trozet15:20
openstackgerritMerged openstack/tripleo-heat-templates: Remove deleted Nova rows  https://review.openstack.org/20790915:21
*** bvandenh has quit IRC15:23
hewbroccabandini: that all looks great. I just dev-acked them both15:26
hewbroccamarios, jistr if you guys have any further questions on the timeouts, bandini is the guy to ask :)15:27
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Enable configuration of Neutron QoS  https://review.openstack.org/24705615:27
*** jobewan has joined #tripleo15:27
*** olap_ has quit IRC15:31
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Making nova parameters configurable for nuage-metadata-agent  https://review.openstack.org/26377315:33
*** oshvartz has quit IRC15:33
*** egafford has joined #tripleo15:33
jistrbandini: hi, i was just wondering if it would be a bit better to make the 'scheduling delta' higher than 5 seconds (say 15) to play it safe(r). Sometimes we're deploying on VMs where things are kinda slow, so i wonder if this could result in a mild time skew. E.g. systemd tries for 90 seconds, but during high machine load it might only start the 2nd attempt 92 seconds after the first one or so, etc. (I don't know if this can happen for real,15:35
jistrbut i wouldn't be very surprised if it did.) We constantly see warnings from pacemaker that 'machine load is high' on VMs.15:35
*** fandrieu__ has joined #tripleo15:35
*** shardy has quit IRC15:35
*** akrivoka has quit IRC15:37
jistr(i didn't mean time skew of system clock, but rather the "unmeasured" operations between the timeouts simply taking too long)15:37
bandinijistr: that is a very valid question, to which only trial and error can give an answer. My five seconds came entirely from a gut feeling ;) I think a few seconds more won't really hurt, so 10 or 15 is okay for me (as long as it is not much more than that)15:37
jistryeah 15 seconds is also just my gut feeling :)15:37
*** fandrieu_ has quit IRC15:38
bandiniI think we will improve the spurious fencing situation by a lot even with 185, anything above that won't hurt15:39
bandiniI am fine with 190 or 195 too15:39
bandiniif we want to play it safer and possibly change less in the future let's go for 195 and call it a day ;)15:39
bnemecmarios: Reviewed https://review.openstack.org/#/c/24116715:40
jistrbandini: alright thanks :)15:40
*** ayoung has quit IRC15:41
*** shardy has joined #tripleo15:44
egaffordHi all. Rebasing and modifying the Sahara and Trove patches, against the possibility that there may be some time for review coming up. Question, though: I'm building a stack from master as per http://docs.openstack.org/developer/tripleo-docs/, and I'm seeing the Controller resource fail: http://paste.openstack.org/show/483035/15:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Manage keystone initialization directly in t-h-t manifests  https://review.openstack.org/24416215:45
*** paramite|afk is now known as paramite15:45
*** absubram has joined #tripleo15:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: endpoint_map: bump nova api from 2.0 to 2.1  https://review.openstack.org/26336615:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: WIP - Deploy Aodh services, replacing Ceilometer Alarm  https://review.openstack.org/24140815:46
egaffordI noted a bug closed in August, which may be relevant, or at least presents the same symptom: https://bugzilla.redhat.com/show_bug.cgi?id=122695715:46
openstackbugzilla.redhat.com bug 1226957 in rhel-osp-director "CREATE_FAILED for overcloud deploy on baremetal, 1 node active, 1 in error state: "BadRequest: Expecting to find username or userId in passwordCredentials"" [High,Closed: errata] - Assigned to jason.dobies15:46
egaffordAny thoughts?15:46
mariosbnemec: appreciated15:51
*** akrivoka has joined #tripleo15:51
bnemecegafford: The doc flow is unfortunately broken _a lot_ because developers mostly don't use it.  I think tripleo.sh has some workarounds you may need: http://docs.openstack.org/developer/tripleo-docs/advanced_deployment/tripleo.sh.html15:52
*** pblaho has quit IRC15:53
egaffordbnemec: Rock rock on. Thanks!15:53
egaffordbnemec: Looks easy enough to inject my dev stuff into. Much appreciated, again.15:54
bnemecegafford: Yeah, I believe the important ones to use the script for are repo-setup, undercloud, and overcloud images.  The other stuff should work as documented.15:56
bnemecAlthough I haven't actually done a deployment in weeks, so take my advice with a grain of salt. :-)15:56
egaffordbnemec: I'll take anything that's more up to date than what I had.15:57
egaffordBeyond that, question: what's currently the state of the art for actually modifying the codebase within this framework? Is there any built-in ability to have local changes propagate into your cloud instead of remote ones?15:58
egaffordbnemec: ^15:58
*** weshay_xchat has joined #tripleo15:58
*** bvandenh has joined #tripleo16:00
*** weshay has quit IRC16:01
bnemecegafford: One option is to push your changes and use the pending review functionality documented here: http://docs.openstack.org/developer/tripleo-docs/basic_deployment/basic_deployment_cli.html#get-images16:01
egaffordbnemec: Yeah, saw that; does that work for repos used outside of the image build process?16:02
*** devvesa has quit IRC16:03
egaffordIt clearly works for Puppet, which is great as pushing puppet modules into an image was pretty janky before that feature. (Thanks!)16:03
*** rebrego has joined #tripleo16:03
*** regebro is now known as Guest4935516:03
*** rebrego is now known as regebro16:04
bnemecegafford: Depends on what you're trying to do.  The undercloud install has the same thing, but I'm not sure if that method works for non-puppet things.16:04
egaffordbnemec: Ack. Will poke, and will probably just end up doing my push-repos-in-from-my-laptop-after-undercloud thing.16:05
egaffordThanks for the hand.16:05
*** slagle has joined #tripleo16:05
bnemecegafford: In case it's helpful, there are rpm builds for proposed changes here: https://repos.fedorapeople.org/repos/openstack-m/jenkins/rpm-build/16:06
bnemecI frequently use that for testing non-puppet things.16:06
*** aufi has quit IRC16:07
*** pblaho has joined #tripleo16:07
*** jobewan is now known as jobewan_away16:07
*** pblaho has quit IRC16:10
*** pblaho has joined #tripleo16:11
*** shakamunyi has joined #tripleo16:14
openstackgerritMerged openstack-infra/tripleo-ci: Don't build everything in periodic jobs  https://review.openstack.org/24451916:15
*** regebro has quit IRC16:15
openstackgerritMerged openstack-infra/tripleo-ci: Set DELOREAN_REPO_URL for the master periodic job  https://review.openstack.org/24452616:15
*** barra204 has quit IRC16:15
*** pblaho has quit IRC16:17
*** pblaho has joined #tripleo16:17
*** pblaho has quit IRC16:20
*** pblaho has joined #tripleo16:20
*** pblaho has quit IRC16:22
*** pblaho has joined #tripleo16:22
jaosoriorany reviews for these two? https://review.openstack.org/#/c/254771/  https://review.openstack.org/#/c/258634/16:25
*** fandrieu__ has quit IRC16:26
*** pradk has joined #tripleo16:26
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Bump the pacemaker service op_params to 200s for start and stop  https://review.openstack.org/26375116:30
*** alop has joined #tripleo16:32
*** ayoung has joined #tripleo16:35
*** olap_ has joined #tripleo16:36
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Add ExtraConfig to cinder storage role  https://review.openstack.org/25371016:36
*** jobewan_away is now known as jobewan16:37
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Add ExtraConfig to cinder storage role  https://review.openstack.org/25371016:38
openstackgerritMerged openstack/python-tripleoclient: Make the undercloud install test discoverable  https://review.openstack.org/25641016:39
openstackgerritMerged openstack/puppet-tripleo: Enable X-Forwarded-Proto header for keystone_public  https://review.openstack.org/25477116:43
*** bvandenh has quit IRC16:43
*** weshay__xchat has joined #tripleo16:44
*** pblaho has quit IRC16:44
*** pblaho has joined #tripleo16:44
*** dprince has quit IRC16:45
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Bump the pacemaker service op_params to 200s for start and stop  https://review.openstack.org/26375116:45
*** weshay_xchat has quit IRC16:47
*** jobewan is now known as jobewan_away16:47
*** dprince has joined #tripleo16:50
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Add ExtraConfig to cinder storage role  https://review.openstack.org/25371016:52
*** pblaho has quit IRC16:54
openstackgerritMerged openstack/puppet-tripleo: Enable X-Forwarded-Proto header for Heat and Nova  https://review.openstack.org/25863416:54
*** pblaho has joined #tripleo16:54
*** pblaho has quit IRC16:56
*** pblaho has joined #tripleo16:57
openstackgerritMerged openstack/tripleo-heat-templates: Changes for configuring Nuage  https://review.openstack.org/26039717:02
*** ayoung has quit IRC17:03
jaosoriorThanks for the reviews :D17:07
*** pblaho has quit IRC17:07
*** pblaho has joined #tripleo17:07
*** jobewan_away is now known as jobewan17:08
*** paramite is now known as paramite|afk17:09
*** jistr has quit IRC17:19
openstackgerritMerged openstack/puppet-tripleo: Sahara integration  https://review.openstack.org/22085917:21
*** paramite|afk is now known as paramite17:21
openstackgerritMerged openstack/puppet-tripleo: Trove integration  https://review.openstack.org/23323217:23
*** liverpooler has quit IRC17:25
*** mbound has joined #tripleo17:29
*** tremble has joined #tripleo17:31
*** tremble has joined #tripleo17:31
*** tremble has left #tripleo17:33
*** mbound has quit IRC17:34
*** shardy has quit IRC17:34
*** shardy has joined #tripleo17:36
*** dtantsur is now known as dtantsur|afk17:42
*** liverpooler has joined #tripleo17:42
*** jaosorior has quit IRC17:44
*** jaosorior has joined #tripleo17:44
*** jaosorior has quit IRC17:45
*** jaosorior has joined #tripleo17:45
dprinceshardy: hey, could you review this one https://review.openstack.org/#/c/248500/17:46
shardydprince: sure, will do17:47
*** liverpooler has quit IRC17:47
shardydprince: it's weird that we're maintaining the v2.0 suffix for ironic/swift auth_url's17:48
dprinceshardy: my interest there is this is required for Mistral17:48
dprinceshardy: yeah, that was required to keep CI passing17:48
shardyI thought everything was moving to unversioned endpoints, that's what we've done for Heat recently w/devstack for example17:48
dprinceshardy: I don't think Ironic inspector properly handles keystone v317:48
shardydprince: k, I guess we can work that out later then17:48
dprinceshardy: fwiw there is also one other v2 URL for the nova -> Ironic URL that I'm not switching in this patch17:49
dprinceshardy: will loop back around to fix those later...17:49
*** yamahata has joined #tripleo17:49
shardydprince: it sounds like mistral is doing something wrong too, if it requires auth_uri to be versioned17:51
shardywe had to add some version discovery keystoneclient stuff to heat to avoid that17:51
dprinceshardy: it doesn't17:51
dprinceshardy: it just requires keystone v317:51
shardykeystone_auth_uri: http://{{LOCAL_IP}}:5000/v317:52
shardythat's going to set the auth_token auth_uri to a versioned endpoint isn't it?17:52
dprinceshardy: yep, I see no harm in that17:52
dprinceshardy: it is the latest... and would get chosen if you unversioned it anyways17:53
shardydprince: well, it's wrong, we had a devstack hack workaround for heat which I recently removed17:53
jaosoriorit has to be versioned for now, as the default I think ends up being 2.0 anyway17:53
openstackgerritJames Slagle proposed openstack/tripleo-image-elements: Don't set default install type for os-cloud-config to pip  https://review.openstack.org/26382817:53
*** trown is now known as trown|lunch17:54
dprinceshardy: why is pinning to a version wrong17:54
shardydprince: I'm fine with landing it for now, but we need to look towards moving away from versioned endpoints, AFAIK it's not right to move from v2.0 to v3 endpoints17:54
shardydprince: because everything requires updating whenever an API version change happens17:54
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates: Keystone domain for Heat  https://review.openstack.org/18056617:54
shardywhich is why moving folks to keystone v3 has been *so* difficult17:55
shardythere are hardcoded v2.0 references everywhere17:55
dprinceshardy: if you don't version then don't you risk breaking things if keystone bumps a new version then. Which may require client changes as well?17:55
shardythe keystone folks fixed it in nearly all clients, by adding version discovery17:55
shardywhich handles detecting and using the latest version17:55
shardydprince: I think the idea is keystoneclient abstracts things sufficiently that you should, in many cases, require versioned interfaces17:56
shardyauth_uri =
shardythat's what my heat.conf auth_uri looks like on devstack FWIW17:57
shardydprince: I suspect the issue is mistralclient can't do version discovery, but I'm fine with landing this as an interim fix if it works I guess17:58
shardyI'm just quite sensitive to the v2.0/v3 thing because it's been a real headache for heat, which has long relied on v3 features17:59
openstackgerritJames Slagle proposed openstack/instack-undercloud: Use enable-packages-install element  https://review.openstack.org/26382917:59
shardyit should be possible to e.g consume v4 features when they happen, just by discovering the verion is available - you shouldn't need to reconfigure every service in your cloud18:00
dprinceshardy: I'm open to using versionless if it works and gets us on v3 sooner18:00
dprinceshardy: I will confirm w/ keystone and update accordingly then18:01
shardydprince: kk, perhaps we should confirm with ayoung or jamielennox, AIUI versionless is the reccommendation but most keystone docs still reference hard-coded v2.0 everywhere18:01
openstackgerritMiles Gould proposed openstack/python-tripleoclient: Use Ironic API v1.11 to support ENROLL state  https://review.openstack.org/26383118:04
*** nico_auv has quit IRC18:07
*** mgould has quit IRC18:07
*** mkovacik has quit IRC18:11
*** mcornea has quit IRC18:19
*** paramite has quit IRC18:22
*** eil397 has joined #tripleo18:25
*** masco has quit IRC18:26
*** athomas has quit IRC18:27
*** ifarkas has quit IRC18:33
*** sthillma has quit IRC18:34
dprinceshardy: https://bugs.launchpad.net/ironic-inspector/+bug/153123618:35
openstackLaunchpad bug 1531236 in Ironic Inspector "ironic os_auth_url doesn't support keystone v3" [High,Triaged]18:35
*** sthillma has joined #tripleo18:35
egaffordbnemec: Ping18:37
bnemecegafford: pong18:37
openstackgerritDan Prince proposed openstack/instack-undercloud: Switch default keystone auth_uri to versionless  https://review.openstack.org/24850018:38
openstackgerritDan Prince proposed openstack/instack-undercloud: Install mistral (workflow) in the undercloud  https://review.openstack.org/24850618:38
dprinceshardy: Switched it to versionless...18:38
egaffordbnemec: Heyup. I'm using tripleo.sh now, and seem to be seeing much the same issue as earlier, or at least a very similar one.18:38
dprinceshardy: thanks for the help...18:38
egaffordAt the moment, my Compute and Controller servers are stuck spinning on CREATE_IN_PROGRESS, and my ironic nodes are in provisioning state "wait call-back". If this continues to previous plan, I'll likely see the same error as I did with the docs in a (significant) while.18:39
egaffordAny known issues you're abreast of that might be indicated?18:40
bnemecegafford: Sounds like an Ironic deployment issue.  Can you get on the console of the ironic nodes?18:40
egaffordI think I should be able to rebase the Sahara and Trove heat templates reasonably smoothly if I can get an env up, but I'm loathe to push anything without seeing it all go.18:41
bnemecIt sounds like there is probably an issue with the deploy ramdisk talking back to Ironic.18:41
bnemecegafford: I'm actually doing a deployment right now and didn't have that problem, and CI is passing so I don't think there's anything fundamentally broken.  Is this a virt environment?18:43
*** jaosorior has quit IRC18:43
*** akrivoka has quit IRC18:44
egaffordbnemec: Yeah, this is an instack-virt-setup spanwed env.18:44
egaffordtripleo.sh from there.18:44
egaffordCentOS Linux release 7.2.1511 (Core)18:44
bnemecegafford: Oh, CentOS.  I think that may be a problem.18:44
egaffordbnemec: Ah...18:45
*** sthillma has quit IRC18:45
egaffordWhat's the gold standard atm?18:45
egaffordI thought CentOS was the OS for upstream dev?18:45
bnemecegafford: Yeah, but there was a problem because it had an old ipxe: https://bugs.launchpad.net/tripleo/+bug/150773818:45
openstackLaunchpad bug 1507738 in tripleo "ipxe fails on Centos 7 (inc: command not found)" [Critical,Triaged]18:45
bnemecIt appears to be fixed in Ironic, but unless we've updated our CI repo pin we may not have it yet.18:46
egaffordbnemec: What distro and version would you recommend using?18:46
egaffordRHEL 7.2 with upstream TripleO?18:47
*** ayoung has joined #tripleo18:47
bnemecegafford: I'm not sure.  I actually use fedora 21 as my host, but I'm running in OVB so that won't work for you (I'm pretty sure instack-virt-setup doesn't work on fedora).18:48
bnemecI actually don't know what other people are using for development. :-/18:48
egaffordbnemec: The CI is running a baremetal deploy, I assume, because that's sane and reasonable?18:49
bnemecegafford: CI is running in some sort of custom virt environments.  I suspect it's actually still on an old fedora because most of that was deployed a long time ago and hasn't been touched since.18:50
egaffordOkay. So what I'm hearing (no judgment, just reflection) is that there is no known good instack-virt-setup (single node) deployment path that spawns a functional overcloud from master at the moment. Is that true?18:52
openstackgerritLucas Alvares Gomes proposed openstack/python-tripleoclient: Use the grub2 element instead of grub2-deprecated  https://review.openstack.org/26384618:53
lucasagomesquick patch ^18:53
egaffordbnemec: Given that I don't really have a ton of hardware, what's your suggestion for how to spawn a viable overcloud?18:55
bnemecegafford: I'm not sure.  I don't personally use instack-virt-setup, but I have to think most other developers are.18:55
bnemecslagle: What does your dev environment look like?  re: egafford's issues running on centos above.18:55
slaglei use centos718:56
slagleyou're only going to get that ipxe error though if your vm's have mutliple nics, i dont think mine do18:56
slagleto workaround it, you just need to use the latest http://boot.ipxe.org/undionly.kpxe18:57
bnemecslagle: I don't think that's true.  It does the inc the first time through the loop.18:57
slagleok i probably just have http://boot.ipxe.org/undionly.kpxe then18:58
bnemecYeah, we definitely don't have the ironic fix in our current pinned repo.  I just installed an undercloud this morning and it still has the old boot.ipxe.18:59
bnemecslagle: So egafford is probably right that we don't have a working out of the box virt-setup right now. :-(19:00
egaffordbnemec, slagle: Ok, let's assume for a moment that I'm a Hadoop/Python/Java/database guy, and don't know how and where to inject that file into my env. How do I do? :)19:00
*** bswartz has joined #tripleo19:00
slaglewell if you know Java, you're already smarter than me19:00
slagleyou'd just put undionly.kpxe under /tftpboot19:00
egaffordslagle: I'm gonna go out on a limb and suggest that they're separate and non-hierarchical skillsets. :)19:01
egaffordslagle: If I do that on my instack node, then respawn the overcloud, will that (to your knowledge) work? Do I need to repack images? Do I need to blow away my virsh domains and re-instack?19:02
slaglenot that i know of19:02
egaffordslagle: I made the mistake of asking too many questions. Let me ask one: Should I:19:06
egaffordA) Delete my overcloud heat stack, copy undionly.kpxe into my instack env, use my pre-existing undercloud and images to spawn a new overcloud.19:06
egaffordB) Delete my overcloud heat stack, copy undionly.kpxe into my instack env, delete and rebuild my glance images, spawn a new overcloud using my pre-existing undercloud.19:06
egaffordC) Delete my virsh domains on my baremetal server, use instack-virt-setup to recreate them, copy undionly.kpxe into my instack env and spawn a new undercloud.19:06
egaffordD) Delete my virsh domains on my baremetal server, copy undionly.kpxe into my baremetal server, use instack-virt-setup to recreate my env, copy undionly.kpxe into my instack node, proceed.19:06
egaffordThere are a lot of layers of this onion, and test cycles are reasonably long. Thanks for the help.19:07
*** penick has joined #tripleo19:11
egaffordOkay, I'll just start experimenting. Thanks.19:11
beaglesgfidente: is there any reason why backporting https://review.openstack.org/#/c/187506/ wouldn19:12
beaglesgfidente: should've ended with "wouldn't be valid?"19:12
beaglesgfidente, as in backport to stable/liberty that is... I see someone already posted a patch in December, but its currently  in merge conflict19:13
*** mkovacik has joined #tripleo19:19
*** trown|lunch is now known as trown19:20
slagleegafford: try A, if that doesnt work, we'd likely need some ironic expertise when those folks are back online19:23
egaffordslagle: Cool; started with B, but that's a superset. Thanks!19:23
openstackgerritMerged openstack/tripleo-heat-templates: compute/ceilometer: use internalURL for os endpoint type  https://review.openstack.org/26340319:24
*** penick has quit IRC19:30
*** mkovacik has quit IRC19:37
slagleEmilienM: i'd like to look into moving off the ironic-conductor element in instack-undercloud and use puppet-ironic exclusively19:37
slagleEmilienM: one thing i wasnt sure of though was if puppet-ironic took care of this bit: https://github.com/openstack/tripleo-image-elements/blob/master/elements/ironic-conductor/install.d/69-ironic-tftp-support19:37
*** gfidente has quit IRC19:38
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates: Add IPv6 Support to Isolated Networks  https://review.openstack.org/23542319:43
*** jprovazn has quit IRC19:45
*** jcoufal has quit IRC19:46
EmilienMslagle: that's a very good idea19:50
EmilienMslagle: no, puppet-ironic only aims to manage ironic services19:50
EmilienMfor https://github.com/openstack/tripleo-image-elements/blob/master/elements/ironic-conductor/install.d/69-ironic-tftp-support -- we would need to write some custom manifests19:50
EmilienMwhich is not a big deal19:50
EmilienMslagle: I also have a question for you, can I drop all tuskar related puppet code in uc & oc ?19:51
openstackgerritJames Slagle proposed openstack/instack-undercloud: Remove unused scripts  https://review.openstack.org/26388119:57
openstackgerritJames Slagle proposed openstack/instack-undercloud: Remove unused elements  https://review.openstack.org/26388219:57
slagleEmilienM: yea, you can kill all tuskar stuff19:58
slagleEmilienM: do you think the puppet manifests for that ironic conductor stuff would go in puppet-ironic or puppet-stack-config in instack-undercloud?19:58
*** weshay__xchat is now known as weshay19:59
*** lucasagomes is now known as lucas-dinner19:59
*** ayoung has quit IRC19:59
EmilienMI'm thinking19:59
openstackgerritMerged openstack/python-tripleoclient: Passes to os-cloud-config Keystone{Admin,Internal}Vip  https://review.openstack.org/25914420:00
EmilienMslagle: I would rather see it in puppet-tripleo for a first shoot. So we can use it from uc & oc (eventually one day). If we realize it can live in puppet-ironic, we'll move it but I think puppet-tripleo is a nice start.20:00
EmilienMslagle: I can write that code if you want20:01
slagleyea, puppet-tripleo makes sense, i didnt think of that20:01
*** mkovacik has joined #tripleo20:01
EmilienMok I'll do it20:02
EmilienMslagle: urgent or not urgent?20:02
slagleEmilienM: not urgent20:02
slaglewas just poking around in instack-undercloud and looking to clean some old stuff up20:03
EmilienMcool, I like cleaning too20:03
bnemecEmilienM: slagle: Speaking of cleaning up old broken things: https://review.openstack.org/#/c/258028/20:10
*** ayoung has joined #tripleo20:10
egaffordslagle: Looks as though this issue may be persistent (for me) even with the new undionly.kpxe, suggesting to me that I may be missing another step somewhere. Still "wait call-back" indefinitely.20:25
openstackgerritMerged openstack/python-tripleoclient: Don't build images with rdo-release by default  https://review.openstack.org/25207320:28
*** sparkyco_ has joined #tripleo20:36
*** weshay has quit IRC20:38
*** jobewan is now known as jobewan_away20:42
openstackgerritDmitry Tantsur proposed openstack/python-tripleoclient: Install python-hardware package on the agent image by default  https://review.openstack.org/26322520:42
*** jobewan_away has quit IRC20:43
slagleegafford: ok, well there's the guy lurking who can help you ^^20:45
slagleegafford: to confirm, you have the boot.ipxe fix that uses inc? and are using the latest undionly.kpxe?20:47
slagleif so, that should fix it, assuming it's the known issue20:47
slagleotherwise, it's possible you're hitting a new issue20:47
egaffordslagle: I had not heard of a "boot.ipxe fix that uses inc" until that line, or at least, did not interpret it if I heard it.20:48
egaffordIs there any record of this issue and a workaround?20:49
egaffordI am using the latest undionly.kpxe.20:49
slagleit's the bug bnemec pointed out earlier20:49
*** penick has joined #tripleo20:51
slagleegafford: do you see any error on the console of the vm's that it's trying to provision?20:51
egaffordslagle: Okay, cool, so I need to bring Ironic up to https://review.openstack.org/#/c/244530/ (though this has -1s at present.) Is that accurate?20:51
slagleif you use that patch, you shouldn't need the newer undionly.kpxe20:52
egaffordI see, so the undionly.kpxe should be the only required fix.20:52
slaglewhat do you have in /httpboot/boot.ipxe now?20:52
egafford(That was my previous understanding, so that's (sort of) good.)20:52
slaglecan u pastebin it?20:52
egaffordI just started a fresh env; when I get there I'll let you know.20:53
*** weshay has joined #tripleo20:53
slaglei thought you said it was stuck in wait call-back?20:53
egaffordI'm trying a run in which I set absolutely no variables (including node_count and the like,) just to remove every imaginable confound.20:53
egaffordYes, that's correct. After a half hour of waiting, though, I trashed the env and restarted.20:54
dprincebnemec: hey so I'm just going to revert to /v3 for https://review.openstack.org/#/c/248500/20:57
bnemecdprince: I have no strong opinions on that so I'll +2 anything that passes CI. :-)20:59
dprincebnemec: yeah, I switch to versionless to accomidate shardy21:00
dprincebnemec: I think keystone would also prefer us to use versionless21:00
dprincebnemec: but not all services support that yet apparently as we are discovering. I already filed a ticket on the inspector issue :/21:01
bnemecdprince: Yeah, I'm guessing nobody wants us on v2, so anything that gets us off that seems like a step in the right direction.21:01
openstackgerritMerged openstack/instack-undercloud: Create auth endpoints for Ironic Inspector  https://review.openstack.org/26020721:02
shardydprince: Sorry if versionless didn't work out, I'm fine with the v3 thing as an interim step, I can help look into the steps needed to move to versionless (perhaps service by service?) later21:02
*** ayoung has quit IRC21:02
dprinceshardy: it is cool. I tried it :)21:02
shardydprince: it went pretty smoothly with Heat, but we've converted to keystonclient sessions & auth plugins21:03
dprinceshardy: I think I tried this a month ago as well. Just couldn't remember all the fallout21:03
shardyif other services are still using the legacy keystonclient python iterfaces, I guess things may not work as easily21:03
shardydprince: ack, OK well sorry for the inconvenience, I just wanted to raise it as a potential issue21:04
dprinceshardy: np, I did file an issue on the ironic inspector stuff21:04
dprinceshardy: https://bugs.launchpad.net/ironic-inspector/+bug/153123621:04
openstackLaunchpad bug 1531236 in Ironic Inspector "ironic os_auth_url doesn't support keystone v3" [High,Triaged]21:04
dprinceshardy: no surprise there really... we still use keystoneclient.v2_0.client directly there21:05
shardydprince: ah OK, sessions and auth plugins are the "new" way, I can potentially help w/fixes if needed as I've been fairly involved in the heat->keystone stuff21:06
egaffordslagle: Possible theory: do I need to restart any ironic services in my undercloud after replacing undionly.kpxe?21:08
slagleegafford: i dont know for sure21:08
egaffordslagle: That's fair.21:08
slagleif anything, it would be httpd21:08
slaglethat's what is serving /httpboot21:09
slagleerr, actually it's under /tftpboot21:09
slaglewhich is tftpd, which is xinetd21:09
slaglei dont really know if any of that needs to be restarted21:09
openstackgerritDan Prince proposed openstack/instack-undercloud: Switch default keystone auth_uri to v3  https://review.openstack.org/24850021:12
openstackgerritDan Prince proposed openstack/instack-undercloud: Install mistral (workflow) in the undercloud  https://review.openstack.org/24850621:12
dprinceshardy, bnemec, slagle: back to previous v3 https://review.openstack.org/248500. If you could ack it I would like to send once it passes CI21:13
dprinceit should pass as it is the same as the previous version...21:13
trozetEmilienM: I see you have done work on puppet-aodh, any idea if it is supported or plan support in tht?21:13
EmilienMtrozet: I wrote the module :)21:14
EmilienMtrozet: https://review.openstack.org/24141221:14
EmilienMand https://review.openstack.org/24140821:14
trozetEmilienM: some folks on the Doctor project for OPNFV asking for it to be included in our next release21:14
EmilienMI'm working on both overcloud & undercloud21:14
EmilienMit will be21:14
trozetEmilienM: cool, overcloud is all we really care about.  Any time frame for this? we release on Feb 2nd21:15
EmilienMtrozet: doing my best to make it before then21:16
trozetEmilienM: if you want, we could help you21:16
EmilienMcode is all writen but does not pass CI yet21:16
EmilienMI'm working on that but yeah, feel free to help me on the overcloud21:16
EmilienMapache does not start and I need to figure why21:16
trozetEmilienM: OK I'll talk to the OPNFV folks then get back to you21:17
EmilienMif you have a working setup, you can apply the patch21:17
trozetEmilienM: thanks21:17
EmilienMtrozet: let me know if you can help on that21:18
*** rhallisey has quit IRC21:18
openstackgerritMerged openstack/tripleo-heat-templates: Add fixup for pcs order constraints after update to new templates  https://review.openstack.org/25849521:19
*** jobewan has joined #tripleo21:20
*** chlong has quit IRC21:22
*** weshay has quit IRC21:26
*** weshay has joined #tripleo21:40
egaffordslagle: I've now gotten back to the failing stage. In my instack node, I have no file in either /httpboot/boot.ipxe nor /tftpboot/boot.ipxe.21:41
egaffordThere are files under /httpboot/{node-uuid}/config21:42
egaffordslagle: Ah, nvm; perms. Dumb. Contents of /httpboot/boot.ipxe: http://paste.openstack.org/show/483081/21:45
egaffordThere really is not a file /tftboot/boot.ipxe.21:45
*** thrash is now known as thrash|g0ne21:49
slagleegafford: do you see an error on the consoles of the vm?21:52
egaffordI haven't managed to succeed in ironic node-get-console, and I'm cmdline only atm (haven't routed UI through.)21:53
slaglethe console through ironic isn't going to work in a virt environment afaik21:53
slagleso you'd have to use virt-manager or something21:53
*** mkovacik has quit IRC21:54
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Deploy Logging on the undercloud with Puppet  https://review.openstack.org/25865321:56
*** rpothier has quit IRC21:58
*** penick has quit IRC21:58
*** sparkyco_ has quit IRC22:00
*** penick has joined #tripleo22:00
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Deploy Monitoring on the undercloud with Puppet  https://review.openstack.org/25370922:02
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Deploy Logging on the undercloud with Puppet  https://review.openstack.org/25865322:02
*** lblanchard has quit IRC22:03
EmilienMslagle: is it ok to land https://review.openstack.org/241412 for you?22:03
*** sparkyco_ has joined #tripleo22:05
prometheanfireanything more I need to do for this? https://review.openstack.org/#/c/263349/22:05
bnemecEmilienM: There's one thing missing in that patch.  I left a comment.22:05
EmilienMbnemec: for undercloud_aodh_password ?22:06
bnemecEmilienM: Yes, all of those params should also be in https://github.com/openstack/instack-undercloud/blob/master/undercloud.conf.sample#L7522:07
bnemecOther than that it looks fine to me.22:07
EmilienMI missed that22:07
* EmilienM doing a patchset22:07
EmilienMok thx bnemec22:07
bnemecI wonder if instack-undercloud has stable enough options that we could add a sample config check job.22:08
bnemecI know it caused a lot of headaches in other projects, but we have a lot fewer options and don't expose any options from other libraries.22:08
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Deploy Aodh services, replacing Ceilometer Alarm  https://review.openstack.org/24141222:09
EmilienMbnemec, dprince ^22:09
*** trown is now known as trown|outttypeww22:09
*** sparkyco_ has quit IRC22:10
bnemecprometheanfire: Left a couple more comments, but overall I'm good with it now.22:18
prometheanfireand replied22:20
prometheanfireI'll update the irc channel to #gentoo-virtual but that's it, the profiles are what we use upstream22:20
*** egafford has quit IRC22:21
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Initial add of gentoo support for diskimage-builder  https://review.openstack.org/26334922:22
prometheanfirebnemec: ^22:23
prometheanfireactually removed the irc chan comment entirely22:23
greghaynesprometheanfire: Hey, so I know I mentioned the workaround for install-packages of just exiting, but to get gentoo support added I'd like to see if we can make emerge work too22:26
*** jayg is now known as jayg|g0n322:26
greghaynesprometheanfire: is there a reason it'd be especially hard for that to work? I would expect it to 'just work'...22:27
openstackgerritBen Nemec proposed openstack/instack-undercloud: Remove option of installing tuskar  https://review.openstack.org/25802822:30
EmilienMbnemec: you'll need to patch puppet-elements too22:34
EmilienMbnemec: see https://review.openstack.org/26391922:34
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: toci_gate_test/overcloud/non-ha: enable monitoring  https://review.openstack.org/25478722:37
bnemecEmilienM: Yeah, I don't mess with puppet-elements.  I'll make a note to send in the request to remove the module though.22:37
openstackgerritBen Nemec proposed openstack/instack-undercloud: Remove option of installing tuskar  https://review.openstack.org/25802822:38
* bnemec forgot to regenerate the config :-)22:38
slaglei'm just going to keep +2'ing22:38
*** dprince has quit IRC22:40
bnemecslagle: I'm all about helping your review stats ;-)22:42
bnemecAlthough not as much as I helped shardy's when I made reviewstats start counting stable reviews properly.22:42
*** zaneb has quit IRC22:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Allow to enable Monitoring agent on Overcloud Controller(s)  https://review.openstack.org/25478822:58
*** zaneb has joined #tripleo23:02
*** absubram has quit IRC23:02
*** yuanying has joined #tripleo23:03
*** rhallisey has joined #tripleo23:04
*** chlong has joined #tripleo23:12
*** dmacpher has joined #tripleo23:13
*** chlong has quit IRC23:14
*** morazi has quit IRC23:18
openstackgerritMerged openstack/instack-undercloud: Switch default keystone auth_uri to v3  https://review.openstack.org/24850023:25
*** jobewan is now known as jobewan_away23:29
*** mbound has joined #tripleo23:29
*** jobewan_away has quit IRC23:29
*** shardy has quit IRC23:30
*** penick has quit IRC23:30
*** chlong has joined #tripleo23:30
*** weshay has quit IRC23:31
openstackgerritMerged openstack/instack-undercloud: Deploy Aodh services, replacing Ceilometer Alarm  https://review.openstack.org/24141223:32
*** mbound has quit IRC23:34
*** eil397 has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!