Thursday, 2016-12-01

*** jcoufal has quit IRC00:00
*** bfournie has quit IRC00:01
*** ctayal has quit IRC00:04
*** absubram has joined #tripleo00:04
*** ctayal has joined #tripleo00:05
openstackgerritDan Prince proposed openstack/python-tripleoclient: Deploy the undercloud with Heat  https://review.openstack.org/35135100:19
*** dmarlin has quit IRC00:25
*** sanagikoki has quit IRC00:29
*** limao has joined #tripleo00:29
*** numans has quit IRC00:39
*** egafford has quit IRC00:42
*** egafford has joined #tripleo00:45
*** achadha has joined #tripleo00:54
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates: Use the local collector to bootstrap deployed servers  https://review.openstack.org/40503201:11
*** Goneri has quit IRC01:12
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates: Use the local collector to bootstrap deployed servers  https://review.openstack.org/40503201:13
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates: Use transient hostname for deployed servers  https://review.openstack.org/40495401:13
*** dsneddon_ has joined #tripleo01:15
*** rajinir has quit IRC01:16
*** dsneddon_ has quit IRC01:20
*** dmacpher-afk has quit IRC01:25
*** penick has quit IRC01:29
*** dsneddon_ has joined #tripleo01:44
*** dsneddon_ has quit IRC01:48
openstackgerritMerged openstack/diskimage-builder: Trace package install in package-installs-v2  https://review.openstack.org/40104801:52
*** dhill_ has quit IRC01:55
*** dhill__ has joined #tripleo01:56
*** pmannidi has quit IRC01:58
*** bana_k has quit IRC01:58
*** pmannidi has joined #tripleo02:00
openstackgerritDan Prince proposed openstack/os-collect-config: Add support for Zaqar websockets  https://review.openstack.org/34248602:13
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Make pep8 task run template generation  https://review.openstack.org/39441502:15
*** ctayal has quit IRC02:17
*** ctayal has joined #tripleo02:17
*** cwolferh has quit IRC02:26
*** ctayal has quit IRC02:32
*** ctayal has joined #tripleo02:33
*** ctayal_ has joined #tripleo02:34
*** ctayal has quit IRC02:34
*** ctayal_ has quit IRC02:34
*** yamahata has quit IRC02:37
*** bkopilov has quit IRC02:38
*** fzdarsky_ has joined #tripleo02:41
openstackgerritMerged openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/40077602:42
*** dmacpher-afk has joined #tripleo02:43
*** fzdarsky|afk has quit IRC02:45
*** achadha has quit IRC02:49
*** saneax-_-|AFK is now known as saneax02:56
*** flepied has joined #tripleo02:57
*** cwolferh has joined #tripleo03:06
*** rodrigods_ is now known as rodrigods03:15
openstackgerritDan Prince proposed openstack/tripleo-puppet-elements: Install hiera orc files via install.d  https://review.openstack.org/40507503:15
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Hiera optimization: use a new hiera hook  https://review.openstack.org/38475703:17
openstackgerritDan Prince proposed openstack/python-tripleoclient: Deploy the undercloud with Heat  https://review.openstack.org/35135103:20
*** absubram has quit IRC03:21
*** Goneri has joined #tripleo03:23
*** ctayal has joined #tripleo03:30
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates: GATE TEST, please ignore  https://review.openstack.org/36544903:30
*** bfournie has joined #tripleo03:32
*** ctayal_ has joined #tripleo03:33
*** ctayal has quit IRC03:34
*** cwolferh has quit IRC03:37
*** Goneri has quit IRC03:50
*** flepied has quit IRC03:53
*** flepied has joined #tripleo03:53
*** prateek has joined #tripleo03:55
*** bkopilov has joined #tripleo04:02
*** bana_k has joined #tripleo04:08
*** bana_k has quit IRC04:17
*** absubram has joined #tripleo04:21
*** absubram_ has joined #tripleo04:25
*** absubram has quit IRC04:26
*** absubram_ is now known as absubram04:26
*** sudipto_ has joined #tripleo04:35
*** sudipto has joined #tripleo04:35
*** saneax is now known as saneax-_-|AFK04:36
*** chandankumar|off is now known as chandankumar04:59
*** jbadiapa has quit IRC04:59
*** links has joined #tripleo05:00
*** rlandy has quit IRC05:02
*** masco has joined #tripleo05:07
*** udesale has joined #tripleo05:10
*** prateek_ has joined #tripleo05:11
*** prateek has quit IRC05:14
*** cwolferh has joined #tripleo05:14
*** yamahata has joined #tripleo05:15
*** parora has joined #tripleo05:15
*** jbadiapa has joined #tripleo05:15
*** ramishra has quit IRC05:16
*** prateek_ has quit IRC05:17
*** ramishra has joined #tripleo05:18
*** dmacpher-afk has quit IRC05:27
openstackgerritMerged openstack/diskimage-builder: elements: zypper-minimal: Add ca-certificates-mozilla package  https://review.openstack.org/40431505:28
*** dmacpher has joined #tripleo05:32
*** Vijayendra has joined #tripleo05:35
*** numans has joined #tripleo05:40
*** Vijayendra has quit IRC05:42
*** pmannidi_ has joined #tripleo05:48
*** pmannidi has quit IRC05:48
*** pmannidi_ is now known as pmannidi05:48
*** Vijayendra has joined #tripleo05:59
*** sudipto has quit IRC06:03
*** sudipto has joined #tripleo06:03
*** sudipto_ has quit IRC06:04
*** sudipto_ has joined #tripleo06:05
*** parora has quit IRC06:13
*** prateek has joined #tripleo06:13
*** jaosorior has joined #tripleo06:19
*** leanderthal|afk is now known as leanderthal06:23
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173806:29
*** dmacpher has quit IRC06:35
*** lmiccini has joined #tripleo06:36
*** saneax-_-|AFK is now known as saneax06:45
*** jbadiapa has quit IRC06:45
*** ealcaniz has joined #tripleo06:48
apetrichMorning07:01
*** pgadiya has joined #tripleo07:02
*** ctayal_ has quit IRC07:05
*** jaosorior has quit IRC07:09
*** florianf has joined #tripleo07:09
*** iranzo has joined #tripleo07:09
*** jaosorior has joined #tripleo07:10
*** oshvartz has joined #tripleo07:20
*** yprokule has joined #tripleo07:20
*** bana_k has joined #tripleo07:22
*** jprovazn has joined #tripleo07:25
*** rasca has joined #tripleo07:27
*** abregman has joined #tripleo07:27
*** ctayal has joined #tripleo07:34
openstackgerritMerged openstack/diskimage-builder: elements: pip-and-virtualenv: Add python-xml dependency  https://review.openstack.org/40015007:34
*** anshul has joined #tripleo07:36
openstackgerritMerged openstack/tripleo-validations: Fixes undercloud-tokenflush validation  https://review.openstack.org/40468807:38
mariosgerrit 503 :/07:39
jaosoriormarios: it's being restarted07:39
mariosty jaosorior07:39
jaosoriormarios: should be fine now07:40
jaosorioryolanda: by the way, did you rebase on top of the commit that gets the logs from the home dir? what was the dib issue?07:45
*** cylopez has joined #tripleo07:51
*** jbadiapa has joined #tripleo07:53
ccamacho|afkmorning guys!07:58
*** ccamacho|afk is now known as ccamacho07:58
*** dciabrin|away is now known as dciabrin07:58
*** bana_k has quit IRC08:02
*** slagle has quit IRC08:05
*** cschwede has quit IRC08:05
*** psanchez has quit IRC08:06
*** stevebaker has quit IRC08:07
*** zoli|gone is now known as zoli08:07
*** gchamoul has quit IRC08:07
*** jlinkes has joined #tripleo08:10
*** arxcruz has joined #tripleo08:11
*** bana_k has joined #tripleo08:11
yolandajaosorior, it was a duplicated element map-services08:12
yolandathe problem is that map-services goes dropped in a new version of dib, and i'm preparing a change for it08:12
yolandabut seems the CI was picking an old dib version08:12
yolandaso it found that dupe08:12
*** jlinkes_ has joined #tripleo08:12
*** lhinds has quit IRC08:13
*** misty-cloud has joined #tripleo08:14
*** rnoriega has quit IRC08:14
*** dtantsur|afk is now known as dtantsur08:14
*** cwolferh has quit IRC08:15
misty-cloudhi all08:15
*** jlinkes has quit IRC08:16
misty-cloudwhat is the difference between "OS::Heat::" vs "OS::TripleO::"08:16
misty-cloudis it namespacing ?08:16
misty-cloudany links which explains this?08:16
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Refactoring current upgrade scripts for composable upgrades  https://review.openstack.org/40344108:18
*** jbadiapa has quit IRC08:19
*** numans has quit IRC08:20
jaosoriormisty-cloud: so, OS::TripleO are usually heat resources that are not standard and are only defined in the TripleO scope (you'll find them in tripleo-heat-templates)08:21
jaosoriormisty-cloud: OS::Heat resources are official, and related to the heat project08:21
misty-cloudok08:21
ccamachomisty-cloud https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml08:21
jaosoriormisty-cloud: you can find documentation about the resources supported by the heat team here http://docs.openstack.org/developer/heat/template_guide/openstack.html08:22
jaosoriormisty-cloud: and, the link that ccamacho pointed out, is the TripleO-specific resource definitions08:22
*** jpena|off is now known as jpena08:22
misty-cloudOS::TripleO is for undercloud and OS::Heat for overcloud, can we say that?08:22
jaosoriorso, we could say that OS::TripleO resources are only  used for tripleo-related stuff, that has to do with deploying the overcloud08:24
jaosoriorwe also use OS::Heat stuff though, that's why I wouldn't say that OS::Heat is only for the overcloud08:24
*** dobson has quit IRC08:24
misty-cloudok08:25
*** dobson has joined #tripleo08:25
misty-cloudyes agree08:25
misty-cloudThanks08:25
*** zoli has quit IRC08:25
*** marios has quit IRC08:26
*** marios has joined #tripleo08:28
*** ccamacho has quit IRC08:28
*** shardy has joined #tripleo08:29
*** ccamacho has joined #tripleo08:30
*** bana_k has quit IRC08:31
*** zoliXXL has joined #tripleo08:33
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Use command instead of env var for setting the hostname in the undercloud  https://review.openstack.org/40471708:34
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173808:34
jaosoriorsshnaidm: ^^ added ::108:34
*** b00tcat has joined #tripleo08:34
*** rcernin has joined #tripleo08:34
sshnaidmjaosorior, great, thanks08:35
*** george_goh has quit IRC08:36
*** numan_ has joined #tripleo08:36
jaosoriorshardy: hey dude, could you check this out? https://review.openstack.org/#/c/404752/08:36
*** george_goh has joined #tripleo08:37
*** rcernin has quit IRC08:37
*** anshul has quit IRC08:37
*** rcernin has joined #tripleo08:37
shardyjaosorior: do we only need those logs for ovb jobs?08:40
shardyI was wondering if we should be updating the value of TARCMD in ./scripts/common_vars.bash08:40
*** yamahata has quit IRC08:41
jaosoriorshardy: cause TARCMD doesn't only run for the undercloud, it does for the overcloud nodes as well08:41
jaosoriorand there shouldn't be relevant logs in the homedir08:42
jaosorioror even logs at all08:42
shardyjaosorior: Ok, but what about multinode jobs, e.g line 222 ?08:42
jaosoriorshardy: that could happen08:42
jaosoriorsshnaidm: do you know what user runs that for the multinode jobs?08:43
shardyI'm just thinking we want the collected logs to be consistent for all jobs wherever possible08:43
jaosoriorshardy: sure, only thing is I don't exactly know which user it is08:43
jaosoriorso I didn't add it08:43
jaosoriorshardy: is it OK if I investigate that and push a subsequent commit adding that?08:43
jaosoriorshardy: right now, that commit hopefully lets yolanda continue with her work08:44
*** fzdarsky_ has quit IRC08:44
*** amoralej|off is now known as amoralej08:44
yolanda++ , it was very useful for me08:44
matbuif someone can review this it would be awesome: https://review.openstack.org/40481208:46
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Include logs in the undercloud's home directory for multinode jobs  https://review.openstack.org/40518408:46
sshnaidmjaosorior, I think it's the same08:46
jaosoriorshardy: added it in a second commit ^^ so yolanda won't need to rebase08:46
shardyjaosorior: sure, or we could just use $USER in both places?08:46
*** jpich has joined #tripleo08:46
sshnaidmjaosorior, actually "$HOME" could work too08:47
jaosoriorok, I'll just squash the two commits and use $HOME08:47
jaosorioryolanda: heads up, so you can rebase08:47
*** yamahata has joined #tripleo08:47
yolandaok08:47
*** panda|Zz is now known as panda08:48
shardyunrelated to the patch but HA is broken for all stable branches08:48
pandawhile talking about logging ... anyone interested in approving this ? https://review.openstack.org/40081708:48
pandashardy: oh, looking08:49
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Include logs in the undercloud's home directory  https://review.openstack.org/40475208:49
shardymatbu: lgtm, I can't approve it but perhaps yolanda can help?08:49
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Refactoring current upgrade scripts for composable upgrades  https://review.openstack.org/40344108:50
yolandachecking08:50
*** ctayal has quit IRC08:50
*** ebarrera has joined #tripleo08:50
*** ctayal has joined #tripleo08:50
yolandaapproved08:51
*** anshul has joined #tripleo08:51
pandaperiodic HA jobs on stable branches this morning all succeded08:51
shardypanda: Hmm, maybe it's a spurious failure then, but both newton and mitaka HA jobs failed in https://review.openstack.org/#/c/404752/208:54
shardyit looks like a real failure to bring up the cluster08:54
*** ctayal has quit IRC08:57
matbushardy: yolanda thanks08:57
matbushardy: i added this yesterday, idk if you catch it https://review.openstack.org/40483108:58
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Refactoring current upgrade scripts for composable upgrades  https://review.openstack.org/40344108:59
matbuyolanda: how many times does it take to be pushed ?08:59
yolandawaht do you mean?08:59
shardymatbu: nice, thanks!09:00
matbuyolanda: i mean when the review is merged,  the jjb should be applied09:00
shardymatbu: I'll break up my WIP patch this morning so we can test it with your patch :)09:00
yolandait will run every 30 minutes09:00
yolandaso between 30 min-1 hour it shall be done09:01
matbuccamacho: btw did your upgrade was working ? i got some 503 on services09:01
matbushardy: ack cool :)09:01
*** ohamada has joined #tripleo09:01
ccamachohey matbu morning, there are some services not starting correctly because of some db-sync issues, but the overall process is working fine, what im doing right now it to run  the db sync for the services and get the errors like the one for the neutron db sync09:04
*** prateek has quit IRC09:07
matbuccamacho: ack , i got only the neutron db sync failure09:08
pandashardy: package list is the same of a working job from this morning. What else could have changed ?09:08
matbuccamacho: the other looks good ... at least ansible didn't failed on the db sync09:08
ccamachomatbu Im redeploying it Ill let you know asap :)09:08
shardypanda: not sure tbh, lets see if ps3 fails09:09
*** hogepodge has quit IRC09:11
shardyhttps://review.openstack.org/#/c/403106/ can land if anyone has a moment09:11
*** hogepodge has joined #tripleo09:12
openstackgerritJulie Pichon proposed openstack/tripleo-ui: Relax JSON input validation  https://review.openstack.org/40520509:13
openstackgerritSteven Hardy proposed openstack/tripleo-common: Add heat-agent-ansible to overcloud-images.yaml  https://review.openstack.org/40520709:16
pandajaosorior: curious, about https://review.openstack.org/404717 what changes /etc/hosts after changing hostname ?09:16
*** milan has joined #tripleo09:17
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Use FQDN for rabbitmq's nodename env variable  https://review.openstack.org/40354709:18
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Use network-based fqdn entry from hiera instead of the custom fact  https://review.openstack.org/40361909:18
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Introduce network-based FQDNs via hiera  https://review.openstack.org/40361809:18
*** gchamoul has joined #tripleo09:19
jaosoriorpanda: so, for instance, something in the CI environment adds the tripleo-centos-7-tripleo-test-cloud-rh1-5889750 entry09:19
jaosoriorpanda: on another instance, it's never satisfactory for my use-case, where I need an FQDN, so I need to change it myself in the TLS everywhere job09:20
jaosoriorand that $HOSTNAME variable was messing it up, sot he ipa-client-install was failing09:20
*** jlinkes_ has quit IRC09:21
*** jlinkes__ has joined #tripleo09:21
pandajaosorior: that's clear, I wanted to understand what changes the hostname after a node is booted. Whatever it is, it's changing /etc/hosts too. If it didn't you could find yourself searching for the new hostname in /etc/hosts that doesn't exist because it hasn't been changed.09:23
jaosoriorpanda: ??09:25
jaosoriorpanda: if it hasn't been changed it would then just place the hostname in front of the localhost entry09:26
*** cwolferh has joined #tripleo09:26
openstackgerritFlavio Percoco proposed openstack/python-tripleoclient: Use the absolute path for temp templates  https://review.openstack.org/40521709:26
*** dtantsur is now known as dtantsur|bbl09:27
pandajaosorior: no, because you're looking for the new one before changing it  in /etc/hosts09:28
*** rcernin has quit IRC09:29
*** rcernin has joined #tripleo09:30
*** hogepodge has quit IRC09:31
jaosoriorpanda: that's the point, if the new one isn't there, I change it.09:31
jaosoriorand add it there09:32
*** hogepodge has joined #tripleo09:32
pandajaosorior: oh. I didn't see the "!"09:32
pandajaosorior: but the doubts remain. If the hostname change happens on the undercloud install, you're just putting the old fqdn in /etc/hosts.09:34
*** lucas-afk is now known as lucasagomes09:36
*** derekh has joined #tripleo09:36
*** tremble has joined #tripleo09:37
*** tremble has joined #tripleo09:37
*** tremble has quit IRC09:37
jaosoriorpanda: why would it change on the undercloud install?09:37
*** tremble has joined #tripleo09:37
pandajaosorior: I don't know, that' my original question, what is changing the hostname ?09:37
jaosoriorpanda: that question I answered already09:38
jaosoriorand it's not the undercloud install09:38
*** pblaho has joined #tripleo09:42
jaosoriorpanda: there are two things changing the hostname: CI scripts (not sure exactly where that happens) and my TLS everywhere job (because I need it to be an FQDN)09:42
pandajaosorior: found it (maybe) toci_instack_ovb.sh line 2209:43
*** pblaho` has quit IRC09:44
pandabut it's not really changing anything it seems09:44
jaosoriorpanda: well, it sure ends up quite strange http://paste.openstack.org/show/591080/09:46
jaosoriorbut either way, I still need to be able to set it to an FQDN, so I can set up the undercloud as a freeipa client09:48
pandalol. We need another systemd interface tool, this for /etc/hosts09:48
jaosoriorlol, seems we do :P09:49
*** paramite has joined #tripleo09:51
*** akrivoka has joined #tripleo09:52
*** openstack has joined #tripleo10:03
*** nijaba has quit IRC10:05
*** yamahata has quit IRC10:06
*** rcernin has quit IRC10:06
*** rcernin has joined #tripleo10:07
*** nijaba has joined #tripleo10:07
*** nijaba has quit IRC10:07
*** nijaba has joined #tripleo10:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Initial support for composable upgrades with Heat+Ansible  https://review.openstack.org/39344810:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add glance service support for composable upgrades  https://review.openstack.org/40524010:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add nova service support for composable upgrades  https://review.openstack.org/40524110:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add neutron service support for composable upgrades  https://review.openstack.org/40524210:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add cinder service support for composable upgrades  https://review.openstack.org/40524310:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add heat service support for composable upgrades  https://review.openstack.org/40524410:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add swift service support for composable upgrades  https://review.openstack.org/40524510:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add mistral service support for composable upgrades  https://review.openstack.org/40524610:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add sahara service support for composable upgrades  https://review.openstack.org/40524710:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add ironic service support for composable upgrades  https://review.openstack.org/40524810:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add telemetry service support for composable upgrades  https://review.openstack.org/40524910:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add snmp service support for composable upgrades  https://review.openstack.org/40525010:07
shardymatbu, ccamacho: ^^10:07
shardyI rebased to split the patch so we can hopefully incrementally test in the new CI job10:07
shardylets get the keystone test passing, then add glance, then figure out nova etc10:08
ccamachoshardy awesome10:08
shardyI'll test the keystone patch locally then we can hopefully get the CI job working10:09
matbushardy: nice10:09
matbushardy: i will update the depends-on on the CI review10:10
shardymatbu: ack - I made one comment - we'll need to add the OS::TripleO::Services::TripleoPackages "service"10:10
shardyas that's where the package update is defined now10:10
shardywill test locally and see if I can spot any other problems10:10
matbushardy: ack thanks10:11
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483110:13
*** florianf has joined #tripleo10:15
matbuccamacho: i'm running the ping test, since i fixed some nits in config files the services looks working10:15
ccamachomatbu awesome, i.e. the nova workers set to 0?10:16
matbuccamacho: yep10:16
ccamachocool10:16
matbuccamacho: i'm deploying master to compare10:16
matbuhmm the pingtest is missing backward compat10:19
yolandahi jaosorior_lunch ... so now facing a new problem, look http://logs.openstack.org/61/404161/10/check/gate-tripleo-ci-centos-7-nonha-multinode/5f1b084/console.html10:20
yolandaeven i set feature/v2 branch for tripleo-image-elements, i think it's not picking feature/v2 branch of diskimage-builder10:20
yolandamm no10:21
yolandai think the issue is that it picks , but then spec for tripleo-image-elements package is wrong as well :(10:21
yolanda /usr/share/diskimage-builder/elements is wrong, with dib v2 this does not exist :(10:22
yolandajpena, around? may need your magic again :)10:22
jpenayolanda: yep, here I am10:23
yolandaso ... more dib problems10:23
yolandalook10:23
yolandahttps://github.com/rdo-packages/tripleo-image-elements-distgit/blob/rpm-master/openstack-tripleo-image-elements.spec#L4710:23
yolandawith dib2 that path does not exist10:23
yolandapath is collected with10:23
yolandaimport diskimage_builder.paths10:24
yolanda            base_elements_path = diskimage_builder.paths.get_path('elements')10:24
yolandajpena, i'm thinking we could simplify our pains10:24
yolandaif you update dib package again10:24
yolandaand extract diskimage-builder/diskimage_builder/elements to /usr/share/diskimage-builder/elements10:24
yolandait seems to be referenced everywhere10:24
jpenayolanda: so it's basically a revert of https://github.com/rdo-packages/diskimage-builder-distgit/commit/49ca8eec8be3fcfb0fa37265c9c89e180781ed9d ?10:26
yolandano, not a revert10:26
yolandaadd a deeper level10:26
openstackgerritThomas Herve proposed openstack/python-tripleoclient: Use absolute path when handling missing files  https://review.openstack.org/40526010:26
yolandainstead of diskimage-builder/elements10:27
yolandathe path is10:27
yolandadiskimage-builder/diskimage_builder/elemetns10:27
openstackgerritMerged openstack/tripleo-quickstart: Add environment parameter to collect-logs.sh  https://review.openstack.org/40486310:27
jpenayolanda: ahh ok. So revert + add one level of depth10:27
yolandayes, it think it will make our life easier10:27
shardyflaper87: Hey I added you to tripleo-drivers so you can triage/target tripleo bugs10:27
yolandaor we are going to need fixing and all pieces that reference this path, that seem to be a lot10:28
shardythanks for the patch fixing the tripleoclient path issue!10:28
jpenayolanda: ok, got it. You still need config-applier to be removed, I suppose10:28
flaper87shardy: a-ha, thanks a lot. I was going to ping you for that10:28
flaper87shardy: np, my pleasure10:28
yolandayep10:28
yolandasorry for that mess, jpena10:29
flaper87shardy: btw, I backported the patch10:29
jpenayolanda: np10:29
flaper87shardy: oh you noticed that :D10:29
shardyflaper87: yup :)10:31
*** nyechiel has joined #tripleo10:31
shardyd0ugal: can you check https://review.openstack.org/#/c/404762 please - I approved it before coffee and incorrectly thought it already had a +210:32
d0ugalshardy: sure10:32
d0ugalshardy, flaper87: lgtm10:33
shardyd0ugal: ack, thanks :)10:33
*** myoung has quit IRC10:34
*** myoung has joined #tripleo10:35
flaper87d0ugal: thanks :)10:36
therveflaper87, shardy https://review.openstack.org/#/c/405260/ :/10:38
*** bswartz has quit IRC10:39
*** colonwq has quit IRC10:39
*** rook has quit IRC10:39
*** michapma_alt has quit IRC10:39
*** thrash has quit IRC10:39
*** number80 has quit IRC10:39
*** hewbrocca_afk has quit IRC10:39
*** ggillies has quit IRC10:39
*** toure has quit IRC10:39
therveI have the test and the bug number! :)10:39
therveThough newer10:39
d0ugalfancy10:39
therveAt least we have the same code fix :D10:40
flaper87therve: I think we should merge the tests in yours at least10:41
therveflaper87, yeah I'll rebase once your fix is in10:41
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Refactoring current upgrade scripts for composable upgrades  https://review.openstack.org/40344110:41
shardytherve: aha, thanks - sorry for the duplication of effort there10:41
therveshardy, No worries, been sitting on that for a couple of days too...10:42
*** limao has quit IRC10:42
shardytherve: heh, you could have saved flaper87 from throwing his laptop out the window yesterday then :D10:42
*** pkovar has joined #tripleo10:42
shardytherve: FWIW I've been chatting with ramishra about ways me might reduce that horrible mess in tripleoclient10:43
therveshardy, Glad I didn't then. :D10:43
therveYeah it's unfortunate10:43
*** bswartz has joined #tripleo10:43
*** colonwq has joined #tripleo10:43
*** rook has joined #tripleo10:43
*** number80 has joined #tripleo10:43
*** michapma_alt has joined #tripleo10:43
*** thrash has joined #tripleo10:43
*** hewbrocca_afk has joined #tripleo10:43
*** ggillies has joined #tripleo10:43
*** toure has joined #tripleo10:43
shardyin particular I'd like some kind of validation API in heat, so you can pass a template and a bunch of environment files, then get a list of missing files back10:43
shardyI think that would help a lot10:43
flaper87shardy: therve no kidding, frustration was high yday and I wrote the fix, submitted it and went for a run right after that.. you know, to  run the frustration off (or to run away from my tech problems)10:44
* flaper87 is convinced computers hate him10:44
therveflaper87, It's not just you, don't worry, they hate everyone equally10:44
matbuflaper87: running is medicinal for us :)10:45
shardyflaper87: it's not just you - every time I touch that tripleoclient code I need a lie down afterwards, it's not good10:45
therveshardy, I don't really understand how a remote API would solve the issue, but I haven't thought about it that much10:45
flaper87therve: oh, mmh... someone needs to remind me why we're spending so much time trying to make them like us10:45
shardyhopefully we can improve it during this cycle10:45
*** cschwede has joined #tripleo10:45
flaper87shardy: lol :D10:46
shardytherve: I raised https://bugs.launchpad.net/heat/+bug/1645686 trying to explain some of the issues, but there are a few inter-related problems10:47
openstackLaunchpad bug 1645686 in python-heatclient "Server side environment merging requires client-side workarounds" [Undecided,New]10:47
shardytherve: the main advantage of an API is we'd be able to merge the environment inside heat, where now you are forced to merge it in the client just to resolve what files need adding to the files map10:47
d0ugalshardy: at this point I am scared to touch overcloud_deploy.py10:47
shardytherve: the two merged environments are certain to be the same, as only server side supports some features e.g parameter merging10:48
shardyand it's possible that will break resolution of the files10:48
shardytherve: it'd also be better for non python users of heat, as currently I assume they're forced to reimplement all that non-trivial template walking logic10:49
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483110:49
shardyI'd like heat template-validate --warn-missing-files -f foo.yaml -e one.yaml -e two.yaml10:49
shardyOr something similar10:49
shardythat gives us a list of all the files referenced which aren't in the provided files map10:49
shardywe might need to call that more than once until the missing files list is empty10:49
shardybut it'd be better than the workaround upon workaround we currently have IMO10:50
matbuccamacho: heat stack create failed (pingtest) but at least the openstack services are working (responding and alive) it's promissing :)10:50
shardyThat doesn't solve all the problems, but it'd be a good start I think10:50
matbushardy: ^10:50
shardymatbu: Yeah we'll have to disable the pingtest until enough services are enabled in the upgrade environment I think10:51
d0ugalshardy: That API sounds neat :)10:51
d0ugalAPI idea*10:51
shardys/certain to be the same/*not* certain to be the same10:51
matbushardy: yep but i was talking about my test env upgraded successfuly yesterday (with pacemaker)10:52
therveshardy, yeah, but it seems the main problem currently is to properly find the files on disk10:52
matbushardy: and w/ ansible of course :)10:52
therveWhich I think we need to fix first10:52
shardytherve: Not really - the problem is we're putting a subset of the files into swift10:52
shardytherve: and we then jump through hooks trying to find what we've not put into swift10:52
shardytherve: if we called heat, and it gave us a list of file:/// stuff we missed, we could probably find them10:52
shardybut yeah, I suppose there's various path mangling things wrt relative paths etc we'd still have to deal with10:53
shardyI still think having a clean way to get the merged environment from heat directly, and some way to preview the missing files would be a useful piece of the puzzle tho10:54
therveshardy, OK. I guess I'm still a bit light on the details then.10:54
*** ipsecguy has quit IRC10:54
*** ipsecguy has joined #tripleo10:54
shardytherve: no worries, I've been going round this problem for a while and I'm still not 100% clear on all the details ;)10:55
*** anshul has quit IRC10:59
shardyd0ugal: have you seen anything like https://bugs.launchpad.net/tripleo/+bug/1646450 ?11:00
openstackLaunchpad bug 1646450 in tripleo "Plan delete fails due to missing, but present .gitignore" [High,Triaged]11:00
shardyI can't delete the plan due to a file swift says is there, but then says it isn't11:00
shardyNot sure how to recover from it atm11:00
d0ugalshardy: very odd. I've not seen that before.11:01
d0ugalshardy: Can you just manually delete the container?11:01
shardyd0ugal: No it fails with a conflict because the is/isn't there .gitignore is still there, or not11:02
d0ugalshardy: even with swiftclient?11:02
shardyd0ugal: yeah11:02
d0ugalthat is odd11:02
d0ugalWe found a swift bug?11:02
shardymaybe11:02
shardywe don't enable any swift logging tho, which is awesome11:02
shardyabout to turn some on and see if there are any clues11:02
shardyHmm, there's a newer swift in current-tripleo, lets see if an undercloud update helps11:05
*** sshnaidm is now known as sshnaidm|afk11:06
jpichI'm having this problem as well, swift won't delete the 'overcloud' plan anymore11:08
d0ugalinteresting11:08
d0ugalI have not deleted for a while, I guess I should try that now11:08
jpichI think I ran --update-plan-only when things started going wrong, but I also had a failed undercloud update (due to the network range) that I wonder if it may be related to the issue11:09
jpichafter I fail to delete, the swift logs are full of "undercloud object-server: ERROR with remote server 192.168.24.1:6001/1: ConnectionTimeout (0.5s)" even though I'm still in the 192.0.2.0 range11:09
d0ugalshardy: I thought we skipped all dotfiles, so I am surprised .gitignore is ever uploaded.11:10
d0ugalI don't think there is a reason we would ever want to upload it11:10
*** misty-cloud has quit IRC11:10
jpich...anyhow I have no solution yet either. I think mine fails on a different file11:11
ccamachoshardy quick question is it ok to remove https://review.openstack.org/#/c/393448/15..16/environments/major-upgrade-composable-steps.yaml ?? in patchset 16 was removed11:14
*** tosky has joined #tripleo11:15
openstackgerritAlejandro Andreu proposed openstack/puppet-tripleo: Adds tripleo::network::midonet::cluster class  https://review.openstack.org/40210411:18
openstackgerritAlejandro Andreu proposed openstack/puppet-tripleo: Adds tripleo::network::midonet::cluster class  https://review.openstack.org/40210411:18
*** karthiks has quit IRC11:21
*** jaosorior_lunch is now known as jaosorior11:25
jaosorioryolanda: could you check this out https://review.openstack.org/#/c/404717/11:26
*** egafford has quit IRC11:26
jaosoriorshardy: could you revisit this https://review.openstack.org/#/c/404752/ ?11:26
yolandajaosorior, checking11:27
*** karthiks has joined #tripleo11:31
karthiksnow11:31
*** nyechiel has quit IRC11:31
*** udesale has quit IRC11:33
*** athomas has joined #tripleo11:34
*** pgadiya has quit IRC11:35
thrashyolanda: still having trouble with image building?11:35
yolandathrash, yes, but the change from jaosorior revealed some of the failures i had11:35
yolandait's related with packaging11:35
thrashyolanda: which change from jaosorior out of curiousity11:36
yolandahttps://review.openstack.org/#/c/404752/11:36
*** sshnaidm|afk is now known as sshnaidm11:36
yolandathrash, it captured a "duplicated element" error11:36
thrashyolanda: ahhh11:37
yolandathrash, so maybe errors related to elements were picked properly, but that comes even before build11:37
yolandais dib complaining about that duplication11:37
thrashyolanda: that could do it.11:37
thrashyolanda: we may need to make a change there.11:38
thrashyolanda: what change of yours is failing so I can take a look?11:38
jaosoriorthrash: if you want to +A the tripleo-ci change feel free :D11:39
yolandathrash, https://review.openstack.org/40416111:40
yolandai amended now11:40
thrashyolanda: I'm not seeing the extra logging..11:46
*** udesale has joined #tripleo11:46
yolandainside undercloud.tar.xz11:47
yolandathere was an extra home directory11:47
yolandabut it was some patchsets above11:47
shardyjaosorior: done11:47
yolandathe latest ones failed with other reasons11:47
shardyccamacho: Oops, no I didn't mean to remove that11:47
thrashyolanda: so you were able to fix it on your end...11:47
shardyjpich, d0ugal: updating doesn't fix the swift issue11:47
yolandathrash, i'm on it :)11:47
yolandapackage problems11:47
thrashyolanda: ack. Just want to make sure I'm helping if I can. :)11:48
yolandathanks11:48
yolandajpena approved a change i did for the package, so i'm retrying11:48
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras: Create tasks to install, run stackviz and collect logs  https://review.openstack.org/40078211:48
thrashjaosorior: shardy beat me to it. :)11:48
jpichshardy: Sorry to hear...11:49
mandrehello, I'm looking for a puppet expert who can help me understand why puppet runs part of my catalog it's not supposed to11:49
mandrewho's good with puppet around here?11:49
jpichshardy: When I try to delete now, every file has a 1 appended to the name so I think whatever it is I'm doing, I'm making it worse11:49
*** jkilpatr has quit IRC11:50
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Initial support for composable upgrades with Heat+Ansible  https://review.openstack.org/39344811:51
*** adarazs is now known as adarazs_lunch11:51
*** zoliXXL is now known as zoli|lunch11:51
*** jpena is now known as jpena|lunch11:52
jpichmandre: From what I've seen mwhahaha and EmilienM usually have all the Puppet answers - there may be more knowledgeable people in hiding though :)11:55
jpichmandre: #puppet-openstack could be a good place to ask too11:55
*** dprince has joined #tripleo11:56
mandrecool jpich, thanks for the pointers. I suspect it has more to do with the tripleo catalog than puppet itself11:57
jpichmandre: Good luck!11:57
mandrejpich: thanks ;)12:00
mandrewhat timezone is mwhahaha?12:00
shardymandre: I'd just ask the question, quite a few folks may be able to help12:01
shardymwhahaha and EmilienM should be around in the next hour or two12:01
mandreshardy: ok, you asked for it :)12:01
* shardy runs away to lunch ;)12:01
mandreso I pass a list of tags to puppet to restrict the catalog, and it fails applying an 'exec' that it is not supposed to do12:02
mandrei captured the trace at http://paste.openstack.org/show/591090/12:02
shardymandre: Hmm, maybe dprince can help - I'm not familiar with how the tags are being used in that case12:04
dprincemandre: is this the keystone patch?12:05
mandredprince: yep12:05
dprincemandre: Any new code here? Or similar to the patch from yesterday?12:07
dprincemandre: we may need a fake resource for Exec in some cases12:07
dprincemandre: I can help w/ that if need be12:08
mandredprince: no, still the same code, I haven't touched it since yesterday12:08
mandredprince: hmm, what's a fake Exec resource?12:08
*** rodrigods is now known as rodrigods_12:09
*** bkopilov has quit IRC12:09
dprincemandre: a fake provider for Exec resources12:09
dprincemandre: I have an old abandoned patch in puppet-tripleo that gives an example12:09
*** masco has quit IRC12:09
dprincemandre: also we do a similar thing for packages in puppet-tripleo too12:09
*** karthiks has quit IRC12:10
*** slagle has joined #tripleo12:10
dprincemandre: I would like to try it myself I guess. Or see the catalog you are hitting12:10
mandredprince: oh cool, so you have an explanation why Exec is still executed by puppet even though not in the tags I pass?12:10
dprincemandre: for that I'd want to see your catalog12:11
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Refactoring current upgrade scripts for composable upgrades  https://review.openstack.org/40344112:11
*** dprince has quit IRC12:11
openstackgerritMerged openstack/tripleo-heat-templates: Fix puppet/services/README.rst step description  https://review.openstack.org/40310612:17
EmilienMgood morning12:20
*** egafford has joined #tripleo12:24
*** dsariel has quit IRC12:24
*** karthiks has joined #tripleo12:25
EmilienMmandre: Error: /Stage[main]/Keystone::Db::Sync/Exec[keystone-manage db_sync]: Failed to call refresh: Command exceeded timeou12:26
*** udesale has quit IRC12:26
EmilienMlooks like the command timeout, is mysql ready?12:26
*** panda is now known as panda|afk12:27
*** jkilpatr has joined #tripleo12:27
EmilienMalso, I think you can look in /var/log/keystone and see what logs say12:27
mandrehello EmilienM12:27
mandreit's a bit different here since we're working with containers12:27
EmilienMdo you have mysql ready?12:28
*** athomas has quit IRC12:28
mandrebut yeah, I'm not surprised the db sync failed, just really surprised it tried to run it without me specifying the 'exec' tag12:28
EmilienMmandre: where do you "not specify it"?12:30
EmilienMand again, is mysql ready?12:30
mandreEmilienM: if you check on line 3 of the log I pasted, I pass the --tags option to puppet12:31
openstackgerritLucas Alvares Gomes proposed openstack/tripleo-quickstart: VirtualBMC support for tripleo-quickstart  https://review.openstack.org/39970412:31
mandreEmilienM: iiuc, puppet should restrict the catalog to only those tags, right?12:31
mandreEmilienM: mysql is running but on a different host, does that matter?12:33
owalshmandre: hi, I've a question about https://review.openstack.org/#/c/285860/12:33
mandreowalsh: oh, this is old :)12:34
owalshmandre: the openstack-puppet-modules rpm depends on puppet-tripleo, so if I set puppet-tripleo to a source install I still get the packaged version12:34
owalshmandre: I expect it's the same for most puppet modules12:35
EmilienMmandre: ah, --tags... now I get it. I used it in the past and it didn't worked as I expected all the time, let me check something12:35
*** lucasagomes is now known as lucas-hungry12:36
mandreowalsh: let me refresh my mind a little bit about the context of this commit12:36
EmilienMI wonder why dprince (offline now) said we need a fake resource for Exec12:39
EmilienMin theory, when you specify --tags, you choose what you want to deploy12:39
mandreowalsh: right, so in that case we may get the wrong module, the packaged one instead of the one from source12:39
owalshmandre: yes, because the packaged version is installed as a dependency12:40
EmilienMmandre: https://github.com/openstack/puppet-tripleo/blob/master/manifests/noop.pp#L6312:40
EmilienMthat's what he mentionned I think12:40
*** dprince has joined #tripleo12:41
mandredprince: speaking of the devil12:42
dprincemandre: whats up?12:43
mandredprince: EmilienM thinks he found your fake Exec resource, https://github.com/openstack/puppet-tripleo/blob/master/manifests/noop.pp#L6312:44
dprincemandre: that is one option that might work, yes12:44
*** zoli|lunch is now known as zoli|gone12:44
jaosoriorayoung: around yet?12:45
dprincemandre: you could try it. Simply adding an include to that puppet class to your docker YAML service would do it12:46
EmilienMdprince: I was asking, why the --tags doesn't work here?12:46
jaosoriorEmilienM, bandini, beagles could you revisit https://review.openstack.org/#/c/403618/ ? Rebased on top of dprince's patch that uses the new hiera hook12:46
EmilienMdprince: why having a fake resource?12:46
dprinceEmilienM: I haven't tried it yet.12:46
EmilienMdprince: in theory --tags should work but it seems Exec is still run12:46
dprinceEmilienM: I'd actually be suspicious that tags weren't working for something12:46
dprinceEmilienM: I'd like to see the catalog12:46
EmilienMjaosorior: done12:47
EmilienMdprince: http://paste.openstack.org/show/591090/12:47
jaosoriorEmilienM: thanks12:47
owalshmandre: I think the logic just needs to be reversed - for a pkg install the source puppet modules should take precence and vice-versa12:50
*** oshvartz has quit IRC12:50
*** abregman has quit IRC12:53
*** bfournie has quit IRC12:53
*** jpena|lunch is now known as jpena12:53
dprinceshardy: hey, one more patch to mention this morning. I added a --safe option here https://review.openstack.org/#/c/394410/3/tools/process-templates.py12:56
dprinceshardy: does that work for your use case?12:56
dprinceshardy: it would prevent overwriting files which was your concern.12:56
jaosoriorderekh: could you check this out? https://review.openstack.org/#/c/404717/12:57
*** rodrigods_ has quit IRC12:58
*** rodrigods has joined #tripleo12:58
derekhjaosorior: looking12:59
*** snecklifter has quit IRC13:00
openstackgerritMerged openstack-infra/tripleo-ci: Include logs in the undercloud's home directory  https://review.openstack.org/40475213:00
openstackgerritMerged openstack/tripleo-common: Add python-heat-agent-ansible to overcloud images.  https://review.openstack.org/40393213:00
openstackgerritMerged openstack/tripleo-puppet-elements: Install hiera orc files via install.d  https://review.openstack.org/40507513:01
openstackgerritMerged openstack/tripleo-heat-templates: Hiera optimization: use a new hiera hook  https://review.openstack.org/38475713:01
*** dtantsur|bbl is now known as dtantsur13:04
derekhjaosorior: I'm looking at /etc/hosts on a ci undercloud, any idea why there are so many duplicates? http://paste.openstack.org/show/591113/13:05
jaosoriorderekh: I believe it's because of this: https://github.com/openstack-infra/tripleo-ci/blob/master/toci_instack_ovb.sh#L2413:07
*** thrash is now known as thrash|appt13:08
*** jayg|g0n3 is now known as jayg13:08
jaosoriorderekh: however, I still would like that to be available in tripleo.sh. For the TLS-everywhere job, I'm changing the host to have a domain (cause it's needed for the FreeIPA enrollment)13:08
*** ccamacho is now known as ccamacho|lunch13:09
*** flepied has quit IRC13:09
derekhok, will approve, probably worth seeing if we can remove that line from toci_instack_ovb.sh13:11
dtantsurhey folks! are you aware of any effort to bring cinder in undercloud?13:11
*** pkovar has quit IRC13:12
*** adarazs_lunch is now known as adarazs13:13
*** trown|outtypewww is now known as trown13:13
jaosoriorderekh: any idea why it's needed? that line in toci_instack_ovb.sh13:14
*** dsariel has joined #tripleo13:14
derekhjaosorior: not sure (I've forgotten) but it may not be needed any longer13:14
EmilienMdtantsur: why would we need cinder?13:16
*** nyechiel has joined #tripleo13:16
dtantsurEmilienM, for boot-from-volume support (which is something too many folks are so keen on)13:16
dtantsurEmilienM, see http://specs.openstack.org/openstack/ironic-specs/specs/approved/boot-from-volume-reference-drivers.html for details13:17
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: WIP: Support copying sources from directory  https://review.openstack.org/40536913:18
EmilienMdtantsur: indeed13:18
EmilienMdtantsur: I'm not aware of any effort, no13:18
EmilienMdtantsur: what cinder backend would you use? iscsi/lvm?13:18
dtantsurgood question :) I'll figure out, but I suspect the answer is iscsi13:19
* dtantsur is not the person behind this effort, but he seems to be the one to integrate it in tripleo13:19
EmilienMjaosorior: can you review https://review.openstack.org/#/c/404447/ and https://review.openstack.org/404450 please?13:20
jaosoriorEmilienM: sure13:20
EmilienMdtantsur: I would make it optional though, and disabled by default13:20
dtantsursure13:20
jaosoriorEmilienM: missed a spot here https://review.openstack.org/#/c/404447/113:21
*** flepied has joined #tripleo13:21
EmilienMjaosorior: oh right13:21
*** jbadiapa has joined #tripleo13:21
*** amoralej is now known as amoralej|lunch13:21
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: cleanup: remove scenario004 bits  https://review.openstack.org/40444713:22
EmilienMjaosorior: I did more cleanup13:22
jaosoriorEmilienM: LGTM13:23
EmilienMjaosorior: thx!13:23
*** bfournie has joined #tripleo13:24
*** jrist has quit IRC13:25
*** gfidente has joined #tripleo13:25
*** gfidente has quit IRC13:25
*** gfidente has joined #tripleo13:25
*** jtomasek has joined #tripleo13:27
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483113:27
flaper87could someone ninja-approve the badge patches for tripleo projects? Just search for tripleo here: https://review.openstack.org/#/q/status:open+topic:project-badges13:28
flaper87imho, there's no need to wait for 2 +2s on those unless there's been disagreement already on some of the patches13:29
*** pkovar has joined #tripleo13:31
EmilienMflaper87: ok13:32
openstackgerritMerged openstack/tripleo-docs: Show team and repo badges on README  https://review.openstack.org/40258513:32
flaper87EmilienM: thank you13:32
*** jtomasek has quit IRC13:33
openstackgerritMerged openstack/tripleo-validations: Show team and repo badges on README  https://review.openstack.org/40258113:33
*** noslzzp has joined #tripleo13:34
*** lucas-hungry is now known as lucasagomes13:34
*** flepied has quit IRC13:34
*** noslzzp has quit IRC13:35
*** flepied has joined #tripleo13:35
*** rlandy has joined #tripleo13:35
openstackgerritMerged openstack/tripleo-quickstart: Show team and repo badges on README  https://review.openstack.org/40258213:35
*** noslzzp has joined #tripleo13:35
*** rhallisey has joined #tripleo13:36
openstackgerritDmitry Tantsur proposed openstack/tripleo-common: Workflow for applying RAID configuration to Ironic nodes  https://review.openstack.org/40023113:36
openstackgerritDmitry Tantsur proposed openstack/tripleo-common: Create a workflow for running manual cleaning on nodes  https://review.openstack.org/40537913:36
*** jprovazn has quit IRC13:37
dtantsurd0ugal, mind reviewing these two please ^^^?13:37
dtantsurespecially the error and result handling bits, I'm not too confident in them13:37
ayoungjaosorior, yeop!13:39
*** lblanchard has joined #tripleo13:39
flaper87EmilienM: if you have time and want to do the puppet ones, that'd be awesome13:40
flaper87promise I won't bother anymore13:41
EmilienMflaper87: no way.13:41
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Initial support for composable upgrades with Heat+Ansible  https://review.openstack.org/39344813:41
* flaper87 will fix bugs13:41
yolandahi, can i get reviews on https://review.openstack.org/401831 ?13:41
yolandahas a +2 from EmilienM already13:41
*** snecklifter has joined #tripleo13:43
*** jcoufal has joined #tripleo13:45
openstackgerritGovardhan Chintha proposed openstack/tripleo-heat-templates: HPELeftHandISCSIDriver support for Cinder  https://review.openstack.org/40538513:46
*** limao has joined #tripleo13:47
*** limao_ has joined #tripleo13:51
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Re-add undercloud.yaml  https://review.openstack.org/35203713:52
*** limao has quit IRC13:52
d0ugaldtantsur: sure!13:52
*** bkopilov has joined #tripleo13:52
mandreowalsh: sorry for the lag, I think reversing the precendence might work, yeah13:53
snecklifterHello, deploying manila I get a duplicate declaration error on nfs-utils, seems like cinder and manila are battling each other13:53
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras: Look for success message in logs when check status  https://review.openstack.org/40539213:53
snecklifterReally basic bz here https://bugzilla.redhat.com/show_bug.cgi?id=140055713:53
openstackbugzilla.redhat.com bug 1400557 in openstack-manila "Duplicate declaration: nfs-utils already declared by cinder" [Unspecified,New] - Assigned to zaitcev13:53
mandreowalsh: what other case of modules installed both from source and from package can we have?13:53
jaosoriorayoung: hey dude, so rod prepared a setup with an undercloud node, and there's another node with ipa and rhsso installed, got some time to help me out following the instructions? I have some pre-knowledge missing13:54
owalshmandre: any puppet module I assume13:54
ayoungjaosorior, sure, what you trying to do?13:55
tbarronsnecklifter: saw this over in #openstack-manila, will look in a moment13:55
sneckliftertbarron: many thanks13:55
mandreowalsh: I mean, other than pkg dependencies, do we have to treat another case of a module being install both from source and pkg on the machine?13:56
sneckliftertbarron: I am bring templates across from Mitaka to Newton to entirely possible I'm being stupid13:56
jaosoriorayoung: do a basic federation setup in tripleo; so I can check the needed configurations in apache and assess what needs to be changed in the puppet manfiests13:56
jaosorior*manifests13:56
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483113:56
shardygah, swift on my undercloud is totally messed up13:57
jpichshardy: Did you get any further with the swift issue, or have more debugging ideas? I'm happy to try things to help narrow the problem down13:57
jpich...right13:58
*** cdearborn has joined #tripleo13:58
tbarronsnecklifter: I think we need more details in the bug as we deploy both cinder and manila with tripleo without hitting this issue.13:58
jpichshardy:  I think I'm going to reimage my undercloud, since I don't really trust it anymore and I don't know which end to attack that problem from anymore13:58
shardyjpich: No, I've been trying to debug but basically swift seems very broken - it lists objects but then 404s when you try to delete them13:58
shardyI'm wondering if I can clean the objects from the filesystem directly13:58
sneckliftertbarron: yes, it is a little sparse13:58
d0ugaldtantsur: How do you plan for people to use these workflows? new CLI commands? Just curious.13:58
*** lhinds has joined #tripleo13:59
*** rnoriega has joined #tripleo13:59
tbarronsnecklifter: you are deploying in RDO, with newton, master? what overcloud deploy command? content of any custom templates ...13:59
sneckliftertbarron: ok, if its not something anyone else is hitting I'll continue to debug, I'm using netapp14:00
snecklifterRDO newton14:00
snecklifterok, will put it all in bz14:00
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart-extras: Add introspection with retries option  https://review.openstack.org/40367714:00
*** snecklifter has quit IRC14:00
jpichshardy: I wonder if maybe they do get deleted but whatever is referencing them, isn't updating. Are you seeing the connectiontimeout error in your own logs?14:01
tbarronsnecklifter: ty.  Here though you can give me a high level description of what you are trying to achieve.  Are you deploying manila in productiion with a NetApp backend?  or for a POC?14:01
shardyjpich: no, I'm just seeing 404s trying to delete objects, and conflict errors (related to the 404s) trying to delete containers14:02
*** fzdarsky has joined #tripleo14:02
*** fzdarsky has quit IRC14:02
* tbarron sees snecklifter has left14:02
*** athomas has joined #tripleo14:02
*** fzdarsky has joined #tripleo14:03
*** fzdarsky has quit IRC14:03
*** ola has joined #tripleo14:03
*** ola has left #tripleo14:03
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras: collect-logs: add rdoproject env requirements  https://review.openstack.org/40539714:03
*** fzdarsky has joined #tripleo14:04
jpichshardy: Maybe what I'm seeing is unrelated then... are you still using the same undercloud where you hit https://bugs.launchpad.net/tripleo/+bug/1645267 ?14:04
openstackLaunchpad bug 1645267 in tripleo "Undercloud upgrade breaks due to IP range change" [High,Triaged]14:04
shardyjpich: yes, but I configured undercloud.conf to match the old network range and then re-ran undercloud install14:05
shardywhich seemed to work fine until now14:05
owalshmandre: yea, I though about that. E.g install puppet-modules from source but install a specific module from a package14:05
dtantsurd0ugal, yep, see https://blueprints.launchpad.net/tripleo/+spec/raid-workflow. I also plan on something directly using the manual_cleaning workflow to wipe the hard drives (as we have it off by default in tripleo)14:06
d0ugal dtantsur oh, cool - thanks. I should have checked the blueprint links :)14:06
jpichshardy: That's what I did as well14:06
*** dtrainor has joined #tripleo14:07
mandreowalsh: so yeah, in that case we would have that specific module we want from package plus all of its dependencies which we probably want from source14:08
*** ccamacho|lunch is now known as ccamacho14:08
*** athomas has quit IRC14:10
*** rcernin has quit IRC14:10
owalshmandre: actually no, can't do this. Setting puppet-modules to source will set all of the puppet modules to source14:10
*** rcernin has joined #tripleo14:11
openstackgerritAlejandro Andreu proposed openstack/tripleo-heat-templates: WIP: Create MidoNet services  https://review.openstack.org/39669214:13
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras: Use generic cloud image for undercloud  https://review.openstack.org/40154814:13
jpichshardy: Out of curiosity, do you see only correct IPs when running "swift-ring-builder container.builder search --region 1" ?14:14
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras: Use generic cloud image for undercloud  https://review.openstack.org/40154814:15
*** jeckersb_gone is now known as jeckersb14:16
*** jprovazn has joined #tripleo14:16
shardyjpich: aha, no it's wrong, could well be related14:16
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: updates: enable ssl  https://review.openstack.org/40293014:17
jpichshardy: I'm removing them now, will let you know if it solves it14:17
shardyso I wonder if we can rebuild the rings to work around it14:17
*** panda|afk is now known as panda14:17
jpichshardy: It worked!!14:17
jpichI finally deleted that damn container14:17
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras: deployment updates for containerized compute  https://review.openstack.org/40098614:17
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates: Fix bug when using multiple DeployArtifactURLs  https://review.openstack.org/40540614:17
shardyjpich: nice!  What sequence of commands did you use?14:17
jpichshardy: I'll paste you the commands I used14:18
*** abregman has joined #tripleo14:18
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: config for containerized-compute  https://review.openstack.org/39334814:18
*** Goneri has joined #tripleo14:18
*** fultonj has joined #tripleo14:19
jpichshardy: http://paste.openstack.org/show/591126/14:19
jpichI guess I'll update the bug too. That was painful14:19
jpichOh these are from /etc/swift14:20
*** amoralej|lunch is now known as amoralej14:21
*** jrist has joined #tripleo14:21
*** jrist has joined #tripleo14:21
*** abregman has quit IRC14:23
*** jtomasek has joined #tripleo14:23
*** abregman has joined #tripleo14:23
*** athomas has joined #tripleo14:24
*** yprokule has quit IRC14:24
mandreowalsh: then you should be good I suppose14:24
*** abregman has quit IRC14:25
*** abregman has joined #tripleo14:25
*** thrash|appt is now known as thrash14:25
*** trown is now known as trown|brb14:26
*** ealcaniz has quit IRC14:27
*** arxcruz has quit IRC14:28
openstackgerritMerged openstack/tripleo-common: Update container images to point to newton  https://review.openstack.org/39968714:28
openstackgerritMerged openstack/tripleo-common: Show team and repo badges on README  https://review.openstack.org/40257314:28
openstackgerritMerged openstack/tripleo-heat-templates: Show team and repo badges on README  https://review.openstack.org/40257114:29
openstackgerritMerged openstack/puppet-tripleo: Show team and repo badges on README  https://review.openstack.org/40294714:29
openstackgerritMerged openstack/tripleo-image-elements: Show team and repo badges on README  https://review.openstack.org/40319614:29
openstackgerritMerged openstack/tripleo-incubator: Show team and repo badges on README  https://review.openstack.org/40257914:29
openstackgerritMerged openstack/puppet-tripleo: Update ceilometer collector ipv6 handling  https://review.openstack.org/40090514:30
*** pkovar has quit IRC14:30
shardyjpich: yeah please do update the bug14:30
dtantsurEmilienM, ok, I went ahead and created a very rough blueprint for that: https://blueprints.launchpad.net/tripleo/+spec/undercloud-boot-from-volume. I'll probably get more information as I figure out how this sausage is actually made.14:30
jpichshardy: Done. I'm not sure what the "42" does, maybe it's not actually needed14:31
dtantsur(also don't kill me please for targeting it to Ocata, I can happily pass your comments to my PM ;)14:31
shardyjpich: I think it makes that undercloud upgrade more critical - we should stop the update running if the cidr's don't match14:31
EmilienMdtantsur: ok, I think it's a bit late for ocata though, right?14:31
*** social has quit IRC14:31
jpichshardy: Sounds reasonable to me14:31
*** arxcruz has joined #tripleo14:31
dtantsurEmilienM, I suspect it is, but I'm kind of under pressure, so I have to request it, and you're free to reject/retarget it ;)14:31
EmilienMdtantsur: if we have nothing starting by beginning of ocata-3 (in 2 weeks), we'll postpone it to Pike.14:31
shardyI'm confused why the rings got rebuilt when the default network changed, but not when I set it back again14:31
dtantsurEmilienM, I'll try my best14:32
dtantsur(though I doubt the ironic parts will be ready)14:32
jpichshardy: I'm also confused as to why I got more helpful logs than you did, since I haven't changed any default that I recall14:32
shardyjpich: Oh, it's because it's added a new ring, the old one is still there14:33
shardyjpich: nice one, confirmed that works :)14:35
jpichshardy: Glad it did!14:35
dtantsurEmilienM, realistically, the only thing we can do in 2 weeks is to optionally enable cinder on undercloud. then everything will be left as manual steps. WDYT?14:36
*** social has joined #tripleo14:38
yolandajaosorior, ugh14:38
yolandanow i got:14:38
yolanda2016-12-01 08:41:02.000 | tar: /home/jenkins/*.log: Cannot stat: No such file or directory14:38
yolanda2016-12-01 08:41:02.000 | tar: Exiting with failure status due to previous errors14:38
jaosorioryolanda: what happened?14:38
jaosoriornoooo :(14:38
yolandahttp://logs.openstack.org/51/401251/15/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/793a001/console.html#_2016-12-01_07_40_55_05983014:39
EmilienMdtantsur: it sounds fair to me, go ahead14:40
dtantsurk14:40
jpichshardy: I'm not sure if that was enough FWIW, creating a new plan from the CLI seems to hang for me now (though the swift container is apparently created correctly)14:40
dtantsurlast question: do you (or somebody hear) knows someone who knows cinder reasonable well?14:40
yolandajaosorior, what i don't know if that's only a red herring or the real error14:41
EmilienMdtantsur: what, you need help for cinder/puppet? :)14:41
shardyjpich: I did swift delete overcloud && openstack overcloud plan delete overcloud14:41
shardyjpich: I also deleted all other swift containers14:41
shardythen the deploy seems to work14:41
shardyJust doing the plan delete didn't work for me, it still had an error14:42
dtantsurEmilienM, well, largely just a point of contact in case I get lost :) otherwise I'm going to copy-paste the overcloud composable service14:42
EmilienMdtantsur: i can help you to deploy cinder or bootstrap something, feel free to ping me14:43
dtantsurthanks!14:43
jpichshardy: Thanks, I'll try deleting all the things too. "openstack overcloud plan create my-new-test-plan" is the one hanging for me at the moment... but I now see Zaqar seems to be in failed state on that machine so I'll try fixing that first14:43
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Document Third Party CI and devmode.sh  https://review.openstack.org/36000714:45
jaosorioryolanda: any idea why there wouldn't be any logs there?14:45
EmilienMjaosorior: can you check https://review.openstack.org/404954 please?14:46
jaosorioryolanda: sorry if I'm answering slowly, I'm in a meeting14:46
*** mgould has joined #tripleo14:46
adarazsmgould: https://review.openstack.org/382845 -- devmode.sh change14:46
jaosoriorEmilienM: Do you know why they need a shortname instead of an fqdn>?14:46
adarazsmgould: documentation change: https://review.openstack.org/36000714:46
yolandaah, i'm on meetings as well, no problem14:46
mgouldadarazs: thanks!14:46
yolandaso jaosorior , maybe it failed on previous steps14:47
yolandabut really the log is not helpful14:47
milanadarazs, ping14:47
EmilienMgfidente: in fact, gnocchi/aodh problem is not related to Ceph or the backend14:47
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Add devmode.sh to wrap full-deploy.sh  https://review.openstack.org/38284514:47
EmilienMgfidente: I see it failing anyway, I'll remove the resource from pingtest for now and re-add it later14:48
gfidenteEmilienM no I think you forgot to remove14:48
gfidentethe GnocchiBackend param a few lines down \14:49
gfidenteso it was trying rbd anyway?14:49
adarazsmgould, milan: here's the eyecandy version of the documentation for devmode.sh: http://docs-draft.openstack.org/07/360007/23/check/gate-tripleo-quickstart-docs-ubuntu-xenial/1ca193d//doc/build/html/thirdparty-ci.html14:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario001/pingtest: remove gnocchi_res_alarm  https://review.openstack.org/40542714:49
milanadarazs, thanks a lot!14:49
openstackgerritBen Kero proposed openstack/tripleo-quickstart-extras: overcloud-deploy: add variable for hypervisor_wait  https://review.openstack.org/40494314:49
EmilienMgfidente: look at current Ci jobs, the resource fails anyway14:49
mgouldTIL about docs-draft.openstack.org!14:50
EmilienMgfidente: I'll disable it for now and investigate later14:50
yolandajpena, are the issues with dlrn still ongoing?14:52
*** pkovar has joined #tripleo14:52
yolandai got an error when packaging http://logs.openstack.org/51/401251/15/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/793a001/console.html#_2016-12-01_07_40_55_05983014:52
jpenayolanda: no, I got it fixed by pinning python-sh to a specific version14:53
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario001: deploy Ceph  https://review.openstack.org/40446214:53
jpenayolanda: when did that happen?14:53
yolandajust right now, i got in the latest logs14:53
yolandamm, no, sorry14:53
yolandaold one14:53
yolandai got feedback from jenkins, but for the jenkins check part14:53
yolandathe ovb logs are older14:54
* jpena breezes :)14:54
yolandaphew14:54
yolandaso yep, the ovb jobs are still executing14:54
yolandai got failures on centos7 jobs, but no really helpful logs14:54
yolandathey don't get output of diskimage builds there14:55
yolandaso i'll wait...14:55
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483114:55
*** jbadiapa has quit IRC14:55
*** dsariel has quit IRC14:55
*** dsariel has joined #tripleo14:56
yolandajpena, it's again the ipaddr error14:56
yolanda2016-12-01 14:25:16.000 |   deploy_stderr: |14:56
yolanda2016-12-01 14:25:16.000 |     Traceback (most recent call last):14:56
yolanda2016-12-01 14:25:16.000 |       File "<string>", line 1, in <module>14:56
yolanda2016-12-01 14:25:16.000 |     ImportError: No module named ipaddr14:56
*** gfidente has quit IRC14:57
*** saneax is now known as saneax-_-|AFK14:57
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui: Adds basic internationalization support  https://review.openstack.org/39962615:00
*** links has quit IRC15:01
*** tzumainn has joined #tripleo15:01
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: ceph-rgw: add missing user parameter  https://review.openstack.org/40542915:02
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Implement scenario004 with Ceph Rados Gateway scenario  https://review.openstack.org/40445815:02
EmilienMcolonwq: ^ fyi15:02
*** faizy has joined #tripleo15:04
*** dbecker has joined #tripleo15:04
*** trown|brb is now known as trown15:06
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud: [WIP] Optional Cinder support for undercloud  https://review.openstack.org/40543515:08
*** jaosorior has quit IRC15:09
*** pradk has joined #tripleo15:09
*** jaosorior has joined #tripleo15:10
*** jbadiapa has joined #tripleo15:11
*** gfidente has joined #tripleo15:11
*** absubram has quit IRC15:12
yolandauh15:12
yolanda2016-12-01 15:01:57.237 773 ERROR ironic.drivers.modules.iscsi_deploy [req-5dddc88c-0ea1-4f33-a6b3-b7c2f6057c27 - - - - -] Couldn't determine the UUID of the root partition or the disk identifier after deploying node 8ab61744-359d-41ba-a39a-09a295099c6515:12
yolandathat looks related with image builds15:13
dtantsurEmilienM, could you please re-review https://review.openstack.org/#/c/382524/? I think you've commented on the old patchset15:13
openstackgerritTomas Sedovic proposed openstack/tripleo-docs: Add tripleo-validations user documentation  https://review.openstack.org/39619715:13
EmilienMdtantsur: +2 - sorry, sometimes my gertty is not synced15:16
dtantsuryeah, I've done the same once or twice due to that15:16
openstackgerritMartin AndrĂ© proposed openstack/tripleo-common: Update container images to point to newton  https://review.openstack.org/40543915:18
yolandajaosorior, so i'm getting two different errors now: in centos7 jobs i still get the ipaddr error http://logs.openstack.org/51/401251/15/check/gate-tripleo-ci-centos-7-nonha-multinode/3d15a22/logs/postci.txt.gz#_2016-12-01_14_25_16_00015:18
yolandaand on the ovb jobs seems there is a problem with root uuid on ironic15:18
*** jbadiapa has quit IRC15:19
yolandahttp://logs.openstack.org/51/401251/15/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/494aca1/logs/undercloud/var/log/ironic/ironic-conductor.txt.gz#_2016-12-01_14_43_36_52315:19
*** liverpooler has joined #tripleo15:20
*** adarazs is now known as adarazs_afk15:20
dprincebnemec, gfidente: still cool with this? https://review.openstack.org/#/c/342486/15:21
colonwqEmilienM, ack on the new 004. I am taking a look at it.15:21
ccamachomatbu shardy, quick question is it normal that testing upgrades takes a lot of time? I mean, by each change "deploying and upgrading" the overcloud takes a lot of time for me, are you doing anything to make this a little bit more agile? i.e. I tried to re-launch the upgrade in a failed upgrade but got an error like "Hey, seems that a previous upgrade failed... "15:23
*** dhill__ has quit IRC15:23
*** dhill_ has joined #tripleo15:23
EmilienMcolonwq: no, https://review.openstack.org/40542915:24
colonwqEmilienM, that is a good catch.15:24
jprovazngfidente, hi15:25
matbucc!15:25
EmilienMcolonwq: is it the right fix/user?15:25
matbuoops15:25
matbuccamacho: i think it mostly depend on the status of the cluster15:26
colonwqEmilienM, I am pulling up my tht test environment. I'll let you know15:26
matbuccamacho: but you should be able to re-run the failed stack update15:26
matbuccamacho: for the duration, for now idk because my local box is really fast, but maybe you are hitting some timeout15:27
*** rajinir has joined #tripleo15:27
matbuccamacho: it can explain why it's so slow15:27
*** liverpooler has quit IRC15:27
matbuccamacho: but mine with pacemaker took arround 20 / 30 minutes maxi (stack update)15:28
*** liverpooler has joined #tripleo15:29
gfidentejprovazn hey15:30
EmilienMjaosorior: should we land https://review.openstack.org/403618 or address jistr's suggestion?15:30
jprovazngfidente, wanted to check with you your thoughts about https://bugs.launchpad.net/tripleo/+bug/164614715:31
openstackjprovazn: Error: Could not gather data from Launchpad for bug #1646147 (https://launchpad.net/bugs/1646147). The error has been logged15:31
jprovazngfidente, I added a comment there, though it's entirely possible I'm wrong15:31
jaosoriorEmilienM: I thinkw e should address jistr's suggestion, but if we can do it in another commit, that's fine too.15:32
EmilienMjaosorior: up to you15:32
jistrjaosorior: if you've tested the patches on top with the current state, i'm fine merging15:33
gfidentejprovazn okay I see it now15:34
jistrIOW i don't mind if we address it in another commit, it's quite a clean/unobtrusive refactoring, not changing any interfaces15:34
jaosoriorlets do it in another commit15:36
gfidentejprovazn though any chance we can pass the path to the keyring to manila?15:36
jaosoriorsorry for the slowness, in a meeting15:36
jprovazngfidente, sec, I'll send you what works for me15:36
gfidentejprovazn point is that I am not sure we want to edit ceph.conf from manila profile15:36
*** jbadiapa has joined #tripleo15:36
jistrEmilienM, jaosorior: +A'd with an explanation on the review15:37
jprovazngfidente, hm, I'm not sure if keyring path can be set directly in manila.conf15:37
jprovazngfidente, last I checked this my impression was it can not15:37
ccamachomatbu for me takes almost 1 hour :(15:38
matbuccamacho: does the nova-compute up and running on the compute ?15:39
matbuEmilienM: shardy any idea of the origin of the failure : http://logs.openstack.org/31/404831/7/experimental/gate-tripleo-ci-centos-7-multinode-upgrades-nv/e547aa5/console.html#_2016-12-01_15_34_17_63103915:39
jprovazngfidente, this patch worked for me http://pastebin.test.redhat.com/435466 if objection is that manila should not touch ceph config (though then there might be argument that w/o this manila setup is not complete) then there neds to be some other puppet module which can touch both manila and ceph - maybe something under puppet-tripleo15:41
gfidentejprovazn my point is more that we'd assume manila can push arbitrary changes for ceph.conf15:41
gfidentebut they might have been deployed even on different nodes15:42
tbarrongfidente: jprovazn it would only push changes for its own section.15:43
gfidentehi tbarron15:43
tbarrongfidente: hi15:43
gfidentewe might try to use ceph::key15:43
jprovazngfidente, right - the point is that it updates its own section15:43
gfidentebut then again, that would assume we have admin credentials15:43
gfidentewhich we don't15:43
gfidentejprovazn tbarron its own credentials you mean client.manila ?15:44
jprovazngfidente, yes15:44
tbarrongfidente: jprovazn yes15:44
gfidentebut it's not an owned section15:44
gfidenteit's just a generic key15:44
jprovazngfidente, and in another part I use ceph::key to create manila own key15:44
jprovazngfidente, I didn't ahve much luck with openstack user - ceph tries to evict users on driver init - https://bugs.launchpad.net/tripleo/+bug/1646147/comments/315:45
openstackLaunchpad bug 1646147 in tripleo "deploy of manila with external ceph fails to update ceph.conf" [Undecided,New] - Assigned to Jan Provaznik (jan-provaznik)15:45
*** athomas has quit IRC15:46
gfidentejprovazn maybe we can add grants to the openstack user?15:46
*** nyechiel has quit IRC15:46
gfidentejprovazn also for the openstack user we'd need to add a section in ceph.conf anyway no?15:47
jprovazngfidente, ok, let me try, though TBH I don't like much the idea of sharing single user fo all services15:47
openstackgerritTomas Sedovic proposed openstack/tripleo-validations: Don't rely on overcloudrc  https://review.openstack.org/40080015:47
gfidentejprovazn right we could work on that15:47
jprovazngfidente, yes, for openstack it would need to be there too15:47
jprovazngfidente, well, I have a POC patch for that15:48
jprovazngfidente, how about this, I'll submit patches (as WIP) and you get better idea what required a change?15:48
*** links has joined #tripleo15:48
*** hrybacki is now known as hrybacki|IAmGE15:49
gfidentejprovazn sure I think the only problem is in figuring how to add the section in ceph.conf for the manila user15:49
gfidenteor whichever user we need to add15:49
*** hrybacki|IAmGE is now known as hrybacki|lAmG315:49
jprovazngfidente, ok, I'll send it later today (going afk now) and add you to the patch15:50
EmilienMmatbu: looking15:51
*** hrybacki|lAmG3 is now known as hrybacki|l4mG315:51
EmilienMmatbu: I have seen it before15:51
EmilienMmatbu: sounds related to https://bugs.launchpad.net/tripleo/+bug/150194915:53
openstackLaunchpad bug 1501949 in tripleo "No image with a name or ID of 'bm-deploy-kernel' exists." [High,Fix released] - Assigned to Derek Higgins (derekh)15:53
matbuEmilienM: maybe it's due to the deploy command ? (missing a tripleo-ci env file ?)15:53
*** adarazs_afk is now known as adarazs15:54
matbuEmilienM: because for example, on this job, it didn't failed: http://logs.openstack.org/31/404831/7/check/gate-tripleo-ci-centos-7-nonha-multinode/327740d/console.html#_2016-12-01_15_26_56_50188615:54
*** yprokule has joined #tripleo15:58
*** numan_ has quit IRC15:59
openstackgerritMerged openstack/tripleo-heat-templates: Make scenario template paths relative  https://review.openstack.org/40484015:59
jistrshardy: just a follow up on the idea of reusing the composable major upgrade code for minor updates too -- i'm trying to sketch how could we possibly approach updates/upgrades of (semi-)containerized deployment, and i'm thinking that going from the monolithic non-customizable yum_update.sh towards reusing the upgrade parts would probably help immensly for this scenario15:59
*** liverpooler has quit IRC16:00
shardyjistr: excellent - yeah it seems like the interface could be exactly the same, we just don't to all the steps on minor updates16:01
*** abregman has quit IRC16:01
shardyjistr: or rather we could but exclude certain tasks based on tags16:01
*** liverpooler has joined #tripleo16:01
shardyjistr: interested to see how this may fit wrt containers - I've been unclear how applicable this step based model will be to containerized deployments16:02
shardywould be great to ensure the service template interfaces make sense in that caase16:02
shardycase16:02
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483116:02
EmilienMgfidente: https://review.openstack.org/#/c/404462/16:02
EmilienMeven with file backend it's broken16:03
EmilienMpradk, gfidente: can you guys review https://review.openstack.org/#/c/405427/ please16:03
EmilienMso we can move the job into the gate16:03
gfidenteyeah16:04
gfidenteEmilienM though the test is nice16:04
gfidentecan I ask you to comment it out instead of deleting it entirely?16:05
EmilienMgfidente: sure thing :)16:05
gfidentethanks!16:05
jistrshardy: i think it's still somewhat hazy for me how we'll use the new upgrade model for containers in detail, but as i see it currently, it should probably be more fitting than the old model, mainly due to the fact that it's so customizable. For containerized services we have different service templates, which means we can also output different upgrade steps, specific to containers, and the current step16:05
jistrmachinery should just pick it up like anything else.16:05
openstackgerritDmitry Tantsur proposed openstack/diskimage-builder: Try configuring iBFT devices in dhcp-all-interfaces  https://review.openstack.org/39178716:06
pradkEmilienM, hmm it fails with file too? we had file before and it was working?16:06
EmilienMpradk: was it?16:06
EmilienMI never saw it working tbh16:07
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras: collect-logs: add rdoproject env requirements  https://review.openstack.org/40539716:07
pradkEmilienM, looking at latest failure logs gnocchi is not even running?16:08
pradkEmilienM, there is no apache log or var/log/gnocchi in there16:08
pradkEmilienM, so something else is wrong16:08
*** ebarrera has quit IRC16:09
*** achadha has joined #tripleo16:09
pradkEmilienM, see http://logs.openstack.org/62/404462/5/check/gate-tripleo-ci-centos-7-scenario001-multinode-nv/900119a/logs/var/log/16:09
*** sshnaidm has quit IRC16:10
*** sshnaidm has joined #tripleo16:10
*** absubram has joined #tripleo16:12
pradkEmilienM, nm see it in subnode16:12
*** tremble has quit IRC16:12
*** nyechiel has joined #tripleo16:13
*** rcernin has quit IRC16:13
pradkEmilienM, the issue with file seems to be with coordinator16:13
pradki see 2016-12-01 15:41:36.915 45084 ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)16:13
*** dsariel has quit IRC16:13
pradkEmilienM, thats regardless of the backend16:14
pradkseems to be redis related16:14
openstackgerritAlejandro Andreu proposed openstack/tripleo-heat-templates: Create MidoNet services  https://review.openstack.org/39669216:14
EmilienMpradk: I might disappear, we've lost electricity and everything here, I'm in 3g16:14
pradkok16:14
EmilienMpradk: I've seen the error in aodh, right?16:14
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario001/pingtest: remove gnocchi_res_alarm  https://review.openstack.org/40542716:15
pradkEmilienM, yea for now we can comment it out, if its blocking16:17
pradkEmilienM, i'll kick off another patch once this merges and we can test this out properly16:19
*** sanagikoki has joined #tripleo16:19
EmilienMpradk: please do, on top of this patch if you like16:19
pradkyea16:19
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario001: deploy Ceph  https://review.openstack.org/40446216:19
*** nyechiel has quit IRC16:19
*** jlinkes__ has quit IRC16:21
*** jlinkes__ has joined #tripleo16:21
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud: [WIP] Optional Cinder support for undercloud  https://review.openstack.org/40543516:23
dtantsurfolks, an easy documentation change that can save our customers some gray hair: https://review.openstack.org/#/c/382524/16:25
*** pkovar has quit IRC16:25
*** sanagikoki has quit IRC16:26
*** sanagikoki has joined #tripleo16:26
*** jaosorior has quit IRC16:30
*** ealcaniz has joined #tripleo16:32
openstackgerritSven Anderson proposed openstack/tripleo-common: Add Ec2ApiPassword to PASSWORD_PARAMETER_NAMES  https://review.openstack.org/40375916:32
*** jbadiapa has quit IRC16:33
openstackgerritMartin AndrĂ© proposed openstack/tripleo-common: Update container images to point to newton  https://review.openstack.org/40543916:33
*** anton has quit IRC16:35
*** ealcaniz has quit IRC16:35
*** liverpooler has quit IRC16:35
*** limao_ has quit IRC16:35
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras: Use openstack common cli for validate-simple cleanup  https://review.openstack.org/40549616:36
*** anton has joined #tripleo16:37
*** achadha has quit IRC16:38
*** numans has joined #tripleo16:44
openstackgerritMerged openstack/tripleo-heat-templates: Add local template generation tox task  https://review.openstack.org/39441016:46
openstackgerritMerged openstack/tripleo-heat-templates: Make pep8 task run template generation  https://review.openstack.org/39441516:46
openstackgerritMerged openstack-infra/tripleo-ci: Update role path for collect-logs  https://review.openstack.org/40389616:47
*** pkovar has joined #tripleo16:47
openstackgerritMerged openstack/tripleo-heat-templates: Introduce network-based FQDNs via hiera  https://review.openstack.org/40361816:47
openstackgerritMerged openstack/tripleo-heat-templates: Initial support for composable upgrades with Heat+Ansible  https://review.openstack.org/39344816:47
openstackgerritMerged openstack/tripleo-heat-templates: Add ping_retry function  https://review.openstack.org/40483516:47
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Add more documentation around configuring DVR  https://review.openstack.org/39287416:48
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: Fix unbound variable in standalone delorean build  https://review.openstack.org/40551716:50
*** rcernin has joined #tripleo16:50
*** leanderthal is now known as leanderthal|afk16:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Implement scenario004 with Ceph Rados Gateway scenario  https://review.openstack.org/40445816:50
EmilienMcolonwq, gfidente: I got rgw scenario working ^16:51
*** lmiccini has quit IRC16:51
gfidenteEmilienM so what was wrong before?16:52
bnemecHey all, it would be nice to get the https://review.openstack.org/#/c/386713 series landed so the updates job works again.16:52
*** links has quit IRC16:53
*** links has joined #tripleo16:53
openstackgerritMerged openstack/tripleo-docs: Recommend using only metadata cleaning with Ironic in virtual overcloud  https://review.openstack.org/38252416:53
EmilienMgfidente: https://review.openstack.org/#/c/405429/16:53
openstackgerritMerged openstack/os-collect-config: Add support for Zaqar websockets  https://review.openstack.org/34248616:55
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Refactoring current upgrade scripts for composable upgrades  https://review.openstack.org/40344116:59
*** ohamada has quit IRC17:00
openstackgerritToure Dunnon proposed openstack/tripleo-common: Nodes registration are not interactive enough, information in regards to current status of each nodes is not available until the registration function completes the entire list of request which may appear to the user as though the process may be hung/susp  https://review.openstack.org/40553117:01
gfidenteEmilienM though I am worried something broke this recently17:03
dtantsurd0ugal, re https://review.openstack.org/#/c/405379/1/workbooks/baremetal.yaml can we add descriptions to parameters? /me was also confused by having both retry and timeout17:03
*** sudipto has quit IRC17:04
*** sudipto_ has quit IRC17:04
d0ugaldtantsur: no, unfortunately not, descriptions are only at the workflow level AFAIK17:06
*** liverpooler has joined #tripleo17:06
dtantsurd0ugal, ah, I see. then I'm not sure what I can change to make it clearer17:07
*** jpich has quit IRC17:07
d0ugaldtantsur: Yeah, well, I'd like us to start using the descriptions a bit like python docstrings (in terms of purpose rather than syntax)17:08
d0ugalbut since we don't do that anywhere else yet... that is why I still added a +217:08
colonwqgfidente, EmilienM I think 403820 broke tht and created the need for 405429.17:09
d0ugaldtantsur: I was going to +W anyway, just going through the other patch17:09
dtantsurah, ok17:09
gfidentecolonwq cool that was to support user/pass authentication17:10
EmilienMcolonwq, gfidente: :(17:10
colonwqI fixed p-o-i but not tht.17:10
d0ugaldtantsur: spotted one small issue in the second patch, otherwise LGTM!17:10
gfidentecolonwq good you found it17:11
gfidenteso we need to pass project to?17:11
gfidente*too17:11
*** mgould is now known as mgould|afk17:11
dtantsurd0ugal, thanks!17:11
gfidentecolonwq ah we have it already17:11
*** achadha has joined #tripleo17:13
colonwqgfidente, Good.17:13
gfidentecolonwq so I assigned this to you https://bugs.launchpad.net/tripleo/+bug/164252417:13
openstackLaunchpad bug 1642524 in tripleo "ceph-rgw should not use the keystone admin token" [High,Confirmed] - Assigned to Keith Schincke (keith-schincke)17:13
*** paramite has quit IRC17:13
gfidentecan you update the status there?17:13
colonwqgfidente, will do.17:13
gfidenteEmilienM not sure if you want to update the ::user fix with Closes-Bug or something?17:14
EmilienMcolonwq: should we merge https://review.openstack.org/#/c/405429/ or fix it in another place?17:14
EmilienMgfidente: same question ^17:14
openstackgerritLucas Alvares Gomes proposed openstack/tripleo-quickstart: Allow customizing the hard-drive Serial and/or WWN  https://review.openstack.org/40415617:15
*** achadha has quit IRC17:15
*** iranzo has quit IRC17:15
*** achadha has joined #tripleo17:15
*** milan has quit IRC17:15
colonwqEmilienM, I feel it should be merged as-is. The admin can override these defaults via a local environment file if wanted.17:16
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: ceph-rgw: add missing user parameter  https://review.openstack.org/40542917:16
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Implement scenario004 with Ceph Rados Gateway scenario  https://review.openstack.org/40445817:16
colonwqThe tenant is in the same file.17:16
EmilienMgfidente: done ^17:16
gfidentecolonwq tenant is already there yes, we don't need to add it17:16
*** achadha has quit IRC17:17
*** rasca has quit IRC17:17
*** achadha has joined #tripleo17:18
*** derekh has quit IRC17:20
*** bana_k has joined #tripleo17:22
openstackgerritDmitry Tantsur proposed openstack/tripleo-common: Workflow for applying RAID configuration to Ironic nodes  https://review.openstack.org/40023117:26
*** dprince has quit IRC17:27
*** liverpooler has quit IRC17:31
*** liverpooler has joined #tripleo17:31
*** ctayal has joined #tripleo17:33
*** rbrady is now known as rbrady-run17:33
*** ctayal has quit IRC17:34
*** jeckersb is now known as jeckersb_gone17:34
*** lucasagomes is now known as lucas-afk17:35
*** jlinkes__ has quit IRC17:36
*** jeckersb_gone is now known as jeckersb17:37
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario001: deploy Cinder with RBD backend  https://review.openstack.org/40554517:37
*** penick has joined #tripleo17:37
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud: [WIP] Optional Cinder support for undercloud  https://review.openstack.org/40543517:38
bnemecEmilienM: Don't we already do that in our regular ceph-enabled jobs?17:39
*** dtantsur is now known as dtantsur|afk17:40
bnemecThe nonha job deploys ceph and uses storage-environment.yaml to configure the services to use it: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_gate_test.sh#n15717:40
EmilienMbnemec: yes, it does17:41
EmilienMbnemec: but I don't think it's a problem to add the coverage on scenarios as they run only at demand17:41
EmilienMbnemec: scenario001 aims to be the ceph + telemetry scenarios, covering Telemetry services and Ceph backends17:41
EmilienMbnemec: it will be run in puppet-ceph gate too, once we switch to zuulv3 (right now we run the job when touching some files, but can't select a whole project)17:42
bnemecEmilienM: Okay, fair enough.17:42
EmilienMbnemec: it will save some OVB resources, that are IMHO very busy and should be used to test actual baremetal things, like nova, ironic, neutron17:43
*** dprince has joined #tripleo17:43
*** mhenkel has joined #tripleo17:43
*** ctayal has joined #tripleo17:43
colonwqgfidente, for development clarification, I should add support for RGW/Keystone V3 but have the admin_token be the default for the OpenStack O? Or can I switch methonds and have admin token be listed as depricated?17:43
bnemecEmilienM: Yeah, makes sense.  I didn't want to deploy services unnecessarily, but if it's going to be running places that ovb jobs don't then that's not the case.17:44
gfidentecolonwq i think we can go to v317:45
colonwqgfidente, ok.17:45
EmilienMbnemec: exactly, sorry I wasn't clear at first :)17:45
*** chlong has joined #tripleo17:45
gfidenteif updates don't break existing17:45
gfidentedata17:45
gfidentecause we will have people doing stack update17:46
colonwqgfidente, I can do that17:46
gfidentebnemec the update job17:48
*** ayoung has quit IRC17:48
gfidenteisn't it missing storage-environment.yaml to work with ceph?17:48
*** dbecker has quit IRC17:49
bnemecgfidente: I had to drop ceph because it was breaking updates.  https://bugs.launchpad.net/tripleo/+bug/164165317:49
openstackLaunchpad bug 1641653 in tripleo "virsh secret-set-value failing on updates" [Critical,Triaged]17:49
bnemecI want to get the job running again and then we can figure out how to re-enable ceph.17:50
gfidenteack17:50
bnemecOnce https://review.openstack.org/#/c/397288 merges I'll post a revert so we can try it with ceph again.17:50
*** b00tcat has quit IRC17:52
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras: DO NOT MERGE: Add test commit to check gate triggers  https://review.openstack.org/40381817:52
*** bkopilov has quit IRC17:54
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Update ovb baremetal flavor to match infra flavor  https://review.openstack.org/39849617:54
*** arxcruz has quit IRC17:54
*** bana_k has quit IRC17:57
*** bkopilov has joined #tripleo17:58
*** athomas has joined #tripleo17:59
*** nyechiel has joined #tripleo17:59
openstackgerritMerged openstack/tripleo-common: Create a workflow for running manual cleaning on nodes  https://review.openstack.org/40537918:04
*** florianf has quit IRC18:04
*** nyechiel_ has joined #tripleo18:05
*** yamahata has joined #tripleo18:09
*** nyechiel has quit IRC18:09
*** dbecker has joined #tripleo18:09
*** nyechiel_ has quit IRC18:10
*** yprokule has quit IRC18:16
*** nyechiel_ has joined #tripleo18:16
*** penick has quit IRC18:18
*** amoralej is now known as amoralej|off18:20
*** pkovar has quit IRC18:21
*** florianf has joined #tripleo18:21
*** saneax-_-|AFK is now known as saneax18:23
*** yamahata has quit IRC18:24
*** penick has joined #tripleo18:24
*** jpena is now known as jpena|off18:24
*** yamahata has joined #tripleo18:26
*** faizy has quit IRC18:28
*** abregman has joined #tripleo18:30
*** panda is now known as panda|bbl18:31
*** liverpooler has quit IRC18:32
*** liverpooler has joined #tripleo18:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario002: test Cinder Backup with Swift backend  https://review.openstack.org/40556418:34
*** shardy has quit IRC18:34
*** gfidente has quit IRC18:34
*** tosky has quit IRC18:35
openstackgerritJohn Eckersberg proposed openstack/tripleo-quickstart: Gracefully handle empty modprobe.d directory  https://review.openstack.org/40556518:35
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario003: configure Keystone tokens with Fernet provider  https://review.openstack.org/40556618:36
*** rbrady-run is now known as rbrady18:36
openstackgerritKeith Schincke proposed openstack/puppet-tripleo: WIP Add support for not using admin_token in Ceph/RGW  https://review.openstack.org/40556718:38
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario001: test Cinder Backup with Ceph backend  https://review.openstack.org/40557118:41
*** ccamacho has quit IRC18:44
openstackgerritMerged openstack-infra/tripleo-ci: Temporarily disable ceph in the updates job  https://review.openstack.org/39728818:44
EmilienMdo you know how we could test horizon from the pingtest? could we run a bash script (that curl horizon) from a Heat resource?18:45
*** bana_k has joined #tripleo18:47
*** bana_k has quit IRC18:49
*** bana_k has joined #tripleo18:50
*** cylopez has left #tripleo18:51
*** trown is now known as trown|lunch19:04
*** penick has quit IRC19:07
*** abregman has quit IRC19:07
*** rlandy is now known as rlandy|mtg19:09
*** penick has joined #tripleo19:09
*** nyechiel_ has quit IRC19:09
EmilienMmwhahaha: do you plan to add tests in tripleo-ci for https://review.openstack.org/401024 ?19:13
mwhahahaMaybe?19:13
EmilienMmwhahaha: I can work on it so i'll play the monkey :)19:16
bnemecWe have a test for that today: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/tripleo.sh#n69019:16
bnemecIt only runs on periodic ha jobs though: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_gate_test.sh#n9919:16
bnemecBecause it adds a non-trivial amount of time to every job.19:17
bnemecI should say we test deleting the overcloud stack.  It should be pretty simple to switch it to the new command though.19:18
* bnemec also notes that we should be able to remove all the liberty hacks in tripleo.sh now \o/19:19
openstackgerritMerged openstack/tripleo-docs: Remove WIP message  https://review.openstack.org/40469719:19
EmilienMbnemec: indeed, thanks for precision19:20
openstackgerritMerged openstack/tripleo-docs: Document how to quiesce and delete a cephstorage node  https://review.openstack.org/40443419:20
*** david-lyle_ has joined #tripleo19:28
openstackgerritMike Burns proposed openstack/tripleo-common: Fix interactive update race condition  https://review.openstack.org/40558519:30
*** david-lyle has quit IRC19:31
openstackgerritMerged openstack-infra/tripleo-ci: Always use cached images in updates job  https://review.openstack.org/38671319:31
*** openstackgerrit has quit IRC19:32
*** openstackgerrit has joined #tripleo19:33
EmilienMbnemec: https://review.openstack.org/#/c/404462/6/ci/environments/scenario001-multinode.yaml -- yes, we're deploying ext4, if we don't set it Ceph is not working using multinode jobs19:36
*** openstackgerrit has quit IRC19:36
*** saneax is now known as saneax-_-|AFK19:40
*** tzumainn has quit IRC19:44
*** openstackgerrit has joined #tripleo19:44
openstackgerritMerged openstack/diskimage-builder: elements: Drop unneeded DIB_INIT_SYSTEM usage  https://review.openstack.org/40199119:44
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario002: test Cinder Backup with Swift backend  https://review.openstack.org/40556419:44
*** fzdarsky is now known as fzdarsky|afk19:47
*** akrivoka has quit IRC19:47
openstackgerritAde Lee proposed openstack/instack-undercloud: Add option to set undercloud dns nameserver  https://review.openstack.org/40093719:47
openstackgerritAde Lee proposed openstack/instack-undercloud: Add code to support novajoin in the undercloud  https://review.openstack.org/39922019:47
openstackgerritMerged openstack-infra/tripleo-ci: cleanup: remove scenario004 bits  https://review.openstack.org/40444719:51
*** bank_ has joined #tripleo19:52
*** nyechiel_ has joined #tripleo19:53
*** bana_k has quit IRC19:54
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario001: test Cinder Backup with Ceph backend  https://review.openstack.org/40557119:54
openstackgerritMerged openstack/tripleo-heat-templates: scenario001/pingtest: remove gnocchi_res_alarm  https://review.openstack.org/40542719:56
openstackgerritMerged openstack/tripleo-heat-templates: ceph-rgw: add missing user parameter  https://review.openstack.org/40542919:59
*** kjw3 has joined #tripleo20:00
*** stevebaker has joined #tripleo20:00
*** david-lyle_ is now known as david-lyle20:01
openstackgerritToure Dunnon proposed openstack/tripleo-common: Nodes registration are not interactive enough, information in regards to current status of each nodes is not available until the registration function completes the entire list of request which may appear to the user as though the process may be hung/susp  https://review.openstack.org/40560220:01
yolandahi, i'm still having that failure on DIB feature/v2 and tripleo: http://logs.openstack.org/51/401251/17/check/gate-tripleo-ci-centos-7-nonha-multinode/03865e2/logs/postci.txt.gz#_2016-12-01_16_34_06_00020:02
yolandaNo module named ipaddr20:02
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add scenario004 to logs  https://review.openstack.org/40445020:02
yolandalooking at the logs, i see python-ipaddress package installed20:02
yolandaand i don't know where this error comes from, also i cannot see how diskimage-builder image is created for that test20:03
yolandacan i get some help?20:03
*** paramite has joined #tripleo20:03
yolandathe other tests are finally passing, including OVB ones20:03
EmilienMyolanda: so it works in ovb but not in multinode jobs?20:04
yolandayep20:05
yolandaon multinode it fails with that error20:05
*** florianf has quit IRC20:05
yolandalatest ovb passed https://review.openstack.org/#/c/401251/20:05
stevebakermorning20:05
*** ctayal has quit IRC20:07
*** links has quit IRC20:09
*** dsariel has joined #tripleo20:11
openstackgerritAdriano Petrich proposed openstack/tripleo-quickstart-extras: WIP testing if it CREATE_FAILED returns false  https://review.openstack.org/40561420:13
openstackgerritAde Lee proposed openstack/tripleo-quickstart: changes to add novajoin to undercloud  https://review.openstack.org/39877220:16
openstackgerritAde Lee proposed openstack/tripleo-quickstart: Add option to set DNS name servers on the undercloud  https://review.openstack.org/40145220:16
*** dprince has quit IRC20:16
openstackgerritAdriano Petrich proposed openstack/tripleo-quickstart-extras: WIP testing if it CREATE_FAILED returns false  https://review.openstack.org/40561420:17
*** nyechiel_ has quit IRC20:17
*** ctayal has joined #tripleo20:18
*** trown|lunch is now known as trown20:19
*** owalsh_ has joined #tripleo20:23
*** owalsh has quit IRC20:25
openstackgerritToure Dunnon proposed openstack/tripleo-common: TripleO-Common message bus module for GUI / CLI  https://review.openstack.org/40553120:28
*** sshnaidm has quit IRC20:30
openstackgerritAde Lee proposed openstack/tripleo-quickstart: changes to add novajoin to undercloud  https://review.openstack.org/39877220:36
*** achadha has quit IRC20:37
*** achadha has joined #tripleo20:37
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Dont merge  https://review.openstack.org/40562320:39
*** openstack has joined #tripleo20:43
*** pradk has quit IRC20:43
openstackgerritKeith Schincke proposed openstack/puppet-tripleo: WIP Add support for not using admin_token in Ceph/RGW  https://review.openstack.org/40556720:45
*** pradk has joined #tripleo20:46
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Refactoring current upgrade scripts for composable upgrades  https://review.openstack.org/40344120:46
openstackgerritKeith Schincke proposed openstack/tripleo-heat-templates: WIP Add support for not using admin_token in Ceph/RGW  https://review.openstack.org/40562520:49
colonwqEmilienM or anyone, about patch 405625, is there a document describing when to use config_settings versus service_config_settings to set values?20:50
EmilienMcolonwq: config_settings is to configure the service itself20:51
EmilienMwhile service_config_settings will configure another service not managed by the YAML you're editing20:51
EmilienMand each key is the name of the service20:52
colonwqEmilienM, keystone in this example but possibly cinder in an other.20:52
EmilienMcolonwq: yes20:53
EmilienMcolonwq: cinder-api or something20:53
colonwqEmilienM, thanks that helps clear things.20:53
openstackgerritJan Provaznik proposed openstack/tripleo-heat-templates: Set manila cephfs backend if ceph is deployed  https://review.openstack.org/40562720:53
*** rlandy|mtg is now known as rlandy20:55
*** jprovazn has quit IRC20:55
*** owalsh_ is now known as owalsh20:56
*** lblanchard has quit IRC20:57
*** penick has quit IRC21:01
*** toure is now known as toure|gone21:04
*** toure|gone is now known as toure|biab21:04
*** dsneddon_ has joined #tripleo21:04
*** penick has joined #tripleo21:05
*** bank_ has quit IRC21:05
*** jayg is now known as jayg|g0n321:05
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: scenario001: deploy Cinder with RBD backend  https://review.openstack.org/40554521:06
*** paramite has quit IRC21:08
*** pradk has quit IRC21:08
*** liverpooler has quit IRC21:08
*** pradk has joined #tripleo21:09
*** rcernin has quit IRC21:10
openstackgerritOpenStack Proposal Bot proposed openstack/os-collect-config: Updated from global requirements  https://review.openstack.org/40090721:15
*** bana_k has joined #tripleo21:17
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras: deployment updates for containerized compute  https://review.openstack.org/40098621:20
*** mhenkel has quit IRC21:20
*** dsavineau has quit IRC21:25
*** dsavineau has joined #tripleo21:25
*** pradk has quit IRC21:28
*** pradk has joined #tripleo21:28
*** egafford has quit IRC21:32
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Test commit  https://review.openstack.org/40564021:33
*** dsneddon_ has quit IRC21:37
*** jeckersb is now known as jeckersb_gone21:38
*** abregman has joined #tripleo21:38
*** mhenkel has joined #tripleo21:39
*** rhallisey has quit IRC21:41
*** jkilpatr has quit IRC21:41
*** dbecker has quit IRC21:44
*** jtomasek has quit IRC21:48
*** dtrainor has quit IRC21:48
*** jrist has quit IRC21:49
*** noslzzp has quit IRC21:49
*** trown is now known as trown|outtypewww21:51
*** jcoufal has quit IRC21:54
openstackgerritAdriano Petrich proposed openstack/python-tripleoclient: Validate the plan name before running  https://review.openstack.org/40566421:57
*** bana_k has quit IRC21:58
*** saibarspeis has joined #tripleo21:59
*** dsariel has quit IRC22:00
*** Goneri has quit IRC22:01
*** openstackgerrit has quit IRC22:03
*** openstackgerrit has joined #tripleo22:04
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Add support for initial state to the register_or_update workflow  https://review.openstack.org/39842222:04
*** thrash is now known as thrash|g0ne22:05
*** bana_k has joined #tripleo22:06
openstackgerritMerged openstack/python-tripleoclient: Remove python-networking-cisco from image build  https://review.openstack.org/40489022:08
openstackgerritMerged openstack/python-tripleoclient: Add a timeout when waiting for messages from the deploy workflow  https://review.openstack.org/40460122:09
openstackgerritMerged openstack/python-tripleoclient: Default the stack name to 'overcloud' in overcloud node delete  https://review.openstack.org/40432422:09
openstackgerritMerged openstack/python-tripleoclient: Implement overcloud delete command  https://review.openstack.org/40102422:09
openstackgerritMerged openstack/python-tripleoclient: Only show deprecated args for overcloud deploy  https://review.openstack.org/39216622:09
openstackgerritMerged openstack/python-tripleoclient: Remove "baremetal show capabilities" command  https://review.openstack.org/38723322:09
openstackgerritMerged openstack-infra/tripleo-ci: Fix unbound variable in standalone delorean build  https://review.openstack.org/40551722:09
openstackgerritMerged openstack-infra/tripleo-ci: Remove temporary hotfix  https://review.openstack.org/40385022:09
*** saibarspeis has quit IRC22:09
*** cdearborn has quit IRC22:11
openstackgerritMerged openstack-infra/tripleo-ci: Rate limit testenv creation  https://review.openstack.org/38473122:20
*** saibarspeis has joined #tripleo22:21
*** chandankumar is now known as chandankumar|off22:29
*** saibarspeis has quit IRC22:37
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add 3 node multinode job  https://review.openstack.org/39744122:41
*** artom_ has quit IRC22:43
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Make get-occ-config.sh support custom roles  https://review.openstack.org/38560722:43
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Run log collection in parallel  https://review.openstack.org/40567022:44
*** artom has joined #tripleo22:44
*** rajinir has quit IRC22:46
*** chlong has quit IRC22:50
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras: deployment updates for containerized compute  https://review.openstack.org/40098622:53
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: config for containerized-compute  https://review.openstack.org/39334822:53
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: config for containerized-compute  https://review.openstack.org/39334822:55
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test with scheduler hints  https://review.openstack.org/37804022:55
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add feature testing matrix to readme  https://review.openstack.org/39926922:55
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add support for testing predictable placement  https://review.openstack.org/37801422:56
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test hostname map  https://review.openstack.org/37801722:56
*** bnemec has quit IRC22:57
*** athomas has quit IRC22:57
*** abregman has quit IRC23:03
openstackgerritMerged openstack-infra/tripleo-ci: Add scenario004 to logs  https://review.openstack.org/40445023:05
*** flepied has quit IRC23:07
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: elements: Drop executable bits from environment files  https://review.openstack.org/38744123:09
openstackgerritMerged openstack/tripleo-heat-templates: scenario003: configure Keystone tokens with Fernet provider  https://review.openstack.org/40556623:10
*** ebalduf_ has joined #tripleo23:10
*** ebalduf_ has quit IRC23:11
ianwhi, anyone around who can help me pinpoint where dib is called?23:12
*** ayoung has joined #tripleo23:12
mwhahahaianw: I think there are a few places, what are you looking to do/find?23:13
openstackgerritMerged openstack/instack-undercloud: Increase the default number of workers for heat engine  https://review.openstack.org/39961923:14
*** achadha has quit IRC23:14
mwhahahaianw: https://github.com/openstack/python-tripleoclient/blob/c9392c7773019cdeff917864bfbbe605534c3c01/tripleoclient/v1/overcloud_image.py is where openstack overcloud image build calls it23:14
ianwmwhahaha: particularly he one that creates the undercloud image in gate-tripleo-ci-centos-7-ovb-ha23:14
mwhahahaso i think that's in a different place23:14
*** achadha has joined #tripleo23:14
mwhahahagimme a minute and i'll help you look23:15
openstackgerritMerged openstack/os-apply-config: Show team and repo badges on README  https://review.openstack.org/40257823:17
openstackgerritMerged openstack/os-cloud-config: Show team and repo badges on README  https://review.openstack.org/40258023:17
openstackgerritMerged openstack/os-collect-config: Show team and repo badges on README  https://review.openstack.org/40257223:17
*** social has quit IRC23:17
*** social has joined #tripleo23:18
*** jkilpatr has joined #tripleo23:18
mwhahahaianw: i think it's done here, https://github.com/openstack-infra/tripleo-ci/blob/01b37d553b115d6bbbbfa08445717a534a6df0aa/scripts/common_functions.sh#L25723:19
openstackgerritMerged openstack/os-refresh-config: Show team and repo badges on README  https://review.openstack.org/40257423:19
ianwmwhahaha: hmm, i'm thinking it comes from http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/bootstrap-overcloud-full.sh#n5323:20
ianwtripleo-build-images is in python-tripeloclient i guess?23:21
*** fultonj has quit IRC23:21
openstackgerritOpenStack Proposal Bot proposed openstack/os-cloud-config: Updated from global requirements  https://review.openstack.org/38992323:21
openstackgerritOpenStack Proposal Bot proposed openstack/os-collect-config: Updated from global requirements  https://review.openstack.org/40090723:21
mwhahahaianw: that's for liberty/mitaka23:21
mwhahahaianw: are you looking into those CI versions?23:22
*** absubram has quit IRC23:22
ianwmwhahaha: not really, what i essentially want to do is turn on "-x" for the disk-image-create call so we get full logging23:22
ianwi'm just trying to find the right place to do that23:22
mwhahahaianw: do you have a review so i can double check i'm looking in the right place? :D23:23
mwhahahacause i was looking at http://logs.openstack.org/02/405002/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/7ba5a2a/console.html#_2016-11-30_23_55_00_74750523:23
mwhahahawhich callses the deloran_build_and_serve23:23
ianwmwhahaha: yolanda told me to take a look at the dib build logs in the undercloud.tar.xz file from -> http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/bootstrap-overcloud-full.sh#n5323:23
ianwalthough the image builds fine with dibv2, it seems that it doesn't boot23:24
*** penick has quit IRC23:25
ianwbah, that is not the link23:25
ianwhttp://logs.openstack.org/51/401251/17/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/2113cc0/logs/23:25
ianwi'm tracking bits and pieces on https://etherpad.openstack.org/p/tripleoVdibv223:26
mwhahahai think you might be in the right spot,i was pointing you higher in up in the run23:26
ianwi think that might be from instack-undercloud23:27
openstackgerritMerged openstack/tripleo-common: Move the overcloudrc generation from tripleoclient to a Mistral action  https://review.openstack.org/39721123:30
ianwok, from the element list http://git.openstack.org/cgit/openstack/tripleo-common/tree/image-yaml/overcloud-images.yaml is definitely creating it23:31
ianwyep, so that's coming from http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/bootstrap-overcloud-full.sh23:32
mwhahahahttp://logs.openstack.org/51/401251/17/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/2113cc0/console.html#_2016-12-01_16_43_33_90272123:33
ianwwhich i think has got to be coming from tripleo_common/image/image_builder.py23:33
mwhahahahttps://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L526-L52823:34
mwhahahawhich would be from python-tripleoclient23:34
mwhahahawhat i pasted originaly23:35
mwhahahaso annoying that there's two places :D i think you found the other one23:35
mwhahahaso you could add a -x here, https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_image.py#L15423:36
*** larstobi has quit IRC23:37
ianwmwhahaha: excellent ... so what's the other one i found?  not used any more?23:37
mwhahahait's used by oooq23:38
ianwok, i have no idea what oooq is :)23:38
mwhahahatripleo-quickstart23:38
mwhahahait calls some otherway to build images23:38
*** cdearborn has joined #tripleo23:38
mwhahahathere's another command to build the images that can be used23:38
mwhahahai forget the name at the moment23:39
mwhahahamight be that tripleo-image-build or whatever23:39
openstackgerritIan Wienand proposed openstack/python-tripleoclient: Add tracing flag to dib invocations  https://review.openstack.org/40568023:39
ianwmwhahaha: ^ my first tripleo patch :)23:39
mwhahaha:D23:40
ianwyolanda: i've depended-on ^^ in https://review.openstack.org/#/c/405460/ and hopefully we'll get some good verbose logs to look into23:42
*** weshay is now known as weshay_pto23:43
ianwi might try and sneak onto the build machines and grab the generated .qcow223:44
ianwi guess i could hold them to23:44
*** bfournie has quit IRC23:44
*** penick has joined #tripleo23:45
*** larstobi has joined #tripleo23:56
*** bana_k has quit IRC23:56
*** penick has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!