Friday, 2016-11-25

*** Pavo has quit IRC00:02
*** Pavo has joined #rdo00:07
*** wolverineav has joined #rdo00:11
*** panda is now known as panda|zZ00:18
*** wolverineav has quit IRC00:20
*** wolverineav has joined #rdo00:21
*** wolverineav has quit IRC00:25
*** wolverineav has joined #rdo00:32
*** wolverineav has quit IRC00:36
*** steveg_afk has quit IRC00:42
*** jrist has quit IRC00:43
*** jrist has joined #rdo00:44
*** sdake_ has joined #rdo00:45
*** jrist has quit IRC00:48
*** sdake has quit IRC00:49
*** gildub has joined #rdo00:49
*** wolverineav has joined #rdo00:50
*** jrist has joined #rdo00:50
*** jrist has joined #rdo00:50
*** fragatin_ has quit IRC00:50
*** fragatina has joined #rdo00:51
*** jrist has quit IRC00:52
*** jrist has joined #rdo00:53
*** artom__ is now known as artom00:53
*** Pavo has quit IRC00:54
*** ihrachys has quit IRC00:55
*** wolverineav has quit IRC00:55
*** Pavo has joined #rdo00:55
*** kaminohana has quit IRC00:58
*** tosky has quit IRC00:58
*** Pavo has quit IRC00:58
*** Pavo has joined #rdo00:59
*** steveg_afk has joined #rdo01:00
*** Pavo has quit IRC01:03
*** puzzled has quit IRC01:05
*** steveg_afk has quit IRC01:06
*** Pavo has joined #rdo01:09
*** steveg_afk has joined #rdo01:10
*** wolverineav has joined #rdo01:13
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: heat, oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html01:16
*** wolverineav has quit IRC01:17
*** steveg_afk has quit IRC01:23
*** wolverineav has joined #rdo01:27
*** sdake_ has quit IRC01:29
*** wolverineav has quit IRC01:36
*** dave-johnston has quit IRC01:43
*** Goneri has quit IRC01:53
*** limao has joined #rdo02:01
*** wolverineav has joined #rdo02:07
*** jkilpatr has quit IRC02:11
*** Jeffrey4l has joined #rdo02:11
*** wolverineav has quit IRC02:12
*** ssbarnea has quit IRC02:15
*** dsneddon has quit IRC02:17
*** severion has joined #rdo02:22
*** v1k0d3n has quit IRC02:26
*** fzdarsky_ has joined #rdo02:47
*** Poornima has joined #rdo02:49
*** crossbuilder_ has joined #rdo02:49
*** crossbuilder has quit IRC02:49
*** sdake has joined #rdo02:50
*** fzdarsky|afk has quit IRC02:51
*** v1k0d3n has joined #rdo02:55
*** v1k0d3n_ has joined #rdo02:56
*** severion has quit IRC02:58
*** Pavo has quit IRC02:58
*** v1k0d3n has quit IRC03:00
*** Pavo has joined #rdo03:01
*** cliles has quit IRC03:07
*** sdake has quit IRC03:07
*** masonjoyers has quit IRC03:09
*** v1k0d3n has joined #rdo03:14
*** wolverineav has joined #rdo03:15
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: heat, oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html03:16
*** v1k0d3n_ has quit IRC03:17
*** wolverineav has quit IRC03:21
*** severion has joined #rdo03:23
*** v1k0d3n has quit IRC03:27
*** v1k0d3n has joined #rdo03:32
*** severion has quit IRC03:35
*** imcsk8_ has joined #rdo03:36
*** imcsk8 has quit IRC03:39
*** wolverineav has joined #rdo03:43
*** ayoung has quit IRC03:47
*** wolverineav has quit IRC03:48
*** links has joined #rdo03:48
*** jhershbe_ has joined #rdo03:55
*** jhershbe_ has quit IRC04:06
*** dgurtner has joined #rdo04:07
*** severion has joined #rdo04:18
*** v1k0d3n has quit IRC04:22
*** v1k0d3n has joined #rdo04:22
*** severion has quit IRC04:25
*** I has joined #rdo04:28
*** sudipto_ has joined #rdo04:28
*** I is now known as Guest6307104:28
*** wolverineav has joined #rdo04:28
*** numans has joined #rdo04:30
*** dgurtner has quit IRC04:32
*** wolverineav has quit IRC04:33
*** apetrich has quit IRC04:47
*** apetrich has joined #rdo04:47
*** masonjoyers has joined #rdo04:52
*** gildub has quit IRC04:52
*** wolverineav has joined #rdo04:58
*** Pavo has quit IRC04:58
*** sbulage has quit IRC04:59
*** Pavo has joined #rdo04:59
*** wolverineav has quit IRC05:03
*** sudipto_ has quit IRC05:04
*** Guest63071 has quit IRC05:04
*** wolverineav has joined #rdo05:09
*** rdas has joined #rdo05:09
*** misty-cloud has joined #rdo05:12
*** Amita has joined #rdo05:13
*** sbulage has joined #rdo05:15
*** wolverineav has quit IRC05:16
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: heat, oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html05:16
*** sbulage is now known as satya4ever05:25
*** limao has quit IRC05:33
*** limao has joined #rdo05:42
*** wolverineav has joined #rdo05:42
*** wolverineav has quit IRC05:47
*** wolverineav has joined #rdo05:54
*** imcleod has quit IRC05:55
*** wolverineav has quit IRC06:04
*** emalikov has joined #rdo06:06
*** yfried has joined #rdo06:08
*** anilvenkata has joined #rdo06:13
*** yfried has quit IRC06:13
*** wolverineav has joined #rdo06:16
*** cliles has joined #rdo06:19
*** wolverineav has quit IRC06:21
*** cliles has quit IRC06:21
*** jaosorior has joined #rdo06:28
*** wolverineav has joined #rdo06:29
*** saneax-_-|AFK is now known as saneax06:30
*** jbadiapa has joined #rdo06:32
*** wolverineav has quit IRC06:34
*** chandankumar has joined #rdo06:38
*** rgogunskiy has joined #rdo06:42
*** pnavarro has joined #rdo06:48
*** iranzo has joined #rdo06:53
*** jaosorior has quit IRC06:58
*** Pavo has quit IRC06:58
*** jaosorior has joined #rdo06:59
*** wolverineav has joined #rdo06:59
*** rwsu has quit IRC07:03
*** wolverineav has quit IRC07:03
*** Pavo has joined #rdo07:04
*** yfried has joined #rdo07:05
*** rcernin has joined #rdo07:05
*** ealcaniz has joined #rdo07:06
*** ealcaniz has quit IRC07:08
*** ealcaniz has joined #rdo07:09
*** chandankumar has quit IRC07:09
*** dgurtner has joined #rdo07:13
*** rasca has joined #rdo07:16
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: heat, oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html07:16
*** jprovazn has joined #rdo07:19
*** aufi has joined #rdo07:19
*** wolverineav has joined #rdo07:23
*** dgurtner has quit IRC07:26
*** ealcaniz has quit IRC07:26
*** rcernin has quit IRC07:26
*** athomas has joined #rdo07:26
*** ealcaniz has joined #rdo07:26
*** rcernin has joined #rdo07:28
*** anilvenkata is now known as anilvenkata_afk07:32
*** wolverineav has quit IRC07:36
*** dbecker has joined #rdo07:41
*** smeyer has joined #rdo07:44
*** vaneldik has joined #rdo07:44
*** pnavarro has quit IRC07:45
ccamachoyfried, morning, yesterday I spent some cycles checking your issue, and there is for sure some snag over there07:47
ccamachoeven if the resource its being executed, the actual "script" is not07:47
ccamachoIll file the bug07:47
ccamachoyfried^07:47
*** rcernin has quit IRC07:51
*** wolverineav has joined #rdo07:51
*** gszasz has joined #rdo07:52
*** rcernin has joined #rdo07:54
*** Jeffrey4l has quit IRC07:57
*** wolverineav has quit IRC07:59
*** pgadiya has joined #rdo08:05
*** shardy has joined #rdo08:06
*** amoralej|off is now known as amoralej08:11
amoralejgood morning08:12
*** florianf has joined #rdo08:16
*** ihrachys has joined #rdo08:17
*** zoli|gone is now known as zoli|wfh08:17
*** zoli|wfh is now known as zoliXXL08:18
*** pcaruana has joined #rdo08:19
*** wolverineav has joined #rdo08:20
amoralejapevec, number80, next issue in migration to 7.3, openstack-selinux, we need to update it https://bugzilla.redhat.com/show_bug.cgi?id=137576608:21
openstackbugzilla.redhat.com bug 1375766 in openstack-selinux "OSP10 puddle install on RHEL7.3 Beta throws AVCs on compute node" [Unspecified,Closed: duplicate] - Assigned to rhallise08:21
*** jpena|off is now known as jpena08:21
amoraleji'm trying to figure out compatibility with 7.208:21
jpenagood morning08:22
amoralejgood morning jpena08:23
*** egallen has joined #rdo08:25
number80ok08:25
*** wolverineav has quit IRC08:25
*** wolverineav has joined #rdo08:26
*** wolverineav has quit IRC08:26
*** wolverineav has joined #rdo08:26
*** wolverineav has quit IRC08:32
*** fzdarsky_ is now known as fzdarsky08:33
*** vaneldik has left #rdo08:35
number80amoralej: I'll build 0.7.1208:35
*** ihrachys has quit IRC08:35
amoralejwait number8008:35
number80?08:36
amoraleji think it has a dependency with selinux-policy from 7.308:36
amoralejwe may break deployments in 7.208:36
amoralejwell, could you do a scratch build for me to test it?08:36
*** jpich has joined #rdo08:37
*** karimb has joined #rdo08:39
*** chandankumar has joined #rdo08:40
kbsinghamoralej: are you tracking centos devel irc? alphacc is working on CR for the cbs services08:40
amoralejoh, i'm not, thanks, i'll keep on eye on it08:41
*** rdas has quit IRC08:44
*** abehl has joined #rdo08:44
*** mcornea has joined #rdo08:44
*** anilvenkata_afk is now known as anilvenkata08:45
*** gkadam has quit IRC08:45
*** egallen has quit IRC08:45
*** Guest84659 has joined #rdo08:46
*** gfidente has joined #rdo08:50
*** dbecker has quit IRC08:54
*** dhill_ has quit IRC08:56
*** Pavo has quit IRC08:58
amoralejnumber80, i'll have to test it but i'd say that required openstack-selinux for 7.3 will not work with 7.208:59
amoralejas it fixes nova to work with new virtlogd types introduced in 7.308:59
amoraleji'm not sure what's the best way to manage that08:59
amoralejin the transition09:00
amoralejas we have builds from 7.2 and 7.3 mixed in different CIs09:01
*** pgadiya has quit IRC09:01
*** sudipto_ has joined #rdo09:03
*** sudswas__ has joined #rdo09:03
alphaccamoralej, number80 : cbs has 7.3 CR repos enabled. Let me know when you have time to send a build.09:03
*** Pavo has joined #rdo09:04
*** ssbarnea has joined #rdo09:05
*** nstrug has joined #rdo09:07
jpenajruzicka, if you have a minute please have a look at https://review.rdoproject.org/r/3880 and check the comments09:10
amoralejnumber80, apevec, jpena, proposal to manage the openstack-selinux case: build a cbs scratch of 0.7.12 and add the generated packages to http://trunk.rdoproject.org/qemu-kvm-ev-7.309:10
amoralejin that way, it will only be used by the jobs in ci.centos running with 7.309:11
amoralejwhen 7.3 is released, we need to do proper build and push it to -testing and -release of mitaka, newton and ocata09:11
amoralejwdyt09:11
jpenaI think it's a good idea. We keep all workarounds together, and only use them for our CI09:13
number80amoralej: I can do a real build and just not tag it09:14
amoralejok, that works09:14
*** bcafarel has quit IRC09:14
amoralejmy concern is that someone push it by mistake09:14
amoralejbut, whatever you think is better09:15
number80amoralej: only apevec and I can tag stuff09:16
number80so little risk09:16
amoralejok09:16
amoralejlet's go for it then09:16
*** _degorenko|afk is now known as degorenko09:16
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: heat, oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html09:16
number80but good remark09:16
*** pgadiya has joined #rdo09:16
chandankumarnumber80: jpena amoralej dmellado \o/09:21
*** jlibosva has joined #rdo09:22
*** pnavarro has joined #rdo09:24
*** gildub has joined #rdo09:25
number80chandankumar: o/09:27
number80amoralej: https://cbs.centos.org/koji/taskinfo?taskID=14120409:27
amoralejthanks number8009:27
number80water is flooding from neighbours upstairs (sorry for the latency)09:27
number80at this rate, I'll live in a swimming pool 8)09:28
*** bcafarel has joined #rdo09:30
*** lucas-afk is now known as lucasagomes09:30
*** limao has quit IRC09:31
amoralejnumber80 :009:32
sudswas__Hi can anyone please help with a few queries on multi path?09:34
*** Son_Goku has joined #rdo09:35
amoralejmultipath with RDO sudswas__?09:35
sudswas__amoralej, yeah09:36
*** Son_Goku has quit IRC09:36
amoralejok09:36
amoralejwhat's the issue?09:36
sudswas__amoralej, basically, the storage is connected to two FC switches, so the multipathing is h/w multi path...the host OS runs the multipathd service. Now when a LUN is created from openstack dashboard, it would created a dm-* device of a fc-lun device?09:37
sudswas__basically at this time, the pci-*fc-*-lun* device is getting created, so it is not using multipathing.09:37
amoralejso, what cinder driver are you using?09:38
sudswas__The IBM SVC storewize FC driver.09:38
*** derekh has joined #rdo09:38
*** wolverineav has joined #rdo09:41
amoralejsudswas__ have you already attached the volume to a instance?09:42
sudswas__amoralej, yeah09:42
amoralejcan you see in what compute node is the instance running?09:42
sudswas__amoralej, if i created the volume, should it appear inside /dev/disk/by-id/ as dm-* if multipathd is ON?09:43
amoraleji think disk devs are always created, multipathd creates new device, but it doesn't prevent from creating the single-path ones09:43
amoralejbut, the important point is to check what device is mapped to the instance09:44
amoralejso if you go the compute node09:44
amoralejand run virsh dumpxml <instance-name>09:44
amoralejyou'll see how the volume is being mapped to the instance09:44
sudswas__amoralej, on the instance the dm- device is not attached09:44
sudswas__dev/disk/by-path/pci-0005:01:00.0-fc-0x500507680230ec42-lun-209:44
sudswas__something like this is attached.09:45
sudswas__basically it's not going to the by-id path09:47
sudswas__and attaching the dm devices, instead it's just attaching from the by-path path09:48
*** ihrachys has joined #rdo09:50
amoralejwhat release of RDO are you using?09:51
sudswas__amoralej, i am using packstack mitaka09:51
amoralejmultipathd is configuring the mpath devices properly?09:52
amoralejthere is something under /dev/mpath/ ?09:52
sudswas__amoralej, the multi-path devices are configured properly09:53
sudswas__amoralej, what would be the logic to attach the LUN from openstack?09:53
sudswas__will it attach a dm-* device or just the lun-* device?09:53
amoralejos-brick module should discover the multipath device and use it if available09:55
sudswas__amoralej, ok so the first pref should go to a mulitpath device followed by the fc- device?09:57
amoralejwait, it may be disabled by default09:58
amoralejin newton there is a parameter volume_use_multipath which is false by default09:59
amoralejin nova.conf09:59
amoralejhttp://docs.openstack.org/newton/config-reference/compute/config-options.html09:59
sudswas__amoralej, that parameter is not present in mitaka seems like...09:59
*** wolverineav has quit IRC10:00
amoralejsudswas__ could you try with iscsi_use_multipath10:02
sudswas__the iscsi_multipath value seems to have been renamed10:02
amoralejit's used for fc also10:02
amoralejin mitaka10:02
sudswas__amoralej, great, i will try this...10:02
amoralejset it to true in nova.conf10:02
*** Poornima has quit IRC10:03
ccamachoyfried the userdata hook works fine, http://paste.openstack.org/show/590433/10:04
ccamachomaybe yesterday I needed some more coffee10:04
*** wolverineav has joined #rdo10:04
*** ohamada has joined #rdo10:05
*** dciabrin has quit IRC10:08
rdogerritMerged openstack/packstack-distgit: Update to 9.0.1  http://review.rdoproject.org/r/390510:09
*** dciabrin has joined #rdo10:09
*** Poornima has joined #rdo10:09
*** dbecker has joined #rdo10:10
*** dciabrin has quit IRC10:12
*** dciabrin has joined #rdo10:15
*** wolverineav has quit IRC10:18
*** jaosorior has quit IRC10:24
*** danpawlik has joined #rdo10:29
*** fragatina has quit IRC10:31
*** fragatina has joined #rdo10:31
*** ealcaniz has quit IRC10:31
*** jhershbe_ has joined #rdo10:31
*** apevec has joined #rdo10:33
*** toanju has joined #rdo10:39
*** jhershbe_ has quit IRC10:47
*** jaosorior has joined #rdo10:47
rdogerritMerged openstack/glance_store-distgit: Bump dependencies for cinder driver  http://review.rdoproject.org/r/378110:53
apevecamoralej, uhm, promote-master does not look good10:54
amoralejlemme check what happened10:54
apevecalso cloudsig newton-testing failed https://ci.centos.org/view/rdo/view/cbs-promote-pipelines/job/rdo-promote-cloudsig-testing-newton/17/10:54
*** toanju has quit IRC10:54
amoralejthat's the selinux issue10:54
*** dtantsur|afk is now known as dtantsur10:55
amoralejpackstack failures are related to openstack-selinux10:55
amoralejhttps://etherpad.openstack.org/p/tripleo-ci-status10:55
amoralejissue 3510:55
amoralejongoing pipeline should work apevec10:55
*** paramite has joined #rdo10:55
amoralejhttps://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/861/10:55
amoralejaffects to newton also, btw10:56
amoralejrelated to migration to 7.310:56
jpenaapevec: going through the pending reviews, I see we have 2 package reviews going on (puppet-qdr and python-novajoin). I can start with  the project creation and stuff if you want10:57
amoralejapeve, look at https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-newton/10:57
apevecjpena, ack - after quick licensecheck10:57
amoralejall green but two oooq, which failed with a "Failed to connect to the host via ssh."10:58
apevecthere is also networking-vsphere?10:58
dmelladochandankumar: o/ around?10:58
amoralejwhick is unrelated, i think10:58
*** Pavo has quit IRC10:58
apevecamoralej, ssh to cico node?10:58
amoralejlet's see how master promotion goes this run10:58
amoralejnot, i think it's from the virthost to the undercloud10:59
amoraleji'd lay, let me recheck10:59
*** milan has joined #rdo10:59
apevecok11:00
jpenaapevec: yes, found networking-vsphere. Time to create projects11:01
*** ssbarnea has quit IRC11:01
*** ssbarnea has joined #rdo11:01
apevecnumber80, amoralej - re. openstack-selinux , we need to move it to rdoinfo and normal rdo workflow, current distgit is out of date :( https://github.com/redhat-openstack/openstack-selinux/blob/el7-rpm/openstack-selinux.spec11:01
apevecI'll ping Ryan&Lon next week about it11:02
amoralejbtw, we have a good cbs build of kvm11:02
amoralejin -testing11:02
amoralejwe need to enable virtsig testing repo for jobs in rdo-ci11:02
apeveccool11:03
amoralejapevec, so the connectivity issue is from slave to undercloud, so yes11:03
*** Pavo has joined #rdo11:03
amoralejand both jobs failed at the same time11:03
amoralejnetworking error in ci.centos?11:03
apevecamoralej, then it was ci.centos infra11:03
amoralejyeap11:03
amoraleji'm compiling all issues related to migration to 7.311:04
*** wolverineav has joined #rdo11:04
amoralejas other CIs and users may get the same ones at GA11:04
apevecok, so let's finish current rechecks then we look at switching to virtsig-testing and re-run11:04
amoralejyeap11:04
apevecso we have more solid setup then temp repo for testday11:04
apevecI'll recheck cloudsig newton-testing11:05
*** WillUK2010 has joined #rdo11:05
*** sdake has joined #rdo11:05
*** k4n0 has joined #rdo11:07
number80apevec: I'll push what I have11:08
*** sdake_ has joined #rdo11:08
*** wolverineav has quit IRC11:08
apevecnumber80, what do you have?11:09
*** sdake has quit IRC11:11
apevecamoralej, before I re-run cloudsig newton-testing, result last night was all 3 puppet weirdo passed vs all 3 packstack weirdo failed https://ci.centos.org/job/weirdo-testing-newton/27/console11:11
amoralejapevec, yes, that's the selinux issue11:11
apevecis puppet running permissive?11:12
amoralejyes11:12
apevecaha11:12
apevecnumber80, ah you mean openstack-selinx? Yeah please send PR11:13
apeveclooks like we'll have more contributors coming11:14
apevecok you merged it, also good11:15
amoralejapevec, but having openstack-selinux as dlrn build wouldn't help us in this case11:15
amoralejincompatible openstack-selinux from 7.3 with 7.211:15
apevecamoralej, yeah, I mean move it to review.rdo11:16
apevecbut keep it as dep11:16
amoralejyeah, that's good anyway11:16
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: heat, oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html11:16
apevecI'll propose separate workflow for all deps, so we can gate them properly11:17
apeveccurrent common-pending  repo is just a quickfix11:17
amoralejand, sorry if you have discussed this before11:17
amoralejbut wouldn't it be better to manage deps per-release by default instead of common?11:17
apevecwe had this on and off, I need to consolidate into summary11:18
apevecamoralej, depends :)11:18
amoralejyeah, that's a good response :)11:18
amoralejoh, my consulting times... i loved to say "depends"11:18
apevechehe I was in consulting too11:19
*** Poornima has quit IRC11:19
apevecsome deps will need to stay per release but most should be in common but with proper gating on all releases11:20
amoralejeven going beyond u-c for stable releases?11:21
apeveceven that if we gate them11:22
*** misty-cloud has quit IRC11:22
apevecb/c upstream stable u-c is just conservatively frozen in time11:22
apevecit is not final truth11:22
amoralejthat means, we'd need to have very good coverage in RDO-CI11:23
apevecand there are also non-python deps outside u-c11:23
apevecyes!11:23
jpenabut then we'd need to have CI jobs running for every CBS build in -pending, right?11:23
apevecor rather: improve upstream CI coverage and reuse it in RDO CI11:23
amoralejand there are many projects, plugins that we hardly can test11:23
apevecjpena, that's details to figure out :)11:23
kbsinghapevec: we should likely talk about the 2way CI bit for CentOS users ( ie. revisit it, i dont think it ever got finished )11:24
apeveckbsingh, yeah, it didn't11:24
kbsinghthat would be one easy way to isolate the userbase from churn at release time, and to give you guys a lot more flexibility on what you use ( ie, non openstack content )11:24
kbsinghwhen i say 'easy', i mean 'easy for the user' :D)11:24
amoralejbtw, i'm writing some notes related to move to 7.3 in https://review.rdoproject.org/etherpad/p/release-centos-7.311:26
rdogerritMerged openstack/aodh-distgit: Fix the aodh api service exec to use separator  http://review.rdoproject.org/r/385711:26
amoralejapevec, jpena, number80, dmsimard, ^ if you can take a look11:26
rdogerritJavier Peña created config: Add novajoin to zuul configuration  http://review.rdoproject.org/r/390611:26
apevecamoralej, good stuff, thanks for noting that down!11:27
kbsinghamoralej: +111:28
*** nmagnezi has joined #rdo11:29
*** jprovazn has quit IRC11:30
sudswas__amoralej, just to affirm that if i set the iscsi_multipath_* flag to true, it would start picking up the multi path devices from the host and there's no need to configure anything on the guests right?11:37
sudswas__the multi path device should internally take care of multipathing across the sda/sdbs?11:37
amoralejyeap11:37
rdogerritJavier Peña proposed config: Add novajoin to zuul configuration  http://review.rdoproject.org/r/390611:37
amoralejdid you test it?11:37
jpenaapevec amoralej: https://review.rdoproject.org/r/3906 plz, so I can move ahead with the next project and avoid ninja-merges :)11:39
apevecack11:39
rdogerritMerged config: Add novajoin to zuul configuration  http://review.rdoproject.org/r/390611:40
sudswas__amoralej, thanks a lot!11:41
*** rdogerrit has quit IRC11:41
*** rdogerrit has joined #rdo11:41
rdogerritAlan Pevec proposed rdoinfo: Adding python-novajoin package  http://review.rdoproject.org/r/364111:41
*** wolverineav has joined #rdo11:42
amoralejglad to help sudswas__11:42
*** sudswas__ has quit IRC11:44
*** sudipto_ has quit IRC11:44
amoralejnumber80, confirmed, new openstack-selinux doesn't work with openstack-policy* from 7.2, maybe we should bump requires version to >= 3.13.1-102 ?11:45
amoralejwhich will be the release in 7.311:45
*** pkovar has joined #rdo11:46
*** wolverineav has quit IRC11:48
*** tosky has joined #rdo11:48
EmilienMhello here11:55
*** panda|zZ is now known as panda11:57
apevecamoralej, number80 - let's keep that in sync w/ Lon11:57
apevecbut otherwise yes, deps should be explicit11:58
*** jhershbe_ has joined #rdo12:03
*** fzdarsky is now known as fzdarsky|lunch12:03
rdogerritJavier Peña created config: Add networking-vsphere to zuul configuration  http://review.rdoproject.org/r/390712:03
number80ack12:04
*** misty-cloud has joined #rdo12:05
apevecjpena, ^ config ready to merge?12:05
jpenaapevec: yep12:06
*** yolanda has quit IRC12:06
rdogerritMerged config: Add networking-vsphere to zuul configuration  http://review.rdoproject.org/r/390712:06
*** lucasagomes is now known as lucas-hungry12:06
*** rdogerrit has quit IRC12:07
*** snarwade has quit IRC12:07
*** rdogerrit has joined #rdo12:07
*** alexismonville has quit IRC12:09
*** misty-cloud- has joined #rdo12:12
*** misty-cloud has quit IRC12:15
*** mosulica has joined #rdo12:19
*** alexismonville has joined #rdo12:20
*** wolverineav has joined #rdo12:22
*** yolanda has joined #rdo12:22
*** jhershbe_ has quit IRC12:22
*** wolverineav has quit IRC12:28
*** pgadiya has quit IRC12:29
*** karimb has quit IRC12:30
*** panda is now known as panda|afk12:31
*** wolverineav has joined #rdo12:35
*** gildub has quit IRC12:35
*** nmagnezi has quit IRC12:36
*** ealcaniz has joined #rdo12:38
*** iberezovskiy|off is now known as iberezovskiy12:38
*** jprovazn has joined #rdo12:40
*** wolverineav has quit IRC12:42
*** panda|afk is now known as panda12:51
*** ssbarnea has quit IRC12:53
*** ssbarnea has joined #rdo12:53
*** jamesllondonlapt has joined #rdo12:54
jamesllondonlaptHas anyone lost their SSH server after installing python-openstackclient12:55
rdogerritJavier Peña created config: Add puppet-qdr to zuul configuration  http://review.rdoproject.org/r/390812:57
jamesllondonlaptis there anyway to install rdo -component by componet and avoid using the packstack script?12:58
*** Pavo has quit IRC12:58
*** steveg_afk has joined #rdo12:59
*** ccamacho is now known as ccamacho|lunch13:01
jpenajamesllondonlapt, you have http://docs.openstack.org/newton/install-guide-rdo/ for a step-by-step install13:02
*** Pavo has joined #rdo13:04
*** wolverineav has joined #rdo13:04
*** pkovar has quit IRC13:05
*** dpeacock has joined #rdo13:05
amoralejapevec, https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/861 the only failed job timed out when uploading logs after running fine13:07
jamesllondonlaptjpena: just reading it - it's perfect.13:08
amoralejp-o-i scenario002 is too heavy for rdo-ci...13:09
*** limao has joined #rdo13:10
jpenaapevec amoralej: so should we promote manually, or increase the timeout for those jobs by 15 min?13:10
amoralejyeah, i'm going to propose it, let's see opinions on that13:11
amoralejlet's see what happens in https://ci.centos.org/view/rdo/view/weirdo-pipelines/view/weirdo-promote-puppet/, it's running 002 also13:11
*** pkovar has joined #rdo13:13
*** wolverineav has quit IRC13:13
jpenalast time it passed, the run took 1h28mins13:14
jpenano, 1h18mins13:14
jpenanah, forget it, I can't substract times today13:15
*** lucas-hungry is now known as lucasagomes13:16
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html13:16
dr_gogeta86hi guys13:16
*** amoralej is now known as amoralej|lunch13:17
*** zoliXXL is now known as zoli|lunch13:19
*** pnavarro has quit IRC13:20
apevecjpena, I'd say drop puppet002 from promotion and reorganize it upstream13:21
apevecEmilienM, ^ wdyt13:21
* apevec checks what's covered in 00213:21
*** limao has quit IRC13:22
EmilienMapevec: why that?13:22
EmilienMI havent followed13:22
apevectoo big for ci.centos13:22
*** jaosorior has quit IRC13:22
apevecit's timing out13:22
EmilienMnumber80, amoralej|lunch: could we update puppet4?13:22
EmilienMapevec: :(13:22
*** limao has joined #rdo13:22
EmilienMapevec: flavors are smaller than osinfra?13:23
apevecEmilienM, we ain't got promotion yet13:23
apevecthey are not13:23
*** ccamacho|lunch is now known as ccamacho13:23
jpenaEmilienM, actually they're "big" machines in theory, but with very slow CPU13:23
EmilienMjpena, apevec: go ahead then13:23
apevecjpena, btw ci.centos cloud is not used yet?13:24
*** alexismonville has quit IRC13:24
jpenaapevec: no. I remember dmsimard mentioned he had some issues, and it would take some time13:24
*** flaper87 has quit IRC13:25
*** sdake has joined #rdo13:25
apevecremoving puppet002 lost are: swift ec2api ironic (but is it tested much in tempest?) zaqar (ditto?) barbican(ditto?), mongodb(what is it used for?)13:26
apevecThose are not present in other scenarios13:26
apevecjpena, ^ do we have them in packstack scenarios?13:27
jpenaapevec: swift and mongodb are, the rest are missing13:27
EmilienMapevec: yes13:27
EmilienMapevec: EVEYTHING is tempest tested13:28
EmilienMapevec: mongodb is used by zaqar13:28
EmilienMit's the package we have in production.13:28
*** flepied1 has quit IRC13:28
EmilienMso yeah, scenario002 is really important and worth it13:28
apevecEmilienM, yeah, my question what is actually tested in ironic tempest plugin13:28
EmilienMapevec: it's testing ironic API13:28
EmilienMmaking sure conductor and api are well configured to work13:28
apevecironic and zaqar are covered by tripleo jobs13:29
EmilienMright13:29
apevecso only real lost in rdo ci would be ec2api unless tripleo is configuring it?13:29
*** sdake_ has quit IRC13:29
EmilienMnot yet13:29
apevecjpena, do we have ec2api support in packstack at all?13:31
apevecI guess not13:31
jpenaapevec: nope13:31
*** eaguilar has joined #rdo13:31
apevecok, I would still temp drop weirdo puppet002 for Ocata113:31
apevecand work to get less heavy scenario in poi for ocata213:32
jpenawe can still promote this repo manually, all tests passed13:32
apevecjpena, it failed only uploading logs?13:32
jpenaapevec: yes13:32
apevecthen let's promote13:32
number80:(13:32
*** limao has quit IRC13:32
apeveclet's collect votes:13:32
apevec+113:32
number80+113:33
*** flaper87 has joined #rdo13:33
jpena+113:33
amoralej|lunch+113:33
amoralej|lunch:)13:33
*** limao has joined #rdo13:33
apevecEmilienM, ?13:33
apevec(you get puppet4 if you +1 :)13:33
amoralej|lunchyou can see in the logs that job had finished successfully13:33
EmilienM+213:34
apevecsold!13:34
apevecjpena, fire away13:34
*** misty-cloud- has quit IRC13:34
* jpena digs in his notes how to run promotions manually13:34
EmilienMapevec: we have scenario004 now in upstream13:35
EmilienMbut not in weirdo yet13:35
apevecyeah, dmsimard is working on it13:35
EmilienMawesome13:35
apevecit' Ocata only?13:35
EmilienMyes13:35
EmilienMso you want us to move some services from scenario002 to 004 for ex?13:36
apevecyeah, let's try some reshuffling13:36
*** limao has quit IRC13:38
jpenaapevec: do you remember if we had a way to run a parameterized build of https://ci.centos.org/job/rdo-promote-repo-promote-master/ ? I can't find it13:38
rdogerritMerged config: Add puppet-qdr to zuul configuration  http://review.rdoproject.org/r/390813:38
*** rdogerrit has quit IRC13:39
*** rdogerrit has joined #rdo13:39
*** rcernin has quit IRC13:39
*** jpena is now known as jpena|lunch13:40
apevechmm, no job parameters13:40
*** limao has joined #rdo13:40
*** rgogunskiy has quit IRC13:41
apevececho $delorean_current_hash13:41
apevecwhere is it taking that from??13:42
apevecjpena|lunch, just run promote.sh manully?13:43
*** pnavarro has joined #rdo13:44
apevecjpena|lunch, but upload step https://ci.centos.org/job/rdo-promote-upload-master/ also did not run13:45
*** limao has quit IRC13:45
*** athomas has quit IRC13:45
*** flepied has joined #rdo13:46
apevecjpena|lunch, to reuse those 2 jobs we need to create a manual-promotion pipeline with hash as build parameter, then store it in /tmp/ as normal pipeline13:47
apeveccf https://ci.centos.org/job/rdo-promote-get-hash-master/configure13:48
*** rcernin has joined #rdo13:49
*** sshnaidm|away has quit IRC13:49
*** athomas has joined #rdo13:51
dmsimardapevec, jpena|lunch: I had a meeting with KB & co this week in regards to cico cloud. There needs to be some development work on their end (as well as in cicoclient) in order to expose the VMs through Duffy, their API. It might be a while still. I would say two weeks at best ?13:52
dmsimardapevec: less heavy scenario in poi ?13:52
dmsimardyou mean the scenario that passes all the times on virtual machines but fails on bare metal ? :)13:53
*** wolverineav has joined #rdo13:53
*** fzdarsky|lunch is now known as fzdarsky13:54
apevecyes13:54
apevec002 seems too packed even w/o our results13:55
dmsimardby the time ocata-2 rolls around, cico cloud will already be available and weirdo jobs will have moved to it13:55
dmsimardso -1 on even remotely touching it13:55
dmsimardproblem is not the job, it's the hardware13:55
dmsimardoh, you want to rebalance the scenarios, sorry was missing context13:56
*** satya4ever has quit IRC13:56
apevecyeah, for now we are not dropping it, but trying to reshuffle13:56
apevecwe'll promote manually last master-promote13:56
*** mosulica has quit IRC13:57
dmsimarddelorean_current_hash comes from the centos-* files13:57
apevecsee jpena's question above how to do it13:57
apevectjat13:57
apevecthat's on /tmp ?13:57
dmsimardyeah13:57
dmsimardhttps://github.com/rdo-infra/ci-config/blob/master/jenkins/jobs/scripts/centos-master.sh and then13:57
dmsimardhttps://github.com/rdo-infra/ci-config/blob/master/jenkins/jobs/scripts/promote-get-hash.sh13:57
apevecso  we need to recreate it in a fake promotion pipeline13:57
apevechow is that $HASH_FILE parsed?13:58
*** wolverineav has quit IRC13:58
apevecI don't see explicit "source" command13:58
*** hogepodge has quit IRC13:59
dmsimardI don't use that in weirdo, must be oooq. https://github.com/rdo-infra/ci-config/blob/master/jenkins/jobs/weirdo-templates.yml#L19-L2013:59
*** wolverineav has joined #rdo13:59
dmsimardhm, I don't really see it used in ci-config, maybe in oooq proper13:59
*** leanderthal|afk is now known as leanderthal13:59
*** aortega has joined #rdo14:00
dmsimardwell, that actual variable doesn't to be used anywhere, it's just a ini-like file that's passed to jenkins as a property file, ex https://github.com/rdo-infra/ci-config/blob/master/jenkins/jobs/promote-cloudsig-testing-mitaka.yml#L2114:01
*** limao has joined #rdo14:03
*** wolverineav has quit IRC14:03
*** aortega_ has joined #rdo14:04
*** aortega has quit IRC14:04
*** egallen has joined #rdo14:04
*** wolverineav has joined #rdo14:05
*** flepied has quit IRC14:05
*** flepied1 has joined #rdo14:07
*** Masber has joined #rdo14:08
EmilienMnumber80: do you think we can update puppet4 today or will it wait next week?14:08
Masberhi14:10
Masbermy host dies every time I create or start an instance14:10
Masberthe system just crash14:11
Masberthe bios has corrupted the hw-PMU resources14:11
*** wolverineav has quit IRC14:12
dmsimardEmilienM: on a friday? :p14:12
Masberthe says "no device found" and "unable to init the device /dev/mcelog"14:12
Masberis any one here familiar with these errors?14:13
dmsimardnot me, sorry14:14
number80dmsimard: do we have a promotion?14:15
number80that's really the point14:15
number80puppet4 works for upstream14:15
*** karimb has joined #rdo14:16
number80I may even take the risk to get a phone call to fix things during the w-e but unlikely to happen14:17
dmsimardWe have not gotten a promotion in RDO proper, no14:17
dmsimardBut it's due to back luck with AMD nodes14:17
*** fzdarsky has quit IRC14:17
dmsimardI'll run a generic scenario002 job on the same hash the last one ran in https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/14:17
dmsimardand if it passes I'll promote manually14:18
dmsimardsince we can't retry the job14:18
number80dmsimard: ping me if it happens14:18
number80btw, https://bugzilla.redhat.com/show_bug.cgi?id=1391444 is still pending14:18
openstackbugzilla.redhat.com bug 1391444 in Package Review "Review Request: boost159 - The free peer-reviewed portable C++ source libraries" [Medium,New] - Assigned to apevec14:18
* number80 is blocked on multiple bottlenecks14:18
*** wolverineav has joined #rdo14:19
dmsimardall jenkins threads are busy ...14:19
dmsimardok, https://ci.centos.org/view/rdo/view/weirdo/job/weirdo-generic-puppet-openstack-scenario002/460/ is the job to watch14:20
*** jkilpatr has joined #rdo14:21
EmilienMdmsimard: yeah, I know...14:22
EmilienMbut we tested it14:22
EmilienMI'm afraid to wait more14:22
dmsimardEmilienM: It's the same hash, waiting more will not have an impact14:23
*** fzdarsky has joined #rdo14:23
*** hogepodge has joined #rdo14:23
dmsimardi.e, this is testing the same hash that everything else passed here: https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/861/14:23
*** wolverineav has quit IRC14:23
*** gszasz has quit IRC14:26
*** amoralej|lunch is now known as amoralej14:26
*** hogepodge has quit IRC14:28
*** saneax is now known as saneax-_-|AFK14:29
*** links has quit IRC14:31
*** pkovar has quit IRC14:32
*** flepied1 has quit IRC14:33
*** flepied has joined #rdo14:35
*** dtantsur is now known as dtantsur|afk14:36
*** jpena|lunch is now known as jpena14:38
jpenadmsimard: so running manually, then promoting?14:40
jpena(catching up after lunch)14:41
*** anilvenkata has quit IRC14:42
*** Goneri has joined #rdo14:43
jpenadmsimard: about apevec's idea of creating a manual promote job for these cases, wdyt?14:45
*** sdake has quit IRC14:46
*** sshnaidm has joined #rdo14:47
*** sdake has joined #rdo14:47
*** pnavarro has quit IRC14:51
*** pkovar has joined #rdo14:52
dmsimardjpena: the odds of that manual promote job running into the same issues (i.e, a particular job failing due to bad hardware) are as high as the non-manual one14:53
*** flepied has quit IRC14:53
*** flepied1 has joined #rdo14:53
jpenadmsimard, I mean a job just for the last two steps (upload images and promote symlinks), for cases like this14:53
*** flepied1 has quit IRC14:53
*** flepied has joined #rdo14:54
dmsimardjpena: ah, yeah, I see what you mean14:54
chandankumarjpena: number80 apevec dmsimard amoralej dmellado Bye, See you on monday :-)14:55
dmelladohey chandankumar14:55
dmelladojust saw your message, have a great weekend! ;)14:55
*** abehl has quit IRC14:55
dmelladoo/14:55
amoralejhave a nice weekend chandankumar14:55
*** chandankumar is now known as chandankumar|off14:55
jpenahave a good weekend chandankumar|off14:55
jruzickao/14:55
dmsimardjpena: I think it's sort of a non-issue, pending the fact that individual jobs can be re-tried14:55
dmsimardthe newer model of weirdo generic jobs can be re-tried directly from the pipeline14:56
dmsimardthis is not the case with the current model of promote jobs which rely to be pinned on a single slave with a file in /tmp/14:56
dmelladodmsimard: YOU14:56
dmelladoare you done with your canadian day?14:56
dmsimarddmellado: yeah, my talk is online but I haven't blogged or advertised it yet :p14:57
dmelladooh, I'll look for it xD14:57
dmelladohope it went well and nobody threw things to you xD14:57
dmsimardgot great reception but my live demo failed, good thing I had a backup plan already prepared14:58
*** Pavo has quit IRC14:58
dmsimardI know why it failed too but I didn't want to go and fix it during the presentation lol14:58
*** flepied1 has joined #rdo14:58
*** flepied has quit IRC14:58
*** Pavo has joined #rdo14:59
*** v1k0d3n has quit IRC14:59
*** zoli|lunch is now known as zoli|wfh15:00
*** hogepodge has joined #rdo15:00
*** limao has quit IRC15:00
*** limao has joined #rdo15:01
*** beagles is now known as beagles_afk15:04
*** wolverineav has joined #rdo15:04
*** limao has quit IRC15:05
*** hogepodge has quit IRC15:05
rdogerritVladislav Odintsov proposed rdoinfo: Adding python-networking-vsphere package  http://review.rdoproject.org/r/342115:08
*** wolverin_ has joined #rdo15:10
rdogerritDavid Moreau Simard created config: Add weirdo puppet-openstack scenario004 to weirdo gate jobs  http://review.rdoproject.org/r/390915:12
rdogerritMerged rdoinfo: Adding python-networking-vsphere package  http://review.rdoproject.org/r/342115:12
*** Jeffrey4l has joined #rdo15:14
*** wolverineav has quit IRC15:14
*** sdake has quit IRC15:15
rdogerritJavier Peña proposed openstack/glance_store-distgit: Fix python3 subpackage  http://review.rdoproject.org/r/381515:16
rdogerritJavier Peña proposed config: Use rdopkg findpkg to map project names in rdoinfo-DLRN  http://review.rdoproject.org/r/387915:16
rdogerritMerged config: Add weirdo puppet-openstack scenario004 to weirdo gate jobs  http://review.rdoproject.org/r/390915:16
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html15:16
rdogerritJavier Peña proposed config: Create experimental DLRN job for TripleO CI  http://review.rdoproject.org/r/390115:16
rdogerritJavier Peña proposed config: Use rdopkg findpkg to map project names in rdoinfo-DLRN  http://review.rdoproject.org/r/387915:17
*** rcernin has quit IRC15:17
*** flepied has joined #rdo15:17
*** sdake has joined #rdo15:17
*** openstackgerrit has quit IRC15:18
*** flepied1 has quit IRC15:19
*** openstackgerrit has joined #rdo15:19
*** ChanServ sets mode: +v openstackgerrit15:19
rdogerritMerged config: Create experimental DLRN job for TripleO CI  http://review.rdoproject.org/r/390115:19
apevecdmsimard, so word was that https://ci.centos.org/job/weirdo-master-promote-puppet-openstack-scenario002/702 actually passed, it only timed out in logs collection15:20
apevecso no need to re-run it15:20
dmsimardoh, you're right - I saw it time out and didn't bother to check why, assuming it was killed prematurely15:21
*** ihrachys has quit IRC15:21
dmsimardthe generic job is running on an AMD node now too..15:21
*** jcoufal has joined #rdo15:22
apevecas luck would have it :)15:22
dmsimardthis is so frustrating15:22
dmsimardyou can't run CI on non homegenous hardware15:22
dmsimarder, s/non homegenous/hererogenous/15:22
dmsimardwow I can't type today15:22
apevecit's real life though15:22
*** rcernin has joined #rdo15:22
apevecand it's Friday :)15:22
dmsimardRDO cloud will save us all with it's light and glory15:23
jpenaapevec: I just realized we're still not pinning puppet modules on master. Do we want to do it? I have a small change to do in CI for that15:23
dmsimardThe mythical and legendary cloud15:23
apevecso how do we cleanly promote dd/2e/dd2e69a7945467ac8dcc6950dfe5bab79b8ac1b3_accb21d7 manually?15:23
apevecjpena, we need to keep them advancing on master15:24
dmsimardapevec: I'll run promote.sh on private and public dlrn, and then run the same thing as the image promote job15:24
* dmsimard doing it right now15:24
apevecEmilienM has that script to bump them then gate15:24
amoralejyuhuuu15:24
jpenaapevec: ack15:24
apevecbut poi is pinning on older versions...15:24
apevecdmsimard, what about upload step?15:25
amoralejapevec et all, i've drafted a mail we may send to rdo-list with the issues we've found to transition to 7.3 in https://review.rdoproject.org/etherpad/p/release-centos-7.315:25
amoralejdo you think will be useful to send it?15:25
apevecjpena, ideally we'd pin the same as poi but some of those are just too old b/c some upstreams didn't have a release in months15:26
*** imcleod has joined #rdo15:26
dmsimardapevec: it's not really an upload step15:26
apevecamoralej, reading15:26
dmsimardapevec: it "copies" the testing image to the stable image15:26
dmsimardapevec: but anyway I'm taking care of that too.15:27
apevecyeah, that still needs to be done15:27
apevecbut... isn't it just symlink now?15:27
dmsimardI'll do the same thing the job does15:27
apevecfor images15:27
apevecack15:27
apevecamoralej, https://ci.centos.org/view/rdo/view/cbs-promote-pipelines/job/rdo-promote-cloudsig-testing-newton/18/ also GREEN !15:27
dmsimardgot lucky, one of those jobs ended at 1h26min15:28
jpenaamoralej: the email looks good15:28
amoralejhttps://media.giphy.com/media/aurUBBayxC55m/giphy.gif15:28
rdogerritJavier Peña proposed config: Use rdopkg findpkg to map project names in rdoinfo-DLRN  http://review.rdoproject.org/r/387915:28
dmsimardjpena: I pinged jruzicka about it yesterday15:28
dmsimard^15:29
dmsimardjpena: http://eavesdrop.openstack.org/irclogs/%23rdo/%23rdo.2016-11-24.log.html#t2016-11-24T23:36:0415:29
amoraleji think we can move to -testing repo from cloudsig now15:29
amoralejlet me check if packages are there15:29
dmsimardIMO I'd just do a simple integration test where I'd clone rdoinfo, then do some findpkg commands on some strings and assert that I get back what's expected15:29
rdogerritVladislav Odintsov created openstack/networking-vsphere-distgit: initial commit  http://review.rdoproject.org/r/391015:30
jpenadmsimard: yeah, that's doable. Worst case we can have a part of the current rdoinfo for the unit test15:30
*** rcernin has quit IRC15:30
dmsimardjpena: you understand why I'm otherwise uneasy with this ? I'm not being mean by blocking it for no reason right ? :)15:30
jpenaI don't see it so horrible15:31
*** jprovazn has quit IRC15:31
jpenadmsimard: well, I tested all those combinations before +1'ing it, and the script we're using today doesn't have any unit tests15:31
jpenaanyway, since the current scripts are working, we can wait for the unit tests to come, so we can be safer15:34
dmsimardyeah.. I would hate to see a spec change merge with the dlrn-rpmbuild passing while it actually built another package15:35
dmsimardthe findpkg implementation had no tests at all attached to it iirc15:36
dmsimardif we're going to rely on it, it would be great to have some level of confidence that it does a good job at returning the right things but also won't break due to a regression15:37
apevecamoralej, these are updates I've tagged yesterday in newton-testing and which passed cloudsig promotion today: http://paste.openstack.org/show/590479/15:37
apevecamoralej, have a quick look before I tag them newton-release15:37
amoralejlooks good15:40
*** sdake has quit IRC15:41
*** sdake has joined #rdo15:43
*** wolverin_ has quit IRC15:49
*** eaguilar has quit IRC15:49
*** wolverineav has joined #rdo15:49
dmsimardapevec: promotion is done on private and public DLRN and image+artifacts are uploaded to both images.rdo and artifacts.ci.centos15:52
*** ajo has quit IRC15:52
dmsimardnow we just need to wait for buildlogs cdn to pick it up15:52
amoralejapevec, dmsimard, i have a new qemu-kvm-ev-7.3.repo file ready to enable cbs build of qemu-kvm-ev from -testing15:55
*** wolverin_ has joined #rdo15:55
*** dhill_ has joined #rdo15:55
dmsimardamoralej: I don't understand that sentence15:55
amoraleji'm going to replace yesterday's one, so that we don't have to touch anything from jobs to move to cloudsig build15:55
apevecdmsimard, thanks!15:55
apevecamoralej, you replaced builds in temp repo?15:56
apevecor you pointed in .repo to virtsig-testing ?15:56
*** eaguilar has joined #rdo15:56
amoralejsee the content of https://trunk.rdoproject.org/.qemu-kvm-ev-7.3-new/qemu-kvm-ev-7.3.repo15:56
amoralejsecond apevec15:56
apevecack15:56
*** ashw has quit IRC15:56
amoralejand i've run a createrepo -x "*qemu*" in the temp one15:57
apevecbut why do you have qemu-kvm-ev-7.3 then?15:57
amoralejfor the selinux package15:57
amoralejopenstack-selinux15:57
apevecah15:57
amoralejwe still need to get the updated build from here15:57
*** wolverineav has quit IRC15:57
apevecdrop $releasever - that will not work on RHEL15:57
apevecjust put 715:58
apevecon RHEL it's 7Server or something like that15:58
apevecok, so we need to update testday instructions: if using centos CR repo, you need to get this .repo15:59
dmsimardamoralej: did we chat with the virt sig on an ETA ? when is test day ?15:59
amoralejwhen is 7.3 GA?15:59
dmsimardKB mentioned sometime next week I believe16:00
*** ajo has joined #rdo16:00
apevecit's ~7 days16:00
apevecdmsimard, yeah, but unlikely before testday16:00
apevecso we need to have both 7.2 and 7.3 CR covered16:00
amoralejdmsimard, we already have a official built from virtsig for testint, that's the change i'm doing16:00
dmsimardamoralej: ok ack16:00
*** ashw has joined #rdo16:01
*** nstrug has quit IRC16:02
*** dbecker has quit IRC16:03
amoralejok, done16:05
*** vaneldik has joined #rdo16:05
*** leanderthal is now known as leanderthal|afk16:06
amoralejdmsimard, can we enable rdo-delorean-promote-master ?16:06
dmsimardyes16:06
dmsimardI'll do it now16:06
dmsimardthere16:07
*** mcornea has quit IRC16:07
rdogerritDavid Moreau Simard created rdo-infra/weirdo: Manage that p-o-i scenario004 is a special snowflake  http://review.rdoproject.org/r/391216:08
*** derekh has quit IRC16:10
dmsimardamoralej, apevec, jpena: so as much as I'd very, very very much hate doing this16:10
dmsimardI guess we have no choice but to bump the weirdo job timeout beyond 1h30 due to AMD hardware considerations16:11
amoralej+116:11
apevecyeah, it won't matter when it's faster16:11
dmsimardI will revert that back to 90 minutes or whatever other duration I feel comfortable with once we migrate weirdo jobs to cico cloud16:11
jpenadmsimard: just do it and don't think about it16:11
dmsimardjpena: we're talking about jobs that take 30 minutes in openstack-infra gate !16:12
apevecbut bumping timeouts might just expose some other bottleneck :)16:12
apevecdmsimard, did we try to get any more detailed profiling?16:12
apevecwe could  help some help from perf team16:13
apevecabout what/how to log perf data16:13
dmsimardapevec: no -- I mean, I thought I had a good thing with the tuned profile and the nested kvm virt16:13
*** limao has joined #rdo16:13
*** ealcaniz has quit IRC16:13
*** limao has quit IRC16:13
dmsimardbut even with those two enabled, it still runs slow as hell -- and I don't remember this being so much of an issue <= newton16:13
jpenaamoralej mentioned that it really looks like a CPU bottleneck16:14
jpenasusprising but...16:14
*** limao has joined #rdo16:14
amoraleji've been monitoring one job execution and i'd say it's mainly cpu-bound16:14
dmsimardnewton: https://ci.centos.org/view/rdo/view/weirdo/job/weirdo-newton-promote-puppet-openstack-scenario002/buildTimeTrend16:14
apevecamoralej, ^ do you have data in logs to support that?16:14
dmsimardmaster: https://ci.centos.org/view/rdo/view/weirdo/job/weirdo-master-promote-puppet-openstack-scenario002/buildTimeTrend16:14
dmsimardmitaka: https://ci.centos.org/view/rdo/view/weirdo/job/weirdo-mitaka-promote-puppet-openstack-scenario002/buildTimeTrend16:14
apevecdmsimard, is that same # of tempest tests?16:14
apeveccan you get time break-down16:15
amoraleji think ec2 is only in master, right?16:15
dmsimardI think that may have landed in time for newton, not sure16:15
dmsimardapevec: don't really have detailed/parsed stats16:15
jpenammm... my home lab uses low-end AMD cpus, let me give it a try16:16
dmsimardbut I mean, open all three tabs all next to each other and switch through them16:16
dmsimardit jumps at you how bad the timeout situation is in ocata16:16
amoralejscenario002 in newton is 120 tests16:16
amoralejin master 33116:17
apevecso it is also increased coverage16:17
dmsimardwow, what ?16:17
*** sdake has quit IRC16:17
dmsimardso in master in 002 there is: +backup, +ec2api.. that's it ? those are 111 tests ?16:18
*** limao has quit IRC16:18
dmsimardif so that's nuts and needs to be fixed16:19
amoralejyeah, dmsimard compare tempest result here https://ci.centos.org/view/rdo/view/weirdo/job/weirdo-master-promote-puppet-openstack-scenario002/702/consoleText16:20
amoralejand https://ci.centos.org/view/rdo/view/weirdo/job/weirdo-newton-promote-puppet-openstack-scenario002/162/consoleText16:20
amoralej1st is master, and 2nd is newton16:21
amoralejec2 is not in newton, that's the big difference, i think16:21
*** nstrug has joined #rdo16:22
*** sdake has joined #rdo16:22
*** ohamada has quit IRC16:22
jpenaI can see 161 lines with ec2api in the tempest test log16:22
*** ohamada has joined #rdo16:22
dmsimardmaster: http://paste.openstack.org/show/590490/16:22
dmsimardnewton: http://paste.openstack.org/show/590491/16:23
dmsimardmitaka: http://paste.openstack.org/show/590493/16:23
dmsimardthere is way too many ec2api tests16:23
jruzickadmsimard, did you get my yesterday's reply as well?16:23
dmsimardI'm going to submit a fix for ec2api16:24
jruzickadmsimard, I'm all open to suggestions howto test rdoinfo related functions of rdopkg16:25
*** dyasny has quit IRC16:26
jruzickaa smoketest to map findpkg mappings would be nice. Even a fuzzy testing from rdoinfo might be possible16:26
jruzicka*to test16:26
dmsimardjruzicka: did you see my discussion with jpena earlier ?16:26
jruzickadmsimard, regarding what? the timeout? :-p16:28
*** steveg_afk has quit IRC16:28
amoralejother point is duplicated tests in different scenarios dmsimard, we are doing lbaas tests in several scenarios16:28
amoralejsome could be reduced16:29
dmsimardamoralej: yeah I'll try and find a regex that gives optimal coverage16:29
*** aufi has quit IRC16:31
*** karimb has quit IRC16:33
*** ccamacho is now known as ccamacho|afk16:33
*** karimb has joined #rdo16:33
*** vaneldik has quit IRC16:34
jruzickadmsimard, online smoke tests will be required in rdopkg I guess. I agree that every piece of rdopkg that's used somewhere that shouldn't break should be covered by tests.16:34
*** eaguilar has quit IRC16:35
*** eaguilar has joined #rdo16:36
*** paramite has quit IRC16:37
*** smeyer has quit IRC16:37
*** dyasny has joined #rdo16:40
*** steveg_afk has joined #rdo16:40
dmsimardjruzicka: http://eavesdrop.openstack.org/irclogs/%23rdo/%23rdo.2016-11-25.log.html#t2016-11-25T15:28:5816:41
*** thebloggu has joined #rdo16:42
*** athomas has quit IRC16:43
jruzickadmsimard, that's basically the same thing I just said :)16:45
jruzickaAllright, feel free to open rdopkg Issue if you want it tracked.16:45
*** ayoung has joined #rdo16:46
*** sdake has quit IRC16:50
*** links has joined #rdo16:50
jamesllondonlapthas anyone managed to get it working in AWS? (rhel requires a license, centos images crash on yumupgrade, amz-ec2?)16:51
*** athomas has joined #rdo16:51
*** apevec has quit IRC16:51
*** sdake has joined #rdo16:52
*** emalikov has quit IRC16:52
amoralejapevec, what if we provide instructions to configure the temp .repo file in the 7.3 mail so users can start testing it?16:52
*** rasca has quit IRC16:52
*** ealcaniz has joined #rdo16:53
*** ealcaniz has quit IRC16:54
*** cliles has joined #rdo16:57
*** eaguilar has quit IRC16:57
*** Pavo has quit IRC16:58
*** nmagnezi has joined #rdo16:58
*** nmagnezi has quit IRC16:58
*** Pavo has joined #rdo16:59
*** eaguilar has joined #rdo17:00
*** degorenko is now known as _degorenko|afk17:02
*** apevec has joined #rdo17:03
*** lucasagomes is now known as lucas-afk17:04
*** WillUK2010 has quit IRC17:04
*** dbecker has joined #rdo17:06
*** wolverin_ has quit IRC17:07
*** wolverineav has joined #rdo17:07
amoralejEmilienM, i've sent a mail about migration to centos 7.3 will be ready soon. Note that puppet upstream jobs may be affected by the mariadb-libs issue17:07
*** jrist has quit IRC17:10
EmilienMamoralej: how do we fix this?17:11
amoralej"yum update" after enabling rdo repos17:11
pabelangerdmsimard: any word on the 3rd party CI patch for namespace issues in zuul?17:11
dmsimardamoralej, jpena, apevec: https://review.openstack.org/#/c/403120/ (I'm just not sure if the regex matching will work properly)17:11
pabelangerdmsimard: not sure where we stand on that right now17:12
*** wolverineav has quit IRC17:12
*** Jeffrey4l has quit IRC17:12
dmsimardpabelanger: no afaik, I'll reply to the thread17:12
*** sdake has quit IRC17:13
*** jrist has joined #rdo17:13
EmilienMamoralej: hum, it's going to take time now?17:14
EmilienMit's weird to do this^17:14
*** wolverineav has joined #rdo17:14
*** links has quit IRC17:15
*** sdake has joined #rdo17:15
amoralejshouldn't take much, images from nodepool are pretty updated, so only few packages will be installed17:15
amoralejyou can do a more selective update17:15
amoralejof mariadb-libs but you may hit similar cases in future for other packages17:16
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html17:16
EmilienMamoralej: can you submit a patch please?17:16
amoralejok17:17
EmilienMthx17:17
dmsimardamoralej: I'll cross-post to openstack-operators17:17
amoralejok17:17
amoralejgood17:17
*** jrist has quit IRC17:17
*** pblaho has quit IRC17:18
EmilienMdmsimard++17:19
*** KarlchenK has joined #rdo17:23
*** hogepodge has joined #rdo17:24
*** jrist has joined #rdo17:24
*** aludwar1 has joined #rdo17:26
*** numans has quit IRC17:26
*** aludwar has quit IRC17:26
*** aludwar1 is now known as aludwar17:26
*** pcaruana has quit IRC17:33
*** gfidente is now known as gfidente|afk17:33
*** jamesllondonlapt has quit IRC17:34
*** dyasny has quit IRC17:36
*** dyasny has joined #rdo17:36
*** sdake has quit IRC17:37
*** rhallisey_ has joined #rdo17:37
*** iberezovskiy is now known as iberezovskiy|off17:37
*** dbecker has quit IRC17:40
*** rhallisey_ is now known as rhallisey17:40
*** Pavo has quit IRC17:41
*** sdake has joined #rdo17:42
*** panda is now known as panda|bbl17:42
*** rhallisey has quit IRC17:43
*** rhallisey has joined #rdo17:43
*** shardy is now known as shardy_afk17:46
*** Pavo has joined #rdo17:51
*** Amita has quit IRC17:51
*** Pavo has quit IRC17:53
*** Pavo has joined #rdo17:56
*** florianf has quit IRC17:59
rdogerritEmilien Macchi created openstack/tripleo-heat-templates-distgit: Add CI directory  http://review.rdoproject.org/r/391317:59
EmilienMcan someone review ^ asap please?17:59
*** tosky has quit IRC17:59
jpenaEmilienM: does that directory exist today in the repo? If not I think it's going to fail to build18:00
EmilienMjpena: https://review.openstack.org/#/c/402119/18:01
EmilienMjpena: I can make it not failing with conditional?18:01
rdogerritEmilien Macchi proposed openstack/tripleo-heat-templates-distgit: Add CI directory  http://review.rdoproject.org/r/391318:02
EmilienMjpena: done ^18:02
jpenaEmilienM: fair enough :)18:03
EmilienMjpena: thx!18:04
*** aortega_ has quit IRC18:07
*** sdake has quit IRC18:07
*** sdake has joined #rdo18:09
*** wolverineav has quit IRC18:10
*** wolverineav has joined #rdo18:10
*** wolverin_ has joined #rdo18:12
jpenahave a nice wekend everyone!18:13
jpenas/wekend/weekend/18:13
jruzickajpena, enjoy!18:14
*** wolverineav has quit IRC18:14
EmilienMjpena: enjoy18:14
*** cwolferh has joined #rdo18:14
*** jpena is now known as jpena|off18:14
*** rhallisey has quit IRC18:15
*** wolverin_ has quit IRC18:17
rdogerritMerged openstack/tripleo-heat-templates-distgit: Add CI directory  http://review.rdoproject.org/r/391318:18
*** milan has quit IRC18:19
*** jlibosva has quit IRC18:21
*** nmagnezi has joined #rdo18:22
*** amoralej is now known as amoralej|off18:23
*** wolverineav has joined #rdo18:27
*** sdake has quit IRC18:30
*** rcrit has quit IRC18:30
*** sdake has joined #rdo18:32
*** wolverineav has quit IRC18:32
*** vaneldik has joined #rdo18:35
*** wolverineav has joined #rdo18:35
*** wolverineav has quit IRC18:39
*** ohamada has quit IRC18:39
*** ihrachys has joined #rdo18:40
*** jbadiapa has quit IRC18:43
*** wolverineav has joined #rdo18:47
*** ihrachys has quit IRC18:50
*** wolverineav has quit IRC18:51
*** vaneldik has left #rdo18:54
*** gfidente|afk has quit IRC18:54
*** pkovar has quit IRC18:56
*** sdake has quit IRC18:57
*** flepied1 has joined #rdo18:57
*** sdake has joined #rdo19:01
*** flepied has quit IRC19:01
*** karimb has quit IRC19:03
*** karimb has joined #rdo19:08
dmsimardapevec: fyi https://review.openstack.org/#/q/topic:test-count19:11
*** hogepodge has quit IRC19:11
dmsimard~300 less tests spread across the three scenarios19:13
zoli|wfhhave a good weekend19:14
dmsimardthe ec2api tests will be highly valuable on scenario002 (161 tests down to 14) and lbaas will help across all scenarios since it's tested everywhere (109 tests down to 30)19:14
*** zoli|wfh is now known as zoli|gone19:15
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html19:16
*** apetrich has quit IRC19:19
*** nmagnezi has quit IRC19:28
*** yolanda has quit IRC19:29
*** fzdarsky is now known as fzdarsky|afk19:32
*** sdake has quit IRC19:34
*** flepied has joined #rdo19:35
*** flepied1 has quit IRC19:35
*** sdake has joined #rdo19:35
*** shardy_afk has quit IRC19:40
*** nstrug_ has joined #rdo19:43
*** panda|bbl is now known as panda19:46
*** nstrug has quit IRC19:46
*** KarlchenK has quit IRC19:47
*** thebloggu has quit IRC19:55
*** Pavo has quit IRC19:55
*** Pavo has joined #rdo19:56
*** racedo has quit IRC19:56
*** wolverineav has joined #rdo19:56
*** wolverineav has joined #rdo19:58
*** racedo has joined #rdo19:59
*** wolverineav has quit IRC20:00
*** wolverineav has joined #rdo20:01
*** nstrug__ has joined #rdo20:01
*** sdake has quit IRC20:04
*** nstrug_ has quit IRC20:05
*** wolverineav has quit IRC20:05
*** ihrachys has joined #rdo20:05
*** sdake has joined #rdo20:05
*** beagles_afk is now known as beagles20:06
*** hogepodge has joined #rdo20:08
*** pkovar has joined #rdo20:12
*** nstrug_ has joined #rdo20:14
*** nstrug__ has quit IRC20:17
*** racedo has quit IRC20:18
*** k4n0 has quit IRC20:22
*** dpeacock has quit IRC20:23
*** jcoufal has quit IRC20:23
*** racedo has joined #rdo20:25
*** sdake has quit IRC20:26
*** sdake has joined #rdo20:28
*** racedo has quit IRC20:31
*** racedo has joined #rdo20:31
*** emalikov has joined #rdo20:32
*** racedo has quit IRC20:35
*** pnavarro has joined #rdo20:38
*** jpich has quit IRC20:43
*** pnavarro has quit IRC20:54
*** sdake has quit IRC20:56
*** wolverineav has joined #rdo20:57
*** wolverineav has quit IRC21:01
*** sdake has joined #rdo21:03
*** ssbarnea has quit IRC21:08
*** ssbarnea has joined #rdo21:09
*** WillUK2010 has joined #rdo21:11
*** nmagnezi has joined #rdo21:11
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html21:16
*** yolanda has joined #rdo21:16
*** Goneri has quit IRC21:17
*** wolverineav has joined #rdo21:19
*** wolverineav has quit IRC21:23
*** karimb has quit IRC21:24
*** iranzo has quit IRC21:25
*** sdake has quit IRC21:26
*** wolverineav has joined #rdo21:29
*** sdake has joined #rdo21:30
*** fragatina has quit IRC21:31
*** fragatina has joined #rdo21:31
*** wolverineav has quit IRC21:33
*** wolverineav has joined #rdo21:39
*** wolverineav has quit IRC21:43
*** nmagnezi has quit IRC21:48
*** dciabrin has quit IRC21:50
*** sdake has quit IRC21:54
*** ssbarnea has quit IRC21:55
*** Pavo has quit IRC21:55
*** sdake has joined #rdo22:00
*** Pavo has joined #rdo22:00
*** eaguilar has quit IRC22:05
*** yolanda has quit IRC22:07
*** wolverineav has joined #rdo22:08
*** TSCHAK has joined #rdo22:12
*** wolverineav has quit IRC22:13
*** limao has joined #rdo22:15
*** limao has quit IRC22:20
*** sdake has quit IRC22:21
*** yolanda has joined #rdo22:22
*** sdake has joined #rdo22:22
*** wolverineav has joined #rdo22:28
*** wolverineav has quit IRC22:32
*** hogepodge has quit IRC22:40
*** nmagnezi has joined #rdo22:41
*** panda is now known as panda|Zz22:41
*** yolanda has quit IRC22:42
*** sdake has quit IRC22:45
*** eaguilar has joined #rdo22:46
*** sdake has joined #rdo22:48
*** limao has joined #rdo22:48
*** hogepodge has joined #rdo22:51
*** limao has quit IRC22:52
*** wolverineav has joined #rdo22:57
*** wolverineav has quit IRC23:02
*** arxcruz has quit IRC23:03
*** Masber has quit IRC23:04
*** Goneri has joined #rdo23:07
*** wolverineav has joined #rdo23:11
*** limao has joined #rdo23:14
*** wolverineav has quit IRC23:16
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-head-current @ http://tinyurl.com/hcnq3ll |#| Build failure on centos7-master-head/current: oslo.db, oslo.log, murano-dashboard: http://trunk.rdoproject.org/centos7-master-head/report.html23:16
*** limao has quit IRC23:21
*** nmagnezi has quit IRC23:22
*** nmagnezi has joined #rdo23:22
*** apevec has quit IRC23:27
*** Goneri has quit IRC23:28
*** sdake_ has joined #rdo23:28
*** sdake has quit IRC23:32
rdogerritMerged openstack/glance_store-distgit: Fix python3 subpackage  http://review.rdoproject.org/r/381523:33
*** nmagnezi has quit IRC23:34
rdogerritMerged openstack/keystonemiddleware-distgit: Fix oslo-context requires for python3 subpackage  http://review.rdoproject.org/r/381123:34
*** ihrachys has quit IRC23:36
rdogerritMerged openstack/troveclient-distgit: Temporarily disable python3 build in Fedora  http://review.rdoproject.org/r/381323:39
*** sdake_ has quit IRC23:43
*** sdake has joined #rdo23:45
*** sdake has quit IRC23:46
*** sdake has joined #rdo23:47
*** sdake has quit IRC23:48
*** aludwar has quit IRC23:49
*** sdake has joined #rdo23:49
*** sdake has quit IRC23:50
*** aludwar has joined #rdo23:51
*** sdake has joined #rdo23:52
*** sdake has quit IRC23:53
*** Pavo has quit IRC23:55
*** sdake has joined #rdo23:56
*** Pavo has joined #rdo23:58
*** sdake has joined #rdo23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!