Friday, 2016-08-12

rdobot[sensu] NEW: - check-delorean-newton-current @ |#| Build failure on centos7-master/current: swift:
EmilienMI'll investigate later, diner now00:14
EmilienMpromotion fails for puppet CI00:14
*** Ryjedo_ has joined #rdo00:19
*** Ryjedo has quit IRC00:20
*** Ryjedo_ is now known as Ryjedo00:20
*** limao has joined #rdo00:28
*** alexismonville has quit IRC00:28
*** limao has quit IRC00:29
*** limao has joined #rdo00:29
*** manous has quit IRC00:33
*** Son_Goku has joined #rdo00:45
*** sdake has joined #rdo00:46
dmsimardEmilienM: it looks like it might be
EmilienMdmsimard: what?01:02
EmilienMdmsimard: and the nova thing?01:02
dmsimardEmilienM: dunno didn't look01:03
dmsimardEmilienM: I was investigating the failure to build and stumbled on the swift ring builder ipv6 commit01:03
dmsimardEmilienM: and we're getting swift ring errors that seem related to ipv6 :)01:03
EmilienMdmsimard: nova.conf looks good01:04
EmilienMi don't understand01:04
EmilienMoh wait01:05
EmilienMscenario001 actually works01:05
EmilienMso it might be a random issue for nova?01:06
rdogerritDavid Moreau Simard proposed openstack/swift-distgit: Add python-netifaces as a buildrequires for docs
EmilienMdmsimard: I'm looking the puppet swift code01:11
EmilienMit's in the second puppet run01:13
EmilienMso it's not idempotent01:13
dmsimardall of a sudden ?01:14
dmsimardnot a ton of things have merged recently in swift
EmilienMthe output seems different now01:16
*** alexismonville has joined #rdo01:16
EmilienMand our ***ing parser needs an update ai guess01:16
dmsimardthat's right01:17
dmsimardwe parse the output01:17
dmsimardI touched that parser ONCE to add multi region support01:17
EmilienMwe need to compare the print01:17
EmilienMI never touched it01:17
EmilienMit's against my religion01:17
EmilienMreally I didn't write this code01:17
dmsimardIt's almost as bad as that one pretty table parsing script somewhere in nova01:18
ggilliesdoes anyone happen to know how the tripleo overcloud images are built at
EmilienMok i'm trying to find what changed in output01:18
dmsimardggillies: I would guess those are out of our CI01:19
ggilliesit's obviously not using python-tripleoclient01:19
dmsimardggillies: they are built through tripleo-quickstart and uploaded there if the job pipeline was successful01:19
EmilienMI found why01:19
EmilienMbefore it was "ip port"01:19
dmsimardggillies: these jobs:
EmilienMnow it's "ip:port"01:19
ggillieswhat has tripleo-quckstart got to do with building images01:19
ggilliesjesus this stuff is a mess01:20
dmsimardggillies: /me shrugs01:20
EmilienMdon't call jesus!01:20
EmilienMI'll have to invoke stars again01:20
dmsimardI'm going to go hide because I have nothing to do with quickstart (but really though I'm going to shower and sleep)01:20
ggilliesok I think I need to put a spec or something to do overhaul of image building01:20
ggilliesit looks like we have a lot of legacy related to "old" tripleo01:21
ggilliesmight be time to clean it out01:21
EmilienMdmsimard: dude I'm preparing a patch01:22
* EmilienM invoking stars tonight01:22
* EmilienM music01:22
EmilienMI swear I don't take drugs01:22
dmsimardEmilienM: good, you can +1 when the dlrn job passes so it looks like I didn't ninja self merge01:23
dmsimardin the state things are I definitely don't want unconsistent dlrn01:23
EmilienMdude I'm doing a regex now01:23
dmsimardneed help with the regex ?01:23
EmilienMI'm really bad01:23
*** rhallisey has joined #rdo01:24
EmilienMCAN WE BE SERIOUS ??01:24
EmilienMI'm doing a regex.01:24
EmilienMlol the regex in puppet-swift:01:25
EmilienMif row =~ /^\s*(\d+)\s+(\d+)\s+(\d+)\s+(\S+)\s+(\d+)\s+\S+\s+\d+\s+(\S+)\s+(\d+\.\d+)\s+(\d+)\s*((-|\s-?)?\d+\.\d+)\s*(\S*)/01:25
ggilliesok so if I am reading this correctly01:25
ggilliesall our CI jobs no longer actually use python-tripleoclient to build images01:25
*** paragan has quit IRC01:25
dmsimardggillies: tripleoci probably uses python-tripleoclient01:25
ggilliesso the whole 'openstack overcloud image build' is basically now untested01:26
dmsimardggillies: I don't know tbh01:26
*** zeroshft has joined #rdo01:26
dmsimard#tripleo probably a better place to ask01:26
EmilienMI go on shamelesly01:26
*** zeroshft has quit IRC01:30
*** limao_ has joined #rdo01:36
EmilienMdoing a regex at 9.30pm01:38
EmilienMlife is sad01:38
*** limao has quit IRC01:39
*** alexismonville has quit IRC01:52
*** Amita has joined #rdo02:00
*** sdake has quit IRC02:01
*** rhallisey has quit IRC02:01
rdobot[sensu] NEW: - check-delorean-newton-current @ |#| Build failure on centos7-master/current: swift:
rdogerritDavid Moreau Simard proposed openstack/swift-distgit: Add python-netifaces and eclib as a buildrequires for docs
*** gfidente has quit IRC02:11
*** sdake has joined #rdo02:13
*** shaunm has quit IRC02:16
*** gildub has joined #rdo02:19
*** zeroshft has joined #rdo02:27
*** bswartz has quit IRC02:33
*** sdake has quit IRC02:34
*** zeroshft has quit IRC02:36
*** bswartz has joined #rdo02:37
*** crossbuilder has joined #rdo02:37
*** imcleod has quit IRC02:37
*** crossbuilder_ has quit IRC02:38
*** zeroshft has joined #rdo02:42
*** zeroshft has quit IRC02:46
rdogerritDavid Moreau Simard proposed openstack/swift-distgit: Add new build dependencies for Swift documentation
*** ayoung has joined #rdo02:49
*** imcleod has joined #rdo02:50
*** sdake has joined #rdo02:54
*** paragan has joined #rdo02:55
*** rhefner has quit IRC02:55
*** rhefner has joined #rdo02:55
*** mwhahaha has quit IRC02:55
*** mwhahaha has joined #rdo02:59
*** paragan has quit IRC03:01
*** Ryjedo has quit IRC03:01
*** zeroshft has joined #rdo03:02
*** zeroshft has quit IRC03:03
*** Ryjedo has joined #rdo03:03
*** zeroshft has joined #rdo03:03
*** imcleod has quit IRC03:05
*** zeroshft has quit IRC03:12
*** limao_ has quit IRC03:13
rdogerritDavid Moreau Simard proposed openstack/swift-distgit: Add new build dependencies for Swift documentation
*** imcleod has joined #rdo03:21
*** paragan has joined #rdo03:24
*** sdake has quit IRC03:24
pabelangerggillies: you might be interested in:
pabelangerggillies: I just added an experimental job upstream to build overcloud-full using python-tripleoclient03:25
pabelangerggillies: is the job-template03:26
pabelangerggillies: my next step is to make it non-voting, but eventually all jobs for all our images too03:27
ggilliespabelanger: thanks03:30
ggilliesI'm about to send out an email with what I've found and some suggestions03:30
pabelangerggillies: Ya, I'm sure we are on the same page.03:30
rdogerritDavid Moreau Simard proposed rdoinfo: Update newton-uc branch tags to latest upper-constraints
*** links has joined #rdo03:33
rdogerritMerged rdoinfo: Update newton-uc branch tags to latest upper-constraints
*** limao has joined #rdo03:38
*** ayoung has quit IRC03:45
*** numans has joined #rdo03:46
*** sdake has joined #rdo03:54
*** vimal has joined #rdo03:54
*** paragan has quit IRC03:56
*** paragan has joined #rdo03:57
rdobot[sensu] NEW: - check-delorean-newton-current @ |#| Build failure on centos7-master/current: swift:
rdogerritMerged openstack/swift-distgit: Add new build dependencies for Swift documentation
*** numans has quit IRC04:03
rdogerritMerged DLRN: Add timestamp to log output
*** vimal has quit IRC04:07
*** Amita has quit IRC04:07
*** imcleod has quit IRC04:16
*** fragatina has quit IRC04:16
*** limao has quit IRC04:19
*** limao has joined #rdo04:20
*** vimal has joined #rdo04:29
*** nehar has joined #rdo04:34
*** nehar has quit IRC04:39
*** nehar has joined #rdo04:51
*** fragatina has joined #rdo04:58
*** rdas has joined #rdo05:01
*** fragatina has quit IRC05:03
*** ohochman has left #rdo05:04
*** jaosorior has joined #rdo05:04
*** nehar has quit IRC05:05
*** anilvenkata has joined #rdo05:06
*** chandankumar has joined #rdo05:16
*** Son_Goku has quit IRC05:20
*** ggillies has quit IRC05:31
*** sdake has quit IRC05:32
*** coolsvap has joined #rdo05:34
*** rcernin has quit IRC05:51
*** hewbrocca-afk is now known as hewbrocca05:53
*** saneax_AFK is now known as saneax05:54
*** saneax is now known as Guest8973905:54
*** Son_Goku has joined #rdo05:59
*** kaminohana has quit IRC06:00
rdobot[sensu] NEW: - check-delorean-newton-current @ |#| Build failure on centos7-master/current: swift:
*** limao has quit IRC06:08
*** limao_ has joined #rdo06:08
chandankumarnumber80, \o/06:08
*** manous has joined #rdo06:10
*** jprovazn has joined #rdo06:11
*** manous has quit IRC06:15
*** limao_ has quit IRC06:15
*** limao has joined #rdo06:15
*** satya4ever has joined #rdo06:16
*** fultonj has quit IRC06:17
*** manous has joined #rdo06:18
*** rcernin has joined #rdo06:21
*** manous has quit IRC06:22
*** aufi has joined #rdo06:23
*** anilvenkata is now known as anilvenkata_afk06:24
*** Amita has joined #rdo06:26
*** manous has joined #rdo06:26
*** lkuchlan has joined #rdo06:27
*** furlongm has quit IRC06:28
*** pgadiya has joined #rdo06:30
*** pgadiya has quit IRC06:31
*** manous has quit IRC06:31
*** vaneldik has joined #rdo06:31
*** vaneldik has quit IRC06:32
*** furlongm has joined #rdo06:32
*** manous has joined #rdo06:35
*** lkuchlan has quit IRC06:39
*** smeyer has joined #rdo06:40
*** manous has quit IRC06:40
*** nyechiel has joined #rdo06:41
*** manous has joined #rdo06:43
*** mrunge has quit IRC06:47
*** manous has quit IRC06:48
*** nyechiel has quit IRC06:49
*** manous has joined #rdo06:50
*** iranzo has joined #rdo06:50
*** manous has quit IRC06:55
*** anilvenkata_afk is now known as anilvenkata06:58
*** manous has joined #rdo06:58
*** smeyer has quit IRC06:58
*** tesseract- has joined #rdo06:59
*** manous has quit IRC07:02
*** smeyer has joined #rdo07:04
*** manous has joined #rdo07:05
*** florianf has joined #rdo07:06
*** manous has quit IRC07:10
*** martinkopec has joined #rdo07:11
*** toanju has joined #rdo07:13
*** manous has joined #rdo07:13
*** manous has quit IRC07:18
*** manous has joined #rdo07:20
*** tumble has joined #rdo07:20
*** hynekm has joined #rdo07:22
*** anilvenkata is now known as anilvenakata_lun07:24
imcsk8good night!07:25
*** manous has quit IRC07:25
*** jpena|off is now known as jpena07:25
jpenagood morning07:26
*** manous has joined #rdo07:27
*** manous has quit IRC07:32
*** jlibosva has joined #rdo07:34
rdogerritJavier Peña proposed DLRN: Parallel mock builds in DLRN
rdogerritJavier Peña proposed DLRN: rsync all files/dirs in a single command
*** manous has joined #rdo07:34
*** manous has quit IRC07:39
*** abehl has joined #rdo07:40
*** abehl has quit IRC07:41
*** manous has joined #rdo07:42
*** pgadiya has joined #rdo07:44
*** pgadiya has quit IRC07:44
*** amoralej|off is now known as amoralej07:44
amoralejgood morning07:44
*** Guest89739 has quit IRC07:45
*** ifarkas_afk is now known as ifarkas07:46
*** saneax has joined #rdo07:46
*** saneax is now known as Guest3408507:47
*** manous has quit IRC07:47
*** gildub_ has joined #rdo07:48
*** jpich has joined #rdo07:49
*** ohamada has joined #rdo07:49
*** gildub has quit IRC07:49
*** milan has joined #rdo07:50
*** hewbrocca is now known as hewbrocca-afk07:54
flepiedgood morning07:56
*** manous has joined #rdo07:59
flepiedso we are blocked by swift/puppet-swift in the RDO promotion?08:00
*** smeyer has quit IRC08:01
rdobot[sensu] NEW: - check-delorean-newton-current @ |#| Build failure on centos7-master/current: swift:
*** Goneri has joined #rdo08:04
*** manous has quit IRC08:04
amoralejflepied, i'm checking puppet-openstack-scenario003 issue08:06
amoralejthat's not identified, right?08:07
*** athomas has joined #rdo08:07
*** manous has joined #rdo08:07
*** social has joined #rdo08:08
*** nstrug has quit IRC08:11
*** shardy has joined #rdo08:11
*** manous has quit IRC08:12
*** danpawlik has joined #rdo08:12
*** ade_b has joined #rdo08:13
*** martinkopec has quit IRC08:13
*** lucas-dinner is now known as lucasagomes08:15
*** pnavarro has joined #rdo08:15
*** manous has joined #rdo08:16
*** Amita has quit IRC08:16
*** dbecker has joined #rdo08:20
*** jlibosva has quit IRC08:22
flepiedamoralej: yes it seems08:23
amoraleji'm checking, it looks like a issue introduced by os-vif...08:23
*** nstrug has joined #rdo08:24
*** Amita has joined #rdo08:27
*** pnavarro has quit IRC08:29
*** hewbrocca-afk is now known as hewbrocca08:29
*** jlibosva has joined #rdo08:31
rdogerritJavier Peña proposed DLRN: Add option in gitrepo driver to determine source branch from spec
rdogerritJavier Peña created DLRN: Allow package name substitution in gitrepo driver
*** Amita is now known as Amita|testday08:31
*** anilvenakata_lun has quit IRC08:34
rdogerritrdo-trunk created openstack/oslo-messaging-distgit: python-oslo-messaging: failed to build 94c958c
*** kozhukalov_ has joined #rdo08:35
*** iranzo has quit IRC08:35
*** gfidente has joined #rdo08:37
*** gfidente has quit IRC08:37
*** gfidente has joined #rdo08:37
*** anilvenakata_lun has joined #rdo08:37
*** numans has joined #rdo08:37
*** anilvenakata_lun is now known as anilvenkata08:37
*** Goneri has quit IRC08:38
*** kozhukalov has quit IRC08:38
*** kozhukalov_ is now known as kozhukalov08:38
*** joelinux73 has quit IRC08:41
*** anshul has joined #rdo08:43
*** ade_b has quit IRC08:46
*** ihrachys has joined #rdo08:47
*** paragan has quit IRC08:47
*** oshvartz has joined #rdo08:49
*** dtantsur|afk is now known as dtantsur08:52
*** d0ugal has quit IRC08:52
*** Goneri has joined #rdo08:53
*** gszasz has joined #rdo08:54
*** athomas has quit IRC08:58
*** iberezovskiy|afk is now known as iberezovskiy08:58
*** numans has quit IRC09:01
*** ade_b has joined #rdo09:01
misca/win 5109:02
*** athomas has joined #rdo09:03
*** smeyer has joined #rdo09:07
*** dgurtner has joined #rdo09:09
*** dgurtner has joined #rdo09:09
*** smeyer has quit IRC09:10
*** panda|zz is now known as panda09:12
*** pkovar has joined #rdo09:13
*** numans has joined #rdo09:13
flepiedjpena: are we lagging in dlrn master? python-swift has not been rebuilt it seems.09:17
*** limao has quit IRC09:18
jpenaflepied: I'm checking. It looks like the rdoinfo change yesterday (updating tags for many projects) has started a build storm, with a lot of commits being built09:18
jpenaI hope it won't take long to catch up09:20
rdogerritJavier Peña proposed DLRN: Allow package name substitution in gitrepo driver
flepiedjpena: also I don't see jenkins result in your patchset
jpenaflepied: maybe it's not checking commits to the newton-rdo branch? Let me check09:25
flepiedjpena: yes can be the case09:26
flepiedjpena: the jobs on the stable branches are being worked out by fbo and number8009:26
*** hynekm has quit IRC09:27
number80jpena: DLRN should not be checking newton-rdo branch09:28
number80it's not even in rdoinfo09:28
*** mosulica has joined #rdo09:28
jpenanumber80: but we're using it for 2 projects: oslo-messaging and mistralclient09:29
jpenawhen using tagged releases, we needed a spec that was before rpm-master09:29
jpenabecause some changes were not merged yet09:30
jpenaand it looks like newton-rdo was chosen09:30
number80we haven't synced branches yet09:30
number80damn, I'm taking over tripleo-ui package and get this done09:31
jpenanumber80: see and
jpenamaybe we can switch oslo-messaging back to rpm-master09:32
jpenaactually that sounds better to me09:32
number80that's why I was not enthusiastic with -uc branches, we're just workaround upstream flawed process with oslo libs09:33
number80well, not that we can do much about it09:34
rdogerritJavier Peña created rdoinfo: Unpin distgit branch for oslo-messaging in newton-uc
*** mrunge has joined #rdo09:41
*** martinkopec has joined #rdo09:43
*** manous has quit IRC09:45
rdobot[sensu] NEW: - check-delorean-newton-current @ Error |#| Build failure on centos7-master/current: swift, oslo.messaging:
*** paragan has joined #rdo10:04
*** Poornima has joined #rdo10:06
*** Ryjedo_ has joined #rdo10:11
*** Ryjedo has quit IRC10:12
*** Ryjedo_ is now known as Ryjedo10:12
*** jlibosva has quit IRC10:13
*** coolsvap is now known as _coolsvap_10:13
*** mvk has quit IRC10:14
*** mvk has joined #rdo10:14
*** tosky has joined #rdo10:15
*** jfjoly has joined #rdo10:18
*** dtantsur is now known as dtantsur|brb10:20
*** leanderthal|afk is now known as leanderthal10:27
rookwfoster can we send dmsimard rough guesses on our EK needs -- for Browbeat in CI.10:27
rookmaybe via email10:28
*** pkovar has quit IRC10:34
number80jruzicka: could you give a look at RDO-NEWTON reviews ?10:38
* number80 has his hands full w/ 3o-ui10:39
*** hlkv6 has quit IRC10:43
*** hlkv6 has joined #rdo10:44
*** manous has joined #rdo10:49
number80error: Unable to create immutable header region.10:52
number80I think I'm getting lunch10:53
*** manous has quit IRC10:54
*** manous has joined #rdo10:58
socialihrachys: :( the ovs issue is still not fixed?10:59
ihrachyssocial: which one?10:59
socialoh maybe I just have too old delorean build11:00
socialihrachys: brs not created with secure mode11:00
ihrachyssocial: not sure what you refer to11:00
ihrachyssocial: do you have a bug in place?11:00
*** manous has quit IRC11:03
*** jlibosva has joined #rdo11:04
ihrachyssocial: we probably did not have proper people on reviewing it11:04
ihrachysit's funny that it's 1 line of a fix and 200+ of tests :)11:04
*** manous has joined #rdo11:05
dmsimardjpena: ugh, wait. That rdoinfo bump will have dlrn build every commit for the project up until the tag ?11:09
socialihrachys: pretty please, it's kinda blocking me11:09
ihrachyssocial: I will raise it in our team, and currently reviewing it11:10
dmsimardI mean, it makes sense that dlrn would do that but I didn't realize that until now. Merging rdoinfo bumps can really mean a LOT of commits will have to be built (I guess like now)11:10
jpenadmsimard: I'm afraid so. The only fixes I can think of are a) run it with --head-only after an rdoinfo bump, or b) remove old commits from the db11:10
jpenaor changing dlrn to behave as --head-only when switching branches11:10
dmsimardOk.. and what's the story with the messaging ftbfs ?11:11
jpenaafter setting a newer tag, we need to switch distro-branch back to rpm-master (it was pinned to newton-rdo because master required a spec change that was not compatible with the previous tag)11:12
dmsimardOk not sure I understand why master != newton at this point11:14
*** weshay has joined #rdo11:14
dmsimardOh, by previous tag you mean between that last tag and master11:14
dmsimardjpena: so.. re: rdoinfo updates11:15
dmsimardI dreamt of a solution11:15
dmsimardI'll try and set up dlrn-rpmbuild job to be able to listen in order to build a specific package11:16
dmsimardi.e, "recheck rpmbuild python-oslo-messaging"11:17
dmsimardNeed to do that though11:17
*** thrash|g0ne is now known as thrash11:18
slagledlrn is building commits from the end of July, is this correct?
slaglewe still dont yet have a build for puppet-swift, that's why i'm asking11:18
dmsimardslagle: yes, we updated clients and librairies because they were outdated11:18
slaglejust saw in scrollback :)11:19
*** jkilpatr has joined #rdo11:19
slagleshould've read first :)11:19
slagleis there anyway to bump the puppet-swift to the top of the queue?11:19
slagledidn't want to get to deep into the day before trying to get a promote to pass11:20
jpenaI could stop the current run, build puppet-swift manually, then let it run again. It'll require some cleanup but it could work11:20
dmsimardjpena: but we also need that messaging fix to merge to fix ftbfs11:21
dmsimardOr we won't have consistent11:21
jpenadmsimard: yep, waiting for the rdoinfo review11:21
amoralejslagle, we still have an issue with scenario003 also, right?11:22
amoralejwe are hitting it in rdo-ci also11:22
dmsimardamoralej: the nova one ?11:22
jpenaok, I'll stop the worker and do some hacking11:22
amoraleji'm investigating11:22
rdogerritMerged rdoinfo: Unpin distgit branch for oslo-messaging in newton-uc
dmsimardamoralej: yeah I didn't find the root cause. When I checked last night, I saw some mysql deadlock errors in neutron-server but not sure if those are fatal.11:23
amoralejthey shouldn't11:24
amoralejit retries11:24
amoralejand didn't get error11:24
amoraleji added some notes in the etherpad11:24
dmsimardso, part of the reason why I was keen on merging the rdoinfo u-c bump11:24
dmsimardwas a neutronclient significant update11:24
dmsimardwe were effectively really not testing was upstream was testing anymore11:25
*** rbowen has quit IRC11:25
dmsimardit's nothing more than my intuition on that one, though11:25
dmsimardnothing to back that up.11:25
*** ashw has joined #rdo11:26
jpenaslagle: it should be openstack-swift, not puppet-swift, right?11:26
*** jfjoly has quit IRC11:27
amoralejjpena, i think they are talking about the puppet-swift, as a fix was added to fix one of the p-o-i scenarios11:27
amoralejbut we need the openstack-swift to get consistent link anyway11:27
jpenaamoralej: ack. puppet-swift rebuilt, openstack-swift rebuilding11:27
dmsimardjpena: aye, I merged a ftbfs fix for openstack-swift last night11:28
amoralejwouldn't be a good idea to run head-only for pinned packages?11:28
dmsimardmore or less11:29
dmsimardit's really fairly the same logic as pinning to a branch11:29
*** jaosorior has quit IRC11:29
dmsimardthe granularity of building every commit lets us know when something starts failing to build11:29
amoralejbut as soon as we are pinning packages, that's only partly true11:30
amoraleji'd say11:30
*** jaosorior has joined #rdo11:30
*** alexismonville has joined #rdo11:30
dmsimardyeah, but unpinning them would potentially mean building >100 commits into a single build11:30
dmsimardI don't have a strong opinion on either direction btw, just discussing.11:31
jpenayes, that's why my idea was to behave as --head-only for packages that switched branches11:31
dmsimardI don't think we'd be discussing this if there was no performance issues11:31
dmsimardwhich brings me to another topic I want to discuss, probably when apevec is back11:31
weshayadarazs, is up to date?11:31
weshaydmsimard, morning11:32
dmsimardlet's be honest with ourselves, the CDN thing is really not working out11:32
*** maeca1 has joined #rdo11:32
*** dpeacock has joined #rdo11:32
dmsimardno one's using it, it's a pain to maintain11:32
weshaydmsimard, thought about it some more.. we can create a delorean link for the job that runs every four hours, but we wouldn't upload an image11:32
amoralejdmsimard, are there stats about CDN usage11:34
*** dtantsur|brb is now known as dtantsur11:34
dmsimardweshay: upload the image in that second step of the job ? or the last step ?11:34
dmsimardamoralej: limited11:34
slaglejpena: thanks11:35
*** kragniz is now known as Guest6666611:36
dmsimardjpena, amoralej: so I just thought about the rdoinfo bump some more11:36
dmsimardjpena, amoralej: I think we really need to do --head-only because the master branches of the other packages are designed to work with the tag itself, not the versions before it11:36
dmsimardif that makes sense11:37
amoralejyeap, a tag correspond to a specific commit, if we really want to test that tag, that's a commit11:37
dmsimardi.e, if neutronclient has an update from 4.4 to 5.0, we need to go straight to 5.0 as things maybe couldnt work in 4.5 or whatever11:37
weshaydmsimard, second to last.. the pin name needs to exclude tripleo.. as to not confuse folks11:38
jpenaok, so that works with my proposal11:38
amoralejthe nice point of per-commit is to troubleshooting purposes11:38
dmsimardamoralej: yeah but in this context it doesn't make sense11:38
amoralejin those cases it's useful move to a specific commit11:38
dmsimardamoralej: HOWEVER, we absolutely need to test the rdoinfo bumps11:38
dmsimardwith a dlrn-rpmbuild job for the affected packages that are being updated11:38
* jpena nods11:39
amoralejyeap, make sense11:39
*** jistr has quit IRC11:39
jpenadmsimard: gooot it, I'll start working on it once we clean up the current newton-uc mess :)11:39
dmsimardjpena: yeah, sure, it's already so early for me but I couldn't sleep anymore11:40
dmsimardjpena: I'll go get some caffeine and work on the job11:40
weshaydmsimard, what should the soft link name be?11:40
dmsimardweshay: ok i'll take another look at the review after I properly wake up11:40
*** jruzicka has quit IRC11:40
jpenaok, we have openstack-swift, puppet-swift and python-oslo-messaging rebuilt. I'm running another DLRN run with --head-only, so all clients catch up to the tagged release, and we're good for another CI run11:41
* dmsimard cross fingers11:42
dmsimardafk a bit11:42
EmilienMso we have a nova error on scenario00311:42
dmsimardEmilienM: amoralej investigated it11:43
dmsimardEmilienM: and me11:43
dmsimardEmilienM: not sure what's the problem tbh, but we are hoping that a upper-constraints update will resolve it.11:43
amoraleji'm still on it11:43
amoralejtrying to reproduce it in a local environment11:43
dmsimardamoralej: oh, you can use weirdo for that :)11:44
dmsimardamoralej: can tell you how if you'd like11:44
EmilienMdmsimard: did you update something in RDO ? can I try with latest rpo?11:44
amoraleji'm trying with run-test.sh11:44
dmsimardEmilienM: dlrn is still catching up11:44
amoralejis documented somewhere dmsimard?11:44
EmilienMmaybe we can ask networking folks11:44
dmsimardamoralej: yup, hang on11:45
amoraleji was trying to have a more clear idea about the failure11:45
*** rbowen has joined #rdo11:45
*** ChanServ sets mode: +o rbowen11:45
amoralejbefore asking network guys11:45
amoralejin fact, i'm not sure if it's nova or neutron issue yet11:46
EmilienMwell, it's highly related11:47
amoralejyes, it is11:48
EmilienMregarding the urgency to promote, I would ping someone from neutron folks11:48
pabelangerdmsimard: did you see the email from tristanC about gerrit_connections?11:48
amoralejthat easy?11:48
dmsimardamoralej: that's the whole point of weirdo ! :D11:48
EmilienMihrachys: good afternoon, you or someone else from your team could help11:48
EmilienMihrachys: we're trying to promote RDO CI and we currently have a blocker that might  be related to neutron or nova11:49
dmsimardpabelanger: I saw the email but did not read it yet11:49
dmsimardpabelanger: I haven't woken up properly yet, just got at the keyboard to discuss some crisis stuff11:49
EmilienMihrachys: we have 2 tempests tests failing when using linuxbridge, more context is documented at the end of
ihrachysEmilienM: details?11:49
pabelangerdmsimard: ack11:50
ihrachysEmilienM: yeah, it's definitely nova issue11:50
ihrachysEmilienM: good news it's fixed now in their gate11:50
EmilienMihrachys: ok, what was the fix?11:50
ihrachysEmilienM: so just a matter of a new nova package11:50
ihrachysEmilienM: sec11:50
EmilienMI'm glad I asked11:50
EmilienMyou're a machine11:51
EmilienMthanks :)11:51
EmilienMso we need delorean to catchup and have this patch11:51
EmilienMand we can try again11:51
ihrachysI am. please insert a coin.11:51
EmilienMihrachys: dude, thanks a lot11:51
EmilienMok it's in delorean11:51
* hewbrocca inserts beer11:51
EmilienMsee 3f642cff8ea837705568f1281f66fa54c7c59ea411:52
*** ashw has quit IRC11:52
dmsimardwe have consistent right now11:52
EmilienMI'm going to try again11:52
dmsimardbut it's probably a weird consistent11:52
ihrachysEmilienM: happy to be helpful11:53
EmilienMI ran puppet CI promotion, let's see11:53
adarazsweshay: good morning, I just got back from lunch; so I'm waiting for the compute/tempest issue (39) to get solved before retriggering a build, otherwise we might be good to go and yes it's up to date afaik11:53
dmsimardjpena: head is still building right now, right ?11:54
jpenadmsimard: yep11:54
*** anilvenkata has quit IRC11:54
jpenaI'll let you know when it's done11:54
adarazsdmsimard: will you trigger the promotion job?11:54
dmsimardadarazs: dlrn is in a weird state right now because we interrupted builds to priorize some packages11:55
jpenayes, let's please give dlrn some minutes to catch up11:55
dmsimardadarazs: jpena is rebuilding the tip of the packages right now, I'd rather wait11:55
adarazsdmsimard: yeah, I meant after jpena finishes :)11:55
adarazsor rather after dlrn finishes.11:56
*** jfjoly has joined #rdo11:56
dmsimardadarazs: yes, sure11:56
*** Poornima has quit IRC11:57
*** Guest34085 is now known as saneax_AFK12:00
*** lucasagomes is now known as lucas-hungry12:00
*** ccamacho is now known as ccamacho|lunch12:02
weshayadarazs, cool.. fyi.. I'll post new diagrams for this
*** morazi has joined #rdo12:04
*** jayg|g0n3 is now known as jayg12:06
*** jfjoly has quit IRC12:06
*** pkovar has joined #rdo12:07
*** jfjoly has joined #rdo12:08
*** morazi has quit IRC12:08
*** morazi has joined #rdo12:09
*** ohamada has quit IRC12:13
*** rhallisey has joined #rdo12:15
*** ohamada has joined #rdo12:15
*** jruzicka has joined #rdo12:17
*** rbowen has quit IRC12:18
*** amoralej is now known as amoralej|lunch12:23
*** jistr has joined #rdo12:24
* jruzicka gets pwned librpm again and again12:24
jruzicka*by librpm12:24
* jpena goes to lunch, will check dlrn execution from time to time12:25
flepiedwhy the rdo-delorean-promote-master is disabled?12:25
*** jpena is now known as jpena|lunch12:25
*** fultonj has joined #rdo12:27
flepiedadarazs: did you disable it to wait for the right packages? ^^12:30
*** jruzicka has quit IRC12:31
*** jistr has quit IRC12:31
adarazsflepied: I didn't disable it, but weshay or dmsimard might have.12:31
adarazsflepied: and yeah, we're waiting for dlrn to finish building stuff.12:31
flepiedadarazs: ok12:32
*** jistr has joined #rdo12:32
*** jruzicka has joined #rdo12:33
*** chlong|mtg has quit IRC12:33
weshayadarazs, I updated
*** jfjoly has quit IRC12:35
*** fultonj has quit IRC12:35
*** jfjoly has joined #rdo12:36
*** fultonj has joined #rdo12:36
adarazsweshay: and what about my comments, apart from the semicolon stuff? :)12:37
weshayadarazs, oh.. /me looks12:37
*** dbecker has quit IRC12:37
*** gildub_ has quit IRC12:38
weshayadarazs, a different job type?12:38
weshayadarazs, dmsimard wants the job that is running every 4 hours RDO-CI Master, to promote a delorean hash12:38
weshayso.. it's a pipeline but not for tripleo12:39
*** jistr has quit IRC12:41
*** jruzicka has quit IRC12:41
adarazsweshay: the purpose of this patch is not very clear to me to begin with, but what I didn't like is that we're starting to magically override env variables from outside, when currently we are setting them based on the job type. so if we need another job type, then let's add it rather than mess around with vars.12:41
weshayadarazs, the purpose of the patch is to implement the diagram12:43
weshayadarazs, if you disagree w/ the diagram.. please be specific12:43
EmilienMdmsimard: some puppet4 error, i'll fix them today12:43
adarazsweshay: I don't disagree with the diagram, I'm disagreeing with how you're hacking in the extra parts :) I'll comment some more and be more specific in a sec.12:44
weshaysetting variables is not a hack12:44
EmilienMamoralej|lunch: fyi ^12:44
weshayI'm removing formally hardcoded values12:45
adarazsweshay: so far each job type is setting the $LOCATION itself.12:45
*** rlandy has joined #rdo12:45
weshayonly the gethash job sets the variable12:45
adarazsweshay: yeah, but now we have a 1:1 relationship with jobtype and locations, which is kind of nice. I think we should have a different job type to promote different stuff.12:45
weshaythere are other variables used throughout the promote set in that job12:45
weshayadarazs, I don't think you understand the workflow.. can you review the image role change12:46
*** ashw has joined #rdo12:46
adarazsweshay: can you link me the diagram again?12:46
*** rbowen has joined #rdo12:50
*** ChanServ sets mode: +o rbowen12:50
*** anshul has quit IRC12:51
*** ohochman has joined #rdo12:52
*** dbecker has joined #rdo12:52
*** links has quit IRC12:53
*** aortega has joined #rdo12:55
*** amuller has joined #rdo12:56
*** jdob has quit IRC12:56
*** Amita|testday has quit IRC12:56
*** jdob has joined #rdo12:57
*** jruzicka has joined #rdo12:58
*** amoralej|lunch is now known as amoralej12:59
amoralejlet's see if we can get a promotion today EmilienM12:59
EmilienMpuppet ci is being promoted atm13:00
EmilienMI hope it will be the same for rdo13:00
amoralejwe'll wait until current dlrn run is done13:00
*** jlibosva has quit IRC13:00
*** lucas-hungry is now known as lucasagomes13:00
*** _elmiko is now known as elmiko13:00
*** iranzo has joined #rdo13:01
*** jlibosva has joined #rdo13:03
*** jistr has joined #rdo13:03
*** jmelvin has joined #rdo13:03
*** pkovar has quit IRC13:04
*** jfjoly has quit IRC13:05
*** jruzicka has quit IRC13:07
dmsimardEmilienM: you're promoting a weird build13:07
EmilienMI took latest13:07
dmsimardwe interrupted builds to priorize and build heads13:08
dmsimardbut you mostly ignored me so /me shrugs13:08
dmsimardthat's why our promote job is disabled13:08
dmsimardwe will be able to kick it soon13:08
dmsimardIn fact from looking at the builds I would say now could be a good time13:09
dmsimardjpena|lunch: what do you think ?13:09
dmsimardlooks like all libs finished building13:10
dmsimardI'll kick it.13:10
EmilienMdmsimard: I didn't ignore you dude, I just missed the information.13:10
dmsimardEmilienM: no offense taken :P13:11
EmilienMis 2a/04 good?13:11
dmsimardEmilienM: that's the one I'm targetting right now13:12
*** vimal has quit IRC13:12
*** jistr has quit IRC13:13
*** manous has quit IRC13:13
*** fragatina has joined #rdo13:13
*** ccamacho|lunch is now known as ccamacho13:14
*** unclemarc has joined #rdo13:14
*** sdake has joined #rdo13:14
*** jfjoly has joined #rdo13:14
*** jcoufal has joined #rdo13:15
*** vimal has joined #rdo13:16
*** tbarron|gone is now known as tbarron13:16
*** fragatina has quit IRC13:18
*** dprince has joined #rdo13:18
*** paragan has quit IRC13:19
*** dprince has quit IRC13:19
*** dustins has joined #rdo13:19
*** dprince has joined #rdo13:20
*** paragan has joined #rdo13:20
*** rbowen is now known as DrBacchus13:23
*** ppowell has joined #rdo13:23
*** vimal has quit IRC13:26
*** Amita|testday has joined #rdo13:26
*** manous has joined #rdo13:27
*** Amita|testday has quit IRC13:27
*** Amita has joined #rdo13:28
*** jruzicka has joined #rdo13:29
*** jpena|lunch is now known as jpena13:31
jpenabuild complete (3 mins ago), time for CI!13:31
*** chandankumar has quit IRC13:31
*** manous has quit IRC13:32
jpenaEmilienM 2a/04 is quite good, we've only had service updates after that (neutron, nova...) plus puppet-neutron13:32
jpenaall pinned versions should be there13:32
EmilienMjpena: I'll promote to latest consistent in a few13:32
*** jfjoly has quit IRC13:32
EmilienMweirdo jobs for puppet should be good I think13:33
EmilienMstars are aligned I guess :P13:33
*** manous has joined #rdo13:33
* jpena crosses his fingers13:33
jpenabtw, purge complete, we have > 100GB of free space in the DLRN instance13:34
*** jruzicka has quit IRC13:34
*** manous has quit IRC13:38
*** rodrigods has quit IRC13:39
*** rodrigods has joined #rdo13:40
*** trozet has quit IRC13:41
*** manous has joined #rdo13:42
tristanChey dmsimard, i'll prepare the cherry-pick for gerrit_connections setting13:44
dmsimardtristanC: cool13:44
dmsimardpabelanger: ^13:44
dmsimardpabelanger: did you ever create the launchpad account ?13:44
*** sdake has quit IRC13:46
*** manous has quit IRC13:47
* social stares at waiting for new openstack-neutron build13:49
dmsimardsocial: why ?13:49
*** manous has joined #rdo13:49
socialihrachys: thanks a lot13:49
dmsimardsocial: what's that fix13:50
*** trozet has joined #rdo13:50
socialdmsimard: machines randomly loosing ips13:50
*** jruzicka has joined #rdo13:50
dmsimardah, that's inconvenient :)13:50
*** Son_Goku has quit IRC13:50
*** d0ugal has joined #rdo13:51
pabelangerdmsimard: I have not, did you want to do it now?13:52
dmsimardI'm on fires left and right, if you have time to do it please do :)13:52
socialdmsimard: is there way to see queue for delorean?13:55
dmsimardbut it's fairly up to date, it shouldn't take that long.13:55
*** pnavarro has joined #rdo13:56
*** eharney has joined #rdo13:56
*** pkovar has joined #rdo13:56
*** sdake has joined #rdo13:56
*** rdogerrit has quit IRC13:57
EmilienMdmsimard, social: they were not loosing IP, it's just, under heavy load, a node can miss probes from ovsdb13:59
tristanCdmsimard: pabelanger: change is now applied on, the configuration template is added at the top of sfconfig.yaml, all you have to do is follow this doc now:
*** myoung is now known as myoung|mtg13:59
EmilienMso I guess the vswitch can't handle all traffic13:59
EmilienMbut VMs do not loose IP.14:00
*** imcleod has joined #rdo14:00
*** dustins has quit IRC14:00
pabelangertristanC: great!14:01
jpenasocial: the last commit built (vpnaas) was merged 36 mins ago14:02
socialEmilienM: after that ovs cleans up14:02
*** pkovar has quit IRC14:03
jruzickadmsimard, oh noes, the bot doesn't announce new reviews anymore?14:03
dmsimardsupposed to, maybe it's not around14:03
dmsimardyeah it's crashed14:04
dmsimardtristanC: sometimes the gerritbot isn't restarted properly14:04
dmsimardtristanC: iirc is also restarts even if there are no config changes14:04
*** danpawlik has quit IRC14:04
honzanumber80: hi!  let me know if i can help with tripleo-ui packaging today14:04
number80honza: I'm currently fixing openstack-tripleo-ui build14:04
*** pradk has quit IRC14:05
*** rdogerrit has joined #rdo14:05
number80it breaks RPM upper caps on number of files in a single package14:05
*** dmsimard sets mode: +v rdogerrit14:05
dmsimardjruzicka: thanks, rdogerrit bot is back now :)14:05
jpenanumber80: is there such a limit? o_O14:05
*** manous has quit IRC14:05
number80jpena: yes, and I was confirmed it will not be lifted in the RPM shipped by EL714:06
jpenanumber80: just curious, how many files is that?14:06
rdogerritJavier Peña created DLRN: Use zuul-cloner in tests to clone rdoinfo, if available
honzaoh my14:07
*** bnemec is now known as beekneemech14:07
*** pradk has joined #rdo14:07
number80jpena: theorically an uint64 max, but it's been set lower, I'll find the definition14:08
hewbroccathat's a lot of files14:09
number80when RPM header > 16 MB, RPM goes boom14:11
number80solution is to split into subpackages14:11
*** satya4ever has quit IRC14:13
jpena16 MB header is an awful lot of files :-/14:14
number80well, node.js14:15
*** iranzo has quit IRC14:16
*** jlibosva has quit IRC14:16
number80we have libraries that are copied multiple times14:16
*** _coolsvap_ is now known as coolsvap14:16
*** jlibosva has joined #rdo14:17
*** pnavarro has quit IRC14:19
*** manous has joined #rdo14:21
number80jruzicka: ack14:24
number80that's huge changeset :)14:24
*** manous has quit IRC14:26
*** manous has joined #rdo14:27
dmsimardjpena, weshay, adarazs: jobs are in progress:
dmsimardwell, the "actual" jobs14:27
*** saneax_AFK is now known as saneax14:28
*** iberezovskiy is now known as iberezovskiy|off14:28
*** saneax is now known as Guest4756514:28
jpenasocial: neutron rpm is now ready14:29
socialjpena: already using it14:30
rdogerritJavier Peña proposed DLRN: Use zuul-cloner in tests to clone rdoinfo, if available
pabelangerdmsimard: did you get the launchpad user?14:32
*** manous has quit IRC14:32
pabelangerif not I can do it14:32
*** pnavarro has joined #rdo14:32
*** paramite has quit IRC14:33
*** manous has joined #rdo14:34
*** myoung|mtg is now known as myoung14:34
*** Amita has quit IRC14:35
*** jistr has joined #rdo14:39
*** pkovar has joined #rdo14:40
jpenahave you seen this? ->
jpenawe're supposed to set lock_path to the same directory for cinder and nova :?14:41
*** Amita has joined #rdo14:42
jpenaof course, it all started with a patch to devstack14:42
*** Amita has quit IRC14:42
EmilienMyou're allowed to troll, it's Friday.14:43
number80let's merge everything into devstack14:43
DrBacchusLet's rewrite packstack in Go.14:44
*** pkovar has quit IRC14:44
number80Like that, we can include kubernetes \o/14:44
socialwhy not rust14:45
number80social: If I do a keynote, I'll announce that we'll rewrite OpenStack in Rust14:46
number80wait, Intel already did that14:47
miscno, I think openstack requires a new language14:48
*** rdas has quit IRC14:49
number80misc: ChuckD ? which would be what to Chuck Norris what ArnoldC is to the governator
jruzickanumber80, with huge changeset comes nice unit tests ;)14:50
dmsimardjpena, amoralej: got a tempest failure in one of the packstack scenarios on the current pipeline
amoraleji was just checking...14:51
dmsimardcould be a flap ?14:51
dmsimardit's a timeout ..14:51
number80jruzicka: true14:51
dmsimardI'm going to start a generic job on that hash14:51
*** pnavarro has quit IRC14:51
number80at least, we have a mitaka promote14:52
dmsimardamoralej: running with the same hash, we'll be able to see if it was a fluke14:53
amoralejerror creating a security-group14:53
jpenait finished, 1 minute later14:54
jpenano, 10 seconds later14:54
jpena[12/Aug/2016 15:41:45] "POST /v2.0/security-groups.json HTTP/1.1" 201 1208 38.93263714:54
number80dmsimard, amoralej, jpena: would it be possible to have a list of changed packages between two snapshots in CI?14:54
dmsimardnumber80: we recover a rpm -qa in jobs14:54
dmsimardso we can compare if needed14:55
dmsimardwe also recover yum repolist14:55
number80in which job?14:55
amoralejin the jobs you can see the hash repo used14:56
number80ok, found it, it's just not displayed in Jenkins directly14:56
*** martinkopec has quit IRC14:58
number80only heat, nova and puppet-neutron changed in between that run and the successful previous one15:00
number80(and glance_store)15:00
jruzickaI got mad at maintainability of regexp so as an experiment I replaced some of it with parsley grammar and I'm curious how that will suck :)15:00
amoralejdmsimard, we are not setting debug in packstack jobs?15:01
amoralejConnectTimeout: Request to timed out15:01
dmsimardamoralej: pretty sure the debug logs are in the actual logs15:01
dmsimardamoralej: is very verbose :)15:01
amoraleji see debug=False15:01
amoralejin nova.conf and neutron.conf15:01
amoraleji though we add --debut to packstack15:02
amoralejthat scenario configuration, right?15:02
jpenaamoralej: so it took 39 seconds for the security-groups call to complete, and it timed out after 3015:03
dmsimardamoralej: I think the debug parameter is for packstack itself, not for the services it configures15:03
rdogerrithguemar created rdo-infra/ansible-role-weirdo-common: Sort output of rpm -qa command for easier diffing
*** ade_b has quit IRC15:05
DrBacchusgchamoul: Sorry about that. I didn't see that you'd already fixed the same thing I was patching.15:05
*** jlibosva has quit IRC15:05
*** Guest47565 is now known as saneax_AFK15:05
gchamoulDrBacchus: well, originally it was not my patch and it was not really fixing the same thing15:08
amoralejyes, jpena maybe just slow ci server15:08
DrBacchusBut that's included in there, and that's all mine was. I would hate to interrupt a much longer-running thing for just that one tweak.15:08
number80jruzicka: since we'll have to parse properly spec files soon, not a bad change15:08
*** leanderthal is now known as leanderthal|afk15:09
jpenaamoralej: could be, it looks like that.15:10
gchamoulDrBacchus: no worries! I will propose a new PS and add the rst format instead. originally it was fixing the doc directory name15:10
amoralejwe should add --os-debug-mode to ci jobs also15:10
*** ayoung has joined #rdo15:10
amoralejto enable debug in services15:10
gchamoulDrBacchus: or feel free do it if you want :-)15:10
amoraleji though --debug did it15:10
jruzickanumber80, pure python .spec parser would be nice15:11
amoraleji think debug is a must for ci15:11
jruzickaas well as pure python rpm module without dark magic15:11
*** eharney has quit IRC15:15
*** eharney_ has joined #rdo15:15
*** jaosorior has quit IRC15:15
*** hewbrocca is now known as hewbrocca-afk15:15
number80jruzicka: it will be soon a requirement :(15:16
*** eharney_ is now known as eharney15:16
amoralejnumber80, i did a script some time ago to get the hash repo, versions.csv and packages in delorean-deps.repo for a promotion job15:21
amoralejif you are trying to get information from the jobs, it may be useful, it's easy to adapt15:22
*** florianf has quit IRC15:23
*** pcaruana has quit IRC15:23
*** jistr is now known as jistr|call15:23
*** eharney_ has joined #rdo15:27
number80that's useful15:27
socialgah shouldn't the mistral issue be fixed already?15:28
amoralejwhat are you looking for?, comparing packages between different promotions?15:28
*** eharney has quit IRC15:29
*** beagles is now known as beagles_brb15:29
*** florianf has joined #rdo15:31
*** ifarkas is now known as ifarkas_afk15:33
*** ayoung has quit IRC15:33
number80honza: if you don't mind, I'll submit a revision of your patchset15:35
number80I fixed the -deps package build15:36
*** mosulica has quit IRC15:36
socialhmm is this new one for mistral?
d0ugalsocial: Looks like it might be :/15:38
number80amoralej: comparing stuff between successful and failed runs of a CI job15:38
number80hence my patchset to order rpm -qa output15:38
*** sdake_ has joined #rdo15:39
*** aufi has quit IRC15:39
*** numans has quit IRC15:40
*** dyasny has quit IRC15:40
sociald0ugal: I just bumped delrean to latest repo and did openstack undercloud upgrade :( it fails on db-sync again :(15:40
* social sad15:40
*** tumble has quit IRC15:41
*** sdake has quit IRC15:41
*** jistr|call is now known as jistr15:42
honzanumber80: go right ahead15:42
dmsimardamoralej, jpena: the generic job passed on the same hash, so it was a fluke
dmsimardI will promote manually if the quickstart jobs pass15:43
dmsimardweshay: fyi all packstack and puppet jobs passed on the promote hash, just waiting for quickstart now15:43
weshaydmsimard, I see scenario003 as red15:43
dmsimardweshay: it's a flap (timeout when creating security group), I ran a one-off job on the same hash and it passed
adarazsstill then this image won't be promoted with this job :(15:44
*** jpich has quit IRC15:45
dmsimardadarazs: I'll promote manually if the quickstart jobs pass15:46
dmsimardI don't want to run the same job again (even on the same hash) because it just takes too long to complete.15:46
adarazsdmsimard: you'll do the testing -> stable image copy as well?15:46
dmsimardadarazs: I'll run manually yes15:46
weshaythat's fine this time, but this is what we need to avoid. the jobs really all need to pass at the same time15:47
*** rcernin has quit IRC15:47
weshaydmsimard, I'm sure ooo will fail anyway :P15:48
dmsimardweshay: well there are no known issues right now15:48
dmsimardweshay: and everything else passed so I'm optimistic15:48
weshayk.. /me grabs a bite15:48
weshayadarazs, I suppose I can just check the review for updates15:49
weshayadarazs, /me wonders re: the deps for this jjb patch though15:49
weshaypanda, you still here?
weshaylarsks, ^15:49
dmsimardweshay, adarazs: did you see the ci-users thread re: Jenkins v2 update for cico ?15:50
weshaydmsimard, not yet15:50
weshaymyoung, we're clear to merge ?15:50
*** weshay is now known as weshay_brb15:51
adarazswoot, minimal passed :)15:52
myoungweshay_brb I think so...that particular portion (copy of the the newly passing image) is one of the only portions not covered by the images-ci-check gates, as they never promote from the gerrit hooks :)15:53
myoungweshay_brb, adarazs, dmsimard: speaking of image build gates...
*** dyasny has joined #rdo15:55
*** beagles_brb is now known as beagles15:57
imcsk8jpena: stil around?15:58
*** imcleod has quit IRC15:59
*** sdake_ has quit IRC15:59
flepiedamoralej: is it the same issue with weirdo-master-promote-packstack-scenario003 than in the previous run?15:59
*** weshay_brb is now known as weshay15:59
amoralejnot flepied16:00
amoralejformer issue is fixed16:00
*** eharney_ is now known as eharney16:00
amoralejit has been just a timeout in a neutron api operation16:00
amoralejwe've re-run the job with the same hash and it passed16:00
dmsimardflepied: I already ran the packstack 003 job on the same hash and it passed16:00
weshaymyoung, is that needed for the image build only?16:01
dmsimardflepied: I will promote manually if both quickstart jobs pass16:01
jpenaimcsk8: yep, I'm here16:01
flepieddmsimard: ack16:01
dmsimardafk food16:01
amoralejfirst tripleo job passed, crossing fingers...16:02
dmsimardEmilienM: ALIGN THE STARS!16:02
EmilienMdmsimard: doing it16:02
weshayEmilienM, we want PONIES16:03
imcsk8jpena: last night i was checking the lp bugs and i noticed that we have a lot of with the "Fix Commited" status that have the review merged. i've written a script that retrieves those bugs and changes their status to "Fix Released"16:03
dmsimardweshay: actual EmilienM commit message "Align stars to deploy OpenStack trunk on June 22th"16:04
adarazsmyoung: reviewed.16:04
myoungweshay, it's the jobs that get kicked when images-ci-check appears in the comment text to build images and test with quickstart.  dmsimard and I were talking about this earlier in the week (or was it last?) - the validate stuff added to quickstart a few weeks ago bumps job times > max and they fail.16:04
jpenaimcsk8: oh, cool. So it's not done automatically :)16:04
dmsimardjpena: it's supposed to16:04
dmsimardjpena: but in my experience it's rather unreliable16:04
imcsk8jpena: just to get a second opinion: i'm willing to deal with false positives but i'm not shure if it's very reckless16:04
dmsimardjpena: sometimes the gerrit < - > lp hooks work, sometimes it's not16:05
dmsimardok afk food for real before I start digesting myself16:05
imcsk8i also thught that, but it's not being done16:05
jpenaimcsk8: yeah, if the fix is committed, it's been released, even if just as a package from dlrn16:05
* adarazs is logging off now before we discover something else preventing a master promote. ;)16:06
adarazssee you all, have a good weekend.16:06
weshaymyoung, did this hit CI?
imcsk8jpena: cool, ill run that then 'cause it's a little noisy with all those "Fix commited" bugs16:07
jpenaimcsk8: just make sure you do a dry run first, we don't want all bugs to be closed :P16:08
imcsk8oh no jajaja16:08
*** dsneddon has quit IRC16:08
*** dsneddon has joined #rdo16:09
imcsk8jpena: the script is based on the from   infra-release-tools16:09
weshaymyoung, we'll need internal rdo master firing on all cylinders shortly16:10
myoungweshay, re: 287153, the ci checks we have in place won't execute the file's only invoked AFAIK during promotion after something has passed.16:11
weshaymyoung, ok.. so I'll just merge16:12
myoungweshay ok...the additional comment was optional16:12
weshaymyoung, If I understand.. you were saying combine the three into one variable16:12
weshay00:01:50.198 The requested operation failed as no inventory is available.16:13
weshayyikes.. haven't seen that before dmsimard ^16:13
myoungweshay, aye - but it's just stylistic sugar.  It looks correct in it's current form.16:13
*** dyasny has quit IRC16:14
weshayadarazs, wow.. deploy passed on pacemaker16:16
*** toanju has quit IRC16:17
*** bkero is now known as bkero-pto16:18
*** florianf has quit IRC16:18
jpenanumber80: I've tested the new python-suds package. It still fails, this time with a different error message ->
weshaydmsimard, ooo passed.. you were right16:21
*** dyasny has joined #rdo16:21
*** hrw has quit IRC16:21
jpenanumber80: after some checks, I see the issue is in this line -> . name is None in the test, so name.encode() fails. We could fix it by patching it to str(name).encode()16:21
*** hrw has joined #rdo16:23
amoralejdmsimard, it seems it's going to pass, it's copying logs now16:23
number80jpena: ack16:24
number80jpena: new suds building16:28
amoraleja new job is running16:30
*** fragatina has joined #rdo16:30
*** fragatin_ has joined #rdo16:31
*** athomas has quit IRC16:32
weshaydmsimard, ping me when you are back16:32
*** fragatina has quit IRC16:35
*** ohamada has quit IRC16:35
*** tesseract- has quit IRC16:35
*** dtantsur is now known as dtantsur|afk16:41
weshaynumber80, tagged?16:42
weshayas in promoted?16:42
number80weshay: I meant I tagged newer python-suds build16:49
weshayack.. thanks16:49
* number80 has no access to CI stuff anyway16:50
jpenahave a nice weekend everyone! BTW, Monday is a bank holiday in Spain16:50
number80jpena: enjoy your week-end16:50
number80the same here, we're celebrating the fact that the mother of god gave birth to Napoleon the first16:51
number80or something like that16:51
*** jpena is now known as jpena|off16:52
number80Well, Napoleon may have thought of himself as some kind of godly being16:53
*** imcleod has joined #rdo16:54
*** lucasagomes is now known as lucas-dinner16:55
*** paragan has quit IRC17:05
dmsimardweshay: did someone start a promote job manually ?17:08
weshayI did17:08
dmsimardso I can't promote manually the last hash anymore ?17:08
weshaywe still could if that is what we want to do17:09
dmsimardI would17:09
weshayk.. I need to build a oooq image for it17:09
dmsimardBut I don't want the current build job to overwrite the image that just passed17:09
*** paragan has joined #rdo17:10
dmsimardcan I interrupt the current job17:10
dmsimardinterrupted, will let is finish semi quickly17:11
dmsimardgoing to promote 2a/04/2a040c25781dd5f907842a862ca4df5c55f56f11_99d1c446 .17:11
*** ayoung has joined #rdo17:13
weshaymyoung, incoming.. rdo master17:13
dmsimardjpena|off: you gone yet ?17:13
weshayjschlueter, I recommend not importing until internal promotes17:14
*** paragan has quit IRC17:14
*** paragan has joined #rdo17:15
weshayrlandy, is bm avail for rdo master?17:15
rlandyweshay: yes17:15
myoungweshay: woot!  are we about to promote (reading scrollback)17:15
dmsimardjschlueter: where are imports done from ?17:15
weshayrlandy, k.. thanks.. myoung rlandy all eyes on rdo master please :)17:15
weshaydmsimard, from delorean, the link you are about to promote17:16
*** paragan has quit IRC17:16
*** dustins has joined #rdo17:16
dmsimardweshay: doesn't answer my question - does it import from (which redirects to CDN and thus has several copies of packages)17:16
dmsimardor does it import from literal
amoralejdmsimard, they use the hash17:17
weshayI thought the latter17:17
dmsimardok, it's better to use the hash, the CDN is out of sync right now17:17
dmsimardjust making sure17:17
dmsimardweshay: the current-passed-ci on the symlink will not be updated properly17:17
amoralejbut jschlueter, could you confirm? ^^17:17
*** russellb has joined #rdo17:18
dmsimardthe current-passed-ci I just promoted will not be synchronized to the CDN17:18
dmsimardso the delorean.repo there will not be updated to carry the hash17:18
*** paragan has joined #rdo17:18
flepiedjschlueter: you can use 2a/04/2a040c25781dd5f907842a862ca4df5c55f56f11_99d1c446 to import17:19
dmsimardflepied: fyi we sort of broke the cdn sync when we added the new worker for upper constraints17:20
dmsimardit's... a mess17:20
flepieddmsimard: how can we fix it?17:20
amoraleji'm leaving, have a nice weekend !!!17:21
*** coolsvap has quit IRC17:21
dmsimardflepied: it's not easy. Long story short, KB doesn't delete things off of the CDN (it's hard apparently). And so, we end up with all versions of the packages on the CDN. It's not so bad with yum-plugin-priorities usually but now we have packages we actually want to use that are older (due to uppper-constraints)17:22
dmsimardflepied: Not only that, but also the path from which to sync has changed. "centos-master-head" is at /home/centos-master (this is where the CDN pulls from)17:22
dmsimardand "centos-newton" (the one with upper constraints) is at /homec/centos-newton (the CDN doesn't pull data from there)17:22
dmsimardThe CDN doesn't turn out to be such a great idea and more trouble than it's worth -- at least thus far17:23
dmsimardI want to discuss it with apevec when he's back17:23
dmsimardand truthfully, almost no one uses it anyway17:23
flepieddmsimard: yes that's what I understand too17:24
*** ppowell has quit IRC17:24
flepieddmsimard: more pain than gain17:24
amoralejflepied, how the dashboard calculates days from last promotion?, doies it uses ?17:24
*** imcleod has quit IRC17:25
amoralejso, it will not reflect real promotions now, until we fix cdn, right?17:25
dmsimardamoralej: right17:25
dmsimardI /could/ hack something manually17:26
amoralejcould it access to trunk-primary somehow?17:26
dmsimardno network access, no17:26
dmsimardweshay: special request17:27
dmsimardweshay: also upload a manifest file to so we can have a look at what repository it's from17:27
*** amoralej is now known as amoralej|off17:27
dmsimardi.e, just a dumb text file with the repositories that were used17:28
weshaydmsimard, agree.. myoung ^17:28
dmsimardweshay: I'm going to download an image just to check if it's indeed the right hash in it17:28
dmsimard(better be safe than sorry)17:28
myoung^ ditto...happening now.  dmsimard/weshay, where's the job that produced the images you just linked?  <buildhost>/var/log/artib will have the build.log, repo files, etc used to build the image17:32
jschlueterflepied: I will have to work harder but might be able to17:34
dmsimardmyoung: promotion pipeline17:34
dmsimardmyoung: for this one time I just downloaded the overcloud image to check the hash that was in it17:35
myoungdmsimard i see...i've almost downloaded it as well.  If this was from #551 then check out here...
myoungdmsimard: this was the script used to set up the repos in the base image
myoung^ and here's the canonical builder.log from the overcloud:
dmsimardmyoung: yeah, but now you know that it was from job 44117:37
dmsimardmyoung: what if you don't17:37
weshayflepied, did you get my review to update the osp10 dashboard?17:38
flepiedweshay: no17:38
flepiedweshay: do you have a link?17:38
myoungdmsimard: for the downstream stuff, I've been archiving a log bundle and publishing it with images, hoping to land that soon for this sort of reason.  sorry for wading into the thread without context, i now see we're doing a by hand promote17:39
dmsimardmyoung: yeah, unfortunately required given the circumstances17:40
myoungdmsimard: just  downloaded the image you linked and checked...that image has  ( )17:41
dmsimardmyoung: yeah I had already checked that17:41
dmsimardmyoung: what I was saying is that it'd be trivial to just add a text file to that directory with the repository it was built from17:42
* myoung shakes his fist at verizon and VPN 17:42
myoungtook me a while :)17:42
myoungto download17:42
dmsimardweshay: ooo-q image is promoted17:42
dmsimardas is dlrn, however not visible from cdn17:42
weshaydmsimard, k.. thanks17:42
dmsimardI'll have to send an e-mail to explain the cdn disconnect17:42
dmsimardbecause people will be panicking at the dashboard17:43
dmsimardthe promote job is set to promote centos-master right now but we want to be promoting centos-newton17:44
dmsimardwe really changed the workers to upper constraints too quickly and didn't take care of changing dependencies17:44
dmsimardweshay: right now if the promote job passes17:45
dmsimardweshay: the actual dlrn repository promotion will fail17:45
dmsimardbecause it will try to promote centos-master and the hash won't exist there17:45
*** ihrachys has quit IRC17:46
weshayuntil a cdn sync?17:46
dmsimardno, has nothing to do with cdn17:46
myoungdmsimard: ack, and agreed.  I put this in for that reason (, we just need to publish it when we publish/promote the images.  for downstream I've been running off this (which does that + a bit more) and hope to land it soon:,
weshaydmsimard, if we're all set.. let's rekick17:46
weshaydmsimard, may I?17:46
dmsimardweshay: feel free to re-kick but the repository promotion will fail17:46
* weshay confused17:46
dmsimardbluejeans ?17:47
*** jdennis1 has joined #rdo17:50
*** jdennis has quit IRC17:51
*** gfidente has quit IRC17:52
*** pblaho has quit IRC17:53
*** number80 has quit IRC17:55
*** jdob has quit IRC17:56
*** jdob has joined #rdo17:58
*** dgurtner has quit IRC17:58
*** fragatin_ has quit IRC18:02
*** Son_Goku has joined #rdo18:02
*** sdake has joined #rdo18:21
*** jdob has quit IRC18:27
*** jdob has joined #rdo18:27
*** v1k0d3n has joined #rdo18:31
*** weshay is now known as weshay_mtg18:33
dmsimardweshay_mtg: how long is trown out for again ?18:38
weshay_mtgtwo more weeks I think18:38
dmsimardwell that's depressing18:39
*** sdake has quit IRC18:45
*** jdob has quit IRC18:46
*** jdob has joined #rdo18:47
weshay_mtglocal test of master passed18:56
*** tosky has quit IRC18:58
*** dustins has quit IRC18:59
*** dustins has joined #rdo19:00
*** fragatina has joined #rdo19:01
*** jprovazn has quit IRC19:03
*** scorcoran has joined #rdo19:04
*** fultonj has quit IRC19:04
openstackgerritAndreas Jaeger proposed openstack/packstack: Move other-requirements.txt to bindep.txt
*** fultonj has joined #rdo19:04
*** dpeacock has quit IRC19:06
*** smeyer has joined #rdo19:11
*** manous has quit IRC19:12
*** jdob has quit IRC19:13
*** jdob has joined #rdo19:15
*** weshay_mtg is now known as weshay19:17
*** milan has quit IRC19:20
*** smeyer has quit IRC19:20
*** dustins has quit IRC19:25
*** dustins has joined #rdo19:26
*** fragatina has quit IRC19:28
*** fragatina has joined #rdo19:29
*** fragatina has quit IRC19:29
weshaymyoung, is there an email brewin?19:30
myoungweshay, yes...been sidetracked.  I'll get to it.19:30
*** Son_Goku has quit IRC19:33
myoungweshay, actually if you have a moment to chat BJ I have an error that's just got me stymied, I could use a quick look.  The issue is probably staring me in the face.19:33
weshaygoing in19:34
*** scorcoran is now known as scorcoran_afk19:35
pabelangerdmsimard: what email address did we want for 3rd party CI user?19:35
*** scorcoran_afk has quit IRC19:35
weshaymyoung, ^19:35
myoungweshay inc19:35
*** pnavarro has joined #rdo19:36
*** imcleod has joined #rdo19:38
*** aortega has quit IRC19:39
*** jmelvin has quit IRC19:45
*** mvk has quit IRC19:54
*** steveg_afk has quit IRC19:54
*** alexismonville has quit IRC19:54
*** alexismonville has joined #rdo19:54
*** unclemarc has quit IRC20:04
*** steveg_afk has joined #rdo20:08
*** alexismonville has quit IRC20:10
*** jdob has quit IRC20:11
myoungweshay, you were right.  the version of tripleo-common we're pulling in doesn't yet contain the recent changes.  the env block was being completely ignored, so it wasn't even using minimal-base, it was using the centos cloud image20:17
myoungweshay openstack-tripleo-common-5.0.0-0.20160725153340.e7377aa.el7.centos.noarch.rpm20:17
myoungweshay for downstream we were running off that gerrit hook gen'd rpm20:17
myoungweshay thanks for the eyes and probing q's :)20:18
*** dprince has quit IRC20:25
*** alexismonville has joined #rdo20:27
*** aortega has joined #rdo20:29
*** sdake has joined #rdo20:32
*** shardy has quit IRC20:32
*** ihrachys has joined #rdo20:33
*** jayg is now known as jayg|g0n320:34
*** rhallisey has quit IRC20:43
*** jkilpatr has quit IRC20:43
*** weshay is now known as weshay_afk20:47
-openstackstatus- NOTICE: The Gerrit service on is restarting for a scheduled upgrade, but should return to service momentarily:
*** aortega has quit IRC20:55
*** jkilpatr has joined #rdo20:56
*** number80 has joined #rdo20:56
*** TicToc has joined #rdo21:00
-openstackstatus- NOTICE: The Mediawiki service at will be offline from 21:00 UTC until approximately 23:00 UTC for a planned upgrade
*** ChanServ changes topic to "The Mediawiki service at will be offline from 21:00 UTC until approximately 23:00 UTC for a planned upgrade"21:00
*** jkilpatr has quit IRC21:00
*** fultonj has quit IRC21:01
*** DrBacchus has quit IRC21:02
*** shivrao has joined #rdo21:04
*** ohochman has left #rdo21:08
*** fragatina has joined #rdo21:11
*** fragatina has quit IRC21:19
TicTocCan anyone explain "tripleo quick start ~/.quickstart/ssh.config.ansible will try to proxy through the localhost to ssh to the localhost and will cause an error if ssh is not setup to support it" how do you proxy through localhost to ssh?21:23
*** sdake has quit IRC21:23
*** amuller has quit IRC21:28
*** dustins has quit IRC21:29
*** manous has joined #rdo21:30
*** decause has left #rdo21:31
*** myoung is now known as myoung|biab21:38
*** ihrachys has quit IRC21:39
*** dneary has quit IRC21:40
*** gszasz has quit IRC21:42
*** imcleod has quit IRC21:43
*** jistr has quit IRC21:47
*** jruzicka has quit IRC21:48
*** fragatina has joined #rdo21:48
*** fragatina has quit IRC21:50
*** jruzicka has joined #rdo21:50
*** fragatina has joined #rdo21:50
*** jistr has joined #rdo21:51
*** manous has quit IRC21:53
*** jruzicka has quit IRC21:56
*** jruzicka has joined #rdo21:57
*** imcleod has joined #rdo21:59
*** pradk has quit IRC22:00
*** jistr has quit IRC22:00
*** shivrao has quit IRC22:04
*** jruzicka has quit IRC22:04
*** ashw has quit IRC22:07
*** jistr has joined #rdo22:09
*** shivrao has joined #rdo22:10
*** jruzicka has joined #rdo22:10
*** elmiko is now known as _elmiko22:12
*** beekneemech is now known as bnemec-pto22:12
*** jistr has quit IRC22:19
*** iranzo has joined #rdo22:19
*** iranzo has quit IRC22:19
*** iranzo has joined #rdo22:19
*** jruzicka has quit IRC22:20
*** jruzicka has joined #rdo22:25
*** jistr has joined #rdo22:25
*** TicToc has quit IRC22:27
*** tumble has joined #rdo22:29
*** panda has quit IRC22:31
*** imcleod has quit IRC22:32
*** pnavarro has quit IRC22:32
*** TicToc has joined #rdo22:34
*** maeca1 has quit IRC22:39
*** imcleod has joined #rdo22:48
*** apetrich has quit IRC22:54
-openstackstatus- NOTICE: ok is now running Mediawiki 1.27.0; please let us know in #openstack-infra if anything seems wrong23:02
*** ChanServ changes topic to "ok is now running Mediawiki 1.27.0; please let us know in #openstack-infra if anything seems wrong"23:02
*** iranzo has quit IRC23:03
-openstackstatus- NOTICE: is now running Mediawiki 1.27.0; please let us know in #openstack-infra if anything seems wrong23:08
*** ChanServ changes topic to "RDO: An OpenStack Distribution for CentOS/Fedora/RHEL | Community meeting is held here every Wednesday at 15:00UTC | Please read our IRC community guidelines: | Logged at""23:08
*** imcleod has quit IRC23:13
*** harmw has quit IRC23:20
*** Ryjedo_ has joined #rdo23:25
*** Goneri has quit IRC23:26
*** saneax_AFK is now known as saneax23:26
*** saneax is now known as Guest4826923:27
*** Ryjedo has quit IRC23:29
*** Ryjedo_ is now known as Ryjedo23:29
*** rlandy has quit IRC23:29
*** trozet has quit IRC23:31
*** aortega has joined #rdo23:31
*** trozet has joined #rdo23:32
*** shivrao has quit IRC23:32
*** sdake has joined #rdo23:33
*** TicToc has quit IRC23:34
*** TicToc has joined #rdo23:36
*** Son_Goku has joined #rdo23:37
*** Son_Goku has quit IRC23:39
*** Kappa has joined #rdo23:43
*** Kappa has left #rdo23:43
*** aortega has quit IRC23:47
*** alexismonville has quit IRC23:52

Generated by 2.14.0 by Marius Gedminas - find it at!