Friday, 2015-07-03

*** patrickeast has quit IRC00:01
*** mtanino has quit IRC00:02
*** tsekiyam_ has joined #openstack-infra00:03
*** tqtran has quit IRC00:03
*** derekh has joined #openstack-infra00:03
*** tsekiyama has quit IRC00:06
*** otter768 has joined #openstack-infra00:07
*** tsekiyam_ has quit IRC00:08
*** derekh has quit IRC00:09
*** cathy_ has joined #openstack-infra00:09
*** dims__ has joined #openstack-infra00:10
*** vnod has quit IRC00:11
*** dims_ has quit IRC00:12
*** cathy_ has quit IRC00:12
*** StevenK has joined #openstack-infra00:13
openstackgerritMerged openstack-infra/project-config: Backward-compatible branch list for bindep element  https://review.openstack.org/19816600:13
*** Sukhdev has quit IRC00:14
jeblairfungi: ^00:15
*** SumitNaiksatam has quit IRC00:15
fungijeblair: thanks!00:15
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Don't fail to build cache on missing bindep lists  https://review.openstack.org/19817100:15
fungithat one i have no excuse for, other than not testing under set -e00:17
*** nadirvardar has joined #openstack-infra00:18
jeblairfungi: stdout is empty string in that case?00:19
fungijeblair: yep00:19
fungiso it didn't dawn on me that git show was also returning nonzero (128 in this case) when it did that00:20
fungii think i must have added set -e to the script after testing that00:21
*** koolhead17 has joined #openstack-infra00:21
*** nadirvardar has quit IRC00:21
*** devanand_ has quit IRC00:21
*** nadirvardar has joined #openstack-infra00:22
*** timrc_ has quit IRC00:24
*** yamamoto has joined #openstack-infra00:26
*** HeOS has quit IRC00:26
openstackgerritJames E. Blair proposed stackforge/gertty: Supply a default query on search  https://review.openstack.org/19817500:27
*** juggler has joined #openstack-infra00:28
*** otter768 has quit IRC00:30
fungiooh, just tested that and it's useful00:30
openstackgerritSpencer Krum proposed openstack-infra/puppet-iptables: Support side-loading iptables rules  https://review.openstack.org/19384700:30
funginibalizer: do you have an example invocation for that ^ or is it backward compatible with how we're using it now?00:32
fungilooks like it still takes the same classvars we're already using at least00:33
funginibalizer: ignore me, i see you updated the readme too. i'm set ;)00:34
nibalizerfungi: see readme00:35
nibalizerah yes00:35
nibalizerso in theory we can remove stuff like http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n230 and the 'groups' class can just ask for the ports to be open that it needs00:36
nibalizerfungi: id also apprecaite your feedback on https://review.openstack.org/#/c/167346/ if you're not too busy00:36
funginibalizer: sure, looking00:37
fungiooh, that's helpful00:37
jeblairmordred: i reviewed https://review.openstack.org/140840 !  i have a question about your clever attempt to root all our servers.00:39
funginibalizer: +2, it makes those job logs much more useful00:39
*** nadirvardar has quit IRC00:39
jeblairwhat's the centos6 status?00:40
greghaynesand he almost got away with it too...00:41
*** fbo has quit IRC00:42
*** mhu has quit IRC00:42
*** fbo has joined #openstack-infra00:42
fungijeblair: last i heard pabelanger confirmed that it's solved by updating to newer git package, however centos 6 epel has no such newer git package. ianw filed a bug about a regression he found with it which could be the underlying cause. i haven't looked at it again in the past couple days00:42
*** mhu has joined #openstack-infra00:42
jeblairfungi: it looks like the centos6 job is voting and fast...00:43
ianwjeblair: yeah, pabelanger is out doing whatever you do on canada day till next week00:43
fungioh, indeed it is voting again00:43
* fungi git blames00:43
jeblair"fungi blame" usually works!00:44
fungitrue enough00:44
ianwjeblair: i think the problem is -> https://bugzilla.redhat.com/show_bug.cgi?id=123739500:44
openstackbugzilla.redhat.com bug 1237395 in git "extremley slow https clone performance" [Unspecified,Assigned] - Assigned to pstodulk00:44
jeblair("jeblair blame" just prints "mordred" and exits)00:45
*** fitoduarte has quit IRC00:45
ianwalthough i'm wondering if something that's happened on the remote end recently with all the git changes might have triggered something00:45
fungijeblair: oh, you were probably looking at the same change i was, which ran that job before we made it non-voting00:46
ianwmaybe switching to git:// could be done quickly, which i haven't looked into?00:46
jeblairfungi: oh ok00:46
fungijeblair: also it's not always super slow. just often enough to cause problems00:46
fungiso that one was apparently lucky and completed in half the timeout00:46
jeblairianw: hrm, i thought we did that, but maybe we lost discipline and have started sliding back to https?00:46
fungiianw: pabelanger's tests indicated that http:// and git:// were a little faster than https:// but not at all on the order of the speed of a later git release00:47
jeblair(i mean, we've been struggling with this in some form for a year)00:47
mordredjeblair: oh - that should have a WIP on it00:47
morganfainbergjeblair: lol00:48
fungimordred: you mean a root password of foobar was just a placeholder?00:48
fungigranted, if your root password is foobar then probably so is your server...00:48
mordredfungi: it was for debugging00:48
jeblairactual change will set it to 's3cr3tpa55w0rd'00:48
mordredwhile we were hacking on glean00:48
morganfainbergfungi: hey, my root password is 1234500:48
mordredand got pushed up senselessly00:49
morganfainbergi mean *******00:49
asselinhave a good weekend. I'll be on vacation until next Tuesday!00:49
jeblairasselin: enjoY!00:49
ianwfungi: i have some packages ... i could pull them in and try; i know pabelanger had a change he was fiddling with, i'll tyr and fin dit00:49
fungihave a fun vacation asselin!00:49
*** teran has quit IRC00:49
mordredjeblair, SpamapS: btw - we can TOTALLY have ansible use sudo00:49
asselinthanks00:49
mordredI believe I shied away from that originally because there was a weird interaction between sudo, puppet and our mysql module00:49
fungiianw: it seemed like that job duration spiked way up on the same day that we patched glibc for the ghost vulnerability, but that could be entirely unrelated00:50
jeblairdoes that get us anything worthwhile?00:50
mordredjeblair: using sudo?00:50
mordredjeblair: I mean, in theory it allows us to set up something with the logging00:50
jeblair(sudo logging the commands i guess, but... meh)00:50
mordredyah00:50
jeblairmordred: yeah00:50
fungiianw: just wondering if something got bumped loose in that glibc update to cause git remote calls to intermittently hang for minutes at a time00:50
openstackgerritMerged openstack-infra/system-config: Print the node definition before apply test  https://review.openstack.org/16734600:50
jeblairnibalizer: ^00:51
ianwfungi: maybe, but you'd think someone else would notice00:51
*** ociuhandu has quit IRC00:51
fungiianw: sometimes i feel like we're the only people in the world using centos 6.x (i know that's far from reality, but...)00:52
jeblairi suspect this has been happening for a year, and the thing that has changed is that the number of refs has increased to the point that we are hitting our arbitrary timeout, but overall the process may have been gradual00:52
fungiianw: and i agree it seems like if it mucked with name resolution or socket handling enough to cause such a regression in git, it would have impacted other things as well00:52
jeblairlemme see if i can graphite that00:52
ianwfungi: so is this change going to test the changed job?00:52
openstackgerritMerged openstack-infra/project-config: Don't fail to build cache on missing bindep lists  https://review.openstack.org/19817100:52
ianw^ https://review.openstack.org/#/c/196761/200:53
fungijeblair: also likely the case00:53
fungiianw: no, 196761 is not self-testing though pabelanger had a separate throwaway change which was00:54
ianwright, that's the one i'm digging for...00:54
nibalizerjeblair: fungi neat00:54
fungiianw: https://review.openstack.org/195288 i think00:55
fungiyeah, that's definitely the one00:56
lifelessfungi: mordred: pretty please give us our daily constraints. https://review.openstack.org/#/c/194886/00:56
*** sdake has quit IRC00:56
ianwfungi: yep, ok, ... let me try with my packages.  if that fixes it, we can get that pushed and is probably the easiest way...00:56
*** sdake has joined #openstack-infra00:56
fungilifeless: also needs https://review.openstack.org/19812000:56
fungibefore the job will actually work00:56
lifelessfungi: no00:56
mordredlifeless: and forgive those who contraint against us?00:56
*** chlong has joined #openstack-infra00:56
lifelessfungi: thats the flip side00:57
lifelessfungi: this is making devstack vm gate runs *use it*00:57
lifelessfungi: the thing you're talking about is the nag job to stop constraints going stale.00:57
fungilifeless: er, right... we need 198120 before the proposal job will work00:57
lifelessmordred: if you're in a good mood :)00:57
*** davideagnello has quit IRC00:57
*** yamamoto has quit IRC00:58
fungiyep, the devstacklog.txt for that looks good01:00
fungiso much ===01:00
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Ensure tests run with ConfigParser object  https://review.openstack.org/17982201:02
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Take parameter order from yaml in trigger_parameterized_builds  https://review.openstack.org/19366001:02
mordredAJaeger_: where does this: http://developer.openstack.org/firstapp-libcloud/getting_started.html come from?01:03
tonybjhesketh: So I see the publish job ran and copied up the new calendars01:04
*** larainema has joined #openstack-infra01:04
tonybjhesketh: but they're still 404 possibly because of your apache review?01:04
jheskethtonyb: yep01:05
jheskethand I can confirm  they are on eavesdrop :-)01:05
tonybjhesketh: :)01:05
openstackgerritIan Wienand proposed openstack-infra/system-config: [DNM] centos6 git hangs  https://review.openstack.org/19817701:05
tonybjhesketh: at some point I'll have to work out how to remove files but that's a conversation for another day.01:05
jheskethtonyb: hmm, that's a good point01:06
tonybjhesketh: I had menat to pate in https://jenkins06.openstack.org/job/irc-meetings-publish/14/console01:06
jheskethtonyb: possibly the easiest way would be to define it in puppet to remove any files older than the mod time on the index.html01:06
tonybjhesketh: okay that could work.01:07
openstackgerritIan Wienand proposed openstack-infra/system-config: [DNM] centos6 git hangs  https://review.openstack.org/19817701:07
jheskethtonyb: hmm, does the target expect a folder01:07
tonybjhesketh: que?01:08
*** puranam__ has quit IRC01:08
mordredAJaeger_: I found it01:08
jheskethtonyb: that console output you just pasted failed to upload index.html and irc-meetings.ical... in he scp change I made I had set those as the target filenames, but perhaps target is just a directory and it only ever takes the source filename01:09
openstackgerritIan Wienand proposed openstack-infra/system-config: [DNM] centos6 git hangs  https://review.openstack.org/19817701:09
*** ayoung has joined #openstack-infra01:09
*** Longgeek has joined #openstack-infra01:10
*** baoli has joined #openstack-infra01:10
tonybjhesketh: Oh I see.01:10
openstackgerritMerged openstack-infra/elastic-recheck: Point out that non-voting jobs are skipped in the readme  https://review.openstack.org/19812701:11
*** mriedem has joined #openstack-infra01:14
*** madong_ has joined #openstack-infra01:14
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Fix ical scp upload  https://review.openstack.org/19818001:15
jheskethtonyb: ^01:15
*** dhellmann has quit IRC01:15
*** dhellmann has joined #openstack-infra01:15
*** jaypipes has quit IRC01:16
openstackgerritMerged openstack-infra/project-config: Create automated job for sample configuration files  https://review.openstack.org/17762001:17
ianwfungi / jeblair : https://review.openstack.org/#/c/198177/ <- what's the metric for success?  does it mostly fail or mostly pass?  i run it few a through rechecks01:18
*** larainema has quit IRC01:18
jeblairianw: istr it was glose to 50% earlier01:18
*** Longgeek has quit IRC01:18
jeblairclose01:18
*** mfisch has quit IRC01:20
*** woodster_ has quit IRC01:21
jeblairfungi, greghaynes: thoughts on https://review.openstack.org/190539 ?01:21
fungiianw: the symptom i was seeing is that a high frequency of jobs hit a random git remote operation which hangs for 10+ minutes. sometimes it hangs for most of the 30 minutes and times out. sometimes it hangs for just 10-15 and then resumes normally. sometimes it hangs for 10 or 15 minutes in a couple places and times out during the second hang01:21
fungijeblair: seems reasonable to me unless we want to try to make node-devstack capable of running independent of nodepool-base01:23
ianwfungi: alright; i'll keep rechecking and see.  if i see it, probably a good thing would be to replace /usr/bin/git with a shell script that runs it under strace01:23
openstackgerritMerged openstack-infra/project-config: Rename zaqar-milestone group in gerrit to zaqar-stable-maint  https://review.openstack.org/18802301:24
fungiianw: agreed. so far i've only been able to jump on machines where i see a job hung and attach strace to the git child process which is stuck. but at most i see it idling in a read on a socket or maybe a select poll loop if i'm lucky01:25
openstackgerritlifeless proposed openstack/requirements: Add location to requirement.Requirement  https://review.openstack.org/19818501:26
openstackgerritlifeless proposed openstack/requirements: Fix editing constraints files with urls in them.  https://review.openstack.org/19818601:26
*** asselin_ has joined #openstack-infra01:27
*** marcusvrn1 has joined #openstack-infra01:30
*** sigmavirus24 is now known as sigmavirus24_awa01:30
*** MarkAtwood has quit IRC01:31
*** wayneeseguin has quit IRC01:32
*** marcusvrn1 has quit IRC01:32
*** fitoduarte has joined #openstack-infra01:32
*** wayneeseguin has joined #openstack-infra01:32
*** gildub has quit IRC01:33
openstackgerritMerged openstack-infra/system-config: Alpha-sort modules.env  https://review.openstack.org/19124501:35
*** Qiming_ has joined #openstack-infra01:35
openstackgerritMerged openstack-infra/system-config: Bring in module to manage update-alternatives  https://review.openstack.org/17155601:37
*** sdake_ has joined #openstack-infra01:40
*** sdake has quit IRC01:43
openstackgerritMerged openstack-infra/devstack-gate: Switch to using constraints files.  https://review.openstack.org/19488601:44
*** ihrachyshka_ has joined #openstack-infra01:44
*** fallenpegasus has quit IRC01:44
*** _diana_ has joined #openstack-infra01:46
*** slagle has quit IRC01:47
jeblairfungi: are there other icehouse removal changes in flight?  https://review.openstack.org/19598201:47
*** slagle has joined #openstack-infra01:47
*** sdake_ has quit IRC01:49
*** dannywilson has joined #openstack-infra01:49
*** teran has joined #openstack-infra01:50
*** sdake has joined #openstack-infra01:51
*** ddieterly has quit IRC01:51
fungijeblair: pretty sure that change is a duplicate of one that merged in the past couple days01:51
*** ihrachyshka_ has quit IRC01:52
jeblairfungi: thought it might be01:52
fungijeblair: yeah https://review.openstack.org/197687 merged a day ago01:52
fungifor whatever reason 195982 didn't get bumped as a merge conflict01:52
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Clean up bindep invocation in cache-bindep element  https://review.openstack.org/19819101:54
fungiokay, with that ^ i completed ubuntu-trusty and centos-6 diskimages on nodepool.o.o01:54
*** teran has quit IRC01:54
fungiso that is a known-working state for nodepool image-build now01:55
*** ddieterly has joined #openstack-infra01:56
*** ihrachyshka_ has joined #openstack-infra01:57
fungiqcow2 images for each of those two are ~5gib01:59
openstackgerritMerged openstack-infra/project-config: Add project for Cisco UI (Horizon plugin)  https://review.openstack.org/19608701:59
*** ashleighfarnham has joined #openstack-infra01:59
*** madong_ is now known as larainema02:02
*** ihrachyshka_ has quit IRC02:02
*** camunoz_ has quit IRC02:02
*** Kennan has joined #openstack-infra02:02
*** Kennan2 has quit IRC02:03
lifelessKiall: so did you find that log for me ?02:04
*** gildub has joined #openstack-infra02:06
*** _diana_ has quit IRC02:07
*** whoops has quit IRC02:11
openstackgerritMerged openstack-infra/project-config: Switch rally-heat job to neutron from nova-network  https://review.openstack.org/19751502:11
ianwfungi / jeblair: so i've rechecked this about 7 times and it has worked -> https://review.openstack.org/198177 but ... http://dilbert.com/strip/2001-10-2502:11
*** yamahata has quit IRC02:14
openstackgerritMerged openstack-infra/project-config: Add functional test job to python-ironic-inspector-client  https://review.openstack.org/19757702:14
*** _diana_ has joined #openstack-infra02:14
jeblairianw: er, i was just about caught up on project-config changes.  now somehow i'm 14 years behind on dilbert02:14
*** fallenpegasus has joined #openstack-infra02:17
*** asselin_ has quit IRC02:19
fungijeblair: ianw: speaking of catching up on dilbert, i haven't read it in ages but this one crossed the crypto list last week and i got a chuckle http://dilbert.com/strip/2015-06-2102:19
*** puranamr has joined #openstack-infra02:20
*** puranamr_ has joined #openstack-infra02:21
openstackgerritMerged openstack-infra/project-config: Octavia: enable a voting py34 gate on master  https://review.openstack.org/19773202:21
fungilifeless: your e-mail says02:22
fungi"If you are raising a minimum version of a requirement, you need to also raise it in upper-constraints.txt."02:22
fungilifeless: should that have been raising a maximum version?02:22
clarkbfungi no if the min is higher than upper constraints thats a fail02:23
* fungi thought minimum versions were ending up in the as of yet implemented lower-constraints.txt02:23
fungier, as of yet unimplemented02:23
clarkbbasically you cant move min ir max beyond that end of upper constraints02:24
openstackgerritMerged openstack-infra/project-config: Skip py26 for oslo.versionedobjects  https://review.openstack.org/19781402:24
openstackgerritMerged openstack-infra/project-config: Make amqp1 check voting again  https://review.openstack.org/19791702:24
*** fallenpegasus has quit IRC02:24
fungiclarkb: that makes sense, though perhaps i didn't squint quite enough at the text between the lines02:24
*** annegentle has joined #openstack-infra02:25
*** puranamr has quit IRC02:25
fungias written, it implies that any time you increase a minimum, regardless of whether it's still less than the upper constraint, you need to raise the upper constraint (and to what version in that case?)02:25
*** puranamr_ has quit IRC02:26
fungiraising your maximum version seems like it would necessitate raising the corresponding upper constraint however02:26
*** annegentle has quit IRC02:27
openstackgerritMerged openstack-infra/project-config: Revert "puppet: disable voting for beaker/centos7 jobs"  https://review.openstack.org/19816702:30
*** otter768 has joined #openstack-infra02:31
*** laughterwym_ has joined #openstack-infra02:31
jeblairfungi, tonyb, jhesketh: https://review.openstack.org/19818002:31
fungijeblair: not if they're insistent on having some files in a calendars subtree02:33
*** gyee has quit IRC02:33
jeblairfungi: are you saying it would flatten?02:34
*** laughterwym has quit IRC02:34
*** thorst has joined #openstack-infra02:34
fungieither the scp publisher is instructed to preserve the hierarchy (in which case it preserves it all, including the "output" prefix dir and you need a dance like i did for the specs-prep macro) or you let it flatten and then you can't put some in a subdirectory02:34
fungioptionally, we could accept the output prefix getting created and adjust all our symlinks in puppet accordingly02:35
*** otter768 has quit IRC02:35
fungiwhich is probably the cleanest solution02:35
jeblairoh, rlight, only ftp has remove-prefix02:35
*** _diana_ has quit IRC02:37
jeblairfungi: i'm okay with either; i'll change my vote to a +202:37
*** _diana_ has joined #openstack-infra02:38
*** mhu has quit IRC02:38
*** yamamoto has joined #openstack-infra02:38
fungiyeah, the options are all terrible and involve working around the scp publisher plugin's behaviors02:39
lifelessfungi: we need to write a manual for this02:39
lifelessfungi: its on my todo to find our existing docs and expand on them02:39
lifelessfungi: but as clarkb says, raising lowers is indeed correct02:40
fungilifeless: when you do find our existing docs, let me know02:40
*** hdd has quit IRC02:40
lifelessfungi: :/02:40
fungilifeless: i thought lower constraints was basically the highest of the lower version bounds across the aggregate set, and upper constraints was the lowest of the upper version bounds across the aggregate set02:41
*** julim has joined #openstack-infra02:41
lifelessfungi: we haven't done lower-cosntraints yet02:42
lifelessfungi: raising a minimum above the pinned version in any of the constraints files we have has to be illegal02:42
*** mfisch has joined #openstack-infra02:42
*** mfisch is now known as Guest6154802:42
fungiso best case, if all repos were in sync with global requirements, then for some requirement>=x,<=y we'd have x in the lower constraints list and y in the upper constraints list02:42
clarkbnot quite, constraints reflects the dep solver resolved max today02:43
fungilifeless: right, but raising a minimum and not raising it above the upper constraint still needs you to raise the upper constraint? and if so, then to what do you raise it if it's already higher?02:43
clarkbmin should be the solved min02:43
lifelessfungi: no, that is indeed a nuance02:43
lifelessfungi: I was aiming for 'don't surprise people' rather than 'the entire manual' :) - your understanding is more complete than my email.02:43
fungilifeless: most of the raises of minimums i see to global requirements in the past have not raised the minimum above the prior maximum (especially since we often didn't declare maximums)02:44
fungiso it doesn't seem like a corner-case nuance02:44
lifelessfungi: it may indeed be a very common nuance02:44
lifeless'be willing to raise' would have been better prose02:44
lifelessnevertheless02:44
fungigot it. i understand now, just be prepared for others to similarly misinterpret and thing they always need to raise the upper constraint but not have any idea what to raise it to02:45
fungis/thing/think/02:45
*** _diana_ has quit IRC02:45
fungiour global requirements enforcement (and requirements handling and pbr and python packaging in general) is already dark magic to most of the people who are submitting changes to global requirements02:46
*** mhu has joined #openstack-infra02:47
jheskethjeblair: yeah what fungi said... I toyed with placing everything inside another sub folder and updating the symlinks, but I thought having 3 separate uploads was neater since we have 3 separate symlinks anyway (so they kind of match)02:47
fungilifeless: oh, as for where our documentation of the current stuff is, i think http://git.openstack.org/cgit/openstack/requirements/tree/README.rst represents the bulk of what we have02:48
*** _diana_ has joined #openstack-infra02:48
lifelessfungi: yeah, I've edited that before, but I feel its kindof undiscoverable02:48
fungithere's more there than i remembered. i'm glad people continued to flesh it out02:48
fungiand yep, we can toss in some sphinx boilerplate and link the readme into that and add a normal publishing job for it02:49
lifelessI'm thinking link from the infra developing-on-openstack guide for instance02:49
jeblairjhesketh: cool, feel free to aprv then02:49
lifeless+ the so-you-want-to-release-something docs02:49
*** _diana_ has quit IRC02:50
fungisection the first: "be afraid... be VERY afraid"02:50
jheskethjeblair: thanks, done02:50
*** teran has joined #openstack-infra02:51
jeblairi have cleared my project-config queue02:51
jeblair\o/02:51
fungijeblair: i am envious02:51
jheskethnice work!02:51
*** baoli has quit IRC02:52
jheskethby the way, are many people planning on attending either of the LinuxCon's this season?02:52
lifelessjhesketh: LinuxCon ?02:52
fungijhesketh: i am not. full dance card already02:52
jeblair120 changes down, 594 to go02:52
jheskethlifeless: http://events.linuxfoundation.org/events/linuxcon-north-america or http://events.linuxfoundation.org/events/linuxcon-europe02:53
lifelessah02:54
lifelessthanks :)02:54
lifelesssome folk call LCA a linuxcon02:55
lifelessand that confuses me, so I seek clarity02:55
*** teran has quit IRC02:56
*** bhunter71 has quit IRC02:56
*** thorst has quit IRC02:56
jheskethlifeless: fair enough :-)02:57
jheskethjeblair: is there a reason you didn't +A 19613002:57
*** Longgeek has joined #openstack-infra02:59
openstackgerritMerged openstack-infra/project-config: Fix ical scp upload  https://review.openstack.org/19818002:59
*** jogo has quit IRC03:00
*** jogo has joined #openstack-infra03:00
jeblairjhesketh: wanted more people to see stackforge project gerrit branch acl configuration happening03:02
*** baoli has joined #openstack-infra03:02
*** baoli has quit IRC03:02
jeblairlca and linuxcon could not be more different03:03
lifelessyeah03:03
jheskethwell the difference is only 3 characters ;-) 'fau'03:04
*** rlandy has joined #openstack-infra03:04
jeblairi mean, i guess one could be about post-modern literary criticism... no that's actually still less different03:04
jheskethlol03:06
*** hogepodge has quit IRC03:06
tonybjeblair: Thanks03:08
*** rlandy has quit IRC03:09
lifelessjhesketh: five letters03:11
lifelessjhesketh: adfut03:11
* Clint squints.03:13
jheskethlifeless: eh?03:14
*** kiran-r has joined #openstack-infra03:15
*** Longgeek has quit IRC03:16
*** BharatK has quit IRC03:16
fungijeblair: taron has expounded on the reasons for submitting 197376 (the project must be compiled building from source before deploying). i guess a hidden step in the spec for this was "determine how we want to deploy go projects from source"03:16
jeblairfungi: maybe step 2 is hook it into the deb packaging system, but maybe step 1 is write some puppet to checkout, compile, and install on host?03:22
jeblairtaron: ^03:22
jeblair(and all that would be triggered by a vcsrepo update)03:23
*** _diana_ has joined #openstack-infra03:23
fungiagreed. that's lighter weight than maintaining a fork just for the sake of having a build solution. i don't find compiling on the server where we're deploying distasteful. especially since it'll be running on its own server anyway03:24
*** _diana_ has quit IRC03:26
jeblairfungi: taron left that and another suggestion in gerrit03:28
jeblairmy plane is fixin to land; 'night03:29
fungienjoy your transition from your airborne office to your home-based office03:29
fungiassuming you're getting home any time soon!03:29
lifelessjhesketh: linux DOT conf DOT au03:30
lifelessjhesketh: O is common, d and t are unique :)03:30
fungilinux dot matrix03:31
jeblairthat's where i think i'm heading at least03:31
*** asselin_ has joined #openstack-infra03:33
*** julim has quit IRC03:36
*** koolhead17 has quit IRC03:37
*** SumitNaiksatam has joined #openstack-infra03:42
*** harlowja_at_home has joined #openstack-infra03:46
*** yamada-h has joined #openstack-infra03:47
*** Qiming_ has quit IRC03:47
*** Qiming_ has joined #openstack-infra03:47
*** samueldmq has quit IRC03:48
*** dalgaaf has quit IRC03:48
*** ericksonsantos has quit IRC03:48
*** coolsvap|away is now known as coolsvap03:48
* taron makes mental note to start opening cygwin at login03:49
Clintdoes that help?03:50
*** hogepodge has joined #openstack-infra03:51
*** yamada-h has quit IRC03:51
*** teran has joined #openstack-infra03:51
*** dims__ has quit IRC03:52
*** harlowja_at_home has quit IRC03:56
*** hogepodge has quit IRC03:56
taronI don't know enough about either option to have a preference, though at a quick glance I'm liking the vcsrepo idea better03:56
* taron will probably find something to install from source on their laptop later since it's managed with puppet anyway03:57
*** teran has quit IRC03:57
*** heyongli has quit IRC03:57
*** heyongli has joined #openstack-infra03:58
fungiyeah, while puppet may _seem_ like a bit of complication to exec the compilation and installation of some software, triggering builds on ephemeral job workers, autopublishing them to a repository and then reconsuming them via puppet is well into rube goldberg machine territory04:00
*** hogepodge has joined #openstack-infra04:00
fungiwe do it for gerrit because we have (more that we had) little other choice. we're working toward eventually not needing to do that04:01
*** baoli has joined #openstack-infra04:03
*** hogepodge has quit IRC04:05
taronyeah, I thought it seemed a little odd when nibz suggested it but I don't really have any kind of background in CI/etc to know any better. it ended up being a really good intro to how zuul configuration and so on works though.04:05
nibalizeri thought it was clewned04:06
nibalizerer cleaner04:06
*** achanda has joined #openstack-infra04:06
nibalizersince exec { 'build': }04:06
taronI'm not totally convinced there's any such thing as a clean install from source04:06
nibalizeris super gross04:07
*** baoli has quit IRC04:07
taronbasically seems like choice of gross at this point04:08
*** hogepodge has joined #openstack-infra04:08
Clintyou should totally get it into debian while choosing04:08
*** ddieterly has quit IRC04:10
*** kiran-r has quit IRC04:10
*** hdd has joined #openstack-infra04:12
*** Longgeek has joined #openstack-infra04:13
nibalizerlol04:14
*** ashleighfarnham has quit IRC04:14
*** Longgeek has quit IRC04:15
*** Longgeek has joined #openstack-infra04:15
*** Longgeek has quit IRC04:16
*** kiran-r has joined #openstack-infra04:17
*** Longgeek has joined #openstack-infra04:17
*** hogepodge has quit IRC04:17
*** Alexandra_ has joined #openstack-infra04:18
*** esmute__ has quit IRC04:20
*** achanda_ has joined #openstack-infra04:21
*** kiran-r has quit IRC04:22
fungii'm not sure why compiling the application on the server where you'll run it is any less gross than a bunch of automation to compile it somewhere else and copy it around04:23
fungiunless you actually plan to actively redistribute the compiled version04:23
*** achanda has quit IRC04:24
*** hogepodge has joined #openstack-infra04:25
tchaypofungi: if anything I think it’s more gross; some people stridently object to having compilers on production machines04:27
*** yamada-h has joined #openstack-infra04:27
*** achanda_ has quit IRC04:29
fungiwow. what unix do you hail from? ;)04:30
*** yamada-h has quit IRC04:31
Clintit's in a bunch of security standards04:31
*** otter768 has joined #openstack-infra04:31
fungiyes, i remember them04:32
fungistill not quite sure what removing cc from your server does to protect you against anything, if you've got several language interpreters that do jit (or no compilation at all) with access to the same04:33
*** mrmartin has joined #openstack-infra04:33
*** otter768 has quit IRC04:36
*** sdake_ has joined #openstack-infra04:39
*** spzala has joined #openstack-infra04:41
*** Longgeek has quit IRC04:42
*** Longgeek has joined #openstack-infra04:42
*** sdake has quit IRC04:43
*** amotoki has joined #openstack-infra04:46
*** spzala has quit IRC04:50
*** Longgeek has quit IRC04:50
*** BharatK has joined #openstack-infra04:50
*** Longgeek has joined #openstack-infra04:51
*** teran has joined #openstack-infra04:53
*** esmute__ has joined #openstack-infra04:53
ianwfungi: do you have examples to hand of where that centos6 job hangs?  i can't replicate it, but i really don't see how the change i identified would modify the behaviour of git:// protocol, which i *think* it uses04:56
*** teran has quit IRC04:59
fungiianw: sure, here's one where the apply log went silent for 22 minutes before the job timed out and was killed http://logs.openstack.org/91/198191/1/check/gate-infra-puppet-apply-centos6/7d45cd7/console.html#_2015-07-03_02_24_32_52104:59
*** dannywilson has quit IRC05:01
*** dannywilson has joined #openstack-infra05:01
ianwfungi: ok, how do you know git was hung from that log?05:02
ianwthe puppet call returned, but git was left in the bg?05:04
*** heyongli has quit IRC05:05
fungiianw: not sure on that exact one, but on the ones where i've caught them in progress and logged in, there's been a git child process with a start time of roughly when the log went silent05:05
*** heyongli has joined #openstack-infra05:05
ianwfungi: alright, well looking at the logs more closely it seems we have a lot of instances of git://... and https:// mixed in.  so i feel better that maybe it's hanging on a https clone05:06
*** Longgeek has quit IRC05:10
*** ddieterly has joined #openstack-infra05:11
*** Longgeek has joined #openstack-infra05:12
openstackgerritSteve Kowalik proposed openstack-infra/project-config: Do not call sys.exit inside ZanataUtils  https://review.openstack.org/19821805:13
*** deepakcs has joined #openstack-infra05:14
*** ddieterly has quit IRC05:15
*** shashank_hegde has quit IRC05:17
openstackgerritSteve Kowalik proposed openstack-infra/project-config: Add Zanata support for manuals projects  https://review.openstack.org/19822105:21
*** Longgeek has quit IRC05:24
openstackgerritSteve Kowalik proposed openstack-infra/project-config: Add Zanata support for openstack-manuals projects  https://review.openstack.org/19822105:24
*** Longgeek has joined #openstack-infra05:24
*** ayoung has quit IRC05:25
*** _nadya_ has joined #openstack-infra05:26
*** fbo has quit IRC05:26
*** _nadya_ has quit IRC05:32
*** hdd has quit IRC05:40
*** mrmartin has quit IRC05:45
*** Alexandra_ has quit IRC05:46
*** teran has joined #openstack-infra05:49
*** igor____ has joined #openstack-infra05:50
*** igor___ has quit IRC05:53
*** fawadkhaliq has joined #openstack-infra05:54
*** fawadk has joined #openstack-infra05:55
*** Alexandra_ has joined #openstack-infra05:55
*** fitoduarte has quit IRC05:56
*** fawadkhaliq has quit IRC05:58
*** Kennan has quit IRC06:02
*** baoli has joined #openstack-infra06:02
*** Kennan has joined #openstack-infra06:02
*** Alexandra_ has quit IRC06:03
*** laughterwym_ has quit IRC06:04
*** baoli has quit IRC06:07
*** _nadya_ has joined #openstack-infra06:09
*** SumitNaiksatam has quit IRC06:09
*** SumitNaiksatam has joined #openstack-infra06:10
*** heyongli has quit IRC06:14
*** mrunge has joined #openstack-infra06:15
*** heyongli has joined #openstack-infra06:15
*** jtomasek has joined #openstack-infra06:19
*** mrunge has quit IRC06:19
*** gmann has quit IRC06:22
*** mrunge has joined #openstack-infra06:24
*** oomichi has joined #openstack-infra06:25
*** oomichi has quit IRC06:25
openstackgerritSteve Kowalik proposed openstack-infra/project-config: Add a register-zanata-projects.py script  https://review.openstack.org/19823606:26
*** achanda has joined #openstack-infra06:29
*** camunoz has quit IRC06:32
*** otter768 has joined #openstack-infra06:32
*** rossella_s has quit IRC06:36
*** otter768 has quit IRC06:37
*** rossella_s has joined #openstack-infra06:37
*** ddieterly has joined #openstack-infra06:41
*** laughterwym has joined #openstack-infra06:43
*** ddieterly has quit IRC06:46
*** scheuran has joined #openstack-infra06:47
*** armax has quit IRC06:48
*** HeOS has joined #openstack-infra06:49
*** mpavlase has joined #openstack-infra06:50
*** Ala has joined #openstack-infra06:51
*** dims_ has joined #openstack-infra06:53
*** dims_ has quit IRC06:58
*** dguitarbite has joined #openstack-infra07:03
*** akscram has quit IRC07:06
*** dguerri` has quit IRC07:10
*** dguerri` has joined #openstack-infra07:10
*** SumitNaiksatam has quit IRC07:10
*** jkt has quit IRC07:10
*** jokke_ has quit IRC07:10
*** med_ has quit IRC07:10
*** dguerri` is now known as dguerri07:10
*** scheuran has quit IRC07:10
*** yamamoto has quit IRC07:10
*** leseb has quit IRC07:10
*** afazekas has quit IRC07:10
*** davidlenwell has quit IRC07:10
*** jeblair has quit IRC07:10
*** akscram has joined #openstack-infra07:11
*** coolsvap is now known as coolsvap|away07:11
*** soren has joined #openstack-infra07:11
*** achanda_ has joined #openstack-infra07:11
*** jokke__ has joined #openstack-infra07:11
*** jkt_ has joined #openstack-infra07:11
*** SumitNaiksatam_ has joined #openstack-infra07:11
*** med_` has joined #openstack-infra07:11
*** jeblair_ has joined #openstack-infra07:11
*** SumitNaiksatam_ is now known as SumitNaiksatam07:11
*** dguerri has quit IRC07:11
*** dguerri has joined #openstack-infra07:11
*** afazekas has joined #openstack-infra07:11
*** BharatK has quit IRC07:11
*** ianw has quit IRC07:11
*** lennyb has quit IRC07:11
*** yamamoto has joined #openstack-infra07:11
*** achanda has quit IRC07:11
*** leseb has joined #openstack-infra07:11
*** lennyb has joined #openstack-infra07:11
*** BharatK has joined #openstack-infra07:11
*** ianw has joined #openstack-infra07:11
*** scheuran has joined #openstack-infra07:11
*** mrunge_ has joined #openstack-infra07:11
*** davidlenwell has joined #openstack-infra07:12
*** achanda has joined #openstack-infra07:12
*** achanda_ has quit IRC07:14
*** kushal has quit IRC07:14
*** ildikov is now known as ildikov_afk07:15
*** gildub has quit IRC07:16
*** BharatK has quit IRC07:16
*** coolsvap has joined #openstack-infra07:24
*** coolsvap has quit IRC07:25
*** dtantsur|afk is now known as dtantsur07:25
openstackgerritSteve Kowalik proposed openstack-infra/project-config: Add a register-zanata-projects.py script  https://review.openstack.org/19823607:26
*** coolsvap|away is now known as coolsvap07:26
*** ParsectiX has joined #openstack-infra07:28
*** mpavone has joined #openstack-infra07:28
*** BharatK has joined #openstack-infra07:29
*** dteselkin has quit IRC07:32
*** niedbalski_ has quit IRC07:32
*** tsufiev has quit IRC07:32
*** leseb has quit IRC07:32
*** andreaf has quit IRC07:32
*** leseb has joined #openstack-infra07:32
*** bnemec has quit IRC07:32
*** mugsie has quit IRC07:32
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: stackforge/{anchor,bandit} -> openstack/{anchor,bandit}  https://review.openstack.org/19767307:33
*** _afazekas has joined #openstack-infra07:33
*** e0ne has joined #openstack-infra07:33
*** ParsectiX_ has joined #openstack-infra07:33
*** bauzas is now known as bauwser07:33
*** fhubik has joined #openstack-infra07:33
*** niedbals- has joined #openstack-infra07:33
*** andreaf_ has joined #openstack-infra07:33
*** chlong has quit IRC07:33
*** dteselkin_ has joined #openstack-infra07:33
*** mugsie_ has joined #openstack-infra07:33
*** tsufiev_ has joined #openstack-infra07:33
*** doude has joined #openstack-infra07:33
*** markus_z has joined #openstack-infra07:33
*** andreaf_ is now known as andreaf07:33
*** fhubik has quit IRC07:33
*** fhubik has joined #openstack-infra07:33
*** markus_z has quit IRC07:33
*** markus_z has joined #openstack-infra07:33
*** ParsectiX has quit IRC07:33
*** afazekas has quit IRC07:33
*** bnemec has joined #openstack-infra07:33
*** samuelBartel has joined #openstack-infra07:34
*** marcusvrn has quit IRC07:34
*** koolhead17 has joined #openstack-infra07:34
*** laughterwym has quit IRC07:35
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add jhesketh to accessbot  https://review.openstack.org/19698307:35
*** laughterwym has joined #openstack-infra07:35
*** e0ne has quit IRC07:36
*** dannywilson has quit IRC07:36
dtantsurhey folks! ironic-inspector-release https://review.openstack.org/#/admin/groups/978,members was initialized empty after https://review.openstack.org/#/c/198008/07:37
dtantsurwhat should I do to add myself into it?07:37
dtantsurwe're close to release, but currently we can't do it :(07:38
dtantsuranteaya, from our chat I thought it will be fine ^^07:38
*** jlanoux has joined #openstack-infra07:38
*** jistr has joined #openstack-infra07:39
*** coolsvap is now known as coolsvap|afk07:39
*** jcoufal has joined #openstack-infra07:41
*** ddieterly has joined #openstack-infra07:42
*** jcoufal_ has joined #openstack-infra07:42
*** arxcruz has joined #openstack-infra07:44
*** esmute__ has quit IRC07:44
*** madong has joined #openstack-infra07:44
*** jcoufal has quit IRC07:46
*** dguerri has quit IRC07:48
*** openstackstatus has quit IRC07:49
*** madong has quit IRC07:50
openstackgerritMerged openstack-infra/project-config: Don't apply strict parsing rules to stable branches.  https://review.openstack.org/19815107:50
*** ddieterly has quit IRC07:50
*** madong has joined #openstack-infra07:50
*** dguerri has joined #openstack-infra07:50
*** madong has quit IRC07:50
*** madong has joined #openstack-infra07:50
*** dguerri is now known as dguerri`07:50
*** larainema is now known as madong_07:50
*** fawadk has quit IRC07:51
*** openstackstatus has joined #openstack-infra07:51
*** ChanServ sets mode: +v openstackstatus07:51
*** madong is now known as larainema07:51
openstackgerritMerged openstack-infra/project-config: Add new project: puppet-refstack  https://review.openstack.org/18243707:51
*** madong_ is now known as madong07:53
*** ParsectiX_ has quit IRC07:54
openstackgerritMerged openstack-infra/project-config: Create a puppet module for os_client_config  https://review.openstack.org/18889507:54
openstackgerritMerged openstack-infra/project-config: Adding doc gate jobs for openstack/defcore  https://review.openstack.org/18995607:54
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Don't run periodic stable jobs for Icehouse  https://review.openstack.org/19598207:55
*** madong has quit IRC07:56
openstackgerritMerged openstack-infra/project-config: Call sudo pip /w -H diskimage-builder-install macro  https://review.openstack.org/19776707:59
*** Hal has joined #openstack-infra07:59
*** dtantsur is now known as dtantsur|brb07:59
*** Hal is now known as Guest7317008:00
*** cdent has joined #openstack-infra08:00
*** laughterwym has quit IRC08:01
*** laughterwym has joined #openstack-infra08:02
openstackgerritMerged openstack-infra/project-config: Switch constraints proposal to use branch-git-prep  https://review.openstack.org/19812008:03
*** binbincong has quit IRC08:03
openstackgerritMerged openstack-infra/project-config: Clean up bindep invocation in cache-bindep element  https://review.openstack.org/19819108:04
*** HeOS has quit IRC08:04
*** k4n0 has joined #openstack-infra08:05
*** fhubik is now known as fhubik_afk08:06
*** rossella_s has quit IRC08:09
*** derekh has joined #openstack-infra08:10
*** mrunge_ has quit IRC08:11
*** ParsectiX_ has joined #openstack-infra08:11
*** rossella_s has joined #openstack-infra08:12
*** heyongli has quit IRC08:13
*** heyongli has joined #openstack-infra08:14
*** teran has quit IRC08:19
*** derekh has quit IRC08:19
*** derekh has joined #openstack-infra08:20
*** _nadya_ has quit IRC08:21
*** yamada-h has joined #openstack-infra08:28
openstackgerritLukasz Zajaczkowski proposed openstack-infra/project-config: added project stackforge/monasca-log-api  https://review.openstack.org/19459508:30
*** _nadya_ has joined #openstack-infra08:32
*** notnownikki has joined #openstack-infra08:32
*** yamada-h has quit IRC08:32
*** fhubik_afk is now known as fhubik08:33
*** otter768 has joined #openstack-infra08:33
*** mpavlase has quit IRC08:34
*** afazekas has joined #openstack-infra08:37
*** otter768 has quit IRC08:38
zigolifeless: The requirements for fixtures are wrong, it expects a higher version of pbr.08:40
*** haypo has joined #openstack-infra08:41
haypohi. a test is failing gate-glance-python27 but i'm unable to reproduce the issue on my Fedora 22. the test looks to depend on the filesystem, which may be /tmp08:42
hayposo it probably depends on /tmp is mounted. or it's maybe just related to my change. or it's a race condition08:42
haypowell, i would like to know if it's ok to add run system commands like find, mount, df, etc. in an unit test just to debug the issue?08:42
*** ddieterly has joined #openstack-infra08:43
openstackgerritWitold Bedyk proposed openstack-infra/project-config: added project stackforge/monasca-log-api  https://review.openstack.org/19459508:43
zigohaypo: I think we should release a new version of sqla-migrate, named 1.0.x, so that we tell the world it supports sqla 1.0.6.08:44
haypozigo: hum ok. sorry, i'm not involved in the sqlalchemy-migrate project, i cannot help you on that08:47
*** ddieterly has quit IRC08:47
*** binbincong has joined #openstack-infra08:48
haypozigo: FYI i have two pending patches for sqlalchemy-migrate: https://review.openstack.org/#/c/174734/ & https://review.openstack.org/#/c/174738/08:48
Odd_BlokeCould I potentially get another pair of eyes on https://review.openstack.org/#/c/191081/? I'd love to have our coverage checks running. :)08:48
openstackgerritVictor Stinner proposed openstack-infra/project-config: Make gate-sqlalchemy-migrate-python34 voting  https://review.openstack.org/19826608:48
*** hichihara has quit IRC08:52
*** john-davidge has joined #openstack-infra08:53
*** john-davidge_ has joined #openstack-infra08:56
*** jcoufal_ has quit IRC08:57
*** mpavone has quit IRC08:57
*** john-davidge has quit IRC08:57
*** john-davidge_ is now known as john-davidge08:57
*** openstackgerrit has quit IRC08:57
*** openstackgerrit has joined #openstack-infra08:58
*** k4n0 has quit IRC08:58
*** mpavone has joined #openstack-infra09:00
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: temprevert heat : Add a new crypt method using cryptography  https://review.openstack.org/19798509:00
*** mpavone has quit IRC09:02
*** heyongli has quit IRC09:03
*** heyongli has joined #openstack-infra09:04
*** robcresswell has joined #openstack-infra09:05
*** jcoufal has joined #openstack-infra09:05
*** mpavone has joined #openstack-infra09:06
*** kushal has joined #openstack-infra09:06
*** jokke__ is now known as jokke_09:06
haypook, so i added my debug commands to https://review.openstack.org/19791609:06
haypo=> https://review.openstack.org/#/c/197916/6/glance/tests/unit/test_image_cache.py09:07
haypoand now something completly different. gate-tempest-dsvm-neutron-src-oslo.utils failed on https://review.openstack.org/#/c/198026/ : devstack failed on09:07
haypo+ /opt/stack/new/requirements/.venv/bin/edit-constraints /opt/stack/new/requirements/upper-constraints.txt -- keystone '-e /opt/stack/new/keystone'09:07
haypo... pkg_resources/__init__.py", line 2917, in parse_requirements09:07
haypopkg_resources.RequirementParseError: Missing distribution spec /opt/stack/new/oslo.utils09:07
haypodid someone already seen this error?09:07
haypoi don't understand the error :-(09:08
*** e0ne has joined #openstack-infra09:08
robcresswellHey all, sorry to bug again. My project patch was merged ( https://review.openstack.org/#/c/196087/ ) and I was wondering if someone could add me to the relevant core and release teams ( https://review.openstack.org/#/admin/groups/?filter=horizon-cisco-ui ). Thanks!09:08
haypolifeless: ^^ maybe you?09:08
*** fawadkhaliq has joined #openstack-infra09:09
*** HeOS has joined #openstack-infra09:10
*** koolhead17 has quit IRC09:12
*** jcoufal has quit IRC09:12
lifelesszigo: how so ?09:14
lifelesshaypo: yes, patches are up for that09:14
lifelesshaypo: in devstack + requirements09:14
lifelesshaypo: one failed CI and I haven't dug into it yet09:15
*** jcoufal has joined #openstack-infra09:16
*** yamada-h has joined #openstack-infra09:17
*** pelix has joined #openstack-infra09:20
*** doude has quit IRC09:21
*** doude has joined #openstack-infra09:24
openstackgerritAndrey Pavlov proposed openstack-infra/project-config: Add non-voting Sahara grenade job for upgrades testing  https://review.openstack.org/19707609:25
*** yamada-h has quit IRC09:27
openstackgerritDawid Malinowski proposed openstack-infra/jenkins-job-builder: Add support for OWASP Dependency-Check Plugin  https://review.openstack.org/17960409:31
*** tsufiev_ is now known as tsufiev09:32
*** achanda_ has joined #openstack-infra09:35
*** marzif_ has joined #openstack-infra09:37
*** achanda has quit IRC09:38
*** mpavone has quit IRC09:39
*** achanda has joined #openstack-infra09:39
*** achanda_ has quit IRC09:42
*** mpavone has joined #openstack-infra09:43
*** ddieterly has joined #openstack-infra09:44
*** ddieterly has quit IRC09:48
openstackgerritDawid Malinowski proposed openstack-infra/jenkins-job-builder: Add support for Artifactory plugin  https://review.openstack.org/17393209:49
*** yamamoto has quit IRC09:50
*** igor____ has quit IRC09:55
*** BharatK has quit IRC09:58
*** yamamoto has joined #openstack-infra09:58
*** BharatK has joined #openstack-infra09:59
*** tmorin has joined #openstack-infra10:03
tmorinI've lots of issues on jenkins jobs not passing, on a Neutron related project10:04
tmorinissues like git clone failing, IOErrors10:04
tmorinI guess this is known and being fixed/investigated, but I wanted to check10:05
*** alex_xu has quit IRC10:06
*** hughsaunders has quit IRC10:07
*** hughsaunders has joined #openstack-infra10:07
*** alex_xu has joined #openstack-infra10:07
*** SpamapS has quit IRC10:09
*** SpamapS has joined #openstack-infra10:09
*** k4n0 has joined #openstack-infra10:11
*** fhubik is now known as fhubik_afk10:11
*** blaedd has quit IRC10:12
*** blaedd has joined #openstack-infra10:13
*** sgordon has quit IRC10:14
*** sdake_ has quit IRC10:14
*** alex_xu has quit IRC10:15
*** alex_xu has joined #openstack-infra10:15
openstackgerritEkaterina Chernova proposed openstack/requirements: Exclude yaql 0.3.0 from requirements  https://review.openstack.org/19697710:16
*** Qiming_ has quit IRC10:16
*** blaedd has quit IRC10:17
*** sgordon has joined #openstack-infra10:18
*** jlanoux_ has joined #openstack-infra10:18
*** jlanoux has quit IRC10:18
*** blaedd has joined #openstack-infra10:19
*** leseb has quit IRC10:22
*** SergeyLukjanov has quit IRC10:22
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Support offset/limit pagination in the API  https://review.openstack.org/19829710:22
*** leseb- has joined #openstack-infra10:23
*** SergeyLukjanov2 has joined #openstack-infra10:23
*** SergeyLukjanov2 is now known as SergeyLukjanov10:23
*** k4n0 has quit IRC10:24
*** k4n0 has joined #openstack-infra10:24
*** dims_ has joined #openstack-infra10:25
*** ociuhandu has joined #openstack-infra10:27
*** yamada-h has joined #openstack-infra10:27
*** yamamoto has quit IRC10:31
*** yamada-h has quit IRC10:32
*** otter768 has joined #openstack-infra10:34
*** claudiub has joined #openstack-infra10:35
*** baoli has joined #openstack-infra10:36
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Support offset/limit pagination in the API  https://review.openstack.org/19829710:36
*** rossella_s has quit IRC10:37
*** rossella_s has joined #openstack-infra10:37
*** koolhead17 has joined #openstack-infra10:38
*** tmorin has quit IRC10:38
*** otter768 has quit IRC10:39
*** ildikov_afk has quit IRC10:39
*** fhubik_afk is now known as fhubik10:40
*** baoli has quit IRC10:41
*** ddieterly has joined #openstack-infra10:45
*** claudiub has quit IRC10:46
*** kushal has quit IRC10:46
*** kushal has joined #openstack-infra10:49
*** ddieterly has quit IRC10:49
openstackgerritMarkus Zoeller (markus_z) proposed openstack-infra/release-tools: launchpad: Add script to clean up bug inconsistencies  https://review.openstack.org/19706010:50
*** dtantsur|brb is now known as dtantsur10:54
*** marcusvrn has joined #openstack-infra10:54
*** robcresswell has quit IRC11:07
*** ociuhandu has quit IRC11:07
*** ildikov has joined #openstack-infra11:09
*** yamamoto has joined #openstack-infra11:11
*** achanda has quit IRC11:13
*** BharatK has quit IRC11:15
*** achanda has joined #openstack-infra11:15
*** dizquierdo has joined #openstack-infra11:15
*** robcresswell has joined #openstack-infra11:16
robcresswellHello. Is there anybody specifically to speak to about adding cores to a new project?11:17
*** samueldmq has joined #openstack-infra11:19
ttxrobcresswell: any infra-core should be able to seed the initial group11:23
ttxhttps://review.openstack.org/#/admin/groups/306,members11:24
*** fawadkhaliq has quit IRC11:24
*** fawadkhaliq has joined #openstack-infra11:25
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Show story list rather than landing page by default  https://review.openstack.org/19831911:28
*** achanda has quit IRC11:29
*** Guest73170 has quit IRC11:29
*** pal has joined #openstack-infra11:32
*** ociuhandu has joined #openstack-infra11:34
markus_zanteaya: http://lists.openstack.org/pipermail/openstack-infra/2015-June/002850.html11:34
markus_zanteaya: I finally found the people behind this mail.11:34
markus_zanteaya: You asked me 3 weeks ago to contact them.11:34
markus_zanteaya: It seems that they understood the provided information and the CI will work soon.11:35
*** radez is now known as radez_g0n311:37
openstackgerritAndrey Kurilin proposed openstack-infra/project-config: Use in-tree devstack plugin to fix rally gates  https://review.openstack.org/19832011:39
*** tmorin has joined #openstack-infra11:39
*** heyongli has quit IRC11:39
*** heyongli has joined #openstack-infra11:40
*** ldnunes has joined #openstack-infra11:43
openstackgerritAndrey Kurilin proposed openstack-infra/project-config: Use in-tree devstack plugin to fix rally gates  https://review.openstack.org/19832011:44
*** ddieterly has joined #openstack-infra11:45
*** dguerri` is now known as dguerri11:46
*** ddieterly has quit IRC11:50
*** deepakcs has quit IRC11:50
openstackgerritEvgeny Antyshev proposed openstack-infra/zuul: show reconfiguration failures  https://review.openstack.org/14892611:50
SergeyLukjanovrobcresswell, hey, I could add you to the gerrit group, what's you gerrit user id?11:53
*** ericksonsantos has joined #openstack-infra11:53
SergeyLukjanovrobcresswell, and group you'd like to join :)11:53
*** jaypipes has joined #openstack-infra11:54
*** pal has quit IRC11:54
*** gordc_afk has quit IRC11:55
openstackgerritMerged openstack-infra/tripleo-ci: temprevert heat : Add a new crypt method using cryptography  https://review.openstack.org/19798511:56
*** ildikov has quit IRC11:59
*** eantysh9 has quit IRC11:59
*** eantyshev has joined #openstack-infra12:00
openstackgerritMarc Koderer proposed openstack-infra/project-config: Activate devstack plugin for Murano  https://review.openstack.org/19832512:00
*** ildikov has joined #openstack-infra12:00
*** liam_ has joined #openstack-infra12:01
*** liam_ is now known as Guest3011812:01
*** k4n0 has quit IRC12:03
*** gordc has joined #openstack-infra12:03
*** Guest30118 has quit IRC12:03
*** gordc has quit IRC12:04
*** heyongli has quit IRC12:04
*** gordc has joined #openstack-infra12:05
*** heyongli has joined #openstack-infra12:06
*** hashar has joined #openstack-infra12:06
openstackgerritMerged openstack-infra/jenkins-job-builder: Add Parameterized Remote Trigger Plugin support.  https://review.openstack.org/15032712:08
*** e0ne is now known as e0ne_12:08
*** hdd has joined #openstack-infra12:08
*** rfolco has joined #openstack-infra12:08
*** marzif__ has joined #openstack-infra12:10
*** e0ne_ is now known as e0ne12:12
*** dprince has joined #openstack-infra12:12
*** Qiming has joined #openstack-infra12:12
openstackgerritMark McLoughlin proposed openstack-infra/project-config: OpenStack Foundation Transparency Policy project  https://review.openstack.org/17964812:12
openstackgerritMerged openstack-infra/jenkins-job-builder: Adding disableArchiveOutput option in Robot Framework Plugin  https://review.openstack.org/18734312:13
openstackgerritMerged openstack-infra/jenkins-job-builder: Support for more options in gerrit plugin and doc cleanup.  https://review.openstack.org/19661012:13
*** marzif_ has quit IRC12:13
*** igor___ has joined #openstack-infra12:14
dtantsurSergeyLukjanov, hi! not sure if you're the right person, but I'll try :) yesterday new ironic-inspector-release group was created in https://review.openstack.org/#/c/198008/ but it's empty. Could you initialize it with me please?12:14
SergeyLukjanovdtantsur, yup12:14
dtantsurthnx!12:14
SergeyLukjanovdtantsur, what's your gerrit id?12:15
dtantsurSergeyLukjanov, it's username, right? dtantsur. email divius.inside at gmail12:15
SergeyLukjanovdtantsur, done12:15
dtantsurSergeyLukjanov, thanks!12:16
openstackgerritMerged openstack-infra/jenkins-job-builder: Support for post-step-run-condition in Maven projects  https://review.openstack.org/19166812:16
openstackgerritMerged openstack-infra/jenkins-job-builder: Add support for the Naginator Plugin  https://review.openstack.org/17936612:17
*** aysyd has joined #openstack-infra12:18
*** madong has joined #openstack-infra12:18
openstackgerritMerged openstack-infra/jenkins-job-builder: Adding support for LiveScreenshot Plugin  https://review.openstack.org/19170812:18
*** mpaolino has joined #openstack-infra12:19
*** claudiub has joined #openstack-infra12:19
openstackgerritFatih Degirmenci proposed openstack-infra/jenkins-job-builder: Add Google Cloud Storage Plugin support  https://review.openstack.org/19239712:19
*** madong has quit IRC12:19
openstackgerritFatih Degirmenci proposed openstack-infra/jenkins-job-builder: Add Disable Failed Job Plugin support  https://review.openstack.org/19272012:20
*** madong has joined #openstack-infra12:21
openstackgerritVictor Stinner proposed openstack-infra/project-config: Make gate-sqlalchemy-migrate-python34 voting  https://review.openstack.org/19826612:21
*** larainema has quit IRC12:22
*** madong is now known as larainema12:23
*** fawadkhaliq has quit IRC12:25
*** e0ne_ has joined #openstack-infra12:25
*** coolsvap|afk is now known as coolsvap|away12:27
*** e0ne has quit IRC12:28
fungirobcresswell: i've added you as the initial member of the groups for horizon-cisco-ui12:28
fungiSergeyLukjanov: i took it from the author/committer e-mail of the change that added that project12:28
*** larainema has quit IRC12:29
*** larainema has joined #openstack-infra12:29
*** claudiub has quit IRC12:31
*** jasondotstar has joined #openstack-infra12:33
*** otter768 has joined #openstack-infra12:35
*** wznoinsk has quit IRC12:38
*** fawadkhaliq has joined #openstack-infra12:39
*** wznoinsk has joined #openstack-infra12:39
*** otter768 has quit IRC12:40
*** mase_x200 has joined #openstack-infra12:43
*** thorst has joined #openstack-infra12:44
*** hogepodge has quit IRC12:46
*** ddieterly has joined #openstack-infra12:46
*** hogepodge has joined #openstack-infra12:48
*** Longgeek has quit IRC12:49
*** Longgeek has joined #openstack-infra12:49
*** fawadkhaliq has quit IRC12:50
*** ddieterly has quit IRC12:51
*** koolhead17 has quit IRC12:52
*** markvoelker has quit IRC12:53
*** hdd has quit IRC12:53
EmilienMfungi: thanks for your help on centos7 thing12:53
*** claudiub has joined #openstack-infra12:54
EmilienMI'm happy to see the job green again12:54
fungiEmilienM: of course, and i'm sorry for the complication there. this time i can at least blame puppet for being weird, even if it's not from a puppet module you maintain ;)12:54
EmilienMahah12:55
EmilienMno problem at all12:55
EmilienMfungi: I would like to highlight a series of 3 patches, starting from https://review.openstack.org/#/c/197216/12:55
fungithe pip package provider unnecessarily upgrading dependencies but only when you ensure => 'latest' was a bit of a surprise12:55
EmilienMI understand why our image was not fresh :)12:56
*** markvoelker has joined #openstack-infra13:00
*** niedbalski has quit IRC13:00
*** niedbalski has joined #openstack-infra13:00
*** jaypipes is now known as leakypipes13:01
*** larainema has quit IRC13:01
*** larainema has joined #openstack-infra13:01
openstackgerritDawid Malinowski proposed openstack-infra/jenkins-job-builder: Adding publisher support to join-trigger plugin  https://review.openstack.org/17883613:04
mordredEmilienM: https://review.openstack.org/#/c/197218/5 does not do what your commit message says13:05
*** e0ne has joined #openstack-infra13:05
mordredEmilienM: it says "non-voting job" and then "dont run on stable" - but instead it's a voting job that is non-voting on stable13:05
EmilienMmordred: I might have done wrong but I want: 1/ do not run the job on stable  branch 2/ do not vote at all, ever never13:06
*** thorst has quit IRC13:07
*** mriedem has quit IRC13:07
*** e0ne_ has quit IRC13:08
openstackgerritMerged openstack-infra/project-config: puppet: refactorize puppet-syntax job  https://review.openstack.org/19721613:08
mordredEmilienM: oh! wait - i think I read something wrong13:10
mordredEmilienM: you're right.13:10
*** peristeri has joined #openstack-infra13:11
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Rename Puppet jobs to avoid word duplication  https://review.openstack.org/19834713:12
EmilienMmordred: no prob13:12
*** nzeer has quit IRC13:12
*** nzeer has joined #openstack-infra13:12
EmilienMmordred: this one ( https://review.openstack.org/198347 ) is for nibalizer and https://twitter.com/nibalizer/status/61605459894024192013:12
*** puranamr has joined #openstack-infra13:13
EmilienMmordred: thx for reviews btw13:14
*** Longgeek_ has joined #openstack-infra13:14
*** Longgeek_ has quit IRC13:15
*** Longgeek has quit IRC13:15
*** madong_ has joined #openstack-infra13:16
*** larainema has quit IRC13:16
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Rename Puppet jobs to avoid word duplication  https://review.openstack.org/19834713:16
*** Longgeek has joined #openstack-infra13:16
*** dboik has joined #openstack-infra13:16
openstackgerritMerged openstack-infra/project-config: puppet: add puppet-unit-latest job  https://review.openstack.org/19721813:16
*** DericHorn-HP has joined #openstack-infra13:18
*** DericHorn-HP has quit IRC13:18
*** dboik has quit IRC13:20
*** mpavone has quit IRC13:20
openstackgerritVictor Stinner proposed openstack-infra/project-config: Move gate-keystone-python34 to check  https://review.openstack.org/19835013:21
openstackgerritMerged openstack-infra/project-config: puppet: do not run beaker/upgrade jobs on old branches  https://review.openstack.org/19721913:22
robcresswellttx, SergeyLukjanov, fungi, thanks for your help13:29
openstackgerritEric Harney proposed openstack-infra/project-config: Add experimental Cinder job for LIO  https://review.openstack.org/19807913:31
*** blaedd has quit IRC13:31
*** blaedd has joined #openstack-infra13:33
*** kir has joined #openstack-infra13:34
*** ZZelle has quit IRC13:42
*** ZZelle has joined #openstack-infra13:42
*** jlanoux has joined #openstack-infra13:45
*** ddieterly has joined #openstack-infra13:47
*** amotoki has quit IRC13:47
*** jlanoux_ has quit IRC13:48
*** jasondotstar has quit IRC13:50
*** achanda has joined #openstack-infra13:51
*** ddieterly has quit IRC13:51
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Remove unneeded patches  https://review.openstack.org/19835613:52
*** ddieterly has joined #openstack-infra13:57
*** ParsectiX_ has quit IRC13:58
*** puranamr has quit IRC14:00
*** puranamr has joined #openstack-infra14:01
EmilienMfungi, mordred: with puppet-syntax refacto, I've spotted new issues in modules. I might come up with a patch to make non-voting something14:03
haypohi. i have an issue on glance tests: a test fails because / is mounted with noatime: https://bugs.launchpad.net/glance/+bug/147124314:04
openstackLaunchpad bug 1471243 in Glance "Test on the xattr image cache fails because of noatime" [Undecided,New]14:04
haypodoes anyone know if the setup of the OS where gate-glance-python27 is running changed recently?14:04
*** ericksonsantos has quit IRC14:05
*** samueldmq has quit IRC14:05
*** fbo- has joined #openstack-infra14:06
*** puranamr_ has joined #openstack-infra14:06
*** otter768 has joined #openstack-infra14:07
*** ericksonsantos has joined #openstack-infra14:07
*** puranamr has quit IRC14:09
*** samueldmq has joined #openstack-infra14:11
freerunnerHi folks! We need your help. Our murano-gates blocked. =( Here the fix. Please, review it.. https://review.openstack.org/#/c/196977/14:12
fungihaypo: is _shouldn't_ have, but we reuse base images made available by our service providers so we don't always know when they subtly change something (like filesystem mount options maybe?)14:12
haypofungi: i'm interested by the noatime mount option for the root fs (/)14:13
mordredhaypo, fungi: we DO in fact know that rackspace 'helpfully' changed the kernel boot options on base images recently - so it's not crazy to think they may have changed root mount options14:14
haypofungi: it looks like *sometimes*, it has atime, sometimes noatime...14:14
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Add check-ironic-inspector-dsvm-nv to Ironic experimental pipeline  https://review.openstack.org/19838114:14
haypomordred: oh. so maybe VM booted some times ago may have different mount options?14:14
*** puranamr has joined #openstack-infra14:14
fungifreerunner: interesting. looks like the yaql authors "hid" 0.3 on the pypi browsing ui but it's still the latest non-beta release. the hide option probably doesn't do what they expect14:14
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet/syntax: do not export FUTURE_PARSER  https://review.openstack.org/19838214:15
EmilienMfungi: ^14:15
EmilienMfungi: source: https://github.com/gds-operations/puppet-syntax/issues/4214:15
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet/syntax: do not export FUTURE_PARSER when Puppet > 3  https://review.openstack.org/19838214:16
haypomordred, fungi : if don't cannot control the atime flag, we may skip the test if the FS is mounted with noatime. this bug may block the development of glance :-/14:16
*** sdake has joined #openstack-infra14:16
*** fhubik has quit IRC14:17
*** sdake_ has joined #openstack-infra14:17
*** puranamr_ has quit IRC14:17
fungihaypo: bingo14:17
fungihaypo: in hpcloud... /dev/vda1 on / type ext4 (rw)14:18
fungihaypo: in rackspace... /dev/xvda1 on / type ext4 (rw,noatime,errors=remount-ro,barrier=0)14:18
fungihaypo: so noatime may or may not be set on the root filesystem depending on where your job runs14:18
fungimordred: haypo: in good news, our new ubuntu-trusty images are booting instances with... /dev/something on / type ext4 (rw,errors=remount-ro)14:20
*** sdake has quit IRC14:21
*** madong_ is now known as larainema14:21
EmilienMmordred, the puppet-syntax refacto broke our CI but I have a fix : https://review.openstack.org/198382 ( source : https://github.com/gds-operations/puppet-syntax/issues/42 )14:21
EmilienMmordred: my bad...14:21
fungimordred: haypo: but it seems that rackspace has helpfully set noatime on their base images (because they live in last decade? or they haven't heard of relatime?)14:21
EmilienMfriday == troll day :)14:22
haypofungi: "because they live in last decade?" hehe14:22
*** sdake_ is now known as sdake14:22
fungihaypo: anyway, any unit tests which depend on your local filesystem options don't sound like unit tests to me. that's a pretty serious isolation issue14:22
haypofungi: noatime is faster! ;)14:22
*** _diana_ has joined #openstack-infra14:23
haypofungi: well, that was my first (hidden) question. is it an infra issue or a glance issue? :)14:23
*** Hal has joined #openstack-infra14:23
fungiif glance has a functional testsuite, it's likely better to relocate things like that there14:23
*** Hal is now known as Guest2761314:23
haypofungi: ok. but a functional test can requires a specific mount option to the infra?14:24
fungiyou'd have full root access to do things like `sudo mount -oatime,remount /`14:24
*** scheuran has quit IRC14:25
haypooh. i didn't know that14:25
fungiat least i'm pretty sure an on-the-fly remount can toggle atime-related mount options for live filesystems14:25
fungilet's call it an exercise left to the reader14:25
haypoi don't know if the test pass with relatime14:26
fungiyeah, which is why i suggested just atime14:26
haypoi remember a nie article on the new "fast atime" option, i don't recall if it was relatime or a new one14:26
haypohttps://lwn.net/Articles/621046/ ?14:27
*** robcresswell has left #openstack-infra14:27
fungihaypo: man 8 mount14:27
fungihaypo: search down to the relatime entry in the options section14:28
haypofungi: no, it's a new one. maybe called "lazytime". i was merged recently in the kernel14:28
haypoit* was14:28
haypo(i'm not part of the kernel -yet-)14:29
*** yamahata has joined #openstack-infra14:29
fungihaypo: basically in linux 2.6.30 the default behavior switched to relatime. before that it used what's now called strictatime (which was a lot more of an i/o performance hit, and why they switched)14:29
haypook, it's lazytime, introduced in Linux 4.0 -- http://kernelnewbies.org/Linux_4.0#head-3e847edbcf4c617048c905b6972979f7bb7547a314:29
fungiso in short, if the test works without noatime, then it's using relatime14:29
fungiin reality your unit test job _could_ be modified to run something like that before it revokes sudo access and executes your normal job payload, but still that doesn't seem like you should have filesystem mount option expectations in your "unit" tests14:30
*** dizquierdo has quit IRC14:30
*** achanda has quit IRC14:31
*** sdake has quit IRC14:31
fungii'm guessing you're in need of some sort of filesystem mock14:31
ttxmordred: just posted episode 2 of my Phabricator adventures.14:34
mordredttx: woot!14:34
ttxI'm slightly worried by what I mention in my "additional note"14:35
*** _diana_ has quit IRC14:35
mordredttx: when you say posted ... to where?14:35
ttxopenstack-infra list14:35
fungiis that the one where captain phab publishes a maniphesto?14:35
mordredoh my14:35
* mordred takes fungi's keyboard away from him14:35
fungimordred: i have another!14:35
ttxI like Wikimedia using the work "phabbing" now for tracking things into Phabricator14:35
ttxword14:36
haypofungi: thanks for your help14:36
mordredzoikes! I'd have gotten away with it if it wasn't for you meddling kids14:36
fungittx: if we do that before we start using it, that would be a pre-phab14:36
mordredttx: ah! there it is14:36
ttxI'm starting to think we could model repo and branches using Phab "projects" if we keep them under control the way Wikimedia does14:36
*** Guest27613 has quit IRC14:36
*** rossella_s has quit IRC14:36
*** rossella_s has joined #openstack-infra14:37
mordredttx: nod. also - since "projects" get a kanban - it probably should go through at least a mild amount of thought14:38
hasharhello :-}14:38
mordredttx: the triaging thing is an interesting one14:38
fungibranch-specific kanbans. that's an ...odd... thought14:38
*** linkedinyou has joined #openstack-infra14:39
ttxyeah, it's pretty deeply rooted in Phab UI approach, and I don't see how we can escape creating a default triaging team14:39
mordredfungi: well, I imagine those would give ignored for normal branches - although a feature branch kanban might actually even make sense14:39
fungihashar: so maniphest is working out well in wikiland?14:39
mordredlike, "feature/erasure-codes"14:39
mordredttx: one the one hand, nobody might do it14:39
ttxmordred: from my experience, default triaging teams never work14:39
ttxmordred: like when you file a bug against "Ubuntu" in Launchpad14:40
ttxalso known as /dev/null14:40
mordredttx: on the other hand, it might open up a new opportunity for people in companies to be involved where they otherwise could not be14:40
hasharfungi: yeah that is a large improvement over bugzilla.  and has bring us the wall of cards :-D   Some teams previously used Trello14:40
mordredttx: yah. but ubuntu didn't have the "we have 2000 companies filled with people trying to figure out how to contribute upstream" problem we have14:40
mordredttx: so - my gut tells me you're right14:40
mordredttx: but also, maybe for us it's different? /me winces14:41
hasharmost of our Phabricator  / bug process  people are in the mailing list team practices  ( https://lists.wikimedia.org/mailman/listinfo/teampractices ) . Feel free to poke people there14:41
ttxmordred: on the plus side, that allows to file issue against "OpenSTack". On the bad side, we kinda don't want bugs filed against "OpenStack".14:42
funginice. quite a few phabricator-in-the-trenches threads on that mailing list14:42
*** r-daneel has joined #openstack-infra14:42
mordredttx: yah. well - it _is_ useful for the people who file bugs and don't know what they are a bug in14:43
mordredttx: they currently tend tofile those against infra14:43
ttxright, that's the plus side14:43
hasharfungi: yup.  And different teams have different process.  We are still experimenting.14:43
mordredttx: and maybe it'll force the issue of getting more thinking about openstack as a thing, rather than nova as a thing14:43
EmilienMsorry for asking again, can we have a quick review to unblock puppet ci ? https://review.openstack.org/#/c/198382/14:43
ttxwe went in circles about that when we discussed Storyboard "no task" stories14:43
fungittx: bugs filed against "OpenStack" can redirect your browser to ask.openstack.org ;)14:43
hasharfungi: the team I am part of has a team board which only has epic tasks / high level tasks.  Then we have a tag per project and we do weekly triages for each projects14:44
ttxfungi: well that's the thing... there is no "against"14:44
ttxfungi: you file a PhabTask14:44
ttxand pray it falls onto someones pile14:44
*** e0ne is now known as e0ne_14:44
ttxhashar: I really like how you kept projects under control14:45
ttxalso your work on security stuff will save us a lot of time14:45
*** puranamr_ has joined #openstack-infra14:45
hasharwe have been very liberal in creating new tags14:45
ttxright, but still enforcing.. style.14:45
*** e0ne_ is now known as e0ne14:46
hasharyeah cause tag creation is only made by a handful of people. That helps to avoid a bazaar or identify potentially similar tags14:46
ttxhashar: I'm all for being liberal. Ideally Phabricator would have different policy based on icon/color14:46
mordredttx: so with projects/tags repos/branches - are you thinking like a "openstack-nova" tag and an "openstack-nova-juno" tag?14:46
ttxso that random people could craete random tags14:46
mordredttx: or an openstack-nova tag and a juno tag?14:46
ttxmore the latter14:47
ttxthose tags would be used for search / categoriziation14:47
mordredso a tag per repo, a tag per branch14:47
ttxthen you could in theory have a "nova-stable" tag taht would be a team thing14:47
ttxwhich makes the color / icon coding so important14:47
mordredand then tags for whichever other arbitrary buckets get requested14:47
hasharand we even have a Sprint extension for phabricator that let you assign points to cards and limit the number of points in a column. Example for a project quaterly goal board: https://phabricator.wikimedia.org/tag/visualeditor_2015_16_q1_blockers/14:47
hasharthat one is a sprint workboard14:48
ttxhashar: don't try to spread Agile glue onto my ski slope14:48
*** puranamr has quit IRC14:48
hasharhehe14:48
hasharit is just a potential use case :-}  Nothing enforces it14:48
hasharsome projects just rely on priorities + assignements14:49
*** sslypushenko has quit IRC14:49
ttxmordred: the worst case is the security issue, since it triggers multiple projects and multiple branches14:49
mordredyah14:49
ttxbasically if we use branch and project, they can't really list affected project/branches14:49
*** tmorin has left #openstack-infra14:49
mordredttx: intereting - looking at hashar's link above - it almost seems like each approved spec might want a project/tag14:49
mordredlike, if you look at this page: https://phabricator.wikimedia.org/project/sprint/profile/1297/14:50
hasharI think we migrated a good six months ago. And at first we had no idea how to organize our tags / work boards.14:50
ttxbasically you want to be able to say "to solve this security issue we need to backport stuff to nova/kilo; nova/juno; glance/juno; horizon/master14:50
openstackgerritMerged openstack-infra/project-config: puppet/syntax: do not export FUTURE_PARSER when Puppet > 3  https://review.openstack.org/19838214:51
hasharbut we can probably organize some chat with the folks in charge at WMF or some product manager that uses it daily14:51
ttxyou REALLY don't want the tool to help you make one fall in the cracks14:51
mordredttx: good point14:51
ttxYou could use the description and strike out stuff there, but that would be a bit of a fail14:51
ttxyou could create one subtask per backport and tag there14:51
fungiyeah, i'm solidly -1 on semantically-significant description fields14:52
fungibecause nobody will get them right14:52
ttxbut then unless you force yourself to use words in description that duplicate the tags... it's nontrivial to see what is what from the parent task14:52
hasharttx: in this case you can have a task for each backporting activity.  The parent task will have  'security-backport' and four sub tasks with labels (nova, kilo)  (nova, juno), (glance, juno) (horizon,master).   This way you can assign each sub tasks to appropriate people and they enter the projects triage column14:52
ttxWe /could/ patch Phab so that the "projects" are displayed on the depended-on tasklists14:52
fungihashar: i think the problem is being able to query those though14:53
hasharor you can use checkboxes lists ( rather long example: https://phabricator.wikimedia.org/T86659 )14:53
*** puranamr has joined #openstack-infra14:53
ttxor at least the repo and branch "projects"14:53
hasharfungi: yeah that depends what you need to see14:53
haypofungi, mordred : i summarized our discussion in https://bugs.launchpad.net/glance/+bug/1471243 - i will investigate the "mock atime in the unit test" option14:53
openstackLaunchpad bug 1471243 in Glance "Test on the xattr image cache fails because of noatime" [Undecided,New]14:53
haypothanks14:53
*** haypo has left #openstack-infra14:53
ttxmordred: since I left the VMT I'm no longer the main consumer of this use case, happy to defer to fungi / tristanC and let them find an acceptable way to use Phab to track their tasks14:54
ttxbut I would hate if the switch made their lives more miserable14:54
*** koolhead17 has joined #openstack-infra14:54
fungihashar: ideally we could have hierarchical tag-like structures, but i'm guessing we can work around it with flat tags14:54
ttxPhab is supposed to introduce "parent projects" but it's still essentially flat structure14:55
*** puranamr_ has quit IRC14:57
ttxfungi: my patch ends up doing that: http://phabricator.disorder.xyz/T114:57
fungilike, say i want a slice of open security vulnerability reports which need backports to stable/juno branches of any repo. i guess if each repo+branch is a project and we have metadata that splits those values, then we can do something like that without needing tags14:57
ttxI use a "repository" custom field, and then the patch makes it display as a prefix in the task title14:58
ttxuseful to see at a glance from the parent task what repo is affected14:58
ttxand what tasks are remaining14:58
funginice domain btw ;)14:58
ttxyeah, I might keep this one. Was a free .xyz I got14:59
ttxso we could use kind of the same patch and display the "projects" there14:59
*** tmorin has joined #openstack-infra14:59
tmorinhi14:59
ttx(like if they match repo or branch projects14:59
ttx)14:59
tmorinNeutron jobs, at least on my project, seem broken15:00
tmorine.g. http://logs.openstack.org/89/198389/1/check/gate-networking-bgpvpn-pep8/8ce8006/console.html15:00
ttxthat way we don't really need to separate repo/branch from "projects" concept15:00
*** jraim has quit IRC15:00
tmorin Running setup.py develop for neutron:  [...] error in setup command: 'install_requires' [...] Expected version spec in pywin32;sys_platform=='win32' at ;sys_platform=='win32'15:00
*** markvoelker has quit IRC15:00
*** jraim has joined #openstack-infra15:00
tmorinanyone has an idea ?15:00
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Revert "temprevert heat : Add a new crypt method using cryptography"  https://review.openstack.org/19839215:00
tmorinI guess this is not specific to my changes15:01
tmorinany idea fungi ? anteaya ?15:02
fungitmorin: no, it's probably something unusual going on in your tox.ini that doesn't work with the newer requirements lists that contain environment markers. i'm seeing if i can spot any obvious offender15:03
*** Ala has quit IRC15:03
*** Ala has joined #openstack-infra15:03
tmorinfungi: thanks15:04
fungitmorin: i think it's likely related to the deps = -egit+https://git.openstack.org/openstack/neutron#egg=neutron15:04
*** Ala has quit IRC15:04
fungitmorin: oh, you have pbr>=0.6,!=0.7,<1.015:04
fungiin your requirements.txt15:05
tmorinfungi: ok15:05
fungitmorin: i think your requirements and test-requirements lists need updating as a first step15:05
fungii'll see if upping the pbr cap takes care of this15:06
tmorinfungi: what is the typical correct requirement for pbr ?15:06
tmorinfungi: thakns15:06
*** puranamr_ has joined #openstack-infra15:08
openstackgerritMerged openstack-infra/tripleo-ci: Revert "temprevert heat : Add a new crypt method using cryptography"  https://review.openstack.org/19839215:08
tmorinfungi: sorry for the dumb question: are you actually trying something, or suggesting me to up the pbr requirement and retry ?15:08
fungitmorin: look in the openstack/requirements repo's global-requirements.txt file15:08
*** puranamr has quit IRC15:10
*** achanda has joined #openstack-infra15:10
fungitmorin: aha, i think that error message ultimately means that the virtualenv in which tox is trying to `setup.py develop` that neutron git clone has a setuptools too old to grok the environment markers in neutron's requirements lists15:11
fungitmorin: but also having your jobs unconditionally git clone neutron over the network every time they run is fragile and could stand to be fixed15:12
*** dprince has quit IRC15:13
fungitmorin: anyway, i'm relatively convinced that updating the requirements in your repo to be more inline with what's in the global-requirements.txt will make this particular issue go away15:13
fungitmorin: also we have a job that can be added for that repo to automatically propose requirements updates to it, so you don't have to track the openstack/requirements repo and try to figure out changes by hand15:14
*** maxandersen has quit IRC15:15
*** cdent has quit IRC15:16
tmorinfungi: ok, I'll update the pbr requirement15:16
tmorinfungi: for the neutron clone at each test, yes, it had occurred to me that this wasn't great -- is there a documented alternative ?15:17
tmorinfungi: I can also look what other neutron-related projects are doing15:17
tmorinfungi: interested to have more information on the job to check requirements15:18
*** jcoufal has quit IRC15:18
fungitmorin: i think some of the other neutron subprojects are solving it by optionally using zuul-cloner to take advantage of a local git cache when available15:18
*** esmute__ has joined #openstack-infra15:18
*** yamamoto has quit IRC15:18
*** hashar has quit IRC15:18
fungii'm hunting down an example now15:19
*** koolhead17 has quit IRC15:19
fungitmorin: look in openstack/neutron-lbaas15:19
fungitmorin: you'll see in their tox.ini they use an install_command which is a wrapper script around pip15:20
fungitmorin: and if you have a peek in that tools/tox_install.sh wrapper they're using, you'll see if will use zuul-cloner to clone from a local cache if available, or else will clone over the network like before15:21
fungispecifically for installing their neutron dependency from source15:22
*** achanda has quit IRC15:22
fungitmorin: dougwig may be able to answer additional questions about that solution15:22
fungitmorin: as for the requirements sync proposal job, you turn it on for your repo by adding a line to the projects.txt file in the openstack/requirements repo15:23
tmorinfungi: thanks, I'm now looking into mimicing that15:23
*** afazekas has quit IRC15:26
*** bnemec has quit IRC15:27
*** yamamoto has joined #openstack-infra15:28
*** bnemec has joined #openstack-infra15:28
*** mase_x200 has quit IRC15:29
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Replace open() with io.open() and force 'utf-8'  https://review.openstack.org/18348815:31
anteayamarkus_z: thank you for following up on that, glad they finally understand15:31
*** puranamr has joined #openstack-infra15:31
*** puranamr has quit IRC15:32
*** davideagnello has joined #openstack-infra15:33
anteayadtantsur: yes, that was my expectation that you should be included in that group15:33
*** Qiming has quit IRC15:33
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Wrap file objects with codecs to handle unicode  https://review.openstack.org/18393915:33
*** puranamr_ has quit IRC15:35
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Upgrade virtualenv to 13.1.0  https://review.openstack.org/19840915:35
fungilifeless: mordred: jeblair_: clarkb: ^15:35
dtantsuranteaya, it's fixed now anyway, sorry for disturbing :)15:36
anteayadtantsur: yes I see, not a disturbance, happy you are all set15:36
*** armax has joined #openstack-infra15:36
tmorinfungi: thanks a lot for your help15:36
openstackgerritThomas Morin proposed openstack/requirements: Add networking-bgpvpn to projects.txt  https://review.openstack.org/19841115:36
tmorinthe pbr fix seems to have solved the first problem15:37
fungitmorin: you're welcome15:37
*** tmorin has left #openstack-infra15:37
*** viktors is now known as viktors|afk15:38
*** tmorin has joined #openstack-infra15:38
tmorinfungi: one last question, my requirements change does not seem to merge, despite a workflow+1   https://review.openstack.org/#/c/198399/15:40
tmorinfungi: is this because some jenkins jobs are failing, or shall I just be a bit more patient ?15:40
fungitmorin: it's failing gate-networking-bgpvpn-python2715:41
tmorinfungi: yes, for a reason totally unrelated to pbr etc,  the failure is due to a change in Neutron that breaks our project15:42
tmorinfungi: a fix for that is in another change, that change can't pass either because of the pbr issue15:42
fungitmorin: you'll need to squash the two patches into one change15:42
tmorinfungi: shall I do change that depend on one another ?15:42
tmorinfungi: ok15:42
fungitmorin: just update the larger change to also include your requirements update15:42
fungiand then abandon the separate requirements update change15:43
tmorinfungi: ok, that looks simple15:43
tmorinfungi: out of curiosity, is this the only way, or would there be a cleaner way if I wanted to keep all those patches separated15:43
*** yfried__ has quit IRC15:44
fungitmorin: not really, no. each pass needs to be able to pass all voting jobs on its own to merge. this is a safety to prevent you from merging a broken change (from the perspective of your jobs) and then fixing it in a later change, which means that your repository is in a broken state between the two. makes git bisect a lot easier when you can expect jobs to pass15:45
fungier, each patch nees to be able to pass15:45
fungineeds15:45
*** e0ne has quit IRC15:45
fungii'll stop trying to type now ;)15:45
tmorinfungi: ok, doing changes dependent of one another would not work in that case ?15:46
fungitmorin: nope. the second change would be passing all jobs, but could never merge because its parent can't pass all the same jobs15:47
tmorinfungi: yes, makes sense15:47
tmorinfungi: thanks again for your support and clear explanations15:48
*** tmorin has left #openstack-infra15:49
fungitmorin: glad i could help. also the current situation is unfortunate but hopefully solved soonish. your repo is depending on internal details of neutron that aren't meant to be a stable interface, so once they actually get further in their libification and are able to expose an interface with more guarantees around stability it should get better15:49
*** amotoki has joined #openstack-infra15:49
anteayamaybe he'll read it in the logs15:49
*** _diana_ has joined #openstack-infra15:49
*** fawadkhaliq has joined #openstack-infra15:51
*** ericksonsantos has quit IRC15:52
*** cody-somerville has joined #openstack-infra15:53
*** _nadya_ has quit IRC15:55
*** fawadkhaliq has quit IRC15:55
*** _diana_ has quit IRC15:58
*** shashank_hegde has joined #openstack-infra15:58
*** fawadkhaliq has joined #openstack-infra15:59
*** puranamr has joined #openstack-infra16:00
openstackgerritMonty Taylor proposed openstack-infra/project-config: Add elements for Infra servers  https://review.openstack.org/14084016:00
openstackgerritMonty Taylor proposed openstack-infra/project-config: Express nodepool base's dependency on puppet  https://review.openstack.org/19841616:00
openstackgerritMonty Taylor proposed openstack-infra/project-config: Split puppet installation into its own element  https://review.openstack.org/19841716:00
*** samuelBartel has quit IRC16:01
*** _diana_ has joined #openstack-infra16:02
*** markus_z has quit IRC16:02
mordredfungi: so - it seems that EmilienM's patch from earlier may have accidentally applied to system-config as well16:02
pelixzaro: re https://review.openstack.org/#/c/179455/4/jenkins_jobs/cmd.py I'm happy to switch it to raising an exception instead of just logging warnings16:02
*** simonmcc has quit IRC16:02
*** simonmcc has joined #openstack-infra16:03
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Restrict stable branches approval on ironic-inspector  https://review.openstack.org/19803016:03
fungimordred: which one was that?16:03
mordredfungi: the solution would be to land a change to exclude system-config from using the puppet unit tests - or to land a Gemfile that implements a unit tests target16:03
mordredfungi: the one that reworked puppet unittests16:03
fungidid i review that? looking16:04
*** _diana_ has quit IRC16:04
mordredfungi: I think it was just me and AJaeger_16:04
*** dtantsur is now known as dtantsur|afk16:04
*** armax has quit IRC16:04
*** jlanoux has quit IRC16:05
*** nihilifer has joined #openstack-infra16:05
fungithanks! found it i think... 197216?16:05
mordredfungi: yah16:05
mordredfungi: patch coming to fix at the jjb level real quick16:06
fungioh, great. you're ahead of me then16:06
fungiready to review16:06
fungii think he asked me to review that stack, but i did not find sufficient time to do so16:07
fungifbo-: http://techs.enovance.com/7542/dive-into-zuul-gated-commit-system-2 is awesome16:08
*** dims_ has quit IRC16:08
openstackgerritMonty Taylor proposed openstack-infra/project-config: Use old puppet syntax job on system-config  https://review.openstack.org/19841916:08
mordredfungi: ^^16:08
mordredfungi, EmilienM, crinkle: I have a hunch this will have broken all of infra's puppet module repos as we used the old puppet-syntax zuul macro for them16:09
*** wayneeseguin has quit IRC16:11
*** _diana_ has joined #openstack-infra16:11
*** wayneeseguin has joined #openstack-infra16:12
fbo-fungi, thanks ! I'm glad you liked it.16:12
fungimordred: it doesn't look like we're using the puppet-syntax template for them in layout.yaml, so we might be okat there?16:12
fungier, okay16:12
openstackgerritMonty Taylor proposed openstack-infra/project-config: Use old puppet syntax job on system-config  https://review.openstack.org/19841916:13
mordredfungi: nope16:13
fungioh, yeah you're right. different template, same job16:13
mordredfungi: I think that should get everything16:13
mordredand then as crinkle gets the infra modules aligned with the puppet testing interface, we can remove the infra specialness there16:14
*** kir has quit IRC16:14
fungiyeah, lgtm16:14
fungiand luckily project-config is split out now, so no puppet syntax job16:15
mordred:)16:15
fungiwhich means we don't have to manually submit the fix to merge16:15
mordredAJaeger_: ^^ when you get a sec16:15
mordredfungi: I love it when we don't need to manually submit the fix to merge16:16
fungias soon as the jobs look like they're passing, i'm fine approving it16:16
mordredkk16:16
mordredfungi: I noticed because I went to review your patch and it had failed those jobs :)16:16
fungiwe just need a precise node allocated and we'll have a completion estimate16:16
*** derekh has quit IRC16:17
fungithere ut goes16:17
fungiit16:17
fungijeblair_: in case you haven't seen fbo-'s article from wednesday, http://techs.enovance.com/7542/dive-into-zuul-gated-commit-system-216:18
*** puranamr has quit IRC16:20
fungimordred: "Job gate-puppet-XXX-puppet-syntax not defined" http://logs.openstack.org/19/198419/2/check/gate-project-config-layout/7ecf6d4/console.html#_2015-07-03_16_20_12_52216:22
*** _diana_ has quit IRC16:23
*** arxcruz has quit IRC16:23
*** sdake has joined #openstack-infra16:23
reazem_Can anyone tell me whats up with that? http://logs.openstack.org/43/198343/2/check/gate-python-surveilclient-python34/3d8d194/16:24
*** jistr has quit IRC16:24
*** pblaho has quit IRC16:25
fungireazem_: "2015-07-03 15:29:36.135 | Build timed out (after 40 minutes). Marking the build as failed." http://logs.openstack.org/43/198343/2/check/gate-python-surveilclient-python34/3d8d194/console.html#_2015-07-03_15_29_36_13516:25
*** reed has quit IRC16:25
*** reed_ is now known as reed16:25
reazem_fungi: Is is timing out during install?16:26
reazem_Or during tests?16:26
reazem_Because tests work fine on my machine.16:26
fungireazem_: the line before that says "running testr" so that's during your tests. maybe a race-related livelock/deadlock16:27
*** fawadkhaliq has quit IRC16:27
fungireazem_: try running with PYTHONHASHSEED='243291355' in case it's a hash-order-dependent bug16:27
*** ctracey has quit IRC16:28
*** ctracey has joined #openstack-infra16:28
*** dprince has joined #openstack-infra16:29
fungireazem_: also your -python27 job failed on the same change, but hit socket connection issues. could be a related bug manifesting in two different ways depending on the python interpreter version's behavior16:29
*** larainema has quit IRC16:29
*** larainema has joined #openstack-infra16:29
*** davideagnello has quit IRC16:30
fungimordred: are you working on an update to 198419 or need someone else to jump in and pick it up?16:31
mordredfungi: oh piddle16:31
mordredyeah16:31
mordredI'm on it16:31
fungiahh, good, you're still here ;)16:31
*** achanda has joined #openstack-infra16:31
*** yamamoto has quit IRC16:32
*** shashank_hegde has quit IRC16:33
*** yamamoto has joined #openstack-infra16:33
openstackgerritMonty Taylor proposed openstack-infra/project-config: Use old puppet syntax job on system-config  https://review.openstack.org/19841916:33
mordredfungi: there yah go16:33
*** doug-fish has joined #openstack-infra16:34
*** shashank_hegde has joined #openstack-infra16:34
*** doug-fish has left #openstack-infra16:34
*** rcarrillocruz has joined #openstack-infra16:39
rcarrillocruzhelo helo16:39
rcarrillocruzmordred: hiya, you around or took the day off , 4th July etc?16:39
*** doude has quit IRC16:41
*** achanda has quit IRC16:41
fungircarrillocruz: he seems to be at least semi-around16:42
rcarrillocruzlooking for someone who's been playing with infra cloud16:42
rcarrillocruzusing bifrost on gozer and getting some error on kernel while booting, wondering if someone else also got that16:42
fungimordred: yep, i've manually run the zuul tox env for that last patchset and get "Job gate-puppet-syntax not defined"16:43
fungircarrillocruz: maybe SpamapS or greghaynes?16:43
rcarrillocruzgood, thx, i'll ping them in a bit16:43
anteayaor TheJulia?16:44
fungiahh, yup16:44
fungimordred: looks like it should be gate-system-config-puppet-syntax in layout.yaml now. i'm retesting now to confirm16:46
*** doude has joined #openstack-infra16:46
ttxfungi: here is how an OSSA could look: http://phabricator.disorder.xyz/T1 -- it's actually less crazy than the backport case (where you have to create a task *depending* on the current one)16:46
*** dguerri is now known as dguerri`16:47
*** HeOS has quit IRC16:47
ttxstill think that would be more usable with "projects" being displayed next to "Blocked by" items16:47
ttxrather than having to come up with prose that matches the projects set16:47
rcarrillocruzanteaya: indeed, pinged her on ironic channel but seems she's off today16:48
rcarrillocruzunderstandable being a bank holiday :-)16:48
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Use old puppet syntax job on system-config  https://review.openstack.org/19841916:48
fungimordred: ^ that worked for me16:48
anteayarcarrillocruz: cool16:48
mordredfungi: yay!16:49
*** laughterwym has quit IRC16:49
*** markvoelker has joined #openstack-infra16:49
*** ildikov has quit IRC16:50
fungittx: neat!16:50
ttxmordred: there seems to be no way to create a depending task (instead of a blocking one). Use case: you're on a bug and want to track a kilo backport for it. The kilo backport is not supposed to be completed until the master patch is in16:50
ttxso instead of "create subtask" you'd want "create parent task"16:50
fungittx: you can't say that the kilo backport is blocked by the master task?16:50
*** dims_ has joined #openstack-infra16:51
ttxfungi: you can but you ned to create B and then edit blocking tasks to add A16:51
fungioh16:51
fungithat seems like effort ;)16:52
rcarrillocruzanyway, i figured16:52
*** Sukhdev has joined #openstack-infra16:53
rcarrillocruzintel_iommu=off on ipxe config fixed the issue i had booting16:53
ttxfungi: err, actually can't16:53
ttxmust be missing something16:54
*** mpaolino has quit IRC16:54
fungittx: yeah, i can't seem to add one subtask as a blocking another subtask16:54
SpamapSrcarrillocruz: I'm not going to be looking at IRC much today. now would be the only time really.16:56
SpamapSrcarrillocruz: do your gozer servers have mellanox cards? ;)16:57
ttxfungi: in theory this is done through "edit blocking tasks" in the aprent task once created. Search can't find things but that may be because I didn't generate fulltext indexes yet16:57
fungittx: oh! t516:57
fungior similar16:57
ttxstill, two steps kinda sucks16:57
fungiit seems to at least be indexed on tNNN16:57
*** notnownikki has quit IRC16:58
fungittx: i now have a juno backport (t8) blocking the main task (t1) and blocked by a master fix task (t5)16:58
rcarrillocruzSpamapS: not sure, i'd have to look16:58
rcarrillocruzi had an issue booting off the coreos kernel16:58
mordredrcarrillocruz: what uses coreos?16:58
rcarrillocruzi was getting a flood of message DMAR pte write access is not set boot"16:58
fungii first read that as "oreos kernel"16:58
rcarrillocruzbifrost16:58
rcarrillocruzthe rd16:58
mordredoh. how weird ... OH - because of the ironic agent right?16:59
rcarrillocruzi fixed by passing the intel_iommu=off param to the pxelinux cfg16:59
mordredcool16:59
rcarrillocruzmordred: i think so yeah16:59
rcarrillocruzhow's the network layout of your infra cloud16:59
rcarrillocruzdo you folks have a management network16:59
ttxfungi: ack16:59
rcarrillocruzand a provisioning network?16:59
fungittx: i think we can work with this, however it could stand some shortcuts to make the workflow more convenient16:59
mordredrcarrillocruz: nope - just a public network and a provisioning network17:00
fungittx: also it needs a curses-based api client ;)17:00
rcarrillocruzand from your ironic conductor you have access to the iLO network I assume?17:00
mordredyes17:00
rcarrillocruzto do ipmi power on commands etc17:00
rcarrillocruzcool17:00
rcarrillocruzi had to do some network things on my side17:00
mordredwe have 2 nodes in each DC that have routeable access to the iLO network17:00
rcarrillocruzdidn't have access to that on our servers :/17:00
rcarrillocruzZOMG17:01
mordredyah. it's kind of importand to have that17:01
rcarrillocruzI JUST INSTALLED THE SERVER WITH IRONIC17:01
mordredrcarrillocruz: WOOT!17:01
rcarrillocruzUBUNTU 14.04!17:01
*** dims_ has quit IRC17:01
mordredrcarrillocruz: nicely done!!!17:01
rcarrillocruzTheJulia: how awesome is your stuff17:01
rcarrillocruzwootz17:01
rcarrillocruzpretty much zero customization i needed to do17:01
rcarrillocruzsrsly17:01
fungijeblair_: if we decide maniphest needs a console ui, the name "mephisto" is available on pypi ;)17:01
mordredheh17:02
SpamapSrcarrillocruz: I'm jealous. TheJulia had to patch the hell out of the ipxe stuff because of our weird mellanox cards. ;)17:02
rcarrillocruzhaha17:02
rcarrillocruzthen that means i do not have those mellanox cards :P17:02
SpamapSfungi: I like maniphestty17:03
mordredSpamapS: hopefully soon we won't have mellanox cards either17:03
SpamapSrcarrillocruz: yeah you probably have sane intel cards.17:03
fungiSpamapS: ooh! yep17:03
nibalizermaniphestty sounds ike something for the suite of *tty17:03
fungiit does indeed17:03
nibalizerideally we'd make it generic enough that a lot of it could be reused in the gozer-maintained jiratty17:03
mordredgross17:04
fungiprojects for ttypists17:04
nibalizerfungi: bahahahaha17:04
mordredfungi: ++17:04
fungithe ttypist brigade17:05
SpamapSjiratty sounds like an australian martial art that involves clicking a lot.17:05
SpamapSttypistas is the proper name17:05
fungiSpamapS: and the ultimate finishing move, "headdesk"17:06
SpamapSfungi: 60% of the time it works, every time.17:06
ttxOMG it's past beer o'clock what am I doing here17:06
SpamapSsame.. I don't know why I'm on IRC17:06
SpamapSrcarrillocruz: good luck17:06
fungittx: go celebrate teh independence of my foul nation by drinking french wine and swearing17:06
SpamapSyeah, pour one out for Lafayette17:06
ttxTo Lafayette!17:07
rcarrillocruzthx, need to dig a bit more, network does not seem to be set up17:07
rcarrillocruzthe ubuntu DIB image, does it have any user/pass by default?17:07
* SpamapS goes to start his "day off" which will mostly consist of chore-doing.17:07
SpamapS"but honey, I WANT TO GO TO WORK"17:07
mordredrcarrillocruz: nope17:08
fungiSpamapS: it helps to stop referring to it as "work"17:08
mordredrcarrillocruz: in the infra elements, we bake in an ssh key17:08
mordredrcarrillocruz: are you using ubuntu + cloud-init or ubuntu-minimal + glean? (I recommend the second)17:08
rcarrillocruzhaven't touched anything of that, so whatever is default on bifrost repo17:08
mordredrcarrillocruz: https://review.openstack.org/#/c/140840/17:09
mordredrcarrillocruz: you may want to look at the infra element there17:09
rcarrillocruzcool , thx17:09
mordredrcarrillocruz: it injects the infra ansible ssh key, allows root login on that key - and is generally designed with ubuntu-minimal/glean in mind17:10
*** sdake_ has joined #openstack-infra17:10
rcarrillocruzthing is boot went fast, dunno if the server got any NIC configured17:10
rcarrillocruzthankfully i recorded the ssion on the iLO client17:10
rcarrillocruzi'll look slowly output17:10
fungioh, hey, it also no longer sets the root password to "foobar"! ;)17:11
SpamapSrcarrillocruz: bifrost should be pulling in ~/.ssh/id_rsa.pub17:11
rcarrillocruzyep, cos i had to ssh-keygen on the conductor17:11
rcarrillocruzotherwise the deploy would fail17:11
rcarrillocruzneed to know the IP it got :(17:11
SpamapSrcarrillocruz: with bifrost, and the agent, you end up getting a configdrive.17:12
SpamapSrcarrillocruz: which will have the key in it, which should be installed under the ubuntu user.17:12
SpamapSbecause some of us believe it's fairly weird to _not_ use sudo. :-P17:12
nibalizerrcarrillocruz: oh are we bifrosting? neat!17:13
*** sdake has quit IRC17:13
rcarrillocruzyup17:15
*** achanda has joined #openstack-infra17:15
*** Kiall has quit IRC17:15
rcarrillocruzoh17:16
rcarrillocruzi see what the problem is17:16
rcarrillocruzin the inventory17:16
*** Kiall has joined #openstack-infra17:16
rcarrillocruzi set the mac address of the prov NIC card17:16
rcarrillocruzwhich is in a different VLAN17:16
rcarrillocruzi'm mixing up NICs17:17
*** shashank_hegde has quit IRC17:18
*** mmedvede has joined #openstack-infra17:18
*** shashank_hegde has joined #openstack-infra17:19
*** rlandy has joined #openstack-infra17:19
openstackgerritMerged openstack-infra/project-config: Use old puppet syntax job on system-config  https://review.openstack.org/19841917:20
fungimordred: ^17:20
*** sdake has joined #openstack-infra17:21
*** larainema has quit IRC17:24
*** tjones1 has joined #openstack-infra17:24
mordredfungi: \o/17:24
*** madong has joined #openstack-infra17:25
mordredSpamapS, rcarrillocruz: it should NOT be under the ubuntu user17:25
mordredbecause that is divergent and bad experience once there is more than one OS17:25
*** madong has quit IRC17:25
mordredif we decided collectively that we want to do sudo users (which I'm fine with) we should really pick a user that is not named after a distro17:25
mordredand make it17:26
mordredand use it17:26
*** sdake_ has quit IRC17:26
*** madong has joined #openstack-infra17:26
*** madong has quit IRC17:26
*** tjones1 has quit IRC17:28
*** _nadya_ has joined #openstack-infra17:30
*** ociuhandu has quit IRC17:30
*** kaisers has quit IRC17:32
*** linkedinyou has quit IRC17:32
*** asselin_ has quit IRC17:33
*** ameade_vacation has quit IRC17:35
*** ameade_vacation has joined #openstack-infra17:35
*** achanda has quit IRC17:36
*** nihilifer has quit IRC17:38
pelixany other Core Reviewer around to review a change for JJB? https://review.openstack.org/18154217:40
pelixalso https://review.openstack.org/18154117:40
fungipelix: oh wow, we weren't testing that?17:40
pelixnope17:41
*** _nadya_ has quit IRC17:41
clarkbfungi o/ I should be around to do db things17:41
*** tjones1 has joined #openstack-infra17:41
pelixfungi: was hit previously when the the parallel patch landed initially, which is when we realised it wasn't being exercised at all17:41
fungiclarkb: all's the better. welcome back to our (virtual) reality17:42
fungipelix: yep, i remember the bug. i guess that's how it snuck in17:42
pelixboth above changes only impact tests, so safe to add just before the weekend ;)17:43
clarkbmordred "root"17:43
fungiclarkb: if all goes well, in another hour or so we should have bindep installed and pre-caching distro packages on all our dib nodepool images. the last of my changes landed for that this morning before image updates started17:44
clarkbfungi awesome17:44
fungiclarkb: also the old-timer in me thinks sudo should use the wheel group like su does (or used to in real unix anyway)17:44
mordredclarkb: SpamapS' argument is that non-root use with sudo is good for logging17:45
crinklenibalizer: made some changes https://review.openstack.org/#/c/19083917:45
mordredclarkb: as opposed to shelling directly into the root user17:45
clarkbmordred which is only true if interacting as a human17:45
mordredI don't care - so I'd be happy to have an ansible user or a wheel user or an admin user or whatever that had full passwordless sudo17:45
clarkbmordred which we each have accounts for17:45
fungimordred: clarkb: SpamapS: having the root user run sudo also logs stuff. also having one generic non-root account and using that to sudo isn't much of an improvement17:46
clarkbeverything automated is already logged via puppet/ansible/etc17:46
fungiif we really care about audit logging for interactive root sessions, there are also mechanisms for that17:46
mordredsure. I'm just saying - I'm fine with root, and not-root doesn't bother me much17:47
mordredjust for the love of all that is holy "ubuntu" is a terrible username17:47
clarkb+117:48
mordredpast that, I truly believe it's six-in-one/half-a-dozen-in-the-other17:48
mordredand would not block work to make a sudo enabled admin user17:48
anteayaha ha ha17:48
mordredif that makes someone happy17:48
anteayaubuntu is a terrible username17:48
nibalizercrinkle: doooood this is getting sweet17:48
openstackgerritMerged openstack-infra/jenkins-job-builder: Test update command with --delete-old option  https://review.openstack.org/18154217:49
*** erlon has joined #openstack-infra17:49
*** yamamoto has quit IRC17:49
fungiif we really want an initial account which is not root, i vote for "notroot" or maybe the ever classic "toor"17:50
fungi</bikeshed>17:50
*** arxcruz has joined #openstack-infra17:50
*** bdemers has quit IRC17:50
mordredfungi: I think the argument is not for an initial account17:50
*** achanda has joined #openstack-infra17:50
mordredfungi: I think it's an argument that the user ansible uses to do things shoudl be not-root17:50
mordredfungi: and taht we should configure ansible to run things through sudo17:50
fungithough when i had "toor" accounts they were usually for alternate uid=0 usage, not for uid>017:51
clarkbmordred wait but ehy? ansible already logs everything?17:51
clarkbso of the argument is for logging I dont get it17:51
fungimordred: so an "ansi-bill" user who ansible logs in as and then does all root-needing things by calling sudo?17:52
mordredfungi: yes17:52
clarkbI suppose if you dont trust ansible you do that but if you dont trust ansible then its tine to open a bier garten17:52
fungii don't entirely object, but i am on clarkb's side of the preference yard17:52
mordredclarkb: I think it's the "remote root login is a bad pattern" - and to be fair, we had it disabled on all of our servers before we added ansible puppet running17:52
mordredbut - I also have convinced myself that I'm fine with it17:53
mordredfor the reason that clarkb just said17:53
*** pelix has quit IRC17:53
fungito be clear, i'm for opening a bier garten17:53
TheJuliarcarrillocruz: awesome to hear!17:53
mordredotoh - we know what we're doing - and in a world where other people blindly copy things we've done, we might be setting a bad example for people in terms of opening up a config setting on their server that they probably should not open17:53
fungitrust or no17:53
mordredfungi: ++17:53
mordredMOAR BIER17:54
TheJuliamordred: ++17:54
clarkbI am sad I wobt have any home brew ready for oscon17:55
clarkbebabies17:55
mordredclarkb: are they going to start making beer?17:56
fungii'm guessing they lack the necessary strength and hand-eye coordination for at least a couple of earth years17:56
mordredbah17:57
fungiin the meantime, portland isn't exactly short on beer, so i think we'll manage when there on visits at least17:57
anteayaI hear they are growing at a good pace17:57
clarkbya plenty of tasty beer to be found17:57
anteayathe babies that is17:57
nibalizercan confirm pdx beer supplies are not low17:58
openstackgerritSpencer Krum proposed openstack-infra/puppet-openstackci: Add beaker boilerplate to openstackci  https://review.openstack.org/18489117:59
openstackgerritSpencer Krum proposed openstack-infra/puppet-openstackci: Update spec helper for zuul-cloner  https://review.openstack.org/18490517:59
funginot like great the beer shortage of 2012. those were dark, dark times18:00
anteayawas that the hops problem?18:00
*** maxandersen has joined #openstack-infra18:00
*** maxandersen has joined #openstack-infra18:00
TheJuliarcarrillocruz: fwiw, I've used the devuser element to get a user into my local testing images for when the network does not work as expected.  It works fairly well, but you have to set the env var for ansible to pass through to set the password :(18:00
fungii hear the entire northwest fell into chaos and ruin, ruled by tyrannical warlords bent on destruction and mayhem18:01
fungior maybe that was just eugene18:01
* TheJulia is fairly sure things are the status quo in the southeast US right now...18:01
*** ildikov has joined #openstack-infra18:02
clarkbif this heat wave doesnt go away we may see this repeated18:03
mordredit's pleasant in NYC18:04
mordredwarm enough to be summer, not so warm I sweat a ton18:04
clarkb10 day forecast says its another week of >90F days18:04
fungithe forecast here is tourists, traffic, and more tourists. oh also sharks18:05
docaedoThere was a beer shortage in 2012? That sounds terrifying.18:06
openstackgerritSpencer Krum proposed openstack-infra/puppet-openstackci: Update spec helper for zuul-cloner  https://review.openstack.org/18490518:07
*** jasondotstar has joined #openstack-infra18:07
mordredfungi: you have so many sharks18:08
clarkb"spec" is officialyy too overloaded18:08
TheJuliafungi: Perhaps the sharks can be convinced to leave the coastal area?18:09
*** tjones1 has left #openstack-infra18:09
*** armax has joined #openstack-infra18:09
* TheJulia saw the photos from above one of the piers in NC from two weeks ago... and WOW18:10
*** boris-42 has quit IRC18:12
fungiTheJulia: yeah, they're becoming pests this season. seems there's a lot of rays and other food sources frequenting the shoreline this year18:12
reazem_fungi: Ha! I got it. I didn't read the logs properly, it was an actual mistake on the tests.18:13
reazem_thanks :)18:13
fungiunsurprisingly, but somewhat to my disappointment, tourists are not their natural diet. they would rather eat other less filthy/toxic things18:14
fungilike mercury-laden fish18:14
*** Svedrin has quit IRC18:16
TheJuliafungi: I take it your out towards the coast? :)18:16
fungiTheJulia: yeah, about 0.5 miles walk to the atlantic and 0.5 miles walk to the sound. though as of next friday i'll have a house 0.9 miles walk to the atlantic and 50 paces from the sound18:17
*** fitoduarte has joined #openstack-infra18:18
TheJuliaAwesome18:18
*** zigo has quit IRC18:18
fungiassuming no last minute surprises between now and closing18:19
*** davideagnello has joined #openstack-infra18:19
*** Svedrin has joined #openstack-infra18:21
fungihrm, maybe more like 20 paces from the sound. i'm terrible with distances. anyway close enough that i can pitch oyster shells from my porch into the water18:21
TheJuliavery nice18:22
*** zigo has joined #openstack-infra18:22
openstackgerritSpencer Krum proposed openstack-infra/system-config: Script to install modules during integration  https://review.openstack.org/19844218:22
fungiit will be. it's in good enough shape right now, but still needs some updating before it'll be the way we want18:22
clarkbas a friendly reminder etherpad lite db udpate process can be found at https://etherpad-dev.openstack.org/p/eplite-db-updates (hosted on the dev server since we are working on the prod service)18:22
*** armax has quit IRC18:22
*** bnemec has quit IRC18:23
clarkbfungi: still no update on the issue with pad not working, you indicated we should go ahead with the conversion since its not lossy and prevents entire server from dying?18:23
openstackgerritSpencer Krum proposed openstack-infra/puppet-openstackci: Update spec helper for zuul-cloner  https://review.openstack.org/18490518:23
clarkbI am on board with that18:23
clarkbmordred: ^ do you have an opinion?18:23
fungiclarkb: yeah, i think we should just take it all the way to 4-byte compliant, regardless18:23
TheJuliafungi: The home improvement projects only end with the sale of the property. :)18:23
*** davideagnello has quit IRC18:23
*** ruagair has quit IRC18:24
clarkbcan I get https://review.openstack.org/#/c/197358/ merged real quick?18:24
*** bnemec has joined #openstack-infra18:24
clarkbjust realized that hadn't merged yet and will make sure we have consistent versions of the service across servers18:24
fungiTheJulia: too true! it's not like we plan to live in it forever anyway. already have our sights set on moving to the caribbean in ~10 years18:25
*** otter768 has quit IRC18:26
*** ddieterly has quit IRC18:26
*** otter768 has joined #openstack-infra18:28
TheJuliafungi: cool, for us, we're thinking someplace a little cooler in the summer, but one never knows :)18:31
fungithe caribbean is actually more pleasant than eastern nc, temperature wise. sure it's in the tropics, but the trade winds keep it tolerably comfortable18:31
*** kdas_ has joined #openstack-infra18:32
fungino 100+f heat waves18:32
clarkbfungi: thanks for the approval on that chnage18:32
fungithough the labrador coast would be pretty awesome too if you don't mind cooler weather18:32
clarkbits funny because looking at houses in portland you discover its cheaper to live on the coast and during a 3 week heat wave that becomes very tempting18:33
openstackgerritMerged openstack-infra/system-config: Bump etherpad version to version running on -dev  https://review.openstack.org/19735818:33
*** dguerri` is now known as dguerri18:34
fungiyeah, until i looked at a map i didn't realize quite how far inland portland really is18:34
fungiyour portland anyway18:34
clarkbabout 65 miles18:34
fungithe one at the other end is really right on the water18:34
fungii quite like portland maine. vacationed there a few times18:34
fungiremarkably comvenient from boston18:34
fungiconvenient too18:35
*** rfolco has quit IRC18:35
*** kushal has quit IRC18:35
*** rfolco has joined #openstack-infra18:36
*** john-davidge has quit IRC18:36
*** dguerri is now known as dguerri`18:36
*** rossella_s has quit IRC18:36
*** dguerri` is now known as dguerri18:36
*** rossella_s has joined #openstack-infra18:37
*** otter768 has quit IRC18:37
*** dguerri is now known as dguerri`18:38
*** ruagair has joined #openstack-infra18:39
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Rename pypi_slave class to release_slave  https://review.openstack.org/19844418:39
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add release.slave.openstack.org  https://review.openstack.org/19844518:39
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add proposal and release workers to cacti  https://review.openstack.org/19844618:39
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Clean up old pypi job worker configuration  https://review.openstack.org/19844718:39
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Switch jobs from old pypi to new release worker  https://review.openstack.org/19844818:40
*** zhiyan has quit IRC18:41
*** zhiyan has joined #openstack-infra18:41
*** jasondotstar has quit IRC18:42
*** Sukhdev_ has joined #openstack-infra18:42
fungikrotscheck: https://review.openstack.org/#/q/status:open+topic:upload-worker,n,z is the set of changes to get us an ubuntu trusty based upload worker for your npm needs18:43
fungii've temporarily wip'd the ones which shouldn't get approved until i launch the actual instance for it18:43
*** koolhead17 has joined #openstack-infra18:44
*** Sukhdev has quit IRC18:44
clarkbfungi: stack lgtm18:44
*** fawadkhaliq has joined #openstack-infra18:45
clarkbadding to jenkins is a manual step :/ but we only have to do that once every couple cycles18:45
fungiyep. also the label change is now safe. i've added the new label to the old worker. i'll swap the labels around on jenkins.openstack.org to make the change happen when we're ready since it'll take effect a lot faster18:46
*** koolhead17 has quit IRC18:49
fungii'll make the actual cut-over early next week, rather than heading into a weekend18:49
fungijust so that i'm able to better be on hand to work through any issues that might arise18:49
*** yamamoto has joined #openstack-infra18:50
fungit minus 10 minutes to etherpad outage18:50
clarkbI will be stopping puppet, etherpad-lite and apache on etherpad.openstack.org at 1900, then will do db dump, restore, conversion and run puppet with new hiera value18:50
fungiclarkb: also not something to approve on a weekend, but https://review.openstack.org/198409 should probably happen sometime in the coming week18:51
clarkbwhats with the syntax job?18:52
fungiclarkb: bleed-over from the openstack-puppet job refactoring work18:52
clarkbfungi: and is there a stack of fixes for the constraints update jobs I can look at?18:52
*** sdake_ has joined #openstack-infra18:52
clarkblifeless thought you had proposed a stack and I can probably find them if I dug around :)18:53
fungiclarkb: hrm, i think lifeless still needed to iterate on https://review.openstack.org/198186 unless someone beats him to fixing whatever's wrong there18:53
fungiclarkb: and then https://review.openstack.org/198188 is a fix in devstack depending on that stack18:54
clarkbwell the constraints update jobs look like they don't even get git set up correctly?18:54
clarkbthey run but arne't doing much18:54
*** yamamoto has quit IRC18:55
fungiclarkb: oh, those. they're less critical at the moment, though i think they'll get further with https://review.openstack.org/198120 when they run again tomorrow18:55
*** sdake has quit IRC18:56
clarkbcool18:56
fungii figured it was easier to drop back and punt with the older branch-git-prep builder than to fiddle puppeting a zuul-env onto the proposal worker18:56
rcarrillocruzmordred: agree, i'm very annoyed of checking distro platforms on my centos/ubuntu playbooks to do stuff on /home/ubuntu or /home/centos, depending on what is run18:56
rcarrillocruzi'd vote to have 'stack' user18:56
rcarrillocruzand that it18:56
clarkbmordred: sdake_ so does the shade stuff in ansible not work with ansible < 2.0? I am confused18:57
*** shashank_hegde has quit IRC18:57
fungiclarkb: though i still intend to use zuul-cloner in my revamped bindep'ing tox-based jobs18:57
clarkbrcarrillocruz: but what if I use aws should we also have an elastic user?18:57
fungiso i kept the builder macro for now18:57
clarkbmaybe azure and engineer too?18:57
rcarrillocruzclarkb: i'd be disappointed if we ever use aws :D18:58
clarkbrcarrillocruz: sure but my point is that "stack" is just as bad as "ubuntu"18:58
rcarrillocruzit's not, we have a user that is common to all images18:58
fungithis is why i think that if we have to have a non-root default user, "toor" is a great nod to antiquity18:58
rcarrillocruzi think 'stack' is better than having 'ubuntu' on a centos image18:59
clarkbrcarrillocruz: its better until someone tries to deploy on not openstack18:59
clarkbrcarrillocruz: and we know people do this18:59
fungihttps://en.wikipedia.org/wiki/Toor_(Unix)18:59
fungiwikipedia remembers all!18:59
clarkbok its 1900 by my watch stopping services now19:00
fungiyep, time to break stuff clarkb19:00
fungishall i #status while you do the things?19:00
clarkbfungi: sure19:01
fungi#status alert etherpad.openstack.org is offline for scheduled database maintenance, ETA 19:30 UTC19:01
openstackstatusfungi: sending alert19:01
clarkbdb backup is in progress now19:02
fungiheh, i've rotated my ssh key since the last time puppet ran on here19:02
-openstackstatus- NOTICE: etherpad.openstack.org is offline for scheduled database maintenance, ETA 19:30 UTC19:03
fungigood thing it was a prophylactic key rotation and not a compromise19:03
clarkbfungi: want me to manually update a authorized_keys file?19:03
*** ChanServ changes topic to "etherpad.openstack.org is offline for scheduled database maintenance, ETA 19:30 UTC"19:03
funginope, i have my old key on hand still, just at a different filename19:03
fungii was able to get in fine19:03
clarkbcool19:03
* fungi is quite used to the key rotation dance19:04
clarkbI should rotate keys too19:04
*** kdas_ is now known as kushal19:04
* clarkb makes note to do this19:04
*** kushal has quit IRC19:04
*** kushal has joined #openstack-infra19:04
fungii actually use a non-default key for openstack systems and have a shell alias i use to hand it to ssh -i19:04
fungihelps me separate contexts better19:04
clarkbthis db dump is slow19:05
fungiand also means i can rotate my openstack ssh keys independently of other ssh keys19:05
*** sdake_ has quit IRC19:05
openstackstatusfungi: finished sending alert19:05
fungiclarkb: oh, we meant to make the new one bigger19:06
fungiwant me to increase it before you load?19:06
clarkbfungi: yes please19:06
fungi10gb good? that'll put us around 50% used19:06
clarkbiirc the cost per gb is low maybe go to 20GB?19:07
fungiyou got it. resizing underway19:07
clarkblet me know when that is done and I will start a restore into that host19:07
fungiyep, i'm staring at it intently19:07
fungiit's a pity. none of our rackspace ubuntu-trusty uploads worked but all the hpcloud ones did. it's sort of amusing that uploading from a rackspace cloudserver to rackspace cloudfiles in the same region is flakier than doing it over the internet and into hpcloud19:09
clarkbfungi: I think that is a function of vhd size vs qcow2 size19:09
clarkbcopying 15GB reliably is hard?19:09
fungioh, this is likely true. the qcow2 is ~5gib but i should check the vhd size19:09
greghaynesalso the many uploads simultaneously because were splitting the image19:09
fungin chunks means you multiply the potential for failure by n19:10
openstackgerritMerged stackforge/python-jenkins: fix passing of byte object to url request method  https://review.openstack.org/19775219:10
greghaynesyep, and I think the chunks happen in parallel, so I wonder if were getting wierd behavior when we saturate the link19:10
clarkbmaybe we can force it to use N=119:11
clarkbor rather uploads = 119:11
clarkbsince swift requires chunked objects for large object support19:11
fungior whether we're slamming cloudfiles too hard ;)19:11
fungiclarkb: the resize is still underway19:11
clarkbkk19:12
notmynamein my testing, HP's swift clusters are *much* faster than rackspace's19:12
*** achanda has quit IRC19:12
greghayneswere doing glance in hp19:12
funginotmyname: well, we're also not uploading to swift in hpcloud because they're glance v119:12
funginotmyname: but also we're uploading a couple of ~15gib (maybe more) diskimages for glance v2 into rackspace cloudfiles. so largeish19:13
fungiwe could likely be saturating our bandwidth limit for the instance from which we're pushing them19:13
*** fawadkhaliq has quit IRC19:14
fungiand hpcloud also has the benefit of accepting qcow2 images, so we aren't having to send nearly as much data19:14
fungican't wait until rackspace no longer requires raw image uploads19:14
*** sdake has joined #openstack-infra19:15
fungiserious waste of bandwidth19:15
clarkbit would be neat if we could have ro cinder volumes that are mountable from N hosts at once19:15
clarkbthen we could just make a cache volume daily per region that all slaves mount19:15
fungiclarkb: boot from volume with a cow overlay?19:15
fungiclarkb: oh! you mean for the cache only19:16
fungiyeah that would be stellar19:16
fungidecouple that from image generation. we could even update it more frequently19:16
clarkbyup19:16
clarkband it would make our images a bit more reconsumable19:16
fungiand that trove resize is _still_ going19:16
fungiwould have been a lot faster to just delete and recreate19:17
fungiwe didn't need to preserve any data19:17
clarkboh well19:17
fungidunno what i was thinking19:17
clarkbits a holiday in MURICA, weekend in apac and europe is asleep. I think we only have to worry about anteaya pabelanger and cody-somerville :)19:18
*** john-davidge has joined #openstack-infra19:18
anteayaI'm watching the conversation19:18
anteayaso not using etherpad, I'm good thanks though19:18
fungiyeah, they got their holiday over and done with on wednesday19:18
anteayait was nice19:19
anteayabeat the rush19:19
anteayazul is canuck too19:20
openstackgerritAntoine Musso proposed openstack-infra/nodepool: Fix Jenkins nodes methods to use POST  https://review.openstack.org/19360019:20
SpamapSjust to be clear about sudo and admin users: any log analysis is compromised when you have a shared admin user that people use as their first contact with the box. I 100% agree with that. Whether it is ubuntu, or root, it's poor practice IMO.19:21
fungiSpamapS: my feeling exactly19:22
*** arxcruz has quit IRC19:23
*** esmute__ has quit IRC19:24
*** john-davidge has quit IRC19:24
*** hashar has joined #openstack-infra19:25
fungithe edge case here is that we have an automated system which connects to machines and (effectively) every action it takes requires root access. and it runs from a trusted system and logs its activity. so the benefits of forcing it to call sudo over and over are marginal, possibly not enough to outweigh the added complexity19:25
*** EricGonczer_ has joined #openstack-infra19:25
*** esmute__ has joined #openstack-infra19:26
fungiclarkb: in case you think i might have fallen asleep over here... nope, still resizing19:27
*** ddieterly has joined #openstack-infra19:27
openstackgerritAntoine Musso proposed openstack-infra/project-config: nodepool: describe nodepool-base env variables  https://review.openstack.org/19356619:28
fungiclarkb: okay, it's at 20gb now. ready to load in?19:28
clarkbfungi: I am ready if you are19:28
fungi#status alert etherpad.openstack.org is still offline for scheduled database maintenance, ETA 19:45 UTC19:29
openstackstatusfungi: sending alert19:29
fungiclarkb: go for it19:29
clarkbrestore is running in screen19:30
fungiattached19:30
-openstackstatus- NOTICE: etherpad.openstack.org is still offline for scheduled database maintenance, ETA 19:45 UTC19:31
*** ChanServ changes topic to "etherpad.openstack.org is still offline for scheduled database maintenance, ETA 19:45 UTC"19:31
*** ddieterly has quit IRC19:31
anteayaI wonder if that sets up up for the bot topic bug where the topic that is restored after you are done is the ETA 19:30 topic19:33
*** igor___ has quit IRC19:33
openstackstatusfungi: finished sending alert19:33
fungianteaya: it shouldn't, we've done this successfully before. the bug we saw last time i think is that we asked it to start sending an updated second alert before it finished sending the first alert19:34
anteayaah19:34
anteayaokay thanks19:34
clarkbfungi: the total size of the db dump was about 2.7GB so this restore isn't unusually slow19:35
*** EricGonczer_ has quit IRC19:36
fungicool19:36
*** armax has joined #openstack-infra19:37
openstackgerritAntoine Musso proposed openstack-infra/project-config: nodepool: nodepool-base no more set a local DNS  https://review.openstack.org/19356719:37
clarkbone thing I had to do to get my etherpad change in place was run their stress tester, it only runs against http and requires flipping a less secure bit in config, tl;dr it would be neat to temporarily make -dev less secure for a time to hit it with the stress tester19:39
fungilooks like it just finished19:39
clarkbyup going to hop on and make the character set changes now19:40
fungiclarkb: can't run the stress tested locally over the http socket listening on localhost?19:40
fungier, tester19:40
clarkbfungi: you can but then you ignore apache and its potential for limiting throughput19:40
clarkbwe acutally likely want to test with and without apache to model that19:41
fungithat's a great point19:41
clarkband this step should take ~5 minutes19:41
clarkbbased on my math from the -dev conversion19:41
clarkbgoing to take the hiera lock now and update hiera while we wait19:42
fungiwe might want to consider making the stress tester a ci job, and run it from a weekly pipeline or something19:42
fungimeh, i guess we really only care after we change something though19:42
clarkbhiera updated19:44
clarkbit only took 3 minutes19:44
clarkbfungi: ready for me to run puppet?19:44
fungiyep!19:45
fungiall i can say is, i'm glad we resized the volume for the new trove instance. it spiked up around 7.5 gib of data during that alter table19:45
fungii expect it would have failed on us if we were still running it with a 6gib volume19:45
fungiyay! i saw it update my ssh key ;)19:46
clarkbwell that was the noop run :) current run will actually update it19:46
fungiwell, _now_ it updated it19:46
fungiyeah19:47
fungiand looks like it updated the database hostname properly too19:47
clarkbhttps://etherpad.openstack.org/p/clarkb-test is up and available19:48
clarkbok service is back, please let us know if you see anthing off/weird unhappy19:48
clarkbif no one objects I will send mail to list saying we are done and we can #status reset19:51
clarkber ok19:51
anteayaI do not object19:51
fungi#status ok19:52
openstackstatusfungi: sending ok19:52
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/"19:53
openstackstatusfungi: finished sending ok19:54
fungii stuck a utf8 4-byte test payload in https://etherpad.openstack.org/p/broken-utf8-4 and it doesn't seem to have broken that pad19:54
fungihow were you able to break it before?19:54
clarkbhuh19:54
clarkbfungi: taron put 4 byte chars in https://etherpad-dev.openstack.org/p/clarkb-test and it broke that pad19:55
clarkbfungi: but it broke in the client not the server side, there are js exceptions if you open the dev tools and look at the console in $brwoser19:55
fungitaron: if you're around, any recollection of which particular characters you tested with?19:55
clarkbhttps://github.com/ether/etherpad-lite/issues/2522 thats the bug which I updated too19:56
clarkbwe should likely add those chars to the bug as well19:56
anteayathe -dev/clarkb-test pad loads the chat for me but not the pad19:56
fungii copied/pasted the set at http://www.i18nguy.com/unicode/supplementary-test.html19:56
clarkbanteaya: yup thats the behavior and seems to be due to chat loading separately from the pad content19:57
anteayaokay, working as expected then, or at least consistent with prior experiences19:57
*** mpaolino has joined #openstack-infra19:58
*** mpaolino has quit IRC19:58
fungii'm tempted to paste http://www.cl.cam.ac.uk/~mgk25/ucs/examples/UTF-8-test.txt into etherpad-dev19:59
anteayaI have no objection20:00
anteayaif it is able to be busted we may as well bust it ourselves20:01
fungii think my browser may have filtered the badnez20:01
fungihttps://etherpad-dev.openstack.org/p/broken-utf8 pasted fine20:01
anteayacan you download with curl then upload to etherpad?20:01
fungiah, yeah, it's copying the unicode "replacement character" codepoint20:03
anteaya:/20:03
fungithough it did manage to paste 𐀀 correctly (LINEAR B SYLLABLE B008 A)20:04
anteayayay20:04
clarkbthats a funny way for copy pasta to work20:04
clarkbcopy what yoy see not what is there20:05
fungiwhich is 0xf0908080 according to .encode('utf-8')20:05
fungiclarkb: well, most of the vectors in that file are invalid constructs meant to test error handling20:06
*** Svedrin has left #openstack-infra20:07
fungibut i've confirmed manually that the glyphs in https://etherpad.openstack.org/p/broken-utf8-4 are truly 4-byte utf-8 so now i'm really curious to know what taron used to break that test pad on etherpad-dev20:07
fungithough not curious enough to go tracking it down in etherpad's terrible, terrible database20:07
clarkb:)20:08
*** davideagnello has joined #openstack-infra20:08
*** jistr has joined #openstack-infra20:08
anteayaone table for all the things20:08
*** ddieterly has joined #openstack-infra20:08
clarkbsomething something and in the darkness bind them20:08
fungianteaya: it's worse than that20:10
fungione table with only two colums20:10
anteayaoh goodness20:10
anteayaand one is a primary key, yeah?20:11
fungibasically an index and the data20:11
fungithey're using an sql table as a key/value store20:11
anteayaha ha ha20:11
fungiliterally the table is called "store" and the columns are named "key" and "value"20:11
anteayaha ha ha20:11
anteayaI'm only laughing because I don't have server permissions20:12
*** davideagnello has quit IRC20:12
anteayaand at this rate, never expect to20:12
anteayahow aweful20:12
fungii saw their database schema for the first time a couple years ago, and it still makes me laugh20:12
anteayawas it drawn in crayon?20:13
clarkband key is a reserved word so if you are sql noob like me you get sql errors using it without proper quoting20:13
anteayaone rectangle with a cross inside20:13
anteayaha ha ha20:13
anteayalovely20:13
fungiburnt sienna for the lines and burnt umber for the labels. it was very tasteful20:13
anteayaha ha ha20:13
anteayaI do love the burnts20:14
*** fifieldt_ has joined #openstack-infra20:19
*** mpaolino has joined #openstack-infra20:20
*** mpaolino has quit IRC20:20
*** fifieldt has quit IRC20:22
*** Sukhdev_ has quit IRC20:23
*** otter768 has joined #openstack-infra20:23
*** dguerri` is now known as dguerri20:24
*** dguerri is now known as dguerri`20:25
*** waynr has quit IRC20:31
*** waynr has joined #openstack-infra20:31
*** otter768 has quit IRC20:33
*** mrunge has quit IRC20:34
openstackgerritMerged openstack/requirements: Exclude yaql 0.3.0 from requirements  https://review.openstack.org/19697720:41
*** _nadya_ has joined #openstack-infra20:42
*** Longgeek has quit IRC20:44
*** jtomasek has quit IRC20:44
openstackgerritsebastian marcet proposed openstack-infra/openstackid: [smarcet]  https://review.openstack.org/19845820:44
*** Longgeek has joined #openstack-infra20:45
*** _nadya_ has quit IRC20:46
*** Longgeek has quit IRC20:49
*** jistr has quit IRC20:50
*** sdake_ has joined #openstack-infra20:52
*** rlandy has quit IRC20:53
*** sdake has quit IRC20:55
*** peristeri has quit IRC20:58
*** mtanino has joined #openstack-infra21:01
*** rfolco has quit IRC21:03
*** amotoki has quit IRC21:05
*** jasondotstar has joined #openstack-infra21:08
*** aysyd has quit IRC21:11
openstackgerritSpencer Krum proposed openstack-infra/system-config: Script to install modules during integration  https://review.openstack.org/19844221:12
nibalizerclarkb: haha that same thing bit me too21:12
openstackgerritSpencer Krum proposed openstack-infra/puppet-openstackci: Update spec helper for zuul-cloner  https://review.openstack.org/18490521:14
*** ldnunes has quit IRC21:15
openstackgerritSpencer Krum proposed openstack-infra/puppet-openstackci: Check resources in the openstackci::loghost class  https://review.openstack.org/19846321:21
openstackgerritSpencer Krum proposed openstack-infra/puppet-openstackci: Check resources in the openstackci::loghost class  https://review.openstack.org/19846321:23
openstackgerritSpencer Krum proposed openstack-infra/puppet-openstackci: Update spec helper for zuul-cloner  https://review.openstack.org/18490521:23
*** tjones1 has joined #openstack-infra21:25
*** HeOS has joined #openstack-infra21:29
*** gordc has quit IRC21:30
*** hashar has quit IRC21:33
*** marcusvrn has quit IRC21:34
*** sdake_ is now known as sdake21:34
sdakecan someone provide me directions to make it so chanserv will permanently recognize my name and allow myself to be op'ed in channel #kolla?21:39
sdake(so I can change topic when occasion merits it)21:39
lifelessclarkb: I did21:42
fungisdake: looks like Slower and rhallisey are the current operators recognized by chanserv for that channel21:42
lifelessfungi: saturday :/ family day but I'll see what I can do21:42
sdakefungi yes I can get them to type commands to add me21:42
sdakebut I dont know what commands to type21:42
sdakeor if someone could use superpowers to fix i'd super appreciate that :)21:42
sdakeI am the elected PTL, should be able to select topic of the channel ;-)21:43
fungilifeless: nothing you need to get to today. just next time you're hacking on stuff21:43
sdakefungi mind throwing me a bone and telling me what cmamnds to feed to slower or rhallisey?21:44
fungisdake: patience. it takes me a few minutes to look these things up21:44
sdakeoh cool sorry dude :)21:44
*** tjones1 has quit IRC21:44
sdakemy bad21:44
fungisdake: if they want to give you full channel control that Slower has, then /msg chanserv access #kolla add sdake +Aefortv21:45
fungisdake: though swap out that o for O if you want chanserv to auto-op you21:45
sdakefungi thanks21:45
sdakenah I dont need autoop21:46
sdakeits only to change topics21:46
*** Longgeek has joined #openstack-infra21:46
fungisdake: you can get by with just +t for topic access21:46
sdakeprobably better i have full channel control tbh21:46
sdakeso i'll go with op, they dont care21:46
sdakethey just dont know what to do ;)21:46
fungiwith o you can op yourself as needed with something like /msg chanserv op #kolla21:47
*** eantyshev has quit IRC21:47
*** ildikov has quit IRC21:47
*** ildikov has joined #openstack-infra21:47
fungibut O just auto-sets op on you when you /join the channel21:47
sdakeya, find people that need that are ego-maniacs :)21:48
sdakemy ego is big enough already :(21:48
lifelessfungi: unbreaking oslo library tests is perhaps urgent :)21:48
fungisdake: also the chanserv bot (and all freenode's service bots) have great context help. just /msg chanserv help21:48
sdakeya rtfm from now on :)21:48
sdakethanks21:48
fungiyw!21:48
sdakeI do know how to use irc pretty well just these tricky things were invented after i learned how to use irc oh 20 years ago or so ;)21:49
fungisdake: you and me both. this is why i still have to look up this sort of stuff. just don't do it often enough to memorize the details unfortunately21:50
fungiand different irc networks run different service bot software with different syntax and different flags21:50
*** erlon has quit IRC21:50
lifelessyah21:50
lifelessIRC - its as standard as using high level libraries in C21:50
fungiheh21:50
persiaAt least the sorts of services available from the bots seems to have begun to stabilise21:51
fungiyes, they've been nicely converging21:51
fungibut also the irc networks have been more or less merging or dying off21:51
sdakelifeless wrong channel, but there is a kolla midcycle - might find it helpful for hp to send a cat there - since you may be using kolla one day in my great hopes and dreams ;)21:51
sdakeya funding thing21:52
sdakepretty sure all the high tech companies would pick up funding for freenode if needbe :)21:52
sdakeif they aren't already21:52
lifelesssdake: a /cat/ ?21:52
*** dprince has quit IRC21:52
sdakea cat is a person21:52
sdakeamerican slang for cowboy dev ;)21:52
fungisdake: lifeless: mordred will sling wet cats at your midcycle if you want21:52
sdakeit woudl be fantastic to have mordred there although i'm sure he is super busy21:53
lifelesssdake: ah21:53
lifelesssdake: yes, I think having someone there would make sense21:53
sdakesince we are using shade  a dep21:53
sdakesince its local i htink the costs would be low21:53
persiasdake: Feel free to shame anyone who both has cash and doesn't appear at https://freenode.net/acknowledgements.shtml21:53
sdakeregistration info is on #kolla or the ml21:53
clarkbwhats local mean21:53
lifelessclarkb: if you're around - https://review.openstack.org/#/c/198185/ - ready for +2A21:54
sdakeoh, san jose clarkb21:54
persiaclarkb: Inside martian orbit21:54
sdakeisn't hp in sjc?21:54
*** heyongli has quit IRC21:54
fungisanta clara i think. not being californian i have no idea how far apart those are21:54
persiaSame public transit network21:55
sdakeanyway wrong channel sorry for noise ;)21:55
fungithough the sorts of hp people you'd want popping up at that are likely working from home anyway, so location is less predictable21:55
clarkbright :)21:55
fungiat least that's what i've been able to gather21:55
clarkblocal for most is home office/cafe/airplane21:55
sdakefungi ack on that21:56
fungi"local" is sort of meaningless in openstackland21:56
sdakewell we are having on site21:56
*** mmedvede has quit IRC21:56
sdakebut it should have reasonable remote access if you can stomach using webex ;-)21:56
*** heyongli has joined #openstack-infra21:56
openstackgerritlifeless proposed openstack/requirements: Fix editing constraints files with urls in them.  https://review.openstack.org/19818621:56
*** davideagnello has joined #openstack-infra21:56
lifelesssdake: HP Cloud has uhm, lots of offices21:57
sdakelifeless ya cisco has a funch of facilities21:57
sdakebunch21:57
sdakepersia what is the minimum donation amount - any idea?21:57
lifelesssdake: ignoring work from home, there's at least.... 6 offices i can think of21:57
*** Longgeek has quit IRC21:58
*** r-daneel has quit IRC21:58
sdakepersia surprised not to see more big openstack names in the list21:59
clarkblifeless out of curiousity what type of value gets assigned to location in the tuple?22:00
clarkboh child cjange22:00
fungiclarkb: url/uri22:01
*** davideagnello has quit IRC22:01
clarkblocation = m.group('url')22:01
*** ociuhandu has joined #openstack-infra22:05
*** madong has joined #openstack-infra22:08
*** madong has quit IRC22:09
*** larainema has joined #openstack-infra22:11
lifelessclarkb: '-e file://...' or 'file:////'22:12
*** ociuhandu has quit IRC22:15
persiasdake: I don't know at all: when I've been involved with a contributing organisation, someone else always dealt with the details.22:25
sdakepersia ack22:28
mordredsdake: I'd be more than happy to come talk about shade and stuff - although I'm not planning on being in SJC any time in the near future22:32
mordredsdake: I actually have _zero_ plans to be in SJC - although I expect some to come up :)22:32
sdakemordred yar our midcycle is 28th/29th22:32
sdake;-)22:32
mordredof july?22:32
sdakeyar22:32
mordrednope. I'll be on the beach in panama22:32
sdakein sjc about 10 min drive from airport22:32
sdakenice I wish I was at a beach in panama right now!22:32
mordredI like you and all22:32
mordredbut let's be honest :)22:33
*** otter768 has joined #openstack-infra22:34
*** otter768 has quit IRC22:39
*** fawadkhaliq has joined #openstack-infra22:39
*** otter768 has joined #openstack-infra22:43
*** dboik has joined #openstack-infra22:47
*** dboik has quit IRC22:51
*** fawadkhaliq has quit IRC22:52
*** Longgeek has joined #openstack-infra22:55
*** dims_ has joined #openstack-infra23:01
*** sdake has quit IRC23:01
*** sdake has joined #openstack-infra23:03
openstackgerritMerged openstack/requirements: Add location to requirement.Requirement  https://review.openstack.org/19818523:03
lifelesssdake: thats pyconau time, so you can't have me eitehr :023:05
*** dims_ has quit IRC23:07
anteayajust looking at the schedule23:09
anteayaI hope whoever is leading the mid-cycle at IBM in Austin makes sure they have working wifi23:09
anteayathey didn't in January23:10
lifelessok so https://review.openstack.org/#/c/198188/ is in the critical bucket IMO23:14
*** dims_ has joined #openstack-infra23:14
lifelesshow do I get review bandwidth on it ?23:14
lifelessmtreinish: ^23:14
fungii was able to get the ubuntu-trusty diskimages uploaded into dfw and iad so far on the first try using the image-upload subcommand, though i've only been running one at a time. ord is running now and looks like it will probably work too. i wonder if we're normally uploading them all in parallel and saturating the interface23:15
*** mnaser has quit IRC23:15
*** Longgeek has quit IRC23:17
*** dims_ has quit IRC23:18
lifelesssdague: dtroyer: mtreinish: chmouel: ianw: jeblair_: https://review.openstack.org/#/c/198188/ if +A'd should unblock dvsm runs in the oslo space that folk are having trouble with23:20
fungii think i'm caught up on all my pymysql transition patches now too. holidays are great for getting things done23:21
*** mnaser has joined #openstack-infra23:22
*** esmute___ has joined #openstack-infra23:41
*** esmut____ has joined #openstack-infra23:43
*** jasondotstar has quit IRC23:43
*** esmute__ has quit IRC23:44
*** tjones1 has joined #openstack-infra23:45
*** davideagnello has joined #openstack-infra23:45
*** esmute___ has quit IRC23:46
*** tjones1 has left #openstack-infra23:49
*** davideagnello has quit IRC23:50
taronfungi: bit late but you pasted the same set of characters I did23:55
fungitaron: thanks for confirming! maybe production is less broken than our dev deployment23:55
* taron crosses their fingers23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!