Tuesday, 2015-11-24

clarkbanteaya: when there is a cross wind and no head on runway planes have to land funny http://www.newschoolbeer.com/2015/11/breakside-brewery-to-open-new-northwest-portland-brewpub.html00:00
clarkbthats the wrong link but also a good one00:00
anteayaha ha ha00:00
clarkbhttps://www.youtube.com/watch?v=r-pmnGAe8EQ there video00:00
anteayaha ha ha00:00
anteayathe beer link is to prep for the vid00:00
clarkbbasically they point their nose into the wind but because of the wind they still go in direction of runway00:00
clarkbthen once back wheels are down they point nose forward and finish up landing00:01
pleia2heh, poor airplanes00:01
*** rbrndt has quit IRC00:02
fungidefinitely not one to watch before getting on a flight00:02
*** Sukhdev has quit IRC00:02
clarkbthere are two tells as a passenger, the first one is just looking out the window00:02
*** sridhar_ram1 has quit IRC00:02
clarkbthe other is if the plane does a rotation after wheels down00:02
*** apoorvad has quit IRC00:03
docaedoclarkb: crosswind landings are neat and all but that breakside link is great news, thanks for sharing!00:03
clarkbdocaedo: :) also I tried that commons farmhouse and its ok00:04
clarkbdocaedo: a bit sweet for me00:04
clarkb(needed more hops imo to cut the sweetness)00:04
clarkbor drier ferment00:04
*** otter768 has joined #openstack-infra00:04
*** sridhar_ram has joined #openstack-infra00:04
*** Sukhdev has joined #openstack-infra00:04
anteayaclarkb: glad you had a good flightdeck team00:04
clarkbdocaedo: the only problem with that location is its too close to the twin's pediatrician >_>00:06
docaedoclarkb: ah ok fair enough re: farmhouse ale. Maybe I'm loving it because I don't usually like sour/farmhouse ales but that one seems just right00:06
*** lhcheng has quit IRC00:07
docaedoas long as we're talking about beer, have a favorite CDA recipe? I need to brew post thanksgiving :)00:07
clarkbdocaedo: I really like farmhouse to be dry and funky00:07
clarkbdocaedo: let me pull up beersmith on other computer really quick00:07
clarkbno CDA there hrm maybe its on other other computer I don't have access to00:08
*** apoorvad has joined #openstack-infra00:08
*** akshai has quit IRC00:08
openstackgerritMerged openstack-infra/irc-meetings: neutron_upgrades: added meeting_id and agenda_url  https://review.openstack.org/24746400:08
openstackgerritMerged openstack-infra/irc-meetings: Changed from Chef Cookbooks to OpenStack-Chef  https://review.openstack.org/24882900:09
*** sfinucan has quit IRC00:09
*** gouthamr has quit IRC00:09
docaedoclarkb: on paper this looks good to me but hard to tell for sure - https://www.brewtoad.com/recipes/pdx-cda-ba52d900:09
*** boris-42 has joined #openstack-infra00:09
*** hichihara has joined #openstack-infra00:10
*** pradk has joined #openstack-infra00:10
*** signed8bit is now known as signed8bit_ZZZzz00:10
clarkb20% specialty malt seems high00:10
*** tsg has quit IRC00:10
pleia2sweet farmhouse ales are always a bit disappoint00:11
clarkbthe internets say not really. Brewing all those SMaSH beers has polluted my brain00:12
clarkbdocaedo: my typical brew has been wyeast 1056, 11 lb maris otter, 4 oz of $hop00:12
clarkbstupid simple but so good00:12
docaedoclarkb: that sounds good00:12
clarkbmash at 152F00:13
clarkbI really like simcoe and galaxy00:13
* pleia2 named her cat simcoe \o/00:14
pleia2obviously it's one of my favorites too :)00:14
*** Sukhdev has quit IRC00:14
docaedosimcoe is good - I've been doing single-hop IPAs with citra for a while, I think it's one of my favs00:15
*** signed8bit_ZZZzz is now known as signed8bit00:15
clarkbdocaedo: oh gigantic publishes their recipes let me see if they have one00:15
clarkbdocaedo: http://giganticbrewing.com/media/Black-Friday-Imperial-CDA-Recipe.docx00:16
clarkbdocaedo: even the name is on point :)00:16
*** openstackgerrit has quit IRC00:16
*** openstackgerrit has joined #openstack-infra00:17
*** markmcd has quit IRC00:17
docaedoclarkb: ooh thanks!00:17
*** markmcd has joined #openstack-infra00:19
clarkbyou can probably cut the sugar and mash at 149F ish00:19
openstackgerritSahdev Zala proposed openstack/requirements: Add tosca-parser to the global requirments projects  https://review.openstack.org/24895000:19
clarkband their hop utilization is going to be much better than a homebrewers so adjust that until IBUs look right00:20
clarkbbasically scale down to your gear then scale back up to get IBUs00:20
*** Sukhdev has joined #openstack-infra00:20
clarkbdocaedo: do you beersmith? its like magical and runs on linux00:22
clarkbvery good for mathsing this stuff00:22
*** otter768 has quit IRC00:23
*** rossella_s has quit IRC00:23
*** rossella_s has joined #openstack-infra00:23
docaedoclarkb: I do not, I always figured I did not brew enough to buy software (but then imagined it cost more than two growler fills) You've almost sold me...00:24
*** sflanigan has joined #openstack-infra00:25
*** sflanigan has joined #openstack-infra00:25
*** ivar-laz_ has joined #openstack-infra00:26
*** ivar-lazzaro has quit IRC00:26
clarkbyou can use it free for some time period00:26
clarkbtry it and decide?00:26
*** otter768 has joined #openstack-infra00:26
docaedoclarkb: this will happen, and one day soon my taps will once again flow with beer!00:27
*** rlandy has quit IRC00:29
*** rlandy has joined #openstack-infra00:30
*** Sukhdev has quit IRC00:33
*** js5175-att has quit IRC00:33
*** signed8bit is now known as signed8bit_ZZZzz00:37
*** rebase has quit IRC00:39
greghaynesdocaedo: clarkb I use an android app that is free00:43
greghaynesIt is called "wort"00:43
*** salv-orlando has quit IRC00:43
docaedogreghaynes: for free I do like brewtoad (especially since it doesn't matter which device I use), but I will look at this wort app you speak of00:44
greghaynesI havent done a ton of research into the different apps, it works and is free so I kind of stopped my search there ;)00:44
*** bpokorny has quit IRC00:44
*** otter768 has quit IRC00:45
*** sdake_ has joined #openstack-infra00:45
*** sdake has quit IRC00:45
*** gildub has joined #openstack-infra00:47
docaedogreghaynes: other nice thing about brewtoad.com is you can find some good recipes there :)00:48
openstackgerritTim Hinrichs proposed openstack-infra/project-config: Fix congress ENABLED_SERVICES  https://review.openstack.org/24895600:48
anteayatonyb: you about?00:48
tonybanteaya: Yup00:48
tonybanteaya: how can I help?00:49
anteayatonyb: seems the docs team has a meeting scheduled: http://lists.openstack.org/pipermail/openstack-docs/2015-November/007916.html but I don't have the channel booked in my ical feed00:49
anteayaand some poor soul showed up and is the lone participant00:49
anteayajust letting you know the meeting isn't in ical00:49
tonybHmm okay  I'll look into it.00:50
anteayatonyb: problem solved00:51
anteayaparticpant is a day early00:51
tonybanteaya: wrong week?00:51
anteayaright week, wrong day00:51
tonybanteaya: Ahhh00:51
anteayathanks, sorry for noise00:51
tonybanteaya: np00:51
*** bpokorny has joined #openstack-infra00:51
*** Swami has quit IRC00:53
*** r-daneel has quit IRC00:55
openstackgerritJames E. Blair proposed openstack-infra/system-config: Sent HAProxy stats to statsd  https://review.openstack.org/24896100:56
jeblairclarkb, fungi, mordred, yolanda: ^ that's ready, and it's now running on git.o.o00:56
fungithanks, that'll be handy for troubleshooting when we get more failures (saw another one hit e-r today)00:57
jeblairclarkb, fungi, mordred, yolanda: so... i've been thinking that since it's looking like systemd is the winner in the init wars, perhaps we should consider using systemd unit files...00:58
*** xyang1 has quit IRC00:58
jeblairclarkb, fungi, mordred, yolanda: if we decide not to, and stick with sysvinit compatibility, i'm perfectly happy to rework that change to do that00:58
fungiyeah, i've written at least one. they're pretty simple as long as you want to do common/simple things00:58
clarkbjeblair: I am happy to systemd, the git daemon for the backends already does so00:59
clarkbits just easier to leverage the thing that the distros want you to use00:59
jeblairclarkb: ah, okay, precedent00:59
jeblairi didn't see any sysvinit for centos, so i thought this would be easier00:59
fungii do enjoy the lack of boilerplate scripting at least00:59
anteayajeblair: whitespace oops00:59
nibalizerjeblair: you have some whitespace in the python script00:59
jeblair(especially since i haven't bothered to actually daemonize the script)00:59
anteayajeblair: I heard you copyright that00:59
*** hidekazu has joined #openstack-infra01:00
openstackgerritJames E. Blair proposed openstack-infra/system-config: Sent HAProxy stats to statsd  https://review.openstack.org/24896101:01
jeblairanteaya: it's an important part of my artistic vision01:01
jeblairyou're all cramping my stile01:01
anteayaha ha ha01:01
* anteaya moves back01:01
jesusaurusjeblair: on the topic of putting more things in statsd, did you happen to see https://review.openstack.org/246037 ?01:02
*** yamamoto has joined #openstack-infra01:02
*** elo has joined #openstack-infra01:03
* anteaya goes back to looking up geocentric planetary nodes01:03
jeblairoverall https connections per second ^01:03
jeblair(the gaps are me restarting the injector)01:05
*** sridhar_ram has quit IRC01:05
*** sridhar_ram1 has joined #openstack-infra01:05
jeblairjesusaurus: not yet, thanks...01:05
*** eil397 has quit IRC01:06
*** sridhar_ram1 has quit IRC01:07
*** yamamoto has quit IRC01:07
anteayaah I wondered01:08
*** nelsnelson has quit IRC01:09
clarkbjeblair: ya so trying to coordinate between sysv compat layer and systemd or upstart is painful01:12
*** sridhar_ram has joined #openstack-infra01:12
*** sdake_ is now known as sdake01:12
*** eliqiao_ is now known as eliqiao01:12
*** glauco_ has quit IRC01:13
clarkbthats sort of why I gave up and am embracing systemd for service management01:13
clarkbit was either that or run gentoo :)01:13
*** glauco has joined #openstack-infra01:13
openstackgerritKirill Zaitsev proposed openstack-infra/irc-meetings: Adds agenda and id to murano meeting info  https://review.openstack.org/24896601:14
hidekazuhello, I want to update irc-meeting yaml file to show murano meeting logs and agenda. I saw irc-meetings repository. https://github.com/openstack-infra/irc-meetings But I can't find how to commit irc-meetings repository.01:14
clarkbjeblair: it might be nice to have a docstring/comment with example output from haproxy01:14
clarkbhidekazu: its the same method as any other openstack project01:14
mordredclarkb: docker01:14
clarkbhidekazu: http://docs.openstack.org/infra/manual/developers.html01:14
clarkbmordred: there ar ea lot of things you cna't and shouldn't docker though01:14
clarkblike iscsi01:15
mordredclarkb: totes01:15
mordredclarkb: well01:15
*** sputnik13 has quit IRC01:15
hidekazu@clarkb: thanks! should I report bug?01:15
mordredclarkb: who wants iscsi really?01:15
clarkbhidekazu: no just updating it is fine01:15
jeblairclarkb: yep.  unfortunately, i don't have that handy.01:15
hidekazu@clarkb: thanks again. I will do.01:15
*** rebase has joined #openstack-infra01:15
* anteaya notes that is a great nick01:16
*** apoorvad has quit IRC01:17
pabelangerfungi: wouldn't mind your feedback: https://review.openstack.org/#/c/248317/01:17
pabelangerclarkb: do you mind commenting when you have a moment? https://github.com/puppetlabs/puppetlabs-apache/pull/127101:18
pabelangerclarkb: want to make sure it is what you expected01:18
*** sambetts-afk has quit IRC01:18
jeblairjesusaurus: i left a few comments on https://review.openstack.org/24603701:19
clarkbjeblair: I think pep8 doesn't like the trailing whitespace01:20
clarkband other than the comment/docstring lgtm can add that ina followup01:21
*** ashleighfarnham has quit IRC01:21
openstackgerritJames E. Blair proposed openstack-infra/system-config: Sent HAProxy stats to statsd  https://review.openstack.org/24896101:22
*** ccrouch has quit IRC01:23
clarkbpabelanger: yes general shape looks good01:24
clarkbpabelanger: how does it handle notifying the service? is the consumer of that define supposed to do it themselves?01:24
*** sridhar_ram has quit IRC01:25
clarkboh its after the github comments01:25
clarkbthats almost impossible to read, thanks github01:25
clarkbpabelanger: I don't think mode is meaningful on a symlink but other than that ya lgtm01:25
jesusaurusjeblair: thanks for the comments. is your concern that making this information available would lead to tooling that depends on the information? my think is that these numbers would allow us to more intelligently tweak the algorithm, not prevent us from tweaking the allocation algorithm01:25
*** hdd has joined #openstack-infra01:26
pabelangerclarkb: ya, we expect custom_config.pp to handle the notifications, so far from what I tested it works as expected01:26
*** Yanyanhu has joined #openstack-infra01:28
*** jgriffith_away is now known as jgriffith01:30
*** ivar-lazzaro has joined #openstack-infra01:32
*** tiswanso has quit IRC01:33
*** hurgleburgler has quit IRC01:34
*** bcourt has quit IRC01:35
*** ivar-laz_ has quit IRC01:36
*** ivar-lazzaro has quit IRC01:36
*** zhenguo has joined #openstack-infra01:38
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: bdist_wheel/universal is the canonical option  https://review.openstack.org/24897201:38
*** baoli has quit IRC01:38
*** baoli has joined #openstack-infra01:39
*** thorst has joined #openstack-infra01:40
*** tiswanso has joined #openstack-infra01:40
*** thorst has quit IRC01:40
*** thorst has joined #openstack-infra01:41
*** julim has joined #openstack-infra01:43
*** hidekazu has left #openstack-infra01:46
*** fitoduarte has quit IRC01:50
*** zhurong has joined #openstack-infra01:52
jeblairjesusaurus: i think the question is whether you want this for nodepool users to tune their params, in which case we should keep it simple and stable, or nodepool devs to tune the algorithm, in which case we shouldn't spend much time on it because it's getting replaced in zuulv3.01:56
jeblairjesusaurus: my feedback was assuming the former :)01:57
*** tsg has joined #openstack-infra01:57
*** Kennan has quit IRC01:57
openstackgerritIan Wienand proposed openstack-infra/zuul: Update to statsd 3.0  https://review.openstack.org/22923201:57
openstackgerritIan Wienand proposed openstack-infra/zuul: Handle a float in assertReportedStat  https://review.openstack.org/24897501:57
*** glauco has quit IRC01:59
*** glauco has joined #openstack-infra02:00
SpamapSjeblair: re os-performance-tools installed not on the image: sure. I wasn't sure about that either. :)02:03
*** Yanyanhu has quit IRC02:03
*** thorst has quit IRC02:04
*** glauco has quit IRC02:04
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Add DIB_LOCAL_CONFIG_USERNAME  https://review.openstack.org/24897602:06
pabelangerianw: thoughts? ^02:06
*** kgiusti has quit IRC02:06
*** pcrews has quit IRC02:07
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Add DIB_LOCAL_CONFIG_USERNAME to local-config  https://review.openstack.org/24897602:07
*** thorst has joined #openstack-infra02:08
*** shashank_hegde has quit IRC02:09
ianwpabelanger: interesting, i haven't really used that, but seems ok ... you want this to override "cloud-user"?02:10
ianwi generally attach an iso with my key to be picked up02:11
*** rhallisey has quit IRC02:11
*** amotoki has joined #openstack-infra02:13
pabelangerianw: Ya, there might be a better way to do it. But I couldn't see any other way to add a local ssh key to the existing cloud user account02:13
pabelangerI mean, I could build an element to do it, but this seems to be one way to add it using existing elements02:13
*** yamamoto has joined #openstack-infra02:17
*** Kennan has joined #openstack-infra02:17
openstackgerritDi Xu proposed openstack-infra/jenkins-job-builder: Support deep merge of defaults  https://review.openstack.org/15073002:18
*** signed8bit_ZZZzz is now known as signed8bit02:19
*** yamamoto has quit IRC02:21
*** thorst has quit IRC02:22
*** apoorvad has joined #openstack-infra02:23
openstackgerritMerged openstack-infra/project-config: Add ansible-role-zuul project  https://review.openstack.org/24831702:24
*** btully has quit IRC02:28
openstackgerritgreghaynes proposed openstack-infra/nodepool: Make secure.conf optional and backwards-compat  https://review.openstack.org/23280002:28
*** signed8bit has quit IRC02:32
*** gouthamr has joined #openstack-infra02:34
*** david-ly_ has quit IRC02:36
*** bcourt has joined #openstack-infra02:37
greghaynespabelanger: check out http://docs.openstack.org/developer/diskimage-builder/elements/devuser/README.html02:37
*** rguillebert has quit IRC02:37
greghaynespabelanger: ah, you want to use an existing user in the image02:38
greghaynesfair enough02:38
*** glauco has joined #openstack-infra02:38
*** dims has joined #openstack-infra02:40
pabelangergreghaynes: ya, I see that too. Some overlap02:41
*** Kennan has quit IRC02:42
*** shashank_hegde has joined #openstack-infra02:45
*** otter768 has joined #openstack-infra02:46
*** salv-orlando has joined #openstack-infra02:47
*** otter768 has quit IRC02:50
*** eil397 has joined #openstack-infra02:56
*** rebase has quit IRC02:56
*** eil397 has quit IRC02:59
*** salv-orlando has quit IRC02:59
*** eil397 has joined #openstack-infra02:59
*** bardia has quit IRC03:00
*** yamamoto has joined #openstack-infra03:04
*** Sree has joined #openstack-infra03:08
*** rlandy has quit IRC03:10
*** ramineni has joined #openstack-infra03:12
*** Kennan has joined #openstack-infra03:13
raminenihi, could someone please review https://review.openstack.org/#/c/248956/ ,03:13
raminenineed to get it merged quickly as tempest tests are failing because of it :(03:13
*** jhesketh has joined #openstack-infra03:14
*** pradk has quit IRC03:15
*** dims has quit IRC03:17
*** eil397 has quit IRC03:18
*** pcrews has joined #openstack-infra03:19
*** xiexs_ has quit IRC03:20
*** dims has joined #openstack-infra03:22
*** yuanying has quit IRC03:23
*** pcaruana has quit IRC03:27
*** apoorvad has quit IRC03:27
openstackgerritDi Xu proposed openstack-infra/jenkins-job-builder: Support deep merge of defaults  https://review.openstack.org/15073003:30
*** rick_ has joined #openstack-infra03:32
*** dims has quit IRC03:35
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config: Fix a typo in tap-as-a-service job template  https://review.openstack.org/24898703:41
*** gildub has quit IRC03:46
*** kushal has joined #openstack-infra03:49
*** asselin has joined #openstack-infra03:51
*** asselin_ has joined #openstack-infra03:52
*** spzala has quit IRC04:01
*** asselin_ has quit IRC04:05
*** asselin has quit IRC04:05
*** bpokorny has quit IRC04:06
*** spzala has joined #openstack-infra04:06
*** yuanying has joined #openstack-infra04:08
*** david-lyle has joined #openstack-infra04:08
zaroclarkb: maybe we leave it for hugo to investigate.  we do have workarounds for it, even revert in our fork if necessary.04:09
*** akshai has joined #openstack-infra04:10
*** hdd has quit IRC04:10
*** thorst has joined #openstack-infra04:11
*** akshai_ has joined #openstack-infra04:11
*** otter768 has joined #openstack-infra04:13
*** bcourt has quit IRC04:14
*** akshai has quit IRC04:15
*** thorst has quit IRC04:15
*** gildub has joined #openstack-infra04:16
*** ayoung has quit IRC04:20
*** btully has joined #openstack-infra04:29
openstackgerritDi Xu proposed openstack-infra/jenkins-job-builder: Support deep merge of defaults  https://review.openstack.org/15073004:31
*** shashank_hegde has quit IRC04:32
*** pcrews has quit IRC04:32
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Fix up the tests and add tox configuration to run them  https://review.openstack.org/23463704:33
notmynamedoes infra run ask.openstack.org/04:39
notmynamecause it's down right now04:39
openstackgerritMerged openstack-infra/irc-meetings: Adds agenda and id to murano meeting info  https://review.openstack.org/24896604:39
StevenKWell, it's up, it's just ISEing04:43
*** spzala has quit IRC04:44
greghaynesISE ISE baby04:49
openstackgerritMasayuki Igawa proposed openstack/os-testr: Add colored output feature to subunit-trace  https://review.openstack.org/24900504:53
*** mahatic has joined #openstack-infra04:54
*** ddieterl_ has quit IRC04:55
*** maishsk has quit IRC04:56
openstackgerritgreghaynes proposed openstack-infra/nodepool: Make secure.conf optional and backwards-compat  https://review.openstack.org/23280004:56
*** maishsk has joined #openstack-infra04:56
StevenKnotmyname: To answer your question, yes, they do -- it's in system-config and managed by puppet04:57
notmynameStevenK: thanks04:57
openstackgerritJamie Lennox proposed openstack/requirements: Bump version of requests-mock  https://review.openstack.org/24900604:57
greghayneslooks like maybe out of disk space?04:57
greghaynesif not, it is really close04:58
StevenKOr it's hit the reserved FS limit?04:58
*** otter768 has quit IRC04:59
*** chenli has joined #openstack-infra04:59
*** maishsk has quit IRC04:59
*** akshai_ has quit IRC05:00
chenlihello, anyone can help here ? I try to run git review command, I get an error : http://paste.openstack.org/show/47981005:01
openstackgerritMasayuki Igawa proposed openstack/os-testr: Add .eggs/* to .gitignore  https://review.openstack.org/24900805:02
nibalizerits full of postgres backups05:03
chenliany core here >?05:03
StevenKnibalizer: How many postgres backups?05:04
nibalizerwe're configured to store 3005:06
nibalizerwe don't have enough space for that in /var05:06
nibalizerbut we do in /opt05:06
*** maishsk has joined #openstack-infra05:08
*** sdake_ has joined #openstack-infra05:09
*** gouthamr has left #openstack-infra05:10
*** sdake has quit IRC05:10
openstackgerritSpencer Krum proposed openstack-infra/system-config: Move pgsql backups to cinder volume  https://review.openstack.org/24900905:12
*** ashishb has joined #openstack-infra05:14
*** rcernin has joined #openstack-infra05:15
nibalizerchenli: that error seems pretty self-explanatory05:21
nibalizergreghaynes: StevenK: want to review ^^05:21
*** Sukhdev has joined #openstack-infra05:24
clarkbniablizer I think you can go ahead and move a bunch to get service happy again then worry about that patch in the morning if you like05:25
clarkbI think we should consider fewer backups if / ismt big enough too05:26
clarkbnibalizer are they getting properly compressed? if so I am impressed by our ability to generate text :)05:26
*** sdake_ has quit IRC05:26
nibalizerclarkb: ya i'm moving files now05:27
nibalizerits back :)05:29
*** achanda has joined #openstack-infra05:29
nibalizerI've moved a few of the backup files to /opt05:29
nibalizerclarkb: the backups are about 600 MB now05:29
clarkband file reports they are gzipped?05:30
clarkbthats an awful lot of human generated text05:31
nibalizeryes, they have .gz in the name, file reports as gziped, and they respond as expected to zcat05:31
*** rcernin has quit IRC05:34
*** sabeen has joined #openstack-infra05:38
*** mahatic has quit IRC05:38
*** maishsk has quit IRC05:41
*** achanda has quit IRC05:41
*** mahatic has joined #openstack-infra05:43
*** Sukhdev has quit IRC05:45
*** harlowja_at_home has joined #openstack-infra05:48
*** pcaruana has joined #openstack-infra05:49
*** aukhan has joined #openstack-infra05:51
*** abregman has joined #openstack-infra05:55
*** ddieterly has joined #openstack-infra05:55
*** salv-orlando has joined #openstack-infra05:56
*** nelsnelson has joined #openstack-infra05:58
*** ddieterly has quit IRC06:00
*** salv-orlando has quit IRC06:01
*** hughhalf has quit IRC06:04
*** zhurong_ has joined #openstack-infra06:05
*** zhurong has quit IRC06:09
*** gouthamr has joined #openstack-infra06:10
*** shashank_hegde has joined #openstack-infra06:11
*** nadya_ has joined #openstack-infra06:11
*** wznoinsk has quit IRC06:11
*** wznoinsk has joined #openstack-infra06:12
*** hughhalf has joined #openstack-infra06:12
*** aopincar has joined #openstack-infra06:12
*** pasquier-s has quit IRC06:13
*** thorst has joined #openstack-infra06:13
*** pasquier-s has joined #openstack-infra06:14
*** Ramanjaneya has joined #openstack-infra06:16
*** thorst has quit IRC06:17
*** rcernin has joined #openstack-infra06:18
*** Ramanjaneya has quit IRC06:26
*** pcaruana has quit IRC06:28
*** mrmartin has joined #openstack-infra06:31
*** mahatic has quit IRC06:31
*** Ramanjaneya has joined #openstack-infra06:32
*** nadya_ has quit IRC06:33
*** mrmartin has quit IRC06:35
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/24903106:36
*** e0ne has joined #openstack-infra06:40
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/24843006:41
openstackgerritMohankumar proposed openstack-infra/project-config: Add networking-sfc-dashboard  https://review.openstack.org/24869506:43
*** boris-42 has quit IRC06:48
*** rick_ has quit IRC06:53
*** ddieterly has joined #openstack-infra06:57
*** nadya_ has joined #openstack-infra06:59
*** HeOS has quit IRC07:01
*** ddieterly has quit IRC07:01
openstackgerritTom Fifield proposed openstack-infra/shade: Add Swift Object Download support  https://review.openstack.org/24903907:03
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/24903107:03
*** e0ne has quit IRC07:08
*** otter768 has joined #openstack-infra07:11
*** chenli has left #openstack-infra07:14
*** jgriffith is now known as jgriffith_away07:15
*** otter768 has quit IRC07:15
*** pcrews has joined #openstack-infra07:15
*** btully has quit IRC07:16
*** yonglihe has quit IRC07:21
*** harlowja_at_home has quit IRC07:23
*** pcrews has quit IRC07:24
openstackgerritMohankumar proposed openstack-infra/project-config: Add networking-sfc-dashboard  https://review.openstack.org/24869507:24
*** mjb has quit IRC07:26
*** vinay_yadhav has joined #openstack-infra07:27
*** rick_ has joined #openstack-infra07:31
*** denisra has quit IRC07:33
*** mjb has joined #openstack-infra07:33
*** sabeen has quit IRC07:33
*** denisra has joined #openstack-infra07:33
*** korzen has joined #openstack-infra07:42
*** ajo has quit IRC07:42
*** scheuran has joined #openstack-infra07:43
*** ajo has joined #openstack-infra07:46
*** nmagnezi has joined #openstack-infra07:47
*** placko has joined #openstack-infra07:48
*** matrohon has joined #openstack-infra07:49
*** btully has joined #openstack-infra07:51
*** btully has quit IRC07:56
*** ddieterly has joined #openstack-infra07:58
*** vinay_yadhav has quit IRC07:59
*** otter768 has joined #openstack-infra08:00
openstackgerrityolanda.robla proposed openstack-infra/system-config: Start using cgit::lb class  https://review.openstack.org/18182908:00
*** HeOS has joined #openstack-infra08:01
*** jyuso1 has joined #openstack-infra08:01
openstackgerritKairat Kushaev proposed openstack/requirements: Bump oslo.middleware to support CORS in glance  https://review.openstack.org/24905708:01
*** larainema has quit IRC08:02
openstackgerritIsaac Beckman proposed openstack-infra/devstack-gate: Only create multinode GRE bridge interfaces once  https://review.openstack.org/23936308:02
*** ddieterly has quit IRC08:02
*** nmagnezi has quit IRC08:02
*** [1]Thelo has joined #openstack-infra08:04
*** gildub has quit IRC08:04
*** matrohon1 has joined #openstack-infra08:05
*** matrohon1 has quit IRC08:05
*** otter768 has quit IRC08:05
*** ramineni has quit IRC08:06
*** Thelo has quit IRC08:06
*** [1]Thelo is now known as Thelo08:06
openstackgerritSteve Kowalik proposed openstack-infra/project-config: Fix two errors in setup_training_guides  https://review.openstack.org/24905808:06
*** ramineni has joined #openstack-infra08:08
*** ramineni has quit IRC08:10
*** gchamoul|AfK is now known as gchamoul08:11
*** ildikov has quit IRC08:11
*** mahatic has joined #openstack-infra08:12
*** larainema has joined #openstack-infra08:12
*** arxcruz has joined #openstack-infra08:12
*** bdemers has quit IRC08:12
*** wuhg has joined #openstack-infra08:13
*** salv-orlando has joined #openstack-infra08:13
*** dingyichen has quit IRC08:13
openstackgerritMerged openstack-infra/project-config: Place constraints comment at proper place  https://review.openstack.org/24887208:14
*** bdemers has joined #openstack-infra08:14
openstackgerritMerged openstack-infra/project-config: Fix a typo in tap-as-a-service job template  https://review.openstack.org/24898708:14
*** ramineni has joined #openstack-infra08:16
*** mpavone has joined #openstack-infra08:16
openstackgerritMerged openstack-infra/project-config: Fix congress ENABLED_SERVICES  https://review.openstack.org/24895608:17
*** salv-orlando has quit IRC08:21
*** mrmartin has joined #openstack-infra08:25
*** kaisers1 has left #openstack-infra08:25
openstackgerritDavid TARDIVEL proposed openstack-infra/project-config: Add coverage check on Watcher.  https://review.openstack.org/24873608:28
*** salv-orlando has joined #openstack-infra08:29
*** fhubik has joined #openstack-infra08:31
*** ifarkas has joined #openstack-infra08:32
*** nmagnezi has joined #openstack-infra08:32
*** salv-orlando has quit IRC08:33
*** rick_ has quit IRC08:33
*** yfried has joined #openstack-infra08:34
*** sshnaidm has joined #openstack-infra08:37
*** Ala has joined #openstack-infra08:40
*** shashank_hegde has quit IRC08:43
*** ildikov has joined #openstack-infra08:43
*** markus_z has joined #openstack-infra08:45
*** sdake has joined #openstack-infra08:45
oomichi"Also, the nosetests test runner is **not** recommended to run Tempest." as :q08:47
oomichi"Also, the nosetests test runner is **not** recommended to run Tempest." on README.rst08:47
*** jlanoux has joined #openstack-infra08:48
*** sdake has quit IRC08:48
*** sdake has joined #openstack-infra08:48
*** dizquierdo has joined #openstack-infra08:48
*** e0ne has joined #openstack-infra08:49
openstackgerritMerged openstack-infra/project-config: Add tacker pypi jobs  https://review.openstack.org/23560208:52
raminenihi, how much time is needed after the infra patch is merged, to take th changes in? for doing a recheck08:54
ramineniinfra patch got merged now, but still jenkins recheck is showng same failure , which should be fixed by merge08:55
yolandaramineni, give it an hour. The change needs to be applied and jobs need to be regenerated08:57
yolandaif in an hour it continues failing, let me know08:57
*** shardy has joined #openstack-infra08:57
ramineniyolanda: thanks for the reply. sure, will check after an hour08:58
*** ddieterly has joined #openstack-infra08:58
*** jordanP has joined #openstack-infra08:59
*** samuelBartel has joined #openstack-infra08:59
*** sdake has quit IRC09:01
*** arxcruz has quit IRC09:01
*** arxcruz has joined #openstack-infra09:01
openstackgerritMerged openstack-infra/project-config: remove python26-jobs from remaining oslo libraries  https://review.openstack.org/24880209:02
*** ddieterly has quit IRC09:03
*** yfried has quit IRC09:03
*** GonZo2000 has quit IRC09:06
*** fhubik is now known as fhubik_brb09:06
*** fhubik_brb is now known as fhubik09:07
andreafyolanda: nice, test nodes are coming up and jobs are running now - just curious, what happened there?09:07
yolandaandreaf, where?09:07
andreafyolanda: with zuul, for a bit I saw no test nodes in the graph, and jobs queued09:08
*** Sree has quit IRC09:08
yolandaandreaf, i don't know , i didn't take any action on that09:08
openstackgerritMerged openstack-infra/project-config: Switch Ansible role jobs to use 'dsvm-functional-trusty'  https://review.openstack.org/24875709:08
yolandathis morning?09:08
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/glean: Fix creation of vlan interfaces in Debian/Ubuntu  https://review.openstack.org/24462509:08
*** zer0c00l has quit IRC09:08
*** Sree has joined #openstack-infra09:09
*** Ala has quit IRC09:09
andreafyolanda: yes - I wonder if it was a stale cache of the graphs or so then09:09
openstackgerritMerged openstack-infra/project-config: Bump RAM to 1G for ironic-inspector IPA job  https://review.openstack.org/24879909:09
*** hashar has joined #openstack-infra09:09
*** fitoduarte has joined #openstack-infra09:09
yolandaandreaf, chart is back again? when that happens, it means that graphite is down09:10
*** mattoliverau has quit IRC09:10
andreafyolanda: ah ok - yes the graph looks good now09:10
openstackgerritMerged openstack-infra/project-config: Move the AMQP 1.0 tests from Fedora21 to Centos7  https://review.openstack.org/24880609:10
*** derekh has joined #openstack-infra09:10
andreafyolanda: but you can see all graphs went down to zero for a bit09:11
*** yamahata has quit IRC09:11
*** matt6434 has joined #openstack-infra09:11
openstackgerritMerged openstack-infra/project-config: Make Horizon Integration Tests voting  https://review.openstack.org/24867309:11
andreafyolanda: http://bit.ly/1Nbv0Xr09:11
yolandaandreaf yes.. let me check logs09:12
openstackgerritMerged openstack-infra/project-config: Add python implementation for monasca-log-api  https://review.openstack.org/24813209:12
*** fhubik is now known as fhubik_brb09:13
*** Ala has joined #openstack-infra09:13
openstackgerritMerged openstack-infra/project-config: Add stable branch notifications to #openstack-dns  https://review.openstack.org/24871209:13
*** adduarte has joined #openstack-infra09:13
openstackgerritMerged openstack-infra/subunit2sql: Add reno release notes to subunit2sql  https://review.openstack.org/24773709:14
*** fitoduarte has quit IRC09:16
*** rguillebert has joined #openstack-infra09:16
*** openstackgerrit has quit IRC09:16
*** dtantsur|afk is now known as dtantsur09:17
*** openstackgerrit has joined #openstack-infra09:17
yolandaandreaf, no relevant errors on zuul09:17
*** claudiub has joined #openstack-infra09:19
*** akscram1 is now known as akscram09:20
*** zhurong_ has quit IRC09:22
*** fhubik_brb is now known as fhubik09:24
*** zeih has joined #openstack-infra09:25
*** mdbooth has joined #openstack-infra09:27
*** sflanigan has quit IRC09:27
*** sflanigan has joined #openstack-infra09:27
*** sflanigan has joined #openstack-infra09:27
*** bexelbie_ has joined #openstack-infra09:30
*** bexelbie_ is now known as bexelbie09:31
*** fhubik is now known as fhubik_brb09:32
*** claudiub has quit IRC09:33
*** oomichi has quit IRC09:34
*** claudiub has joined #openstack-infra09:34
*** fhubik_brb is now known as fhubik09:34
*** achanda has joined #openstack-infra09:35
*** ashishb has quit IRC09:35
*** ifarkas has quit IRC09:36
*** ifarkas has joined #openstack-infra09:36
*** ashishb has joined #openstack-infra09:41
lxslijenkins seems a bit slow?09:42
*** ociuhandu has quit IRC09:42
*** arxcruz has quit IRC09:43
*** jistr has joined #openstack-infra09:44
*** jcoufal has joined #openstack-infra09:46
*** dizquierdo has quit IRC09:50
*** andymaier has joined #openstack-infra09:54
*** maishsk has joined #openstack-infra09:55
*** AJaeger has joined #openstack-infra09:58
*** arxcruz has joined #openstack-infra09:59
*** woodster_ has quit IRC09:59
*** ddieterly has joined #openstack-infra10:00
*** otter768 has joined #openstack-infra10:01
*** zhenguo has quit IRC10:02
*** ddieterly has quit IRC10:05
*** otter768 has quit IRC10:06
openstackgerritTom Fifield proposed openstack-infra/shade: Add Swift Object Download support  https://review.openstack.org/24903910:09
*** mahatic has quit IRC10:12
*** nmagnezi has quit IRC10:13
*** achanda has quit IRC10:14
*** thorst has joined #openstack-infra10:15
*** mahatic has joined #openstack-infra10:16
*** tdurakov has quit IRC10:16
*** Guest67865 has joined #openstack-infra10:16
*** ildikov has quit IRC10:19
*** thorst has quit IRC10:20
*** fhubik is now known as fhubik_brb10:20
*** ramineni1 has joined #openstack-infra10:21
*** ramineni has quit IRC10:22
*** nmagnezi has joined #openstack-infra10:24
*** tdurakov has joined #openstack-infra10:29
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Show the currently running version on the about page  https://review.openstack.org/24911310:29
*** jlanoux_ has joined #openstack-infra10:29
AJaegeryolanda, thanks a lot for your reviews! Could you push https://review.openstack.org/248435 and https://review.openstack.org/248549 also on your queue, please?10:29
yolandaAJaeger, sure10:30
AJaegeryolanda: looking at status.openstack.org/zuul, we have quite some load at the moment - do we have a problem with ready nodes?10:31
AJaegerOr is Zuul too busy?10:31
yolandaAJaeger, i haven't looked but i 'll check10:31
*** glauco has quit IRC10:32
*** glauco has joined #openstack-infra10:32
*** jlanoux has quit IRC10:32
AJaegerseems we're building lots of nodes now, so might go down...10:32
*** ildikov has joined #openstack-infra10:32
AJaegerlooking at the graphs it seems we are just backlogged - we build 100s of nodes over an hour ago which looks quite late...10:33
*** adduarte has quit IRC10:33
AJaegerSo, current status might be fine if I interpret http://grafana.openstack.org/dashboard/db/zuul-status correctly10:34
*** ldnunes has joined #openstack-infra10:34
*** fhubik_brb is now known as fhubik10:36
*** salv-orlando has joined #openstack-infra10:38
yolandanodepool seems ok for me10:38
yolandado you notice a special demand of some slave type?10:38
*** tdurakov has quit IRC10:41
*** salv-orlando has quit IRC10:42
*** dizquierdo has joined #openstack-infra10:43
AJaegerI think we're fine now - we seem to have been stuck some time ago and currently recover10:43
BobBallWhat conditions make reviews bold in Gerrit's web view?  I know that changes go unbold after I have reviewed them, but some changes have gone bold again even though they have a +1 from me in the latest changeset10:43
*** aspiers has quit IRC10:43
claudiubI think when there are new updates on that review, like someone else reviewed it / left comments.10:45
BobBallOK - then how do I make it go unbold?  normally bold indicates that I need to _do_ something... :)10:46
BobBallI mean "normally I interpret bold as meaning I need to do something"10:46
*** markus_z has quit IRC10:47
openstackgerritMerged openstack-infra/project-config: Really skip directories for translation sync  https://review.openstack.org/24856110:48
*** aukhan has quit IRC10:48
openstackgerritJulien Danjou proposed openstack-infra/system-config: Rename Ceilometer to Telemetry  https://review.openstack.org/24302010:48
*** dtantsur is now known as dtantsur|brb10:50
*** Liuqing has joined #openstack-infra10:50
AJaegerBobBall: it means: Something has changed, you might want to review what has changed ;)10:51
BobBallAnd I've reviewed it and my last review still stands10:52
BobBallbut I keep re-reviewing because the bold doesn't go away :/10:52
BobBallso I forget lol10:52
AJaegerBobBall: here's a different query for you:10:53
AJaegerConfigure the repos you want to watch and only see those that you didn't review with the above link10:53
*** matt6434 has quit IRC10:54
BobBallAh - I'll check it out.  Thanks.10:54
yolandamm, gerrit is so slow for me10:54
AJaegeryolanda: your typing is faster than mine ;)10:55
*** matt6434 has joined #openstack-infra10:55
AJaegersomething odd is currently happening10:55
*** flwang has quit IRC10:55
yolandaAJaeger, gerrit is failing10:55
yolandafull of jetty errors10:55
yolandawill restart10:55
odyssey4meyeah, I'm seeing quite a bit of slowness10:55
odyssey4mealso, the check queue seems a little larger than normal for this time of day?10:56
AJaegerodyssey4me: yes, it is...10:56
*** maishsk has quit IRC10:59
dmelladois gerrit down?10:59
yolandai'm restarting that10:59
dmelladoty yolanda11:00
yolandais that better now?11:00
*** flwang has joined #openstack-infra11:00
dmelladoyolanda: yep, just loaded ;)11:00
*** amotoki has quit IRC11:01
*** ddieterly has joined #openstack-infra11:02
lxslithanks yolanda !11:03
*** dims has joined #openstack-infra11:06
odyssey4mety yolanda - it is better now11:06
*** ddieterly has quit IRC11:06
odyssey4meanother issue though, https://review.openstack.org/248757 merged around two hours ago but the jobs are still showing as NOT_REGISTERED11:07
*** dgonzalez has joined #openstack-infra11:08
odyssey4meyou can test with https://review.openstack.org/248632 if you need something to try it out with11:08
*** yamamoto has quit IRC11:10
*** aysyd has joined #openstack-infra11:10
*** Sree has quit IRC11:12
*** Sree has joined #openstack-infra11:13
*** rcernin is now known as rcernin|lunch11:13
AJaegerodyssey4me: with the high load on the server,better wait some more ;(11:17
*** Sree has quit IRC11:17
AJaegerLooking at the puppet runs, it should have been updated ;(11:19
*** Daisy_ has joined #openstack-infra11:19
*** ociuhandu has joined #openstack-infra11:21
*** AJaeger has quit IRC11:23
odyssey4meAJaeger yeah, it's usually done within 30 mins11:25
*** jlanoux_ has quit IRC11:27
*** jlanoux has joined #openstack-infra11:28
openstackgerritFlavio Percoco proposed openstack-infra/project-config: Fix job deffinition for ceph job  https://review.openstack.org/24914811:36
*** Daisy_ has quit IRC11:37
openstackgerritMehdi Abaakouk (sileht) proposed openstack-infra/project-config: Gnocchi: Fix mapping between of stable branches  https://review.openstack.org/24805011:38
*** Daisy has joined #openstack-infra11:38
*** daemontool has joined #openstack-infra11:38
*** achanda has joined #openstack-infra11:39
*** daemontool has quit IRC11:40
*** hashar is now known as hasharLunch11:40
*** daemontool has joined #openstack-infra11:40
*** Daisy has quit IRC11:41
*** Daisy has joined #openstack-infra11:41
*** Daisy has quit IRC11:43
*** markus_z has joined #openstack-infra11:43
*** fhubik is now known as fhubik_brb11:46
*** Daisy has joined #openstack-infra11:46
*** jlanoux_ has joined #openstack-infra11:46
*** ramineni1 has quit IRC11:47
*** ildikov has quit IRC11:48
*** jlanoux has quit IRC11:49
*** Daisy has quit IRC11:51
*** Daisy has joined #openstack-infra11:51
*** dtantsur|brb is now known as dtantsur11:51
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/24843011:53
*** Daisy has quit IRC11:53
*** ihrachys has joined #openstack-infra11:53
*** Daisy has joined #openstack-infra11:53
*** oomichi has joined #openstack-infra11:57
*** yamamoto has joined #openstack-infra11:57
odyssey4meyolanda any ideas why we still have NOT_REGISTERED jobs even after the merge 3 hours ago?11:58
*** baoli has quit IRC11:58
openstackgerritIvan Kolodyazhny proposed openstack-infra/project-config: Skip unsupported tests for BlockDeviceDriver  https://review.openstack.org/24802111:58
yolandaodyssey4me, that normally indicates that the job is not registered with jenkins, or that the node type requested is not present11:58
*** sdake has joined #openstack-infra11:58
yolandai cannot look now, but i will have some time in a while11:59
odyssey4meyolanda ok, thanks11:59
*** markus_z is now known as markus_z_meeting11:59
*** otter768 has joined #openstack-infra12:02
*** ddieterly has joined #openstack-infra12:02
*** sdake has quit IRC12:03
*** GonZo2000 has joined #openstack-infra12:05
*** GonZo2000 has quit IRC12:05
*** GonZo2000 has joined #openstack-infra12:05
*** Daisy has quit IRC12:05
*** Daisy has joined #openstack-infra12:06
*** otter768 has quit IRC12:06
*** ddieterly has quit IRC12:07
*** mpavone has quit IRC12:07
odyssey4meyolanda how do I gain the ability to change the topic of the project channel for which I'm the PTL?12:08
odyssey4meit would appear that it has something to do with https://git.openstack.org/cgit/openstack-infra/project-config/tree/accessbot/channels.yaml#n37 ?12:08
*** daemontool has quit IRC12:08
*** sdake has joined #openstack-infra12:09
*** daemontool has joined #openstack-infra12:09
*** Daisy has quit IRC12:11
*** thorst has joined #openstack-infra12:15
*** salv-orlando has joined #openstack-infra12:17
openstackgerritMehdi Abaakouk (sileht) proposed openstack-infra/project-config: Gnocchi: Fix mapping between of stable branches  https://review.openstack.org/24805012:19
*** mpavone has joined #openstack-infra12:20
*** thorst has quit IRC12:20
*** salv-orlando has quit IRC12:22
*** rossella_s has quit IRC12:23
*** rossella_s has joined #openstack-infra12:23
*** mahatic has quit IRC12:24
*** zeih has quit IRC12:27
*** zeih has joined #openstack-infra12:28
*** ramineni has joined #openstack-infra12:30
*** sergmelikyan has joined #openstack-infra12:30
*** mahatic has joined #openstack-infra12:30
*** fhubik_brb is now known as fhubik12:34
*** rcernin|lunch is now known as rcernin12:36
*** ashishb has quit IRC12:38
*** wolsen has quit IRC12:41
*** ildikov has joined #openstack-infra12:41
yolandaodyssey4me, what jobs  are causing you problems? can you share link?12:42
odyssey4meyolanda I think I've figured out the cause - perhaps you can help me verify.12:42
odyssey4methe job is defined here: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/ansible-role-jobs.yaml#L34-L5212:43
openstackgerritEmilien Macchi proposed openstack-infra/project-config: zuul: enable beaker jobs for puppet-mistral  https://review.openstack.org/24917912:43
odyssey4meyolanda and one of them is executed here: https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L679412:44
*** isaacb has joined #openstack-infra12:45
odyssey4meyolanda but we have a function here which bypasses the dsvm node allocation: https://github.com/openstack-infra/project-config/blob/master/zuul/openstack_functions.py#L132-L13512:45
*** maishsk has joined #openstack-infra12:45
odyssey4meyolanda so I think we're missing a node allocation here: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/projects.yaml#L3450-L345712:46
odyssey4meoh no - there is a node allocation...12:46
*** trown|outttypeww is now known as trown12:47
jyuso1hi guys,i want to ask a question about applying a patch to my local CI env.12:47
*** yamamoto has quit IRC12:47
jyuso1I use "git fetch xxx && git checkout FETCH_HEAD" command to patch now,should i use "git rebase master" operation after it?12:47
odyssey4meyolanda ok, perhaps it's best to actually review a check job: https://review.openstack.org/24863212:48
yolandaodyssey4me, that job is a new one? i see job is created on jenkins, but not run12:49
odyssey4meyolanda yes, the job merged this morning12:49
odyssey4meyolanda https://review.openstack.org/24875712:50
yolandaok looking at jenkins, it needs devstack-trusty12:50
odyssey4meyolanda yeah, or ubuntu-trusty is an option I think12:51
yolandaand in projects.yaml i see it restricts to bare-precise or bare-trusty?12:51
odyssey4meok, so your thinking is that if we switch https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/projects.yaml#L3452 to include 'devstack-trusty' as well, then it should work?12:53
openstackgerritIvan Kolodyazhny proposed openstack-infra/project-config: Skip unsupported tests for BlockDeviceDriver  https://review.openstack.org/24802112:53
yolandaodyssey4me, i think so, because if you look at job configuration, it's restricting the labels where it can be run to devstack-trusty12:54
*** dewsday has joined #openstack-infra12:54
*** dprince has joined #openstack-infra12:54
*** dewsday has left #openstack-infra12:54
odyssey4meok, thanks yolanda I'll work up a patch12:55
*** baoli has joined #openstack-infra12:55
*** bdemers has quit IRC12:55
*** yamamoto has joined #openstack-infra12:59
*** tiswanso has quit IRC12:59
*** andymaier has quit IRC12:59
*** gordc has joined #openstack-infra12:59
*** mpavone has quit IRC13:00
*** gouthamr has left #openstack-infra13:00
*** markus_z_meeting is now known as markus_z13:01
*** zhenguo has joined #openstack-infra13:01
openstackgerritJesse Pretorius proposed openstack-infra/project-config: Include devstack-trusty nodes for OSA role jobs  https://review.openstack.org/24918913:01
odyssey4meyolanda ^13:01
*** oomichi has quit IRC13:02
*** ddieterly has joined #openstack-infra13:03
*** rhallisey has joined #openstack-infra13:04
*** kgiusti has joined #openstack-infra13:04
*** salv-orl_ has joined #openstack-infra13:05
*** marcusvrn_ has quit IRC13:05
*** jhesketh has quit IRC13:06
*** olaph has quit IRC13:06
*** jhesketh has joined #openstack-infra13:07
*** ddieterly has quit IRC13:08
yolandaodyssey4me, actually i think i was wrong. I see it uses devstack-trusty, but nodes are set correctly13:09
*** amuller has joined #openstack-infra13:10
yolandaso i'm comparing with another jobs of same type, such as pep8, that were executed properly13:10
odyssey4meok, thanks yolanda13:11
yolandaodyssey4me, the ones using bare-precise || bare-trusty seem to have executed. There are also nodes with centos7 failing right?13:11
*** mpavone has joined #openstack-infra13:12
odyssey4meyolanda our particular roles have no centos, pabelanger does have one though13:12
yolandaodyssey4me .. https://jenkins01.openstack.org/view/All/job/gate-openstack-ansible-apt_package_pinning-dsvm-functional-centos7-nv/ ?13:13
*** bpokorny has joined #openstack-infra13:14
odyssey4meyolanda oh, that's odd - that shouldn't be happening13:14
yolandaseems there is some misconfiguration on the job and nodes, but i'm not sure13:14
*** wolsen has joined #openstack-infra13:14
yolandai see this one was created yesterday13:15
odyssey4meyolanda yeah, the change was made to give these jobs access to sudo13:16
*** dolpher has quit IRC13:16
odyssey4meperhaps it's best to wait until pabelanger gets online - he's more familiar than I am with the effects of the change and can probably point us right13:16
*** dolpher has joined #openstack-infra13:17
openstackgerritAndrea Frittoli proposed openstack-infra/subunit2sql: Fix documentation before the release  https://review.openstack.org/24919913:18
yolandaodyssey4me, so in ansible roles template i see13:20
yolanda- job-group:13:20
yolanda    name: 'ansible-role-jobs'13:20
yolanda    jobs:13:20
yolanda      - 'gate-{name}-docs'13:20
yolanda      - 'gate-{name}-pep8'13:20
yolanda      - 'gate-{name}-tox-{envlist}':13:20
yolanda          envlist: ansible-lint13:20
yolanda      - '{pipeline}-{name}-dsvm-functional-{ostype}{job-suffix}':13:20
yolanda          job-suffix: '-nv'13:20
yolanda          ostype:13:20
yolanda            - centos713:20
yolanda            - trusty13:20
yolandathat's generating jobs for trusty and centos713:20
*** olaph has joined #openstack-infra13:21
*** jyuso1 has quit IRC13:21
*** daemontool has quit IRC13:22
*** Sree has joined #openstack-infra13:23
yolandaodyssey4me, so actually the idea of restricting slaves is ok, but look at another samples on projects.yaml... you can define general labels, bare-precise  || bare-trusty, but then you can add a jobs section in the project13:23
yolandaand set the dsvm ones to use different nodes, such as centos7 or trusty13:23
odyssey4meso the thing is that this job template is used for projects where not all of them support centos, so how do we restrict the jobs kicked off for the projects?13:25
openstackgerritAndrea Frittoli proposed openstack-infra/subunit2sql: Fix documentation before the release  https://review.openstack.org/24919913:25
openstackgerritVitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs voting in master branch  https://review.openstack.org/24920313:26
openstackgerritVitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs voting in master branch  https://review.openstack.org/24920313:27
*** spzala has joined #openstack-infra13:27
openstackgerritDmitriy Ukhlov proposed openstack/requirements: Updates pika-pool library  https://review.openstack.org/24920613:29
openstackgerritAntoine Musso proposed openstack-infra/zuul: zuul-cloner: recognizes bare repos in cache dir  https://review.openstack.org/24920713:29
openstackgerritVitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs voting in master branch  https://review.openstack.org/24920313:30
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Fix tags causing 500 error when editing stories  https://review.openstack.org/24920813:30
*** dizquierdo has quit IRC13:30
*** doug-fish has joined #openstack-infra13:30
*** jhesketh has quit IRC13:30
*** Liuqing_ has joined #openstack-infra13:31
*** Liuqing has quit IRC13:32
*** weshay_xchat is now known as weshay13:34
*** markvoelker has quit IRC13:35
*** pradk has joined #openstack-infra13:35
*** thorst has joined #openstack-infra13:36
*** thorst_ has joined #openstack-infra13:37
*** Sree__ has joined #openstack-infra13:37
*** daemontool has joined #openstack-infra13:39
*** Sree has quit IRC13:40
*** thorst has quit IRC13:41
openstackgerritVitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs voting in master branch  https://review.openstack.org/24920313:43
*** aopincar has quit IRC13:43
*** bexelbie_ has joined #openstack-infra13:43
*** thiagop has joined #openstack-infra13:43
*** bexelbie is now known as Guest892713:44
*** bexelbie_ is now known as bexelbie13:44
*** thorst_ has quit IRC13:44
*** bpokorny has quit IRC13:45
*** thorst_ has joined #openstack-infra13:45
openstackgerritMichael Krotscheck proposed openstack/requirements: Update oslo.middleware to 3.0.0  https://review.openstack.org/24921613:45
krotscheckThis... is going to be interesting.13:45
openstackgerritChristian Berendt proposed openstack-infra/irc-meetings: [docinstallteam] change agenda_url  https://review.openstack.org/24921713:45
*** claudiub|2 has joined #openstack-infra13:46
*** claudiub has quit IRC13:46
*** thorst_ has quit IRC13:49
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Don't add unexpected `story_id` attribute to Comment  https://review.openstack.org/24921913:49
*** fhubik is now known as fhubik_brb13:49
*** fhubik_brb is now known as fhubik13:50
*** fhubik is now known as fhubik_brb13:50
*** fhubik_brb is now known as fhubik13:53
*** ayoung has joined #openstack-infra13:53
*** markvoelker has joined #openstack-infra13:53
*** fhubik is now known as fhubik_brb13:54
*** fhubik_brb is now known as fhubik13:54
*** fhubik is now known as fhubik_brb13:54
*** sergmelikyan has quit IRC13:55
*** daemontool has quit IRC13:56
*** daemontool has joined #openstack-infra13:57
*** achanda has quit IRC13:57
*** daemontool has quit IRC13:58
*** maishsk has quit IRC13:58
*** daemontool has joined #openstack-infra13:59
*** salv-orl_ has quit IRC14:00
*** tiswanso has joined #openstack-infra14:00
*** w__ has joined #openstack-infra14:00
openstackgerritAndrey Pavlov proposed openstack-infra/project-config: Rework ec2api jobs for new tempest`s plugin technology  https://review.openstack.org/24689014:01
*** maishsk has joined #openstack-infra14:01
*** olaph has quit IRC14:01
openstackgerritMateusz Matuszkowiak proposed openstack-infra/project-config: Added new repo for fuel-plugin-virtual-accelerator in Openstack NS  https://review.openstack.org/24922914:02
*** otter768 has joined #openstack-infra14:03
*** rcernin has quit IRC14:03
*** ddieterly has joined #openstack-infra14:04
*** Ramanjaneya has quit IRC14:04
*** achanda has joined #openstack-infra14:06
*** dtardivel has joined #openstack-infra14:06
*** trukisesst has joined #openstack-infra14:07
*** jhesketh has joined #openstack-infra14:07
*** otter768 has quit IRC14:08
*** ddieterly has quit IRC14:08
*** abregman is now known as abregman|brb14:10
*** w__ has quit IRC14:11
*** rlandy has joined #openstack-infra14:17
*** eharney has joined #openstack-infra14:19
*** hichihara has quit IRC14:20
*** alivigni has joined #openstack-infra14:22
*** regXboi has joined #openstack-infra14:23
*** trukisesst3 has joined #openstack-infra14:23
*** zz_dimtruck is now known as dimtruck14:25
*** trukisesst has quit IRC14:26
mordredkrotscheck: your commit message there makes me sad14:29
mordredkrotscheck: not surprised, of course, but sad14:29
ttxmordred: would you be around to kill a tag I just pushed by mistake during release tools testing14:29
*** Sree__ has quit IRC14:30
mordredttx: sure14:31
*** Sree has joined #openstack-infra14:32
mordredttx: which tag/repo ?14:32
ttxmordred: hmm, dims decided to let it live14:32
*** amotoki has joined #openstack-infra14:32
ttxwas 3.0.1 for oslo.rootwrap14:32
*** akshai has joined #openstack-infra14:32
ttxit's valid, just useless.14:32
dimsy, we are ok14:33
*** mriedem_away is now known as mriedem14:33
dimsttx : we can try the pylockfile next time we have to test :) (need this to merge first https://review.openstack.org/#/c/248972/)14:34
*** Sree has quit IRC14:36
*** mtanino has joined #openstack-infra14:37
openstackgerritThierry Carrez proposed openstack-infra/release-tools: New tooling for service releases  https://review.openstack.org/24924114:37
openstackgerritAntoine Musso proposed openstack-infra/zuul: zuul-cloner: recognizes bare repos in cache dir  https://review.openstack.org/24920714:37
openstackgerritIgor Belikov proposed openstack-infra/project-config: Don't trigger gate-fuel-web-python26 job for fuel-web  https://review.openstack.org/24924214:37
*** ddieterly has joined #openstack-infra14:38
openstackgerritThierry Carrez proposed openstack-infra/release-tools: [WIP] New tooling for service releases  https://review.openstack.org/24924114:38
krotscheckmordred: At least they're not swift.14:38
openstackgerritMerged openstack/requirements: Updated from generate-constraints  https://review.openstack.org/24843014:38
*** tsg has quit IRC14:39
openstackgerritMoises Trovó proposed openstack-infra/zmq-event-publisher: Override parameters with environment variables  https://review.openstack.org/23554514:40
openstackgerritQiming Teng proposed openstack-infra/project-config: Add release notes jobs for senlin  https://review.openstack.org/24924414:40
*** abregman|brb is now known as abregman14:41
*** EricGonczer_ has joined #openstack-infra14:44
*** goodygum_ is now known as noqa_v_qoovnie14:44
*** jgriffith_away is now known as jgriffith14:47
*** AJaeger has joined #openstack-infra14:48
*** bdemers has joined #openstack-infra14:49
*** bexelbie_ has joined #openstack-infra14:52
*** hasharLunch is now known as hashar14:52
*** achanda has quit IRC14:53
*** achanda has joined #openstack-infra14:54
*** bexelbie has quit IRC14:54
*** trukisesst has joined #openstack-infra14:55
*** olaph has joined #openstack-infra14:55
*** achanda_ has joined #openstack-infra14:56
dhellmannfungi : if you're online already, do you have a few minutes to chat with me and ttx in #openstack-release?14:57
*** trukisesst3 has quit IRC14:57
*** ramineni has quit IRC14:58
AJaegerwe still have a NOT_REGISTERED - as odyssey4me pointed out a few hours ago: https://review.openstack.org/248757  is merged but https://review.openstack.org/248632 does not use it. pabelanger, are you around?14:58
*** akshai has quit IRC14:59
*** achanda has quit IRC14:59
*** akshai has joined #openstack-infra15:00
fungidhellmann: yep15:01
*** akshai has quit IRC15:02
*** boris-42 has joined #openstack-infra15:02
*** salv-orlando has joined #openstack-infra15:04
*** thorst_ has joined #openstack-infra15:04
*** dkranz has joined #openstack-infra15:05
*** thorst_ has quit IRC15:05
*** thorst_ has joined #openstack-infra15:06
*** bhunter71 has joined #openstack-infra15:07
*** dims_ has joined #openstack-infra15:08
AJaegerpabelanger, infra-root, could you look at the above, please? I don't see the job generated in jenkins01.15:08
*** dims has quit IRC15:09
odyssey4meAJaeger after a chat with yolanda I put this in, but we're not sure if this will make a difference: https://review.openstack.org/24918915:09
*** burgerk has joined #openstack-infra15:10
yolandaodyssey4me, the change as it is right now won't work... but if you amend that, and add the right nodes for the jobs you need, it will make more sense15:10
*** thorst_ has quit IRC15:10
AJaegerodyssey4me, yolanda I would just add this to jenkins/jobs/ansible-role-jobs.yaml for the functional job.15:11
*** burgerk_ has joined #openstack-infra15:11
yolandayes, i mean it15:11
odyssey4meAJaeger ah ok, then the jobs would also need to be renamed to reflect the correct node required, correct?15:12
AJaegerthat one has already "node: 'devstack-{ostype}'", so change that15:12
AJaegerodyssey4me: right now your change is a noop, since the job itself overrides it.15:12
*** hurgleburgler has joined #openstack-infra15:13
AJaegerodyssey4me: we have zuul/openstack_functions.py that will do the right thing based on the job name15:14
AJaegerodyssey4me: check function devstack_params15:14
odyssey4meAJaeger will this override that though? https://github.com/openstack-infra/project-config/blob/master/zuul/openstack_functions.py#L132-L13515:14
pabelangerAJaeger: 1 min, looking15:15
*** peristeri has joined #openstack-infra15:15
*** burgerk has quit IRC15:15
*** dizquierdo has joined #openstack-infra15:15
AJaegerthanks, pabelanger15:15
AJaegerodyssey4me: but we use the same setup for the puppet modules as well where it works.15:15
pabelangerAJaeger: I have an idea of the issue15:16
pabelangerAJaeger: let me get a patch up to simplify15:16
jeblairNov 24 09:39:45 jenkins01 puppet-agent[20055]: (/Stage[main]/Jenkins::Job_builder/Exec[jenkins_jobs_update]) Command exceeded timeout15:16
*** btully has joined #openstack-infra15:17
*** sridhar_ram has joined #openstack-infra15:17
AJaegerjeblair: are you suggesting we should first run puppet manually?15:18
odyssey4methanks pabelanger, and good morning :)15:18
*** markvoelker has quit IRC15:18
*** rbrndt has joined #openstack-infra15:18
*** tiswanso has quit IRC15:18
jeblairAJaeger: that usually happens when someone makes a change that causes all jobs to update, and usually we need to fix it by running jjb manually15:18
*** markvoelker has joined #openstack-infra15:18
jeblairAJaeger: it is likely the cause of the current problem15:18
jeblairNov 24 03:24:50 jenkins01 puppet-agent[19633]: (/Stage[main]/Jenkins::Job_builder/Exec[jenkins_jobs_update]) Command exceeded timeout15:19
*** tiswanso has joined #openstack-infra15:19
jeblairthat's the first timeout ^15:19
pabelangerAJaeger: actually, my fix would be noop, so I think we should look at jeblair fix first15:19
yolandajeblair, AJaeger, but in that case, i saw jobs were created on jenkins0115:20
yolandaentries are there15:20
*** sergmelikyan has joined #openstack-infra15:21
pabelangerAJaeger: yolanda: I don't see why this would not work15:21
AJaegeryolanda: https://jenkins01.openstack.org/view/All/job/gate-openstack-ansible-apt_package_pinning-dsvm-functional-trusty-nv/ exists but the variant without -nv does not15:22
AJaegerjeblair: are you running jjb manually now?15:23
e0nehi. could anybody review https://review.openstack.org/#/c/248021/, please?15:23
jeblairAJaeger: not yet15:23
cloudnullmornings o/15:24
AJaegerjeblair: could you afterwards review the release-notes post job again, please? https://review.openstack.org/#/c/248256/15:24
jeblairthat change to jjb affected all of our jobs15:25
*** tsg has joined #openstack-infra15:25
mordredpabelanger: was it you who recently made a patch to update something to statsd 3.0 or something?15:27
*** maishsk has quit IRC15:27
jeblairi have to run; can another infra-root run jjb on all masters in screen?15:27
*** maishsk has joined #openstack-infra15:27
*** maishsk has quit IRC15:27
AJaegerthanks jeblair for looking into this15:27
yolandaAJaeger, so you missed the one without -nv ? i looked at the one with -nv, and saw it was created, but never run15:28
mordredjeblair: yay15:28
AJaegersdague: could you review  https://review.openstack.org/#/c/248021/ for e0ne, please? The DEVSTACK_GATE_TEMPEST_REGEX is one thing that I'd like you to look at15:28
AJaegeryolanda: yes, the one without -nv is missing15:29
*** abregman has quit IRC15:29
yolandaAJaeger, ok, i thought it was some problem with labels, because we talked also about some job, generated for centos, that should not be there15:29
*** maishsk has joined #openstack-infra15:30
*** ccrouch has joined #openstack-infra15:30
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Link to the relevant story in comment notifications  https://review.openstack.org/24927315:30
mordredjeblair: it's been a while since I've run jjb by hand - anything other than jenkins-jobs update --delete-old /etc/jenkins_jobs/config ?15:30
e0neAJaeger, sdague: I can provide testr list-tests with current regexp15:30
pabelangermordred: not me. I know ianw was recently updating statsd requirements (well a few months ago)15:30
*** ccrouch has quit IRC15:31
fungimordred: time sudo -H jenkins-jobs update --delete-old /etc/jenkins_jobs/config15:32
mordredfungi: sweet. I'm starting on 01 now15:32
fungimordred: the -H is necessary so that root's copy of the cache gets updated15:32
*** ccrouch has joined #openstack-infra15:33
fungiotherwise puppet agent will just continue to be broken when it tries to rerun it later15:33
*** ccrouch has quit IRC15:33
*** ccrouch has joined #openstack-infra15:33
e0neadded 'testr list-tests' results as a comment to my patch15:34
*** salv-orlando has quit IRC15:36
*** akshai has joined #openstack-infra15:36
mordredfungi: I have jjb running in a screen on jenkins01-0715:36
*** asselin_ has joined #openstack-infra15:36
*** asselin has joined #openstack-infra15:36
*** maishsk has quit IRC15:36
*** pcrews has joined #openstack-infra15:36
fungithanks mordred!15:37
AJaegerthanks, mordred !15:37
*** dprince has quit IRC15:39
*** sridhar_ram1 has joined #openstack-infra15:40
*** salv-orlando has joined #openstack-infra15:40
openstackgerritThierry Carrez proposed openstack-infra/release-tools: Release tagging automation  https://review.openstack.org/24924115:40
*** sridhar_ram has quit IRC15:41
anteayaAJaeger: I think sdague said he was out this week, I recall that from last week's backscroll15:41
*** asselin has left #openstack-infra15:41
*** asselin_ has left #openstack-infra15:41
*** dprince has joined #openstack-infra15:41
*** asselin has joined #openstack-infra15:42
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Add DIB_LOCAL_CONFIG_USERNAME to local-config  https://review.openstack.org/24897615:42
AJaegeranteaya: thanks for the info15:42
openstackgerritMerged openstack-infra/nodepool: Add provider node stats  https://review.openstack.org/24829915:44
*** sfinucan has joined #openstack-infra15:46
lifelessarmax: could you please +1 https://review.openstack.org/#/c/247306/ ?15:46
lifelessarmax: infra needs your vote to move forward on it15:46
openstackgerritJames E. Blair proposed openstack-infra/jenkins-job-builder: Add template-name as a variable that can be used in a template  https://review.openstack.org/24726315:46
* armax looks15:46
armaxI did at one point15:47
pabelangeryolanda: AJaeger: it should be noted that both https://jenkins01.openstack.org/view/All/job/gate-ansible-role-nodepool-dsvm-functional-trusty-nv/ and https://jenkins01.openstack.org/view/All/job/gate-ansible-role-nodepool-dsvm-functional-trusty/ exist too. So, I would expect the other ansible jobs to work, since they use the same job template15:47
clarkbmordred: did you run with sudo -H ?15:47
mordredclarkb: yes15:47
clarkb(thats what got me last time)15:48
*** jzerebecki has quit IRC15:48
*** sergmelikyan has quit IRC15:48
odyssey4mepabelanger this is why I'm wondering whether https://github.com/openstack-infra/project-config/blob/master/zuul/openstack_functions.py#L132-L135 is interfering with the node allocation15:49
lifelessarmax: yeah, Nakato added the stable change to the same patch15:49
pabelangerodyssey4me: Ah, ya. That might also explain it15:49
pabelangerodyssey4me: didn't know about that15:49
lifelessarmax: thanks15:49
lifelessclarkb: mordred: https://review.openstack.org/#/c/247306/ now has armax' vote15:49
pabelangerodyssey4me: we should likely remove that, as it is not needed anymore15:49
pabelangerodyssey4me: it should be matching the devstack name now15:50
*** salv-orlando has quit IRC15:51
odyssey4mepabelanger so that was implemented for the openstack-ansible integrated test jobs, but I think we're at a point where we can probably implement that another way and remove the functions code15:51
openstackgerritMerged openstack-infra/tripleo-ci: Set puppet DIB_INSTALLTYPE in tripleo.sh not toci_instack.sh  https://review.openstack.org/24645715:51
AJaegerpabelanger: I also think it will work once jjb has been run manually...15:52
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add docs-on-rtfd hook for ansible-role-{nodepool|zuul}  https://review.openstack.org/24839615:53
*** achanda_ has quit IRC15:53
pabelangerodyssey4me: Ah, ya.  So it can't be removed just yet15:53
jeblairmordred: thanks15:54
odyssey4meok, so for now we wait and see15:54
*** Liuqing_ has quit IRC15:54
jeblairmordred: we have some images on internap that show up in 'image list' but nodepool doesn't know about them because when it uploaded them, it got:15:56
jeblairOpenStackCloudException: Image creation failed: Unable to establish connection to https://image.api.nyj01.cloud.iweb.com/v1/images/670158e7-bd75-4da0-932f-48f91992b9fa (Inner Exception: Connection failure that may be retried.)15:56
jeblairmordred: so it deleted the local record15:57
mordredjeblair: oh nice!15:57
mordredjeblair: we should catch that exception and retry, dontcha think?15:57
*** arxcruz has quit IRC15:57
*** bexelbie__ has joined #openstack-infra15:57
mordred(given that it's a connection failure that may be retried)15:57
*** bexelbie__ is now known as bexelbie15:58
*** bexelbie_ has quit IRC15:59
*** achanda has joined #openstack-infra15:59
*** hdd has joined #openstack-infra16:00
*** aspiers has joined #openstack-infra16:00
jeblairmordred: maybe?  i guess i'm still trying to work out why internap thinks there is an image at all...  how many requests are involved in that?16:00
*** salv-orlando has joined #openstack-infra16:00
mordredjeblair: just one - it's a v1 call16:00
*** isaacb has quit IRC16:01
mordredjeblair: so it's just a put call16:01
mordredjeblair: oh - wait16:01
mordredjeblair: no, sorry, it's 2 calls in v116:01
*** sergmelikyan has joined #openstack-infra16:01
*** trukisesst3 has joined #openstack-infra16:01
mordredjeblair: it's an image_create call with the image metadata but not data, then an image_update call with teh image contents16:01
jeblair  File "/usr/local/lib/python2.7/dist-packages/shade/__init__.py", line 2212, in create_image16:02
jeblair    "Image creation failed: {message}".format(message=str(e)))16:02
*** hashar has quit IRC16:02
jeblairmordred: can you tell which one failed?  that line doesn't exist anymore on the filesystem since shade has updated16:02
mordredjeblair: one sec16:02
*** trukisesst3 has quit IRC16:02
*** tmorin has joined #openstack-infra16:03
*** trukisesst3 has joined #openstack-infra16:03
tmorinfungi, sdague, armax, mestery: I wanted to talk about https://review.openstack.org/#/c/24361016:03
lxslimriedem: happy to purge orphaned bw_usage_cache rows. How should I do that please? Extra lines in my migration script? Deleting rows doesn't seem suitable for an online data migration16:03
jeblairmordred: i'm guessing the answer is no, because the exception is masked?16:03
lxsliohhh wrong channel sorry >.<16:04
mordredjeblair: no - they're both covered by the same exception there ... there should be a task manager call for ImageCreate and one for ImageUpdate16:04
tmorinfungi, sdague, armax, mestery: would you have 5-10 minutes ?16:04
mordredjeblair: yah - and that should be fixed much better in 1.2.016:04
*** otter768 has joined #openstack-infra16:04
mesterytmorin: Yes, lurking and here16:04
fungitmorin: i'm on a conference call for the next 30-60 minutes but can sort of multitask16:04
*** salv-orlando has quit IRC16:04
mordredjeblair: so if you can look for the task manager entries for internap for Image* it should be possible to see if an update was attempted16:05
jeblairmordred: ok, while i see if i can deduce by task calls, can you re-review https://review.openstack.org/226087 ? :)16:05
*** amitgandhinz has joined #openstack-infra16:05
openstackgerritSébastien Han proposed openstack-infra/project-config: Add Ceph DevStack plugin to Stackforge  https://review.openstack.org/18876816:05
tmorinfungi, mestery: the basic issue is that as-is we are stuck (can't merge changes in backports, can't fix the requirements in our master to have code ready to fork a liberty release)16:05
*** trukisesst has quit IRC16:05
mordredjeblair: done16:06
AJaegertmorin: developing on stable/liberty seems for me the best approach - but that means changing the ACLS AFAIU, armax.16:06
tmorinfungi, mestery: we would like to advance before a decision is made to eventually let subproject maintain their stable branches16:06
tmorinhi AJaeger16:06
fungitmorin: it seems like working around this by dropping requirements sync/enforcement jobs is at best a short-term fix16:06
*** fhubik_brb is now known as fhubik16:07
armaxtmorin: russellb, mestery and I will have to suggest the latest ML threads on the topic…we’ll reach a conclusion asap16:07
*** ericksonsantos has joined #openstack-infra16:07
tmorinfungi: yes, this is understood, but we need a short term fix16:07
armaxright now I am in a meeting and I can’t give you devoted attention, please bear with us16:07
fungialso i'll admit i've been internetless for more than a week and am just now starting to catch up, so haven't read all the backstory16:08
tmorinarmax: ok16:08
tmorincould it be considered to make the check-reqs job non-voting as a temporary measure ?16:08
*** otter768 has quit IRC16:09
jeblairmordred: i can't tell -- this is nodepool-pre-shade, so shade is not using the nodepool task manager16:10
AJaegerarmax, mestery: gate-networking-cisco-requirements is also non-voting for now - but as temporary measure to get files into global requirements. We souuld follow up with Sambetts16:10
*** nmagnezi has quit IRC16:10
mordredjeblair: ohhhh16:11
mordredjeblair: I've got a patch up to pass in the nodepool task manager to shade16:11
mordredjeblair: lemme update that16:11
anteayatmorin: what happened to get you into this positon?16:11
tmorinAJaeger: yes, I saw about gate-networking-cisco-requirements -- I was thinking we should also, *temporarily* be allowed to do the same16:11
anteayaI'd like to know so we can avoid this workflow in future16:12
*** amitgandhinz has quit IRC16:12
jeblairmordred: okay, but that's a whole other can of worms -- like we don't want a 45 minute upload task blocking everything16:12
pabelangerAJaeger: yolanda: odyssey4me: https://review.openstack.org/#/c/248632/ looks better now \o/16:12
*** amuller has quit IRC16:12
mordredjeblair: oh right16:12
fungitmorin: if neutron are okay with it (and hopefully qa as well) as a short-term measure, then i don't see why we'd object from an infrastructure standpoint. just no guarantees we can work around other job-related assumptions about branches being mismatched16:12
pabelangerAJaeger: yolanda odyssey4me: okay, I lied16:12
tmorinanteaya: hi, basically we tried to be the good pupils (enable check-resq jobs) without understanding that this wouldn't work for a delayed release, nor for doing backports16:12
mordredjeblair: so - I know which exception to try/except16:12
pabelangerI swear the job was registered16:13
mordredgimme a sec to get that into a patch16:13
pabelangerokay, something up with browser, refreshing16:13
anteayatmorin: why not remove the check requirements rather than making them non-voting?16:13
tmorinfungi: understood - we have few CI jobs for now, so that shouldn't be too complex, we already have branch-overriding jobs so that our master is tested against stable/liberty16:13
jeblairmordred: anyway, i'm assuming it's the second request that failed -- that would explain why there is a record in glance despite the failure, yeah?16:13
tmorinanteaya: yes, that would work too16:13
anteayaAJaeger: is there anything that says a repo has to use the check requirements job?16:14
mordredjeblair: yes. that would make the most sense16:14
tmorinanteaya: but having them for the soon-to-come stable/liberty branch would be nice, right, even if non-voting...16:14
anteayaI'm more in favour of you not using a job at all rather than using it poorly16:14
fungitmorin: that's likely to be hacky and might not be testing what you expect, but as long as you/armax are comfortable with it then i'll lift my -116:14
anteayatmorin: seems like you are asking us to do something that is beyond nice anyway16:14
lifelessanteaya: we won't accept them into global-requirements as a cross-check or a tested project if they don't16:14
anteayalifeless: okay great, that is the consequence of lifting the job16:15
anteayalifeless: thank you16:15
lifelessthere may be more consequences, but thats the immediate one I know of16:15
*** Ala has quit IRC16:15
anteayatmorin: so you don't have to have check requirements on your repo, you just need to have it if you want into global requirements16:15
fungitmorin: my remaining objection with 243610 is from a technical perspective. if you _know_ those jobs aren't going to succeed for now, there's no reason to run them even nonvoting. experimental at most16:16
openstackgerritMerged openstack-infra/system-config: Add shade logging to nodepool  https://review.openstack.org/22608716:16
*** matrohon has quit IRC16:16
anteayatmorin: I'd prefer you lift the job until you get yourself sorted out then put the job back, rather than change how the job works on your repo16:16
*** rcernin has joined #openstack-infra16:16
tmorinanteaya: about "nice": yes, well, I meant "useful"16:16
anteayawell sounds like your definition of useful and mine differ16:16
*** mpavone has quit IRC16:17
anteayaso how about you remove them from your repo until we can agree they are useful to you16:17
*** rossella_s has quit IRC16:17
tmorinlifeless: we are not introducing new requirements, our reqs are a subset of neutron's requirements plus sphinx specific ones already used in some other places16:17
*** rossella_s has joined #openstack-infra16:18
tmorinfungi: the job will be useful for the stable/liberty branch to come16:18
fungitmorin: you can add the job back at that point, and/or restrict it to just run for stable/liberty changes16:18
tmorinanteaya, fungi: I'm fine with removing the job if this is what makes consensus16:18
e0neAJaeger: thanks for review!16:18
anteayatmorin: it is what I would prefer to see16:18
*** amuller has joined #openstack-infra16:19
anteayaAJaeger: can we remove the job from cisco as well, for the same reason?16:19
tmorinfungi, anteaya: ok, what I will do then is update the change to remove the job, and see if everyone agress16:19
anteayatmorin: thank you16:19
openstackgerritMonty Taylor proposed openstack-infra/shade: Retry API calls if they get a Retryable failure  https://review.openstack.org/24930416:19
anteayamorning zaro16:19
mordredjeblair: ^^16:19
lifelesstmorin: we can't sync requirements to you16:19
fungitmorin: an alternative would be to replace "voting: false" with "branch: stable/liberty" and then it will remain voting but only run on changes to stable/liberty16:19
tmorinfungi, anteaya: we'll add it back when we'll have clear guidelines on how to do this16:19
tmorinlifeless: understood, that will have to be manual16:20
clarkbmordred: is retrying that going to make 2 images in glance or get the original image record to line up server and client side16:20
lifelesstmorin: if you're not checking that you only land compatible reuquirements16:20
anteayatmorin: yes clear guidelines seem helpful in this situation16:20
lifelesstmorin: which means you need to be removed from the projects.txt list in openstack/requirements16:20
greghaynesjeblair: mordred I wonder if nodepool should detect that failure too and attempt a delete along with the db row deletion?16:20
mordredclarkb: the retryable exception gets thrown when the connection itself failed in a way that did not result in the aPI call being made16:20
tmorinfungi: 'branch: stable/liberty' would work for us as well16:20
lifelesstmorin: we're talking about the networking-bgvpn thing right?16:20
clarkbmordred: except according to jeblair we have evidence the api call was made and glance has an image16:20
mordredclarkb: two different calls16:21
tmorinlifeless: yes, we are16:21
fungitmorin: anyway, as i said, i'm happy to look to neutron and qa leadership for policy in this regard. from an infra perspective i simply want whatever you're running to at least make some sense16:21
greghaynesclarkb: I think this is a second call16:21
mordredclarkb: the sequence was "create image -> success ; update image -> retryable exception"16:21
lifelesstmorin: so yes, if you're disabling check-requirements, we must remove you from projects.txt16:21
clarkbglance can have an image after one call but requires 2 calls to make it useable?16:21
pabelangercould I trouble an infra-root to add me to https://review.openstack.org/#/admin/groups/1194,members and https://review.openstack.org/#/admin/groups/1195,members please?16:21
mordredclarkb: in v1, yes16:21
*** rossella_s has quit IRC16:21
greghaynesin v2 it requires N :p16:21
mordredclarkb: which is what this is using16:21
tmorinlifeless: why ? (what breaks if you don't ?)16:21
*** rossella_s has joined #openstack-infra16:22
fungipabelanger: done16:22
clarkbI should buy a lighter keyboard16:22
lifelesstmorin: the periodic job that updates requirements16:22
tmorinlifeless: keeping in mind the assumption we don't add stuff that is not already there16:22
zaromordred: rollback update, https://review.openstack.org/#/c/245598/16:22
fungiclarkb: heavier keyboards make for better bludgeons16:22
lifelesstmorin: we can't make that assumption16:22
anteayaclarkb: do you need to start fires while you type?16:22
lifelesstmorin: because you're an independent team16:22
zaroanteaya: maybe you can help test the rollback.16:22
mordredinfra-root: the channel topic in #openstack-meeting is out of sync - I have too many tasks I'm context switching -can someone help?16:22
tmorinlifeless: ok, understood16:22
fungimordred: on it16:22
clarkbfungi: I am afraid that one day I will throw it across the room and take out a wall16:22
lifelesstmorin: and the files that reflect that assumption are under your review16:22
anteayazaro: I would love to test the rollback16:22
mordredclarkb: :)16:22
jeblairmordred, infra-root: will fix topic16:22
tmorinlifeless: means I have to make a change on the requirements project as well16:22
fungithanks jeblair16:23
*** flepied has quit IRC16:23
lifelesstmorin: http://git.openstack.org/cgit/openstack/requirements/tree/README.rst#n10216:23
lifelesstmorin: is the documentation abou this16:23
clarkbanteaya: I should avoid doing that too16:23
*** achanda_ has joined #openstack-infra16:23
anteayaclarkb: you never know when you need a lighter16:23
tmorinlifeless: I think I understand, I'll read to confirm16:23
lifelesstmorin: we require the check job be present beforce accepting into projects.txt; if you disable it, we need to remove it.16:23
zaroanteaya: msg you the VM with running the rolled back gerrit16:23
zaroanteaya: maybe play around to make sure it's working as expected?16:24
lifelesstmorin: as I said in the mailing list thread, *all* our code assumes 'code on master is targeting master'16:24
tmorinlifeless: understood, I'll do both things then16:24
anteayazaro: as so as you help me figure out how to sign in I will be happy to16:24
lifelesstmorin: at least from my perspective, things would work a lot better if you're targeting liberty, ig your branch was called liberty :)16:24
zaroanteaya: sign in as any user you want16:24
tmorinlifeless: thanks for pointing our the reverse flow of net-bgpvpn adding reqs being propagated into global requirements - this is indeed an important data point16:25
*** flepied has joined #openstack-infra16:25
zaroanteaya: you can push with same account as on review.o.o16:25
tmorinlifeless: yes, but based on existing ACLs and policy on "what stable/* means", we can't work in a stable/liberty branch16:25
anteayazaro: okay16:25
tmorinfungi, anteaya, lifeless: thanks for your feedback, it seems we have a working short term solution16:26
lifelesstmorin: I understand that too; FWIW I'm in favour of addressing those acls and policy, rather than changing the conventions around master and what that implies16:26
*** achanda has quit IRC16:26
zaroanteaya: i've updated https://review.openstack.org/#/c/245598/ if you would like to know how i got to this point.16:26
tmorinwhich is removing the check-reqs job and removing us from projects.txt, until we know better16:26
lifelesstmorin: but - I'm not trying to drive a particular outcome, just illuminating the current consequences16:26
fungitmorin: and from an existing acl policy perspective, i think it's up to neutron to decide whether that should be adjusted (presumably that's what armax and others are deliberating on)16:26
*** bexelbie has quit IRC16:27
tmorinfungi: this may even go beyond neutron, but I think the discuss on openstack-dev is in good shape16:27
anteayatmorin: glad you have what you need to continue the discussion16:28
* zaro stepping away for about 1/2 hr.16:28
fungiif developing for master and backporting to stable under control of the neutron stable branch maintainers is a requirement of being part of neutron, then networking-bgpvpn may not yet be a fit for inclusion in neutron. otherwise, the acls in place are probably insufficient to cover neutron's desired landscape of possible development models16:28
openstackgerritMikhail S Medvedev proposed openstack-infra/ciwatch: Use zuul gerrit event listener implementation  https://review.openstack.org/24891916:28
fungianyway, those are the two possible outcomes i see16:28
tmorinfungi: yes16:29
*** zhenguo has quit IRC16:29
anteayazaro: thanks I'm in, that should give me some time to orient myself and poke around a bit16:29
lifelessfungi: if you have a sec, 247306 could use another vote16:30
*** rebase has joined #openstack-infra16:30
*** dims_ has quit IRC16:30
anteayaAJaeger: did you want me to offer a patch to address the non-voting requirements cisco plugin job?16:30
*** EricGonczer_ has quit IRC16:31
clarkbcatching back up from last night16:31
clarkbnibalizer fixed ask.o.o's full / by moving some DB backups onto the ephemeral drive16:31
*** EricGonczer_ has joined #openstack-infra16:31
*** trukise has joined #openstack-infra16:32
clarkbhe proposed a change to put all DB backups there, I am not super comfortable with that becuase its supposed to be "ephemeral"16:32
openstackgerritgreghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders  https://review.openstack.org/22239816:32
openstackgerritgreghaynes proposed openstack-infra/nodepool: Builders distinguish between failure and exception  https://review.openstack.org/24213116:32
clarkbmaybe we need to reduce the retention instead and see if logrotate can do something like 7 days then a few weeklies?16:32
*** matrohon has joined #openstack-infra16:32
openstackgerritgreghaynes proposed openstack-infra/nodepool: Decouple builders from nodepool instance  https://review.openstack.org/23213516:32
openstackgerritgreghaynes proposed openstack-infra/nodepool: Builders can be run on their own  https://review.openstack.org/23225116:32
*** korzen has quit IRC16:33
*** placko has quit IRC16:33
*** trukise has quit IRC16:34
*** rebase has quit IRC16:34
openstackgerritThomas Morin proposed openstack/requirements: Remove networking-bgpvpn from projects.txt  https://review.openstack.org/24931216:35
*** trukise has joined #openstack-infra16:36
*** yonglihe has joined #openstack-infra16:37
*** dizquierdo has quit IRC16:38
*** signed8bit has joined #openstack-infra16:40
*** salv-orlando has joined #openstack-infra16:41
*** salv-orlando has quit IRC16:41
*** salv-orlando has joined #openstack-infra16:41
openstackgerritAnita Kuno proposed openstack-infra/project-config: Remove non-voting requirements check job from cisco plugin  https://review.openstack.org/24931816:43
anteayaAJaeger: ^^16:43
pleia2good morning16:43
*** daemontool has quit IRC16:43
anteayamorning pleia216:43
*** daemontool has joined #openstack-infra16:44
openstackgerritAndrea Frittoli proposed openstack-infra/subunit2sql: Fix documentation before the release  https://review.openstack.org/24919916:45
anteayalifeless: https://review.openstack.org/#/c/249318/ if you are able to ensure my commit message is accurate I would be grateful16:45
rcarrillocruztrukise: welcome to the channel :-)16:46
rcarrillocruzyolanda: sergio ^16:46
*** dims has joined #openstack-infra16:46
yolandahi trukise, welcome16:47
*** sabeen1 has joined #openstack-infra16:49
*** daemontool has quit IRC16:49
*** scheuran has quit IRC16:50
*** bnemec has quit IRC16:50
*** Swami has joined #openstack-infra16:51
*** ashishb has joined #openstack-infra16:51
clarkbnibalizer for ask what do think about changing retention instead of using ephemeral disk?16:52
nibalizer:shrug: the ephemeral disk is completely empty so there isn't a reason not to use it imho16:53
nibalizerclarkb: i don't have a strong opinion16:53
clarkbexcept its ephemeral :)16:53
*** dprince has quit IRC16:54
clarkbmordred ask.o.o filled /last night16:54
clarkbstopped working16:54
mordredyeah. full / == bad16:54
clarkbpostgres backups were reason16:54
clarkbnibalizer has a change up to write them to /opt16:54
openstackgerritThomas Morin proposed openstack-infra/project-config: networking-bgpvpn: remove check-requirements jobs  https://review.openstack.org/24932216:55
clarkbI think on rax ephemeral is not actually ephemeral though16:55
clarkbso not end of world16:55
*** fhubik is now known as fhubik_brb16:56
*** trukise has left #openstack-infra16:56
nibalizerso the backups are currently going to /var/backups/postgres_backups16:56
nibalizeror maybe pgsql_backups16:56
*** sridhar_ram1 is now known as sridhar_ram16:56
nibalizerwe keep 30, they are gziped and about 6-700 mb each16:56
nibalizerwhich as clark pointed out is an impressive ammount of text16:57
clarkbgenerated by humans apparently16:57
nibalizerwe shuld be vigilant though16:57
nibalizerask.puppetlabs.com is periodically overrun with spambots16:58
openstackgerritChristian Schwede proposed openstack-infra/project-config: Add Ceph DevStack plugin to Stackforge  https://review.openstack.org/18876816:58
*** e0ne has quit IRC16:58
*** dprince has joined #openstack-infra16:59
*** lykinsbd has joined #openstack-infra17:00
openstackgerritMike Fedosin proposed openstack/requirements: Rename semantic-version dep to semantic_version  https://review.openstack.org/24932717:00
*** ssancheztrujillo has joined #openstack-infra17:01
*** abregman has joined #openstack-infra17:02
greghaynesclarkb: secure.conf change passes tests now FYI17:02
lifelessanteaya: I don't understand the intent of your patch17:03
lifelessanteaya: the cisco plugin isn't in requirements/projects.txt, so we don't care whether they run the check job or not17:03
lifelessanteaya: but if they are aiming to be there (And the comment in the section you're removing suggests they do)17:04
lifelessanteaya: then a non-voting run is the usual pattern to work up to voting17:04
*** samuelBartel has quit IRC17:04
notmorganlifeless: you're up ... early? but good morning sir!17:04
lifelessnotmorgan: ECATs17:04
notmorganlifeless: ah.17:05
lifelessnotmorgan: then couldn't get back to sleep17:05
lifelessnotmorgan: :/17:05
notmorganlifeless: yah17:05
*** jlanoux_ has quit IRC17:06
*** sdake_ has joined #openstack-infra17:07
anteayalifeless: the issue from my perspective is that having requirements check be non-voting is an outlier17:07
anteayalifeless: that was the red flag that prompted the question on tmorin's patch17:07
*** sdake has quit IRC17:07
anteayalifeless: so if there is a workflow for how projects are supposed to be using the requirements check job template I would like it documented so I can follow it17:08
lifelessanteaya: I understand; I can see pros and cons there. What is the exepcted pattern for a project that wants to build up to having the job passs ?17:08
anteayabecause at the moment I having been working with the belief that requirements check should always be voting17:09
*** fhubik_brb is now known as fhubik17:09
anteayalifeless: sure that is fine, the patch was intended to follow policy not create it17:09
lifelessanteaya: the only docs I'm aware of are the ones I wrote for requirements/README.rst, which simply require the job to be used for things in projects.txt.17:09
anteayalifeless: I thought I was following a policy17:09
anteayalifeless: so perhaps there needs to be a dicussion about workflow for a repo that wants in to requirements17:10
openstackgerritThomas Morin proposed openstack/requirements: Remove networking-bgpvpn from projects.txt  https://review.openstack.org/24931217:10
anteayabecause I don't know what that workflow is17:10
jeblairmgagne: i'm having trouble launching instances on internap, do you have a fem moments to help?17:10
anteayaall I know is that every project that uses a template differently than the others creats havoc for someone17:10
lifelessanteaya: I thought the normal pattern for anyone adding a job was to add it nonvoting, then fix it, then make it voting; the same pattern would apply here17:10
lifelessanteaya: understood; I value the benefits of consistency17:11
anteayalifeless: if that was the case the tmorin patch wouldn't have raised a red flag17:11
lifelessanteaya: tmorin's patch is the reverse: its taking a voting thing non-voting17:11
lifelessanteaya: that should always raise a flag IMO17:11
anteayait doesn't for me17:11
anteayathe workflow for a brand new job is to start is off as experimental17:11
anteayathen to non-voting in check then to voting in check and gate17:12
tmorinlifeless: it you can review https://review.openstack.org/#/c/249312/, that will allow the zuul change to go through17:12
anteayathe workflow I know for jobs taht have a template is use the template or don't17:12
tmorinlifeless: s/it/if/17:12
anteayafor jobs that have a template folks can indicate if they want certain branches tested or voting or not17:13
*** tmorin has left #openstack-infra17:13
*** ayoung has quit IRC17:13
anteayathat is the perspective I carry in my head at the moment with others may or may not agree with17:13
openstackgerritAndrea Frittoli proposed openstack-infra/subunit2sql: Fix documentation before the release  https://review.openstack.org/24919917:13
openstackgerritMerged openstack-infra/project-config: Flip Neutron's unit tests to -constraints  https://review.openstack.org/24730617:14
*** eil397 has joined #openstack-infra17:15
ryanpetrelloanybody know if the README on https://github.com/stackforge/pecan could be updated to point to github.com/pecan/pecan17:17
ryanpetrelloor at least see if the "This project is no longer maintained." could be removed (because it's not true)17:17
ryanpetrellothe project's still maintained - it just moved :)17:17
*** nadya_ has quit IRC17:17
*** sdake_ has quit IRC17:17
openstackgerritgordon chung proposed openstack-infra/project-config: rename ceilometer-specs to telemetry-specs  https://review.openstack.org/24889717:18
ryanpetrelloI had a nice simple README uploaded there that explained the move: https://github.com/stackforge/pecan/commit/b49e8c7be413512866390e0a03ee18802ad3d04617:18
*** dims has quit IRC17:18
ryanpetrellomordred or jeblair or clarkb ^17:18
*** dims_ has joined #openstack-infra17:18
*** mahatic has quit IRC17:19
*** regXboi has quit IRC17:19
mgagnejeblair sure17:19
mgagnejeblair going to grab a coffee in a moment17:19
*** david-ly_ has joined #openstack-infra17:19
*** matrohon has quit IRC17:19
jeblairryanpetrello: yeah, i think we ought to be able to revert that last commit -- it looks like it was erroneously trying to do what you had already done :)17:21
ryanpetrellojeblair: great - thanks :D17:21
ryanpetrelloI know this URL's going to disappear at some point, but I'd like to point folks in the right direction as long as possible :)17:22
jeblairmgagne: i currently have a server in build state: c350ea27-30ce-49cd-93e9-43d64bccc2ca and it's not advancing beyond 'spawning'17:22
*** ihrachys has quit IRC17:22
anteayazaro: I was trying to locate the most recent patchset by patchset number in the rollback instance to test the most recent patchset (assuming it is a new patchset you created when at 2.11) and am now getting server not available errors17:23
*** aspiers_ has joined #openstack-infra17:23
*** david-l__ has joined #openstack-infra17:23
*** david-ly_ has quit IRC17:23
*** david-lyle has quit IRC17:23
*** mohankumar has joined #openstack-infra17:24
mgagnejeblair looks like you didn't provide any networks. I found out yesterday that if you have cells, the network sanity check is not performed by the API (fail if you have 2>=networks and didn't provide any). The instance is scheduled and stay in spawning for a while before failing with No valid host found.17:24
zaroanteaya: sorry should be back on now.  i forgot to run gerrit as a daemon.17:25
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196417:25
jeblairmgagne: aha, hrm, i thought i specified one, but i will look into that assuming something is wrong there.  is inap-17301-WAN2344 the one i should use?17:25
mgagnejeblair yes17:26
mordredjeblair, ryanpetrello: https://review.openstack.org/#/c/249334/17:26
zaroanteaya: new patches i created with 2.11 are 236753, and 23675417:26
*** aspiers has quit IRC17:26
mgagnejeblair I found the source of the bug mentioned above, will deploy in prod soon17:26
*** ayoung has joined #openstack-infra17:26
jeblairmordred: oh you're doing that to... :)17:26
mgagnejeblair bug was introduced in 2013 =)17:26
jeblairmordred: one sec17:26
mordredjeblair: sorry - I should have said "yeah, on it"17:27
jeblairmordred, ryanpetrello: i changed the commit message on https://review.openstack.org/24933417:27
ekarlsohey guys, what's needed to make a plugin in devstack work with the new plugin model ? ref designate17:27
mordredjeblair: ++17:27
jeblairmordred: cool, i'll finish pushing that through17:27
mordredjeblair: woot17:28
ryanpetrellojeblair mordred: thanks a ton!17:28
*** dtantsur is now known as dtantsur|afk17:28
anteayazaro: okay thanks17:28
jeblairryanpetrello, mordred: https://github.com/stackforge/pecan/17:28
*** yamamoto has quit IRC17:29
jeblairand it's read-only again17:29
mordredjeblair: oh, that's nice "emonty commited with jeblai" - I don't think I'd notcied that before17:29
anteayazaro: I'd gotten as far as 236750 :)17:29
*** david-l__ has quit IRC17:30
jeblairmordred: heh, yeah, of course the wording is wrong -- i'm the committer, you're the author, but i guess that collided with the way github normally says those things :)17:30
anteayaelmiko: devstack plugin questions probably have a better audience in #openstack-qa17:30
*** ccrouch has quit IRC17:31
jeblairekarlso: ^17:31
*** ccrouch has joined #openstack-infra17:31
mordredjeblair: heh17:31
fungielmiko: i think anteaya meant to reply to ekarlso and mistyped17:33
mordredfungi, jeblair, clarkb: I got this on jenkins02:17:33
mordredurllib2.HTTPError: HTTP Error 502: Proxy Error17:33
mordredINFO:jenkins_jobs.builder:Cache saved17:33
elmikofungi: seems reasonable =)17:33
mordredsame with 0517:33
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Fail early if no data is found in the database  https://review.openstack.org/24933817:33
clarkbmordred check thread count under /monitoring17:33
mordredthe others are still running17:33
anteayaelmiko: I did so, sorry about that17:33
fungimordred: restart it. when jenkins is loaded or breaking, incidence of that will increase17:33
ekarlsoanteaya: kewl17:34
fungimordred: jjb will pick up where it left off, in theory17:34
elmikoanteaya: hehe no worries17:34
mordredfungi, clarkb: AWESOME17:34
anteayafungi: thank you17:34
mordredclarkb: can I use your playbook to restart just one master?17:34
fungimordred: but if the jjb update dies with too much frequency then a jenkins restart will make it less frequent again17:34
anteayazaro: so far the gui for editing topic and commit message work on patchset 23657417:35
clarkbmordred you have to change the hosts glob17:35
*** mohankumar has quit IRC17:35
clarkbmordred I have no idea if ansible has a better system for doing that than cp and sed17:35
*** derekh has quit IRC17:35
anteayazaro: sorry that was 23575417:36
mordredclarkb: -l jenkins02.openstack.org I believe should do it17:37
anteayazaro: I don't know if you care or not but I am using the new screen and in ff 42 and don't see a 'copy to clipboard' button like mordred and I tested last week17:37
anteayazaro: I don't know if I should be seeing it or not17:38
*** bcourt has joined #openstack-infra17:38
*** jordanP has quit IRC17:38
zaroanteaya:  i think that bug was only with 2.1117:39
anteayaah yes sorry and I am on 2.8 again17:39
anteayayup thanks17:39
anteayaokay back in a bit17:39
zaroanteaya: fwiw, the little copy icons are next to change id and commit message on old screen17:39
anteayaI'll look when I get back17:39
openstackgerritMerged openstack-infra/jenkins-job-builder: Add template-name as a variable that can be used in a template  https://review.openstack.org/24726317:40
zaroanteaya: git review won't work with that test site.  old screen has the download link, something like 'git fetc ...'17:41
*** trown is now known as trown|lunch17:41
*** HeOS has quit IRC17:42
*** shardy has quit IRC17:44
*** david-lyle has joined #openstack-infra17:44
*** electrofelix has joined #openstack-infra17:46
*** ashleighfarnham has joined #openstack-infra17:46
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Fix documentation before the release  https://review.openstack.org/24919917:47
*** lykinsbd has quit IRC17:48
mriedemmordred: did pbr change somehow such that it doesn't blow up when the version in setup.cfg of a project conflicts with a release tag on the same repo?17:49
mriedemi would expect juno side grenade to be failing: http://logs.openstack.org/16/216716/1/check/gate-grenade-dsvm/b9a97bb//logs/old/devstacklog.txt.gz#_2015-11-24_17_17_15_85917:49
*** maishsk has joined #openstack-infra17:49
mriedemsince nova stable/juno setup.cfg says the version is 2014.2.4 and that tag already exists in the repo17:49
*** shashank_hegde has joined #openstack-infra17:50
*** yamahata has joined #openstack-infra17:51
*** placko has joined #openstack-infra17:51
jeblairmgagne: found it, thanks!  entirely my fault.   btw 65c94183-8256-4f90-978a-9f0037ddf5c7 seems stuck in build/delete.17:51
*** zz_zz_ja is now known as zz_zz_zz_ja17:51
mgagnejeblair no problem. every error raised by Nova and forward to notifications.error are sent to our monitoring system. Let me tell you it forces us to fix bugs =)17:52
mgagnejeblair ok, will try to cleanup the instance17:53
lifelessanteaya: sorry, family getting up17:53
jeblairmgagne: oh you must love it when i leave nodepool in an error loop :)17:53
mgagnejeblair :D17:53
lifelessanteaya: I differ slightly in my views; I see the experimental -> nonvoting -> voting path as applying to any job that is being added to a new context17:54
mgagnejeblair tbh, they think it's mordred17:54
mriedemlifeless: question to you on pbr also ^17:54
lifelessanteaya: the case where the job is new to the system as a whole is one special case of the general case17:54
jeblairmgagne: excellent :)17:54
lifelessmriedem: no, but we agreed at the summit to remove things from setup.cfg17:54
mriedemlifeless: yeah, but that's not hte case here (it's not post-versioning), so i'm not sure why pbr doesn't fail17:55
mriedembecause https://github.com/openstack/nova/blob/stable/juno/setup.cfg#L317:55
lifelessmriedem: very old pbr17:55
*** AJaeger has quit IRC17:55
dims_anteaya : hopefully a quick one https://review.openstack.org/#/c/248972/ since lifeless and AJaeger have already blessed it17:56
mriedem0.11 had the change which would break on the case like that17:56
mriedemi remember it from before17:56
*** AJaeger has joined #openstack-infra17:56
*** maishsk has quit IRC17:56
*** nmagnezi has joined #openstack-infra17:57
flaper87jeblair: hey, how hard would it be to make gertty load a dashboard template? It'd be super cool to be able to do that, I might even help :D17:57
dims_anteaya : background, ran into it when pylockfile job failed to upload to pypi since that script was using older wheel/universal syntax. thanks in advance!17:57
electrofelixzaro waynr zxiiro: https://review.openstack.org/150730 is another fairly major change that I think is ready to land, and we may want to look at https://review.openstack.org/230613 to see if it still works afterwards.17:57
asselinpuppet really needs to fix this: Error: Duplicate declaration: Httpd_mod[rewrite] is already declared in file /etc/puppet/modules/zuul/manifests/init.pp:407; cannot redeclare at /etc/puppet/modules/httpd/manifests/mod.pp:11 on node test-ci.openstacklocal17:57
lifelessmriedem: is there a pip freeze output around somewhere to look at?17:58
mriedemlifeless: http://logs.openstack.org/16/216716/1/check/gate-grenade-dsvm/b9a97bb//logs/pip-freeze.txt.gz17:58
*** mohankumar has joined #openstack-infra17:58
mriedemlifeless: although that's most likely the kilo side after the upgrade17:58
mtreinishnibalizer: whenever you're around I think the set of patches in: https://etherpad.openstack.org/p/the-big-subunit2sql-migration should be stable now17:59
mtreinishonce those all land we can start working through the manual steps17:59
*** ihrachys has joined #openstack-infra17:59
mriedemlifeless: apparently it installed pbr 1.8.1 http://logs.openstack.org/16/216716/1/check/gate-grenade-dsvm/b9a97bb//logs/old/devstacklog.txt.gz#_2015-11-24_17_15_32_38617:59
mriedemlifeless: so g-r pbr on stable/juno isn't being taken into effect17:59
mriedemprobably b/c of testtools18:00
*** sergmelikyan has quit IRC18:00
lifelessmriedem: -e git+https://git.openstack.org/openstack/nova@4b158202e63d0aa252087664f8e3f64080988a21#egg=nova-dev18:00
lifelessmriedem: I'm speculating but it may have avoided a version entirely18:00
jeblairflaper87: i think it would be cool; i haven't looked at it though, so don't really know what might be involved...18:00
*** ivar-lazzaro has joined #openstack-infra18:00
mriedemlifeless: that's the kilo change18:00
*** ccrouch has quit IRC18:00
*** e0ne has joined #openstack-infra18:01
*** ccrouch has joined #openstack-infra18:01
lifelessmriedem: true, but if develop mode is being used on both sides I'd expect the same18:01
flaper87jeblair: If I manage to get 1 finger out of this huge pile of ______ I'm in, I'll take a look and let you know18:01
lifelessmranyhow, pbr really can't be pinned, because setuptools can't handle conflicts18:01
pabelangerfungi: thanks!18:01
AJaegerjust catching up with backscroll: anteaya, yes, we should remove the job from cisco as well. Will you send a change?18:01
lifelessAJaeger: cisco is going to be the same pattern?18:02
nibalizermtreinish: I'll be avilable after the infra meeting18:02
mtreinishnibalizer: ok cool, thanks18:03
*** david-lyle has quit IRC18:03
jeblairflaper87: cool, happy to help with advice, i'm in the middle of another gertty project right now unable to contribute hacking atm.18:03
mriedemlifeless: yeah, fixtures 1.0.0 has uncapped testtools which has uncapped pbr so we pull in latest pbr,18:03
mriedembut as you say, maybe that doesn't matter in this case18:03
mriedemlifeless: but that would mean pbr did change between 0.11 and 1.8.1 to treat the versions differently, at least in dev mode18:04
*** [1]Thelo has joined #openstack-infra18:04
AJaegerjust catching up with backscroll: anteaya, yes, we should remove the job from cisco as well. Will you send a change?18:04
*** jistr has quit IRC18:04
lifelessmriedem: *perhaps*18:04
AJaegeroops, sorry about the duplicate18:04
lifelessmriedem: without sitting down and testing, I wouldn't want to speculate18:04
AJaegerlifeless: cisco has a comment "Waiting for merge to global requirements"18:05
*** ssancheztrujillo has quit IRC18:05
*** otter768 has joined #openstack-infra18:05
lifelessAJaeger: yes, which suggests it *won't* be the same as networking-bgpvpn18:05
*** sshnaidm has quit IRC18:05
AJaegerlifeless: correct18:05
lifelessAJaeger: which is why removing their job doesn't make sense to me18:05
*** Thelo has quit IRC18:06
*** [1]Thelo is now known as Thelo18:06
lifelessAJaeger: its nonvoting todaty, and they've expressed an intent to be synced18:06
*** placko has quit IRC18:06
lifelessAJaeger: but ultimately IMO its up to cisco - if their master matches master, we can sync once they're installable18:06
AJaegerlifeless, anteaya : then let's leave it in - but let's figure out whether the TODO is still valid...18:06
lifelessNakato: https://review.openstack.org/#/c/247306/ is in - \o/18:06
AJaegerlifeless: they seem to not make any progress, see https://review.openstack.org/#/c/215673/4 ;(18:07
*** kushal has quit IRC18:07
lifelessAJaeger: https://review.openstack.org/#/c/249312/ - you may want to 2A that18:07
*** markus_z has quit IRC18:08
AJaegerlifeless: I'm not core on requirements, so can only +118:08
*** placko has joined #openstack-infra18:09
*** otter768 has quit IRC18:09
mgagnejeblair ok, you should get a badrequest if you don't provide networks now =)18:10
lifelessmriedem: 0.11.. has nothing likely in it18:11
*** david-lyle has joined #openstack-infra18:11
asselinpabelanger, can you help me resolve this issue: Error: Duplicate declaration: Httpd_mod[rewrite] is already declared in file /etc/puppet/modules/zuul/manifests/init.pp:407; cannot redeclare at /etc/puppet/modules/httpd/manifests/mod.pp:11 on node test-ci.openstacklocal18:11
*** ayoung has quit IRC18:12
*** hemna has quit IRC18:12
*** ayoung has joined #openstack-infra18:12
lifelessmriedem: even better, pbr 0.11 *cannot* install juno18:12
*** claudiub|2 has quit IRC18:12
mriedemlifeless: yeah it's not using pbr 0.1118:12
lifeless    UnicodeDecodeError: 'utf8' codec can't decode byte 0xa0 in position 1187750: invalid start byte18:13
mriedemit's using 1.8.118:13
mriedemb/c of deps pulling it in18:13
lifeless    error in setup command: Error parsing /home/robertc/work/nova/setup.cfg: UnicodeDecodeError: 'utf8' codec can't decode byte 0xa0 in position 1187750: invalid start byte18:13
*** shashank_hegde has quit IRC18:13
lifeless    UnicodeDecodeError: 'utf8' codec can't decode byte 0xa0 in position 1187750: invalid start byte18:13
lifeless    error in setup command: Error parsing /home/robertc/work/nova/setup.cfg: UnicodeDecodeError: 'utf8' codec can't decode byte 0xa0 in position 1187750: invalid start byte18:13
lifelessbah, soryr for double paste18:13
lifelessmriedem: yeah, which is a good thing, because of that utf8 decode bug :)18:13
jeblairmgagne: that was fast :)18:13
mgagnejeblair yea, I found the issue and solution yesterday :-/18:13
*** achanda has joined #openstack-infra18:13
*** trown|lunch is now known as trown18:14
pabelangerasselin: where is the log for this?18:14
asselinpabelanger, my test system18:14
asselinseems to be a recent issue, but not sure how long...perhaps within a month?18:15
mordredinfra-root: jjb runs are done everywhere but 1 and 218:16
pabelangerasselin: looks like httpd_mod { 'rewrite' ... } is getting called twice some place18:16
clarkbmordred: and 2 is running the restart playbook?18:16
pabelangerpuppet-zuul looks good18:16
mordredclarkb: no. not yet18:16
AJaegermordred: wow, that takes long ;(18:16
lifelessmriedem: http://paste.openstack.org/show/479907/ works, though the UNKNOWN is strange and new18:16
mordredAJaeger: yah ... we have a LOT of jobs18:16
asselinpabelanger, yeah...looking for the culprit....and seeing two different ways to install mods, also httpd::mod18:17
*** achanda_ has quit IRC18:17
clarkbmordred: AJaeger and updates are O(n^2) with gearman plugin18:17
yolandaclarkb, mordred, so what's the play for that? run jjb manually and... restart jenkins?18:17
lifelessmriedem: oh, its because there is no 2.4 tag in juno18:17
mordredyolanda: on each jenkins master, in a screen session, run: time sudo -H jenkins-jobs update --delete-old /etc/jenkins_jobs/config18:17
*** mriedem has quit IRC18:17
mordredyolanda: the restarting is just because 2 was starting to be a bit a of a wank18:17
mordredyolanda: not strictly necessary for the operation18:18
waynrelectrofelix: thanks for the heads up, i'll try to keep an eye on those changes18:18
yolandaso one thing that we have downstream, and that is quite useful, is have a runbook. We have documented typical infra failures and have the right actions to perform on each case, so any root knows how to fix properly18:18
yolandabecause for example, we could fix running jjb, but without the right parameters18:18
mordredyolanda: I think that would be nice18:18
waynrelectrofelix: do you know what we need to do to create a 2.x branch for JJB?18:18
AJaegerclarkb: So, we need to remove some more jobs ;)18:18
lifelessmrodden: erm, so this is weird :)18:18
yolandamordred, having something on the public infra documentations sounds good?18:19
clarkbyolanda: mordred I mena for jjb we should just fix geraman18:19
lifelessfail IBM internets:)18:19
lifelessmordred: you should get on that18:19
clarkbwhich I started a while back then babies happened18:19
pabelangerasselin: I'd be careful using httpd::mod, it lacks redhat support18:20
waynrelectrofelix: asking because I began dissecting cmd.py last night and hoping to be ready for initial review in a week or so18:20
pabelangerasselin: other then that, do you see the error in the gate?18:20
*** kevinbenton has quit IRC18:20
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Get public IPs from supplied networks  https://review.openstack.org/24935118:20
jeblairmordred, clarkb: that's the nodepool workaround i came up with for internap (before we move to shade which should handle this via other means)18:21
*** kushal has joined #openstack-infra18:21
asselinpabelanger, I didn't look. my 3rd party ci folks are running into it and I reproduced it too18:21
*** mriedem has joined #openstack-infra18:21
clarkbpabelanger: well there is nothing to support on red hat fwiw18:21
clarkbred hat modules are enabled when installed18:22
clarkbunlike on debian where you can install and enable independently18:22
*** achanda has quit IRC18:22
pabelangerclarkb: that is true18:22
lifelessmriedem: welcome back to the internets18:23
openstackgerritMoises Trovó proposed openstack-infra/zmq-event-publisher: Override parameters with environment variables  https://review.openstack.org/23554518:23
lifelessmriedem: now, I have at least a proximate cause for the behaviour18:23
lifelessgit describe origin/stable/juno18:23
anteayazaro: thanks found the download link, never used it before18:24
clarkbjeblair: does tripleo cloud use net label too?18:24
mriedemlifeless: hmm18:24
jeblairclarkb: yes it does18:25
mriedemlifeless: not what i have:18:25
mriedemmriedem@ubuntu:~/git/nova$ git describe origin/stable/juno18:25
jeblairclarkb: i don't know which thing is matching tripleo right now, but since this new thing is last, it shouldn't affect18:25
anteayalifeless: okay that is fine, but if your view is the prevailing view including templates (which it isn't for me) then I can see red flags not being raised when something moves between voting and non-voting18:26
clarkbjeblair: gotcha18:27
anteayadims_: done18:28
dims_thanks anteaya18:28
clarkbI wish there was a better way to test all these using the integration job18:29
anteayaAJaeger: what was the reason you red flagged tmorin's change, I'm glad you did but I am interested in what your thought process was if you recall18:29
clarkb"here is a neutron with all possible neutron return values (should have len() of 1)18:29
*** yamamoto has joined #openstack-infra18:29
lifelessmriedem: so I did a pull first18:30
lifelessmriedem: and I have the 2014.2.4 tag18:30
anteayaclarkb: babies have a tendency to happen18:30
AJaegerpabelanger, odyssey4me : the gate-openstack-ansible-apt_package_pinning-dsvm-functional-trusty is looking fine now on https://review.openstack.org/#/c/248632/, so the jjb restart fixed the problem18:30
lifelessmriedem: tag 2014.2.418:30
lifelessTagger: Alan Pevec <alan.pevec@redhat.com>18:30
lifelessDate:   Thu Nov 19 19:53:10 2015 +010018:30
lifelessmriedem: but if I have the oddity; then the gate could too18:30
pabelangerAJaeger: \o/18:31
AJaegeranteaya: the explanation about the workflow was something that surprised me. The workflow they proposed was not one that is used anywhere else and therefore I wanted some discusion on it.18:31
lifelessanteaya: huh, voting -> nonvoting should always raise flags18:31
anteayaAJaeger: great, that is what I thought18:31
*** fitoduarte has joined #openstack-infra18:31
anteayalifeless: no, it happens all the time18:31
*** tjones has joined #openstack-infra18:31
AJaegerbut normally it happens for "We need some time to fix this, will revert soon again"18:31
*** zeih has quit IRC18:31
lifelessanteaya: you just said 'then I can see red flags not being raised when something moves between voting and non-voting' coupled to whether my view is prevailing or not18:31
lifelessanteaya: but you just said it happens all the time and you don't see red flags there18:32
lifelessanteaya: which means that either the double negative is confusing me18:32
lifelessanteaya: or I'm confused for some other reason18:32
anteayaif someone uses the requirement checks job template and you are fine with it being a non-voting state at some point then I can see red flags not being raised in future18:32
AJaegerpabelanger, odyssey4me : but failing https://jenkins01.openstack.org/job/gate-openstack-ansible-apt_package_pinning-dsvm-functional-trusty/1/console18:33
anteayajobs change status all the time for jobs specific to taht repo18:33
lifelessanteaya: ok. It *must* raise a red flag if and only if they are in requirements/projects.txt18:33
lifelessanteaya: ideally this would be a lint check on layout.yaml18:33
anteayaand requirements check was always voting before now the cisco job being a notable exception18:33
anteayabut if we leave it in, others will copy like tmorin did and patches will get in18:34
openstackgerritMerged openstack-infra/system-config: Sent HAProxy stats to statsd  https://review.openstack.org/24896118:34
anteayalifeless: well that should be documented in zuul/layout.yaml then18:34
clarkbgreghaynes: seems like https://review.openstack.org/#/c/222398/ is the big scary one :)18:34
*** yamamoto has quit IRC18:34
*** mrmartin has quit IRC18:34
lifelessanteaya: makes sense to document it to me18:34
anteayalifeless: because I don't think other reviewers of that file know that18:34
AJaegeranteaya, leifmadsen : let me document the template...18:34
anteayaAJaeger: okay18:34
lifelessanteaya: it is documented from the requirements side already18:34
odyssey4meah, thanks AJaeger - so it seems our change to get it to have sudo access had no effect :p18:34
AJaegersorry, meant lifeless instead of leifmadsen18:34
odyssey4mepabelanger ping?18:35
pabelangerAJaeger: odyssey4me Ya, looks like some tweaking is needed for test job18:35
pabelangerodyssey4me: pong18:35
anteayalifeless: that may be but if project-config reviewers don't know that then they won't review for it18:35
lifelessAJaeger: please do; a reference to the requirements readme section might be helpful18:35
*** shashank_hegde has joined #openstack-infra18:35
AJaegerfound one more non-voting: gate-kuryr-requirements18:37
lifelessalso not in projects.txt, so fine with me18:37
AJaegerlifeless: which link should I add?18:37
*** ccrouch has quit IRC18:37
*** ccrouch has joined #openstack-infra18:37
*** ddieterly has quit IRC18:37
lifelessAJaeger: http://git.openstack.org/cgit/openstack/requirements/tree/README.rst#n102 (or perhaps the rendered copy?)18:37
AJaegerand there's gate-murano-agent-requirements - also not in requriments18:38
asselinpabelanger, would be nice if puppet gives to a stacktrace of who's declaring what when there's an error18:38
AJaegerand gate-solum-requirements18:38
AJaegerbut there's also cliff which is in requirements!18:38
lifelessAJaeger: we should fix that asap18:39
lifelessAJaeger: it led to the confusion haypo and i have been discussing18:39
lifelesssince cliff landed a non-requirements-compatible change18:39
lifelessAJaeger: a linter would be better than docs IMO18:40
lifelessAJaeger: I'm not quite sure what would be involved in wiring that up18:40
AJaegerlifeless: I have no good solution right now18:41
mordredjeblair: looks great18:41
lifelessAJaeger: if we can get a list of (job, project) tuples out of zuul18:41
lifelesserm, (job, project, branch)18:42
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Document check-requirements template  https://review.openstack.org/24937518:42
*** kzaitsev_mb has joined #openstack-infra18:42
lifelessthen we could clone requirements and check18:42
AJaegerlifeless, anteaya ^18:42
kzaitsev_mbsomeone said murano here18:42
AJaegerlifeless: you could just parse zuul/layout.yaml.18:42
lifelessAJaeger: long as we're not reimplementing the guts of zuul :)18:43
*** ihrachys has quit IRC18:43
AJaegerkzaitsev_mb: ;) everything fine ;) gate-murano-agent-requirements is not in the global-requirements process but if you want to go there, you need to make it voting first18:43
jeblairlifeless: what's the tldr version of what you want?18:43
openstackgerritMerged openstack-infra/project-config: bdist_wheel/universal is the canonical option  https://review.openstack.org/24897218:43
*** bardia has joined #openstack-infra18:43
*** ihrachys has joined #openstack-infra18:43
AJaegerjeblair: check that every repo in requirements/projects.txt uses the requirements check template18:44
lifelessjeblair: to check that every project in requirements/proejcts.txt has a check-requirements gate job18:44
lifelessjeblair: and not permit removing those jobs in changes to layout.yaml18:44
jeblairat least checking the template should be a simple matter of yaml parsing18:44
lifelessjeblair: (or making them non-voting)18:44
jeblairdetermining whether they are made non-voting is more complex18:45
kzaitsev_mbsorry, I'm on other meeting, would be free in 5 mins I guess )18:45
AJaegeroops, my change had a bad negation in it ;(18:45
AJaegerkzaitsev_mb: no worries18:45
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Document check-requirements template  https://review.openstack.org/24937518:45
anteayakzaitsev_mb: I am curious why you are running the job if you don't want it to be voting18:45
*** nadya_ has joined #openstack-infra18:46
jeblairthat would probably be a 'import zuul; load config; examine config data structures' kind of effort.18:46
AJaegeranteaya: fixed18:46
jeblaireither that, or parse the zuul config test output18:46
jeblair(which is not really meant to be parseable)18:46
*** fhubik has quit IRC18:46
AJaegerlifeless: cliff as non-voting is there since April 2014 ;(18:47
*** bnemec has joined #openstack-infra18:47
*** mtanino has quit IRC18:47
AJaegerlifeless: change is I40b2cf4030df66c851d7d11da4f81f645d110e76 . Do you want to propose a fix?18:47
AJaegeranteaya: use case with voting turned off would be for me: Ensure that no extra requirements come in while getting some into global-requirements18:49
*** dramalho has joined #openstack-infra18:49
anteayaokay I think a link to the patchset up for global-requirements in the comments for making a job non-voting would be in order, do you think?18:50
lifelessAJaeger: its probably failing at the moment18:51
kzaitsev_mbAJaeger: ok, I caught up =) Let me see, why do we have the job, and where do we have it (cause I do not see it in latest patchsets to agent, oddly)18:51
lifelessAJaeger: let me ping dhellmann18:51
lifelessjeblair: yeah, is zuul's api stable enough for a proejct-config script to sanely import and grovel around like that18:51
kzaitsev_mbanteaya: well, if it is green and the requirements match global — we definitelly want it voting. Although it might be not the case.18:52
lifelessjeblair: or will we be creating tech debt/a future foot gun ?18:52
mordredjeblair, clarkb, fungi, yolanda: could I get a review on https://review.openstack.org/#/c/241495/ ? once that's in, testing puppet apply on individual nodes will be faily easy to do18:52
kzaitsev_mbAnd if it's not the case — we probably do not need it, as it is a waste of resources anyway18:52
jeblairlifeless: i think it could be fairly debt-attracting; we've shied away from considering that an external api18:52
*** apoorvad has joined #openstack-infra18:52
*** eil397 has quit IRC18:53
lifelessjeblair: what about a command line thing to dump some sort of yaml/json to stdout ?18:53
pabelangerleifmadsen: you!18:53
leifmadsenpabelanger, OHAI18:53
lifelessjeblair: e.g. zull --dump-config --no-daemon18:53
lifeless(dump-jobs perhaps , whatever - thats bikeshed territory)18:54
jeblairlifeless: that might be a better approach -- the current config test outputs human readable text, making that optionally output yaml/json should be easy18:54
fungilifeless: we basically already have that (its output by our layout check jobs for example)18:54
anteayakzaitsev_mb: are you wanting to be in global requirements?18:54
fungier, what jeblair just said18:54
kzaitsev_mbanteaya: you meant the agent?18:55
lifelessHenryG: so https://review.openstack.org/#/c/215673/4 - is that still in progress?18:55
*** HeOS has joined #openstack-infra18:55
anteayakzaitsev_mb: yes the job is gate-murano-agent-requirements18:55
*** ihrachys has quit IRC18:55
anteayakzaitsev_mb: do you want that in global requirements?18:55
dhellmannlifeless, AJaeger : what's up with cliff?18:56
jeblairmordred: ah, i understand what that change is doing!  lgtm.18:56
mordredjeblair: yay!18:56
mordredjeblair: it's so good when the change is understandable18:56
HenryGlifeless: yeah, that's going to take a while due to some deps not supporting py318:57
lifelessdhellmann: the check-requirements job on it is non-voting / missing18:57
jeblairmordred: it took me a minute :)18:57
openstackgerritMichael Krotscheck proposed openstack/requirements: Update oslo.middleware to 3.0.0  https://review.openstack.org/24921618:57
mordredjeblair: blast18:57
lifelessdhellmann: but it is in requirements/proejcts.txt18:57
*** ihrachys has joined #openstack-infra18:57
dhellmannlifeless : oh, that's definitely an oversight we should fix that18:57
lifelessdhellmann: we can't make it voting right now because it has this unicodecsv change18:57
dhellmannlifeless : (by making cliff comply with requirements)18:57
*** achanda has joined #openstack-infra18:57
dhellmannah, yeah, so we need that in the requirements list?18:57
lifelessdhellmann: well, we need to figure out whats up with it18:58
AJaegerkzaitsev_mb: you have it on stable branches - so you should have it everyhwere: https://review.openstack.org/#/c/230407/18:58
nibalizerI won't be able to attend the infra meeting today folks, sorry18:58
lifelessdhellmann: haypo put up the change to requirements once I pointed this out18:58
lifelessdhellmann: but I haven't looked into it yet18:58
anteayanibalizer: hope everything is alright18:58
AJaegerdhellmann: change that did part of it is I40b2cf4030df66c851d7d11da4f81f645d110e7618:58
dhellmannAJaeger : looks like I dropped the ball on restoring those jobs18:59
kzaitsev_mbanteaya: tbh, I'm not sure that we do want murano-agent to be in global requirements — gotta check that with the others.18:59
AJaegerkzaitsev_mb: ah, you run the update manaully...18:59
*** fedexo has joined #openstack-infra18:59
*** adduarte has joined #openstack-infra19:00
lifelessdhellmann: https://review.openstack.org/#/c/247962/ - click through and look at the linked bug19:00
fungiit's that (weekly meeting) time again! let's all head on over to #openstack-meeting19:00
*** bardia has quit IRC19:00
lifelessdhellmann: and the patch to cliff19:00
kzaitsev_mbAJaeger: strange, that it's not here https://review.openstack.org/#/c/240808/19:00
*** pradk has quit IRC19:00
lifelessdhellmann: in fact, you have ;)19:00
anteayakzaitsev_mb: okay well having the requirements check job running if you don't want to be in requirements doesn't serve a purpose in my mind19:00
AJaegerkzaitsev_mb: the requirements jobs are only run if requirements files change19:00
kzaitsev_mbAJaeger: yeah, in kilo murano still had non-standard requirements. We're only getting the OpenstackProposalBot from liberty and on =)19:00
AJaegerkzaitsev_mb: you can run it only on liberty and newer...19:01
kzaitsev_mbAJaeger: oh, I see.19:01
dhellmannlifeless : I think this is coming back to the cmd2 use again. Dropping that has been on  my todo list for ages, and keeps getting pushed down.19:01
AJaegerdhellmann: will you send a change for cliff or shall I?19:01
*** wuhg has quit IRC19:01
jeblairlet's all go to the meeting... let's all go to the meeting... let's all go to the meeting, and have ourselves a ... meeting.19:01
dhellmannAJaeger : if you send it I can vote on it.19:01
lifelessdhellmann: what I don't understand is how unicodecsv being installed breaks things19:01
lifelessdhellmann: it looks to me like it just becomes unnecessary at that point19:02
dhellmannlifeless : I'd have to ask haypo19:02
*** pradk has joined #openstack-infra19:02
lifelessdhellmann: https://review.openstack.org/#/c/226966/2/cliff/formatters/commaseparated.py19:02
kzaitsev_mbanteaya: well, tbh it does, since we would be sure, that murano-agent only depnds on everything standard. Even if it's not in global requirements.19:02
*** pradk has quit IRC19:02
lifelessdhellmann: I think haypo was wrong to worriy about it19:02
freerunnerAJaeger: We still have non-global requirement in murano-agent.. https://github.com/openstack/murano-agent/blob/master/requirements.txt#L2119:02
lifelessdhellmann: we have no way in the requirmens machinery at the moment to express the difference between19:02
freerunnerkzaitsev_mb: ^^19:02
lifelessdhellmann: 'not needed' and 'must not have'19:02
*** dramalho has quit IRC19:03
anteayakzaitsev_mb: okay can we have it voting?19:03
*** fitoduarte has quit IRC19:03
kzaitsev_mbfreerunner: well, that probably means, that we can remove the job completely.19:03
*** kozhukalov_ has joined #openstack-infra19:03
dhellmannlifeless : yeah, I think this version check for installing the lib is not needed19:03
lifelessdhellmann: if we make unicodecsv be prevented on 3.x, then noone in the openstack context *can* have it as a dep even if they want ro19:03
dhellmannlifeless : right19:03
lifelessdhellmann: and as having it there is not harmful, I propose we just accept the requirements sync19:03
dhellmannok, so -2 to the requirements patch and remove the version check in cliff19:03
freerunnerkzaitsev_mb: AJaeger: anteaya: I can't find 'bunch' in the global-requirements. So, if we make it voting, it will become broken.19:04
kzaitsev_mbanteaya: AJaeger: would it be ok, if we come back to you tomorrow, after pinging our PTL and the rest of the community (most of them are probably asleep by now) =))19:04
lifelessdhellmann: the version check in cliff's code is fine IMO19:04
dhellmannlifeless : not in the code, in the requirements file19:04
lifelessdhellmann: we'll just have a stubby requirement until 2.7 EOLs19:04
anteayakzaitsev_mb: freerunner I'm fine either way, voting or gone, but having it non-voting is a grey area right now that I would like to clean up if possible19:04
anteayakzaitsev_mb: freerunner thank you19:04
lifelessfreerunner: are you trying to make it voting? You need to be adding your requirements to openstack/requirements if so19:05
lifelessfreerunner: if you're not trying to make it voting, there's not much point having the job19:05
kzaitsev_mbanteaya: I believe there are 2 options here — we either start working towards removing non-standard requirements and makeing the job voting. Or we decide, that we keep those and remove the job =)19:05
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add check-requirements for cliff  https://review.openstack.org/24938019:06
anteayakzaitsev_mb: yes, voting or remove the job19:06
AJaegerdhellmann, lifeless: here's the cliff change ^19:06
freerunnerkzaitsev_mb anteaya lifeless: Voting is preferred, ofc. We need some time to try to investigate, how we can remove 'bunch'19:06
lifelessfror add it to global requirements....19:06
dhellmannAJaeger : oh, I thought you meant a change *in* cliff. I can't +2 that one. :-)19:06
lifelessfreerunner: or did you get rejected?19:07
AJaegerkzaitsev_mb: sure, figure it out but please figure out where you want to go ;)19:07
freerunnerlifeless: We're not tryed yet.19:07
AJaegerdhellmann: I will find others to +2 ;)19:07
AJaegerdhellmann: your +1 would still be good19:07
dhellmannAJaeger : I added the cliff core folks to the review19:07
AJaegerthanks, dhellmann19:07
lifelessdhellmann: so I'm going to approve https://review.openstack.org/#/c/217142/19:08
kzaitsev_mbanteaya: either way — we should ping the rest of our team, to make sure, they're aware of that. =) would come up with some solution tomorrow (or before the end of the week at least =)19:08
dhellmannlifeless : I just voted +2 on another one, let me find that19:08
anteayakzaitsev_mb: thank you19:08
dhellmannoh, that was liberty19:08
kzaitsev_mbfreerunner: well, that's up to debate imho. I'd better remove the job )19:08
*** ddieterly has joined #openstack-infra19:09
*** mohankumar has quit IRC19:09
*** unicell has joined #openstack-infra19:09
*** kevinbenton has joined #openstack-infra19:10
freerunnerkzaitsev_mb: Heh ;) Let's try to discuss it tomorrow, yep.19:10
*** ihrachys has quit IRC19:11
*** ihrachys has joined #openstack-infra19:12
lifelessmriedem: is it possible that two differnet 2014.2.4 tags have been pushed at different times19:12
mriedemlifeless: i'd hope not19:12
lifelessmriedem: the 2014.2.4 I have here is 044154de11ddd0d250e3486718843642ddaf579a19:12
*** sridhar_ram has quit IRC19:12
*** placko has quit IRC19:12
*** arborism has joined #openstack-infra19:13
*** signed8bit is now known as signed8bit_ZZZzz19:13
fungii believe gerrit would reject a push to overwrite a tag, unless it was first deleted (which is also disallows by policy hence not likely without gerrit admin collusion?)19:14
lifelessmriedem: I see a 2014.2.4 with this in gitk:19:14
*** ccrouch has quit IRC19:14
lifelessFollows: 2014.2.219:14
lifelessPrecedes: 2014.2.419:14
*** ccrouch has joined #openstack-infra19:14
clarkbfungi: you can --force as admin19:14
clarkbfungi: er s/admin/project creator/19:15
fungiclarkb: yeah, by "policy" there i mean default acls19:15
mriedemlifeless: i have 044154de11ddd0d250e3486718843642ddaf579a19:15
lifelessso I dunno19:16
lifelessanyhow, when git describe says 2014.2.3, pbr is going to be ok with things19:16
lifelessfigure out why that happens,a nd you'll get the version error we expect :)19:17
*** mtanino has joined #openstack-infra19:18
mriedemasselin: at what point will we have a global elastic-recheck job for 3rd party CIs? that would be *awesome*19:19
mriedemso that when hyper-v and xen ci fails in nova for known things, e-r would tell us - would have to be like a 3rd party e-r though19:19
mriedemsince i don't suppose anyone will ever have 3rd party ci publishing logs to the community logstash index19:20
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add check-requirements for cliff  https://review.openstack.org/24938019:20
clarkbmriedem: I am not sure we would ever have that unless someone wants to give us a whole heck fo a lot of disk and cpu19:20
openstackgerrityolanda.robla proposed openstack-infra/system-config: Start using cgit::lb class  https://review.openstack.org/18182919:20
asselinmriedem, yeah. mmedvede made progress is getting logstash for 3rd party ci, so we're going towards that direction19:20
mriedemclarkb: i know, i can dream...19:20
clarkbwe are already just barely riding the line with our stuff19:20
clarkbeg two indexes leak over and we hit OOM protection19:20
*** kzaitsev_mb has quit IRC19:20
*** achanda has quit IRC19:21
mriedemyeah, but like, couldn't a 3rd party ci team have their own e-r bot that is then used to report back on failed changes19:21
fungihowever our e-r stack including logstash/es are puppeted and runnable by any third-party ci operators as well19:21
asselinclarkb, I think the idea would be the 3rd party ci itself would give recheck comments19:21
mriedemfungi: yeah19:21
clarkbasselin: thats not "global"19:21
clarkbthats multiple instances of this tool19:21
clarkbwhich is fine19:21
*** dramalho has joined #openstack-infra19:21
*** burgerk_ has quit IRC19:22
*** adduarte has quit IRC19:22
*** signed8bit_ZZZzz is now known as signed8bit19:23
lifelessmriedem: (test)robertc@lifeless-z140:~/work/nova$ git describe origin/stable/juno19:24
lifeless(test)robertc@lifeless-z140:~/work/nova$ git describe gerrit/stable/juno19:24
*** tjones has quit IRC19:24
lifelessmriedem: origin is origin  https://git.openstack.org/openstack/nova19:24
lifelessmriedem: gerrit is well gerrit19:24
*** achanda has joined #openstack-infra19:25
*** kdas_ has joined #openstack-infra19:25
*** kushal has quit IRC19:26
lifelessgit rev-parse origin/stable/juno19:26
lifelessgit rev-parse gerrit/stable/juno19:26
*** tjones has joined #openstack-infra19:27
lifelessmriedem: so - for some reason my origin remote was stale. Fixed and I see 2014.2.419:27
*** abregman is now known as abregman|nearby19:27
*** ccrouch has quit IRC19:27
lifelessmriedem: and yet I don't get an error from pbr. ooo.19:28
*** ccrouch has joined #openstack-infra19:28
lifelessmriedem: I shall investigate more19:28
*** tjones has left #openstack-infra19:28
lifelessmriedem: hmm, there was a cached egg info somewhere pbr was trusting and not rebuilding.We'll have to revisit that cache code I think19:29
lifelessmordred: ^19:30
*** hashar has joined #openstack-infra19:30
*** aspiers_ has quit IRC19:30
mordredlifeless: stellar19:31
*** trukisesst3 has quit IRC19:31
lifelessmordred: by revisit I mean delete19:31
*** ihrachys has quit IRC19:33
*** mrmartin has joined #openstack-infra19:35
*** ashishb has quit IRC19:36
openstackgerritVilobh Meshram proposed openstack/requirements: Add python consul client  https://review.openstack.org/24602119:39
openstackgerritMonty Taylor proposed openstack-infra/system-config: Add rollback script for 2.11  https://review.openstack.org/24559819:39
*** sabeen1 has quit IRC19:41
*** salv-orlando has quit IRC19:41
openstackgerritMonty Taylor proposed openstack-infra/system-config: Add rollback script for 2.11  https://review.openstack.org/24559819:41
Shrewsmordred: On 247205, I agree soooo much with SpamapS about missing tests. At the same time, I don't think we have a real good solution for testing that particular code path yet, right?19:42
mordredzaro: ^^ there is your data migration (fungi, jeblair in case you're curious)19:43
fungithanks mordred! splintering discussion across channels is confusing19:43
mordredfungi: (sorry)19:44
*** claudiub has joined #openstack-infra19:45
zaromordred: thanks19:46
*** regXboi has joined #openstack-infra19:46
*** mrmartin has quit IRC19:47
*** sdake has joined #openstack-infra19:49
*** Sukhdev has joined #openstack-infra19:51
openstackgerritMerged openstack-infra/shade: Retry API calls if they get a Retryable failure  https://review.openstack.org/24930419:51
*** sergmelikyan has joined #openstack-infra19:51
*** sdake_ has joined #openstack-infra19:52
openstackgerritMerged openstack-infra/glean: Fix creation of vlan interfaces in Debian/Ubuntu  https://review.openstack.org/24462519:52
jesusaurusclarkb: re: voting on log_processor, i don't think we've added infra-core to log-processor-core yet, would you mind doing the needful?19:53
*** dims has joined #openstack-infra19:53
clarkbjesusaurus: they are there https://review.openstack.org/#/admin/groups/811,members19:53
clarkbits just caching or doing something funny19:54
jesusaurusyep, looks like we still need to add infra-core to log-processor-core and log-processor-release19:54
jesusaurusclarkb: i see nothing at https://review.openstack.org/#/admin/groups/1188,members19:54
*** sdake has quit IRC19:54
jesusaurusoh, that's a different group19:54
*** achanda has quit IRC19:54
*** mrmartin has joined #openstack-infra19:55
clarkbshould infra core be in the release group too?19:55
*** sridhar_ram has joined #openstack-infra19:55
jesusaurusyeah, i think so19:55
*** dims_ has quit IRC19:56
*** achanda has joined #openstack-infra19:57
*** abregman|nearby is now known as abregman|afk19:57
zarorcarrillocruz: hey, i remember you and cody-somerville asked about a gerrit feature to review tags and branches.19:57
rcarrillocruzgood memory19:58
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: move add_comment.py to a console script  https://review.openstack.org/24939619:58
thingeeasselin: where can I find the current CI repo being recommended for vendors?19:58
rcarrillocruzi can tell you release managers and all in downstream would be happy with it19:58
rcarrillocruzis it coming?19:58
thingeeasselin: preparing things for the ironic folks19:58
asselinthingee, https://github.com/openstack-infra/puppet-openstackci/tree/master/contrib19:59
zarorcarrillocruz: i talked to one of the gerit maintainers and he says he thought about adding that feature in gerrit but opted against it because the workflow can be so varied between users.20:00
*** rfolco_ has quit IRC20:00
clarkbzaro: I think the implementation would be similar to change review. push to refs/proposed_tag refs/proposed_branch or whatever, this makes a "change", vote and instead of merging you just create the thing20:01
clarkbthen you can ACL it just like anything else20:02
openstackgerritHenry Gessau proposed openstack/requirements: Add networking-cisco repo to projects list  https://review.openstack.org/21567320:02
* jesusaurus thinks it would be really useful to review tag creation20:02
rcarrillocruzthat's how i pictured, exactly as a regular change20:02
asselinthingee, http://lists.openstack.org/pipermail/openstack-dev/2015-November/080058.html20:02
zaroclarkb: the problem is that there needs to be some checks in place to make sure that it's a valid change.20:02
clarkbzaro: for tags you would check "does this sha1 exist"20:03
clarkbsame for branches20:03
clarkbotherwise reject20:03
krotscheckcrinkle: For that wheel mirror patch - should the known hosts file include all of our pypi mirrors? There seem to be a couple missing.20:03
clarkb(I think gerrit has a track record of trying to make simple things complicated and really need to keep it simple)20:03
zaroi think that's just one thing that you might want to check for.  others might be is it a valid name?20:03
openstackgerritMerged openstack-infra/system-config: Add puppet apply settings to puppet.conf  https://review.openstack.org/24149520:04
clarkbzaro: if you want to be defensive sure, but git should already only allow pusing of valid names20:04
*** ashishb has joined #openstack-infra20:04
*** bdemers has quit IRC20:04
crinklekrotscheck: sounds likely! but i'm not really sure, i just helped make the puppet tests pass20:04
zaroi mean valid to humans20:04
krotscheckcrinkle: Got it, will add a comment.20:04
crinklekrotscheck: i suspect greghaynes will be back online in a bit to answer20:04
clarkbzaro: that is what review is for20:05
clarkbzaro: if it isn't valid abandon it20:05
clarkb(this is why we want reviewable tags fwiw)20:05
*** bdemers has joined #openstack-infra20:05
*** otter768 has joined #openstack-infra20:06
anteayapleia2: is feb 10-12 an option for the infra mid-cycle?20:06
*** dtardivel has quit IRC20:07
*** fitoduarte has joined #openstack-infra20:08
openstackgerritTom Cocozzello proposed openstack-infra/project-config: Remove python26 from keystone projects  https://review.openstack.org/24940020:08
asselinpabelanger, fyi I found the issue, we have a mixed mode with httpd::mod and httpd_mod. i'll submit some patches to fix it.20:08
pleia2anteaya: I don't have any information yet20:09
anteayapleia2: okay thanks20:10
yolandaso if that mid-cycle is related to infra-cloud,  some of us need to attend: rcarrillocruz, crinkle, myself... i guess we need to discuss at some near point20:10
openstackgerritTom Cocozzello proposed openstack-infra/project-config: Remove python26 from keystone projects  https://review.openstack.org/24940020:10
hasharzaro: hello, sorry been mostly silent recently.  Was wondering where to fill feature request for the Jenkins gearman plugin :-}  storyboard/launchpad/jenkins jira  confuses me :/20:10
*** otter768 has quit IRC20:10
zaroclarkb: you do nave a compelling argument.  i'm not reemembering why having CI check made more sense to me when i discussed with DavidP.  I'm guessing it was because the lists of things to check were pretty big for for them before tags/branches would get created.20:10
*** changbl has quit IRC20:11
zarohashar: hey, good Q :)20:13
*** ociuhandu has quit IRC20:13
openstackgerritMerged openstack-infra/project-config: Add tempest to magnum devstack gate  https://review.openstack.org/24812320:13
zaroi would put them in the jenkins jira tracker20:13
pleia2yolanda: yes, the mid-cycle would be focused on infra-cloud20:14
hasharzaro: deal!20:14
fungiasselin: thingee: also known as https://git.openstack.org/cgit/openstack-infra/puppet-openstackci20:14
*** signed8bit is now known as signed8bit_ZZZzz20:14
hasharzaro: also for what it is worth, seems the plugin works with Jenkins 1.625.220:14
yolandapleia2 ok, so share with us dates and plans if you organize it, and we can help on whatever is needed20:15
fungiasselin: thingee: especially if you're writing up official documentation--please don't point people to github. it makes many assume we use github development workflow for those repos20:15
zarohashar: that's just crazy!20:15
*** sdake_ has quit IRC20:15
asselinfungi, the issue I have with that link is it doesn't show it "pretty" Any tips to resolve that20:15
*** sdake has joined #openstack-infra20:15
*** AJaeger has quit IRC20:15
pleia2yolanda: will do :)20:15
fungiasselin: start publishing documentation and link to that instead if you want something "pretty"20:15
*** ldnunes has quit IRC20:15
*** signed8bit_ZZZzz is now known as signed8bit20:16
* pleia2 seeks lunch20:16
asselinfungi, within system-config for puppet module?20:16
zaroanteaya, dimtruck : so if you would like to test the reverted change to fix https://code.google.com/p/gerrit/issues/detail?id=3365  it's up on review-dev.o.o  thanks.20:17
*** hdd has quit IRC20:17
fungiasselin: documentation for our puppet modules would be awesome, even if it's just a job that runs README.rst through docutils and stuffs the result up in some subpath of docs.openstack.org/infra20:17
dimtruckzaro: thanks!20:17
anteayazaro: thanks, will test, going to finish sitting in on the tc meeting then a cup of tea20:18
asselinfungi, yeah I will look into that. thanks!20:18
*** otter768 has joined #openstack-infra20:18
fungiasselin: thank you too!20:18
openstackgerritTom Cocozzello proposed openstack-infra/project-config: Remove python26 from keystone projects  https://review.openstack.org/24940020:19
openstackgerritDavid Caro proposed openstack-infra/jenkins-job-builder: Added support for the workflow job type  https://review.openstack.org/24816920:20
clarkbfor all of these ^ changes it might be easier if infra just pulled them all out when the slaves go away?20:20
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Typo in pypi-extract-universal.py  https://review.openstack.org/24940320:20
clarkbI worry about conflicts and completeness otherwise20:20
*** placko has joined #openstack-infra20:20
*** apoorvad has quit IRC20:21
fungiclarkb: that would be my preference too, but it seems like some individual projects are eager to start ripping out their 2.6 support ahead of our schedule20:21
openstackgerritTom Cocozzello proposed openstack-infra/project-config: Remove python26 from keystone projects  https://review.openstack.org/24940020:22
*** sergmelikyan has quit IRC20:23
*** haypo has joined #openstack-infra20:23
clarkbwhich is fine once juno is eol'd20:23
clarkbbut before that point not so good20:23
clarkb(and infra can handle it as part of juno eol)20:23
haypoclarkb: hi. would you mind to review the update patch https://review.openstack.org/#/c/247936/ to add liberasurecode packages? this change blocks my python 3 work on swift20:24
dimtruckzaro: tested the redirect.  +120:24
fungiclarkb: well, 2014.2.4 releases are out 5 days ago so i don't see anyone approving more stable changes for stable/juno before eol. i'd be working through it already except i first want to make sure i'm caught up on the related ml threads20:24
dimtrucki'm going to run more manual tests against it just to make sure i don't find anything.20:25
clarkbfungi: I know of at least one project (swiftclient) that isn't quite ready yet20:25
clarkbunless they went ahead and got that done yesterday20:25
*** EricGonczer_ has quit IRC20:25
*** ayoung has quit IRC20:26
*** ayoung has joined #openstack-infra20:26
clarkbgreghaynes: I think I found a small bug in https://review.openstack.org/#/c/222398/33 but lgtm otherwise20:27
anteayadimtruck: thanks20:27
*** EricGonczer_ has joined #openstack-infra20:28
*** sergmelikyan has joined #openstack-infra20:29
*** changbl has joined #openstack-infra20:31
*** fedexo has quit IRC20:31
*** placko has quit IRC20:33
*** EricGonczer_ has quit IRC20:33
*** ashishb has quit IRC20:34
*** EricGonczer_ has joined #openstack-infra20:34
*** ociuhandu has joined #openstack-infra20:35
hasharzaro: filled a bug, but I think it is an issue in the rebuilder Jenkins plugin rather than in Gearman plugin :-}   OFFLINE_NODE_WHEN_COMPLETE is not reinserted when manually rebuilding (i.e. without 'recheck' but directly in the web GUI)20:36
*** e0ne has quit IRC20:38
*** EricGonczer_ has quit IRC20:38
electrofelixwaynr: I was hoping that we might be able to refactor the api's without needing to create a separate branch, but  if not I think its not to difficult to request one.20:38
zarodimtruck: you can apply that +1 here if you like https://review.openstack.org/#/c/248411/20:38
dimtruckzaro: will do20:39
*** Swami has quit IRC20:39
*** nadya_ has quit IRC20:41
openstackgerritSteve Martinelli proposed openstack-infra/project-config: modify openstackclient functional tests to use neutron dsvm  https://review.openstack.org/24941120:42
electrofelixwaynr: at the very least I recall Thierry sent out an email about stable branches and the various release cycles and I'm pretty sure we'd match at least one of them and could just follow the suggestions.20:42
*** yamahata has quit IRC20:42
anteayastevemar: is that test voting right now?20:43
stevemaranteaya: yes maam20:43
*** achanda has quit IRC20:43
anteayastevemar: okay so if that change breaks the job you can't merge any code20:43
openstackgerritRamy Asselin proposed openstack-infra/puppet-zuul: Migrato to httpd::mod from httpd_mod  https://review.openstack.org/24941220:43
asselinpabelanger, ^^20:44
zarohashar: i think only gearman knows about OFFLINE_NODE_WHEN_COMPLETE so why do you expect it to do that when you manually kick on build from UI?20:44
anteayastevemar: so my suggestion is to make a new job with that change and add it to the experimental pipeline20:44
asselinmigrato...is that italian?20:44
waynrelectrofelix: i seem to recall someone else preferring to work off a branch20:44
anteayastevemar: then if that job builds make it non-voting in check, so two jobs running the old one voting and this new one non-voting20:44
hasharzaro: the rebuild plugin doesn't reinject  the parameter anyway since it is not in the default list of parameters of the job20:44
waynrs/branch/separate branch/20:44
waynrbut I don't really care20:45
anteayastevemar: once the job is stable, the new job runs voting in check and gate and you remove the old job20:45
anteayastevemar: make sense?20:45
openstackgerritRamy Asselin proposed openstack-infra/puppet-zuul: Migrate to httpd::mod from httpd_mod  https://review.openstack.org/24941220:45
hasharzaro: from a manual rebuild, I would expect the node to be discarded, just like if it got triggered by Zuul :D20:45
*** EricGonczer_ has joined #openstack-infra20:45
mtreinishnibalizer: let me know when you're back around. I've got a couple hours, so lets see if we can get things moving20:45
stevemaranteaya: it does, i was thinking of just skipping the functional tests that fail (if any) if a failure did happen20:45
anteayastevemar: add that as a comment on the patch, that way if this change breaks the job you are taking responsiblity for the outcome20:46
stevemaranteaya: cool with me20:46
mordredgreghaynes, yolanda, clarkb, fungi: it seems like it's time for a glean release with that latest patch20:46
zarohashar: no, if you want it to work like zuul then you need to trigger the job by sending to gearman.20:46
electrofelixwaynr: sure, if it looks like there will be a break in compatibility that can't be easily masked it makes sense, but given the rate of reviews I think we'd still have plenty of time to cut a release and branch20:46
mordredand it has a new feature - dealing with vlans, so perhaps v 1.5.0 ?20:46
*** placko has joined #openstack-infra20:47
clarkbmordred: wfm20:47
*** placko has quit IRC20:47
anteayastevemar: thanks20:47
*** eil397 has joined #openstack-infra20:47
*** placko has joined #openstack-infra20:48
openstackgerritSteve Martinelli proposed openstack-infra/project-config: modify openstackclient functional tests to use neutron dsvm  https://review.openstack.org/24941120:49
zarohashar: the gearman plugin is the thing that knows about OFFLINE_NODE_WHEN_COMPLETE and will do something with it.20:49
fungimordred: glean release sounds fine20:49
stevemaranteaya: thanks for the suggestion!20:49
hasharzaro: so doing a manual rebuild bypass the gearman plugin ?20:49
zarohashar: triggering with the build buton on jenkins UI will bypass gearman plugin code.20:49
stevemaranteaya: i gotta remember that not everyone knows all the details about all the proejcts :)20:50
mordredinfra-root: copying hiera data to hosts works!!!20:50
openstackgerritJJ Asghar proposed openstack-infra/system-config: Adding openstack-opportunities@lists.openstack.org  https://review.openstack.org/24941520:50
stevemaranteaya: it's just test code, so i ain't worried if things break, we can clean up our own mess20:50
clarkbmordred: what was missing for that again?20:50
openstackgerritSylvain Bauza proposed openstack-infra/project-config: add release notes jobs for novaclient  https://review.openstack.org/24889820:50
mordredclarkb: the patch we just landed20:50
hasharzaro: ah I see. So I will just disable the rebuild link entirely :-}  thank you!20:50
mordredclarkb: I have now verified that it works as expected20:50
anteayastevemar: great, it is archievd20:50
zarohashar: you can use this to test https://github.com/zaro0508/gearman-plugin-client20:50
clarkbmordred: awesme20:50
stevemaranteaya: \o/20:51
anteayastevemar: I have so much more understanding for folks willing to clean up after themselves20:51
mordredinfra-root: also, jjb re-run is done everywhere20:52
*** matt6434 is now known as mattoliverau20:52
*** aysyd has quit IRC20:52
jeblairmordred: huzzah!20:53
hasharzaro: yeah noticed that one. Needs shell access though :-}  I will just disable the rebuild plugin on those jobs20:53
*** placko has quit IRC20:57
*** abregman|afk has quit IRC20:57
*** maishsk has joined #openstack-infra20:58
*** sdake has quit IRC20:59
*** sdake has joined #openstack-infra20:59
*** salv-orlando has joined #openstack-infra21:00
*** mrmartin has quit IRC21:01
*** salv-orl_ has joined #openstack-infra21:01
*** baoli has quit IRC21:02
*** sridhar_ram1 has joined #openstack-infra21:02
*** Sukhdev has quit IRC21:04
openstackgerritDoug Wiegley proposed openstack-infra/project-config: Add python3 testing to neutron-lib  https://review.openstack.org/24942121:04
*** sridhar_ram has quit IRC21:04
*** salv-orlando has quit IRC21:05
mordredclarkb, pleia2, fungi, jhesketh: could you please +A the patches before this one: https://review.openstack.org/#/c/248752/ I have verified that they work on our systems21:06
* pleia2 has a look21:07
*** tsg has quit IRC21:07
flwanggreetings, can anybody help approve this one https://review.openstack.org/#/c/248490/ ? it's blocking zaqar client's functional test21:07
pleia2ah, inventory_hostname, nice21:07
flwangthe patch just adds a environment variable, thanks21:07
mtreinishpleia2, mordred: if you get a sec, can you take a pass at all the reviews listed on: https://etherpad.openstack.org/p/the-big-subunit2sql-migration21:08
mtreinishyou should have +2 on all of them except for 121:08
openstackgerritMerged openstack-infra/ansible-puppet: Use inventory_hostname to avoid fact gathering  https://review.openstack.org/24875121:08
*** otter768 has quit IRC21:08
pleia2mordred: please see my comment on https://review.openstack.org/#/c/248720/21:10
*** tsg has joined #openstack-infra21:11
*** dprince has quit IRC21:11
pleia2mtreinish: I haven't kept up, are we ready to land these changes? (looking at the one to turn off db backups now)21:12
*** rossella_s has quit IRC21:14
*** rossella_s has joined #openstack-infra21:14
openstackgerritAntoine Musso proposed openstack-infra/jenkins-job-builder: [WMF] pin python-jenkins ==0.4.8  https://review.openstack.org/24942521:15
mordredpleia2: me lookie21:16
*** dramalho has quit IRC21:16
openstackgerritMonty Taylor proposed openstack-infra/ansible-puppet: Restrict the file list to when copy_hieradata  https://review.openstack.org/24872021:16
openstackgerritMonty Taylor proposed openstack-infra/ansible-puppet: Remove stray debug lines  https://review.openstack.org/24875221:16
mordredpleia2: it was a commit message issue - fixed and rebaed the final patch in the series21:17
mordredpleia2: (thanks!)21:17
pleia2mordred: thanks :)21:17
*** haypo has left #openstack-infra21:18
openstackgerritMerged openstack-infra/ansible-puppet: Restrict the file list to when copy_hieradata  https://review.openstack.org/24872021:18
*** Ala has joined #openstack-infra21:18
openstackgerritMerged openstack-infra/ansible-puppet: Remove stray debug lines  https://review.openstack.org/24875221:19
*** kgiusti has quit IRC21:19
clarkbback from lunch21:20
jheskethmordred: done21:20
pleia2mtreinish: went through the patches I was confident about (so, all but the 2 subunit2sql ones), didn't approve anything, just review+vote for now21:20
mordredjhesketh, pleia2: thanks!21:20
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: remove debug statement in release_from_yaml.py  https://review.openstack.org/24942621:21
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: fix error handling and bug reporting in release script  https://review.openstack.org/24942721:21
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: make release_from_yaml.py figure out the deliverable files for us  https://review.openstack.org/24942821:21
*** yonglihe has quit IRC21:21
*** akshai has quit IRC21:22
*** akshai has joined #openstack-infra21:23
openstackgerritMonty Taylor proposed openstack-infra/system-config: Update system-config and puppet modules everywhere  https://review.openstack.org/24943021:24
openstackgerritCody Herriges proposed openstack-infra/project-config: (WIP) Test pupept-openstack modules on more Puppet  https://review.openstack.org/24943121:25
*** regXboi has quit IRC21:25
openstackgerritCody Herriges proposed openstack-infra/project-config: (WIP) Test pupept-openstack modules on more Puppet  https://review.openstack.org/24943121:25
*** kdas_ has quit IRC21:25
*** otter768 has joined #openstack-infra21:29
mtreinishpleia2: yeah, they should all be good to land now. But, either way nothing will take effect until I push the release21:30
mtreinishthat's what triggers everything21:30
mtreinishwell except for the pin reverts :)21:31
mtreinishpleia2: thanks for the reviews21:31
openstackgerritMonty Taylor proposed openstack-infra/system-config: Copy system-config and puppet modules everywhere  https://review.openstack.org/24943421:31
*** arborism has quit IRC21:31
mordredinfra-root: ^^ https://review.openstack.org/249434 and https://review.openstack.org/249430 are two alternate ways of making sure that the puppet modules are all on the target machines before we run puppet apply21:32
pleia2mtreinish: ok, approved the first two, need more eyes on the rest21:32
openstackgerritMonty Taylor proposed openstack-infra/system-config: Copy system-config and puppet modules everywhere  https://review.openstack.org/24943421:33
*** sergmelikyan has quit IRC21:33
mordred(minor change)21:33
mordredthey both work - the synchronize version is a bit faster21:33
mordredand also has the benefit of making each run operate from a consistent state21:33
mordredso I'm more inclined to do https://review.openstack.org/249434 - but would love opinions from folks21:34
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Revert "Allow to delete nodes with missing target or provider"  https://review.openstack.org/24707121:34
clarkbmordred: not sure why the non synchronize method does the ansible galaxy install21:34
jeblairmordred, clarkb: i think we have decided along with yolanda to revert that ^, clarkb added the docs.  the test in that change just flaked and failed an unrelated change so maybe we could go ahead and approve the revert?21:34
clarkbmordred: that shouldn't be required right? is it possible that is why it is slower?21:35
jeblairmordred: reading your changes21:35
mordredclarkb: it doens't need to - I can remove that21:35
clarkbjeblair: my only concern with reverting now is that we will ahve to rebase the image builders again21:35
mordredclarkb: but no - install_modules.sh is the slow part21:35
clarkbjeblair: and I think they are very close ...21:35
mtreinishpleia2: cool, thanks. I'll probably just fast approve the subunit2sql ones. Unless SpamapS shows up to save the day21:35
mordredclarkb: rsyncing the tree turns out to be faster than a bash loop over the dirs and a git pull21:35
openstackgerritMerged openstack-infra/puppet-subunit2sql: Stop attempting to run a mysqldump before migrations  https://review.openstack.org/24668621:35
*** Ala has quit IRC21:36
*** Ala has joined #openstack-infra21:36
mordredclarkb: now - to be fair, I've only tested this on one node - so it's possible that 20 parallel rsyncs from the same host outbound will be slower than 20 parallel bash loop/fetches21:36
mordredbut I didn't want to start shotgunning ansible playbooks across too many of our nodes before they're actually reviewed21:37
openstackgerritMerged openstack-infra/elastic-recheck: Disable InsecurePlatform Warnings  https://review.openstack.org/24706921:37
pabelangerasselin: odd we didn't see it sooner21:37
clarkbya I don't think we should worry too much about it21:37
jeblairclarkb: i'd be more sympathetic to that if we had managed to avoid approving the original change very recently.21:37
clarkbI just noticed the one was doing more work than the other21:37
mordredclarkb: it's not a long time in either case21:37
*** dims has quit IRC21:37
jeblairi know i'm trying to keep out of the way of the builders21:37
mordredclarkb: I think I'm more focused on the sync case providing each host for a given run with the exact same config state21:38
clarkbmordred: ya that is nice21:38
asselinpabelanger, yeah....21:38
mordredclarkb: so since it seems to be low-cost for now, maybe we start with that and if the rsync becomesa bottleneck we cna always move to the install_modules.sh everwhere?21:38
*** dims has joined #openstack-infra21:38
clarkbmordred: sure21:39
*** sabeen1 has joined #openstack-infra21:39
jeblairclarkb: if it helps -- removing a flaky test will help land the builders :)21:40
*** sergmelikyan has joined #openstack-infra21:41
jeblairclarkb: there are no merge conflicts with the builders?  what problem are you seeing?21:41
clarkbI think there are21:42
openstackgerritMatthew Treinish proposed openstack-infra/puppet-subunit2sql: Lets time the super long migrations we have to run  https://review.openstack.org/24604121:42
mtreinishpleia2: ^^^ isn't it great when your patches merge conflict with each other21:42
clarkbneeded a rebase after that change merged21:42
clarkbits how I found that change21:42
*** sabeen3 has joined #openstack-infra21:43
jeblairclarkb: my git disagrees http://paste.openstack.org/show/479921/21:43
*** sabeen1 has quit IRC21:43
*** gordc has quit IRC21:45
*** elo has quit IRC21:46
*** jaypipes has quit IRC21:47
openstackgerritEmilien Macchi proposed openstack-infra/project-config: gerrit: allow puppet openstack release team to manage puppet-keystone  https://review.openstack.org/24944021:47
*** ayoung has quit IRC21:48
EmilienMI'm unable to create branches on puppet-keystone anymore, can anyone review ^ if possible today? I'm in the release process, thanks21:48
*** otter768 has quit IRC21:48
*** dimtruck is now known as zz_dimtruck21:48
*** boris-42 has quit IRC21:48
*** nmagnezi has quit IRC21:49
EmilienMclarkb: maybe if you can look ^21:49
*** bardia has joined #openstack-infra21:49
pleia2mtreinish: doh :)21:49
anteayaEmilienM: you could create branches on puppet-keystone previously?21:50
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Stop using nova client in test_compute  https://review.openstack.org/24944321:50
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Clean up compute functional tests  https://review.openstack.org/24944421:50
EmilienManteaya: yes but we recently created this ACL for the repo21:50
EmilienMand I missed that part I guess21:50
EmilienMI did not produce a after before the change21:50
*** yamahata has joined #openstack-infra21:50
EmilienMso I'm seeing the issue now21:51
*** hemna has joined #openstack-infra21:51
anteayaEmilienM: yes I see you created juno and kilo: http://git.openstack.org/cgit/openstack/puppet-keystone/refs/21:51
openstackgerritMonty Taylor proposed openstack-infra/system-config: Ensure system-config hieradata link exists  https://review.openstack.org/24944521:51
anteayaEmilienM: ah okay, that makes sense21:51
EmilienManteaya: the ACL for puppet-keystone is  new21:51
clarkbEmilienM: where is that change?21:51
mordredclarkb, jeblair, pleia2: puppet apply from ansible works21:51
EmilienMI did a mistake in the acl :(21:51
mordredwith that change above21:51
mordredI have not verified the puppetdb reports yet21:51
EmilienManteaya: https://github.com/openstack-infra/project-config/commit/5b49af8f646c4836f79f9e2f0c07c02d5c53919f21:52
anteayaEmilienM: it happens21:52
EmilienMclarkb: ^21:52
clarkbyou need a create clause21:52
openstackgerritMerged openstack-infra/subunit2sql: Fix documentation before the release  https://review.openstack.org/24919921:52
anteayaEmilienM: thanks that makes sense now21:52
mordredbut I have now successfully run the hiera-copy/modules-sync/puppet-apply and it totally worked - and it worked on a host that has hiera values it needs (the patch above fixed that)21:52
*** Swami has joined #openstack-infra21:53
EmilienMclarkb: this is what I did, isn't?21:53
anteayaclarkb: https://review.openstack.org/#/c/249440/121:53
openstackgerritMerged openstack-infra/subunit2sql: Fail early if no data is found in the database  https://review.openstack.org/24933821:54
clarkbEmilienM: ^F create no results21:55
*** maishsk has quit IRC21:55
anteayaclarkb: he is adding the create clause in 24944021:56
*** rhallisey has quit IRC21:57
EmilienMclarkb: sorry? I don't get it21:58
*** glauco has quit IRC21:58
clarkbneither do I21:58
*** glauco_ has joined #openstack-infra21:58
clarkbI asked for original change, it doesn't do create21:58
clarkbI see there is now a 249440 change21:58
clarkbnot sure how I was supposed to know about that one21:58
clarkbanyways reviewing it now21:58
*** glauco_ has quit IRC21:58
anteayaclarkb: he linked it in backscroll21:58
EmilienMclarkb: I'm not able to create a branch since this change21:58
anteayaclarkb: you must have missed it21:59
EmilienMyes, I sent the link to anita on IRC a few min ago21:59
openstackgerritMerged openstack-infra/project-config: modify openstackclient functional tests to use neutron dsvm  https://review.openstack.org/24941121:59
anteayathen EmilienM and you were talking past each other since21:59
anteayaI was trying to help21:59
*** akshai has quit IRC21:59
anteayaEmilienM: well openstackgerrit showed the link22:00
*** akshai has joined #openstack-infra22:01
EmilienMthank you anteaya and clarkb !22:02
anteayaEmilienM: glad we got it sorted out22:04
*** sergmelikyan has quit IRC22:04
*** hashar has quit IRC22:04
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Clean up compute functional tests  https://review.openstack.org/24944422:06
openstackgerritMerged openstack-infra/project-config: gerrit: allow puppet openstack release team to manage puppet-keystone  https://review.openstack.org/24944022:06
openstackgerritDmitriy Ukhlov proposed openstack/requirements: Updates pika-pool library  https://review.openstack.org/24920622:07
*** ashleighfarnham has quit IRC22:07
openstackgerritSteve Martinelli proposed openstack-infra/project-config: Remove py26 jobs from openstackclient  https://review.openstack.org/24945022:07
*** apoorvad has joined #openstack-infra22:08
*** abregman|afk has joined #openstack-infra22:08
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Fix resource leak in test_compute  https://review.openstack.org/24945222:09
*** sergmelikyan has joined #openstack-infra22:10
*** bdemers has quit IRC22:10
*** abregman|afk has quit IRC22:10
anteayastevemar: did you see the remove py26 jobs on a keystone repo? I asked the patch owner to get your +1 on that one22:10
*** abregman has joined #openstack-infra22:10
anteayastevemar: tom someone?22:11
anteayastevemar: oh you did22:12
*** Sukhdev has joined #openstack-infra22:12
*** baoli has joined #openstack-infra22:12
openstackgerritgreghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders  https://review.openstack.org/22239822:14
openstackgerritgreghaynes proposed openstack-infra/nodepool: Builders distinguish between failure and exception  https://review.openstack.org/24213122:14
openstackgerritgreghaynes proposed openstack-infra/nodepool: Decouple builders from nodepool instance  https://review.openstack.org/23213522:14
openstackgerritgreghaynes proposed openstack-infra/nodepool: Builders can be run on their own  https://review.openstack.org/23225122:14
*** trown is now known as trown|outttypeww22:15
openstackgerritJames E. Blair proposed openstack-infra/project-config: Print the JJB template name in devstack jobs  https://review.openstack.org/24726422:15
*** alivigni has quit IRC22:15
*** SotK has quit IRC22:16
*** Piet has quit IRC22:16
*** dramalho has joined #openstack-infra22:17
*** SotK has joined #openstack-infra22:17
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Clean up compute functional tests  https://review.openstack.org/24944422:18
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Fix resource leak in test_compute  https://review.openstack.org/24945222:18
jeblairclarkb: are you still opposed to landing https://review.openstack.org/247071 now?22:18
*** ZZelle_ has joined #openstack-infra22:18
clarkbjeblair: no22:19
openstackgerritVitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs voting in master branch  https://review.openstack.org/24920322:19
*** baoli has quit IRC22:19
clarkbwill review it22:19
greghayneshttps://review.openstack.org/#/c/249351/ is a new nodepool race fail? :(22:19
*** signed8b_ has joined #openstack-infra22:20
*** zaina has joined #openstack-infra22:20
*** signed8bit has quit IRC22:20
*** thorst_ has joined #openstack-infra22:21
greghaynesI think I hit that one locally last night, so it seems kind of new22:21
*** dramalho has quit IRC22:22
*** thorst__ has joined #openstack-infra22:22
*** abregman has quit IRC22:23
jeblairgreghaynes: that's what i'm trying to fix with the revert clarkb is reviewing now (and you have previously +1d)22:24
openstackgerritMerged openstack-infra/nodepool: Revert "Allow to delete nodes with missing target or provider"  https://review.openstack.org/24707122:24
jeblairgreghaynes: and fixed! :)22:24
*** ccrouch has quit IRC22:24
greghaynesjeblair: oh! I didnt connect those two dots, I thought the revert was just because the node leak22:24
jeblairgreghaynes: it was; the renewed urgency on my part was due to the flaky test22:25
*** elo has joined #openstack-infra22:25
openstackgerritMerged openstack-infra/shade: boot-from-volume and network params for server create  https://review.openstack.org/24720522:25
*** ccrouch has joined #openstack-infra22:25
*** thorst_ has quit IRC22:25
openstackgerritMerged openstack-infra/nodepool: Get public IPs from supplied networks  https://review.openstack.org/24935122:26
greghaynesawesome. Now we just have the one pymysql fixture race to figure out22:26
*** thorst__ has quit IRC22:26
jeblairdstufft: i'm still seeing errors with HTTPError: 404 Client Error: Not Found for url: https://pypi.python.org/packages/source/b/bendacoder-pyDb/bendacoder-pyDb-1.1.0.tar.gz22:26
*** thorst_ has joined #openstack-infra22:27
jeblairdstufft: and we have a bandersnatch mirror that's dead in the water because of that... any idea how i can proceed?22:27
clarkbjeblair: I have no idea if this will work, but maybe we can have that mirror pull from another one of our mirrors22:27
clarkbas a temporary workaround?22:27
jeblairclarkb: i'll give that a try22:28
nibalizermtreinish: pleia2 I'm available now22:30
nibalizerthough maybe the deed is done?22:30
stevemaranteaya: yep, tom is new, he pinged me about it22:30
pleia2nibalizer: https://review.openstack.org/24604122:30
clarkbnibalizer: are you still planning on doing the logstash stuff today? I am around if so22:31
stevemaranteaya: we discussed it in keystone-meeting to remove py2622:31
anteayastevemar: wonderful, way to go new tom22:31
anteayastevemar: lovely22:31
stevemaranteaya: he needs to idle in infra -_-22:31
*** dizquierdo has joined #openstack-infra22:31
mtreinishnibalizer: yep that patch pleia2 linked should be the last one we need to land22:31
*** thorst_ has quit IRC22:31
pleia2nibalizer: ah, this one too: https://review.openstack.org/#/c/248906/22:31
*** achanda has joined #openstack-infra22:31
anteayastevemar: he'll figure it out22:31
*** Ala has quit IRC22:31
pleia2but both are pretty straight forward :)22:31
mtreinishnibalizer: then it's just manual steps before I push the release to to trigger armageddon22:32
anteayaclarkb: what are you doing today for logstash?22:32
*** unicell1 has joined #openstack-infra22:32
clarkbanteaya: nibalizer wanted to merge a series of patches to update the puppeting for the logstash workers22:32
clarkbthe actual service doesnt change at all22:32
anteayaclarkb: cool22:32
anteayaclarkb: great22:32
*** signed8b_ has quit IRC22:32
anteayaclarkb: haven't debugged horizon yet, any time frame in your mind to moving to logstash 2.0?22:33
clarkbanteaya: I still have to untablgle the puppet for that22:33
anteayawas hoping to continue picking away at that and figuring out parsing22:33
*** achanda has quit IRC22:33
anteayaclarkb: okay22:33
clarkbprobably next week at the earliest22:33
clarkbsince we are fast approaching clarkb figures out turkey22:34
anteayaoh good, didn't want to slow you down22:34
anteayayeah that too22:34
anteayaare you smoking one this year?22:34
*** ssancheztrujillo has joined #openstack-infra22:34
clarkbno its going to be cold (for us anyways) and doing it at my place not my brothers22:34
clarkbso no covered patio22:34
*** unicell has quit IRC22:34
anteayaoh okay22:35
clarkb(to give you an idea of how cold it is I am currently saving space in my fridge by storing my beer outside, so its refridgerator temps)22:35
clarkbI think canada cold is probably closer to freezer temps22:35
anteayayou can make ice outside now it is true22:36
*** glauco_ has joined #openstack-infra22:36
anteayaI like being able to store the drinks outside22:36
anteayahow cold does portland usually get?22:37
openstackgerritMonty Taylor proposed openstack-infra/ansible-puppet: Fetch puppet logs and facts after puppet run  https://review.openstack.org/24044622:37
openstackgerritMonty Taylor proposed openstack-infra/ansible-puppet: Remove copy_hieradata value from vars file  https://review.openstack.org/24946622:37
nibalizerclarkb: we can just push it22:37
nibalizersince i'm also helping mordred with puppet apply22:37
clarkbanteaya: this is normalish, its either sunny and just below freezing or wet and just above freezing from about december to march22:38
nibalizermtreinish: pleia2 approved 24604122:38
*** signed8bit has joined #openstack-infra22:38
*** mriedem has quit IRC22:38
anteayaclarkb: nice22:38
anteayaI vote for sunny and below freezing22:38
anteayathat's my favourite22:39
*** ssancheztrujillo has quit IRC22:39
*** ssancheztrujillo has joined #openstack-infra22:39
mtreinishnibalizer: cool, then we're on step 4: https://etherpad.openstack.org/p/the-big-subunit2sql-migration22:40
*** ssancheztrujillo has quit IRC22:41
*** ssancheztrujillo has joined #openstack-infra22:41
openstackgerritMonty Taylor proposed openstack-infra/ansible-puppet: Fetch puppet logs and facts after puppet run  https://review.openstack.org/24044622:41
openstackgerritMonty Taylor proposed openstack-infra/ansible-puppet: Remove copy_hieradata value from vars file  https://review.openstack.org/24946622:41
nibalizerso for https://review.openstack.org/#/c/248906/ won't that not have an effect until we rebuild nodes ?22:41
mordrednibalizer: ^^ k. I don't  have the actual posting to puppetdb working, but everything else does22:42
anteayamtreinish: I'll take 9a as a work item22:42
mtreinishnibalizer: that's fine, because we haven't pushed the release yet22:42
mtreinishanteaya: heh, thanks :)22:42
* anteaya does 9a22:42
mtreinishnibalizer: we just need to make sure we don't end up with 1.0.0 on the images until after the migration is finished22:43
openstackgerritMerged openstack-infra/puppet-subunit2sql: Lets time the super long migrations we have to run  https://review.openstack.org/24604122:43
nibalizerapproved then22:43
*** zaina has quit IRC22:43
openstackgerritMerged openstack-infra/project-config: Set a temporary cap on subunit2sql before 1.0.0 release  https://review.openstack.org/24890622:43
mtreinishnibalizer: cool, ok then I think we're ready to kill the subunit worker and stop puppet22:44
greghaynesjeblair: So I am noticing some nodepool patches that are going to conflict with builders, do we have any plan for eventually making a push so we dont have to spin wheels on rebase/re-review cycling?22:45
greghayneslike, maybe at some point start basing changes off of the builder series22:45
*** zaina has joined #openstack-infra22:45
*** zaina has quit IRC22:45
*** sergmelikyan has quit IRC22:45
pleia2nibalizer: ooh, congrats on scale talk acceptance22:46
nibalizerpleia2: thanks22:47
*** ssancheztrujillo has left #openstack-infra22:48
*** unicell1 has quit IRC22:49
*** doug-fis_ has joined #openstack-infra22:49
elohow does an project start getting tracked for metric for activity dashboard?22:49
*** unicell has joined #openstack-infra22:49
*** fedexo has joined #openstack-infra22:51
eloi noticed that the astara project is not a subproject in http://activity.openstack.org22:51
nibalizermordred: for https://review.openstack.org/#/c/249434/ isn't that going to be painfully slow?22:51
nibalizerpleia2: which one of us is doing the rootish stuff for mtreinish ?22:51
anteayais mrmartin doing activity.o.o things?22:52
nibalizeri guess it's a one time cost then just an rsync22:52
anteayaelo: I'm not exactly sure22:52
pleia2nibalizer: I had not volunteered ;)22:52
nibalizerbut git is pretty good at things, seems odd to use rsync to ensure git repo state22:52
nibalizerpleia2: ok22:52
mtreinishpleia2: heh, I dunno it sounds like you just did :)22:52
*** doug-fish has quit IRC22:53
*** doug-fis_ has quit IRC22:53
nibalizermtreinish: no its fine for me to do it22:53
*** sergmelikyan has joined #openstack-infra22:53
mtreinishnibalizer: ok, cool thanks22:53
openstackgerritEmilien Macchi proposed openstack-infra/project-config: zuul: enable beaker jobs for puppet-mistral  https://review.openstack.org/24917922:54
anteayareed: you are listed as an activity.o.o core reviewer: https://review.openstack.org/#/admin/groups/208,members22:54
anteayareed: how does someone add a project to activity.o.o for tracking?22:55
*** hemna is now known as hemnafk22:55
*** wuhg has joined #openstack-infra22:57
*** peristeri has quit IRC22:57
openstackgerritMerged openstack-infra/irc-meetings: [docinstallteam] change agenda_url  https://review.openstack.org/24921722:58
*** FallenPegasus has joined #openstack-infra22:59
mordrednibalizer: nope23:00
openstackgerritgreghaynes proposed openstack-infra/nodepool: Add test for failing provider loading  https://review.openstack.org/24947023:00
mordrednibalizer: it's actually pretty snappy23:00
jeblairgreghaynes: my priorities are a) new clouds b) builders c) zuulv3.  i'm basically ignoring nodepool patches that are outside of those.23:00
mordrednibalizer: the rsync is actually a bit quicker than the git23:00
jeblairclarkb: apparently that does not work.  i may just need to rsync from an existing mirror23:00
greghaynesjeblair: Ya, I have seen it for bugfixes a few times and it scares me because I have caught at least one time we would have regressed on a bugfix becuase of a merge conflict resolve failure23:01
greghaynesignoring broken providers is an example23:01
greghaynes(also, you should check out that test for it)23:02
jeblairgreghaynes: if you see a problem with that patch, do you mind leaving a review comment to that effect? :)23:02
nibalizerdisabling puppet on subunit-worker0123:02
greghaynesjeblair: sure23:02
nibalizerstopping worker23:03
jeblairgreghaynes: oh i see what you mean -- because there wasn't a test for that, but you added one23:03
jeblairgreghaynes: thanks :)23:04
greghaynesjeblair: Yep23:04
*** mestery has quit IRC23:04
jeblairgreghaynes: you'll note i haven't been pushing on that one since it's not in my critical path :)23:04
nibalizermtreinish: okay im gonna see about taking a snapshot of this trove database23:04
*** doug-fish has joined #openstack-infra23:04
*** mestery has joined #openstack-infra23:05
mtreinishnibalizer: ok23:05
mtreinishI think SpamapS just meant trove backup23:05
greghaynesjeblair: Ya. I just dont have a great strategy for making sure I dont mess up merge conflicts other than to hope tests catch fixes or to try and avoid conflicting with bugs, and once a fix it up it tends to eventually get merged.23:05
mtreinishI think it does a snapshot under the covers23:05
greghaynesjeblair: Normally it isnt a huge issue, this is just a conflict magnet23:05
openstackgerritColleen Murphy proposed openstack-infra/system-config: Add baremetal hpuswest node definition  https://review.openstack.org/20875123:06
mtreinishclarkb: is puppet running on logstash.o.o?23:06
*** ddieterly has quit IRC23:07
greghaynesjeblair: BTW, do we have a topic for new clouds?23:07
clarkbmtreinish: it should be23:08
clarkbjeblair: :(23:08
mtreinishclarkb: ok, just wanted to make sure, before it's time to push the release23:08
*** otter768 has joined #openstack-infra23:08
*** doug-fish has quit IRC23:08
clarkbmtreinish: you cna check on puppetbaord23:09
openstackgerritMerged openstack-infra/jenkins-job-builder: Added support for the workflow job type  https://review.openstack.org/24816923:09
clarkbsee when puppet last ran there23:09
mtreinishclarkb: but that doesn't have the friendly personal touch I get by asking you :)23:10
anteayaclarkb, the friendly ui to puppetboard23:10
*** boris-42 has joined #openstack-infra23:10
*** ddieterly has joined #openstack-infra23:11
*** baoli has joined #openstack-infra23:11
*** dkranz has quit IRC23:12
*** baoli has quit IRC23:13
*** baoli has joined #openstack-infra23:14
openstackgerritFei Long Wang proposed openstack-infra/project-config: Create Zaqar UI repo  https://review.openstack.org/24885023:15
*** baoli has quit IRC23:16
jeblairgreghaynes: no, but i can try to start one23:16
*** ZZelle_ has quit IRC23:17
nibalizergonna take a trove backup23:17
tsgclarkb: on bug 238926, the RH package maintainer for liberasurecode just informed me that the package is now available on F22 (https://bodhi.fedoraproject.org/updates/liberasurecode-1.0.9-3.fc22)23:18
clarkbtsg: so the current change is fine? can you test and confirm that you can install it on f22?23:19
nibalizermtreinish: the backup is building23:19
mtreinishnibalizer: ok cool23:19
mtreinishnibalizer: we probably can check the free space on the database server while that's running too23:19
mtreinishpleia2: did you end up resizing it when we were talking about that the other day?23:20
nibalizerim not sure what tha tmeans23:20
nibalizerwhat database server?23:20
*** signed8bit is now known as signed8bit_ZZZzz23:20
mordrednibalizer, Hunner: u'The POST method is not allowed for /'23:20
mtreinishnibalizer: the subunit2sql server (the one we're backing up now)23:20
pleia2mtreinish: I did not, I haven't done it before and am not familiar with how that works (online resize?)23:20
mordrednibalizer: I got the SSL context figured out in requests (ZOMG INTERFACE MY EYES MY EYES)23:21
mtreinishok, well we should wait until the backup is done then23:21
mordrednibalizer: but I'm getting that 405  - which means I'm guessing / is not what I should be posting to23:21
mtreinishnibalizer, pleia2: yeah we just need to make sure we have enough free space for the migration23:21
nibalizerlikely not23:21
tsgclarkb: I will test on F22 and comment - I am not sure if we need to enable updates-testing repo or the package appears in "updates" repo23:21
clarkbtsg: if its easier you can still chang eit to >2223:21
nibalizermtreinish: i dont really have a lot of visibilyt into that, its just a trove db23:22
*** FallenPegasus has quit IRC23:22
mtreinishnibalizer: there should be a dropdown somewhere in the ui23:22
nibalizer volume            | 32023:22
nibalizer volume_used       | 289.9923:22
pleia2nibalizer: one of the pages has a link where you can resize, and the resize box allows you to go up to 500G23:23
mtreinishnibalizer: yeah, we should be able to increase that to 500, which should give us enough free space to run the migration23:23
mtreinishbut we should probably wait until after the backup is done23:23
*** sabeen3 has quit IRC23:23
*** dingyichen has joined #openstack-infra23:24
tsgclarkb: the devstack guys are waiting on the package to appear in F22 anyway so it should ok to wait a bit23:24
tsgclarkb: I will resubmit tonight if I see this taking longer23:24
openstackgerritMerged openstack/requirements: Add python consul client  https://review.openstack.org/24602123:24
*** apoorvad has quit IRC23:25
mtreinishpleia2: yeah it is an online resize, it just bumps the size of the backing filesystem. I don't know what the backend store but it's either a file somewhere or using something that natively supports resizing23:26
*** EricGonczer_ has quit IRC23:26
openstackgerritQiming Teng proposed openstack-infra/project-config: Add release notes jobs for senlin  https://review.openstack.org/24924423:26
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Keep going on network timeouts or service errors  https://review.openstack.org/23859823:26
*** tlian has joined #openstack-infra23:26
mordrednibalizer: according to the pdb docs: https://docs.puppetlabs.com/puppetdb/3.2/api/command/v1/commands.html#store-report-version-6 the endpoint is /pdb/cmd/v123:27
jeblairclarkb: i'm rsyncing dfw -> nyj0123:27
mordrednibalizer: but when I try to use that, I get Not Found23:27
nibalizerwe're on 2.223:27
openstackgerritIan Wienand proposed openstack/diskimage-builder: Update default to F23  https://review.openstack.org/24729623:27
openstackgerritIan Wienand proposed openstack/diskimage-builder: Pre-install python on F23 images  https://review.openstack.org/24947923:27
ianwgreghaynes: ^ so that brings fedora-minimal & fedora inline23:28
*** dims_ has joined #openstack-infra23:28
clarkbmordred: pdb != pdb I was confused for a moment23:28
*** dims has quit IRC23:29
*** thorst has joined #openstack-infra23:29
*** jffische has joined #openstack-infra23:29
mordrednibalizer: cool - different endpoint23:30
mtreinishanteaya: if you get a sec: https://review.openstack.org/#/c/247868/ the depends on has already landed23:31
mordrednibalizer: it does not like /commands :)23:32
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Keep going on network timeouts or service errors  https://review.openstack.org/23859823:32
nibalizermordred: https://github.com/nibalizer/puppetdb-hacking/blob/master/reports.sh23:32
nibalizerthats how i was doing it23:32
nibalizertechnically hunner and I tested on 2.3 and i think we are running 2.2 on puppetdb.openstack.org23:32
mordredit's /v3 - totally missing from the docs23:33
* anteaya stops staring into the abyss to review that patch23:33
nibalizeranywyas that shell script should get you there23:33
mordredjust like not even in the docs at all23:33
mordredrequests.post('https://puppetdb.openstack.org:8081/v3/commands', json=json.load(open("/var/lib/puppet/reports/ask-staging.openstack.org/201511242211_puppetdb.json", 'r')), cert=('/var/lib/puppet/ssl/certs/puppetmaster.openstack.org.pem', '/var/lib/puppet/ssl/private_keys/puppetmaster.openstack.org.pem'), verify='/var/lib/puppet/ssl/ca/ca_crt.pem')23:33
mordredthat works23:33
nibalizertrove backup-show is really a wealth of information ---- not23:33
*** claudiub has quit IRC23:33
nibalizerstatus is BULDING23:33
nibalizerthat could mean anything lol23:33
zxiiroIn JJB how do I pass a boolean to a parameter through inheritance from a project section? for example I defined "boolvar" in project and I want to set a job template section: Disabled: '{boolvar}'23:34
zxiirothis passes a string unfortunately23:34
notmorganfungi / clarkb / zaro: ping re apache-fu things from meeting today. there is an "easy reproducer"  bit? /me is lookin to dust off the wonderful apache skills23:34
clarkbnotmorgan: deploy latest gerrit release and put behind apache using our config which I will dig up in a sec23:34
notmorganclarkb: cool thnx23:34
clarkbnotmorgan: oh and configure that gerrit to auth with openid23:34
notmorganok yeah.23:35
clarkbsince the weirdness happens when you login and it does the redirect thing back to gerrit23:35
notmorganah ok23:35
notmorganclarkb: 2.11.5?23:35
clarkbnotmorgan: https://git.openstack.org/cgit/openstack-infra/puppet-gerrit/tree/templates/gerrit.vhost.erb is apache vhost template23:35
notmorganor the 2.12rc?23:35
clarkbnotmorgan: ya 2.1..523:35
clarkber 2.11.523:36
*** signed8bit_ZZZzz is now known as signed8bit23:36
anteayaI thought we were on 2.11.423:36
mtreinishnibalizer: heh, yeah that's useful23:36
notmorgananteaya: i'm digging into the reason 2.11.5 is unhappy23:36
*** jffische has quit IRC23:36
clarkbanteaya: either should work since bug is present in both23:36
notmorgananteaya: or whatever, but yeah :)23:36
*** thorst has quit IRC23:36
zxiironevermind figured it out with the {obj:key} thing23:36
*** sergmelikyan has quit IRC23:37
anteayaclarkb notmorgan okay23:37
clarkbnotmorgan: there is a setup script to get started and it runs a h2 db which is fine23:37
clarkbnotmorgan: you iwll likely need to stop it after that, edit config for openid, then start again23:37
anteayanotmorgan: no I mean current review.o.o is on gerrit 2.8, right now our upgrade path is pointed at 2.11.423:38
zaronotmorgan: can repro with 2.11.5 as well23:38
notmorganclarkb: yah i remember setting up gerrit in the past23:38
notmorganzaro: awesome. thnx for confirming23:38
openstackgerritMerged openstack-infra/project-config: Add release notes jobs to subunit2sql  https://review.openstack.org/24786823:39
*** akshai has quit IRC23:39
*** akshai has joined #openstack-infra23:40
*** Swami has quit IRC23:40
zaronotmorgan: dimtruck is also trying his apache-fu on it as well.  you might want to bounce ideas off him as well23:40
* notmorgan nods23:40
notmorganwell i'm setting up a quick env for it and we'll see how it shakes out23:40
*** gildub has joined #openstack-infra23:40
zarorepro steps are in the bug, https://code.google.com/p/gerrit/issues/detail?id=336523:41
clarkbnotmorgan: the hack fix was rewrite //\(.*\) to /$1 with a redirect but that never seemed to match because // was being treated as /23:42
*** thiagop has quit IRC23:42
notmorganclarkb: aye. that was what i was going to look at trying first23:42
*** rcernin has quit IRC23:42
notmorganclarkb: it's odd in some versions of mod_rewrite to strip out extra trailing slashes elegantly23:42
notmorgani remember having some odd issues with this in the past23:43
notmorganwhere it just ... worked some places.23:43
notmorganand then didn't other times.23:43
*** tlian has quit IRC23:44
*** akshai_ has joined #openstack-infra23:45
*** akshai has quit IRC23:46
*** sridhar_ram1 has quit IRC23:46
openstackgerritMerged openstack-infra/puppet-gerrit: Allow puppet to configure 'Report Bug' in Gerrit UI.  https://review.openstack.org/22138823:50
clarkbgreghaynes: I have reviewed the entire builder stack except for the last change23:51
clarkbI think we could try merging next week if someone else is able to review as well23:51
*** apoorvad has joined #openstack-infra23:51
*** ccrouch has quit IRC23:51
mtreinishnibalizer: is it still building?23:51
jesusaurusgreghaynes: jeblair: for 246037 are you suggesting changing the variable names or just the statsd keys?23:52
*** rbrndt has quit IRC23:52
*** otter768 has quit IRC23:53
* jesusaurus is tempted to change the variable names in another change and rebase on top of it23:53
*** gildub has quit IRC23:53
*** ccrouch has joined #openstack-infra23:54
nibalizermtreinish: yep23:55
mtreinishsigh, I wonder what it's doing23:57
clarkbbuilding of course23:58
*** sridhar_ram has joined #openstack-infra23:58
*** Swami has joined #openstack-infra23:59
*** signed8bit is now known as signed8bit_ZZZzz23:59
mtreinishclarkb: haha23:59
mtreinishclarkb: it is supposed to be a backup/snapshot. I don't really think of building anything when I think of backing up23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!