Wednesday, 2017-11-29

mordredI think that sounds good00:00
jeblairmordred: (aside from that, i was going to say the answer may be to branch the inheritance hierarchy and re-use roles.  but this sounds better)00:00
fungimordred: in fairness, we preinstall python and python3 packages on our images, but it would be entirely legit for projects to stick those in their bindep.txt files00:00
pabelangeryah, for puppet jobs, we add puppet to bindep.txt. Then use different profile for bindep if needed (for puppet-tarball job)00:00
Zaraclarkb: o_O yeah that's weird00:00
Zarafeel free to add a note to the bottom of that story I linked above00:00
Zaraor wherever, I don't think *that* bit is a known issue00:01
mordredfungi: it would be - but I think introducing a protocol for having people tag python-version-specific bindep things is a good way todo that00:01
fungimordred: also aligning bindep profile names with tox env names always seemed like a good idea to me where possible00:01
mordredso python3-dev-all [py35 test] and pypy [pypy test] or something00:01
mordredfungi: ++00:01
fungiyup00:02
fungigranted, bindep is implemented in python... so you sort of need a python installed to get far enough for bindep to tell you there's no python ;)00:02
fungii suppose at some point we just throw up our hands and go out drinking00:03
clarkbfungi: ya thats why python is typically a weird case but I think we can be extra verbose for the pypy or even py3k case00:03
openstackgerritJulia Kreger proposed openstack-infra/shade master: de-client-ify baremetal get_machine  https://review.openstack.org/49977400:03
openstackgerritJulia Kreger proposed openstack-infra/shade master: Catch attrbute error for other APIs  https://review.openstack.org/49977500:03
openstackgerritJulia Kreger proposed openstack-infra/shade master: De-clientify baremetal create/delete  https://review.openstack.org/50011900:03
openstackgerritJulia Kreger proposed openstack-infra/shade master: De-client-ify baremetal machine port list  https://review.openstack.org/50012000:03
openstackgerritJulia Kreger proposed openstack-infra/shade master: De-client-ify machine patch operations  https://review.openstack.org/50012100:03
*** pahuang has quit IRC00:05
clarkbZara: and now to add cards based on a tag I do add card then in the query do something like tags:openstack-infra-inprogress ?00:06
clarkb(that doesn't seem to return any results fwiw)00:06
*** lbragstad has joined #openstack-infra00:06
*** mriedem has quit IRC00:06
openstackgerritMerged openstack-infra/puppet-zanata master: Preparation for Zanata 4 version upgrade  https://review.openstack.org/50679500:07
*** Guest888 has joined #openstack-infra00:08
Zarayou'd edit the lane, and add criteria 'stories matching openstack-infra-inprogress' and the tag should show up in the dropdown00:09
clarkboh I'm guessing that the "automatic" tick box is something I need to check00:10
Zarayeah :D00:10
openstackgerritMonty Taylor proposed openstack-infra/openstack-zuul-jobs master: Pass bindep profiles matching tox environments  https://review.openstack.org/52360900:10
Zarathat will give the menu for selecting criteria, it's prolly hidden by default to avoid being overwhelming00:10
Zarayeah it is00:11
*** ihrachys has quit IRC00:11
clarkbat least from my trying to figure this out I think you could just treat it as not automatic until someone adds a rule (rather than hving to enable ti then add a rule)00:11
*** yamamoto has joined #openstack-infra00:12
*** hongbin has quit IRC00:13
*** slaweq has joined #openstack-infra00:13
Zarayeah, I think part of the reasoning for the checkbox is because when it's automatic, any cards that used to be in there won't show up (until/unless the box is unchecked again) since just 'add rule' might make it look like you could add rules to an otherwise manual lane... but I'm not sure if that does make it clearer or not00:14
Zaradefo open to suggestions on it00:15
Zaraalso sorry if my messages are confused, it's late here :D00:15
*** thorst has joined #openstack-infra00:16
clarkbok https://storyboard.openstack.org/#!/board/54 lanes have minimal content now00:16
clarkbI'll be working to fill that out based on what work I know is going on and backlogged00:16
Zara(in general there's tension with boards because some of the people who use them want them to just visualise data, and some think there's value in performing the action of moving cards around)00:17
clarkboh the PTG announcement went out00:18
* clarkb gets a link00:18
*** slaweq has quit IRC00:18
clarkbhttp://lists.openstack.org/pipermail/openstack-dev/2017-November/124978.html00:18
*** pahuang has joined #openstack-infra00:18
Zara(and once you have custom lanes, you can't use a status attribute to satisfy both views)00:19
clarkbinfraians I've also gotten an email asking if we will be present at the PTG. They want to know if we will be there00:19
jeblairZara: i can't remember if we talked about this last year -- what's the likelihood we could have story tags attach to their tasks as well?  so you could have a lane that is "all tasks with tag:foo and status:todo" ?00:20
clarkbnow is probably a good time to start thinking about whether or not you will attend so that I can give them an answer00:20
fungiclarkb: i don't have any better plans00:20
clarkbfungi: oh also they want to know how many of us attended denver ptg00:20
jeblairZara: (to be clear, not adding tags to tasks, but having them "inherit" the tags from their stories)00:20
clarkbfungi: you don't happen to have that info do you?00:20
clarkb(I can guestimate it though)00:21
*** thorst has quit IRC00:21
Zarajeblair: I believe we (ie: Sotk) worked out how to do it but there's been no time, and it's a feature we'd like them to have.00:22
clarkbI think tehre were about 10 of us00:22
Zara+ if I've misremembered that he may have more details.00:22
fungiclarkb: 10 sounds good. i know it was more than 1 and fewer than 10000:22
jeblairZara: neat!  i'll try to chat with you both about it later in a more civilized time zone00:22
*** hasharAway has quit IRC00:23
Zara:) It's on the radar, I'm just way behind with everything atm00:23
pabelangerclarkb: one of the links in PTG seem to be for denver PTG (marriott.com)00:23
fungiclarkb: too many years in physics courses, i can only count in orders of magnitude00:23
clarkbpabelanger: it does indeed, I will let them know00:24
jeblairclarkb, pabelanger: they *promised* no train!00:24
fungiclarkb: we're amassing errata reports in #openstack-ptg if you want to glom on there00:24
fungijeblair: the germans have no trains, it'll be _fine_00:24
fungioh, wait, this time it's ireland00:25
pabelangerchoo choo00:25
fungii hear they have no trains either00:25
ZaraI hope I can attend; it's unusually nearby :D00:25
Zarathere are so many trains that you can easily get off at the wrong station00:25
fungiZara: right? almost squarely in your backyard, give or take some hundreds of miles00:25
Zarawhen you have a short connection00:26
clarkbpabelanger: https://www.openstack.org/ptg#tab_travel seems to have correct details00:26
jeblairZara: indeed!  i don't think they'll have closed the border by then!00:26
clarkbI think my flight route will be fly to Zara's country then fly to ptg00:26
pabelangerclarkb: +100:26
jeblairoh, right, i'm not supposed to mention that, sorry00:26
Zara;_; went to dublin this summer, on way back we took a train then a bus to the airport, arrived at the airport about 20 min before our flight was departing00:27
Zarahad to run00:27
ZaraI think the airport grew as we were running through it00:27
clarkbI am bummed that the seasonal flight from pdx to reykjavik starts a month later00:27
fungistill better than if you'd tried to take the train _all_ the way home i guess00:27
clarkbotherwise I could iceland for a few days then get a direct flight from there00:27
*** Guest888 is now known as Gaucho00:27
jeblairthe last time i went to ireland, i flew to dublin and drove to galway.  i had a blast.00:28
ZaraI've been recovering from the stress ever since and it's the main reason I didn't attempt to go to sydney :D00:28
*** Gaucho is now known as Guest3925900:28
fungiclarkb: come to my side of the continent, we have flights to ireland without needing to visit extra countries along the way00:28
Zaraso I need to go back to conquer my fear00:28
clarkblooks like the html version of the email also has the right infos00:28
*** Guest39259 is now known as Canuck00:28
fungiwell, unless you count "new jersey" that is00:29
clarkbfungi: ya problem is seattle to heathrow on BA appears to be cheapest and they partner with alaska00:30
bkeroOh wow, Aer Lingus is going to do SEA-DUB00:30
bkeroStarting in May, boo.00:30
Zaracome to manchester00:30
openstackgerritJames E. Blair proposed openstack-infra/tripleo-ci master: Zuul: add file extension to playbook path  https://review.openstack.org/52361100:30
Zarafly with ryanair00:31
fungii've probably just gotten desensitized by all the random cities we hit, but dublin seems conveniently close to where i live00:31
mtreinishclarkb: they'll partner with alaska even after the virgin merger?00:31
bkeroEthiopian does LAX-DUB too00:31
*** yamamoto has quit IRC00:31
*** bobh has joined #openstack-infra00:32
fungithis soon after sydney, anything that doesn't cross the international dateline seems like a quaint daytrip to me00:32
clarkbmtreinish: ya virgin america is/was mostly separate from its brethren. Its just a branding thing aiui00:33
clarkbmtreinish: american is the airline that is getting weird as a result of that00:33
bkeroI think Alaska's taking away the codes later this year00:33
bkeroOr next year00:33
mtreinishclarkb: the alaska american airlines partnership is ending next year because of it00:33
ZaraI'm kinda thankful I don't travel enough to know these things00:33
clarkbmtreinish: with BA?00:33
clarkbor american ya00:33
clarkbthey are still sort of partnering00:33
clarkbbut not for anything domsetic aiui00:34
mtreinishamerican and alaska. I won't get points starting next year on alaska flights00:34
*** Goneri has quit IRC00:34
clarkbmtreinish: ya I think you can get points on alaska side for american international flights00:34
clarkbbut no more domestic00:34
*** Canuck is now known as RedBeaver00:35
mtreinishooh, but it looks like I can fly norwegian air direct from SWF in Newburgh, NY (which is the closest airport to me) to dublin00:37
fungimtreinish: that's surprisingly convenient00:38
*** salv-orl_ has quit IRC00:38
*** salv-orlando has joined #openstack-infra00:38
*** RedBeaver is now known as Canuck00:39
*** jamesmcarthur has quit IRC00:39
mtreinishyeah, it's really nice. It's only like a 35-45min drive to the airport (as opposed to ~2 hrs to JFK)00:40
openstackgerritJames E. Blair proposed openstack-infra/tripleo-ci master: Zuul: add file extension to playbook path  https://review.openstack.org/52361100:40
openstackgerritJames E. Blair proposed openstack-infra/openstack-zuul-jobs master: Zuul: add file extension to playbook path  https://review.openstack.org/52362600:40
mtreinishand the airport is normally pretty empty, because it's kinda in the middle of nowhere00:40
clarkbmtreinish: last year was the alaska and delta falling out too00:40
clarkbmtreinish: but the vast majority of that appears to be competition over domestic routes00:40
*** bmjen has quit IRC00:42
*** salv-orlando has quit IRC00:43
*** Canuck is now known as Beard00:43
*** mguiney has quit IRC00:43
*** sdague has quit IRC00:44
*** bmjen has joined #openstack-infra00:44
*** mguiney has joined #openstack-infra00:44
jeblairsince the last round, it's likely some in-flight changes landed without file extensions, so i just pushed up 18 new topic:zuulv3-paths changes00:46
jeblairi'll give those a few days to merge before changing zuul itself to drop support for no extensions00:47
*** thorst has joined #openstack-infra00:49
openstackgerritMerged openstack-infra/devstack-gate master: Add fallback to -eol tag if stable branch doesn't exists  https://review.openstack.org/51224500:49
*** thorst has quit IRC00:54
clarkbfungi: still around?00:56
clarkbfungi: whats a good description for the work remaining around teh wiki server?00:56
*** Beard is now known as BlackBeaver00:57
*** thorst has joined #openstack-infra00:58
fungiclarkb: mostly puppeted on wiki-dev, still needs toubleshooting of at least the openid extension00:59
fungiproduction is not puppeted and is still residing on a temporary instance00:59
clarkbfungi: do you know if there is already a story for that?00:59
*** thorst has quit IRC00:59
clarkbwant to add it to the in progress list at https://storyboard.openstack.org/#!/board/5401:00
fungii believe it's the one for the corresponding infra spec01:00
clarkbperfect I can dig that up01:00
fungithat would be a great one for a volunteer to pick up if we get new people01:00
clarkbfungi: should I put it under help wanted instead of in progress then?01:01
fungiotherwise i'll pobably get to it eventually01:01
*** caphrim007_ has joined #openstack-infra01:01
fungiyeah, maybe. it's had progress but stalled out to backlog01:01
hoangcxfrickler: Yes. Because there is no much such jobs in vpnaas recently.01:01
clarkbdone01:02
*** caphrim007 has quit IRC01:02
*** caphrim007_ has quit IRC01:05
clarkbok https://storyboard.openstack.org/#!/board/54 is up to date with the local list I brainstormed today01:06
clarkbI am sure there are missing items. Conspicuously I left Zuulv3 off the list01:06
clarkbmostly because I don't think I can do nested boards otherwise I'd have a card for zuulv3 under in progress linked to board 5301:06
*** thorst has joined #openstack-infra01:06
clarkbbut also because zuulv3 is sort of self organizing enough taht it doesn't need higher level tracking01:07
clarkbFeel free to add things to that board if I have missed them. Will send ml message shortly with details01:07
*** BlackBeaver is now known as Canuck01:08
*** cuongnv has joined #openstack-infra01:14
*** Canuck is now known as blackbear01:17
*** yamamoto has joined #openstack-infra01:20
*** liujiong has joined #openstack-infra01:21
*** thorst has quit IRC01:21
*** blackbear is now known as gaucho01:21
*** Swami has quit IRC01:22
*** gaucho is now known as Guest8352301:22
*** Guest83523 is now known as tche01:22
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: zk: use client.retry instead of direct call  https://review.openstack.org/52364001:29
*** nicolasbock has quit IRC01:30
*** salv-orlando has joined #openstack-infra01:39
*** hongbin has joined #openstack-infra01:40
openstackgerritMatthew Treinish proposed openstack-infra/devstack-gate master: Handle a stestr results directory  https://review.openstack.org/52364601:40
*** gmann_afk is now known as gmann01:41
*** salv-orlando has quit IRC01:44
*** cuongnv has quit IRC01:45
*** dayou has joined #openstack-infra01:45
*** wangqian_ has joined #openstack-infra01:45
*** cuongnv has joined #openstack-infra01:46
*** gongysh has joined #openstack-infra01:48
ianwclarkb / eumel8 : i had a poke at translate after the puppet commit, all looks good01:51
ianwonly odd bit was01:51
ianwConfiguration file /etc/systemd/system/wildfly.service is marked executable. Please remove executable permission bits. Proceeding anyway.01:51
*** thorst has joined #openstack-infra01:51
ianwwhich is fixed but unreleased : https://github.com/biemond/biemond-wildfly/commit/ea75c07a90949f2cd600167161debc3cb9d4789301:52
*** mat128 has joined #openstack-infra01:52
*** tlaxkit has quit IRC01:56
*** thorst has quit IRC01:57
*** Guest97530 has quit IRC01:57
*** sree has joined #openstack-infra01:58
*** tche has quit IRC01:58
*** annp has joined #openstack-infra01:59
*** thorst has joined #openstack-infra02:00
*** sree has quit IRC02:02
*** hamzy has joined #openstack-infra02:03
*** thorst has quit IRC02:05
*** gongysh has quit IRC02:07
*** yamamoto has quit IRC02:07
openstackgerritMerged openstack-infra/system-config master: Revert "Reduce elasticsearch retention to 7 days"  https://review.openstack.org/52347402:07
*** shu-mutou-AWAY has quit IRC02:09
*** pahuang has quit IRC02:10
*** bmjen has quit IRC02:12
*** mguiney has quit IRC02:14
*** mguiney has joined #openstack-infra02:14
*** bmjen has joined #openstack-infra02:14
*** Apoorva_ has joined #openstack-infra02:16
*** gongysh has joined #openstack-infra02:16
*** Apoorva has quit IRC02:19
*** Apoorva_ has quit IRC02:20
*** caphrim007 has joined #openstack-infra02:22
*** pahuang has joined #openstack-infra02:22
*** caphrim007 has quit IRC02:23
*** yamamoto has joined #openstack-infra02:23
*** caphrim007 has joined #openstack-infra02:24
*** Wei_Liu has joined #openstack-infra02:25
*** daidv has joined #openstack-infra02:33
*** jamesmcarthur has joined #openstack-infra02:39
*** salv-orlando has joined #openstack-infra02:40
*** bobh has quit IRC02:42
*** dave-mccowan has quit IRC02:42
*** jamesmcarthur has quit IRC02:43
*** salv-orlando has quit IRC02:45
*** gongysh has quit IRC02:48
*** kiennt26 has joined #openstack-infra02:57
*** raissa has quit IRC02:58
*** iyamahat has quit IRC03:00
*** gongysh has joined #openstack-infra03:01
*** yamahata has quit IRC03:02
*** threestrands has joined #openstack-infra03:05
*** threestrands has quit IRC03:05
*** threestrands has joined #openstack-infra03:05
*** thorst has joined #openstack-infra03:05
*** thorst has quit IRC03:10
*** dhinesh has quit IRC03:15
openstackgerritNam Nguyen Hoai proposed openstack-infra/openstack-zuul-jobs master: Remove Designate legacy jobs  https://review.openstack.org/52366703:17
*** yamamoto has quit IRC03:18
*** aeng has joined #openstack-infra03:23
*** liujiong has quit IRC03:26
*** sree has joined #openstack-infra03:27
*** ramishra has joined #openstack-infra03:31
*** coolsvap has joined #openstack-infra03:33
openstackgerritMerged openstack-infra/devstack-gate master: Use = for string comparisons  https://review.openstack.org/50988503:34
*** thorst has joined #openstack-infra03:36
*** Apoorva has joined #openstack-infra03:37
*** thorst has quit IRC03:40
*** links has joined #openstack-infra03:42
*** gongysh has quit IRC03:42
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove Bandit legacy jobs  https://review.openstack.org/52250703:44
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove all legacy zuul jobs for openstack-helm  https://review.openstack.org/52348903:44
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove legacy-cinder-tox-* jobs  https://review.openstack.org/52165603:50
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Add python35 charm jobs template for new python3-only charms  https://review.openstack.org/52343303:54
*** jamesmcarthur has joined #openstack-infra03:54
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove unused legacy oaktree jobs  https://review.openstack.org/52324803:56
*** mixos has joined #openstack-infra03:57
*** mixos has quit IRC03:58
*** adisky_ has joined #openstack-infra04:00
wangqian_I have some questions about nodepool04:02
wangqian_I use the command ‘nodepool image-build ubuntu-xenial’ to build a image04:02
wangqian_I can see the image ubuntu-xenial is building04:02
wangqian_But when the image build is completed, it is immediately deleted, why ?04:02
clarkbwangqian_: that implies the build failed rather than succeeded04:03
clarkbwangqian_: check your nodepool image logs04:03
wangqian_but I can see the image is ready04:04
wangqian_[root@wa-v3nodepool-test nodepool_dib]# nodepool dib-image-list04:04
wangqian_+--------------------------+---------------+------------------------------+---------+-------+-------------+04:04
wangqian_| ID                       | Image         | Builder                      | Formats | State | Age         |04:04
wangqian_+--------------------------+---------------+------------------------------+---------+-------+-------------+04:04
wangqian_| ubuntu-xenial-0000000005 | ubuntu-xenial | wa-v3nodepool-test.novalocal |         | ready | 00:00:00:02 |04:04
wangqian_+--------------------------+---------------+------------------------------+---------+-------+-------------+04:04
wangqian_[root@wa-v3nodepool-test nodepool_dib]# nodepool dib-image-list04:04
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: Remove Python-cinderclient legacy jobs  https://review.openstack.org/52178704:04
wangqian_+----+-------+---------+---------+-------+-----+04:04
wangqian_| ID | Image | Builder | Formats | State | Age |04:04
wangqian_+----+-------+---------+---------+-------+-----+04:04
wangqian_+----+-------+---------+---------+-------+-----+04:04
wangqian_it just like above04:04
clarkbwangqian_: interesting, you'll still want to check the logs to see why it decided to delete the image. Possibly because it didn't actually produce any useable formats for your clouds? is the image associated with a label that is used by at least one provider?04:05
clarkbwangqian_: I know nodepool will refuse to automatically build iamges if that image isn't used by any providers. Its possible that it thinks it is cleaning up after old stale builds in your case if you don't have that associated to a provider04:08
wangqian_My provider is defined like this04:09
wangqian_providers:04:09
wangqian_  - name: sz-xingyun04:09
wangqian_    region-name: 'RegionOne'04:09
wangqian_    cloud: xingyun04:09
wangqian_    api-timeout: 6004:09
wangqian_    boot-timeout: 12004:09
wangqian_    max-servers: 004:09
wangqian_    rate: 0.00104:09
wangqian_    # Remove this when glean has support for ipv6 on centos04:09
wangqian_    ipv6-preferred: false04:09
wangqian_    image-type: raw04:09
wangqian_    template-hostname: '{image.name}-{timestamp}'04:09
wangqian_    images:04:09
wangqian_      - name: ubuntu-xenial04:09
wangqian_        min-ram: 819204:09
wangqian_        diskimage: ubuntu-xenial04:10
wangqian_        username: jenkins04:10
wangqian_        private-key: /home/nodepool/.ssh/id_rsa04:10
wangqian_        name-filter: 'Performance'04:10
wangqian_        config-drive: true04:10
wangqian_        key-name: infra-root-keys04:10
clarkbwangqian_: in the future can you use a paste service like http://paste.openstack.org it helps with readability with irc clients04:10
*** mat128 has quit IRC04:10
wangqian_ok thx04:12
clarkbwangqian_: you'll probably want to search your logs to see why that image is being deleted04:12
*** thorst has joined #openstack-infra04:12
*** stevebaker has quit IRC04:12
*** dmellado has quit IRC04:13
*** stevebaker has joined #openstack-infra04:13
*** dmellado has joined #openstack-infra04:15
*** slaweq has joined #openstack-infra04:15
*** thorst has quit IRC04:17
*** d0ugal has quit IRC04:18
*** ykarel|away has joined #openstack-infra04:18
*** slaweq has quit IRC04:19
*** ykarel_ has joined #openstack-infra04:20
wangqian_OK, I'll go back and look at the log file04:20
wangqian_Another question04:20
wangqian_Zuul initiates a job that will be stored in /nodepool/requests/ in zookeeper, but when nodepool build a image, it will check the /nodepool/image/ubuntu/request-build stored in zookeeper.04:20
wangqian_How do they relate each other?04:20
*** rlandy|rover has quit IRC04:22
clarkbwangqian_: the relationship is that the requests are made for instances booted off of the built images04:22
*** ykarel|away has quit IRC04:23
clarkbwangqian_: so zuul will say give me two nodes of label ubuntu. Then nodepool looks up its label to iamge mapping and boots two instances using the image specified by the ubuntu label04:23
*** dbecker has quit IRC04:24
*** d0ugal has joined #openstack-infra04:25
*** bobh has joined #openstack-infra04:25
*** threestrands has quit IRC04:29
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: zk: use client.retry instead of direct call  https://review.openstack.org/52364004:29
*** bobh has quit IRC04:29
*** shu-mutou has joined #openstack-infra04:29
*** markvoelker has quit IRC04:30
*** janki has joined #openstack-infra04:33
wangqian_clarkb, What I don't understand is who transforms /ndoepool/requests into /nodepool/images/ubuntu/request-build ,node pool or Zulu?04:34
*** yamamoto has joined #openstack-infra04:36
*** dbecker has joined #openstack-infra04:36
*** ykarel_ has quit IRC04:36
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Refactor provider config to driver module  https://review.openstack.org/48838404:37
*** armaan has joined #openstack-infra04:37
*** ykarel_ has joined #openstack-infra04:38
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove Python-cinderclient legacy jobs  https://review.openstack.org/52178704:40
clarkbnodepool, expect it transforms it into a boot request for successfully built images04:41
clarkbso its not a direct mapping04:41
*** threestrands has joined #openstack-infra04:41
*** threestrands has quit IRC04:41
*** threestrands has joined #openstack-infra04:41
clarkbimage is built and uploaded to cloud the zuul requests are processed as nova boot calls that use those images04:41
*** salv-orlando has joined #openstack-infra04:42
*** gouthamr has quit IRC04:43
*** pgadiya has joined #openstack-infra04:43
*** thorst has joined #openstack-infra04:44
*** pgadiya has quit IRC04:45
*** yamamoto has quit IRC04:46
*** salv-orlando has quit IRC04:46
*** kzaitsev1pi has quit IRC04:47
*** thorst has quit IRC04:49
*** rosmaita has quit IRC04:56
*** eharney has quit IRC05:00
*** kzaitsev_pi has joined #openstack-infra05:00
*** yamamoto has joined #openstack-infra05:09
*** caphrim007_ has joined #openstack-infra05:13
openstackgerritAndreas Jaeger proposed openstack-infra/system-config master: remove #openstack-shade irc channel  https://review.openstack.org/52368905:14
AJaegermordred, infra-root, any meetings now? Let's not double log the removed channel ^05:14
*** dklyle has quit IRC05:15
*** hongbin has quit IRC05:16
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: github: add integration documentation  https://review.openstack.org/52242005:17
SamYapleAJaeger: its called redudant logging05:17
*** caphrim007 has quit IRC05:17
AJaeger;)05:18
*** thorst has joined #openstack-infra05:21
* AJaeger will be on the road the whole day...05:21
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Refactor provider config to driver module  https://review.openstack.org/48838405:22
*** janki has quit IRC05:23
*** thorst has quit IRC05:26
wangqian_thx clarkb05:26
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: mqtt: add basic reporter  https://review.openstack.org/51827905:28
*** armax has quit IRC05:28
*** thorst has joined #openstack-infra05:29
*** markvoelker has joined #openstack-infra05:30
*** yamamoto has quit IRC05:31
*** armax has joined #openstack-infra05:31
*** armax has quit IRC05:31
*** threestrands has quit IRC05:32
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add Cache-Control to static files  https://review.openstack.org/52216305:32
*** thorst has quit IRC05:34
*** gongysh has joined #openstack-infra05:36
openstackgerritJeffrey Zhang proposed openstack-infra/system-config master: Add more reverse proxy  https://review.openstack.org/52369305:42
*** yamamoto has joined #openstack-infra05:43
*** jamesmcarthur has quit IRC05:45
*** gouthamr has joined #openstack-infra05:46
*** Apoorva has quit IRC05:53
*** yamamoto has quit IRC05:56
*** thorst has joined #openstack-infra05:57
*** yamamoto has joined #openstack-infra06:01
*** yamamoto has quit IRC06:01
*** thorst has quit IRC06:03
*** gouthamr has quit IRC06:04
*** gongysh has quit IRC06:04
*** cshastri has joined #openstack-infra06:06
*** yamahata has joined #openstack-infra06:09
*** alex_xu has quit IRC06:10
*** udesale has joined #openstack-infra06:10
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add Cache-Control to static files  https://review.openstack.org/52216306:11
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add /{tenant}/jobs route  https://review.openstack.org/50327006:11
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add /{tenant}/builds route  https://review.openstack.org/46656106:11
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: make console-stream tenant scoped  https://review.openstack.org/50545206:11
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add /{source}/{project}.pub route  https://review.openstack.org/50253006:11
*** alex_xu has joined #openstack-infra06:11
*** slaweq has joined #openstack-infra06:17
*** janki has joined #openstack-infra06:19
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add Cache-Control to static files  https://review.openstack.org/52216306:20
*** aeng has quit IRC06:20
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add Cache-Control to static files  https://review.openstack.org/52216306:22
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: executor: add log_stream_port and log_stream_file settings  https://review.openstack.org/52369706:23
*** gongysh has joined #openstack-infra06:23
*** salv-orlando has joined #openstack-infra06:25
*** gongysh has quit IRC06:26
*** iyamahat has joined #openstack-infra06:28
*** thorst has joined #openstack-infra06:29
*** dhajare has joined #openstack-infra06:32
*** thorst has quit IRC06:34
*** slaweq has quit IRC06:35
*** tushar has quit IRC06:35
*** tushar has joined #openstack-infra06:35
*** sree_ has joined #openstack-infra06:38
*** sree_ is now known as Guest2490406:38
*** sree has quit IRC06:42
*** sree has joined #openstack-infra06:43
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: github: add integration documentation  https://review.openstack.org/52242006:43
*** Guest24904 has quit IRC06:46
*** jtomasek has joined #openstack-infra06:47
*** esberglu has quit IRC06:54
*** yamamoto has joined #openstack-infra06:56
*** wangqian_ has quit IRC06:56
*** wangqian_ has joined #openstack-infra06:59
*** yamamoto has quit IRC07:01
*** armaan has quit IRC07:03
*** dhajare is now known as dhajare-brb07:06
*** thorst has joined #openstack-infra07:07
*** thorst has quit IRC07:11
*** kjackal has joined #openstack-infra07:15
*** sree has quit IRC07:17
*** sree has joined #openstack-infra07:18
*** armaan has joined #openstack-infra07:19
*** sree has quit IRC07:22
*** dsariel has joined #openstack-infra07:26
*** jaosorior has quit IRC07:33
*** sree has joined #openstack-infra07:34
*** jaosorior has joined #openstack-infra07:35
*** alexchadin has joined #openstack-infra07:39
*** sree has quit IRC07:39
*** sree has joined #openstack-infra07:40
*** thorst has joined #openstack-infra07:42
*** rcernin has quit IRC07:43
*** mguiney has quit IRC07:45
*** thorst has quit IRC07:46
*** mguiney has joined #openstack-infra07:47
*** ykarel_ is now known as ykarel|lunch07:49
*** florianf|afk is now known as florianf07:52
*** shardy has joined #openstack-infra07:56
*** sshnaidm|off is now known as sshnaidm07:57
*** pcaruana has joined #openstack-infra08:04
*** sshnaidm is now known as sshnaidm|afk08:11
*** ccamacho has joined #openstack-infra08:12
*** claudiub|2 has joined #openstack-infra08:14
*** hashar has joined #openstack-infra08:14
*** jpich has joined #openstack-infra08:17
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Refactor provider config to driver module  https://review.openstack.org/48838408:18
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement a static driver for Nodepool  https://review.openstack.org/46862408:18
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement an OpenContainer driver  https://review.openstack.org/46875308:18
*** thorst has joined #openstack-infra08:21
*** Hal has joined #openstack-infra08:22
*** chkumar|404 is now known as chandankumar08:22
*** rossella_s has quit IRC08:23
*** thorst has quit IRC08:26
*** kiennt26 has quit IRC08:32
*** amoralej|off is now known as amoralej08:35
*** ykarel|lunch is now known as ykarel08:35
*** wangqian_ has quit IRC08:36
*** rcernin has joined #openstack-infra08:39
*** bhavik1 has joined #openstack-infra08:44
*** e0ne has joined #openstack-infra08:44
*** jpena|off is now known as jpena08:48
*** bhavik1 has quit IRC08:48
*** ralonsoh has joined #openstack-infra08:49
*** thorst has joined #openstack-infra08:54
*** thorst has quit IRC08:59
*** alexchadin has quit IRC09:00
*** spectr has joined #openstack-infra09:03
*** jascott1 has quit IRC09:09
*** jascott1 has joined #openstack-infra09:09
*** jascott1 has quit IRC09:14
*** armaan has quit IRC09:17
*** martinkopec has joined #openstack-infra09:19
*** akscram1 has quit IRC09:19
*** sree_ has joined #openstack-infra09:22
*** sree_ is now known as Guest6518909:22
*** sree has quit IRC09:23
*** akscram1 has joined #openstack-infra09:23
*** hoangcx has quit IRC09:24
*** thorst has joined #openstack-infra09:24
*** lucas-afk is now known as lucasagomes09:25
*** dtantsur|afk is now known as dtantsur09:26
*** thorst has quit IRC09:29
*** jonher_ has joined #openstack-infra09:35
*** jonher has quit IRC09:37
*** gcb has joined #openstack-infra09:39
*** gmann is now known as gmann_afk09:39
*** yamamoto has joined #openstack-infra09:41
*** derekh has joined #openstack-infra09:43
*** armaan has joined #openstack-infra09:46
*** kiennt26 has joined #openstack-infra09:48
*** Guest65189 has quit IRC09:51
*** sree has joined #openstack-infra09:51
*** ganso has joined #openstack-infra09:51
*** iyamahat has quit IRC09:52
*** thorst has joined #openstack-infra09:55
*** slaweq has joined #openstack-infra09:55
*** alexchadin has joined #openstack-infra09:57
*** thorst has quit IRC09:59
*** slaweq has quit IRC10:00
*** sree has quit IRC10:00
*** annp has quit IRC10:02
*** stakeda has quit IRC10:03
*** cuongnv has quit IRC10:12
*** yamahata has quit IRC10:13
*** Hal has quit IRC10:16
*** caphrim007_ has quit IRC10:20
*** shu-mutou is now known as shu-mutou-AWAY10:21
*** caphrim007 has joined #openstack-infra10:22
*** caphrim007 has quit IRC10:22
*** electrofelix has joined #openstack-infra10:22
*** caphrim007 has joined #openstack-infra10:23
*** tosky has joined #openstack-infra10:24
*** caphrim007 has quit IRC10:24
*** mat128 has joined #openstack-infra10:26
*** sambetts|afk is now known as sambetts10:26
sambettsclarkb: thanks for approviing it, yes its for third party CI still stuck on jenkins+zuulv210:27
*** Hal has joined #openstack-infra10:30
*** thorst has joined #openstack-infra10:31
*** spectr has quit IRC10:33
*** thorst has quit IRC10:36
*** caphrim007 has joined #openstack-infra10:36
*** daidv has quit IRC10:39
*** ldnunes has joined #openstack-infra10:39
*** caphrim007 has joined #openstack-infra10:39
*** caphrim007 has joined #openstack-infra10:43
*** kiennt26 has quit IRC10:45
openstackgerritSam Betts proposed openstack-infra/glean master: Break systemd unit dependency cycle  https://review.openstack.org/48574810:46
*** sshnaidm|afk is now known as sshnaidm10:47
*** alexchadin has quit IRC10:50
*** hashar is now known as hasharAway10:50
*** flwang1 has joined #openstack-infra10:55
flwang1greetings, any known issue for the tox-integration job? zaqar's tox-integration always failed due to a mongodb connection error10:56
flwang1any comments/suggestion will be appreciated, thanks10:57
*** alexchadin has joined #openstack-infra10:58
openstackgerritThierry Carrez proposed openstack-infra/project-config master: Fix publication of IRC meetings ICS files  https://review.openstack.org/52384110:59
ttxinfra-core: irc-meetings ICS file publication is broken, this should fix it ^11:00
ttx(been broken since Oct 13)11:00
*** gcb has quit IRC11:05
*** yamamoto has quit IRC11:06
*** kjackal has quit IRC11:06
*** kjackal has joined #openstack-infra11:06
*** thorst has joined #openstack-infra11:08
*** caphrim007 has joined #openstack-infra11:09
*** caphrim007 has quit IRC11:09
*** pblaho has joined #openstack-infra11:10
*** slaweq has joined #openstack-infra11:10
*** yamamoto has joined #openstack-infra11:10
*** LindaWang1 has joined #openstack-infra11:12
*** thorst has quit IRC11:13
*** caphrim007 has joined #openstack-infra11:13
*** slaweq has quit IRC11:19
*** slaweq has joined #openstack-infra11:19
*** adisky_ has quit IRC11:21
*** caphrim007 has joined #openstack-infra11:23
*** erlon has joined #openstack-infra11:23
*** yamamoto has quit IRC11:24
*** slaweq has quit IRC11:24
*** sdague has joined #openstack-infra11:27
*** alexchadin has quit IRC11:30
*** thorst has joined #openstack-infra11:30
lennybmmedvede, clarkb thanks for the zuul3 notification. We are still using zuul2.11:30
*** sree has joined #openstack-infra11:31
*** thorst has quit IRC11:32
*** caphrim007 has joined #openstack-infra11:33
*** caphrim007 has quit IRC11:33
*** sree has quit IRC11:36
*** caphrim007 has joined #openstack-infra11:37
*** armaan has quit IRC11:42
*** armaan has joined #openstack-infra11:42
*** jkilpatr has quit IRC11:46
*** caphrim007 has joined #openstack-infra11:50
*** caphrim007 has joined #openstack-infra11:53
*** rhallisey has joined #openstack-infra11:53
*** caphrim007 has joined #openstack-infra11:55
*** wolverineav has joined #openstack-infra11:58
*** caphrim007 has joined #openstack-infra11:58
*** lucasagomes is now known as lucas-hungry12:00
*** thorst has joined #openstack-infra12:03
*** thorst has quit IRC12:07
*** slaweq has joined #openstack-infra12:10
*** smatzek has joined #openstack-infra12:11
*** raissa has joined #openstack-infra12:12
*** armaan has quit IRC12:16
*** armaan_ has joined #openstack-infra12:16
*** jkilpatr has joined #openstack-infra12:17
*** thorst has joined #openstack-infra12:18
*** eharney has joined #openstack-infra12:20
*** bobh has joined #openstack-infra12:20
*** caphrim007 has joined #openstack-infra12:20
*** slaweq has quit IRC12:21
*** sshnaidm is now known as sshnaidm|afk12:22
*** thorst has quit IRC12:24
*** yamamoto has joined #openstack-infra12:24
*** caphrim007 has joined #openstack-infra12:26
*** yamamoto has quit IRC12:31
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Collect /etc/kubernetes/ from CI jobs  https://review.openstack.org/52385712:32
*** armaan_ has quit IRC12:32
*** katkapilatova has joined #openstack-infra12:32
fungiinfra-root: (and anyone else who cares) heads up, i'm not really around for most of today... got appointments on the mainland so likely won't be back at a computer for any appreciable length of time until at least 21:00z12:34
*** yamamoto has joined #openstack-infra12:34
*** nicolasbock has joined #openstack-infra12:36
*** armaan has joined #openstack-infra12:38
*** caphrim007 has joined #openstack-infra12:39
*** kiennt26 has joined #openstack-infra12:39
*** slaweq has joined #openstack-infra12:39
openstackgerritMerged openstack-infra/project-config master: Fix publication of IRC meetings ICS files  https://review.openstack.org/52384112:41
*** threestrands has joined #openstack-infra12:42
*** threestrands has quit IRC12:42
*** threestrands has joined #openstack-infra12:42
fungittx: ^ hopefully someone has time to approve another schedule change and make sure that's working12:43
*** slaweq has quit IRC12:44
ttxfungi: let me see if we have good candidates in store12:46
*** dtantsur is now known as dtantsur|brb12:47
*** psachin has joined #openstack-infra12:48
ttxhmm, I'll push something12:48
*** armaan has quit IRC12:48
ttxlike removing the "traditional" TC irc meeting we don't use anymore12:49
*** armaan has joined #openstack-infra12:49
*** bobh has quit IRC12:50
*** bobh has joined #openstack-infra12:51
openstackgerritMerged openstack-infra/system-config master: remove #openstack-shade irc channel  https://review.openstack.org/52368912:51
*** rosmaita has joined #openstack-infra12:52
*** caphrim007 has joined #openstack-infra12:52
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Remove TC "weekly" meeting, promote office hours  https://review.openstack.org/52386012:52
*** sboyron has joined #openstack-infra12:54
*** thorst has joined #openstack-infra12:55
*** ansmith has quit IRC12:57
*** caphrim007 has joined #openstack-infra12:58
*** rlandy has joined #openstack-infra12:58
*** dprince has joined #openstack-infra12:58
*** caphrim007_ has joined #openstack-infra13:00
ssbarneais this the right channel to ask about a shade issue? as still breaking os_router in ansible https://storyboard.openstack.org/#!/story/200126513:01
*** threestrands has quit IRC13:01
*** yamamoto has quit IRC13:04
*** eharney has quit IRC13:07
*** yamamoto has joined #openstack-infra13:08
*** lucas-hungry is now known as lucasagomes13:08
*** yamamoto has quit IRC13:08
*** yamamoto has joined #openstack-infra13:09
*** yamamoto has quit IRC13:09
*** caphrim007 has joined #openstack-infra13:09
*** caphrim007 has quit IRC13:09
*** bobh has quit IRC13:11
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Fix log link for Zun meetings  https://review.openstack.org/52386613:12
*** jaypipes has joined #openstack-infra13:12
*** dhajare-brb has quit IRC13:12
*** yamamoto has joined #openstack-infra13:14
*** slaweq has joined #openstack-infra13:15
*** amoralej is now known as amoralej|lunch13:17
*** alexchadin has joined #openstack-infra13:18
*** yamamoto has quit IRC13:19
*** markvoelker has quit IRC13:19
*** markvoelker has joined #openstack-infra13:19
*** caphrim007 has joined #openstack-infra13:20
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Clean up inactive meetings  https://review.openstack.org/52386913:20
*** links has quit IRC13:21
*** LindaWang1 has quit IRC13:25
*** sshnaidm|afk is now known as sshnaidm13:26
Shrewsssbarnea: the correct channel for that is now #openstack-sdks13:26
*** caphrim007 has joined #openstack-infra13:27
*** caphrim007 has quit IRC13:27
*** edmondsw has joined #openstack-infra13:32
rcarrillocruzlong live #openstack-shade!13:32
* rcarrillocruz goes join new sdks13:32
Jeffrey4linfra-core please review https://review.openstack.org/52369313:32
*** udesale has quit IRC13:33
*** caphrim007 has joined #openstack-infra13:35
*** haleyb has quit IRC13:35
*** caphrim007 has quit IRC13:35
*** sree has joined #openstack-infra13:36
*** dave-mccowan has joined #openstack-infra13:37
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Move meeting channel to free up weekly slot  https://review.openstack.org/52387113:37
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings master: Move Watcher meeting chan to free up weekly slot  https://review.openstack.org/52387213:37
openstackgerritDavid Shrewsbury proposed openstack-infra/shade master: WIP: os_router idempotency check  https://review.openstack.org/52387313:38
*** zhurong has joined #openstack-infra13:39
*** caphrim007 has joined #openstack-infra13:39
*** haleyb has joined #openstack-infra13:39
*** sree has quit IRC13:40
*** openstackstatus has quit IRC13:43
*** openstack has joined #openstack-infra13:44
*** ChanServ sets mode: +o openstack13:44
*** caphrim007 has joined #openstack-infra13:47
*** caphrim007 has quit IRC13:47
*** trown|outtypewww is now known as trown13:48
ttxbeh13:50
*** sboyron has quit IRC13:50
*** caphrim007 has joined #openstack-infra13:51
*** caphrim007 has quit IRC13:51
*** mriedem has joined #openstack-infra13:51
*** sboyron has joined #openstack-infra13:53
*** eharney has joined #openstack-infra13:54
*** zhurong has quit IRC13:56
*** ansmith has joined #openstack-infra13:56
*** zhurong has joined #openstack-infra13:58
*** caphrim007 has joined #openstack-infra13:59
*** udesale has joined #openstack-infra14:01
*** Goneri has joined #openstack-infra14:03
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Add documentation build and publish jobs for python-tripleoclient  https://review.openstack.org/52352314:04
dmsimardby the way, a low hanging fruit to fix gerrit change-id links in git.o.o needs a last +2: https://review.openstack.org/#/c/518092/14:05
*** pblaho has quit IRC14:07
*** pblaho has joined #openstack-infra14:07
*** caphrim007 has joined #openstack-infra14:08
*** kgiusti has joined #openstack-infra14:09
*** caphrim007 has joined #openstack-infra14:12
*** shardy has quit IRC14:14
*** yamamoto has joined #openstack-infra14:14
*** yamamoto has quit IRC14:15
*** yamamoto has joined #openstack-infra14:15
*** yamamoto has quit IRC14:15
*** slaweq has quit IRC14:17
fricklerinfra-root: with thierry's fix above merged, someone should clean up http://eavesdrop.openstack.org/calendars/calendars/14:17
*** ihrachys has joined #openstack-infra14:18
*** amoralej|lunch is now known as amoralej14:18
*** mat128 has quit IRC14:19
*** dsariel has quit IRC14:20
*** LindaWang1 has joined #openstack-infra14:20
openstackgerritGraham Hayes proposed openstack-infra/project-config master: Remove legacy designateclient jobs  https://review.openstack.org/52388214:21
fricklermugsie: we should add the new jobs before removing the legacy ones, I'll put up patches for that later today14:24
mugsiefrickler: there is a patch to the client just gone up as well14:24
*** dtantsur|brb is now known as dtantsur14:24
openstackgerritGraham Hayes proposed openstack-infra/openstack-zuul-jobs master: Remove legacy Designate jobs content  https://review.openstack.org/52350214:25
fricklermugsie: ah, good, designate-dashboard is still missing one, can you do that, too?14:25
mugsieyeah, its next on the list. I need to port the npm-* jobs as well14:26
*** rcernin has quit IRC14:27
*** psachin has quit IRC14:28
*** caphrim007 has joined #openstack-infra14:29
*** smatzek has quit IRC14:29
*** smatzek has joined #openstack-infra14:30
*** esberglu has joined #openstack-infra14:31
*** smatzek has quit IRC14:34
*** yamamoto has joined #openstack-infra14:36
tinwoodAJaeger, thanks for your help with the project-config changes, etc.  If you have a quick moment, would it please be possible for you to look at: https://review.openstack.org/#/c/523098/ for me.  It's our test project to check that the voting works for py3.14:37
*** cshastri has quit IRC14:37
*** sboyron has quit IRC14:38
*** andreas_s has joined #openstack-infra14:39
*** hongbin has joined #openstack-infra14:40
*** yamamoto has quit IRC14:41
smcginnisGerrit needs some coffee.14:41
*** zhurong has quit IRC14:46
*** sboyron has joined #openstack-infra14:46
*** openstack has quit IRC14:46
*** openstack has joined #openstack-infra14:48
*** ChanServ sets mode: +o openstack14:48
*** armax has joined #openstack-infra14:48
*** armaan has quit IRC14:50
*** ramishra has quit IRC14:50
*** andreas_s has quit IRC14:51
*** andreas_s has joined #openstack-infra14:52
*** alexchadin has quit IRC14:52
*** jamesmcarthur has joined #openstack-infra14:53
*** Wei_Liu has joined #openstack-infra14:53
Wei_Liuhello, all14:54
*** andreas__ has joined #openstack-infra14:54
*** caphrim007 has joined #openstack-infra14:55
*** caphrim007 has quit IRC14:55
*** andrea___ has joined #openstack-infra14:56
*** andreas_s has quit IRC14:56
*** d0ugal has quit IRC14:56
*** ramishra has joined #openstack-infra14:57
*** caphrim007 has joined #openstack-infra14:58
Wei_LiuI got a error when I try to start zuul executor locally,  "git.exc.GitCommandError: Cmd('git') failed due to: exit code(-13)", the gerrit server is also local private gerrit, and scheduler could work with the same gerrit configuration in zuul.conf. But executor failed. Any idea?14:59
*** andreas__ has quit IRC14:59
*** andreas_s has joined #openstack-infra14:59
*** andrea___ has quit IRC15:01
*** armaan has joined #openstack-infra15:01
*** mat128 has joined #openstack-infra15:01
*** salv-orl_ has joined #openstack-infra15:02
*** caphrim007 has joined #openstack-infra15:02
*** salv-orlando has quit IRC15:03
*** andreas_s has quit IRC15:04
*** d0ugal has joined #openstack-infra15:04
ansmithfungi, pabelanger: hello, thanks again for bindep_profile fix15:05
*** marst has joined #openstack-infra15:06
*** yamamoto has joined #openstack-infra15:06
ansmithfungi, pabelanger: i had a question, is there a way to access bindep_profile variable from bash script? e.g. test-setup.sh?15:06
*** andreas_s has joined #openstack-infra15:06
*** adarazs|ruck is now known as adarazs15:06
*** caphrim007 has joined #openstack-infra15:06
*** rlandy is now known as rlandy|ruck15:06
*** coolsvap has quit IRC15:07
*** yamamoto has quit IRC15:07
*** yamamoto has joined #openstack-infra15:08
*** yamamoto has quit IRC15:08
*** janki has quit IRC15:10
*** janki has joined #openstack-infra15:10
*** caphrim007 has joined #openstack-infra15:10
*** andreas_s has quit IRC15:11
*** cliffparsons has joined #openstack-infra15:12
*** jascott1 has joined #openstack-infra15:12
*** smatzek has joined #openstack-infra15:12
*** psachin has joined #openstack-infra15:13
pabelangeransmith: fungi: You'd have to pass it into the bash script, from you ansible playbook15:13
*** bobh has joined #openstack-infra15:14
ansmithpabelanger: if parent is openstack-tox-py*, will unittest call the test-setup.sh? Can I effect what it passes in?15:15
*** sshnaidm is now known as sshnaidm|rover15:16
ansmithpabelanger: affect15:16
*** jascott1 has quit IRC15:16
*** d0ugal_ has joined #openstack-infra15:17
*** mat128 has quit IRC15:17
*** yamahata has joined #openstack-infra15:18
*** iyamahat has joined #openstack-infra15:18
*** sboyron has quit IRC15:19
*** d0ugal has quit IRC15:20
*** mat128 has joined #openstack-infra15:20
mordredansmith: you can set a bindep_profile variable on the job ... see: https://review.openstack.org/#/c/523609/15:20
Wei_Liuansmith: I got a error when I try to start zuul executor locally,  "git.exc.GitCommandError: Cmd('git') failed due to: exit code(-13)", the gerrit server is also local private gerrit, and scheduler could work with the same gerrit configuration in zuul.conf. But executor failed. Any idea?15:20
pabelangeransmith: no, I don't think that would work.  Do you mind explaining more the issue you are trying to solve?15:20
mordredpabelanger: speaking of - feel like +Aing https://review.openstack.org/#/c/523609/ ?15:21
ansmithpabelanger: in oslo.messaging, we have a number of drivers, the bindep_profile helps us select the correct dependencies15:21
pabelangermordred: +315:22
ansmithpabelanger: one of the drivers has some extra setup in test-setup.sh, we would like to restrict what the script does based on bindep_profile value15:22
*** gouthamr has joined #openstack-infra15:22
pabelangeransmith: what if you just created a new jobs but set bindep_profile in zuul.yaml directly?15:23
*** mat128 has quit IRC15:24
*** dsariel has joined #openstack-infra15:24
*** mat128 has joined #openstack-infra15:25
pabelangerWei_Liu: can you post the log from your executor?15:25
ansmithpabelanger: that is what we are doing and it works great when unittest selects dependencies from bindep.tx15:25
ansmithpabelanger: it is when it then executes test-setup.sh that it would help to access bindep_profile from withint the script15:25
*** sboyron has joined #openstack-infra15:26
ansmithpabelanger: if I understand the sequence correctly15:26
pabelangeransmith: do you have a log of your failure? it would be helpful to see what you have done up until now15:27
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Pass bindep profiles matching tox environments  https://review.openstack.org/52360915:27
pabelangeransmith: likey I said, the way to do it would be pass bindep_profile into test.sh, but that is going to require some changes to our jobs.  I might be better just to create a new parent job for this use case15:27
Wei_Liupabelanger: should I post log here in the channel?15:27
*** rbrndt has joined #openstack-infra15:28
*** tlbr has joined #openstack-infra15:28
ansmithpabelanger: thanks, let me re-submit as I changed a few things15:28
*** camunoz has joined #openstack-infra15:29
pabelangerWei_Liu: please use paste.openstack.org15:29
pabelangerinfra-root: I'd like to proceed with https://review.openstack.org/513506/ today, the removal of zuul-cloner from our base jobs.  We have 2 -2's, but believe everything is in place based on our meeting last week. Will be here all day to support the removal15:30
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: Create ovb-ha-ipv6 and deprecate fs024 job  https://review.openstack.org/52390315:31
pabelangerconfig-core:^ too15:31
dmsimardpabelanger: got your ping about it yesterday, I'll take a look after meeting15:31
mordredpabelanger: oh - wait - I don't think we can do thatyet15:33
mordredpabelanger: it'll break pretty much every tox job in the system15:34
*** d0ugal has joined #openstack-infra15:34
*** d0ugal has quit IRC15:34
*** d0ugal has joined #openstack-infra15:34
pabelangermordred: Oh? tox jobs are using zuul-cloner?15:34
mordredpabelanger: I'm sorry - I didn't put two different thought trains together when we were discussing this the other day15:34
Wei_Liupabelanger: executor log: http://paste.openstack.org/show/627729/15:34
mordredpabelanger: tox_install.sh in each repo currently does15:35
mordredwe need to finish unwinding the use of tox_install.sh before we can kill zuul-cloner15:35
pabelangermordred: Oh, wow. I didn't know that15:35
pabelangerokay, let me look15:35
pabelangerWei_Liu: what are your permissions on /var/lib/zuul/executor-git ?15:36
mordredthat's going to involve getting neutron and horizon published to pypi - then making sure that tox_install_siblings is working for the projects that need it ... then we need to update tox.ini files to add -c$CONSTRAINTS_FILE to their requiremnts list instead of passing thevar to tox_install.sh15:36
pabelangerWei_Liu: and are you able to SSH to ssh://zuul@192.168.210.28:29418 on your executor?15:36
*** d0ugal_ has quit IRC15:37
mordredpabelanger: I think we should probably write up an etherpad or a storyboard story or something15:37
pabelangermordred: Wow... I that is a long chain.15:37
*** psachin has quit IRC15:37
Wei_Liupabelanger: drwxr-xr-x 3 root root 28 Nov 29 19:43 executor-git15:37
pabelangermordred: what if we created a legacy-tox parent job, and reparented those for now?15:38
mordredpabelanger: this is partially what I have been poking at with the build-sphinx patches - but it's a deep problem. tonyb and I discussed it a bit in denver15:38
mordredpabelanger: it's literally every tox job for every openstack project15:38
pabelangerWei_Liu: what user did you setup to drop privledges? I am guessing 'zuul'?15:38
Wei_Liupabelanger: yes, ssh worked on my executor,15:39
pabelangermordred: okay, then yah, we'll need to figure that ot15:39
mordredpabelanger: so, while we could, I think we'll be better served by contiuing to pull the threads to unravel the current use15:39
pabelangerWei_Liu: I'm guessing git is failing to clone into /var/lib/zuul, because of root:root on directory. You'll have to chmod it to the user that is invoking zuul-executor15:40
Wei_Liupabelanger: no, the user is root, if I setup to zuul, I got a permission error to launch executor15:40
mordredpabelanger: I have an example patch from tonyb in shade: https://review.openstack.org/#/c/508061/15:40
mordredpabelanger: this is what we eventually need to get done across the board ... but first we need to get neutron and horizon pulished to pypi15:41
pabelangerWei_Liu: https://docs.openstack.org/infra/zuul/feature/zuulv3/admin/components.html?highlight=zuul%20conf#attr-executor.user15:41
pabelangerWei_Liu: what is your setting in zuul.conf?15:41
mordredinfra-root: heads up - shade released today - I don't expect any nodepool issues, but heads up anyway15:41
pabelangermordred: okay, I'll review shortly15:41
*** dsariel has quit IRC15:42
Wei_Liupabelanger: user: root15:42
pabelangerWei_Liu: if you are using tcp/79 for fingur port, then you need to start zuul-executor as root, but it then drops permissions to zuul user by default15:42
*** dsariel has joined #openstack-infra15:42
pabelangerWei_Liu: I'd set that back to zuul, and not run the executor as root TBH. You'll then need to setup properly file permissions and start executor again15:43
pabelangerI think exit code -13 is permission denied15:44
*** armaan has quit IRC15:45
*** armaan has joined #openstack-infra15:45
Wei_Liupabelanger: if not run executor as root, I need to change fingur port too?15:46
*** Sukhdev has joined #openstack-infra15:47
jeblairWei_Liu: start the executor as root, but set "user: zuul" in the config file, and it will drop root privileges to become the zuul user.15:48
openstackgerritMonty Taylor proposed openstack-infra/shade master: Avoid tox_install.sh for constraints support  https://review.openstack.org/50806115:48
pabelangerWei_Liu: yah, you have 2 options. still start executor as root, and set executor.user back to zuul, this will cause zuul to drop permissions back to zuul user after we bind to port 79. other option is to change figur port to something greater then 1024 and start as zuul user15:48
openstackgerritMonty Taylor proposed openstack-infra/shade master: Fix basepython setting in tox.ini  https://review.openstack.org/52391515:48
*** Apoorva has joined #openstack-infra15:48
*** rfolco is now known as rfolco_biab15:49
Wei_Liupabelanger: thanks, I will try it. also for scheduler and merger, should I start them as root or zuul user?15:49
*** janki has quit IRC15:50
pabelangerWei_Liu: you are safe to start them as zuul user, they do not need root permissions15:50
Wei_Liupabelanger: Thank you very much.15:51
pabelangerWei_Liu: np!15:51
*** LindaWang1 has quit IRC15:56
mordredpabelanger: https://etherpad.openstack.org/p/zuulv3-remove-zuul-cloner15:57
mordredpabelanger: I made an etherpad with the information15:57
mordredpabelanger: crap - I accidentally closed the zuul migration issues etherpad - have the link handy?15:58
*** e0ne has quit IRC15:59
Jeffrey4lhi, please review https://review.openstack.org/52369315:59
*** edmondsw_ has joined #openstack-infra16:00
Shrewsmordred: https://etherpad.openstack.org/p/zuulv3-issues ??16:00
pabelangermordred: jeblair: dmsimard: what would be stopping us today from re-organizing our base job a little to do the following: project-config: base job (trusted, add-build-sshkey), ozj: base-child (untrusted, eg: configure-mirror), reparent jobs to base-child. All in the effort to make it easy to test changes to our base roles.  I can't really see of a reason that something like configure-mirror or16:01
pabelangerconfigure-unbound really needs to be trusted, aside from the fact that is where our base job is today16:01
*** iyamahat has quit IRC16:01
mordredShrews: thanks16:02
*** psachin has joined #openstack-infra16:03
mordredpabelanger: well - the job in ozj would need to be called base and the one in project-config would need to be called base-base or something16:03
mordredpabelanger: because a job named 'base' is an interface that the jobs in zuul-jobs expect16:03
*** edmondsw has quit IRC16:03
*** edmondsw_ is now known as edmondsw16:03
mordredpabelanger: past that - I *think* some things might get tricky related to shadowing and whatnot16:04
pabelangermordred: right, so if base was added to ozj, and base-minimal was project-config, could base parent to base-minimal? I'm not sure if zuul expects base to always be top16:04
pabelangermordred: yah, that is what I am thinking too16:05
*** iyamahat has joined #openstack-infra16:05
mordredpabelanger: I think just fleshing out the integration tests for the base job is likely the better path16:07
*** jascott1 has joined #openstack-infra16:08
*** psachin has quit IRC16:08
mordredpabelanger, jeblair: ok - I have put a link to the remove-zuul-cloner etherpad on the zuul-cloner entry in the zuulv3-issues etherpad, as well as on the change removing it16:08
*** yamamoto has joined #openstack-infra16:08
mordredI apologize again for not thinking about this issue when we discussed it at the meeting16:08
*** coolsvap has joined #openstack-infra16:09
*** psachin has joined #openstack-infra16:09
jkilpatrwhere would I go to find zull job definitions? I can't find them in project config anymore16:10
pabelangermordred: sure, we should totally do that too. But the more I was thinking about it, it seems like a lot of our roles really don't need to be trusted in bsse, it is just a result of having base in project-config.16:11
Jeffrey4lmordred, could you review this patch ? https://review.openstack.org/523693 thanks.16:12
mordredjkilpatr: https://docs.openstack.org/infra/manual/zuulv3.html#where-jobs-are-defined-in-zuul-v316:12
jkilpatrmordred, thanks!16:12
mordredpabelanger: yes - I agree with you on that - I'm just not sure about logistical concerns with the proposed re-org (although I like it in theory)16:12
pabelangermordred: agree, it would take some effort and time to split. Not something to push today :)16:13
*** armaan has quit IRC16:13
*** mat128 has quit IRC16:14
mordredJeffrey4l: https://nexus.oraclelinux.org/repo/OracleLinux/ <-- that doesn't seem to actually be resolvable - also ... is everything in the oraclelinux repo open source?16:14
*** armaan has joined #openstack-infra16:14
Jeffrey4lhrm ,sorry, this is a typo. the correct url should be http://yum.oracle.com/repo/OracleLinux/OL7/latest16:16
Jeffrey4lfixing it.16:16
Jeffrey4land oraclelinux repo is open.16:16
mordredJeffrey4l: cool16:17
*** yamamoto has quit IRC16:17
openstackgerritJeffrey Zhang proposed openstack-infra/system-config master: Add more reverse proxy  https://review.openstack.org/52369316:18
*** rfolco_biab is now known as rfolco16:20
openstackgerritAkihiro Motoki proposed openstack-infra/project-config master: Stop translation job for django-openstack-auth master branch  https://review.openstack.org/52392416:24
*** ykarel has quit IRC16:25
*** sboyron has quit IRC16:25
*** dsariel has quit IRC16:26
*** dsariel has joined #openstack-infra16:28
openstackgerritSam Betts proposed openstack-infra/devstack-gate master: Fix setup_project checking out eol with branch name  https://review.openstack.org/52392516:30
*** psachin has quit IRC16:31
*** kiennt26 has quit IRC16:31
*** Wei_Liu has quit IRC16:32
jeblairdmsimard, andreykurilin: we may need bigger warning message on the 'base-integration' job saying do not use.  see the confusion in this patch: https://review.openstack.org/52361316:33
jeblairdmsimard, andreykurilin: though, once we have the features, setting 'protected' and 'abstract' on those jobs could help16:34
mordredjeblair: we could rename base-integration to 'infra-internal-do-not-use'16:35
*** ramishra has quit IRC16:35
jeblairmordred: ;)16:35
andreykurilinyes, this may help)16:36
andreykurilinlol16:36
jeblairat least, we really probably should call it something other than base-* since all the other base- jobs are actually base jobs.  this one isn't.16:36
openstackgerritAkihiro Motoki proposed openstack-infra/project-config master: Stop translation job for django-openstack-auth master branch  https://review.openstack.org/52392416:37
mordredjeblair: yah. although I also think protected and abstract will be nice for it too16:38
mordredjeblair: but "base-integration" sounds like an inviting base job to use for doing integratoin tests16:38
*** psachin has joined #openstack-infra16:38
jeblairyeah, and that looks like what happened here16:39
jeblairespecially the convenient-looking node variants16:39
mordredyup16:39
dmsimardjeblair: I'm not up to date, what are "protected" and "abstract" going to do ?16:40
mordredjeblair: those two jobs are the only things using base-integration (outside of the infra repos)16:40
mordreddmsimard: abstract means "this is not runnable as a job in a pipeline, it's only meant to bea base job"16:40
mordreddmsimard: protected means "this can only be used by other jobs in the same repo"16:40
*** martinkopec has quit IRC16:40
dmsimardmakes sense16:41
jeblairso base-integration would be abstract; base-integration-centos-7 would be protected16:41
jeblairmaybe16:41
jeblairdepends on exactly what we do with protected :)16:41
mordredyah16:41
jeblair(whether it's inheritance only, or inheritance + running)16:41
openstackgerritMonty Taylor proposed openstack-infra/shade master: Fix basepython setting in tox.ini  https://review.openstack.org/52391516:41
dmsimardI really really want to have time to work on the integration test prototype I've been meaning to do16:41
dmsimardI want roles to be able to test themselves fairly easily and automatically16:42
dmsimardThe approach we currently have doesn't scale16:42
dmsimardproof, there's like 6 roles tested out of 100 ?16:42
*** psachin has quit IRC16:45
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix branch checkout order  https://review.openstack.org/52392916:46
jeblairdmsimard: the only roles we're testing are the ones that aren't self-testing.16:46
jeblairdmsimard: if you want to add explicit testing to other roles, that's a fine thing worth discussing.  however, i would at least like us to acknowledge that it's two different problems.16:47
jeblairmy own thoughts are that the importance of role tests are proportional to the difficulty in self-testing them.  so the base roles are highest.  complex roles (like git repo sync and tox-siblings) are next because they are difficult to test in all the possible configuration they may be used.  simpler roles (eg, just tox itself) may be most easily tested directly (or with a depends-on) and may not be worth the effort of explicit tests.16:49
dmsimardjeblair: what do you mean self-testing ?16:49
*** eharney has quit IRC16:50
jeblairdmsimard: i mean that when you propose a change to most of the roles used by zuul, zuul uses that change when running the tests on that change (and in changes that depend on it)16:50
dmsimardjeblair: right, but that doesn't mean the role is used in the jobs that happen to run16:51
jeblairdmsimard: that's where depends-on comes in16:51
dmsimardjeblair: then it's not self-tested :D16:51
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: DONT MERGE: Create ovb-ha-ipv6 and deprecate fs024 job  https://review.openstack.org/52390316:51
jeblairdmsimard: it's also why we run the zuul unit tests on zuul-jobs.  we can add more jobs like that as necessary.16:52
jeblairdmsimard: anyway, for now are you planning on adding the warning to docs and renaming base-integration, or should i?16:53
dmsimardI can take it, what would be an appropriate name ?16:53
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Combine branch templates and pipeline branch matchers  https://review.openstack.org/52354416:54
dmsimardopenstack-infra-integration-base ? or something16:54
*** eharney has joined #openstack-infra16:54
jeblairdmsimard: or maybe openstack-infra-base-role-integration ?16:54
dmsimardI guess to be consistent we also need to rename the multinode one16:55
dmsimardjeblair: sure, I'm not picky16:55
tinwoodhi, is there anyone who can review/land https://review.openstack.org/#/c/523098/  -- we have a charm release coming up and it would be good to test that this is a proper gate for out py3 only charms.  Thanks!16:55
*** katkapilatova has left #openstack-infra16:58
*** dprince has quit IRC16:59
*** rwellum has joined #openstack-infra16:59
Jeffrey4lmordred, please review https://review.openstack.org/523693 fixed the oracle linux url. and other infra-cores please.16:59
*** udesale has quit IRC17:00
mordredJeffrey4l: +217:00
Jeffrey4lthanks.17:00
*** weshay is now known as weshay_mtg17:00
rwellumHi. I want to add a new storyboard project. The current documentation, https://docs.openstack.org/infra/system-config/storyboard.html, describes a file to update - but I don't see which file and which repo to clone etc. The docs say to ask on this IRC so...17:01
clarkb morning17:01
clarkbrwellum: :config:`gerrit/projects.yaml`: is supposed to result in a link to the file. Looks like something is broken in the docs builds. Let me get you a link17:02
*** vhosakot has joined #openstack-infra17:02
clarkbrwellum: https://git.openstack.org/cgit/openstack-infra/project-config/tree/gerrit/projects.yaml is the file in question17:02
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job  https://review.openstack.org/52261817:02
clarkbrwellum: the repository to clone is https://git.openstack.org/openstack-infra/project-config17:03
*** lucasagomes is now known as lucas-afk17:06
clarkbJeffrey4l: you'll want to test those about an hour after the change merges. You can do so locally without jobs as well17:06
*** Sukhdev has quit IRC17:06
Jeffrey4lclarkb, roger, thank.17:06
*** sree has joined #openstack-infra17:07
rwellumclarkb: ty.17:07
clarkbrwellum: now to figure out why that link wasn't autogenerated in the docs as expected17:08
rwellumI just thought I was being dense...17:08
*** dsariel has quit IRC17:09
*** sshnaidm|rover is now known as sshnaidm|rover|m17:10
*** sshnaidm|rover|m is now known as sshnaidm|rover17:10
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Normalize daemon process handling  https://review.openstack.org/51738117:10
*** sree has quit IRC17:12
clarkbrwellum: I think I've got it, patch shortly17:14
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job  https://review.openstack.org/52261817:15
rwellumThanks clarkb17:16
openstackgerritClark Boylan proposed openstack-infra/system-config master: Fix config links in storyboard admin docs  https://review.openstack.org/52393717:17
clarkbrwellum: ^ that should do it. sorry for the confusion but hopefully thats better to read17:17
*** leifmadsen has left #openstack-infra17:19
openstackgerritMerged openstack-infra/puppet-log_processor master: Collapse logically identical filenames for crm114  https://review.openstack.org/52239917:20
openstackgerritRich Wellum proposed openstack-infra/project-config master: Allow the use of Storyboard for Kolla-Kubernetes  https://review.openstack.org/52393917:21
*** efried is now known as efried_rollin17:22
clarkbsshnaidm|rover: pabelanger EmilienM et al I've removed the WIP from https://review.openstack.org/#/c/520171/1 I think we are good to start adding in new files to elasticsearch/logstash and keep an eye on it17:25
*** Apoorva has quit IRC17:25
EmilienMclarkb: good to know things are back to a normal state - thanks17:26
*** florianf is now known as florianf|afk17:26
*** priteau has joined #openstack-infra17:27
openstackgerritMerged openstack-infra/system-config master: Add more reverse proxy  https://review.openstack.org/52369317:29
openstackgerritMerged openstack-infra/system-config master: Remove an extra # from irc renaming instructions  https://review.openstack.org/52356417:29
*** jpich has quit IRC17:29
*** jamesmca_ has joined #openstack-infra17:31
EmilienMI'm not sure if it's just me but I got a bunch of 502 on gerrit this morning17:31
*** jamesmcarthur has quit IRC17:34
clarkbEmilienM: there is a non zero amount of garbage collection happening17:34
clarkbit has picked up since about 0600UTC today17:35
clarkbif it persists we may need to consider a gerrit restart17:35
EmilienMok17:35
*** ralonsoh has quit IRC17:36
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Use username from node information if available  https://review.openstack.org/45398317:38
mordredssbarnea: shade 1.25 released - your routers issue should work better now17:39
openstackgerritMerged openstack-infra/zuul feature/zuulv3: web: add Cache-Control to static files  https://review.openstack.org/52216317:41
*** e0ne has joined #openstack-infra17:44
*** sree has joined #openstack-infra17:44
pabelangerclarkb: did you want to review: https://review.openstack.org/523178 unbound changes that dmsimard put together.17:46
clarkbpabelanger: sure. Also I epxect at least some of the images have the debug level unbound logging configured on them at this point17:47
clarkbpabelanger: dmsimard we should confirm then go hunting for failures with logs probably17:47
*** sree has quit IRC17:48
*** sambetts is now known as sambetts|afk17:48
*** derekh has quit IRC17:51
fricklermordred: ssbarnea: shade 1.25 works fine for my routers at least, thx17:51
clarkbpabelanger: dmsimard approved17:51
*** jamesmca_ has quit IRC17:53
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Don't run functional test jobs for requirements changes  https://review.openstack.org/52394717:53
dmsimardclarkb: the change is self tested by the integration jobs17:54
dmsimardclarkb: I'd be surprised if things start breaking horribly left and right because it didn't in the jobs17:54
*** sree has joined #openstack-infra17:55
clarkbdmsimard: ya I don't expect it to. re hunting for failures I mean look for jobs where dns lookups failed and then look at the unbound logs17:55
clarkbdmsimard: since the unbound logs should start having debug info in them17:55
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: General improvements to configure-unbound role  https://review.openstack.org/52322817:56
*** cshastri has joined #openstack-infra17:57
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Re-enable test_zuul_trigger_project_change_merged  https://review.openstack.org/51326717:57
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Remove unused function toList from scheduler  https://review.openstack.org/51326817:57
openstackgerritKen Giusti proposed openstack-infra/devstack-gate master: Save logs from alternative oslo.messaging backend servers  https://review.openstack.org/52394817:58
dmsimardclarkb: has the nodepool image change merged ?17:58
dmsimardAh yeah it has17:59
*** sree has quit IRC17:59
*** salv-orl_ has quit IRC17:59
*** salv-orlando has joined #openstack-infra17:59
*** salv-orlando has quit IRC17:59
*** thorst has quit IRC18:00
*** jascott1 has quit IRC18:02
*** ansmith has quit IRC18:02
tinwoodthanks clarkb for the +218:02
*** jascott1 has joined #openstack-infra18:02
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Add support for configuring TTLs in configure-unbound  https://review.openstack.org/52317818:02
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Normalize daemon process handling  https://review.openstack.org/51738118:03
*** salv-orlando has joined #openstack-infra18:03
openstackgerritClark Boylan proposed openstack-infra/puppet-zuul master: Ensure ara is updated on executors  https://review.openstack.org/51674018:04
clarkbtinwood: no problem18:04
clarkbtinwood: pabelanger or dmsimard may be able to quickly be your second reviewer18:05
clarkbdmsimard: ya yesterday so new images should be showing up soon (or already be there)18:05
*** iyamahat has quit IRC18:05
tinwoodclarkb, ah, thanks.  good to know.18:05
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Honor constraints files in tox-siblings  https://review.openstack.org/52394918:06
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Combine tox-siblings and tox roles  https://review.openstack.org/52395018:06
*** cshastri has quit IRC18:06
*** jascott1 has quit IRC18:06
*** thorst has joined #openstack-infra18:06
openstackgerritMonty Taylor proposed openstack-infra/shade master: Fix basepython setting in tox.ini  https://review.openstack.org/52391518:07
openstackgerritMonty Taylor proposed openstack-infra/shade master: Avoid tox_install.sh for constraints support  https://review.openstack.org/50806118:07
sshnaidm|roverclarkb, thanks a lot18:07
sshnaidm|roverpabelanger, can you please vote? https://review.openstack.org/#/c/52017118:07
*** Apoorva has joined #openstack-infra18:07
*** Apoorva has quit IRC18:08
mordredpabelanger: ^^ in looking at the logs of the shade patch that's the guniea pig for the tox_install.sh removal, I noticed that constraints are being skipped in siblings ... the two zuul-jobs patches above fix that and https://review.openstack.org/508061 now depends-on them so we can verify it works18:08
*** Apoorva has joined #openstack-infra18:08
mordredproject-config-core: ^^18:08
*** yamahata has quit IRC18:09
*** dtantsur is now known as dtantsur|afk18:10
mordredinfra-root, project-config-core: this is in service of https://etherpad.openstack.org/p/zuulv3-remove-zuul-cloner - in case context is missing18:10
*** thorst has quit IRC18:11
pabelangermordred: looking18:11
pabelangersshnaidm|rover: +318:12
sshnaidm|rover\o/18:12
*** sboyron has joined #openstack-infra18:13
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Refactoring/Update of logic for SummitEvent Update  https://review.openstack.org/52352618:14
openstackgerritMikhail S Medvedev proposed openstack-infra/puppet-openstackci master: Change zuul and nodepool revision defaults  https://review.openstack.org/52395118:15
openstackgerritMerged openstack-infra/project-config master: Add errors file to be indexed by logstash  https://review.openstack.org/52017118:16
*** jpena is now known as jpena|away18:17
ssbarneafrickler: thanks! really helped the shade release.18:18
*** thorst has joined #openstack-infra18:18
*** coolsvap has quit IRC18:18
openstackgerritMerged openstack-infra/openstackid-resources master: Refactoring/Update of logic for SummitEvent Update  https://review.openstack.org/52352618:19
*** dprince has joined #openstack-infra18:19
openstackgerritClark Boylan proposed openstack-infra/system-config master: Revert "Disable crm114 on the logstash worker nodes"  https://review.openstack.org/52395518:21
clarkbpabelanger: tristanC jeblair ^ turning crm114 back on again18:22
*** thorst has quit IRC18:22
*** ccamacho has left #openstack-infra18:23
*** tosky has quit IRC18:24
mordredssbarnea: \o/18:24
mordredinfra-root: we just hit a MITM key change error ona shade patch:18:25
mordredhttp://logs.openstack.org/93/523893/1/gate/openstack-tox-py27/8ddfac1/ara/result/38e984ce-db99-4dac-8399-5e4002a0025b/18:25
pabelangerrackspace?18:26
*** iyamahat has joined #openstack-infra18:26
ssbarneamordred: already raised https://review.gerrithub.io/#/c/389552/ for bumping share in infrared.18:26
ssbarnea(shade)18:26
Shrewspabelanger: inap (i think)18:26
pabelangerinap18:26
pabelangeryah18:26
clarkbmordred: ya thats been happening a bunch18:26
clarkbI don't actually think its a mitm issue18:26
pabelangermaybe we have a leaked instances some place18:26
clarkbeither IP conflict ^ or some other network error causing the data to not be transfered properly18:27
*** rbrndt has quit IRC18:27
Shrewsit's more fun to imagine that "SOMEONE IS DOING SOMETHING NASTY!"18:29
mgagneclarkb, pabelanger: checking for leaked IPs or zombie instances18:29
Shrewsmordred: i'm going to recheck it18:30
mordredShrews: kk18:30
mordredclarkb: yah- I agree it's likely not actually MITM - but definitely seems like a thing we should get to the bottom of18:30
ssbarneamordred: i am wondering if is possible to bump shade in ansible to avoid this bug. the problem is that shade requirement seems to only inside docstrings, one for each openstack module... really hard to update/test/maintain.18:32
pabelangermordred: Shrews: didn't we also have an issue where zuul lost the lock on on zookeeper and deleted a node under ansible before?18:33
dmsimardssbarnea: shade is not a requirement of ansible18:33
dmsimardssbarnea: https://github.com/ansible/ansible/blob/devel/requirements.txt18:34
*** iyamahat_ has joined #openstack-infra18:34
clarkbmordred: I've +2'd the stack for siblings and constraints but not approved them as results haven't come back for the canary change18:34
clarkbmordred: I figure you can approve once you are happy the canary survived18:34
*** iyamahat has quit IRC18:34
*** armaan has quit IRC18:35
ssbarneadmsimard: not really because shade is not mentioned there, is because ansible team wants to keep deps minimal, we need not to forget that not everyone using ansible is using it with openstack.18:35
Shrewspabelanger: i can't remember off hand18:35
dmsimardssbarnea: right, but you're asking to bump the ansible shade requirement ?18:35
mgagnelooks like there is a leaked/orphan instance since oct 2618:36
dmsimardssbarnea: whatever ends up in the docstrings is not enforced in any way18:36
*** salv-orlando has quit IRC18:36
ssbarneaalso, shade is needed on the machine running the module, which may be different than ansible controller machine. not sure how they want to deal with this.18:36
*** salv-orlando has joined #openstack-infra18:36
ssbarneadmsimard: better to add these comments on the ticket: https://github.com/ansible/ansible/issues/29129 someone from ansible core team will know what to do about this.18:36
*** dhill_ has quit IRC18:36
openstackgerritEmilien Macchi proposed openstack-infra/zuul-jobs master: build-javascript-tarball: add files to run job when needed  https://review.openstack.org/52396018:37
Shrewsssbarnea: the ansible core team will say "not our problem"18:37
Shrewsssbarnea: they can't possibly keep track of all libraries that community modules may use18:38
Shrewscore modules are different18:38
openstackgerritEmilien Macchi proposed openstack-infra/project-config master: tripleo-ui: run build-javascript-tarball  https://review.openstack.org/52396118:39
ssbarneaShrews: well, not really, the module is core, they want to assure is working. I got very good help from them so far. Lets see what they recommend. Maybe they parse the docstrings and use the info from there.18:39
*** thorst has joined #openstack-infra18:40
*** thorst has quit IRC18:40
*** thorst has joined #openstack-infra18:40
*** mat128 has joined #openstack-infra18:40
Shrewsssbarnea: the os_* modules are not core, they are community maintained (thus the https://github.com/ansible/ansible/blob/devel/lib/ansible/modules/cloud/openstack/os_auth.py#L12)18:40
*** salv-orlando has quit IRC18:41
ssbarneaShrews: well, is not an external module, is part of the same git repo. which is a good thing.18:41
*** dhinesh has joined #openstack-infra18:42
Shrewsssbarnea: agreed, but that doesn't make it "core". let's move this to #ansible-devel18:42
*** weshay_mtg is now known as weshay18:42
ssbarneaShrews: already posted the question there. better to solve this problem at source, is not the first time when wrong shade version affected ansible.18:43
ihrachysAJaeger heya. could you please check / nudge https://review.openstack.org/#/c/523514/ in?18:44
*** dhinesh_ has joined #openstack-infra18:44
ssbarneaShrews: TBH, I really hate to see errors regarding missing modules when using ansible. Ansible should deploy them transparently on first use of the module. (on demand install)18:44
ihrachysthis blocks progress on neutron tempest plugin separation that we would like to move forward quicker18:44
pabelangerAJaeger: EmilienM: if we move https://review.openstack.org/523960 into a project-template, are we okay with that living in the project zuul.yaml, or so we want it in openstack-zuul-jobs18:44
pabelangerEither place does work18:44
*** jascott1 has joined #openstack-infra18:45
*** yamahata has joined #openstack-infra18:45
*** david-lyle has joined #openstack-infra18:45
EmilienMpabelanger: let's do it in openstack-zuul-jobs18:46
*** dhinesh has quit IRC18:47
*** dhinesh has joined #openstack-infra18:48
openstackgerritEmilien Macchi proposed openstack-infra/openstack-zuul-jobs master: Create javascript-tarball template  https://review.openstack.org/52396218:49
EmilienMpabelanger: ^18:49
*** dhinesh_ has quit IRC18:50
openstackgerritClark Boylan proposed openstack-infra/openstack-zuul-jobs master: Add required projects to legacy puppet rspec jobs  https://review.openstack.org/52396318:50
*** ansmith has joined #openstack-infra18:51
clarkbconfig-core I think ^ fixes the error at http://logs.openstack.org/40/516740/4/check/legacy-puppet-beaker-rspec/8a8b1ff/job-output.txt.gz#_2017-11-29_18_18_05_74837818:51
clarkbwhich I need to get working in order to get passing CI on the ara update change18:51
*** jamesmcarthur has joined #openstack-infra18:51
openstackgerritMerged openstack-infra/shade master: Implement availability_zone_hints for networks and routers.  https://review.openstack.org/52200418:51
openstackgerritEmilien Macchi proposed openstack-infra/project-config master: tripleo-ui: run javascript-tarball  https://review.openstack.org/52396118:51
EmilienMpabelanger: ^ better now?18:52
*** iyamahat_ has quit IRC18:54
*** david-lyle has quit IRC18:54
*** iyamahat has joined #openstack-infra18:54
pabelangerEmilienM: maybe just add them to nodejs6-jobs / nodejs6-publish-to-npm project-template?18:57
EmilienMpabelanger: it's opinionated18:58
EmilienMbut I'm fine with it if you think it's the right way to do18:58
pabelangerEmilienM: yah, I think that fits more into how python / puppet jobs work18:59
*** Sukhdev has joined #openstack-infra18:59
EmilienMok I'll do that18:59
*** david-lyle has joined #openstack-infra19:01
*** david-lyle has quit IRC19:02
*** sboyron has quit IRC19:02
openstackgerritEmilien Macchi proposed openstack-infra/openstack-zuul-jobs master: Add build-javascript-tarball to nodejs6-jobs template  https://review.openstack.org/52396219:03
*** dhill_ has joined #openstack-infra19:04
*** electrofelix has quit IRC19:04
EmilienMpabelanger: ok so at the end it's just https://review.openstack.org/#/c/523962/19:05
EmilienMpabelanger: I'm still waiting for my testing to finish: http://zuulv3.openstack.org/static/stream.html?uuid=849ea4146f7e47f79dfc90a868875c3b&logfile=console.log19:05
EmilienMpabelanger: i'm testing the job against tripleo-ui, to make sure it actually works how I want19:05
*** amoralej is now known as amoralej|off19:05
*** pblaho has quit IRC19:07
*** iyamahat has quit IRC19:07
*** iyamahat has joined #openstack-infra19:08
*** Goneri has quit IRC19:08
*** dhinesh_ has joined #openstack-infra19:08
EmilienMpabelanger, jrist: it works \o/ http://logs.openstack.org/64/523964/2/check/build-javascript-tarball/849ea41/job-output.txt.gz#_2017-11-29_19_05_45_68341119:09
jristyooge success19:09
EmilienMtested by https://review.openstack.org/#/c/523964/19:09
EmilienMso https://review.openstack.org/#/c/523962/ is ready for review19:10
jristthat is a yooge output19:10
*** slaweq has joined #openstack-infra19:10
openstackgerritClark Boylan proposed openstack-infra/openstack-zuul-jobs master: Add required projects to legacy puppet rspec jobs  https://review.openstack.org/52396319:10
EmilienMjrist: go blame npm :P19:10
*** dhinesh has quit IRC19:11
jristEmilienM: added reviewers from the team19:12
*** hemna_ has quit IRC19:13
*** rbrndt has joined #openstack-infra19:15
*** armaan has joined #openstack-infra19:15
*** armaan has quit IRC19:17
*** slaweq has quit IRC19:17
*** armaan has joined #openstack-infra19:17
*** slaweq has joined #openstack-infra19:18
*** tosky has joined #openstack-infra19:18
*** david-lyle has joined #openstack-infra19:21
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Add required projects to legacy puppet rspec jobs  https://review.openstack.org/52396319:21
mtreinishjeblair: I keep hitting retry_limit on the grenade docs job for: https://review.openstack.org/#/c/523643/19:22
mtreinishwhat does that mean?19:22
*** slaweq has quit IRC19:22
clarkbon further reading puppet-nova et all do use the legacy jobs, I thought that they had completely converted off of those19:23
openstackgerritMerged openstack-infra/project-config master: Modify charm-ceph-mon to make it an python35 only for gate  https://review.openstack.org/52309819:23
clarkbmnaser: ^ fyi I may have just broken testing on puppet-* via 523963. This was due to thinking puppet-* was completely off of legacy jobs.19:23
clarkbmnaser: is the intent to continue running jobs like legacy-puppet-beaker-rspec or is that a bug?19:24
clarkb(I want to fix it but I think that determines what the fix is)19:24
* clarkb starts writing keep it the way it was fix19:24
jeblairmtreinish: retry_limit jobs still upload their logs; the error is here: http://logs.openstack.org/43/523643/1/check/build-openstack-sphinx-docs/3beb391/job-output.txt.gz#_2017-11-29_16_25_22_59977019:27
*** kjackal has quit IRC19:27
jeblairmtreinish: possibly this has run into the sphinx docs pti work mordred and others are doing19:27
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Don't run functional test jobs for requirements changes  https://review.openstack.org/52394719:27
jeblairmtreinish: i have to run right now -- maybe that's enough of a thread for you to start pulling on19:28
openstackgerritClark Boylan proposed openstack-infra/openstack-zuul-jobs master: Make infra specific beaker rspec template  https://review.openstack.org/52396719:28
clarkbjeblair: AJaeger pabelanger ^ that should fix puppet openstack but will rebreak infra moduel testing until I update project-config to use that template19:28
clarkb(sorry for this I had really thought puppet openstack was compeltely off of the legacy jobs)19:28
mtreinishjeblair: yeah I assume it's all mordred's fault. I'll add a venv job and that should hopefully be enough to get this working19:29
mtreinishjeblair: thanks19:29
EmilienMhonza: replied on https://review.openstack.org/#/c/523962/19:30
* honza looks19:30
openstackgerritMerged openstack-infra/project-config master: Remove legacy jobs from Blazar  https://review.openstack.org/52220019:31
openstackgerritMerged openstack-infra/project-config master: neutron: don't execute legacy in-tree tempest jobs for master  https://review.openstack.org/52351419:31
*** jascott1 has quit IRC19:31
*** smatzek has quit IRC19:32
*** ociuhandu has joined #openstack-infra19:32
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove the instack-undercloud-puppet-lint job  https://review.openstack.org/52286219:33
honzaEmilienM: are you saying that we only want a new tarball when the version in package.json changes?  is it your intention to move away from having tarball builds on every patch merged?19:34
honza(just clarifying)19:34
*** david-lyle has quit IRC19:34
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix mixed canonical/non-canonical project merge  https://review.openstack.org/51333119:34
*** david-lyle has joined #openstack-infra19:35
EmilienMhonza: we never had this job before19:35
openstackgerritClark Boylan proposed openstack-infra/project-config master: Use infra specific beaker rspec template  https://review.openstack.org/52397019:36
EmilienMhonza: this job is new and will only be run when we prepare a new release19:36
clarkbjeblair: AJaeger pabelanger ^ there is the other half of the actual fix19:36
EmilienMhonza: we'll still have tarball created everytime *any* patch lands in tripleo-ui19:36
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Add regex support to project stanzas  https://review.openstack.org/51336819:36
*** ociuhandu has quit IRC19:36
honzaEmilienM: perfect, thanks for clarifying, it wasn't obvious to me from the patch (I'm still somewhat confused by the new layout of jobs)19:37
honzaEmilienM: vote changed19:37
*** salv-orlando has joined #openstack-infra19:37
*** rosmaita has quit IRC19:37
*** smatzek has joined #openstack-infra19:38
*** wolverineav has quit IRC19:38
EmilienMhonza: thanks!19:38
EmilienMhonza: my goal on this patch is to improve our testing when releasing19:38
EmilienMhonza: and catch errors earlier19:39
honzaEmilienM: ++19:39
*** smatzek_ has joined #openstack-infra19:41
*** salv-orlando has quit IRC19:42
*** smatzek has quit IRC19:43
*** rosmaita has joined #openstack-infra19:43
*** smatzek_ has quit IRC19:46
*** smatzek has joined #openstack-infra19:46
*** jpena|away is now known as jpena|off19:48
*** rwsu has quit IRC19:49
*** linkmark has joined #openstack-infra19:50
*** smatzek_ has joined #openstack-infra19:51
*** smatzek has quit IRC19:51
*** david-lyle has quit IRC19:53
*** Hal has quit IRC19:53
*** dprince has quit IRC19:53
*** wolverineav has joined #openstack-infra19:55
*** hasharAway is now known as hashar19:56
*** camunoz has quit IRC19:58
clarkbI'm going to take an informal poll here and in in #zuul because apparently we only have until the 5th to respond re ptg attendance or we will be considered as not attending20:01
*** sshnaidm|rover is now known as sshnaidm|off20:01
clarkbso hello #openstack-infra residents, will you be attending the dublin ptg to do infray things?20:01
clarkb(I will be)20:01
bkeroI hope so20:02
pabelangerclarkb: pending travel budget, yes!20:03
*** david-lyle has joined #openstack-infra20:04
*** rfolco is now known as rfolco|off20:04
clarkbya I understand travel budgets won't be sorted out so give me your best guess20:04
clarkbpabelanger: can I get quick review on https://review.openstack.org/#/c/523967/ needed to sort out an earlier derp of mine :/20:05
clarkbpabelanger: https://review.openstack.org/#/c/523970/ too20:05
*** efried_rollin is now known as efried20:07
pabelangerclarkb: +320:07
clarkbthank you20:08
*** flwang1 has quit IRC20:09
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Make infra specific beaker rspec template  https://review.openstack.org/52396720:11
*** camunoz has joined #openstack-infra20:12
*** trown is now known as trown|brb20:18
*** spectr has joined #openstack-infra20:18
*** spectr has quit IRC20:20
openstackgerritMerged openstack-infra/project-config master: Use infra specific beaker rspec template  https://review.openstack.org/52397020:21
dmsimardEmilienM, mwhahaha, pabelanger: I wonder if there's something weird going on with tripleo jobs, it seems to be the only project hitting DNS resolution issues against openstack-infra pypi mirrors: https://i.imgur.com/cAabI0Q.png20:21
*** slaweq has joined #openstack-infra20:21
*** smatzek_ has quit IRC20:21
dmsimardI'm currently gathering data around legitimate dns resolution errors in general to know where to apply unbound minimum ttl configuration changes but that one stood out20:22
*** smatzek has joined #openstack-infra20:22
mwhahahainteresting, not sure why we'd be downloading pypi stuff in the deployment. maybe tempest related items?20:22
dmsimardThe logstash query is:    message:"Name or service not known -- Some packages may not be found!"20:23
dmsimardExample failure: http://logs.openstack.org/88/523388/1/check/tripleo-ci-centos-7-undercloud-oooq/09d914c/logs/devstack-gate-cleanup-host.txt20:23
dmsimardfor installing PBR20:23
mwhahahadmsimard: that's in devstack gate cleanup20:24
mwhahahahttp://logs.openstack.org/88/523388/1/check/tripleo-ci-centos-7-undercloud-oooq/09d914c/logs/devstack-gate-cleanup-host.txt20:24
mwhahahastackviz20:24
dmsimardyes, that's the link I sent you :)20:24
*** smatzek has quit IRC20:24
* mwhahaha was in a different window :D20:25
dmsimardI'm writing a couple e-r queries related to DNS failures, that'll be one of them20:25
mwhahahait didn't fail the job so we wouldn't have noticed it20:25
*** dprince has joined #openstack-infra20:26
*** Sukhdev has quit IRC20:26
*** smatzek has joined #openstack-infra20:26
dmsimardmwhahaha: you sure about that ? all the jobs ended up failing according to logstash20:26
dmsimardbuild_status: FAILURE20:26
mwhahahaoh there it is20:27
*** salv-orlando has joined #openstack-infra20:27
mwhahahahttp://logs.openstack.org/88/523388/1/check/tripleo-ci-centos-7-undercloud-oooq/09d914c/job-output.txt.gz#_2017-11-28_11_31_44_31156920:27
mwhahahait failed out cause dns20:27
dmsimardmwhahaha: well, yeah, it didn't resolve for pypi and ended up not resolving later on20:28
mwhahahaother way around20:28
dmsimardoh ?20:28
mwhahahagate-cleanup-host runs after20:28
*** smatzek has quit IRC20:28
mwhahahathat's the log generation stuff20:28
mwhahahadmsimard: dns was fine, then crapped out20:29
*** jaypipes has quit IRC20:29
mwhahahahttp://logs.openstack.org/88/523388/1/check/tripleo-ci-centos-7-undercloud-oooq/09d914c/job-output.txt.gz#_2017-11-28_11_30_16_853699 OK20:29
*** smatzek has joined #openstack-infra20:29
mwhahahahttp://logs.openstack.org/88/523388/1/check/tripleo-ci-centos-7-undercloud-oooq/09d914c/job-output.txt.gz#_2017-11-28_11_31_44_311569 FAIL20:29
dmsimardone is pypi, the other is yum20:30
*** rwsu has joined #openstack-infra20:30
*** ldnunes has quit IRC20:30
mwhahahacheck the dns failure20:30
dmsimardthere's a one minute difference between the two20:30
*** smatzek has quit IRC20:30
dmsimardthat's odd, would there be a cache per process or something ?20:30
mwhahaharight dns was OK and within that minute unbound or whatever failed20:30
mwhahahawe use 127.0.0.120:30
mwhahahathere should be logs cause we started to capture them20:30
dmsimardright20:30
dmsimardwell that was yesterday though20:31
dmsimardlet me see if there's one like that today20:31
mwhahahawe started capturing them weeks ago20:31
* mwhahaha is starting a meeting20:31
dmsimardwe enabled debug logging yesterday though20:31
mwhahahai'll dig20:31
mwhahahawe enabled tripleo debugging a while ago :D20:31
dmsimardok20:32
mwhahahanm it didn't even get to that part20:32
mwhahahacause no undercloud20:32
dmsimardhow amazing20:32
dmsimardwe don't have one today yet20:32
dmsimardbut anyway, I'll have an e-r query for it so we can dig further20:33
*** smatzek_ has joined #openstack-infra20:33
*** smatzek__ has joined #openstack-infra20:35
*** smatzek__ has quit IRC20:35
*** smatzek__ has joined #openstack-infra20:35
*** camunoz has quit IRC20:35
*** iyamahat has quit IRC20:36
*** smatzek_ has quit IRC20:37
*** Goneri has joined #openstack-infra20:39
*** ansmith has quit IRC20:41
*** hughhalf has quit IRC20:41
*** hughhalf has joined #openstack-infra20:43
*** iyamahat has joined #openstack-infra20:43
*** trown|brb is now known as trown20:44
*** david-lyle has quit IRC20:45
*** threestrands has joined #openstack-infra20:47
*** dprince has quit IRC20:47
*** jamesmcarthur has quit IRC20:53
*** erlon has quit IRC20:53
*** vhosakot has quit IRC20:54
*** jamesmcarthur has joined #openstack-infra20:56
*** salv-orlando has quit IRC20:58
*** pcaruana has quit IRC21:00
*** jamesmcarthur has quit IRC21:01
*** salv-orlando has joined #openstack-infra21:04
*** david-lyle has joined #openstack-infra21:04
mwhahahadmsimard: so yea, dns was fine and while we were still setting up the packages it died somewhere. And since we didn't actually get to quickstart no logs21:04
mwhahahadmsimard: i've seen a simlar issue where things were find and then like the docker prep stuff fails on the dns server misbehaving21:05
mwhahahadmsimard: with the debug unbound logs but i didn't see anything specific21:05
mwhahahai'll see if i can dig up one of those21:05
*** dprince has joined #openstack-infra21:05
*** flwang has joined #openstack-infra21:06
clarkbre docker it will use its own dns server config if the host's resolv.conf points at localhost21:07
flwanggreetings, anybody can me an idea if there is any known issue about the gate for MongoDB?21:07
*** d0ugal has quit IRC21:07
flwangclarkb: ^21:07
clarkbthis is because localhost is network namespace local so you can't talk to the host's localhost easily and the current namespace's localhost won't have a resolver21:07
flwangZaqar's gate is always failed21:07
clarkbmwhahaha: ^ fyi21:07
flwanghere is the log http://logs.openstack.org/12/523812/1/check/openstack-tox-py35/8da4581/job-output.txt.gz21:08
clarkbflwang: without more info my only guess is that maybe you were getting mongodb from the rdo repo on centos 7 which was disabled by default21:08
clarkbflwang: do you have job logs?21:08
flwangclarkb: see above21:08
mwhahahaclarkb: no we saw the request in unbound21:08
flwangclarkb: and http://logs.openstack.org/12/523812/1/check/openstack-tox-py35/8da4581/21:08
*** aeng has joined #openstack-infra21:08
mwhahahaclarkb: though that would be something to check out21:09
clarkbflwang: that may be due to the bindep fallback being cleaned up. Do you have a bindep.txt and does that include mongodb?21:09
pabelangeryah, I think we might have removed it21:10
flwangclarkb: let me check21:10
clarkbflwang: if I am reading the job log right I think it can't find the bindep.txt21:10
clarkbso fix would be to have on that lists your deps (like mongodb21:10
clarkbmwhahaha: if it is hitting unbound and showing up in the logs then not likely that issue. But something to be aware of if you have name resolution errors in containers21:11
mwhahahaclarkb: oh no this i was in the image pull21:11
mwhahahanot in the container itself21:11
clarkbgotcha21:11
flwangclarkb: may i know where to get a sample of bindep.txt? is it a new file for zuul v3?21:11
mwhahahathe go dns lib or whatever just throws a 'server mishaving' when it gets a weird response or something. i went looking previously and there wasn't much detail21:12
*** caphrim007 has quit IRC21:12
*** caphrim007 has joined #openstack-infra21:12
clarkbflwang: it is not a new file, we've supported it for a few years now. I will find an example21:12
mordredmtreinish, jeblair: the updated build_sphinx jobs haven't landed yet- but I'm wondering how grenade *ever* ran docs jobs if it didn't have a venv tox environment21:13
clarkbflwang: https://git.openstack.org/cgit/openstack/nova/tree/bindep.txt that is novas and has links to docs21:13
*** caphrim007_ has joined #openstack-infra21:13
mordredthe changes to the docs jobs are, amusingly enough, to remove the need for a venv tox environment21:13
pabelangerclarkb: flwang: https://review.openstack.org/519533/21:13
mordredbut the docs jobs have run "tox -evenv -- python setup.py build_sphinx" for as long as we've had tox jobs and a PTI21:13
pabelangeris the removal21:13
jeblairmordred: what you say makes sense to me.21:14
dmsimardpabelanger, clarkb: I think I nailed a fairly accurate logstash query for legit errors21:15
dmsimardmessage:"Name or service not known -- Some packages may not be found!" OR message:"[Errno 14] curl#6" OR message:"curl: (6) Could not resolve host" OR message:"Curl error (6): Couldn't resolve host name"21:16
flwangpabelanger: does that mean it's removed from the central jenkins config so we(zaqar) has to keep one in tree?21:16
*** caphrim007 has quit IRC21:16
clarkbmordred: maybe grenade never ran docs jobs?21:17
clarkband in the transition grew them?21:17
mordredclarkb: maybe?21:17
*** aeng has quit IRC21:17
flwangpabelanger: clarkb: and if that's the case, should I expect a notice next time before removing?21:18
*** smatzek__ has quit IRC21:18
pabelangerflwang: yah, we posted something to openstack-dev ML a few weeks ago, let me find post21:19
jeblairclarkb, mordred, mtreinish: or it may have had a custom job which switched to the standard one21:19
pabelangerflwang: http://lists.openstack.org/pipermail/openstack-dev/2017-November/124613.html21:19
flwangpabelanger: ok, cool21:19
flwangpabelanger: so back to my first question, we will have one in tree, right?21:19
flwangi mean we have to create one in tree21:20
mordredwell- the new job should suite them well :)21:20
pabelangerflwang: yah, you'll need to create a bindep.txt file now intree21:20
flwangpabelanger: i see, thank you very much21:20
*** jtomasek has quit IRC21:21
mordredjeblair: am I  missing something stupid? http://logs.openstack.org/61/508061/9/check/shade-functional-devstack-tips/07ca825/ara/ doesn't show a run being executed at all21:23
efriedHowdy folks.  This change merged earlier [Port wiki bugs pages (1 of ?)  https://review.openstack.org/523551] but isn't reflected in the publish location [https://docs.openstack.org/project-team-guide/bugs.html]  I can't tell anything wrong with the publish job [http://logs.openstack.org/d3/d3a367920bc67cc0254927494f6f4ab682aac72e/post/publish-openstack-sphinx-docs-direct/5e71e35/job-output.txt.gz] but I don't really know w21:24
efriedhat I'm looking at.  Can anyone help?21:24
mordredjeblair: the job does have a run playbook listed21:24
mordredjeblair: before I go trolling in executor logs - am I just not seeing something stupid?21:24
clarkbmordred: http://logs.openstack.org/61/508061/9/check/shade-functional-devstack-tips/07ca825/job-output.txt.gz#_2017-11-29_18_23_18_715898 seems to jump right over in the console output too21:25
mtreinishclarkb, mordred, jeblair: it ran docs jobsin the past. I'm assuming it was a one off (because it ran tox -edocs or manually installed sphinx and built them)21:25
mtreinishclarkb, mordred, jeblair: either way: https://review.openstack.org/523968 fixed it21:26
mordredmtreinish: woot21:26
mordredmtreinish: you should be able to re-remove that once we land the new build-openstack-sphinx-docs jobs21:26
pabelangerefried: looking21:27
*** jascott1 has joined #openstack-infra21:27
*** ganso has quit IRC21:27
jeblairmordred: deduction suggests that the last pre-run failed21:28
jeblairmordred: but we're definitely lacking output in the logs to indicate why.  we should treat that as a bug.21:29
efriedpabelanger Thanks!21:29
jeblairmordred: that deduction seems to be reinforced by the fact that the result is retry_limit (which is what would happen if a pre-run fails)21:30
*** aeng has joined #openstack-infra21:30
pabelangerefried: seems like something is broken, https://review.openstack.org/500941/ was the last job to actually publish21:31
pabelangerefried: I'll dig a little deeper here in a few moments21:31
efriedpabelanger Okay, thanks.21:31
mordredjeblair: oh - yah. duh. thank you21:31
pabelangerhttps://docs.openstack.org/project-team-guide/.root-marker21:31
pabelangeris where I found the publish info21:32
clarkbefried: pabelanger in the linked job log it does run the afs sync task21:33
clarkband it takes almost a second implying it did something21:33
clarkbhttp://logs.openstack.org/d3/d3a367920bc67cc0254927494f6f4ab682aac72e/post/publish-openstack-sphinx-docs-direct/5e71e35/job-output.txt.gz#_2017-11-29_16_59_04_201938 there21:33
*** kjackal has joined #openstack-infra21:34
*** dprince has quit IRC21:34
pabelangermaybe vos release?21:35
openstackgerritJulia Kreger proposed openstack-infra/shade master: De-client-ify many baremetal calls  https://review.openstack.org/52398621:35
openstackgerritJulia Kreger proposed openstack-infra/shade master: Fix operator cloud get_nic_by_mac  https://review.openstack.org/52398721:35
openstackgerritJulia Kreger proposed openstack-infra/shade master: De-client-ify fixed method get_nic_by_mac  https://review.openstack.org/52398821:35
openstackgerritJulia Kreger proposed openstack-infra/shade master: Remove python-ironicclient  https://review.openstack.org/52398921:35
pabelangeractually, we don't vos release in the job21:35
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Combine tox-siblings and tox roles  https://review.openstack.org/52395021:35
pabelangerwe do that in a crontab I think21:35
clarkbya its some other system doing it21:35
pabelangerchecking AFS21:35
clarkbbut possible that stopped, we can check the RW volume to see right?21:35
mordredclarkb, pabelanger, jeblair: ^^ https://review.openstack.org/523950 the problem is that there are some uses of the tox-siblings roles in a few playbooks (including shade) - so I updated that patch to leave a role in place that does nothing - I'll get patches up to the other projects that depends-on that one that remove the use21:36
*** mat128 has quit IRC21:37
openstackgerritMonty Taylor proposed openstack-infra/shade master: Avoid tox_install.sh for constraints support  https://review.openstack.org/50806121:37
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Remove tox-siblings role stub  https://review.openstack.org/52399621:43
pabelangerclarkb: looking at /afs/.openstack.org/docs/project-team-guide, I only see data from Sep 2021:43
pabelangerclarkb: maybe we have an issue with upload-afs role21:43
pabelangerclarkb: eg: not overwriting the data for some reason21:44
clarkbmaybe the secret is wrong or doesn't have the correct permissions?21:44
pabelangerdon't think so, we have other doc jobs publishing I think21:45
pabelangerbut, will check21:45
pabelangerhmm, I don't see a root-marker in the job21:47
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Normalize daemon process handling  https://review.openstack.org/51738121:47
*** oomichi_afk is now known as oomichi21:48
pabelangerthink that is the issue21:48
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job  https://review.openstack.org/52261821:48
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: DONT MERGE: Create ovb-ha-ipv6 and deprecate fs024 job  https://review.openstack.org/52390321:49
fungiokay, finally home and catching up, but i expect the remainder of my evening will involve treading backlog21:49
clarkbfungi: will you be joining us at the PTG? (I think I know the answer to that already)21:50
clarkbmordred: ^ you too?21:50
*** ccamacho has joined #openstack-infra21:50
EmilienMI cancel my trip if infra doesn't join PTG :P21:51
fungimordred: Shrews: pabelanger: clarkb: prior instances i've seen for ssh key mismatches appeared to be nova/hypervisor side leaks, where the api no longer reported the instance as existing but it was never completely deleted from the host and was still occupying the ip address nova thought had been reassigned to a newly-booted instance21:51
clarkbhaha I expect we'll be there. Quite a few of us have said they inted on going21:51
clarkbEmilienM: mostly just collecting as much headcount info as possible so that can be used for room scheduling stuff21:51
*** rwsu has quit IRC21:51
*** oomichi is now known as oomichi_afk21:51
EmilienMclarkb: count me in21:51
fungias you can imagine, not an easy thing to track down (operator needs to run virsh list or whatever on the compute node looking for the defunct uuid)21:51
EmilienMif that count21:51
*** edmondsw has quit IRC21:51
fungiand/or comparing all uuids to what the nova controller thinks exist21:52
openstackgerritMerged openstack-infra/shade master: Fix basepython setting in tox.ini  https://review.openstack.org/52391521:52
mordredclarkb: yes. I will be in Dublin21:52
fungiclarkb: oh, yeah i said yesterday i'd come to the ptg21:52
fungimaybe i was not overly specific... seems like i probably said something like "i don't have any better plans"21:52
*** edmondsw has joined #openstack-infra21:53
pabelangerclarkb: efried: i see the issue, working on patch21:53
efriedpabelanger Nice, thank you.21:54
fungiyay, my manual run of the log expiration script finally completed. time(1) reports it took "real 19594m35.139s"21:54
* fungi does basic math21:54
fungithat's ~13.6 days21:54
fungiso our "weekly" log deletion passes take very nearly 2 weeks to complete21:55
clarkbwow21:55
dmsimardfungi: yeah we're struggling in RDO to delete faster than people fill it up21:55
dmsimardBut we also have other problems that contribute to that21:55
clarkbinfra-root and config-core on https://storyboard.openstack.org/#!/board/54 I think it might be a good idea to have contact info for each of the help wanted stories. I would probably put a name and irc nick (probably not email because spam?) in each of the stories if we are comfortable with that?21:56
fungiwell, our biggest problem contributing to it, other than sheer inode count, is that we're running this fs on a 14-way jbod of iscsi-connected volumes with who-knows-how-much contention over the transport layer21:56
clarkbfor example pabelanger is pushing the xenial upgrades so would put paul on that one and I did the last Gerrit upgrade so can help with the next one and so on21:57
openstackgerritJulia Kreger proposed openstack-infra/shade master: De-clientify baremetal create/delete  https://review.openstack.org/50011921:57
openstackgerritJulia Kreger proposed openstack-infra/shade master: De-client-ify baremetal machine port list  https://review.openstack.org/50012021:57
clarkbBut I don't want this to feel like anyone is being voluntold to do anything so let me know if that doesn't work for you21:57
dmsimardfungi: The current find approach is very safe and conservative but it also makes us crawl through every single directories and *files* to check their mtime21:57
dmsimardfungi: We need to determine the structure of the log directories and only crawl through top-level directories instead21:57
fungiclarkb: i have no objection to e-mail as well... i mean our e-mail addresses are already plastered all over commits in git repositories, basically painted in 50'-high neon letters21:57
clarkbfungi: that is a good point21:58
dmsimardfungi, clarkb: mailing lists too.. :)21:58
fungidmsimard: agreed, i have several ideas on ways we could alter our current log archiving layout to make expiration nearly-instantaneous21:58
*** edmondsw has quit IRC21:58
dmsimardthe problem is that it's quite dangerous because directories higher up in the tree aren't necessarily modified when you're just creating directories further down21:59
fungiclarkb: the main reason i can see for not including e-mail addresses (and even putting in irc nicks runs this risk) is that it encourages people to contact us privately over discussions we should be having in public21:59
dmsimardso you could end up deleting those top directories which haven't been modified in a long time but actually contain a whole stack of directories21:59
clarkbfungi: thats true, but I also get a sense that if your first interaction is with a 470 person irc chat channel it can be overwhelming22:00
fungiclarkb: but i agree that listing someone who has some background on the task would still be a big help to jump-starting new contributors so probably worth the risk22:00
dmsimardclarkb: I took https://storyboard.openstack.org/#!/story/2001369 which screams puppetboard spec22:00
*** kgiusti has left #openstack-infra22:00
dmsimardWhich I'll try to write. soon.22:00
clarkbdmsimard: ya thats what it is inteded to be but I left it open ended enough that we could let a spec sort out details22:01
clarkbtrying to get enough detail and contact info on specs so that people looking to help can find stuff that interests them without making those stories design docs22:01
clarkbdmsimard: thank you for grabbing it22:01
openstackgerritJulia Kreger proposed openstack-infra/shade master: De-client-ify machine patch operations  https://review.openstack.org/50012122:01
fungidmsimard: with some fairly minor adjustments, we could root logs dirs one layer deeper under top-level directories organized by date, or even in logical volumes we rotate by date22:02
*** Apoorva_ has joined #openstack-infra22:02
fungiand that lets us get rid of the find nonsense entirely because we know automatically what can be deleted22:02
*** jascott1 has quit IRC22:02
*** rcernin has joined #openstack-infra22:03
*** jascott1 has joined #openstack-infra22:03
fungiif we shard across multiple volumes by date then we even get the ability to just drop/reformat/mount the lv instead of having to wait for all the inode deletions to get accounted22:03
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Add root-marker to publish-openstack-sphinx-docs-direct  https://review.openstack.org/52400122:03
pabelangerclarkb: efried: ^root-marker fix22:03
*** jascott1 has quit IRC22:04
*** jascott1 has joined #openstack-infra22:04
fungidmsimard: an alternative is that we create a new "tarball" log publisher that tars up the tree of artifacts and then puts that on the logserver, and teach os-loganalyze to unpack those tarballs to tempdirs and serve their contents on demand. far fewer inodes that way, with a bonus that people can opt to download a tarball of the logs rather than having to crawl the tree when they want all logs from a22:05
fungibuild22:05
*** eharney has quit IRC22:05
efriedpabelanger No idea what I'm looking at there, so I'll refrain from voting, but I did leave a comment :)22:05
*** Apoorva has quit IRC22:05
*** jascott1 has quit IRC22:05
*** jkilpatr has quit IRC22:05
dmsimardfungi: ianw has a patch that does exactly that22:06
dmsimardfungi: which is where I drew inspiration from for the ara sqlite over http middleware22:06
dmsimardI couldn't find you the review if I tried though, it dates back to 2015 or something22:06
pabelangerefried: replied!22:07
fungiif it's the one i'm thinking of, seems like that did the opposite? (tars up a tree of logs on demand and serves it to the client)22:07
dmsimardoh, maybe, I don't remember :/22:07
pabelangerfungi: dmsimard: 524001 will fix the issue above from efried22:07
*** hashar has quit IRC22:07
clarkbinfra-root can I get reviews on https://review.openstack.org/#/c/523955/ to turn crm114 back on?22:08
clarkband https://review.openstack.org/#/c/523937/ is an easy doc fix22:08
*** hashar has joined #openstack-infra22:11
clarkbhttp://logs.openstack.org/40/516740/4/check/legacy-puppet-beaker-rspec-infra/179f248/job-output.txt.gz#_2017-11-29_21_49_00_034723 that is an interesting way that zuulv3 breaks puppet vcsrepo22:12
clarkbjeblair: ^ you may be interested in that22:12
openstackgerritMerged openstack-infra/project-config master: Add root-marker to publish-openstack-sphinx-docs-direct  https://review.openstack.org/52400122:13
*** Goneri has quit IRC22:13
clarkbanyone have opinions on how to address that? could just add a step to the job that runs git remote add origin and point to git.o.o or something22:13
*** Goneri has joined #openstack-infra22:13
*** aeng has quit IRC22:14
jeblairclarkb: i feel like in this situation that may be the correct thing to do.22:14
efriedpabelanger That merged; do I need to take any action to retrigger the publish job?22:14
dmsimardianw: heh, logan- has a thing: https://github.com/logan2211/ansible-unbound22:15
clarkbok I'll work on a patch to add an origin22:16
logan-o/ dmsimard22:17
*** jascott1 has joined #openstack-infra22:18
*** thorst has quit IRC22:19
ianwdmsimard / fungi: well my patch is sort of the opposite of that, in that it tars up the directory and serves it, rather than untars it and presents it22:20
ianwhttps://github.com/Logan2211/ansible-unbound/tree/master/tasks ... every time i see this i think there has to be a better way22:22
ianwmaybe it's just like autoconf though.  all your good intentions of papering over differences end up in a huge mess anyway22:23
logan-there is a better way, thats just an old role that predates the 'package' meta module and hasn't been updated yet :)22:24
fungiianw: yup, that's what i thought i remembered. glad to know old age hasn't completely destroyed my memory ;)22:24
ianwlogan-: yeah, sorry i didn't pull it apart; even package: explodes out when names are different etc.  it just is what it is, i guess22:25
*** aeng has joined #openstack-infra22:26
EmilienMpabelanger: any chance to review https://review.openstack.org/#/c/523962/ please22:26
ianwit's better than dib's current testing install of "apt-get install pkg || yum install pkg || zypper install pkg" ... i mean one will work eventually, right :)22:26
rcarrillocruzit's usual to use with_first_found / include_vars pattern22:27
rcarrillocruzwhich basically22:28
rcarrillocruzis doing a data driven load of package per platform22:28
rcarrillocruzianw: https://serverfault.com/questions/587727/how-to-unify-package-installation-tasks-in-ansible22:28
rcarrillocruzthat's the cleanest imho22:28
logan-ianw: https://github.com/Logan2211/ansible-unbound/pull/17/files :P22:28
*** jkilpatr has joined #openstack-infra22:29
*** hashar has quit IRC22:29
ianwrcarrillocruz: yeah, i believe we've followed that pattern pretty well in z-j / o-z-j so that's good22:31
dmsimardso I was trying to pull up relevant data for DNS lookup failures22:32
*** edmondsw has joined #openstack-infra22:32
dmsimardand it's not funny, I can't find anything for github.com22:32
*** slaweq has quit IRC22:32
dmsimardIt was presumably the worst case and I can't find anything.22:32
dmsimardI put up an ethercalc with legit DNS lookup failures and wanted to make an e-r query with it, however, some of the failures aren't fatal (i.e, yum tries another repo) https://ethercalc.openstack.org/c4z5uworv7kx22:33
*** rlandy|ruck is now known as rlandy|ruck|brb22:33
openstackgerritMerged openstack-infra/shade master: De-client-ify baremetal node_set_provision_state  https://review.openstack.org/49977322:34
*** slaweq has joined #openstack-infra22:35
dmsimardThe domains that tend to come up are "copr-be.cloud.fedoraproject.org" and "download.fedoraproject.org", opentack infra mirrors in general (yum/apt/pypi), "yum.oracle.com"22:37
*** edmondsw has quit IRC22:37
pabelangerwe likey mirror the things for fedoraproject.org22:38
mnaserclarkb: the puppet-beaker jobs have not been migrated yet, so we still have legacy-puppet-beaker22:38
mnaserthough i dont see how 523963 could have broken us22:38
pabelangerI think we just added oracle.com22:38
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Add build-javascript-tarball to nodejs6-jobs template  https://review.openstack.org/52396222:38
clarkbmnaser: I swapped out the job with one that only had infra repos in it22:39
clarkbmnaser: but got it sorted out fairly quickly so you may not have even noticed22:39
*** slaweq has quit IRC22:39
clarkbpabelanger: ya I just approved a proxy cache change for oracle this morning22:39
mnaserclarkb: ok yeah, we should migrate the beaker jobs at some point but i want to avoid any big zuul related changes till queens-2 because we had some issues releasing queens-122:39
mnaserso its cutting it a bit close to potentially raise any issues22:40
*** Goneri has quit IRC22:40
clarkbmnaser: no rush just wanted to make sure you were back to working in the expected manner again22:40
mnaseri had started doing some work for a generic beaker job but i never got around finishing it unfortunately, but over the holidays ill be having a lot of spare time.22:40
mnaserhttps://review.openstack.org/#/c/523449/ most recent puppet-openstack change seems to have passed okay!22:40
clarkbjeblair: the best feature about requiring the yaml suffix in run/pre/post is that I can open those files directly using the path as is from my editor22:44
jeblairclarkb: ++22:46
*** edmondsw has joined #openstack-infra22:48
*** e0ne has quit IRC22:49
*** thorst has joined #openstack-infra22:50
*** e0ne has joined #openstack-infra22:50
*** e0ne has quit IRC22:51
*** e0ne has joined #openstack-infra22:51
*** e0ne has quit IRC22:51
*** e0ne has joined #openstack-infra22:52
*** e0ne has quit IRC22:52
*** e0ne has joined #openstack-infra22:53
*** e0ne has quit IRC22:53
*** e0ne has joined #openstack-infra22:54
*** e0ne has quit IRC22:55
*** thorst has quit IRC22:55
*** e0ne has joined #openstack-infra22:55
*** rlandy|ruck|brb is now known as rlandy|ruck22:55
*** esberglu has quit IRC22:55
*** e0ne has quit IRC22:55
*** Goneri has joined #openstack-infra22:56
*** thorst has joined #openstack-infra22:56
openstackgerritClark Boylan proposed openstack-infra/system-config master: Set origin on /etc/project-config in rsepc tests  https://review.openstack.org/52401622:58
clarkbjeblair: ^ and thats the force origin remote in change22:58
clarkbI'm going to depends on that and see what happens22:58
openstackgerritClark Boylan proposed openstack-infra/puppet-zuul master: Ensure ara is updated on executors  https://review.openstack.org/51674022:59
*** thorst has quit IRC23:01
tristanCclarkb: lgtm, also it seems like tc is waiting for your +1 on the log-classify addition to infra project in governance repo here: https://review.openstack.org/52216623:02
clarkbtristanC: oh sorry for missing that will review now23:03
*** Apoorva_ has quit IRC23:03
*** ccamacho has left #openstack-infra23:04
*** Apoorva has joined #openstack-infra23:04
clarkbtristanC: done23:04
*** d0ugal has joined #openstack-infra23:04
tristanCclarkb: thanks!23:05
*** jamesmcarthur has joined #openstack-infra23:07
openstackgerritDavid Moreau Simard proposed openstack-infra/tripleo-ci master: DNM: Test minimum unbound TTL for TripleO jobs  https://review.openstack.org/52401823:10
*** gibi has quit IRC23:10
*** jamesmcarthur has quit IRC23:11
*** wolverineav has quit IRC23:14
*** jonher has joined #openstack-infra23:14
*** wolverineav has joined #openstack-infra23:15
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Revert "Fix #1627402: fix grub2 element for ubuntu xenial"  https://review.openstack.org/52401923:16
*** jonher_ has quit IRC23:17
*** wolverineav has quit IRC23:19
EmilienMjeblair: stupid question but can you confirm we can't use the same instance of gertty for multiple gerrits?23:21
EmilienMjeblair: since beginning I run gertty multiple times (one for each gerrit I'm using)23:21
EmilienMjeblair: but I was wondering if you can actually run one instance talking to multiple gerrits23:21
*** salv-orlando has quit IRC23:22
*** salv-orlando has joined #openstack-infra23:22
jeblairEmilienM: correct -- you'll need different processes running for each gerrit.  you can have them share a config file, and specify the name of the gerrit on the command line, or you could make different config files for them23:23
jeblairEmilienM: i would like to support more than one in the same process.  that would probably require substantial db and config file changes though.23:24
EmilienMjeblair: ok good to know, thx23:25
EmilienMjeblair: tool is awesome23:25
EmilienM(using it for years now)23:25
*** linkmark has quit IRC23:25
*** bobh has quit IRC23:25
*** bobh has joined #openstack-infra23:26
*** pbourke has quit IRC23:26
*** salv-orlando has quit IRC23:27
clarkbhttp://logs.openstack.org/40/516740/5/check/legacy-puppet-beaker-rspec-infra/a60771b/job-output.txt.gz#_2017-11-29_23_21_45_589847 bah we delete the zuul prepared system-config looks like23:27
clarkbso my fix above won't be self testing23:28
*** pbourke has joined #openstack-infra23:28
*** bobh has quit IRC23:30
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job  https://review.openstack.org/52261823:30
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: DONT MERGE: Create ovb-ha-ipv6 and deprecate fs024 job  https://review.openstack.org/52390323:31
*** ijw has joined #openstack-infra23:31
*** priteau has quit IRC23:31
*** gmann_afk is now known as gmann23:31
*** priteau has joined #openstack-infra23:31
openstackgerritClark Boylan proposed openstack-infra/puppet-openstack_infra_spec_helper master: Check if we are running under Zuul v3  https://review.openstack.org/52402323:35
*** thorst has joined #openstack-infra23:35
openstackgerritClark Boylan proposed openstack-infra/puppet-zuul master: Ensure ara is updated on executors  https://review.openstack.org/51674023:35
clarkblets see if that works23:35
*** priteau has quit IRC23:36
clarkbhttp://logs.openstack.org/16/524016/1/check/legacy-infra-puppet-apply-3-centos-7/6791399/job-output.txt.gz#_2017-11-29_23_15_16_596670 this is beginning to feel like whac-a-mole23:37
clarkbhttp://logs.openstack.org/16/524016/1/check/legacy-infra-puppet-apply-3-centos-7/6791399/job-output.txt.gz#_2017-11-29_23_13_01_61099423:38
clarkbpabelanger: is ^ fallout from the removal of repos and things?23:38
*** dougwig has joined #openstack-infra23:38
openstackgerritJames E. Blair proposed openstack-infra/infra-specs master: Add a spec for top-level project hosting  https://review.openstack.org/52402423:41
*** thorst has quit IRC23:41
jeblairderp23:41
fungi#status log Requested removal of storyboard.o.o ipv4 address from policy blacklist (pbl listing PBL1660430 for 23.253.84.0/22)23:41
openstackstatusfungi: finished logging23:41
fungiinfra-root: ^23:41
*** ijw has quit IRC23:41
openstackgerritJames E. Blair proposed openstack-infra/infra-specs master: Add a spec for top-level project hosting  https://review.openstack.org/52402423:42
jeblairfungi: oh yeah ++23:42
fungiwe likely want to keep an eye out for future such issues with other servers. apparently rackspace has blanked pbl listings for their v4 assignments23:44
*** ijw has joined #openstack-infra23:44
fungis/blanked/blanket/23:44
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Make tripleo-buildimage-overcloud-full-centos-7 voting  https://review.openstack.org/52402523:44
jeblairthe pbl and cloud is ... an interesting combination.23:45
clarkbat least they don't block/thottle port 25 like in other clouds23:46
openstackgerritMerged openstack/diskimage-builder master: Fix grub2 dependency on arm64  https://review.openstack.org/51217423:47
openstackgerritMerged openstack/diskimage-builder master: Add debian minimal requirement for arm64  https://review.openstack.org/51217523:47
*** gibi has joined #openstack-infra23:47
mordredpabelanger, jeblair: https://review.openstack.org/#/c/523950/ is ready to go - it passed tests on https://review.openstack.org/#/c/508061/ and I verified in the logs that it did constraints and siblings properly23:48
*** tesseract has joined #openstack-infra23:48
*** tesseract has quit IRC23:49
mordredthere's also a follow up, https://review.openstack.org/#/c/523996/1 which actually removes the role that depends on the patches removing use of the role from each of the projects in which is was used23:49
*** marst has quit IRC23:49
*** rbrndt has quit IRC23:49
*** rbrndt has joined #openstack-infra23:49
*** rbrndt has quit IRC23:49
mordredjeblair: incidentally, I love that that set of changes involves a full DAG :)23:49
jeblairmordred: oh yes, nice use of depends-on :)23:50
clarkboh derp it failed to pull the rpm from puppetlabs to install the puppetlabs repo23:51
jeblairmordred: can you review https://review.openstack.org/518815 and suggest how you would like to incorporate it into this?23:51
clarkblooks like thats hosted by cloud front /me rechecks23:51
mordredjeblair: yes!23:52
*** bobh has joined #openstack-infra23:53
mordredjeblair: I can rebase https://review.openstack.org/518815 on top of https://review.openstack.org/#/c/523950/ - or vice-versa ...23:53
mordredjeblair: it'll just be a simple copying of that line to two places in the tox role instead of where it is now in the tox-siblings role23:54
jeblairmordred: i think they're all ready to go in, so maybe just whatever's less typing23:54
mordredjeblair: I think https://review.openstack.org/518815 on top of https://review.openstack.org/#/c/523950/ will be less typing ... lemme do that real quick23:54
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Move to dictionary list of projects zuul._projects (take 2)  https://review.openstack.org/51881523:56
mordredjeblair: ^^ donezo23:56
jeblairmordred: whole stack +w23:58
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add /{tenant}/jobs route  https://review.openstack.org/50327023:59
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add /{tenant}/builds route  https://review.openstack.org/46656123:59
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: make console-stream tenant scoped  https://review.openstack.org/50545223:59
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: web: add /{source}/{project}.pub route  https://review.openstack.org/50253023:59
jeblairianw, tonyb, clarkb: ^ constraints / projects dict changes23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!