| *** tinwood has quit IRC | 00:00 | |
| *** rbrndt has quit IRC | 00:00 | |
| clarkb | jlvillal: https://pypi.python.org/pypi/gerritbot/0.3.0 | 00:00 |
|---|---|---|
| *** shardy has quit IRC | 00:01 | |
| *** tinwood has joined #openstack-infra | 00:01 | |
| *** sdague has joined #openstack-infra | 00:02 | |
| *** rbuzatu has joined #openstack-infra | 00:02 | |
| *** tdasilva has joined #openstack-infra | 00:03 | |
| *** gordc has quit IRC | 00:03 | |
| *** rbuzatu has quit IRC | 00:06 | |
| *** pramodrj07 has quit IRC | 00:07 | |
| *** tphummel has quit IRC | 00:07 | |
| *** Swami_ has joined #openstack-infra | 00:08 | |
| *** purp_too has joined #openstack-infra | 00:08 | |
| *** Swami has quit IRC | 00:10 | |
| *** purp has quit IRC | 00:11 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Pass job identifier to testenv-worker https://review.openstack.org/424736 | 00:11 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add debugging information for bmc issues https://review.openstack.org/421409 | 00:11 |
| *** nicolasbock has quit IRC | 00:12 | |
| *** mattmceuen has quit IRC | 00:13 | |
| *** xarses has quit IRC | 00:17 | |
| *** shu-mutou-AWAY is now known as shu-mutou | 00:17 | |
| jlvillal | clarkb, Thanks :) | 00:18 |
| *** Guest9757 is now known as rook | 00:21 | |
| *** tlian2 has joined #openstack-infra | 00:21 | |
| *** hongbin has quit IRC | 00:22 | |
| *** tlian has quit IRC | 00:24 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Clone zuul into workspace in gate-zuul-nodepool https://review.openstack.org/424912 | 00:25 |
| jeblair | clarkb: ^ | 00:25 |
| jlvillal | Is there anyway to populate a relatively new repository with a sort-of pre-existing git tree? We are moving the ironic_tempest_plugin from openstack/ironic to openstack/ironic_tempest_plugin. | 00:26 |
| *** sdake has joined #openstack-infra | 00:26 | |
| jlvillal | I was thinking about doing a git-filter-branch (or whatever is the command) to be able to have history of our changes. | 00:26 |
| *** mtanino has joined #openstack-infra | 00:26 | |
| jeblair | jlvillal: yeah, do that and stick it somewhere public and then set that as the 'upstream' url in the new project creation change | 00:27 |
| jlvillal | Instead of just a single giant commit. | 00:27 |
| *** yamahata has quit IRC | 00:27 | |
| jlvillal | jeblair, Okay. And if the project already exists? With an empty commit or something | 00:27 |
| jlvillal | jeblair, Currently it just has a .gitreview file. | 00:28 |
| *** mtanino_ has quit IRC | 00:28 | |
| jlvillal | But I'm taking it to mean, that it is possible. We will work on figuring out git-filter-branch :) | 00:28 |
| jlvillal | soliosg, ^^^ | 00:28 |
| *** nicolasbock has joined #openstack-infra | 00:28 | |
| jeblair | jlvillal: ohhh. it already exists. | 00:29 |
| jlvillal | jeblair, Yeah. One commit | 00:29 |
| jlvillal | The .gitreview file | 00:29 |
| jeblair | jlvillal: that's different. you'd need to find an infra-root to force-push the project history into it. | 00:29 |
| jlvillal | jeblair, Okay. But possible? | 00:29 |
| jlvillal | jeblair, And hopefully there are a few infra-roots to ask... | 00:30 |
| jlvillal | :) | 00:30 |
| jeblair | jlvillal: there's a big note about this in the project creators guide: http://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-projects-list | 00:30 |
| *** inc0 has joined #openstack-infra | 00:31 | |
| jlvillal | jeblair, Oh. I see. | 00:31 |
| *** mtanino has quit IRC | 00:32 | |
| clarkb | jeblair: your change failed testing, I left a note with what i think is the fix | 00:32 |
| *** nicolasbock has quit IRC | 00:33 | |
| jeblair | jlvillal: i think the infra-roots are becoming increasingly resistent to doing these force-pushes. i would ask on the mailing list or at the meeting. if you have any suggestions as to what we could do to prevent this from happening again, i think that would be welcome. | 00:34 |
| *** wolverineav has quit IRC | 00:34 | |
| jlvillal | jeblair, Well we are one of the first projects trying to do the tempest work. So I guess we didn't think about it thoroughly. | 00:35 |
| jlvillal | jeblair, So is the procedure easier to delete a project? :) | 00:35 |
| jeblair | jlvillal: well, yes and no. projects are never deleted. :) | 00:36 |
| *** wolverineav has joined #openstack-infra | 00:36 | |
| jlvillal | Darn... | 00:36 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Clone zuul into workspace in gate-zuul-nodepool https://review.openstack.org/424912 | 00:37 |
| jeblair | clarkb: thanks ^ | 00:37 |
| jlvillal | jeblair, Maybe we will do the one patch at a time method then. | 00:37 |
| fungi | clarkb: thanks! (both for keysigning and gerritbot releasing) | 00:38 |
| fungi | clarkb: note that i think the puppet manifest for gerritbot won't ever upgrade so we likely still need to fix that | 00:38 |
| clarkb | ya I think we can change it to be latest | 00:39 |
| clarkb | or something likethat | 00:39 |
| fungi | ianw: yes, i've seen it on centos servers in the past. rebooting seems to clear it (for a while). i think nothing else i tried restarting or reloading did any good | 00:39 |
| ianw | for the next person finding "unable to create PAG: Disk quota exceeded" --> i see k5start returning quickly here : http://paste.openstack.org/show/596331/ . restarting afs on the host did not help. restarting afsd with "-debug" (/etc/sysconfig/openafs) did not show any logging in response to a k5start was called, suggesting it is not involved | 00:39 |
| fungi | maybe afsd restarts solved it though, i don't recall now | 00:39 |
| ianw | yeah, it did not for me | 00:40 |
| ianw | i have restarted the centos wheel builder, and it does appear ok now | 00:40 |
| *** knangia has quit IRC | 00:40 | |
| fungi | i'm sort of at a loss for how to debug that given i don't know what eventually triggers it | 00:41 |
| *** wolverineav has quit IRC | 00:41 | |
| *** panda is now known as panda|zZ | 00:42 | |
| *** thorst_ has joined #openstack-infra | 00:42 | |
| clarkb | amazingly our irc logs are the only thing google knows about it | 00:42 |
| *** adrian_otto has joined #openstack-infra | 00:42 | |
| clarkb | (does google exclude source code from its search?) | 00:42 |
| fungi | i have a feeling the rest of the world is not crazy enough to try to run openafs on centos 7 | 00:43 |
| fungi | or if they are, they complain in private away from the prying eyes of search engine spiders | 00:43 |
| ianw | no, i found the relevant source ... but it's calling the ioctl per the strace and gets back EDQUOT | 00:43 |
| ianw | it seems EDQUOT is mapped back from internal afs error codes | 00:44 |
| *** zhurong has joined #openstack-infra | 00:45 | |
| clarkb | ianw: meaning it might not actually be a quota issue, its just how some enums line up? | 00:45 |
| *** yolanda has quit IRC | 00:45 | |
| fungi | that was my take after having dug around in the relevant bits of source, but it didn't get me any further in identifying a cause | 00:46 |
| fungi | next step was to probably write something up for the openafs ml, but then i probably got distracted by some other shiny stuff | 00:47 |
| fungi | i can't remember back that far any more | 00:47 |
| *** nicolasbock has joined #openstack-infra | 00:49 | |
| *** amotoki has joined #openstack-infra | 00:49 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT https://review.openstack.org/424190 | 00:51 |
| *** tphummel has joined #openstack-infra | 00:51 | |
| *** yolanda has joined #openstack-infra | 00:51 | |
| *** yolanda has quit IRC | 00:53 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes) https://review.openstack.org/418098 | 00:53 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes) https://review.openstack.org/418098 | 00:53 |
| *** kzaitsev_mb has joined #openstack-infra | 00:54 | |
| *** adrian_otto has quit IRC | 00:57 | |
| *** thorst_ has quit IRC | 00:58 | |
| *** yolanda has joined #openstack-infra | 01:00 | |
| *** sdague has quit IRC | 01:01 | |
| openstackgerrit | Adam Gandelman proposed openstack-infra/zuul: Move and re-enable test_build_configuration_branch tests https://review.openstack.org/409376 | 01:01 |
| *** adrian_otto has joined #openstack-infra | 01:02 | |
| *** rbuzatu has joined #openstack-infra | 01:03 | |
| *** yolanda has quit IRC | 01:04 | |
| *** rajinir has quit IRC | 01:06 | |
| *** rbuzatu has quit IRC | 01:08 | |
| openstackgerrit | Dan Smith proposed openstack-infra/devstack-gate: Run discover_hosts to register subnodes in a multinode setup https://review.openstack.org/424252 | 01:08 |
| openstackgerrit | Dan Smith proposed openstack-infra/devstack-gate: Make the workspace logs owned by stack user for grenade also https://review.openstack.org/423417 | 01:08 |
| *** tphummel has quit IRC | 01:13 | |
| *** zz_dimtruck is now known as dimtruck | 01:13 | |
| *** adrian_otto has quit IRC | 01:14 | |
| *** adrian_otto has joined #openstack-infra | 01:15 | |
| *** adrian_otto has quit IRC | 01:16 | |
| *** admcleod_ has quit IRC | 01:17 | |
| *** sdake has quit IRC | 01:22 | |
| *** mtanino has joined #openstack-infra | 01:25 | |
| *** adrian_otto has joined #openstack-infra | 01:25 | |
| *** inc0 has quit IRC | 01:26 | |
| *** ssbarnea has quit IRC | 01:29 | |
| *** adrian_otto has quit IRC | 01:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Clone zuul into workspace in gate-zuul-nodepool https://review.openstack.org/424912 | 01:32 |
| *** wolverineav has joined #openstack-infra | 01:33 | |
| *** sdake has joined #openstack-infra | 01:35 | |
| *** tqtran has quit IRC | 01:37 | |
| ianw | http://logs.openstack.org/periodic/wheel-build-centos-7-amd64-python2/0f2efef-byhand/logs/ <- at least we get a build | 01:43 |
| *** pvaneck_ has quit IRC | 01:44 | |
| *** Sukhdev has quit IRC | 01:45 | |
| *** yujunz has joined #openstack-infra | 01:46 | |
| *** kzaitsev_mb has quit IRC | 01:47 | |
| *** john-davidge has joined #openstack-infra | 01:48 | |
| *** yujunz has quit IRC | 01:52 | |
| *** john-davidge has quit IRC | 01:52 | |
| *** Swami_ has quit IRC | 02:00 | |
| *** jamesden_ has joined #openstack-infra | 02:04 | |
| *** sdake has quit IRC | 02:06 | |
| *** mtanino has quit IRC | 02:12 | |
| *** pradk has quit IRC | 02:13 | |
| *** Apoorva has quit IRC | 02:14 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT https://review.openstack.org/424190 | 02:15 |
| *** Apoorva has joined #openstack-infra | 02:16 | |
| *** yujunz has joined #openstack-infra | 02:18 | |
| *** yujunz has quit IRC | 02:18 | |
| *** Apoorva has quit IRC | 02:18 | |
| *** yujunz has joined #openstack-infra | 02:19 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet-openstack: add ocata patches notifs on IRC https://review.openstack.org/424939 | 02:21 |
| *** camunoz has quit IRC | 02:21 | |
| *** jamesden_ has quit IRC | 02:24 | |
| *** wolverineav has quit IRC | 02:25 | |
| *** wolverineav has joined #openstack-infra | 02:25 | |
| *** wolverineav has quit IRC | 02:25 | |
| *** rkukura has joined #openstack-infra | 02:27 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Clean up testenv if Jenkins instance goes away https://review.openstack.org/424343 | 02:29 |
| *** armax has quit IRC | 02:31 | |
| *** yujunz has quit IRC | 02:31 | |
| *** yujunz has joined #openstack-infra | 02:31 | |
| *** winggundamth has joined #openstack-infra | 02:35 | |
| *** yujunz has quit IRC | 02:36 | |
| *** admcleod has joined #openstack-infra | 02:38 | |
| *** admcleod has joined #openstack-infra | 02:38 | |
| *** wolverineav has joined #openstack-infra | 02:41 | |
| *** gildub has quit IRC | 02:42 | |
| *** kzaitsev_mb has joined #openstack-infra | 02:42 | |
| *** pradk has joined #openstack-infra | 02:43 | |
| *** jamesdenton has joined #openstack-infra | 02:43 | |
| *** wolverineav has quit IRC | 02:45 | |
| *** dinob has quit IRC | 02:46 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Replace custom multinode oooq playbook with default quickstart playbook https://review.openstack.org/424683 | 02:56 |
| *** tlian2 has quit IRC | 02:56 | |
| *** thorst_ has joined #openstack-infra | 02:57 | |
| *** thorst_ has quit IRC | 02:57 | |
| *** rbuzatu has joined #openstack-infra | 02:58 | |
| openstackgerrit | Leehom Li proposed openstack/diskimage-builder: Fix problem unable disable iptables service https://review.openstack.org/419703 | 02:58 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Replace multinode playbook with default quickstart playbook https://review.openstack.org/424683 | 02:58 |
| *** rkukura has quit IRC | 03:00 | |
| *** hongbin has joined #openstack-infra | 03:02 | |
| ianw | whta do people think of an openstack-infra-status email list where we can push things like the wheel build status, daily dib build status, etc? | 03:02 |
| *** rbuzatu has quit IRC | 03:02 | |
| *** wolverineav has joined #openstack-infra | 03:02 | |
| *** wolverineav has quit IRC | 03:07 | |
| Jeffrey4l_ | is there any better solution to download packages from tarballs.openstack.org? kolla saves around 3GB into tarballs.o.o site. and will download it in kolla-ansible project. but it takes one hour to download such a file ;( | 03:10 |
| Jeffrey4l_ | is there any mirror link in the infra node? | 03:10 |
| *** mriedem has joined #openstack-infra | 03:11 | |
| *** wolverineav has joined #openstack-infra | 03:13 | |
| *** pradk has quit IRC | 03:15 | |
| *** wolverineav has quit IRC | 03:17 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tripleo: run upgrade job only after Ocata https://review.openstack.org/424954 | 03:18 |
| *** jamesdenton has quit IRC | 03:20 | |
| *** hongbin has quit IRC | 03:20 | |
| *** sdake has joined #openstack-infra | 03:21 | |
| *** hongbin has joined #openstack-infra | 03:21 | |
| *** ijw has quit IRC | 03:21 | |
| *** ihrachys has joined #openstack-infra | 03:23 | |
| *** wolverineav has joined #openstack-infra | 03:23 | |
| *** kzaitsev_mb has quit IRC | 03:23 | |
| *** nmathew has joined #openstack-infra | 03:23 | |
| *** wolverineav has quit IRC | 03:27 | |
| openstackgerrit | Zhang Ni proposed openstack-infra/project-config: Add new project(fuxi-kubernetes) to Openstack https://review.openstack.org/423126 | 03:29 |
| *** vikrant has joined #openstack-infra | 03:32 | |
| *** rbuzatu has joined #openstack-infra | 03:35 | |
| *** ihrachys has quit IRC | 03:37 | |
| *** rbuzatu has quit IRC | 03:39 | |
| *** ijw has joined #openstack-infra | 03:42 | |
| *** Apoorva has joined #openstack-infra | 03:44 | |
| *** Apoorva_ has joined #openstack-infra | 03:46 | |
| *** ijw has quit IRC | 03:46 | |
| *** pahuang has quit IRC | 03:48 | |
| *** john-davidge has joined #openstack-infra | 03:48 | |
| *** Apoorva has quit IRC | 03:49 | |
| *** anilvenkata has joined #openstack-infra | 03:50 | |
| *** wolverineav has joined #openstack-infra | 03:52 | |
| *** pahuang has joined #openstack-infra | 03:52 | |
| *** john-davidge has quit IRC | 03:53 | |
| *** wolverineav has quit IRC | 03:57 | |
| ianw | Jeffery4l_ : hmm, we do not have mirrors for things such as that | 03:57 |
| ianw | i imagine it would be fast for rax nodes, but maybe not for others | 03:57 |
| ianw | a range of vm's and stuff we embed into the daily image builds based on devstack needs. but adding 3gb or so is going to blow those out too much | 03:58 |
| *** marst has joined #openstack-infra | 04:01 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Prepare TripleO CI for stable/ocata https://review.openstack.org/424637 | 04:02 |
| *** wolverineav has joined #openstack-infra | 04:02 | |
| *** wolverineav has quit IRC | 04:07 | |
| *** sdake has quit IRC | 04:08 | |
| *** armax has joined #openstack-infra | 04:10 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Run install-distro-packages for wheel build https://review.openstack.org/424971 | 04:15 |
| *** rlandy has quit IRC | 04:15 | |
| *** adrian_otto has joined #openstack-infra | 04:16 | |
| *** nicolasbock has quit IRC | 04:16 | |
| *** adrian_otto has quit IRC | 04:16 | |
| *** kzaitsev_mb has joined #openstack-infra | 04:19 | |
| *** erikmwil_ has quit IRC | 04:21 | |
| *** sputnik13 has joined #openstack-infra | 04:21 | |
| *** wolverineav has joined #openstack-infra | 04:21 | |
| *** hongbin has quit IRC | 04:23 | |
| *** wolverineav has quit IRC | 04:26 | |
| *** dave-mccowan has quit IRC | 04:30 | |
| *** armax has quit IRC | 04:30 | |
| *** erikmwil_ has joined #openstack-infra | 04:30 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/424974 | 04:31 |
| *** wolverineav has joined #openstack-infra | 04:31 | |
| *** mriedem has quit IRC | 04:32 | |
| *** wolverineav has quit IRC | 04:36 | |
| *** rbuzatu has joined #openstack-infra | 04:36 | |
| *** Sukhdev has joined #openstack-infra | 04:37 | |
| *** sdake has joined #openstack-infra | 04:39 | |
| *** sdake_ has joined #openstack-infra | 04:40 | |
| *** sdake_ has quit IRC | 04:40 | |
| *** sdake_ has joined #openstack-infra | 04:40 | |
| *** rbuzatu has quit IRC | 04:40 | |
| *** hongbin has joined #openstack-infra | 04:41 | |
| *** wolverineav has joined #openstack-infra | 04:41 | |
| *** psachin has joined #openstack-infra | 04:42 | |
| *** sdake has quit IRC | 04:44 | |
| *** wolverineav has quit IRC | 04:46 | |
| *** sree has joined #openstack-infra | 04:46 | |
| *** sree has quit IRC | 04:46 | |
| *** sree has joined #openstack-infra | 04:46 | |
| *** erikmwil_ has quit IRC | 04:52 | |
| *** erikmwil_ has joined #openstack-infra | 04:53 | |
| *** hongbin has quit IRC | 04:53 | |
| *** kzaitsev_mb has quit IRC | 04:54 | |
| *** ianychoi has joined #openstack-infra | 04:55 | |
| *** armax has joined #openstack-infra | 04:55 | |
| *** armax has quit IRC | 04:56 | |
| *** yamahata has joined #openstack-infra | 04:56 | |
| *** thorst_ has joined #openstack-infra | 04:59 | |
| *** thorst_ has quit IRC | 05:03 | |
| *** jamielennox is now known as jamielennox|away | 05:06 | |
| *** kzaitsev_mb has joined #openstack-infra | 05:07 | |
| *** wolverineav has joined #openstack-infra | 05:11 | |
| *** kzaitsev_mb has quit IRC | 05:14 | |
| *** wolverineav has quit IRC | 05:15 | |
| *** gongysh has joined #openstack-infra | 05:18 | |
| *** tlbr_ has quit IRC | 05:20 | |
| *** Cibo has quit IRC | 05:23 | |
| *** nadya has joined #openstack-infra | 05:29 | |
| *** nadya has quit IRC | 05:32 | |
| *** Cibo has joined #openstack-infra | 05:35 | |
| *** wolverineav has joined #openstack-infra | 05:36 | |
| *** tqtran has joined #openstack-infra | 05:37 | |
| *** wolverineav has quit IRC | 05:41 | |
| *** tqtran has quit IRC | 05:41 | |
| *** bkorren has joined #openstack-infra | 05:42 | |
| *** Apoorva_ has quit IRC | 05:43 | |
| *** csomerville has quit IRC | 05:47 | |
| *** cody-somerville has joined #openstack-infra | 05:49 | |
| *** cody-somerville has joined #openstack-infra | 05:49 | |
| *** tlbr has joined #openstack-infra | 05:49 | |
| *** john-davidge has joined #openstack-infra | 05:49 | |
| *** john-davidge has quit IRC | 05:54 | |
| *** abregman has joined #openstack-infra | 05:55 | |
| *** wolverineav has joined #openstack-infra | 05:56 | |
| *** nadya has joined #openstack-infra | 05:58 | |
| *** wolverineav has quit IRC | 06:00 | |
| *** thethorongil has joined #openstack-infra | 06:05 | |
| *** wolverineav has joined #openstack-infra | 06:06 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Merge remote-tracking branch 'origin/master' into merge-branch https://review.openstack.org/424988 | 06:08 |
| *** pgadiya has joined #openstack-infra | 06:10 | |
| *** wolverineav has quit IRC | 06:10 | |
| *** nadya has quit IRC | 06:11 | |
| *** armax has joined #openstack-infra | 06:13 | |
| *** slagle has quit IRC | 06:15 | |
| *** wfoster has quit IRC | 06:15 | |
| *** ianychoi has quit IRC | 06:15 | |
| *** armax has quit IRC | 06:16 | |
| *** slagle has joined #openstack-infra | 06:17 | |
| *** wfoster has joined #openstack-infra | 06:19 | |
| *** hichihara has joined #openstack-infra | 06:19 | |
| *** huanxie has joined #openstack-infra | 06:20 | |
| *** diga has joined #openstack-infra | 06:22 | |
| *** wolverineav has joined #openstack-infra | 06:26 | |
| *** aeng has quit IRC | 06:27 | |
| *** rbuzatu has joined #openstack-infra | 06:27 | |
| *** pgadiya has quit IRC | 06:30 | |
| *** wolverineav has quit IRC | 06:30 | |
| *** anilvenkata has quit IRC | 06:32 | |
| *** rbuzatu has quit IRC | 06:32 | |
| *** wolverineav has joined #openstack-infra | 06:36 | |
| openstackgerrit | Surya Prakash Singh proposed openstack-infra/project-config: Add non-voting coverage job to python-magnumclient https://review.openstack.org/425000 | 06:36 |
| *** noama has joined #openstack-infra | 06:37 | |
| *** yuval has joined #openstack-infra | 06:38 | |
| *** bhavik1 has joined #openstack-infra | 06:38 | |
| *** Sukhdev has quit IRC | 06:39 | |
| *** wolverineav has quit IRC | 06:40 | |
| *** pgadiya has joined #openstack-infra | 06:42 | |
| *** rbuzatu has joined #openstack-infra | 06:43 | |
| *** anilvenkata has joined #openstack-infra | 06:44 | |
| *** bhavik1 has quit IRC | 06:45 | |
| diga | Hi | 06:45 |
| diga | I am developing new api framework for tacker but to start the dev, we need to create feature/branch for that | 06:46 |
| diga | can someone help create feature/branch for tacker project ? | 06:47 |
| *** digvijay2016 has joined #openstack-infra | 06:47 | |
| digvijay2016 | ARA static file generation is taking too much time (approx 1 hr) in CI environment... what things do I need to check? | 06:47 |
| *** Jeffrey4l_ has quit IRC | 06:48 | |
| *** yolanda has joined #openstack-infra | 06:51 | |
| *** umeshksingla has joined #openstack-infra | 06:51 | |
| *** Jeffrey4l has joined #openstack-infra | 06:53 | |
| *** makowals_ has quit IRC | 06:53 | |
| *** pahuang has quit IRC | 06:57 | |
| *** thorst_ has joined #openstack-infra | 06:59 | |
| *** sdake_ has quit IRC | 07:01 | |
| *** kjackal_ has quit IRC | 07:01 | |
| *** kjackal_ has joined #openstack-infra | 07:03 | |
| *** thorst_ has quit IRC | 07:04 | |
| openstackgerrit | Merged openstack-infra/project-config: add reno jobs for Zaqar-UI https://review.openstack.org/421178 | 07:05 |
| *** makowals has joined #openstack-infra | 07:06 | |
| *** aojea has quit IRC | 07:06 | |
| *** mrunge has quit IRC | 07:08 | |
| *** mrunge has joined #openstack-infra | 07:09 | |
| *** nmathew- has joined #openstack-infra | 07:09 | |
| *** tnovacik has joined #openstack-infra | 07:09 | |
| *** nmathew has quit IRC | 07:11 | |
| *** nmathew has joined #openstack-infra | 07:12 | |
| openstackgerrit | Surya Prakash Singh proposed openstack-infra/project-config: Add non-voting coverage job to python-magnumclient https://review.openstack.org/425000 | 07:13 |
| *** nmathew- has quit IRC | 07:14 | |
| *** matrohon has joined #openstack-infra | 07:16 | |
| *** yamamoto has quit IRC | 07:17 | |
| *** anilvenkata has quit IRC | 07:17 | |
| *** mpaolino has joined #openstack-infra | 07:18 | |
| *** umeshksingla has quit IRC | 07:18 | |
| *** aojea has joined #openstack-infra | 07:19 | |
| AJaeger | yolanda, ianw, could you put these project-config changes on your review queue, please? https://review.openstack.org/424813 and https://review.openstack.org/424674 . Thanks | 07:19 |
| *** adriant has quit IRC | 07:19 | |
| *** dimtruck is now known as zz_dimtruck | 07:20 | |
| *** tnovacik has quit IRC | 07:20 | |
| *** markus_z has joined #openstack-infra | 07:22 | |
| *** matrohon has quit IRC | 07:23 | |
| *** bkorren has quit IRC | 07:23 | |
| *** isaacb_ has joined #openstack-infra | 07:25 | |
| *** aviau has quit IRC | 07:26 | |
| *** aviau has joined #openstack-infra | 07:26 | |
| *** pcaruana has joined #openstack-infra | 07:28 | |
| *** anilvenkata has joined #openstack-infra | 07:30 | |
| *** nmathew- has joined #openstack-infra | 07:33 | |
| *** tesseract has joined #openstack-infra | 07:34 | |
| *** john-davidge has joined #openstack-infra | 07:35 | |
| *** yuanying-alt has quit IRC | 07:35 | |
| *** nmathew has quit IRC | 07:35 | |
| *** yuanying-alt has joined #openstack-infra | 07:36 | |
| *** andreas_s has joined #openstack-infra | 07:37 | |
| *** murkk has quit IRC | 07:38 | |
| *** lcastell has quit IRC | 07:40 | |
| *** jlwhite has quit IRC | 07:40 | |
| *** john-davidge has quit IRC | 07:40 | |
| *** nadya has joined #openstack-infra | 07:42 | |
| vsaienk0 | yolanda, ianw could you please help to merge https://review.openstack.org/#/c/423313 . Thanks in advance! | 07:46 |
| *** e0ne has joined #openstack-infra | 07:48 | |
| openstackgerrit | Merged openstack/diskimage-builder: Update hpssacli to ssacli in proliant-tools element https://review.openstack.org/396504 | 07:48 |
| *** panda|zZ is now known as panda | 07:51 | |
| openstackgerrit | Peter Razumovsky proposed openstack-infra/project-config: Add fuel-ccp-designate repository https://review.openstack.org/425035 | 07:53 |
| *** lennyb has joined #openstack-infra | 07:53 | |
| *** e0ne has quit IRC | 07:57 | |
| *** lennyb has quit IRC | 07:57 | |
| *** yamamoto has joined #openstack-infra | 08:00 | |
| *** e0ne has joined #openstack-infra | 08:01 | |
| *** sree_ has joined #openstack-infra | 08:02 | |
| *** yamamoto has quit IRC | 08:02 | |
| *** sree_ is now known as Guest54535 | 08:02 | |
| *** sree has quit IRC | 08:02 | |
| *** yamamoto has joined #openstack-infra | 08:03 | |
| openstackgerrit | Imran Hayder Malik proposed openstack-infra/jenkins-job-builder: Add depth/noTags options to git shallow-clone https://review.openstack.org/425042 | 08:07 |
| *** lennyb_ has joined #openstack-infra | 08:09 | |
| *** lennyb_ has quit IRC | 08:09 | |
| *** lennyb has joined #openstack-infra | 08:10 | |
| *** yonglihe has joined #openstack-infra | 08:11 | |
| openstackgerrit | Thomas Herve proposed openstack-infra/project-config: Add a non voting gate for Zaqar using Swift https://review.openstack.org/425045 | 08:11 |
| *** kzaitsev_mb has joined #openstack-infra | 08:12 | |
| *** ianychoi has joined #openstack-infra | 08:12 | |
| *** yujunz has joined #openstack-infra | 08:14 | |
| *** sflanigan has quit IRC | 08:17 | |
| *** shardy has joined #openstack-infra | 08:19 | |
| *** shu-mutou is now known as shu-mutou-AFK | 08:22 | |
| *** ralonsoh has joined #openstack-infra | 08:24 | |
| *** dingyichen has quit IRC | 08:27 | |
| *** ssbarnea has joined #openstack-infra | 08:28 | |
| *** e0ne has quit IRC | 08:30 | |
| *** Jeffrey4l_ has joined #openstack-infra | 08:30 | |
| *** umeshksingla has joined #openstack-infra | 08:31 | |
| *** umeshksingla has quit IRC | 08:31 | |
| *** kjackal_ has quit IRC | 08:31 | |
| *** ssbarnea has quit IRC | 08:32 | |
| *** abregman has quit IRC | 08:32 | |
| *** Jeffrey4l has quit IRC | 08:34 | |
| *** john-davidge has joined #openstack-infra | 08:36 | |
| *** lcastell has joined #openstack-infra | 08:37 | |
| *** jlwhite has joined #openstack-infra | 08:39 | |
| *** yuval has quit IRC | 08:44 | |
| *** abregman has joined #openstack-infra | 08:47 | |
| *** amotoki has quit IRC | 08:47 | |
| *** esikachev has joined #openstack-infra | 08:48 | |
| *** sshnaidm|afk is now known as sshnaidm | 08:48 | |
| *** yujunz has quit IRC | 08:50 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: mark redis jobs in trove CI as non-voting https://review.openstack.org/425062 | 08:52 |
| *** askb has quit IRC | 08:52 | |
| *** pgadiya has quit IRC | 08:54 | |
| *** yujunz has joined #openstack-infra | 08:55 | |
| *** jpich has joined #openstack-infra | 08:55 | |
| amrith | hi infra, I need some help with getting https://review.openstack.org/425062 merged as it is currently stalling fixing the trove gate. this change is temporary till I can unblock a logjam in the gate. | 08:55 |
| amrith | AJaeger ^^ | 08:55 |
| *** yujunz-zte has joined #openstack-infra | 08:56 | |
| *** stakeda has quit IRC | 08:56 | |
| *** yujunz has quit IRC | 08:56 | |
| *** tlbr has quit IRC | 08:58 | |
| *** abregman has quit IRC | 08:58 | |
| *** hashar has joined #openstack-infra | 08:58 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config: use the tripleo oooq containers job to gate t-h-t/docker/* https://review.openstack.org/423519 | 08:58 |
| *** rossella_ has joined #openstack-infra | 08:59 | |
| *** zzzeek has quit IRC | 09:00 | |
| *** thorst_ has joined #openstack-infra | 09:00 | |
| *** abregman has joined #openstack-infra | 09:00 | |
| *** zzzeek has joined #openstack-infra | 09:00 | |
| *** claudiub|2 is now known as claudiub | 09:02 | |
| *** dtantsur|afk is now known as dtantsur | 09:02 | |
| *** hichihara has quit IRC | 09:02 | |
| openstackgerrit | Surya Prakash Singh proposed openstack-infra/project-config: Add non-voting coverage job to kolla deliverable https://review.openstack.org/425000 | 09:04 |
| *** martinkopec has joined #openstack-infra | 09:04 | |
| *** thorst_ has quit IRC | 09:05 | |
| *** tlbr has joined #openstack-infra | 09:06 | |
| *** newmember has joined #openstack-infra | 09:08 | |
| *** pgadiya has joined #openstack-infra | 09:09 | |
| *** rvba` is now known as rvba | 09:13 | |
| *** zhurong has quit IRC | 09:14 | |
| *** florianf has joined #openstack-infra | 09:16 | |
| *** jordanP has joined #openstack-infra | 09:16 | |
| lennyb | mordred, pls review again https://review.openstack.org/#/c/424000 'Create mandatory /etc/nodepool for later use' patch | 09:20 |
| *** tqtran has joined #openstack-infra | 09:24 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Fix logging issues for quickstart jobs https://review.openstack.org/422638 | 09:24 |
| *** umeshksingla has joined #openstack-infra | 09:26 | |
| *** mhickey has joined #openstack-infra | 09:27 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Conntainers with multi-nic and net-iso https://review.openstack.org/422448 | 09:27 |
| *** lucas-afk is now known as lucasagomes | 09:27 | |
| *** yujunz-zte has quit IRC | 09:27 | |
| *** tqtran has quit IRC | 09:28 | |
| *** liusheng has quit IRC | 09:29 | |
| *** winggundamth_ has joined #openstack-infra | 09:33 | |
| openstackgerrit | Jordan Pittier proposed openstack-infra/project-config: Add some functional tests to OSPurge https://review.openstack.org/424712 | 09:33 |
| *** dtardivel has joined #openstack-infra | 09:35 | |
| *** winggundamth has quit IRC | 09:35 | |
| *** umeshksingla has quit IRC | 09:35 | |
| *** bkorren has joined #openstack-infra | 09:37 | |
| openstackgerrit | Peter Razumovsky proposed openstack-infra/project-config: Add fuel-ccp-designate repository https://review.openstack.org/425035 | 09:37 |
| *** yamamoto has quit IRC | 09:38 | |
| *** kzaitsev_mb has quit IRC | 09:39 | |
| openstackgerrit | Tomasz Trębski proposed openstack-infra/project-config: Update CI for monasca-log-api https://review.openstack.org/424017 | 09:44 |
| *** rossella_ has quit IRC | 09:47 | |
| *** yujunz has joined #openstack-infra | 09:47 | |
| *** umeshksingla has joined #openstack-infra | 09:47 | |
| *** derekh has joined #openstack-infra | 09:47 | |
| *** rossella_ has joined #openstack-infra | 09:47 | |
| ttx | Some jobs are stuck -- Logs show that the Zuul task exited successfully but the results are not processed | 09:49 |
| *** strigazi_AFK is now known as strigazi | 09:50 | |
| *** umeshksingla has quit IRC | 09:50 | |
| *** erikmwil_ has quit IRC | 09:50 | |
| *** e0ne has joined #openstack-infra | 09:52 | |
| *** abregman has quit IRC | 09:53 | |
| *** erikmwil_ has joined #openstack-infra | 09:53 | |
| *** askb has joined #openstack-infra | 09:58 | |
| *** pgadiya has quit IRC | 10:00 | |
| *** tlbr has quit IRC | 10:02 | |
| *** yujunz has quit IRC | 10:02 | |
| openstackgerrit | Merged openstack-infra/project-config: puppet-openstack: add ocata patches notifs on IRC https://review.openstack.org/424939 | 10:03 |
| openstackgerrit | Merged openstack-infra/project-config: Bump rh1 max-servers to 70 https://review.openstack.org/424822 | 10:04 |
| *** erikmwil_ has quit IRC | 10:05 | |
| *** erikmwi__ has joined #openstack-infra | 10:05 | |
| openstackgerrit | Merged openstack-infra/project-config: Replace ironic-multitest job by ironic-standalone https://review.openstack.org/423313 | 10:06 |
| *** martinkopec has quit IRC | 10:09 | |
| *** yujunz has joined #openstack-infra | 10:09 | |
| *** isaacb_ has quit IRC | 10:10 | |
| openstackgerrit | Merged openstack-infra/project-config: Add magnum job to run tox migration env https://review.openstack.org/424773 | 10:11 |
| *** yujunz has quit IRC | 10:11 | |
| openstackgerrit | Merged openstack-infra/project-config: tripleo/scenario001: add opstools https://review.openstack.org/424710 | 10:11 |
| openstackgerrit | Merged openstack-infra/project-config: Make the ironic-staging-drivers-dsvm job voting https://review.openstack.org/424618 | 10:12 |
| openstackgerrit | Merged openstack-infra/project-config: Update swift functional job list https://review.openstack.org/423508 | 10:12 |
| *** pgadiya has joined #openstack-infra | 10:12 | |
| *** sambetts|afk is now known as sambetts | 10:13 | |
| *** openstackgerrit has quit IRC | 10:17 | |
| *** amotoki has joined #openstack-infra | 10:19 | |
| *** nmathew has joined #openstack-infra | 10:19 | |
| *** Guest88892 has quit IRC | 10:19 | |
| *** openstackgerrit has joined #openstack-infra | 10:20 | |
| openstackgerrit | Antoine Cabot proposed openstack-infra/irc-meetings: Update Watcher team meeting time on odd weeks https://review.openstack.org/425107 | 10:20 |
| *** ociuhandu has joined #openstack-infra | 10:22 | |
| *** nmathew- has quit IRC | 10:23 | |
| *** nmathew- has joined #openstack-infra | 10:24 | |
| *** nmathew- has quit IRC | 10:24 | |
| *** yamamoto has joined #openstack-infra | 10:25 | |
| *** tosky has joined #openstack-infra | 10:25 | |
| *** yamamoto has quit IRC | 10:26 | |
| *** sree has joined #openstack-infra | 10:31 | |
| *** cdent has joined #openstack-infra | 10:31 | |
| *** aarefiev_afk is now known as aarefiev | 10:32 | |
| *** martinkopec has joined #openstack-infra | 10:32 | |
| openstackgerrit | Sergey Kraynev proposed openstack-infra/project-config: Add fuel-ccp-nginx repository https://review.openstack.org/424542 | 10:32 |
| *** Guest54535 has quit IRC | 10:33 | |
| *** umeshksingla has joined #openstack-infra | 10:34 | |
| *** abregman has joined #openstack-infra | 10:34 | |
| *** jpich has quit IRC | 10:35 | |
| *** tlbr has joined #openstack-infra | 10:38 | |
| *** ldnunes has joined #openstack-infra | 10:40 | |
| *** huanxie has quit IRC | 10:45 | |
| *** aidin has joined #openstack-infra | 10:45 | |
| *** tlbr has quit IRC | 10:46 | |
| *** umeshksingla has quit IRC | 10:48 | |
| *** tosky has quit IRC | 10:48 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:49 | |
| *** jordanP has quit IRC | 10:51 | |
| *** sree has quit IRC | 10:53 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Add ceph support to major upgrade job https://review.openstack.org/423383 | 10:53 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Add Ironic support to major upgrade CI https://review.openstack.org/424287 | 10:53 |
| *** sree has joined #openstack-infra | 10:53 | |
| *** aidin has quit IRC | 10:53 | |
| *** jordanP has joined #openstack-infra | 10:54 | |
| *** sree has quit IRC | 10:55 | |
| *** yamahata has quit IRC | 10:56 | |
| *** tlbr has joined #openstack-infra | 10:59 | |
| *** dfflanders has quit IRC | 10:59 | |
| *** newmember has quit IRC | 11:00 | |
| *** thorst_ has joined #openstack-infra | 11:01 | |
| *** jordanP has quit IRC | 11:04 | |
| *** thorst_ has quit IRC | 11:05 | |
| *** isaacb_ has joined #openstack-infra | 11:08 | |
| *** nicolasbock has joined #openstack-infra | 11:09 | |
| ttx | some zuul jobs still being stuck | 11:11 |
| *** panda is now known as panda|afk | 11:12 | |
| *** yamamoto has joined #openstack-infra | 11:18 | |
| *** yamamoto has quit IRC | 11:18 | |
| openstackgerrit | Oleksandr Karpenko proposed openstack-infra/zuul: keepalive_interval for gerrit stream-events connection. https://review.openstack.org/425137 | 11:20 |
| openstackgerrit | Filip Pytloun proposed openstack-infra/project-config: Remove openstack-salt projects https://review.openstack.org/425139 | 11:23 |
| *** chem has quit IRC | 11:24 | |
| *** rfolco has joined #openstack-infra | 11:26 | |
| *** dtantsur is now known as dtantsur|lunch | 11:27 | |
| *** jbernard has quit IRC | 11:27 | |
| *** chem has joined #openstack-infra | 11:28 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test dlrn logs https://review.openstack.org/424354 | 11:28 |
| *** jbernard has joined #openstack-infra | 11:32 | |
| *** ociuhandu has quit IRC | 11:32 | |
| *** yamamoto has joined #openstack-infra | 11:33 | |
| *** yamamoto has quit IRC | 11:34 | |
| skraynev | hi folks, I know, that it's not a good to ask about review, so.... I just say, that it will be really awesome if someone spent a couple minutes and tae a llok https://review.openstack.org/424542 :) | 11:34 |
| *** jkilpatr_ has quit IRC | 11:37 | |
| openstackgerrit | Rabi Mishra proposed openstack-infra/project-config: Specify release job for heat-agents https://review.openstack.org/425142 | 11:37 |
| *** mpaolino_ has joined #openstack-infra | 11:38 | |
| *** wolverineav has joined #openstack-infra | 11:40 | |
| *** anilvenkata has quit IRC | 11:41 | |
| *** mpaolino has quit IRC | 11:42 | |
| *** panda|afk is now known as panda | 11:44 | |
| *** chem has quit IRC | 11:44 | |
| *** chem has joined #openstack-infra | 11:44 | |
| *** kzaitsev_mb has quit IRC | 11:49 | |
| skraynev | ttx: fungi: yolanda: AJaeger: hi folks, I know, that it's not a good to ask about review, so.... I just say, that it will be really awesome if someone spent a couple minutes and take a look https://review.openstack.org/424542 :) sorry for the interruption ;) | 11:53 |
| *** kzaitsev_mb has joined #openstack-infra | 11:53 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Update ironic-multinode and ironic-standalone jobs https://review.openstack.org/425146 | 11:54 |
| *** jkilpatr has joined #openstack-infra | 11:54 | |
| *** dtantsur|lunch is now known as dtantsur | 11:58 | |
| *** anilvenkata has joined #openstack-infra | 12:01 | |
| *** lucasagomes is now known as lucas-hungry | 12:01 | |
| openstackgerrit | Michele Baldessari proposed openstack-infra/tripleo-ci: Collect /var/lib/pacemaker/cib/cib*raw in the tar files from nodes https://review.openstack.org/425151 | 12:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use port list to find missing floating ips https://review.openstack.org/424087 | 12:07 |
| frickler | hickup time for gerrir again? | 12:07 |
| frickler | gerrit even | 12:07 |
| *** anilvenkata has quit IRC | 12:09 | |
| openstackgerrit | Tomasz Trębski proposed openstack-infra/project-config: Update CI for monasca-log-api https://review.openstack.org/424017 | 12:09 |
| *** d0ugal has quit IRC | 12:10 | |
| *** wolverineav has quit IRC | 12:14 | |
| *** dizquierdo has joined #openstack-infra | 12:16 | |
| *** pgadiya has quit IRC | 12:16 | |
| *** florianf has quit IRC | 12:16 | |
| *** raildo has joined #openstack-infra | 12:16 | |
| *** d0ugal has joined #openstack-infra | 12:18 | |
| *** shardy is now known as shardy_lunch | 12:20 | |
| *** anilvenkata has joined #openstack-infra | 12:21 | |
| *** wolverineav has joined #openstack-infra | 12:24 | |
| frickler | infra-root: review.o.o seems to be close to flatlining again, high load + cpu usage, memory usage similar to the state before the last reboots | 12:26 |
| ianychoi | hmm gerrit is slowing again.. +1 frickler :) | 12:26 |
| *** florianf has joined #openstack-infra | 12:27 | |
| *** wolverineav has quit IRC | 12:28 | |
| yolanda | ouch yes, gerrit is terribly slow | 12:30 |
| yolanda | going to take a look | 12:30 |
| stevemar | yolanda: yah, super slow | 12:31 |
| stevemar | yolanda: it's fast again :) | 12:32 |
| yolanda | i didn't touch anything | 12:32 |
| *** ccamacho is now known as ccamacho|lunch | 12:33 | |
| amrith | ttx, yolanda could I get a hand with https://review.openstack.org/425062 please I need it merged to unblock the gate. I need it to get the change to blacklist novaclient merged as there's something broken with redis that I can't fix the novclient change goes in. thx | 12:34 |
| *** wolverineav has joined #openstack-infra | 12:34 | |
| ttx | amrith: I don't have any special power to help you there -- looks like we'll have to wait for more infra people to get up | 12:35 |
| openstackgerrit | Anshul Jain proposed openstack/diskimage-builder: Update to python-brickclient element to accommodate python2/3 changes https://review.openstack.org/425162 | 12:35 |
| amrith | sorry ttx, I thought you were also infra god | 12:35 |
| ttx | I wouldn't trust myself to touch anything :) | 12:36 |
| frickler | stevemar: yolanda: the slowdown isn't completely persistent, but it doesn't look like it is fixed yet, history seems to advise a restart/reboot | 12:36 |
| openstackgerrit | Oleksandr Karpenko proposed openstack-infra/zuul: keepalive_interval for gerrit stream-events connection. https://review.openstack.org/425137 | 12:37 |
| *** vikrant has quit IRC | 12:37 | |
| stevemar | frickler: yeah, one snappy reload gave me false hope | 12:38 |
| *** wolverineav has quit IRC | 12:39 | |
| *** pradk has joined #openstack-infra | 12:40 | |
| *** thorst_ has joined #openstack-infra | 12:44 | |
| yolanda | #status notice Gerrit is going to be restarted due to slow performance | 12:45 |
| openstackstatus | yolanda: sending notice | 12:45 |
| *** sdake has joined #openstack-infra | 12:45 | |
| openstackgerrit | Filip Pytloun proposed openstack-infra/project-config: Remove openstack-salt projects https://review.openstack.org/425139 | 12:45 |
| -openstackstatus- NOTICE: Gerrit is going to be restarted due to slow performance | 12:46 | |
| yolanda | #status notice Gerrit has been successfully restarted | 12:48 |
| *** nmathew- has joined #openstack-infra | 12:48 | |
| openstackstatus | yolanda: finished sending notice | 12:48 |
| openstackstatus | yolanda: sending notice | 12:48 |
| *** isaacb_ has quit IRC | 12:49 | |
| -openstackstatus- NOTICE: Gerrit has been successfully restarted | 12:49 | |
| *** isaacb has joined #openstack-infra | 12:49 | |
| openstackstatus | yolanda: finished sending notice | 12:51 |
| *** nmathew has quit IRC | 12:51 | |
| openstackgerrit | Ben Kero proposed openstack-infra/project-config: Add experimental jobs for TripleO OOOQ Multinode scenario testing https://review.openstack.org/424034 | 12:52 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tripleo: run upgrade job only in Ocata and after https://review.openstack.org/424954 | 12:52 |
| *** wolverineav has joined #openstack-infra | 12:53 | |
| *** nmathew- has quit IRC | 12:55 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Fix logging issues for quickstart jobs https://review.openstack.org/422638 | 12:55 |
| openstackgerrit | Rabi Mishra proposed openstack-infra/project-config: Specify release job for heat-agents https://review.openstack.org/425142 | 12:57 |
| *** sshnaidm is now known as sshnaidm|afk | 12:57 | |
| *** wolverineav has quit IRC | 12:58 | |
| mordred | amrith: +A | 12:59 |
| amrith | thx mordred | 13:00 |
| samueldmq | good morning, Gerrit is looking pretty healthly now, thanks all :) | 13:00 |
| *** lucas-hungry is now known as lucasagomes | 13:00 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use port list to find missing floating ips https://review.openstack.org/424087 | 13:00 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Manage providers in ProviderWorker threads https://review.openstack.org/424808 | 13:01 |
| bkero | EmilienM: regarding your request that the multinode-oooq scenario jobs only run on master, would you recommend modifying these regexes to accomplish that? http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n1611 | 13:02 |
| openstackgerrit | Ben Kero proposed openstack-infra/project-config: Add experimental jobs for TripleO OOOQ Multinode scenario testing https://review.openstack.org/424034 | 13:03 |
| bkero | context: ^ | 13:03 |
| EmilienM | bkero: not only on master but only where it's needed, so do not run it for mitaka, newton | 13:03 |
| *** isaacb_ has joined #openstack-infra | 13:04 | |
| bkero | EmilienM: I think this regex might do that. http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n1593 | 13:04 |
| EmilienM | bkero: see https://review.openstack.org/#/c/424954/ and do the same | 13:05 |
| EmilienM | bkero: no, you missed newton for oooq | 13:05 |
| bkero | Oh okay, need to add newton to that | 13:05 |
| openstackgerrit | Merged openstack-infra/project-config: mark redis jobs in trove CI as non-voting https://review.openstack.org/425062 | 13:05 |
| EmilienM | bkero: do you plan to run oooq multinode on newton? | 13:05 |
| *** isaacb has quit IRC | 13:05 | |
| EmilienM | bkero: don't add newton to zuul/layout.yaml#n1593 | 13:06 |
| bkero | EmilienM: It could be supported, but right now I'm targeting ocata | 13:06 |
| EmilienM | yeah, don't target newton | 13:06 |
| bkero | Right, I won't add newton to that, will make a new directive | 13:06 |
| EmilienM | ++ | 13:06 |
| bkero | Thank you. I just wanted to make sure I was doing the right thing. | 13:06 |
| EmilienM | cool np | 13:07 |
| *** isaacb_ has quit IRC | 13:07 | |
| *** arxcruz has quit IRC | 13:08 | |
| *** isaacb_ has joined #openstack-infra | 13:09 | |
| *** arxcruz has joined #openstack-infra | 13:10 | |
| *** askb has quit IRC | 13:10 | |
| openstackgerrit | Ben Kero proposed openstack-infra/project-config: Add experimental jobs for TripleO OOOQ Multinode scenario testing https://review.openstack.org/424034 | 13:11 |
| bkero | EmilienM: https://review.openstack.org/#/c/424034/9/zuul/layout.yaml line 1608. The regex should cover scenario and non-scenario multinode-oooq jobs | 13:11 |
| EmilienM | bkero: +1 | 13:12 |
| bkero | \o/ | 13:12 |
| * bkero looks forward to getting scenarios implemented in a portable way | 13:13 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use port list to find missing floating ips https://review.openstack.org/424087 | 13:14 |
| EmilienM | bkero: ++ | 13:14 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use port list to find missing floating ips https://review.openstack.org/424087 | 13:16 |
| *** isaacb_ has quit IRC | 13:18 | |
| *** isaacb_ has joined #openstack-infra | 13:19 | |
| *** ccamacho|lunch is now known as ccamacho | 13:19 | |
| *** katkapilatova has joined #openstack-infra | 13:20 | |
| *** sshnaidm|afk is now known as sshnaidm | 13:21 | |
| *** isaacb_ has quit IRC | 13:23 | |
| *** wolverineav has joined #openstack-infra | 13:23 | |
| *** isaacb_ has joined #openstack-infra | 13:24 | |
| *** tqtran has joined #openstack-infra | 13:25 | |
| *** shardy_lunch is now known as shardy | 13:26 | |
| *** ociuhandu has joined #openstack-infra | 13:26 | |
| *** rlandy has joined #openstack-infra | 13:27 | |
| *** tongli has joined #openstack-infra | 13:27 | |
| *** wolverineav has quit IRC | 13:28 | |
| *** wolverineav has joined #openstack-infra | 13:29 | |
| *** mgiles has joined #openstack-infra | 13:30 | |
| *** tqtran has quit IRC | 13:30 | |
| *** nadya has quit IRC | 13:32 | |
| *** zeih has joined #openstack-infra | 13:33 | |
| *** aidin has joined #openstack-infra | 13:35 | |
| mgiles | Hello. It appears there might be a problem with the gate checks right now. I see a lot of queued jobs and nothing seems to be progressing: http://status.openstack.org/zuul/ | 13:35 |
| mgiles | It seems to be affecting most (if not all) projects | 13:35 |
| mgiles | if somebody can take a look, I'd appreciate it | 13:35 |
| *** gordc has joined #openstack-infra | 13:36 | |
| sshnaidm | can somebody help me with periodic jobs? after this patch landed https://review.openstack.org/#/c/424265/ I see only one of periodic jobs ran in http://logs.openstack.org/periodic/ - it's only periodic-tripleo-ci-centos-7-scenario001-multinode, why didn't run another 3 jobs? | 13:37 |
| *** rhallisey has joined #openstack-infra | 13:38 | |
| *** xyang1 has joined #openstack-infra | 13:39 | |
| *** jordanP has joined #openstack-infra | 13:39 | |
| *** isaacb_ has quit IRC | 13:42 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT https://review.openstack.org/424190 | 13:44 |
| *** isaacb has joined #openstack-infra | 13:46 | |
| openstackgerrit | Andreas Scheuring proposed openstack-infra/project-config: Enable RTD job for networking-dpm https://review.openstack.org/425181 | 13:48 |
| *** kgiusti has quit IRC | 13:52 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config: Separate OVB and non-OVB experimental job in check https://review.openstack.org/425184 | 13:53 |
| sshnaidm | trown, EmilienM bnemec wdyt? ^^ | 13:53 |
| EmilienM | sshnaidm: mhh, that's something worth a discussion on openstack-dev imho | 13:54 |
| sshnaidm | EmilienM, on #openstack-dev or ML? | 13:55 |
| EmilienM | sshnaidm: ml | 13:55 |
| sshnaidm | EmilienM, ok | 13:55 |
| trown | sshnaidm: maybe the others will run later? /me has no clue | 13:56 |
| *** ihrachys has joined #openstack-infra | 13:56 | |
| *** kgiusti has joined #openstack-infra | 13:56 | |
| sshnaidm | trown, depends on what people expect when run "check experimental" | 13:56 |
| sshnaidm | I run it only for a few jobs, never from both queues, but others may have different approach | 13:57 |
| openstackgerrit | Oleksandr Karpenko proposed openstack-infra/zuul: keepalive_interval for gerrit stream-events connection. https://review.openstack.org/425137 | 13:58 |
| *** baoli has joined #openstack-infra | 13:58 | |
| *** marst has quit IRC | 13:58 | |
| *** aidin has quit IRC | 13:59 | |
| *** panda is now known as notpython-panda | 13:59 | |
| *** baoli_ has joined #openstack-infra | 14:00 | |
| mnaser | dat queue.. | 14:00 |
| *** mdrabe has joined #openstack-infra | 14:01 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 14:01 |
| *** bhunter71 has quit IRC | 14:01 | |
| *** dmsimard|off is now known as dmsimard | 14:02 | |
| *** jcoufal has joined #openstack-infra | 14:03 | |
| *** baoli has quit IRC | 14:03 | |
| Shrews | infra-core: fyi, zuul is no longer processing jobs | 14:04 |
| *** notpython-panda is now known as panda | 14:05 | |
| *** srobert has joined #openstack-infra | 14:05 | |
| *** srobert has quit IRC | 14:05 | |
| *** srobert has joined #openstack-infra | 14:06 | |
| *** rkukura has joined #openstack-infra | 14:07 | |
| *** pradk has quit IRC | 14:11 | |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack-infra/project-config: Add experimental job for ironic's ansible-deploy https://review.openstack.org/415024 | 14:11 |
| *** tlian has joined #openstack-infra | 14:12 | |
| *** zzzeek has quit IRC | 14:12 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Manage providers in ProviderWorker threads https://review.openstack.org/424808 | 14:13 |
| *** Goneri has joined #openstack-infra | 14:13 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Update Watcher team meeting time on odd weeks https://review.openstack.org/425107 | 14:14 |
| *** zzzeek has joined #openstack-infra | 14:14 | |
| *** sdague has joined #openstack-infra | 14:15 | |
| *** matrohon has joined #openstack-infra | 14:15 | |
| *** matt-borland has joined #openstack-infra | 14:15 | |
| *** dave-mccowan has joined #openstack-infra | 14:17 | |
| *** jamesdenton has joined #openstack-infra | 14:17 | |
| *** diga has quit IRC | 14:20 | |
| *** dprince has joined #openstack-infra | 14:21 | |
| *** psachin has quit IRC | 14:22 | |
| *** portdirect has joined #openstack-infra | 14:24 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Replace multinode playbook with default quickstart playbook https://review.openstack.org/424683 | 14:26 |
| *** gouthamr has joined #openstack-infra | 14:30 | |
| *** winggundamth_ has quit IRC | 14:31 | |
| *** esikachev has quit IRC | 14:33 | |
| fungi | starting to dig in now, and wow we've got a ton of nodes ostensibly in a ready state | 14:33 |
| *** fguillot has joined #openstack-infra | 14:33 | |
| fungi | as well as jobs running for 11+ hours | 14:34 |
| fungi | ouch, here's one that's been running almost 13 | 14:34 |
| *** tlbr has quit IRC | 14:35 | |
| fungi | zl01 was rebooted 11 hours ago? | 14:35 |
| *** Swami has joined #openstack-infra | 14:36 | |
| fungi | hrm, two open rackspace trouble tickets for us | 14:37 |
| fungi | "...the host your cloud server 'zl01.openstack.org' resides on alerted our monitoring systems at 03:32 UTC..." | 14:37 |
| bkero | ouch | 14:38 |
| bkero | Didn't something similar to this happen about two weeks ago? | 14:39 |
| fungi | i don't recall. maybe the infra status log remembers | 14:39 |
| bkero | Just dug through irc logs. Looks like that was nodepool. | 14:41 |
| andreykurilin | fungi: hi! Does it possible to release bindep? | 14:41 |
| andreykurilin | our users need rhel support:( | 14:41 |
| bkero | That was nodepool host not responding to ssh connections. Maybe this is different. | 14:41 |
| bkero | yolanda: ^ | 14:41 |
| fungi | andreykurilin: maybe when we're not neck-deep in an incident | 14:41 |
| andreykurilin | fungi: oh.. sure | 14:42 |
| bkero | check queue is up to 217 | 14:42 |
| *** tongli has quit IRC | 14:42 | |
| fungi | okay, i count ~780 nodepool nodes assigned to zl01 and in a ready state for >3 hours | 14:43 |
| bkero | Wow that's a lot of ready-state nodes | 14:43 |
| openstackgerrit | James Page proposed openstack-infra/project-config: Add snap for openstackclient tools https://review.openstack.org/425214 | 14:43 |
| fungi | some as long as 11 hours | 14:43 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Update ironic-multinode and ironic-standalone jobs https://review.openstack.org/425146 | 14:43 |
| *** digvijay2016 has quit IRC | 14:44 | |
| fungi | i'm going to restart nodepoold first because i suspect it needs to reconnect to zeromq for zl01 | 14:44 |
| *** digvijay2016 has joined #openstack-infra | 14:44 | |
| bkero | Nodepool is responding on ssh, so it's not the same as last time | 14:45 |
| bkero | Looks like it's still doing ethernet traffic | 14:45 |
| *** mrtenio has joined #openstack-infra | 14:46 | |
| fungi | yeah, i expect the only issue with nodepool is that it has a hung zeromq listener it thinks is connected to zl01 | 14:46 |
| bkero | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=4683&rra_id=all | 14:46 |
| bkero | There seems to be a busy CPU state and then a cut-out of logs from zl1 about 11 hours ago | 14:47 |
| fungi | tcp 0 0 nodepool.openstac:41337 zl01.openstack.org:8888 ESTABLISHED | 14:48 |
| fungi | that's the nodepool side of the socket | 14:48 |
| bkero | loadavg spiked up to ~47 | 14:48 |
| fungi | and yeah, zl01 doesn't show nodepool.o.o connected to 8888/tcp at all | 14:48 |
| bkero | Does zl1 have an open connection on src port 41337? | 14:48 |
| bkero | bleh | 14:49 |
| fungi | probably if there's a way to get keepalives going on for teh zeromq connection it would solve this particular corner case | 14:49 |
| fungi | because nodepool should reconnect _if_ it knew the connection was dead | 14:49 |
| fungi | however force-disconnecting hung established tcp sockets is tough | 14:50 |
| fungi | so i'm sticking with my nodepoold reboot solution for now | 14:50 |
| *** mrtenio has quit IRC | 14:50 | |
| *** matrohon_ has joined #openstack-infra | 14:50 | |
| bkero | There are some packages out there to kill tcp connectoins, but they're all nasty, kernel-specific, and aren't packaged in distros. | 14:51 |
| bkero | Better to reboot :) | 14:51 |
| fungi | yeah, i'm aware. we've tried several over the years to deal with similar situations | 14:51 |
| fungi | sometimes i can get them to work with much futzing | 14:51 |
| bkero | ZMQ_TCP_KEEPALIVE: Override SO_KEEPALIVE socket option | 14:51 |
| Shrews | zmq gone in v3, so yay for that | 14:51 |
| fungi | indeed | 14:51 |
| bkero | http://api.zeromq.org/3-2:zmq-setsockopt although I'm not sure the application using 0mq exposes that knob | 14:52 |
| fungi | once nodepoold has settled for a few minutes i'll start deleting stale ready nodes | 14:52 |
| *** isaacb has quit IRC | 14:52 | |
| *** EricGonczer_ has joined #openstack-infra | 14:53 | |
| *** matrohon has quit IRC | 14:53 | |
| fungi | er, i said reboot above, i of course meant restart | 14:53 |
| *** isaacb has joined #openstack-infra | 14:54 | |
| fungi | though graceful nodepool restart was taking too long and is pretty pointless, so i ended up killing the nodepoold process and then starting it again once i confirmed it was no longer running | 14:54 |
| *** hongbin has joined #openstack-infra | 14:55 | |
| *** matrohon__ has joined #openstack-infra | 14:55 | |
| fungi | takes a while for nodepoold to finish starting | 14:56 |
| fungi | lots of "Loading configuration...Zookeeper client does not need to be updated...Gearman client does not need to be updated" over and over in the debug log | 14:56 |
| *** marst has joined #openstack-infra | 14:57 | |
| fungi | and the main log is basically silent after it set all building nodes to delete | 14:57 |
| *** matrohon_ has quit IRC | 14:57 | |
| fungi | it hasn't gotten to the point where it's established any zeromq connections to the launchers yet | 14:57 |
| bkero | I'm sure our cloud providers love us. | 14:57 |
| fungi | this log loop looks like a 10-second pulse. is this regular idle behavior for nodepoold? | 14:59 |
| fungi | we're coming up on 10 minutes of silence in the main log and nothing but these three messages over and over in the debug log | 15:01 |
| fungi | could it be caught in some sort of polling loop? | 15:01 |
| mnaser | i htink so fungi | 15:02 |
| mnaser | https://github.com/openstack-infra/nodepool/blob/master/nodepool/nodepool.py#L1269-L1278 | 15:02 |
| mnaser | updateConfig calls reconfigureZooKeeper which outputs that message if running == configured | 15:02 |
| mnaser | but it looks like that's normal behaviour | 15:03 |
| fungi | for reference, the last nodepoold restart was on january 10 | 15:03 |
| *** esikachev has joined #openstack-infra | 15:03 | |
| fungi | prior to the restart just now | 15:03 |
| *** dtantsur is now known as dtantsur|brb | 15:04 | |
| mnaser | fungi: i'd strace the process by now | 15:04 |
| mnaser | maybe it's waiting on an fd/socket, lsof might help find out which/where | 15:04 |
| fungi | since it seems to be some sort of livelock this will likely be a fun strace to sift through | 15:04 |
| fungi | hrm, the main python process seems to be stuck at a "pause(" | 15:05 |
| *** rbuzatu has quit IRC | 15:06 | |
| fungi | ps shows no child processes for that pid either | 15:06 |
| *** eharney has joined #openstack-infra | 15:06 | |
| fungi | so maybe this is a deadlock after all and the periodic log messages are coming from the deleter or something | 15:06 |
| mnaser | ps -T will list threads but i dont think that would be much help | 15:07 |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci: Allow to use an RDO review to fix a packaging issue https://review.openstack.org/388791 | 15:08 |
| fungi | i also don't see our deleter or launcher daemons running on the server | 15:09 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Updated serialization expand for team members * added groups expand https://review.openstack.org/425227 | 15:10 |
| mwhahaha | i don't suppose there's a way to manually poke at a change stuck in the gate? https://review.openstack.org/#/c/424936/ according to the status page is stuck for the last 12 hours and i'm not sure the running jobs are still running | 15:10 |
| *** jaosorior has joined #openstack-infra | 15:10 | |
| fungi | mwhahaha: we're in the process of recovering from an outage in the provider donating our control plane. we'll have things running again soon | 15:10 |
| mwhahaha | pl | 15:11 |
| mwhahaha | er ok | 15:11 |
| openstackgerrit | Merged openstack-infra/openstackid-resources: Updated serialization expand for team members * added groups expand https://review.openstack.org/425227 | 15:11 |
| fungi | yeah, the deleter and launcher logs are completely silent since i restarted the scheduler | 15:12 |
| fungi | i'll get them going again and see if that makes any difference | 15:12 |
| *** sdague has quit IRC | 15:12 | |
| mnaser | fungi if there is many processes spawning it might be because scheduler is launched with --no-launches | 15:12 |
| mnaser | https://github.com/openstack-infra/nodepool/blob/54bd6b86f1ccdcf8ac3e980896b44fdbd32082c8/nodepool/nodepool.py#L1281-L1282 | 15:13 |
| mnaser | id imagine something like this is happening | 15:13 |
| *** esikachev has quit IRC | 15:13 | |
| fungi | mnaser: yeah, we run separate processes for scheduler, launcher and deleter. it didn't occur to me that restarting the scheduler would kill off the other two | 15:14 |
| *** esikachev has joined #openstack-infra | 15:14 | |
| fungi | they seem active now | 15:15 |
| *** rbrndt has joined #openstack-infra | 15:15 | |
| fungi | and zeromq sockets are established to all our zl* servers again | 15:15 |
| fungi | i'll start cleaning up stale ready nodes next | 15:16 |
| openstackgerrit | Victor Morales proposed openstack-infra/elastic-recheck: Add query for neutron bug 1656386 https://review.openstack.org/425232 | 15:16 |
| openstack | bug 1656386 in neutron "Memory leaks on Neutron jobs" [Critical,Confirmed] https://launchpad.net/bugs/1656386 - Assigned to Darek Smigiel (smigiel-dariusz) | 15:16 |
| *** timello has quit IRC | 15:17 | |
| * mordred waves to fungi and mnaser from an airplane | 15:17 | |
| mnaser | fungi zl01 starting deleting a lot so i think that took care of it | 15:18 |
| mnaser | its up to ~20 or so | 15:18 |
| bkero | mordred: aren't you supposed to be in Brno? | 15:18 |
| mnaser | mordred: o/ | 15:18 |
| fungi | mnaser: right, i've got a loop going now blowing out ready nodes older than 3 hours | 15:18 |
| *** esikachev has quit IRC | 15:19 | |
| *** mhickey has quit IRC | 15:19 | |
| mordred | bkero: I'm often supposed to be many places | 15:19 |
| bkero | mordred: have you given any thought to a mordredbot telepresence robot? | 15:20 |
| fungi | my remaining concern, cleanup aside, is that i don't know if zuul's scheduler will figure out whether the jobs running through zl01 at the time it vanished need restarting | 15:20 |
| mnaser | http://grafana.openstack.org/dashboard/db/nodepool used nodes is climbing for zl01 | 15:21 |
| fungi | i have a sinking suspicion the only solution there is to dump the check/gate queues and restart the main zuul daemon | 15:21 |
| *** arxcruz has quit IRC | 15:23 | |
| Shrews | fungi: about to head out, but yes, those log messages are normal | 15:23 |
| mnaser | anyways: i'll try to chime in if anyone needs help :> also, I know we've discussed this a while back but we're always still open to host control plane infra. for openstack (and then hopefully at some point get back to providing CI infra) | 15:23 |
| Shrews | fungi: the config is continuously re-read to get changes | 15:23 |
| fungi | mnaser: Shrews: thanks! | 15:24 |
| fungi | mnaser: yep, we still want to start moving some stuff there too, we've just been sort-handed recently | 15:25 |
| *** EricGonczer_ has quit IRC | 15:25 | |
| *** zz_dimtruck is now known as dimtruck | 15:26 | |
| mordred | fungi: dude. we should sort everyone's hands | 15:26 |
| *** EricGonczer_ has joined #openstack-infra | 15:26 | |
| *** arxcruz has joined #openstack-infra | 15:27 | |
| fungi | ouch, totally missed my typo there | 15:27 |
| *** burgerk has joined #openstack-infra | 15:27 | |
| *** rajinir has joined #openstack-infra | 15:27 | |
| *** baoli_ has quit IRC | 15:29 | |
| *** mpaolino_ has quit IRC | 15:30 | |
| *** mtanino has joined #openstack-infra | 15:30 | |
| *** markvoelker has quit IRC | 15:31 | |
| *** markvoelker has joined #openstack-infra | 15:32 | |
| *** timello has joined #openstack-infra | 15:33 | |
| jeblair | fungi: if zl01 disappeared in a way that gearman thinks it was still connected, it's probably indefinitely stuck | 15:35 |
| fungi | jeblair: ugh. well, i'll go ahead and dump the check/gate and get it restarted | 15:35 |
| *** pradk has joined #openstack-infra | 15:36 | |
| *** markvoelker has quit IRC | 15:36 | |
| fungi | losing everything in post this close to final library releases is pretty unfortunate, but probably not much we can do about that | 15:36 |
| *** esikachev has joined #openstack-infra | 15:37 | |
| jeblair | fungi: would it be worth trying to 'kill' that connection? | 15:37 |
| *** Hal has joined #openstack-infra | 15:38 | |
| *** Hal is now known as Guest55936 | 15:38 | |
| fungi | probably not. i've had very little luck doing that on trusty servers | 15:39 |
| fungi | and i've already stopped zuul anyway | 15:39 |
| fungi | it's coming back up now | 15:39 |
| *** jschwarz is now known as jschwarz|brb | 15:41 | |
| fungi | takes a while for zuul-server to get to the point where it writes anything into its debug log | 15:42 |
| fungi | been several minutes already | 15:43 |
| fungi | there it is finally | 15:43 |
| fungi | that was nearly 5 minutes of silence at process startup | 15:43 |
| fungi | enqueuing changes now | 15:44 |
| mnaser | fungi: aha about sort handing -- no worires | 15:45 |
| *** zeih has quit IRC | 15:45 | |
| *** Swami_ has joined #openstack-infra | 15:46 | |
| robcresswell | Are projects allowed to make use of Infra's post-merge hooks? I'm sort of thinking aloud here, but I was wondering if Horizon could run a post-merge job that creates a 'dist/' folder like most JS libs do. This might potentially allow us to work around a lot of issues, like the reasoning behind XStatic packages. | 15:48 |
| robcresswell | Sort of like the job that creates tarballs. | 15:48 |
| *** jschwarz|brb is now known as jschwarz | 15:48 | |
| *** Swami has quit IRC | 15:49 | |
| AJaeger | robcresswell: where would that dist folder get created? | 15:50 |
| fungi | robcresswell: create a dist folder where after changes merge? | 15:51 |
| *** Sukhdev has joined #openstack-infra | 15:51 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Tell geard to use keepalives https://review.openstack.org/425248 | 15:51 |
| jeblair | fungi: ^ | 15:51 |
| robcresswell | Inside the Horizon tree | 15:51 |
| dmsimard | mordred: just to get a general idea, how far away are you into eliminating *client requirements from shade ? | 15:51 |
| robcresswell | So you ship the compressed JS etc, rather than having it compressed locally by deployments. In theory. | 15:52 |
| fungi | robcresswell: you mean a job that would propose a change to update contents of a dist subtree of your git repository when changes merge to your git repository? | 15:52 |
| mordred | dmsimard: I'm making good progress -I've removed glanceclient and swiftclient | 15:52 |
| fungi | that seems circular | 15:52 |
| *** mhickey has joined #openstack-infra | 15:53 | |
| mordred | dmsimard: I'm about to write a doc/spec describing how people can help if it's a thing they're interested in accelerating | 15:53 |
| mordred | dmsimard: (it's fairly mechanical) | 15:53 |
| fungi | robcresswell: also checking generated content into revision control is waaay unsanitary | 15:53 |
| *** sdake_ has joined #openstack-infra | 15:53 | |
| *** digvijay2016 has quit IRC | 15:53 | |
| dmsimard | mordred: neat, thanks for the update -- it's especially because we're getting a lot of requests to package shade in RDO but it's a special beast in terms of requirements, it'd be challenging to package it due to client requirements in our typical stable repositories | 15:54 |
| robcresswell | fungi: It's a pretty commonly done thing. Most JS libs for example have a source and dist, where the dist is just generated (compressed/minified) version of the source. | 15:54 |
| fungi | robcresswell: we try to steer people toward any other solution. if you're considering checking generated content into revision control, you're probably looking at it wrong | 15:54 |
| AJaeger | robcresswell: you could publish the generated content to tarballs.o.o instead | 15:55 |
| fungi | we can publish generated content to other places outside revision control much more cleanly | 15:55 |
| fungi | and in ways that won't result in wasteful busywork of reviewers needing to rubber-stamp a generated change every time another change merges to the same repo | 15:55 |
| AJaeger | fungi, seems we think alike today - and I'll have to leave now, so don't worry about me becoming silent ;) | 15:55 |
| jlvillal | Any known issue with paste.openstack.org? It doesn't seem to connect for me. | 15:55 |
| robcresswell | fungi: My thinking was along the lines of this https://github.com/jquery/jquery/blob/3.1.1/dist/jquery.min.js | 15:56 |
| *** sdake has quit IRC | 15:56 | |
| *** dtantsur|brb is now known as dtantsur | 15:56 | |
| robcresswell | Which is just generated, checked in content? | 15:56 |
| fungi | jlvillal: sometimes its db query socket gets timed out from the trove end and it takes a minute to realize it needs to drop the dead connection and reestablish. taking a look now | 15:56 |
| *** xarses has joined #openstack-infra | 15:57 | |
| fungi | robcresswell: eek, frightening. people use that? | 15:57 |
| jlvillal | fungi, Thanks :) | 15:57 |
| fungi | i've heard of jquery before, so i guess they do | 15:57 |
| mordred | dmsimard: yup. that's why I';m working on the client-ectomy so hard | 15:57 |
| robcresswell | fungi: Indeed. It's pretty common practice in JS-land. | 15:57 |
| dmsimard | <3 | 15:57 |
| *** xarses_ has joined #openstack-infra | 15:57 | |
| fungi | though most of the jquery discussion i've seen has mostly been on debian mailing lists about finding ways to strip out generated content and properly rebuild those files at deployment time | 15:58 |
| mordred | fungi: so - I hestitate to mention this ... | 15:58 |
| *** isaacb has quit IRC | 15:58 | |
| mordred | but I have a cantrip for this in the oaktree repo - since golang grpc code _requires_ checking generated content into git | 15:58 |
| fungi | jlvillal: it finally pulled up a paste for me, and is responding quickly now, so seems to have reestablished its db socket | 15:59 |
| *** abregman has quit IRC | 15:59 | |
| robcresswell | fungi: So Debian package the JS files themselves and link to a single copy right? I've spoken with zigo a little about packaging. | 15:59 |
| jlvillal | fungi, Great! Thanks. | 15:59 |
| mordred | fungi: the approach I took isn't automation of creating the generated content - it's a gate job that generates content from source and verifies that doing so does not change the copy checked in | 15:59 |
| fungi | robcresswell: right, though they also don't package the prebuilt minified/browserified files. they rebuild them from the original source | 16:00 |
| mordred | fungi: so it's encumbent on the developer to generate the content and commit it with the changes to the source code - but the gate job ensures both that they do so and that the content IS actually generated from the source | 16:00 |
| mordred | so you can be somewhat secure in understanding what the blobs of crud are | 16:00 |
| fungi | mordred: interesting approach. i agree assuring reproducible builds is better than nothing | 16:00 |
| *** abregman has joined #openstack-infra | 16:01 | |
| *** xarses has quit IRC | 16:01 | |
| robcresswell | mordred: So the generated content would be submitted along with the source modification? | 16:01 |
| mordred | robcresswell: yes. and the gate job will fail if the two do not match | 16:02 |
| robcresswell | And a gate test generating it too, and diffing it or something? | 16:02 |
| robcresswell | Ah, interesting. | 16:02 |
| mordred | yah. runs the generation and then diffs | 16:02 |
| mordred | if the diff is non-zero - fail | 16:02 |
| clarkb | I think the approach taken by storyboard was to publish built artifacts elsewhere (tarballs and maybe npm?) ratherthan check directly into the repo | 16:03 |
| openstackgerrit | Solio Sarabia proposed openstack-infra/devstack-gate: WIP/DNM: Test new repo ironic-tempest-plugin https://review.openstack.org/424870 | 16:03 |
| mordred | http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/oaktree.yaml#n38 fwiw | 16:03 |
| *** sdague has joined #openstack-infra | 16:03 | |
| *** shamail has joined #openstack-infra | 16:04 | |
| robcresswell | mordred: Thanks | 16:04 |
| mordred | but I agree that publication of tarballs, such as storyboard does, to somewhere like npm, would be preferrable if possible | 16:04 |
| *** martinkopec has quit IRC | 16:05 | |
| AJaeger | clarkb, mordred : Won't that cause problems with merges? Whouldn't this serialize all the merges? | 16:05 |
| *** derekh has quit IRC | 16:05 | |
| fungi | right, the idea being that traditional linux distros don't care about the generated content (would even prefer it weren't in the source tree at all) and npm consumers can be satisfied by continuous publication | 16:05 |
| clarkb | AJaeger: yes oaktrees approach would serialize any changes to the protobuf definitions. Likely less an issue than a js project | 16:05 |
| mordred | AJaeger: yup. it makes changing things that change the generated code much harder to land :) - it's also _definitely_ a last resort approach | 16:05 |
| *** rbuzatu has joined #openstack-infra | 16:06 | |
| *** gongysh has quit IRC | 16:07 | |
| robcresswell | I'm just thinking about how to improve the packaging process in Horizon. XStatic is a serious hindrance. Any modification to our dependencies requires pulling the source, reuploading it as XStatic, getting that reviewed, released, and then finally updating u-c/requirements. Whereas in Python-land, you can just submit a u-c patch immediately, because of PyPI. | 16:07 |
| robcresswell | Ideally we'd just pull all our build dependencies from NPM, but there are issues with connectivity and OS packages. | 16:07 |
| robcresswell | Anyway, thanks for the discussion :) | 16:07 |
| *** anilvenkata has quit IRC | 16:07 | |
| clarkb | robcresswell: issues with connectivity and OS packages? | 16:08 |
| clarkb | (I thought the issue was more distros didn't want to deal with npm) | 16:08 |
| mordred | robcresswell: I fully suport replacing xstatic with not-xstatic | 16:08 |
| robcresswell | clarkb: My understanding on it is pretty poor, but as I understand it you should be able to build Horizon entirely with system packages, which is where XStatic packages come in. | 16:09 |
| robcresswell | and also, the general JS hatred. | 16:09 |
| mordred | clarkb: the distros actually backed off of that position 3 cycles ago or so | 16:09 |
| robcresswell | s/hatred/dislike :) | 16:09 |
| mordred | but we were already down the xstatic road so last I heard nobody wanted to spend the effort to retool | 16:10 |
| *** rbuzatu has quit IRC | 16:11 | |
| clarkb | mordred: gotcha | 16:11 |
| robcresswell | It's a pretty sizeable bottleneck for us. I'm spending a big chunk of each cycle just repackaging JS files :/ | 16:11 |
| openstackgerrit | Filip Pytloun proposed openstack-infra/project-config: Retire openstack-salt, moving to github.com/salt-formulas https://review.openstack.org/425257 | 16:11 |
| *** isaacb has joined #openstack-infra | 16:12 | |
| clarkb | robcresswell: I think from our perspective (us being infra/openstack) we want to communicate as best as possible what the distros need to package. Not depend on them necessarily having packaged everything already for us | 16:12 |
| openstackgerrit | Filip Pytloun proposed openstack-infra/project-config: Remove openstack-salt projects https://review.openstack.org/425139 | 16:12 |
| clarkb | robcresswell: in the past the distros have said communicating via npm tooling is not what they want (but apparently they relaxed on that more recently) | 16:12 |
| robcresswell | clarkb: Absolutely, I'm all for putting the packagers ease of consumption ahead of "well this is nice for the developers" | 16:13 |
| robcresswell | My hope is sometime soon we can manage something that improves the situation for both sides, though :) | 16:13 |
| openstackgerrit | Filip Pytloun proposed openstack-infra/project-config: Remove openstack-salt projects https://review.openstack.org/425139 | 16:14 |
| *** mdrabe has quit IRC | 16:15 | |
| fungi | i expect as long as we can provide distro packagers with pristine sources for the javascript parts and a means of configuring horizon to use them wherever they've been installed on the system, then the distros will be happy | 16:15 |
| fungi | and we could at the same time start publishing minified/browserified packages of those things to npm as well | 16:15 |
| fungi | and that wouldn't necessitate checking the minified/browserified versions back into the upstream source trees | 16:16 |
| robcresswell | fungi: Understood. I'll give it some more thought and see if I can come up with a more concrete plan. Might be a nice discussion point for Horizon at the PTG. | 16:17 |
| robcresswell | Thanks everyone | 16:17 |
| mordred | robcresswell: yah. and might e a good session for some of us to come sit in on | 16:17 |
| *** markvoelker has joined #openstack-infra | 16:17 | |
| mordred | robcresswell: so give us a heads up if you do decide to put it on your agenda | 16:17 |
| robcresswell | mordred: Will do :) | 16:17 |
| *** armax has joined #openstack-infra | 16:18 | |
| *** rbuzatu has joined #openstack-infra | 16:18 | |
| fungi | quite a lot of the infra team will be at the ptg for the full week, and are done with infra-specific time after tuesday | 16:18 |
| *** markvoelker_ has joined #openstack-infra | 16:18 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test with scheduler hints https://review.openstack.org/378040 | 16:18 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add feature testing matrix to readme https://review.openstack.org/399269 | 16:18 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add support for testing predictable placement https://review.openstack.org/378014 | 16:18 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test hostname map https://review.openstack.org/378017 | 16:18 |
| *** knangia has joined #openstack-infra | 16:18 | |
| robcresswell | Horizon also occupies the cross-project days (mon/tue), but that shouldn't prevent discussion. Even if its just at a bar or something. | 16:19 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Deploy simple ethercalc server https://review.openstack.org/424800 | 16:19 |
| clarkb | fungi: jeblair ^ now updated to use digited fqdn | 16:19 |
| fungi | thanks | 16:20 |
| jeblair | oh, right, forgot about that :) | 16:20 |
| *** sneti has joined #openstack-infra | 16:21 | |
| *** mdrabe has joined #openstack-infra | 16:21 | |
| *** markvoelker has quit IRC | 16:22 | |
| clarkb | jeblair: reading redis docs I haev confirmed that they replace the snapshot file atomically using rename after writing the new snapshot to a temp destination | 16:23 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh https://review.openstack.org/395813 | 16:23 |
| clarkb | jeblair: so should be safe to copy an existing file at any point in time (which is what bup will do for us) | 16:23 |
| jeblair | cool | 16:23 |
| *** adrianofr_ has joined #openstack-infra | 16:23 | |
| clarkb | now I just need to double check the server configs as produced by this redis puppet module to make sure it is producing snapshots and we should be good to add bup | 16:23 |
| *** Guest55936 has quit IRC | 16:25 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job https://review.openstack.org/419529 | 16:25 |
| *** Hal has joined #openstack-infra | 16:25 | |
| *** Hal is now known as Guest70394 | 16:25 | |
| *** Guest70394 has quit IRC | 16:26 | |
| clarkb | jeblair: http://paste.openstack.org/show/596479/ is how snapshotting is configured. So we will write a snapshot to disk every 15 minutes if at least one change has been made, every 5 minutes if at least 10 changes have been made, and every minute if at least 10k changes have been made | 16:26 |
| clarkb | and that goes into /var/lib/redis/dump.rdb, so should be good for buping | 16:27 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use port list to find missing floating ips https://review.openstack.org/424087 | 16:27 |
| *** zul has quit IRC | 16:28 | |
| *** zul has joined #openstack-infra | 16:29 | |
| *** annegentle has joined #openstack-infra | 16:29 | |
| *** EricGonczer_ has quit IRC | 16:29 | |
| fungi | clarkb: i wish i'd thought about buying an ethercalc.o.o cert last week. i assume we're going to need one? | 16:30 |
| clarkb | fungi: yeah, sorry I should've mentioned it. We could run it over http, but I was keeping this as close to etherpad as possible and that has a forced http to https redirect | 16:31 |
| fungi | np, i'll get that going in a bit | 16:31 |
| clarkb | thanks | 16:31 |
| * mordred waves at all of the people in Quebec as he flies over them | 16:32 | |
| fungi | continuing to clean up more of the stale ready/used nodes from before the zuul restart | 16:33 |
| *** EricGonczer_ has joined #openstack-infra | 16:33 | |
| *** morgabra has quit IRC | 16:36 | |
| jeblair | clarkb: cool, that sounds good :) | 16:37 |
| *** mgiles has left #openstack-infra | 16:38 | |
| *** radez has joined #openstack-infra | 16:39 | |
| *** rbuzatu has quit IRC | 16:39 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test dlrn logs https://review.openstack.org/424354 | 16:39 |
| clarkb | fungi: not sure if you saw but somewhere in last nights scrollback was talk about how kolla jobs are downloading 3GBs of artifacts from tarballs.o.o now. Tarballs is the same server as logs.o.o, may explain why the network is pegged there | 16:39 |
| fungi | clarkb: oh, got it. yeah we'd suggested that we should put whatever stuff they need on the mirrors instead. that may help | 16:40 |
| *** abregman has quit IRC | 16:40 | |
| jeblair | easist way to do that may be to move tarball publishing to afs | 16:42 |
| fungi | we've wanted that for a while anyway | 16:45 |
| *** bhunter71 has joined #openstack-infra | 16:47 | |
| jeblair | (note that first-download times from mirrors are still pretty slow, so this isn't a great idea for something that changes every commit, but should be good for something that changes every ~day) | 16:48 |
| *** shamail has quit IRC | 16:48 | |
| *** kzaitsev_mb has quit IRC | 16:52 | |
| *** tphummel has joined #openstack-infra | 16:53 | |
| *** andreas_s has quit IRC | 16:53 | |
| *** katkapilatova has left #openstack-infra | 16:54 | |
| *** tonytan4ever has joined #openstack-infra | 16:56 | |
| *** markvoelker_ has quit IRC | 16:59 | |
| *** markvoelker has joined #openstack-infra | 16:59 | |
| *** jordanP has quit IRC | 17:00 | |
| jeblair | fungi: what's your procedure for deleting ready nodes? and is it in process now? | 17:01 |
| fungi | jeblair: nope. i noticed i picked an incorrect timeframe and removed some used nodes from just after the zuul restart | 17:02 |
| fungi | as opposed to just before | 17:02 |
| jeblair | fungi: okay. i see 173 that have > 10 hour ready times. those should be safe to delete, yeah? | 17:03 |
| *** markvoelker has quit IRC | 17:03 | |
| clarkb | fwiw my typical process is do a listing sorted by age, then looking at the timestamps determine where teh cutoff is and manually edit the file to remoev anything after the cutoff, then clear out all but the ids, then do a cat | xargs | 17:03 |
| fungi | ahh, yep. i forgot to look for any >10 hours old. i can get them now | 17:03 |
| jeblair | fungi: i'll get them | 17:03 |
| clarkb | (its a little bit manual, but gives me a nice sanity check of knowing I am not deleting anything too new) | 17:03 |
| fungi | cool, thanks | 17:03 |
| *** panda is now known as panda|bbl | 17:04 | |
| fungi | was matching on the nodepool timestamp strings like 00:0[^01] | 17:04 |
| jeblair | that 'splains it. :) | 17:04 |
| fungi | which would have completely missed those >10 hours, yeah | 17:04 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tripleo: improve scenario001 & 002 coverage https://review.openstack.org/425287 | 17:05 |
| *** dizquierdo has quit IRC | 17:06 | |
| *** Jeffrey4l_ has quit IRC | 17:06 | |
| *** nadya has joined #openstack-infra | 17:07 | |
| *** isaacb has quit IRC | 17:07 | |
| clarkb | ianychoi: good morning. When you are around I'd like to discuss https://review.openstack.org/#/c/423367/ with you. It will upgrade the puppet wildfly module that we use in order to support wildfly 10 on translate-dev, but this same wildfly module is shared with the production server running wildfly 9. So there is a small risk we can impact translate.openstack.org and wanted your input on that before | 17:07 |
| clarkb | I go ahead and update the puppet module | 17:07 |
| *** Hal has joined #openstack-infra | 17:07 | |
| clarkb | ianychoi: happy to provide more details too, just let me know :) | 17:07 |
| *** Hal is now known as Guest36770 | 17:08 | |
| *** pfallenop has quit IRC | 17:09 | |
| jeblair | done. and i'm deleting a 4 day old 3 node just in case. :) | 17:10 |
| *** nadya has quit IRC | 17:12 | |
| *** nadya has joined #openstack-infra | 17:12 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job with MySQL https://review.openstack.org/425295 | 17:12 |
| *** newmember has joined #openstack-infra | 17:13 | |
| *** ccamacho has left #openstack-infra | 17:13 | |
| *** dtantsur is now known as dtantsur|brb | 17:14 | |
| *** nadya has quit IRC | 17:16 | |
| clarkb | EmilienM: just wanted to let you know that the centos7 and fedora25 devstack+tempest "platform" jobs seem to be failing consistently right now. Centos on volume issues and fedora on instance console issues. (In the past you have expressed interest in making sure that the red hat distros are being tested and workign) | 17:17 |
| EmilienM | clarkb: ack, do you have logs that I can look? | 17:18 |
| *** yolanda has quit IRC | 17:18 | |
| clarkb | EmilienM: http://logs.openstack.org/17/423417/3/check/gate-tempest-dsvm-platform-centos7-nv/dcf341c/console.html and http://logs.openstack.org/17/423417/3/check/gate-tempest-dsvm-platform-fedora25-nv/cbcbfa3/console.html from https://review.openstack.org/#/c/423417/ which should only be affecting grenade jobs | 17:19 |
| EmilienM | clarkb: thank ypou | 17:19 |
| *** kgiusti has quit IRC | 17:20 | |
| EmilienM | clarkb: http://logs.openstack.org/17/423417/3/check/gate-tempest-dsvm-platform-centos7-nv/dcf341c/logs/screen-c-bak.txt.gz?level=ERROR#_2017-01-25_01_57_34_501 | 17:21 |
| *** EricGonczer_ has quit IRC | 17:21 | |
| EmilienM | clarkb: I'll poke cinder folks | 17:21 |
| clarkb | sdague: you may be interested in https://review.openstack.org/#/c/417554/1 https://review.openstack.org/#/c/417555/ and https://review.openstack.org/#/c/417982/ (series of changes in d-g to test and run the test-matrix.py script under python3 if available) | 17:21 |
| *** jaosorior has quit IRC | 17:22 | |
| clarkb | EmilienM: weird | 17:22 |
| EmilienM | clarkb: not sure why it fails on *centos* | 17:22 |
| EmilienM | or fedora | 17:22 |
| EmilienM | clarkb: it could be an old package (or too new?) | 17:22 |
| clarkb | EmilienM: well its doing an fsync on a file descriptor looks like | 17:22 |
| sdague | clarkb: I probably can't realy look until Friday, at some meetings for the rest of the week | 17:23 |
| *** ramishra_ has joined #openstack-infra | 17:23 | |
| *** hashar has quit IRC | 17:24 | |
| clarkb | EmilienM: almost like the filesystem is being angry | 17:24 |
| clarkb | sdague: ok | 17:24 |
| *** jheroux has joined #openstack-infra | 17:24 | |
| *** nadya has joined #openstack-infra | 17:25 | |
| *** ramishra has quit IRC | 17:25 | |
| *** Jeffrey4l has joined #openstack-infra | 17:25 | |
| clarkb | EmilienM: man page says "An error occurred during synchronization." :) | 17:25 |
| openstackgerrit | Merged openstack-infra/nodepool: Add nodepoold test for request decline and fail https://review.openstack.org/424298 | 17:25 |
| *** tqtran has joined #openstack-infra | 17:26 | |
| *** bhunter71 has quit IRC | 17:26 | |
| EmilienM | clarkb: oops | 17:26 |
| EmilienM | clarkb: I can try to run the test outside devstack in puppet CI and see how it works | 17:27 |
| *** Swami_ has quit IRC | 17:27 | |
| *** ggnel_t has quit IRC | 17:27 | |
| *** bhunter71 has joined #openstack-infra | 17:27 | |
| EmilienM | clarkb: making sure we're not missing something here | 17:27 |
| clarkb | EmilienM: so maybe we need an elastic recheck rule for that and see if it is consistent, or contained to a specific cloud or something | 17:27 |
| clarkb | EmilienM: sounds good thanks | 17:27 |
| EmilienM | clarkb: http://logs.openstack.org/36/424936/1/gate/gate-puppet-openstack-integration-4-scenario002-tempest-centos-7/99432ba/console.html#_2017-01-25_16_10_54_731579 | 17:28 |
| EmilienM | clarkb: in puppet ci we test cinder backup with swift backend, but only v2 api, not v1 | 17:28 |
| EmilienM | in devstack, the failure was on v1 iiuc | 17:28 |
| EmilienM | not sure about backend, let me check | 17:29 |
| EmilienM | clarkb: swift too | 17:29 |
| *** Jeffrey4l has quit IRC | 17:30 | |
| EmilienM | clarkb: though puppet CI didn't test tempest.api.volume.test_volumes_backup.VolumesBackupsV2Test.test_volume_backup_create_get_detailed_list_restore_delete - I'm doing it now | 17:30 |
| *** Apoorva has joined #openstack-infra | 17:30 | |
| EmilienM | clarkb: mhh, scenario with encrypted volume works in tripleo AND puppet CI: http://logs.openstack.org/36/424936/1/gate/gate-puppet-openstack-integration-4-scenario002-tempest-centos-7/99432ba/console.html#_2017-01-25_16_12_28_815074 | 17:31 |
| EmilienM | clarkb: not sure why it fails in devstack | 17:31 |
| *** rossella_ has quit IRC | 17:31 | |
| * EmilienM brb lunch | 17:31 | |
| *** jaosorior has joined #openstack-infra | 17:32 | |
| *** dtantsur|brb is now known as dtantsur | 17:33 | |
| *** anilvenkata has joined #openstack-infra | 17:33 | |
| *** tesseract has quit IRC | 17:33 | |
| *** baoli has joined #openstack-infra | 17:35 | |
| *** aarefiev is now known as aarefiev_afk | 17:37 | |
| openstackgerrit | Filip Pytloun proposed openstack-infra/project-config: Stop gating of openstack-salt projects https://review.openstack.org/425139 | 17:38 |
| *** tonytan4ever has quit IRC | 17:39 | |
| *** rbuzatu has joined #openstack-infra | 17:40 | |
| *** tonytan4ever has joined #openstack-infra | 17:40 | |
| *** tnovacik has joined #openstack-infra | 17:41 | |
| *** florianf has quit IRC | 17:41 | |
| *** yolanda has joined #openstack-infra | 17:41 | |
| *** mhickey has quit IRC | 17:44 | |
| *** kgiusti has joined #openstack-infra | 17:44 | |
| *** rbuzatu has quit IRC | 17:44 | |
| *** Swami has joined #openstack-infra | 17:46 | |
| openstackgerrit | Christopher Aedo proposed openstack-infra/irc-meetings: Add Interop meeting for China time https://review.openstack.org/425319 | 17:47 |
| *** cody-somerville has quit IRC | 17:48 | |
| *** cody-somerville has joined #openstack-infra | 17:48 | |
| *** cody-somerville has joined #openstack-infra | 17:48 | |
| *** kgiusti has quit IRC | 17:50 | |
| openstackgerrit | Merged openstack-infra/project-config: Add fuel-ccp-nginx repository https://review.openstack.org/424542 | 17:52 |
| *** dprince has quit IRC | 17:53 | |
| *** lucasagomes is now known as lucas-afk | 17:54 | |
| *** ralonsoh has quit IRC | 17:58 | |
| *** beagles is now known as beagles-biab | 17:59 | |
| *** bkorren has quit IRC | 17:59 | |
| *** cdent has quit IRC | 17:59 | |
| *** nadya has quit IRC | 18:02 | |
| *** sdague has quit IRC | 18:03 | |
| fungi | anybody happen to know what the deal is with nodepool ready nodes which have None for a manager? i see quite a few (though none over 5 minutes in a ready state). do they go into ready prior to getting assigned to a launcher? | 18:03 |
| kfox1111 | is there an example of a zuul job that runs nightly somewhere? | 18:04 |
| clarkb | kfox1111: if you grep for 'periodic' in project-config you should find plenty of examples | 18:05 |
| fungi | kfox1111: what kind of example are you looking for? the names? their payloads? their logs? long-term trending of their results? | 18:05 |
| kfox1111 | cool. thanks. | 18:05 |
| openstackgerrit | Karthik Prabhu Vinod proposed openstack-infra/project-config: Adding two other combinations of cinder multinode grenade job https://review.openstack.org/384836 | 18:06 |
| kfox1111 | I would like to setup a kolla-kubernetes job that periodically runs, and uploads a tarball of cached containers that were used during the run. Then the gate jobs can pull that into their cache, and if its current, then it won't download anything else. | 18:06 |
| clarkb | fungi: I want to say that is normal, but I don't actually feel confident in that answer | 18:06 |
| fungi | if i get time later i'll trace one through the debug logs | 18:06 |
| *** yolanda has quit IRC | 18:06 | |
| *** tonytan_brb has joined #openstack-infra | 18:06 | |
| kfox1111 | if the cache is incomplete/older, it will not block the gate though, as the gate jobs can just download the missing containers until the periodic job runs again. | 18:07 |
| *** tonytan4ever has quit IRC | 18:07 | |
| *** dtantsur is now known as dtantsur|afk | 18:09 | |
| fungi | sounds like the images ironic generates for testing their agent | 18:09 |
| kfox1111 | yeah. similar. | 18:10 |
| fungi | they do that with a periodic (daily) job and upload it to tarballs.o.o, then consume it from there in their jobs | 18:10 |
| *** matrohon__ has quit IRC | 18:10 | |
| fungi | would probably make a good example to work from | 18:10 |
| kfox1111 | cool. thanks. :) | 18:11 |
| fungi | kfox1111: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/ironic-python-agent-jobs.yaml | 18:11 |
| kfox1111 | ah. nice. | 18:12 |
| kfox1111 | thanks. :) | 18:12 |
| fungi | any time! | 18:12 |
| clarkb | fungi: re your hiera comment on my ethercalc system-config change. Do I also need to set a group for that so ethercalc02 etc get the same hiera? or do we want to start with an ethercalc01 specific hiera file? | 18:14 |
| fungi | clarkb: yep (see my addition of a files group in the docs https change). i was also about to leave a comment about adding it to the certcheck config | 18:15 |
| clarkb | fungi: sounds good, for your other comments can you see my replies and if you want me to edit anything about them too? | 18:15 |
| fungi | clarkb: if you solidify group vs fqdn and confirm the hiera key names i'll go ahead and add these files into our private hiera in a moment | 18:15 |
| fungi | clarkb: i'm fine with them as is if you prefer (which is why i used a +2) | 18:16 |
| clarkb | ok will get a new patchset up in a sec for the other things | 18:16 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Deploy simple ethercalc server https://review.openstack.org/424800 | 18:18 |
| clarkb | fungi: ^ how is that? | 18:18 |
| *** e0ne has quit IRC | 18:18 | |
| *** rbuzatu has joined #openstack-infra | 18:20 | |
| fungi | certcheck config addition still needed. see comment | 18:21 |
| fungi | clarkb: ^ | 18:21 |
| kfox1111 | fungi: how do you get it to run periodically? | 18:21 |
| *** Guest36770 has quit IRC | 18:21 | |
| fungi | clarkb: sorry i forgot to check for it in previous reviews or would have -1'd over it then | 18:22 |
| kfox1111 | do you need to add it to zuul/layout.yaml? | 18:22 |
| kfox1111 | or somewhere else? | 18:22 |
| fungi | kfox1111: correct you are | 18:22 |
| clarkb | fungi: oh right | 18:22 |
| fungi | kfox1111: add a periodic pipeline section to your project in zuul/layout.yaml and add the job inside that | 18:22 |
| kfox1111 | whats the type for a periodic job? | 18:22 |
| kfox1111 | ah. k. thanks. | 18:22 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Deploy simple ethercalc server https://review.openstack.org/424800 | 18:23 |
| kfox1111 | is there a zuul ui for looking after them? | 18:23 |
| *** matt-borland has quit IRC | 18:23 | |
| clarkb | kfox1111: it is the same status page as teh other jobs, they show up under the periodic heading | 18:23 |
| kfox1111 | hmm... | 18:24 |
| kfox1111 | what if they aren't running? | 18:24 |
| kfox1111 | still show up there? | 18:24 |
| clarkb | no they only just up when theyarein progress | 18:24 |
| *** rbuzatu has quit IRC | 18:24 | |
| fungi | http://status.openstack.org/openstack-health/#/ | 18:24 |
| *** dharinic is now known as dharinic|lunch | 18:24 | |
| clarkb | you can find previous job logs at http://logs.openstack.org/periodic and the openstack health site will show previous info if you are producing subunit artifacts | 18:24 |
| kfox1111 | perfect. thanks. :) | 18:25 |
| fungi | i'm not sure whether the health dashboard tracks periodic jobs which lack subunit output though | 18:25 |
| fungi | er, clarkb just said that, right | 18:25 |
| clarkb | ya its backend data store is the subunit to sql database so you have to produce subunit as a prereq to getting on there | 18:27 |
| fungi | kfox1111: ironic's buildimage job template i linked as an example does some basic subunit stuff so that it will show up in the health dashboard, e.g. http://status.openstack.org/openstack-health/#/job/ironic-python-agent-buildimage-coreos-ubuntu-xenial | 18:27 |
| fungi | oh, though those are being done as post pipeline jobs rather than periodic | 18:28 |
| fungi | but same difference really | 18:28 |
| kfox1111 | ah. cool. | 18:28 |
| kfox1111 | I'll work on those as a seperate ps? | 18:28 |
| *** inc0 has joined #openstack-infra | 18:29 | |
| fungi | i wasn't suggesting you need to add post pipeline jobs, just saying that the fact that the ipa image builds are post pipeline instead of periodic pipeline is irrelevant in this case | 18:29 |
| fungi | and that the trick they use to get theirs to show up in the health dashboard should work for your periodic jobs just fine | 18:30 |
| kfox1111 | ok. | 18:30 |
| openstackgerrit | Kevin Fox proposed openstack-infra/project-config: Add a periodic jobs to cache kolla-kubernetes deps https://review.openstack.org/425331 | 18:31 |
| kfox1111 | hows that look? | 18:31 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Rename nodepool integration script https://review.openstack.org/424863 | 18:33 |
| *** sambetts is now known as sambetts|afk | 18:34 | |
| AJaeger | kfox1111: now your previous job will also upload. Better duplicate and have one to test only, and one for test and upload | 18:34 |
| AJaeger | kfox1111: and periodic jobs are never -nv, remove that | 18:34 |
| *** inc0 has quit IRC | 18:34 | |
| *** inc0 has joined #openstack-infra | 18:35 | |
| kfox1111 | AJaeger: I passed the periodic flag to the setup_gate.sh script so it could not upload if it chose. | 18:35 |
| *** Sukhdev has quit IRC | 18:35 | |
| kfox1111 | so, should I just fork the whole resource then into a periodic version? | 18:35 |
| *** Sukhdev has joined #openstack-infra | 18:36 | |
| *** trown is now known as trown|lunch | 18:37 | |
| AJaeger | kfox1111: the scp at the end uploads... | 18:37 |
| kfox1111 | AJaeger: yeah, but it doesnt' do anything if the job doesn't put anything there? | 18:37 |
| AJaeger | kfox1111: that's ugly | 18:38 |
| kfox1111 | I guess its safer though to split it. | 18:38 |
| kfox1111 | k. | 18:38 |
| AJaeger | yes, please split it | 18:38 |
| *** sdake_ has quit IRC | 18:39 | |
| *** wolverineav has quit IRC | 18:39 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Add Ironic support to major upgrade CI https://review.openstack.org/424287 | 18:39 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Add telemetry services to major upgrade test https://review.openstack.org/425334 | 18:39 |
| *** wolverineav has joined #openstack-infra | 18:39 | |
| kfox1111 | can I do: | 18:39 |
| kfox1111 | '{pipeline}-kolla-kubernetes-{action}-{distro}-{type}-{ver}-{config}{suffix}' | 18:39 |
| *** sdake has joined #openstack-infra | 18:39 | |
| kfox1111 | and 'periodic-kolla-kubernetes-{action}-{distro}-{type}-{ver}-{config}{suffix}' | 18:40 |
| kfox1111 | or will that confuse it? | 18:40 |
| *** yolanda has joined #openstack-infra | 18:40 | |
| *** krtaylor has quit IRC | 18:40 | |
| AJaeger | it would work - but remove the {suffix} form the periodic one and you can use gate directly for the first instead of pipeline to not confuse any reviewers ;) | 18:41 |
| *** Jeffrey4l has joined #openstack-infra | 18:41 | |
| *** dprince has joined #openstack-infra | 18:41 | |
| kfox1111 | k. thanks. | 18:42 |
| kfox1111 | so, like this? | 18:43 |
| openstackgerrit | Kevin Fox proposed openstack-infra/project-config: Add a periodic jobs to cache kolla-kubernetes deps https://review.openstack.org/425331 | 18:43 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add wait_for from tripleo-incubator https://review.openstack.org/425335 | 18:43 |
| *** wolverineav has quit IRC | 18:43 | |
| *** yamahata has joined #openstack-infra | 18:43 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Update ironic-multinode and ironic-standalone jobs https://review.openstack.org/425146 | 18:44 |
| openstackgerrit | Filip Pytloun proposed openstack-infra/project-config: Remove openstack-salt projects https://review.openstack.org/425337 | 18:44 |
| AJaeger | kfox1111: commented | 18:44 |
| kfox1111 | thx. | 18:46 |
| *** Jeffrey4l has quit IRC | 18:46 | |
| *** Shrews has quit IRC | 18:46 | |
| openstackgerrit | Filip Pytloun proposed openstack-infra/project-config: Remove openstack-salt projects https://review.openstack.org/425337 | 18:46 |
| openstackgerrit | Kevin Fox proposed openstack-infra/project-config: Add a periodic jobs to cache kolla-kubernetes deps https://review.openstack.org/425331 | 18:47 |
| *** Shrews has joined #openstack-infra | 18:47 | |
| *** EricGonczer_ has joined #openstack-infra | 18:48 | |
| AJaeger | kfox1111: you only did half of my suggested changes | 18:48 |
| kfox1111 | so you want me to do the gates too? k. I misunderstood. | 18:50 |
| openstackgerrit | Kevin Fox proposed openstack-infra/project-config: Add a periodic jobs to cache kolla-kubernetes deps https://review.openstack.org/425331 | 18:51 |
| kfox1111 | k. This may fix it. | 18:51 |
| *** markus_z has quit IRC | 18:51 | |
| AJaeger | kfox1111: worth trying ;) | 18:52 |
| kfox1111 | AJaeger: cool. thanks for the help. :) | 18:52 |
| *** pcaruana has quit IRC | 18:53 | |
| AJaeger | np | 18:53 |
| *** rbuzatu has joined #openstack-infra | 18:53 | |
| *** inc0 has quit IRC | 18:54 | |
| *** rbrndt has quit IRC | 18:55 | |
| kfox1111 | fungi: does that ps look about like you were thinking? | 18:56 |
| *** inc0 has joined #openstack-infra | 18:56 | |
| kfox1111 | inc0: hey. :) | 18:56 |
| *** tonytan4ever has joined #openstack-infra | 18:56 | |
| inc0 | whats up kfox1111 ? | 18:56 |
| kfox1111 | nothing. just saying hi. :) | 18:57 |
| inc0 | lol, well hello there;) | 18:57 |
| *** tonytan_brb has quit IRC | 18:58 | |
| *** sdague has joined #openstack-infra | 19:00 | |
| *** benj_ has quit IRC | 19:00 | |
| openstackgerrit | Filip Pytloun proposed openstack-infra/project-config: Remove openstack-salt projects https://review.openstack.org/425337 | 19:00 |
| *** shardy is now known as shardy_afk | 19:01 | |
| *** csomerville has joined #openstack-infra | 19:03 | |
| *** nicolasbock has quit IRC | 19:03 | |
| *** EricGonczer_ has quit IRC | 19:03 | |
| *** benj_ has joined #openstack-infra | 19:04 | |
| fungi | clarkb: okay, those hiera keys are in place for the ethercalc server now. ready for you to take it for a spin | 19:05 |
| clarkb | fungi: thanks! | 19:05 |
| clarkb | sizing wise should I start with etherpad server size or try smaller? | 19:05 |
| fungi | we could probably get by with way smaller | 19:06 |
| clarkb | My concern is the colocated redis server may put more pressure then expected on it so being a bit less conservative may be good | 19:06 |
| *** cody-somerville has quit IRC | 19:06 | |
| clarkb | then than? english hard | 19:06 |
| *** dharinic|lunch is now known as dharinic | 19:06 | |
| fungi | oh, that's a good point, but still we've sized the etherpad server to much hugeness | 19:06 |
| clarkb | thats true, I doubt ethercalc will get a thousand concurrent users at PTG | 19:06 |
| fungi | i say try to stand it up, see how much ram it's consuming at rest and then we can adjust early on without needing to restore backups | 19:07 |
| fungi | if we can put the redis data on a cinder volume, all the better | 19:07 |
| *** ociuhandu has quit IRC | 19:07 | |
| openstackgerrit | Kaitlin Farr proposed openstack-infra/project-config: Upgrade barbican-tempest-plugin gate https://review.openstack.org/424757 | 19:08 |
| *** MasterOfBugs has joined #openstack-infra | 19:08 | |
| *** ijw has joined #openstack-infra | 19:08 | |
| *** Drago1 has joined #openstack-infra | 19:08 | |
| *** MasterOfBugs has quit IRC | 19:08 | |
| *** Drago1 has left #openstack-infra | 19:08 | |
| *** ijw has quit IRC | 19:09 | |
| *** MasterOfBugs has joined #openstack-infra | 19:09 | |
| clarkb | I am not sure a cinder volume will be necessary, it is literally a single file so scp should work even better than cinder ? | 19:09 |
| *** ijw has joined #openstack-infra | 19:09 | |
| *** pramodrj07 has joined #openstack-infra | 19:09 | |
| clarkb | (not being able to do multi attached volumes makes that process really clunky to me | 19:09 |
| *** Jeffrey4l has joined #openstack-infra | 19:10 | |
| clarkb | well that and the bug where if you turn off the server or don't turn it off before detaching causes the volume to go wonky is one that makes me have a sad | 19:10 |
| clarkb | fungi: ^ so that I can hope to remember do you recall what the "proper" bug avoiding detach process is? | 19:10 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Rename nodepool integration script https://review.openstack.org/424863 | 19:10 |
| openstackgerrit | Kaitlin Farr proposed openstack-infra/project-config: Upgrade barbican-tempest-plugin gate https://review.openstack.org/424757 | 19:11 |
| clarkb | etherpad.o.o is a 4GB instance, thinking 2GB for ethercalc to start? | 19:12 |
| *** bhunter71 has quit IRC | 19:12 | |
| fungi | clarkb: shut down the server, then detach the volume. the issue for me has been nova continuing to think the volume is active when it's been completely umount'ed in the os | 19:13 |
| *** Sukhdev has quit IRC | 19:13 | |
| jeblair | etherpad / is nearly full. | 19:13 |
| morgan | o/ | 19:13 |
| morgan | fungi: we might have an issue in gerrit | 19:13 |
| fungi | jeblair: i have a feeling that's apache logs | 19:13 |
| morgan | fungi: stevemar hit a rebase on a patch with a -2 | 19:13 |
| morgan | the -2 CR dropped in the rebase | 19:14 |
| jeblair | clarkb: 2g lgtm | 19:14 |
| fungi | clarkb: also you make a fine case for not cindering as long as the redis db never gets particularly large | 19:14 |
| morgan | fungi: https://review.openstack.org/#/c/418166/ is the review in question | 19:14 |
| morgan | ih wait | 19:14 |
| morgan | nvm | 19:14 |
| morgan | i was on the wrong patchet | 19:14 |
| stevemar | morgan: it is reapplied | 19:14 |
| stevemar | lag | 19:14 |
| morgan | fungi: nevewrmind. | 19:14 |
| clarkb | jeblair: likely db backups, we probably want to adjust retention of thsoe on review.o.o and etherpad.o.o | 19:14 |
| *** bhunter71 has joined #openstack-infra | 19:14 | |
| fungi | stevemar: was it manually reapplied or did it show back up on its own? | 19:14 |
| *** Jeffrey4l has quit IRC | 19:15 | |
| stevemar | fungi: morgan was looking at the wrong patch :) | 19:15 |
| fungi | clarkb: oh, right, db backups on that one are indeed a more likely cause | 19:15 |
| *** anilvenkata has quit IRC | 19:15 | |
| AJaeger | fungi, clarkb, could either of you abandon this change, please? https://review.openstack.org/276228 - the salt team has no permissions to abandon it and it's needed to clean up the queue since they retire salt in OpenStack CI | 19:16 |
| clarkb | AJaeger: sure one sec | 19:17 |
| fungi | AJaeger: done | 19:17 |
| clarkb | fungi wins | 19:17 |
| AJaeger | thanks | 19:17 |
| *** krtaylor has joined #openstack-infra | 19:18 | |
| *** xarses_ has quit IRC | 19:18 | |
| *** xarses_ has joined #openstack-infra | 19:19 | |
| clarkb | as soon as the system-config change merges I will be booting a 2gb instance for ethercalc | 19:19 |
| clarkb | confirmed 29GB of db backups | 19:19 |
| jeblair | zuul/nodepool seem to have caught up now | 19:20 |
| openstackgerrit | tonytan4ever proposed openstack/os-testr: Allow using ostestr with --ipdb option https://review.openstack.org/425354 | 19:20 |
| *** tojuvone has quit IRC | 19:21 | |
| *** jaosorior has quit IRC | 19:21 | |
| tonytan4ever | folks ^^ | 19:21 |
| tonytan4ever | Reviews will be appreciated. | 19:21 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Reduce local db backup retention to 10 days https://review.openstack.org/425356 | 19:22 |
| clarkb | fungi: jeblair ^ that should deal with retention | 19:22 |
| clarkb | tonytan4ever: I think you may have better luck with that repo over in #openstack-qa | 19:23 |
| *** kzaitsev_mb has joined #openstack-infra | 19:23 | |
| tonytan4ever | Okay thanks clarkb | 19:23 |
| openstackgerrit | Merged openstack-infra/system-config: Deploy simple ethercalc server https://review.openstack.org/424800 | 19:25 |
| openstackgerrit | Kaitlin Farr proposed openstack-infra/project-config: Upgrade barbican-tempest-plugin gate https://review.openstack.org/424757 | 19:25 |
| *** sdague has quit IRC | 19:26 | |
| *** tqtran has quit IRC | 19:26 | |
| *** wolverineav has joined #openstack-infra | 19:27 | |
| *** sdague has joined #openstack-infra | 19:27 | |
| *** EricGonczer_ has joined #openstack-infra | 19:30 | |
| *** vsaienko has joined #openstack-infra | 19:30 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Rename nodepool integration script https://review.openstack.org/424863 | 19:31 |
| vsaienko | dtantsur, jroll, yolanda, AJaeger: please add to your review queue https://review.openstack.org/#/c/425146/ thanks in advance! | 19:31 |
| fungi | clarkb: looks like your ethercalc system-config addition merged ~7 minutes ago, so can probably deploy the server normally now | 19:32 |
| clarkb | fungi: yup waiting for it to show up on puppetmaster | 19:32 |
| clarkb | maybe I should stop waiting and manually update that repo | 19:32 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes) https://review.openstack.org/418098 | 19:32 |
| *** abregman has joined #openstack-infra | 19:32 | |
| *** trown|lunch is now known as trown | 19:33 | |
| fungi | kfox1111: your change failed one of the check jobs, fix is trivial, noted inline | 19:36 |
| fungi | clarkb: oh, right, i forget we update system-config via cron | 19:37 |
| openstackgerrit | Jimmy McCrory proposed openstack-infra/project-config: Skip os_nova func_lxd job on stable/mitaka branch https://review.openstack.org/425363 | 19:38 |
| *** rbrndt has joined #openstack-infra | 19:39 | |
| *** e0ne has joined #openstack-infra | 19:39 | |
| *** BobBall is now known as BobBall_AWOL | 19:39 | |
| openstackgerrit | Kevin Fox proposed openstack-infra/project-config: Add a periodic jobs to cache kolla-kubernetes deps https://review.openstack.org/425331 | 19:40 |
| kfox1111 | fungi: thx. this should fix it. | 19:40 |
| *** dinob has joined #openstack-infra | 19:42 | |
| *** mitchjameson has joined #openstack-infra | 19:43 | |
| openstackgerrit | Merged openstack-infra/system-config: Reduce local db backup retention to 10 days https://review.openstack.org/425356 | 19:44 |
| AJaeger | team, could you review a change to stop running py34 on cinder master, please? https://review.openstack.org/424674 - and one cleanup to remove the single item lists, please? https://review.openstack.org/424813 | 19:47 |
| *** dprince has quit IRC | 19:48 | |
| *** dprince has joined #openstack-infra | 19:49 | |
| *** Sukhdev has joined #openstack-infra | 19:52 | |
| *** esikachev has quit IRC | 19:53 | |
| *** pvaneck has joined #openstack-infra | 19:53 | |
| *** gordc has quit IRC | 19:54 | |
| *** e0ne has quit IRC | 19:55 | |
| clarkb | ok ethercalc server is booted and puppeted, running apache and redis but I don't see any of the node stuff | 19:55 |
| openstackgerrit | Merged openstack-infra/project-config: JJB: Replace single item lists https://review.openstack.org/424813 | 19:58 |
| clarkb | I think it may be a puppet scoping issue | 19:58 |
| *** Jeffrey4l has joined #openstack-infra | 19:58 | |
| AJaeger | thanks, clarkb | 19:59 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Convince puppet to use proper ethercalc class https://review.openstack.org/425375 | 19:59 |
| *** EricGonczer_ has quit IRC | 19:59 | |
| *** hashar has joined #openstack-infra | 19:59 | |
| clarkb | fungi: jeblair I think ^ may do it based on how etherpad works | 20:00 |
| *** neiljerram has joined #openstack-infra | 20:00 | |
| *** EricGonczer_ has joined #openstack-infra | 20:01 | |
| openstackgerrit | Merged openstack-infra/project-config: Add a periodic jobs to cache kolla-kubernetes deps https://review.openstack.org/425331 | 20:03 |
| clarkb | I went ahead and updated dns and accepted the ssh host key so once ^ gets in we should see the nodejs service get installed and start | 20:03 |
| kfox1111 | thanks for the help. :) | 20:03 |
| clarkb | and now time for lunch | 20:03 |
| *** Jeffrey4l has quit IRC | 20:04 | |
| *** tqtran has joined #openstack-infra | 20:05 | |
| *** Sukhdev has quit IRC | 20:05 | |
| jeblair | clarkb: should you sprinkle some more :: around that file just as a foolish consistency? | 20:06 |
| *** sdague has quit IRC | 20:06 | |
| *** morgabra has joined #openstack-infra | 20:08 | |
| *** morgabra has joined #openstack-infra | 20:08 | |
| clarkb | jeblair: I can if you like | 20:08 |
| clarkb | the other names are unique enough to resolve propelry though | 20:08 |
| fungi | clarkb: oh! i guess it picked up the local ethercalc class rather than the ethercalc module? | 20:10 |
| fungi | that's a fun one | 20:10 |
| clarkb | thats what ut looked like from yhe log and since include will noop on duplicates it didnt do anything | 20:11 |
| clarkb | so we got apache and redis but no ethercalc | 20:11 |
| openstackgerrit | Alex Schultz proposed openstack-infra/project-config: Revert "puppet: disable voting on ubuntu/integration jobs" https://review.openstack.org/425382 | 20:11 |
| *** john-davidge has quit IRC | 20:12 | |
| jeblair | clarkb: i don't insist. +3 :) | 20:12 |
| *** jaosorior has joined #openstack-infra | 20:12 | |
| *** abregman has quit IRC | 20:13 | |
| *** abregman has joined #openstack-infra | 20:13 | |
| *** ldnunes has quit IRC | 20:14 | |
| *** dtardivel has quit IRC | 20:14 | |
| *** spligak has quit IRC | 20:15 | |
| *** nicolasbock has joined #openstack-infra | 20:16 | |
| *** beagles-biab is now known as beagles | 20:16 | |
| *** jaosorior has quit IRC | 20:17 | |
| *** e0ne has joined #openstack-infra | 20:17 | |
| *** sdague has joined #openstack-infra | 20:18 | |
| *** burgerk has quit IRC | 20:23 | |
| *** gordc has joined #openstack-infra | 20:23 | |
| *** jaosorior has joined #openstack-infra | 20:24 | |
| * fungi needs to step out and run an errand, but will bbiab | 20:27 | |
| *** abregman has quit IRC | 20:28 | |
| *** e0ne has quit IRC | 20:28 | |
| *** Goneri has quit IRC | 20:29 | |
| *** e0ne has joined #openstack-infra | 20:32 | |
| *** esikachev has joined #openstack-infra | 20:34 | |
| mitchjameson | Hi, I recently created a new branch for a project, but I’m having a tough time getting Jenkins to vote on changes to it. Is there a universal regex that filters based on branch name? If so, can it be overridden? (The project is openstack/networking-arista and the branch is stable/mitaka-hpb) | 20:35 |
| *** dougshelley66 has quit IRC | 20:38 | |
| *** esikachev has quit IRC | 20:39 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add wait_for from tripleo-incubator https://review.openstack.org/425335 | 20:39 |
| *** e0ne has quit IRC | 20:40 | |
| *** esikachev has joined #openstack-infra | 20:41 | |
| *** dougshelley66 has joined #openstack-infra | 20:45 | |
| *** Jeffrey4l has joined #openstack-infra | 20:45 | |
| *** jamielennox|away has quit IRC | 20:46 | |
| clarkb | mitchjameson: there are likely many regexes that deal with stable/mitaka that may not end in $ so match your branch too | 20:46 |
| clarkb | mitchjameson: what jobs do you expect to run against it but do not? | 20:47 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Use the Newton node management commands https://review.openstack.org/416982 | 20:47 |
| mitchjameson | I’m just expecting python-jobs in this case | 20:48 |
| *** dprince has quit IRC | 20:48 | |
| *** esikachev has quit IRC | 20:48 | |
| *** dprince has joined #openstack-infra | 20:48 | |
| AJaeger | mitchjameson: do you have an example change? | 20:49 |
| *** esikachev has joined #openstack-infra | 20:49 | |
| mitchjameson | https://review.openstack.org/#/c/424854/ | 20:49 |
| *** panda|bbl is now known as panda | 20:50 | |
| AJaeger | not shown in zuul status page ;( | 20:50 |
| *** adriant has joined #openstack-infra | 20:51 | |
| *** mrunge has quit IRC | 20:51 | |
| AJaeger | mitchjameson: looking at jobs, you really choose the wrong branch name. We have: | 20:52 |
| AJaeger | for python-jobs on trusty: branch: ^stable/(liberty|mitaka)$ -so, dosn't appaly | 20:52 |
| clarkb | ah | 20:52 |
| AJaeger | and this one - for xenial- neither matches branch: ^(?!stable/(liberty|mitaka)).*$ | 20:52 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config: use the tripleo oooq containers job to gate t-h-t/docker/* https://review.openstack.org/423519 | 20:53 |
| clarkb | probably best way to fix that is drop the $ on the trustyregex | 20:53 |
| AJaeger | mitchjameson: stable branches are special | 20:53 |
| AJaeger | clarkb: yeah - or rename the branch? | 20:53 |
| *** sdague has quit IRC | 20:53 | |
| clarkb | ya, or just use stable/mitaka | 20:54 |
| *** sdague has joined #openstack-infra | 20:54 | |
| *** panda is now known as panda|zZ | 20:54 | |
| *** mrunge has joined #openstack-infra | 20:55 | |
| *** esikachev has quit IRC | 20:55 | |
| mitchjameson | There’s already a stable/mitaka - this was meant be an alternative to stable/mitaka that works with a specific neutron feature. I can create a new branch. Would you recommend just dropping the ‘stable/‘? | 20:55 |
| *** jamielennox|away has joined #openstack-infra | 20:56 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test dlrn logs https://review.openstack.org/424354 | 20:56 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test dlrn logs https://review.openstack.org/424354 | 20:56 |
| *** jamielennox|away is now known as jamielennox | 20:56 | |
| clarkb | I think the simplest fix is to drop that $ frmo the default regex for mitaka | 20:57 |
| clarkb | and let it match mitaka with a suffix | 20:57 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job novajoin metadata https://review.openstack.org/425411 | 20:57 |
| *** burgerk has joined #openstack-infra | 21:00 | |
| *** burgerk_ has joined #openstack-infra | 21:02 | |
| *** shardy_afk has quit IRC | 21:03 | |
| *** raildo has quit IRC | 21:04 | |
| *** shardy_afk has joined #openstack-infra | 21:05 | |
| *** burgerk has quit IRC | 21:05 | |
| kfox1111 | source: 'UPLOAD_CONTAINERS/*' | 21:05 |
| kfox1111 | thats relative to $WORKSPACE? | 21:06 |
| *** shardy_afk is now known as shardy | 21:07 | |
| clarkb | fungi: jeblair https://ethercalc01.openstack.org/86ysv5cdurc3 (you'll need to accept the cert error until I get the CNAME in place) | 21:10 |
| clarkb | seems to be up and doing stuff now though | 21:10 |
| clarkb | kfox1111: yes | 21:10 |
| kfox1111 | ok. cool. thanks. | 21:11 |
| clarkb | fungi: jeblair I have put content in there, curious if you see it or not | 21:11 |
| openstackgerrit | Ildiko Vancsa proposed openstack-infra/irc-meetings: Change the day for the Cinder-Nova API interactions meeting https://review.openstack.org/425414 | 21:12 |
| ihrachys | anyone to review https://review.openstack.org/#/c/411328/ ? It doesn't make much progress, and it's a preparation step for centos enablement | 21:13 |
| *** john-davidge has joined #openstack-infra | 21:13 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Add telemetry services to major upgrade test https://review.openstack.org/425334 | 21:14 |
| *** dimtruck is now known as zz_dimtruck | 21:16 | |
| jeblair | clarkb: neato :) | 21:16 |
| clarkb | I just created the CNAME so you should be able to use ssl properly in a few minutes (if not now) | 21:17 |
| *** Goneri has joined #openstack-infra | 21:17 | |
| *** john-davidge has quit IRC | 21:18 | |
| *** erlon has quit IRC | 21:20 | |
| *** hamzy has quit IRC | 21:22 | |
| *** dprince has quit IRC | 21:23 | |
| *** erlon has joined #openstack-infra | 21:23 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Don't set worker counts in nonha jobs https://review.openstack.org/425420 | 21:24 |
| jeblair | clarkb, fungi: you can make forms: https://ethercalc01.openstack.org/ttwax58wbzee/appeditor | 21:24 |
| *** umeshksingla has joined #openstack-infra | 21:25 | |
| jeblair | https://ethercalc01.openstack.org/ttwax58wbzee_rf5o2393137e/app | 21:25 |
| *** yamamoto has joined #openstack-infra | 21:27 | |
| clarkb | neat | 21:27 |
| *** mriedem has joined #openstack-infra | 21:29 | |
| *** tonytan4ever has quit IRC | 21:29 | |
| *** tonytan4ever has joined #openstack-infra | 21:29 | |
| *** eharney has quit IRC | 21:30 | |
| *** tonytan4ever has quit IRC | 21:30 | |
| *** tonytan4ever has joined #openstack-infra | 21:31 | |
| *** jaosorior has quit IRC | 21:31 | |
| openstackgerrit | Chris Krelle proposed openstack-infra/glean: Adjust the way we wait for interfaces to become available https://review.openstack.org/359471 | 21:32 |
| *** askb has joined #openstack-infra | 21:32 | |
| clarkb | jeblair: and so far thats worth about 8kb of redis on disk | 21:32 |
| clarkb | so I don't think this will grow too particularly fast, but worth keepign an eye on | 21:32 |
| jeblair | clarkb: maybe if it's too big, we can run visicalc in a screen session over telnet instead? | 21:33 |
| *** EricGonczer_ has quit IRC | 21:33 | |
| *** tonytan4ever has quit IRC | 21:33 | |
| clarkb | haha | 21:34 |
| *** tonytan4ever has joined #openstack-infra | 21:34 | |
| * clarkb can already imagine teaching everyone how to ^] | 21:34 | |
| *** Jeffrey4l_ has joined #openstack-infra | 21:34 | |
| jeblair | it's like ~.NO CARRIER | 21:34 |
| *** Jeffrey4l has quit IRC | 21:35 | |
| clarkb | I've poked ttx to start using it and make sure it does what he wants, and will push up bup change shortly | 21:35 |
| clarkb | then maybe merge that as soon as we are happy with the size/performance/etc of this installation | 21:36 |
| *** yamamoto has quit IRC | 21:36 | |
| *** umeshksingla has quit IRC | 21:37 | |
| *** jamesdenton has quit IRC | 21:38 | |
| clarkb | so ya lets bash on this for the rest of the week and see how it goes | 21:39 |
| *** ociuhandu has joined #openstack-infra | 21:39 | |
| *** EricGonczer_ has joined #openstack-infra | 21:40 | |
| *** kzaitsev_mb has quit IRC | 21:40 | |
| *** kzaitsev_mb has joined #openstack-infra | 21:40 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Rename nodepool integration script https://review.openstack.org/424863 | 21:42 |
| *** esikachev has joined #openstack-infra | 21:42 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Fix log path in gate-zuul-nodepool https://review.openstack.org/425425 | 21:43 |
| jeblair | clarkb: ^ | 21:43 |
| openstackgerrit | Mitchell Jameson proposed openstack-infra/project-config: Run jobs on mitaka/liberty branches with a suffix https://review.openstack.org/425429 | 21:45 |
| *** shardy has quit IRC | 21:45 | |
| ihrachys | I wonder if infra supports any job states beyond SUCCESS and FAILURE. Specifically, is UNSTABLE possible? | 21:45 |
| *** tonytan4ever has quit IRC | 21:46 | |
| clarkb | ihrachys: SUCCESS, FAILURE, and nil/none/null are the 3 states. THe third state indicates the job did not complete itself so is not a success but not erally a failure either | 21:46 |
| *** tonytan4ever has joined #openstack-infra | 21:46 | |
| *** zz_dimtruck is now known as dimtruck | 21:46 | |
| ihrachys | clarkb: ok. we were thinking of marking some functional tests in neutron as unstable, so that they are still executed, but don't affect the result. | 21:47 |
| clarkb | ihrachys: that is what non voting is typically used for | 21:47 |
| ihrachys | clarkb: and I was thinking, maybe we could also tag such a run with any of those failed as unstable | 21:47 |
| clarkb | oh you mean specific individual tests? | 21:47 |
| ihrachys | yes | 21:47 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Use playbooks defined in repos https://review.openstack.org/423550 | 21:47 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Put Zuul vars in an ansible vars file https://review.openstack.org/424367 | 21:47 |
| ihrachys | skip works, but it takes data points from us | 21:47 |
| clarkb | ya there isn't a way to bubble that up. You'd have to write it into your test framework explicitly using something like expected fail | 21:48 |
| ihrachys | yeah, somewhere in base test class I guess | 21:48 |
| ihrachys | that may become nasty | 21:48 |
| ihrachys | I know the proper answer is fixing the tests, but... :) | 21:48 |
| jeblair | when we're running zuulv3, we'll be in a better position to plan ways to pass extra data back like that | 21:48 |
| clarkb | jeblair: https://review.openstack.org/#/c/424863/6/tools/nodepool-integration-setup.sh no longer installs zuul? | 21:49 |
| clarkb | ihrachys: there are existing decorators thatallow you to annotate tests that way I think | 21:50 |
| *** esikachev has quit IRC | 21:50 | |
| clarkb | ihrachys: you just have to use them | 21:50 |
| ihrachys | oh, looking | 21:50 |
| clarkb | xfail? though that might cause a failure if you have success, so maybe you have to implement something similar? | 21:51 |
| ihrachys | yeah, like @always_succeed_after_dumping_logs :) | 21:51 |
| jeblair | clarkb: right, the job uses run-tox macro to run tox so it's just installed in the venv | 21:52 |
| clarkb | jeblair: gotcha | 21:52 |
| clarkb | ihrachys: https://docs.python.org/2/library/unittest.html#unittest.expectedFailure | 21:53 |
| clarkb | ihrachys: I think that may just work | 21:53 |
| ihrachys | clarkb: actually it seems xfail applies. I will need to play with it. | 21:53 |
| ihrachys | yeah, thanks for the pointer, I haven't thought it's there. | 21:54 |
| openstackgerrit | d.marlin proposed openstack/diskimage-builder: diskimage-builder - Add AArch64-specifics to finalize the bootloader https://review.openstack.org/425432 | 21:54 |
| jhesketh | Morning | 21:56 |
| *** tonytan4ever has quit IRC | 21:56 | |
| *** tonytan4ever has joined #openstack-infra | 21:56 | |
| clarkb | morning | 21:58 |
| clarkb | jhesketh: if you want to play with a new srvice and see if you can break it https://ethercalc.openstack.org is now a thing | 21:59 |
| jhesketh | clarkb: oh awesome :-) | 21:59 |
| ijw | Hey - can someone tell me whether, if I were to use a 17.01 or 17.01.0 version (17.01 comes from an upstream project I'm related to), the release process would trigger? | 21:59 |
| clarkb | ijw: it dpeends on the project and its jobs iirc | 22:00 |
| clarkb | ijw: what project are you looking to tag? | 22:00 |
| ijw | Well, the project is networking-vpp, and it's new enough that releasing hasn't really come up until now | 22:00 |
| ijw | I'm happy for the moment with laying down a tag and saying 'hey peeps, stuff ready' if it comes to it, but I'm trying to avoid making horrifying future problems and I'm happy to take advantage of whatever the infra will do for me | 22:01 |
| *** sdague has quit IRC | 22:02 | |
| clarkb | ijw: if you look in openstack-infra/project-config/zuul/layout.yaml networking-vpp has no publishing/release jobs set up | 22:03 |
| clarkb | ijw: also generally you want to do semver so the version number would be 17.1.0 not 17.01 (too few segments) or 17.01.0 (extra 0) | 22:03 |
| *** fguillot has quit IRC | 22:04 | |
| ijw | Yeah - again, VPP itself is the problem there, they've gone Ubuntu style with their version numbers and it makes some sense to remain consistent with them (but 17.1.0 will do just fine) | 22:05 |
| *** bhunter71 has quit IRC | 22:05 | |
| clarkb | ijw: however since you aren't currently using any of our automagic you can use any tag you want | 22:06 |
| clarkb | it will only be an issue if you set up the automagic | 22:07 |
| *** eranrom has quit IRC | 22:07 | |
| ijw | It's not entirely clear how semver would for a project that doesn't actually have APIs, thinking about it | 22:07 |
| clarkb | (so may be a good idea to start with compliant versions so that things line up when automagic is used) | 22:07 |
| clarkb | ijw: you probably have configuration? | 22:07 |
| ijw | Yeah, true. A sum total of about ten properties, but that's all you need to break backward compatibility. | 22:08 |
| *** eharney has joined #openstack-infra | 22:09 | |
| *** tonytan4ever has quit IRC | 22:11 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use port list to find missing floating ips https://review.openstack.org/424087 | 22:14 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT https://review.openstack.org/424190 | 22:15 |
| EmilienM | hey infra, trying to save node resources here, can someone approve https://review.openstack.org/#/c/424954/ please? | 22:17 |
| *** rhallisey has quit IRC | 22:18 | |
| *** ihrachys has quit IRC | 22:20 | |
| *** spligak has joined #openstack-infra | 22:20 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh https://review.openstack.org/395813 | 22:21 |
| *** yamamoto has joined #openstack-infra | 22:22 | |
| *** EricGonczer_ has quit IRC | 22:22 | |
| *** gouthamr has quit IRC | 22:24 | |
| *** eranrom has joined #openstack-infra | 22:24 | |
| *** esikachev has joined #openstack-infra | 22:26 | |
| *** srobert_ has joined #openstack-infra | 22:28 | |
| *** thorst_ has quit IRC | 22:28 | |
| *** tphummel has quit IRC | 22:28 | |
| openstackgerrit | Tomasz Trębski proposed openstack-infra/project-config: Update CI for monasca-log-api https://review.openstack.org/424017 | 22:29 |
| *** esikachev has quit IRC | 22:30 | |
| openstackgerrit | Tomasz Trębski proposed openstack-infra/project-config: Update CI for monasca-log-api https://review.openstack.org/424017 | 22:30 |
| *** srobert has quit IRC | 22:31 | |
| *** baoli has quit IRC | 22:31 | |
| fungi | general heads-up, there's a good chance that the next virtualenv release will no longer bundle setuptools and just rely on pip unless you need to install from sdists: https://mail.python.org/pipermail/distutils-sig/2017-January/030061.html | 22:32 |
| *** srobert_ has quit IRC | 22:32 | |
| fungi | i wouldn't be surprised if we end up having to rework some things infra-side | 22:33 |
| *** jheroux has quit IRC | 22:33 | |
| fungi | (note the pep mentioned there is the one which adds pyproject.toml support)' | 22:34 |
| fungi | https://www.python.org/dev/peps/pep-0518/ | 22:34 |
| *** annegentle has quit IRC | 22:34 | |
| clarkb | should we preemptively be adding pyproject.toml files to our repos? | 22:37 |
| jeblair | only if you want to drive contributors away | 22:38 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tripleo: run 3nodes job only in Ocata and after https://review.openstack.org/425443 | 22:38 |
| clarkb | jeblair: my reading of the pep is that you can't setuptools without it anymore? | 22:38 |
| jeblair | then i won't setuptools | 22:38 |
| clarkb | jeblair: assuming virtualenv also drops the bundling of it | 22:39 |
| clarkb | basically we assume setuptools is present everywhere and for the most part it is because virtualenv includes it and python installs elsewhere do too | 22:39 |
| clarkb | but if setuptools is removed from virtuaelnv that assumption breaks and so you can't rely on setuptools just being there. So if you want to keep using setuptools you need some mechanism to install it (python upstreams thin is the pyproject.toml file) | 22:40 |
| EmilienM | same for https://review.openstack.org/425443, if we want to save some resources :) | 22:40 |
| clarkb | jeblair: distutils appears to still be a thing in python that should always be there because its stdlib though | 22:41 |
| *** esikachev has joined #openstack-infra | 22:41 | |
| *** Sukhdev has joined #openstack-infra | 22:41 | |
| clarkb | I guess if using tox you could add setuptools as your first dep potentially and that would work? | 22:42 |
| openstackgerrit | Merged openstack-infra/project-config: Fix log path in gate-zuul-nodepool https://review.openstack.org/425425 | 22:45 |
| *** esikachev has quit IRC | 22:49 | |
| clarkb | anyways I am sure there are other options there, but likely something will need to be done around our use of setuptools if virtualenv drops it | 22:51 |
| *** dave-mcc_ has joined #openstack-infra | 22:52 | |
| *** dave-mccowan has quit IRC | 22:54 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh https://review.openstack.org/395813 | 22:56 |
| *** vhosakot has joined #openstack-infra | 22:57 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Handle multiple playbook extensions https://review.openstack.org/425450 | 22:59 |
| *** jordanP has joined #openstack-infra | 22:59 | |
| *** jordanP has quit IRC | 22:59 | |
| *** jkilpatr has quit IRC | 23:00 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Tell geard to use keepalives https://review.openstack.org/425248 | 23:01 |
| *** dimtruck is now known as zz_dimtruck | 23:02 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Fix logging issues for quickstart jobs https://review.openstack.org/422638 | 23:03 |
| *** Swami has quit IRC | 23:04 | |
| *** mdrabe has quit IRC | 23:05 | |
| *** dave-mcc_ has quit IRC | 23:05 | |
| *** claudiub has quit IRC | 23:05 | |
| *** dave-mccowan has joined #openstack-infra | 23:05 | |
| *** Goneri has quit IRC | 23:07 | |
| *** zz_dimtruck is now known as dimtruck | 23:08 | |
| *** marst has quit IRC | 23:13 | |
| openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Fix rally job of zaqar https://review.openstack.org/422271 | 23:13 |
| *** john-davidge has joined #openstack-infra | 23:14 | |
| *** jcoufal has quit IRC | 23:15 | |
| *** wolverineav has quit IRC | 23:15 | |
| *** john-davidge has quit IRC | 23:18 | |
| *** krtaylor has quit IRC | 23:18 | |
| *** hamzy has joined #openstack-infra | 23:18 | |
| *** vsaienko has quit IRC | 23:20 | |
| *** xyang1 has quit IRC | 23:20 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Use playbooks defined in repos https://review.openstack.org/423550 | 23:21 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Put Zuul vars in an ansible vars file https://review.openstack.org/424367 | 23:21 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Handle multiple playbook extensions https://review.openstack.org/425450 | 23:21 |
| *** gordc has quit IRC | 23:24 | |
| *** dimtruck is now known as zz_dimtruck | 23:24 | |
| *** newmember has quit IRC | 23:25 | |
| *** newmember has joined #openstack-infra | 23:25 | |
| *** wolverineav has joined #openstack-infra | 23:27 | |
| *** vhosakot has quit IRC | 23:29 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh https://review.openstack.org/395813 | 23:29 |
| *** vsaienko has joined #openstack-infra | 23:30 | |
| *** thingee has quit IRC | 23:31 | |
| *** wolverineav has quit IRC | 23:32 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Add HTTPS to developer and docs.openstack.org https://review.openstack.org/424893 | 23:32 |
| fungi | ^ merge-conflicted on clarkb's ethercalc additions | 23:32 |
| clarkb | ianychoi: any chance you are around? | 23:33 |
| *** thingee has joined #openstack-infra | 23:34 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/puppet-gerritbot: Use latest version of gerritbot https://review.openstack.org/425458 | 23:35 |
| *** hichihara has joined #openstack-infra | 23:35 | |
| *** tphummel has joined #openstack-infra | 23:35 | |
| jlvillal | clarkb, ^^^ I know very little about puppet. So I could have made mistakes... | 23:35 |
| jlvillal | Odds are probably pretty high for a mistake | 23:36 |
| *** wolverineav has joined #openstack-infra | 23:38 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Add multinode subnodes to inventory https://review.openstack.org/423870 | 23:39 |
| *** pradk has quit IRC | 23:40 | |
| *** jkilpatr has joined #openstack-infra | 23:41 | |
| ianychoi | clarkb, hi! | 23:41 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Rename nodepool integration script https://review.openstack.org/424863 | 23:42 |
| clarkb | ianychoi: hello there, not sure if you saw my earlier message | 23:42 |
| ianychoi | Yep seeing.. | 23:42 |
| clarkb | ianychoi: short story is we want to upgrade the puppet-wildfly module to support wildfly 10 so that we can continue translate-dev upgrade work. But that module is also used by translate.openstack.org to install wildfly 9 | 23:42 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Collect only logs we need https://review.openstack.org/425459 | 23:42 |
| *** wolverineav has quit IRC | 23:42 | |
| clarkb | ianychoi: so there is some risk that something could happen to the translate.openstack.org service (though I think it is low). Want your input on when would be a good time to merge that change for you | 23:43 |
| ianychoi | clarkb, aha question: wildify is only used currently for translate and translate-dev? | 23:43 |
| clarkb | ianychoi: https://review.openstack.org/#/c/423367/ is the change in question | 23:43 |
| clarkb | ianychoi: that is correct, only translate and translate-dev use wildfly | 23:43 |
| ianychoi | clarkb, aha I agree if we can roll back right after if translate will nit work | 23:44 |
| ianychoi | s/nit/not | 23:44 |
| *** zz_dimtruck is now known as dimtruck | 23:44 | |
| clarkb | ianychoi: yes rolling back shouldn't be too difficult, we would revert that change, then rerun puppet to change anything back if necessary | 23:45 |
| clarkb | ianychoi: I also think that ianw ran into a problem where that module won't update an existing wildfly install so it shouldn't touch the production server at all | 23:45 |
| clarkb | so I do think it is safe, but wanted to be extra careful and talk to you about it first | 23:45 |
| *** Swami has joined #openstack-infra | 23:46 | |
| ianychoi | clarkb, i see! just a little more second for me to see differences.. :) | 23:46 |
| *** esikachev has joined #openstack-infra | 23:47 | |
| clarkb | ianychoi: no rush | 23:47 |
| *** baoli has joined #openstack-infra | 23:47 | |
| *** hashar has quit IRC | 23:47 | |
| clarkb | ianychoi: I did check the docs of the puppet module and it claims to continue to support wildfly 8, 9 and 10 | 23:48 |
| *** Swami_ has joined #openstack-infra | 23:48 | |
| *** Swami has quit IRC | 23:51 | |
| *** Swami has joined #openstack-infra | 23:52 | |
| *** rbuzatu has quit IRC | 23:53 | |
| *** esikachev has quit IRC | 23:53 | |
| ianychoi | clarkb, yep I left +1 for the patch, and left one comment for https://review.openstack.org/#/c/423369/ -> I am not sure but this change is not included in puppet-artifact 1.0.1 | 23:54 |
| *** Swami_ has quit IRC | 23:55 | |
| clarkb | ianychoi: the default check works on 16.04 and determiens it is systemd correctly | 23:56 |
| clarkb | ianychoi: so that should be ok | 23:56 |
| clarkb | ianychoi: when would be a good time to merge https://review.openstack.org/#/c/423367/ ? maybe ianw and I can watch it tomorrow (it is getting late in the day for me and I need to get on the phone to sort out some travel things) | 23:56 |
| clarkb | ianw: if tomorrow works for ianychoi would you be willing to be an extra set of eyes if necessary? | 23:57 |
| *** wolverineav has joined #openstack-infra | 23:58 | |
| ianychoi | I am fine for tomorrow ianw: what is your timezone? :) I think clarkb is in PST | 23:59 |
| *** Swami has quit IRC | 23:59 | |
| clarkb | yes I am pst | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!