| *** wolverineav has joined #openstack-infra | 00:00 | |
| *** ntpttr_ has quit IRC | 00:02 | |
| dmsimard | There is apparently a problem with the cron that deletes the status.json backups, looking | 00:03 |
|---|---|---|
| clarkb | mordred: I'm trying to finish up cleanup on zuulv3-issues etherpad and tox siblings is one of the biggest remaining items. Are the known issues with it fixed? maybe you can look over the info on the therpad? | 00:03 |
| dmsimard | hmm, wait -- the cron that deletes the status.json backups works fine on zuulv3.o.o, but there is an error on the new zuul node | 00:04 |
| dmsimard | from zuul01: ls: cannot access '/var/lib/zuul/www/backup/*': No such file or directory | 00:05 |
| clarkb | neutron unittests generate a ton of deprecation warnings | 00:05 |
| *** wolverineav has quit IRC | 00:08 | |
| *** yamamoto has joined #openstack-infra | 00:08 | |
| clarkb | fungi: http://docs.ansible.com/ansible/latest/intro_patterns.html I had that tab open for unrelated reasosn and during tab cleanup saw it | 00:08 |
| *** rossella_s has quit IRC | 00:08 | |
| clarkb | I think I was using it when running meltdown patching commands | 00:09 |
| *** rossella_s has joined #openstack-infra | 00:10 | |
| corvus | dmsimard, fungi: oh, i think we still have some manual installation steps for the js dependencies; it may even be the case that the www dir isn't being created. i think we were going to wait until the js tooling patches landed before we fixed up puppet. | 00:11 |
| corvus | or maybe not... i do remember making some puppet changes | 00:11 |
| dmsimard | #status log (dmsimard) Zuul scheduler status.jsons are now periodically backuped provided by https://review.openstack.org/#/c/532955/ -- these are available over the vhost, ex: http://zuulv3.openstack.org/backup/status_1516146901.json | 00:11 |
| openstackstatus | dmsimard: finished logging | 00:11 |
| corvus | so it's possible i just missed something small | 00:11 |
| dmsimard | corvus: I looked and the issue is actually that the backup folder was empty | 00:12 |
| *** wolverineav has joined #openstack-infra | 00:12 | |
| dmsimard | because the cron that backs up the status.jsons is trying to poke http://zuul01.o.o/status.json | 00:12 |
| corvus | ok | 00:12 |
| dmsimard | I'm not sure if zuul01.o.o is accurate but that's what's in the vhost | 00:13 |
| *** wolverineav has quit IRC | 00:18 | |
| fungi | well, the services on it are stopped (intentionally) for on thing | 00:20 |
| fungi | er, for one thing | 00:20 |
| fungi | would also stopping apache help? | 00:20 |
| dmsimard | it's fine | 00:21 |
| dmsimard | wow my font was weird for that, not sure if that's just me | 00:22 |
| fungi | ugh, something has started them again (puppet?!?) | 00:22 |
| fungi | i'm going to stick zuul01 in the emergency disable list for the moment | 00:23 |
| fungi | and then stop services yet again | 00:23 |
| fungi | they're not even stopping gracefully this time around | 00:25 |
| fungi | oh, maybe they didn't stop cleanly to begin with and i never double-checked | 00:26 |
| fungi | may have been unhappy due to firewall rules or something and deadlocked | 00:26 |
| fungi | i'll just kill them for now | 00:26 |
| *** wolverineav has joined #openstack-infra | 00:27 | |
| fungi | definitely not running now | 00:27 |
| *** jamesmcarthur has quit IRC | 00:29 | |
| *** jamesmcarthur has joined #openstack-infra | 00:29 | |
| *** wolverineav has quit IRC | 00:32 | |
| *** jamesmcarthur has quit IRC | 00:32 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add --strip option to encrypt_secret.py https://review.openstack.org/530547 | 00:32 |
| *** wolverineav has joined #openstack-infra | 00:32 | |
| *** kgiusti has quit IRC | 00:36 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Enable direct use of github driver in debug tool https://review.openstack.org/529606 | 00:36 |
| *** rhallisey has quit IRC | 00:37 | |
| *** olaph has joined #openstack-infra | 00:37 | |
| *** wolverineav has quit IRC | 00:37 | |
| *** olaph1 has quit IRC | 00:37 | |
| *** wolverineav has joined #openstack-infra | 00:38 | |
| *** bobh has joined #openstack-infra | 00:40 | |
| *** wolverineav has quit IRC | 00:43 | |
| *** smatzek has joined #openstack-infra | 00:43 | |
| *** jamesmcarthur has joined #openstack-infra | 00:43 | |
| *** jamesmcarthur has quit IRC | 00:43 | |
| *** jamesmcarthur has joined #openstack-infra | 00:43 | |
| *** zhurong has joined #openstack-infra | 00:45 | |
| Dmitrii-Sh | Hi everybody, sorry to bother: looking for somebody to review https://review.openstack.org/#/c/533273/1 followed by https://review.openstack.org/#/c/533274/1 if the first one lands. Any feedback is appreciated. | 00:45 |
| *** hongbin has quit IRC | 00:48 | |
| *** dave-mccowan has joined #openstack-infra | 00:49 | |
| *** spzala has quit IRC | 00:51 | |
| *** wolverineav has joined #openstack-infra | 00:52 | |
| *** tosky has quit IRC | 00:54 | |
| *** wolverineav has quit IRC | 00:57 | |
| *** jamesmcarthur has quit IRC | 01:01 | |
| *** jamesmcarthur has joined #openstack-infra | 01:01 | |
| *** jaypipes has quit IRC | 01:06 | |
| *** cuongnv has joined #openstack-infra | 01:08 | |
| *** kiennt26 has joined #openstack-infra | 01:12 | |
| *** caphrim007 has joined #openstack-infra | 01:15 | |
| *** wolverineav has joined #openstack-infra | 01:18 | |
| *** caphrim007 has quit IRC | 01:19 | |
| *** david-lyle has quit IRC | 01:23 | |
| *** markvoelker has quit IRC | 01:25 | |
| *** jamesmcarthur has quit IRC | 01:27 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] GPT partitioning support https://review.openstack.org/533490 | 01:33 |
| *** dhajare|BNE|Mtg has joined #openstack-infra | 01:35 | |
| *** dave-mccowan has quit IRC | 01:42 | |
| *** dave-mccowan has joined #openstack-infra | 01:42 | |
| *** edmondsw has joined #openstack-infra | 01:45 | |
| *** edmondsw has quit IRC | 01:50 | |
| *** wolverineav has quit IRC | 01:52 | |
| *** bobh has quit IRC | 01:54 | |
| *** jamesmcarthur has joined #openstack-infra | 01:57 | |
| *** wolverineav has joined #openstack-infra | 01:58 | |
| *** jamesmcarthur has quit IRC | 02:01 | |
| *** wolverineav has quit IRC | 02:06 | |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient master: Update UI-Router https://review.openstack.org/384554 | 02:09 |
| *** wolverineav has joined #openstack-infra | 02:09 | |
| *** wolverineav has quit IRC | 02:14 | |
| *** dave-mccowan has quit IRC | 02:19 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Do pep8 housekeeping according to zuul rules https://review.openstack.org/522945 | 02:20 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Use same flake8 config as in zuul https://review.openstack.org/509715 | 02:20 |
| *** wolverineav has joined #openstack-infra | 02:23 | |
| *** hongbin has joined #openstack-infra | 02:24 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: pep8: ignore E124 rule https://review.openstack.org/534588 | 02:24 |
| *** olaph1 has joined #openstack-infra | 02:26 | |
| *** rlandy has quit IRC | 02:27 | |
| *** olaph has quit IRC | 02:28 | |
| *** wolverineav has quit IRC | 02:28 | |
| *** wolverineav has joined #openstack-infra | 02:29 | |
| *** jamesmcarthur has joined #openstack-infra | 02:33 | |
| *** ramishra has joined #openstack-infra | 02:37 | |
| *** jamesmcarthur has quit IRC | 02:38 | |
| *** gyee has quit IRC | 02:41 | |
| *** esberglu has quit IRC | 02:44 | |
| *** wolverineav has quit IRC | 02:45 | |
| *** dave-mccowan has joined #openstack-infra | 02:52 | |
| *** olaph has joined #openstack-infra | 02:55 | |
| openstackgerrit | Kiran Thyagaraja proposed openstack-infra/project-config master: Add ansible-role-k8s-cinder https://review.openstack.org/534594 | 02:57 |
| *** olaph1 has quit IRC | 02:58 | |
| *** liujiong has joined #openstack-infra | 02:58 | |
| *** yamahata has quit IRC | 02:59 | |
| *** iyamahat has quit IRC | 02:59 | |
| *** wolverineav has joined #openstack-infra | 03:05 | |
| *** ramishra has quit IRC | 03:08 | |
| *** wolverineav has quit IRC | 03:13 | |
| openstackgerrit | Yandy Sun proposed openstack/python-jenkins master: modify version spelling errors https://review.openstack.org/534598 | 03:13 |
| *** gcb has quit IRC | 03:14 | |
| *** ramishra has joined #openstack-infra | 03:15 | |
| *** gcb has joined #openstack-infra | 03:18 | |
| *** smatzek has quit IRC | 03:20 | |
| *** smatzek has joined #openstack-infra | 03:20 | |
| *** smatzek has quit IRC | 03:22 | |
| *** smatzek has joined #openstack-infra | 03:22 | |
| openstackgerrit | Kiran Thyagaraja proposed openstack-infra/project-config master: Add ansible-role-k8s-cinder https://review.openstack.org/534594 | 03:25 |
| *** markvoelker has joined #openstack-infra | 03:26 | |
| *** smatzek has quit IRC | 03:27 | |
| *** ekcs has quit IRC | 03:28 | |
| *** wolverineav has joined #openstack-infra | 03:28 | |
| *** bobh has joined #openstack-infra | 03:30 | |
| *** esberglu has joined #openstack-infra | 03:31 | |
| *** wolverineav has quit IRC | 03:34 | |
| *** ramishra has quit IRC | 03:34 | |
| openstackgerrit | Kiran Thyagaraja proposed openstack-infra/project-config master: Add ansible-role-k8s-cinder to zuul.d https://review.openstack.org/534608 | 03:36 |
| *** ramishra has joined #openstack-infra | 03:38 | |
| *** iyamahat has joined #openstack-infra | 03:39 | |
| *** spzala has joined #openstack-infra | 03:40 | |
| *** sree has joined #openstack-infra | 03:40 | |
| *** sree has quit IRC | 03:41 | |
| *** sree has joined #openstack-infra | 03:41 | |
| *** caphrim007 has joined #openstack-infra | 03:41 | |
| *** yamahata has joined #openstack-infra | 03:42 | |
| *** ykarel has joined #openstack-infra | 03:45 | |
| *** bobh has quit IRC | 03:47 | |
| *** liujiong has quit IRC | 03:50 | |
| *** daidv has joined #openstack-infra | 03:50 | |
| *** liujiong has joined #openstack-infra | 03:50 | |
| *** vivsoni_ has quit IRC | 03:57 | |
| *** vivsoni_ has joined #openstack-infra | 03:58 | |
| *** vivsoni_ has quit IRC | 03:59 | |
| *** markvoelker has quit IRC | 04:01 | |
| *** olaph1 has joined #openstack-infra | 04:01 | |
| *** vivsoni_ has joined #openstack-infra | 04:01 | |
| *** olaph has quit IRC | 04:01 | |
| *** vivsoni_ has quit IRC | 04:01 | |
| *** vivsoni_ has joined #openstack-infra | 04:02 | |
| *** coolsvap has joined #openstack-infra | 04:05 | |
| *** nicolasbock has quit IRC | 04:09 | |
| *** jamesmcarthur has joined #openstack-infra | 04:10 | |
| *** jamesmcarthur has quit IRC | 04:14 | |
| *** wolverineav has joined #openstack-infra | 04:16 | |
| *** wolverineav has quit IRC | 04:20 | |
| *** david-lyle has joined #openstack-infra | 04:23 | |
| *** wolverineav has joined #openstack-infra | 04:23 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack-infra/zuul feature/zuulv3: Fix dependency cycle false positive https://review.openstack.org/534444 | 04:24 |
| *** jbadiapa_ has quit IRC | 04:25 | |
| *** jamesmcarthur has joined #openstack-infra | 04:25 | |
| clarkb | frickler: if you are around, I'm not sure if pabelanger mentioned it to you but he was planning on making new afs volumes for puppet package mirrors. Mentiond that you might be interested in the process | 04:26 |
| *** jamesmcarthur has quit IRC | 04:30 | |
| *** wolverineav has quit IRC | 04:30 | |
| *** dhajare|BNE|Mtg has quit IRC | 04:30 | |
| *** psachin has joined #openstack-infra | 04:31 | |
| *** psachin has quit IRC | 04:31 | |
| *** dave-mccowan has quit IRC | 04:32 | |
| *** bhavik1 has joined #openstack-infra | 04:32 | |
| *** psachin has joined #openstack-infra | 04:33 | |
| frickler | clarkb: pabelanger: ya, certainly interested, but difficult to find time for it currently. so don't wait for me on that, there'll be other opportunities I hope | 04:36 |
| *** zhurong has quit IRC | 04:36 | |
| *** jamesmcarthur has joined #openstack-infra | 04:39 | |
| *** bobh has joined #openstack-infra | 04:42 | |
| *** wolverineav has joined #openstack-infra | 04:46 | |
| *** jamesmcarthur has quit IRC | 04:48 | |
| *** jamesmcarthur has joined #openstack-infra | 04:48 | |
| *** andreas_s has joined #openstack-infra | 04:49 | |
| *** links has joined #openstack-infra | 04:49 | |
| *** gouthamr has joined #openstack-infra | 04:49 | |
| *** bobh has quit IRC | 04:50 | |
| *** wolverineav has quit IRC | 04:51 | |
| *** dhajare|BNE|Mtg has joined #openstack-infra | 04:52 | |
| *** gouthamr has quit IRC | 04:53 | |
| *** andreas_s has quit IRC | 04:53 | |
| *** lathiat has quit IRC | 04:54 | |
| *** markvoelker has joined #openstack-infra | 04:57 | |
| *** jamesmcarthur has quit IRC | 04:58 | |
| *** lathiat has joined #openstack-infra | 05:06 | |
| *** ankkumar has joined #openstack-infra | 05:07 | |
| *** hongbin has quit IRC | 05:09 | |
| *** hongbin has joined #openstack-infra | 05:12 | |
| dmsimard | ianw: replied to your comment about the IRC bot spec, thanks for bringing that up: https://review.openstack.org/#/c/531242/ | 05:14 |
| * dmsimard sleep | 05:14 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Remove unused method term_handler https://review.openstack.org/530202 | 05:16 |
| *** markvoelker has quit IRC | 05:16 | |
| *** spzala has quit IRC | 05:17 | |
| dmsimard | ianw, frickler: btw we landed the zuul-scheduler backups today so we have something we can restore from if we lose all the queues | 05:18 |
| dmsimard | See https://wiki.openstack.org/wiki/Infrastructure_Status | 05:18 |
| *** wolverineav has joined #openstack-infra | 05:19 | |
| *** robled has quit IRC | 05:19 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix dependency cycle false positive https://review.openstack.org/534444 | 05:20 |
| *** bhavik1 has quit IRC | 05:21 | |
| *** edmondsw has joined #openstack-infra | 05:21 | |
| *** rosmaita has quit IRC | 05:22 | |
| *** wolverineav has quit IRC | 05:24 | |
| *** edmondsw has quit IRC | 05:26 | |
| *** jamesmcarthur has joined #openstack-infra | 05:29 | |
| *** hongbin has quit IRC | 05:30 | |
| *** spzala has joined #openstack-infra | 05:32 | |
| *** spzala has quit IRC | 05:32 | |
| *** spzala has joined #openstack-infra | 05:34 | |
| *** vivsoni_ has quit IRC | 05:34 | |
| *** vivsoni_ has joined #openstack-infra | 05:36 | |
| *** vivsoni_ has quit IRC | 05:36 | |
| *** jamesmcarthur has quit IRC | 05:37 | |
| *** robled has joined #openstack-infra | 05:38 | |
| *** robled has joined #openstack-infra | 05:38 | |
| *** jamesmcarthur has joined #openstack-infra | 05:40 | |
| *** jamesmcarthur has quit IRC | 05:45 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Centrally register stack dump handler https://review.openstack.org/530203 | 05:47 |
| *** zhurong has joined #openstack-infra | 05:48 | |
| *** jamesmcarthur has joined #openstack-infra | 05:53 | |
| *** jamesmcarthur has quit IRC | 05:58 | |
| *** annp has joined #openstack-infra | 06:00 | |
| *** armax has quit IRC | 06:01 | |
| *** armax has joined #openstack-infra | 06:01 | |
| *** armax has quit IRC | 06:02 | |
| *** jamesmcarthur has joined #openstack-infra | 06:02 | |
| *** armax has joined #openstack-infra | 06:02 | |
| *** armax has quit IRC | 06:02 | |
| *** jamesmcarthur has quit IRC | 06:08 | |
| *** jamesmcarthur has joined #openstack-infra | 06:12 | |
| *** iyamahat has quit IRC | 06:17 | |
| *** olaph has joined #openstack-infra | 06:17 | |
| *** jamesmcarthur has quit IRC | 06:17 | |
| *** jbadiapa has joined #openstack-infra | 06:18 | |
| *** olaph1 has quit IRC | 06:19 | |
| *** spzala has quit IRC | 06:19 | |
| *** janki has joined #openstack-infra | 06:20 | |
| *** olaph1 has joined #openstack-infra | 06:26 | |
| *** jamesmcarthur has joined #openstack-infra | 06:27 | |
| *** olaph has quit IRC | 06:28 | |
| *** markvoelker has joined #openstack-infra | 06:28 | |
| *** jamesmcarthur has quit IRC | 06:31 | |
| *** jamesmcarthur has joined #openstack-infra | 06:34 | |
| ianw | it seems to not want to install in a container (good idea) ... i wonder if we can fool it | 06:36 |
| *** pgadiya has joined #openstack-infra | 06:39 | |
| *** jamesmcarthur has quit IRC | 06:39 | |
| bhagyashris | ianw: Hi, | 06:42 |
| *** ekcs has joined #openstack-infra | 06:42 | |
| ianw | bhagyashris: hello | 06:42 |
| bhagyashris | ianw: I need some help from you, Actually I have submitted patch https://review.openstack.org/#/c/527635/9 in glance and that was dependent on my devstack patch https://review.openstack.org/#/c/527907/ and that is mereged now which is basically generate the glance-image-import.conf | 06:45 |
| bhagyashris | ianw: so right now on my glance patch https://review.openstack.org/#/c/527635/9 zuul is failing even if the devstack patch is merged and that successfully generate that conf file using devstack | 06:47 |
| *** pcichy has joined #openstack-infra | 06:47 | |
| *** jamesmcarthur has joined #openstack-infra | 06:48 | |
| bhagyashris | ianw: right now neutron-grenade job is failing is #link: http://logs.openstack.org/35/527635/9/check/neutron-grenade/2bf3b47/logs/screen-g-api.txt.gz | 06:49 |
| bhagyashris | ianw: with the error raise ConfigFilesNotFoundError(self._namespace._files_not_found) | 06:49 |
| bhagyashris | Jan 16 11:56:27.467555 ubuntu-xenial-rax-ord-0001922144 devstack@g-api.service[4220]: oslo_config.cfg.ConfigFilesNotFoundError: Failed to find some config files: /etc/glance/glance-image-import.conf | 06:49 |
| *** ekcs has quit IRC | 06:49 | |
| *** spzala has joined #openstack-infra | 06:50 | |
| ianw | Implements: I6a7ed31d5fae677cbbc9a6f6053f79d3e9326561 isn't a thing, do you mean Depends-On: ? | 06:52 |
| bhagyashris | ianw: on glance patch right? | 06:53 |
| ianw | in https://review.openstack.org/#/c/527635/ | 06:53 |
| ianw | ok, so "oslo_config.cfg.ConfigFilesNotFoundError: Failed to find some config files: /etc/glance/glance-image-import.conf" | 06:54 |
| *** spzala has quit IRC | 06:54 | |
| *** ramishra has quit IRC | 06:54 | |
| bhagyashris | ianw: in the the implements i have given the reference of glance-spec | 06:55 |
| ianw | oh, ok, well yeah, your code is merged into devstack | 06:56 |
| bhagyashris | and earlier on patch set 8 there was depends-on devstack patch reference so that i have removed yesterday and pushed patch again | 06:56 |
| bhagyashris | ianw: but still it's failing :( | 06:57 |
| bhagyashris | ianw: yeah | 06:57 |
| *** jamesmcarthur has quit IRC | 06:57 | |
| openstackgerrit | Merged openstack-infra/subunit2sql master: Add subunit2sql CLI option to use non_subunit_name https://review.openstack.org/507192 | 07:01 |
| bhagyashris | ianw: tried to find alot why it's failing but didn't get you have any idea | 07:01 |
| *** makowals has joined #openstack-infra | 07:01 | |
| *** markvoelker has quit IRC | 07:02 | |
| *** olaph has joined #openstack-infra | 07:03 | |
| ianw | bhagyashris: well it's failing in grenade ... on the old side (stable/pike). | 07:04 |
| ianw | you either need to make sure you're implementation is backwards compatible, or port the devstack changes back to stable/pike branch | 07:05 |
| *** olaph1 has quit IRC | 07:05 | |
| bhagyashris | ianw: ohh ok, how can you find this | 07:05 |
| bhagyashris | that this is failing on stable/pike | 07:05 |
| ianw | bhagyashris: just parsing through http://logs.openstack.org/35/527635/9/check/neutron-grenade/844a25d/logs/grenade.sh.txt.gz and seeing it's on the "old" side | 07:06 |
| *** ramishra has joined #openstack-infra | 07:07 | |
| *** jamesmcarthur has joined #openstack-infra | 07:08 | |
| bhagyashris | ianw: thank you so much :) i will backport my devstack patch to stable/pike | 07:09 |
| *** edmondsw has joined #openstack-infra | 07:09 | |
| bhagyashris | ianw: and will add as reviewer please review and thank you in advanced | 07:09 |
| ianw | bhagyashris: well, i'm not sure that's appropriate in this case -- see https://github.com/openstack-dev/grenade#theory-of-upgrade . new code should work with old configs | 07:11 |
| ianw | it's probably something worth discussing with the glance team | 07:12 |
| *** jamesmcarthur has quit IRC | 07:12 | |
| bhagyashris | ianw: ok i will discuss this point with them as well thank you :) | 07:12 |
| *** andreas_s has joined #openstack-infra | 07:14 | |
| *** edmondsw has quit IRC | 07:14 | |
| *** abhishekk has joined #openstack-infra | 07:16 | |
| *** jamesmcarthur has joined #openstack-infra | 07:17 | |
| *** iyamahat has joined #openstack-infra | 07:19 | |
| *** tojuvone has joined #openstack-infra | 07:19 | |
| *** tojuvone has left #openstack-infra | 07:20 | |
| *** dhajare|BNE|Mtg has quit IRC | 07:20 | |
| *** iyamahat has quit IRC | 07:20 | |
| *** dhajare|BNE|Mtg has joined #openstack-infra | 07:20 | |
| *** spzala has joined #openstack-infra | 07:20 | |
| *** threestrands_ has quit IRC | 07:20 | |
| *** jamesmcarthur has quit IRC | 07:21 | |
| *** dsariel has joined #openstack-infra | 07:21 | |
| *** armaan has joined #openstack-infra | 07:22 | |
| *** spzala has quit IRC | 07:25 | |
| *** jamesmcarthur has joined #openstack-infra | 07:25 | |
| *** wolverineav has joined #openstack-infra | 07:27 | |
| *** olaph1 has joined #openstack-infra | 07:28 | |
| *** jkilpatr has quit IRC | 07:28 | |
| *** olaph has quit IRC | 07:29 | |
| *** jamesmcarthur has quit IRC | 07:29 | |
| *** wolverineav has quit IRC | 07:31 | |
| *** spzala has joined #openstack-infra | 07:33 | |
| *** ykarel has quit IRC | 07:36 | |
| *** armaan has quit IRC | 07:38 | |
| *** jamesmcarthur has joined #openstack-infra | 07:38 | |
| *** ykarel has joined #openstack-infra | 07:38 | |
| *** spzala has quit IRC | 07:38 | |
| *** jkilpatr has joined #openstack-infra | 07:39 | |
| *** wolverineav has joined #openstack-infra | 07:40 | |
| *** claudiub has joined #openstack-infra | 07:40 | |
| *** jamesmcarthur has quit IRC | 07:43 | |
| *** ykarel has quit IRC | 07:43 | |
| *** ykarel has joined #openstack-infra | 07:43 | |
| *** wolverineav has quit IRC | 07:44 | |
| *** spzala has joined #openstack-infra | 07:45 | |
| *** lathiat has quit IRC | 07:46 | |
| *** vsaienk0 has joined #openstack-infra | 07:47 | |
| *** dingyichen has quit IRC | 07:48 | |
| *** pcaruana has joined #openstack-infra | 07:48 | |
| *** olaph has joined #openstack-infra | 07:48 | |
| *** jamesmcarthur has joined #openstack-infra | 07:49 | |
| *** olaph1 has quit IRC | 07:49 | |
| *** spzala has quit IRC | 07:50 | |
| *** spzala has joined #openstack-infra | 07:51 | |
| *** liujiong has quit IRC | 07:52 | |
| *** honza has quit IRC | 07:53 | |
| *** lathiat has joined #openstack-infra | 07:53 | |
| *** jamesmcarthur has quit IRC | 07:53 | |
| *** wolverineav has joined #openstack-infra | 07:53 | |
| *** liujiong has joined #openstack-infra | 07:54 | |
| *** pcaruana has quit IRC | 07:55 | |
| *** pcaruana has joined #openstack-infra | 07:55 | |
| *** spzala has quit IRC | 07:56 | |
| *** spzala has joined #openstack-infra | 07:57 | |
| *** wolverineav has quit IRC | 07:58 | |
| *** markvoelker has joined #openstack-infra | 07:58 | |
| *** liujiong has quit IRC | 07:58 | |
| *** danpawlik has quit IRC | 08:00 | |
| *** jamesmcarthur has joined #openstack-infra | 08:01 | |
| *** spzala has quit IRC | 08:01 | |
| *** dhajare|BNE|Mtg has quit IRC | 08:01 | |
| *** dhajare|BNE|Mtg has joined #openstack-infra | 08:03 | |
| *** danpawlik has joined #openstack-infra | 08:04 | |
| *** jamesmcarthur has quit IRC | 08:05 | |
| *** florianf has joined #openstack-infra | 08:06 | |
| *** spzala has joined #openstack-infra | 08:06 | |
| *** wolverineav has joined #openstack-infra | 08:07 | |
| *** dhajare|BNE|Mtg has quit IRC | 08:07 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Add memory awareness to system load governor https://review.openstack.org/508960 | 08:08 |
| *** wolverineav has quit IRC | 08:11 | |
| *** spzala has quit IRC | 08:11 | |
| AJaeger | tobiash: Guten Morgen! could you review https://review.openstack.org/#/c/532688/ as well, please? It's part of mordred's fetch-subunit stack. | 08:13 |
| tobiash | AJaeger: hi, looking | 08:13 |
| AJaeger | thanks | 08:14 |
| *** shardy has joined #openstack-infra | 08:14 | |
| tobiash | lgtm | 08:14 |
| *** jamesmcarthur has joined #openstack-infra | 08:15 | |
| AJaeger | ianw: could you review https://review.openstack.org/#/c/529341/ for devstack, please? It uses the new fetch-subunit so that we can remove the old roles | 08:16 |
| *** amoralej|off is now known as amoralej | 08:17 | |
| *** b_bezak has joined #openstack-infra | 08:17 | |
| *** spzala has joined #openstack-infra | 08:19 | |
| *** jamesmcarthur has quit IRC | 08:21 | |
| *** alexchadin has joined #openstack-infra | 08:22 | |
| *** spzala has quit IRC | 08:24 | |
| *** shardy is now known as shardy_afk | 08:25 | |
| *** cshastri has joined #openstack-infra | 08:29 | |
| *** tesseract has joined #openstack-infra | 08:29 | |
| *** jamesmcarthur has joined #openstack-infra | 08:29 | |
| *** dsariel has quit IRC | 08:30 | |
| *** spzala has joined #openstack-infra | 08:31 | |
| *** markvoelker has quit IRC | 08:32 | |
| *** jamesmcarthur has quit IRC | 08:34 | |
| *** spzala has quit IRC | 08:35 | |
| *** ykarel has quit IRC | 08:36 | |
| *** jamesmcarthur has joined #openstack-infra | 08:37 | |
| *** jamesmcarthur has quit IRC | 08:42 | |
| *** pcichy has quit IRC | 08:42 | |
| *** mandre is now known as mandre_afk | 08:44 | |
| *** rcernin has quit IRC | 08:45 | |
| *** jamesmcarthur has joined #openstack-infra | 08:47 | |
| *** spzala has joined #openstack-infra | 08:50 | |
| *** shardy_afk is now known as shardy | 08:52 | |
| *** ralonsoh has joined #openstack-infra | 08:53 | |
| *** jamesmcarthur has quit IRC | 08:53 | |
| *** psachin` has joined #openstack-infra | 08:54 | |
| *** spzala has quit IRC | 08:54 | |
| *** psachin has quit IRC | 08:54 | |
| *** jpena|off is now known as jpena | 08:57 | |
| *** edmondsw has joined #openstack-infra | 08:58 | |
| AJaeger | jamespage: regarding https://review.openstack.org/533273, see the needed-by... | 08:58 |
| *** jpich has joined #openstack-infra | 08:58 | |
| AJaeger | jamespage: indeed, missing - sorry, wrong review | 08:59 |
| *** annp has quit IRC | 09:01 | |
| *** cuongnv has quit IRC | 09:01 | |
| *** daidv has quit IRC | 09:01 | |
| *** jamesmcarthur has joined #openstack-infra | 09:01 | |
| *** spzala has joined #openstack-infra | 09:01 | |
| *** annp has joined #openstack-infra | 09:01 | |
| *** daidv has joined #openstack-infra | 09:01 | |
| *** cuongnv has joined #openstack-infra | 09:01 | |
| *** edmondsw has quit IRC | 09:02 | |
| *** StevenK has quit IRC | 09:02 | |
| *** ykarel has joined #openstack-infra | 09:04 | |
| *** jamesmcarthur has quit IRC | 09:05 | |
| *** spzala has quit IRC | 09:06 | |
| *** psachin` has quit IRC | 09:09 | |
| *** jamesmcarthur has joined #openstack-infra | 09:11 | |
| *** psachin has joined #openstack-infra | 09:13 | |
| *** jamesmcarthur has quit IRC | 09:15 | |
| *** StevenK has joined #openstack-infra | 09:17 | |
| *** jamesmcarthur has joined #openstack-infra | 09:20 | |
| *** Kevin_Zheng has quit IRC | 09:23 | |
| *** jamesmcarthur has quit IRC | 09:24 | |
| *** jamesmcarthur has joined #openstack-infra | 09:27 | |
| *** stakeda has quit IRC | 09:28 | |
| *** markvoelker has joined #openstack-infra | 09:29 | |
| *** jamesmcarthur has quit IRC | 09:32 | |
| *** dsariel has joined #openstack-infra | 09:38 | |
| *** derekh has joined #openstack-infra | 09:39 | |
| *** rcernin has joined #openstack-infra | 09:40 | |
| *** arxcruz|off is now known as arxcruz|rover | 09:42 | |
| *** jamesmcarthur has joined #openstack-infra | 09:43 | |
| *** e0ne has joined #openstack-infra | 09:47 | |
| *** jamesmcarthur has quit IRC | 09:47 | |
| *** xinliang has quit IRC | 09:48 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Adjust check for .stestr directory https://review.openstack.org/532688 | 09:48 |
| *** wolverineav has joined #openstack-infra | 09:48 | |
| *** yamamoto has quit IRC | 09:49 | |
| *** wolverineav has quit IRC | 09:52 | |
| *** sshnaidm|off is now known as sshnaidm | 09:54 | |
| *** wolverineav has joined #openstack-infra | 09:55 | |
| *** jamesmcarthur has joined #openstack-infra | 09:55 | |
| *** yamamoto has joined #openstack-infra | 09:57 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Clean up when conditions in fetch-subunit-output https://review.openstack.org/534428 | 09:57 |
| *** jamesmcarthur has quit IRC | 10:00 | |
| *** xinliang has joined #openstack-infra | 10:00 | |
| *** lathiat has quit IRC | 10:01 | |
| *** sree has quit IRC | 10:02 | |
| *** markvoelker has quit IRC | 10:02 | |
| *** sree has joined #openstack-infra | 10:03 | |
| *** wolverineav has quit IRC | 10:03 | |
| *** lathiat has joined #openstack-infra | 10:03 | |
| *** wolverineav has joined #openstack-infra | 10:05 | |
| *** cuongnv has quit IRC | 10:06 | |
| *** spzala has joined #openstack-infra | 10:07 | |
| *** annp has quit IRC | 10:09 | |
| *** sree has quit IRC | 10:09 | |
| *** jamesmcarthur has joined #openstack-infra | 10:10 | |
| *** wolverineav has quit IRC | 10:10 | |
| *** ramishra has quit IRC | 10:12 | |
| *** spzala has quit IRC | 10:12 | |
| *** ramishra has joined #openstack-infra | 10:13 | |
| *** jamesmcarthur has quit IRC | 10:14 | |
| *** kjackal has joined #openstack-infra | 10:15 | |
| *** ganso has joined #openstack-infra | 10:16 | |
| *** jamesmcarthur has joined #openstack-infra | 10:20 | |
| *** wolverineav has joined #openstack-infra | 10:21 | |
| *** spzala has joined #openstack-infra | 10:21 | |
| *** dbecker has joined #openstack-infra | 10:23 | |
| *** tosky has joined #openstack-infra | 10:23 | |
| *** pbourke has quit IRC | 10:24 | |
| *** jamesmcarthur has quit IRC | 10:25 | |
| *** pbourke has joined #openstack-infra | 10:26 | |
| *** spzala has quit IRC | 10:26 | |
| *** aspiers has quit IRC | 10:27 | |
| *** sambetts|afk is now known as sambetts | 10:28 | |
| *** jamesmcarthur has joined #openstack-infra | 10:30 | |
| *** wolverineav has quit IRC | 10:30 | |
| *** yamamoto has quit IRC | 10:31 | |
| *** yamamoto has joined #openstack-infra | 10:31 | |
| *** yamamoto has quit IRC | 10:31 | |
| *** mandre_afk is now known as mandre | 10:33 | |
| *** spzala has joined #openstack-infra | 10:33 | |
| *** jamesmcarthur has quit IRC | 10:34 | |
| *** ldnunes has joined #openstack-infra | 10:35 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Only fail requests if no cloud can service them https://review.openstack.org/533372 | 10:37 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: handler: fix support for handler without launch_manager https://review.openstack.org/524773 | 10:37 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Add a plugin interface for drivers https://review.openstack.org/524620 | 10:37 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: builder: do not cleanup image for driver not managing image https://review.openstack.org/516920 | 10:37 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement a static driver for Nodepool https://review.openstack.org/468624 | 10:37 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Refactor run_handler to be generic https://review.openstack.org/526325 | 10:37 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Refactor NodeLauncher to be generic https://review.openstack.org/532450 | 10:37 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement an OpenContainer driver https://review.openstack.org/468753 | 10:37 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement a Kubernetes driver https://review.openstack.org/521356 | 10:37 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement an Amazon EC2 driver https://review.openstack.org/528982 | 10:37 |
| *** spzala has quit IRC | 10:37 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Add test_launcher test https://review.openstack.org/533771 | 10:38 |
| *** wolverineav has joined #openstack-infra | 10:39 | |
| *** olaph1 has joined #openstack-infra | 10:39 | |
| *** jamesmcarthur has joined #openstack-infra | 10:39 | |
| *** olaph has quit IRC | 10:41 | |
| *** olaph has joined #openstack-infra | 10:42 | |
| *** zhurong has quit IRC | 10:43 | |
| *** olaph1 has quit IRC | 10:44 | |
| *** wolverineav has quit IRC | 10:44 | |
| *** jamesmcarthur has quit IRC | 10:44 | |
| *** jamesmcarthur has joined #openstack-infra | 10:45 | |
| *** wolverineav has joined #openstack-infra | 10:47 | |
| *** priteau has joined #openstack-infra | 10:49 | |
| *** jamesmcarthur has quit IRC | 10:51 | |
| *** wolverineav has quit IRC | 10:52 | |
| *** jamesmcarthur has joined #openstack-infra | 10:52 | |
| *** spzala has joined #openstack-infra | 10:53 | |
| *** efried has quit IRC | 10:56 | |
| *** dtantsur|afk is now known as dtantsur | 10:57 | |
| *** erlon has joined #openstack-infra | 10:57 | |
| *** jamesmcarthur has quit IRC | 10:57 | |
| *** dims has quit IRC | 10:57 | |
| *** spzala has quit IRC | 10:58 | |
| *** dims has joined #openstack-infra | 10:58 | |
| *** markvoelker has joined #openstack-infra | 11:00 | |
| *** andreas_s has quit IRC | 11:01 | |
| *** andreas_s has joined #openstack-infra | 11:01 | |
| *** jamesmcarthur has joined #openstack-infra | 11:02 | |
| *** spzala has joined #openstack-infra | 11:02 | |
| *** jamesmcarthur has quit IRC | 11:06 | |
| *** spzala has quit IRC | 11:07 | |
| *** hrw has quit IRC | 11:08 | |
| *** jamesmcarthur has joined #openstack-infra | 11:09 | |
| *** andreas_s has quit IRC | 11:10 | |
| *** rfolco has joined #openstack-infra | 11:11 | |
| *** alexchadin has quit IRC | 11:13 | |
| *** janki has quit IRC | 11:13 | |
| *** jamesmcarthur has quit IRC | 11:14 | |
| *** spzala has joined #openstack-infra | 11:14 | |
| *** andreas_s has joined #openstack-infra | 11:16 | |
| *** jamesmcarthur has joined #openstack-infra | 11:18 | |
| *** alexchadin has joined #openstack-infra | 11:18 | |
| *** spzala has quit IRC | 11:19 | |
| *** jamesmcarthur has quit IRC | 11:22 | |
| *** spzala has joined #openstack-infra | 11:23 | |
| *** andreas_s has quit IRC | 11:25 | |
| *** dizquierdo has joined #openstack-infra | 11:26 | |
| *** andreas_s has joined #openstack-infra | 11:26 | |
| *** spzala has quit IRC | 11:28 | |
| *** jamesmcarthur has joined #openstack-infra | 11:29 | |
| *** spzala has joined #openstack-infra | 11:30 | |
| *** andreas_s has quit IRC | 11:30 | |
| *** andreas_s has joined #openstack-infra | 11:31 | |
| *** yamamoto has joined #openstack-infra | 11:32 | |
| *** yamamoto has quit IRC | 11:32 | |
| *** yamamoto has joined #openstack-infra | 11:32 | |
| *** markvoelker has quit IRC | 11:32 | |
| *** nicolasbock has joined #openstack-infra | 11:33 | |
| *** jamesmcarthur has quit IRC | 11:34 | |
| *** spzala has quit IRC | 11:34 | |
| *** abhishekk has quit IRC | 11:37 | |
| *** spzala has joined #openstack-infra | 11:39 | |
| *** jamesmcarthur has joined #openstack-infra | 11:40 | |
| *** vsaienk0 has quit IRC | 11:43 | |
| *** spzala has quit IRC | 11:44 | |
| *** jamesmcarthur has quit IRC | 11:44 | |
| *** jamesmcarthur has joined #openstack-infra | 11:46 | |
| cmurphy | I think sphinx 1.6.6 broke keystone's autodoc builds :'( http://logs.openstack.org/48/532248/2/gate/build-openstack-sphinx-docs/bbd58f6/job-output.txt.gz#_2018-01-17_10_06_55_533900 | 11:46 |
| cmurphy | not that that's infra's fault but it might be affecting other projects too | 11:46 |
| *** vsaienk0 has joined #openstack-infra | 11:47 | |
| *** jamesmcarthur has quit IRC | 11:51 | |
| *** rhallisey has joined #openstack-infra | 11:53 | |
| *** spzala has joined #openstack-infra | 11:53 | |
| *** coolsvap has quit IRC | 11:55 | |
| *** jamesmcarthur has joined #openstack-infra | 11:58 | |
| *** spzala has quit IRC | 11:58 | |
| *** alexchadin has quit IRC | 12:02 | |
| *** jamesmcarthur has quit IRC | 12:02 | |
| *** alexchadin has joined #openstack-infra | 12:03 | |
| *** spzala has joined #openstack-infra | 12:06 | |
| *** jkilpatr has quit IRC | 12:07 | |
| *** jamesmcarthur has joined #openstack-infra | 12:07 | |
| *** jkilpatr has joined #openstack-infra | 12:09 | |
| *** spzala has quit IRC | 12:11 | |
| *** dizquierdo has quit IRC | 12:11 | |
| *** sshnaidm is now known as sshnaidm|afk | 12:11 | |
| *** jamesmcarthur has quit IRC | 12:12 | |
| *** shardy is now known as shardy_lunch | 12:12 | |
| *** pgadiya has quit IRC | 12:12 | |
| *** smatzek has joined #openstack-infra | 12:13 | |
| *** rcernin has quit IRC | 12:14 | |
| *** pgadiya has joined #openstack-infra | 12:15 | |
| openstackgerrit | Dmitrii Shcherbakov proposed openstack-infra/project-config master: add charm-panko to project-config https://review.openstack.org/533273 | 12:15 |
| openstackgerrit | Dmitrii Shcherbakov proposed openstack-infra/project-config master: add system-req template and jobs for charm-panko https://review.openstack.org/533274 | 12:15 |
| *** sshnaidm|afk has quit IRC | 12:16 | |
| *** jamesmcarthur has joined #openstack-infra | 12:20 | |
| *** spzala has joined #openstack-infra | 12:20 | |
| *** pgadiya has quit IRC | 12:21 | |
| *** jaypipes has joined #openstack-infra | 12:24 | |
| *** jamesmcarthur has quit IRC | 12:25 | |
| *** spzala has quit IRC | 12:26 | |
| *** markvoelker has joined #openstack-infra | 12:29 | |
| *** spzala has joined #openstack-infra | 12:30 | |
| *** jamesmcarthur has joined #openstack-infra | 12:32 | |
| *** pgadiya has joined #openstack-infra | 12:34 | |
| *** edmondsw has joined #openstack-infra | 12:34 | |
| *** spzala has quit IRC | 12:35 | |
| *** wolverineav has joined #openstack-infra | 12:36 | |
| *** jamesmcarthur has quit IRC | 12:36 | |
| *** edmondsw has quit IRC | 12:38 | |
| *** dprince has joined #openstack-infra | 12:40 | |
| *** jpena is now known as jpena|lunch | 12:45 | |
| *** dave-mccowan has joined #openstack-infra | 12:45 | |
| *** spzala has joined #openstack-infra | 12:46 | |
| *** jamesmcarthur has joined #openstack-infra | 12:48 | |
| *** kiennt26_ has joined #openstack-infra | 12:48 | |
| *** eharney has joined #openstack-infra | 12:49 | |
| *** ethfci has quit IRC | 12:49 | |
| *** spzala has quit IRC | 12:50 | |
| *** verdurin_ is now known as verdurin | 12:51 | |
| *** ralonsoh has quit IRC | 12:51 | |
| *** ralonsoh_ has joined #openstack-infra | 12:51 | |
| *** jamesmcarthur has quit IRC | 12:53 | |
| *** alexchadin has quit IRC | 12:53 | |
| *** janki has joined #openstack-infra | 12:54 | |
| *** sshnaidm|afk has joined #openstack-infra | 12:55 | |
| *** spzala has joined #openstack-infra | 12:55 | |
| *** sshnaidm|afk is now known as sshnaidm | 12:55 | |
| *** ykarel has quit IRC | 12:57 | |
| *** alexchadin has joined #openstack-infra | 12:57 | |
| *** jamesmcarthur has joined #openstack-infra | 12:58 | |
| *** spzala has quit IRC | 12:59 | |
| *** ykarel has joined #openstack-infra | 13:00 | |
| *** aspiers has joined #openstack-infra | 13:01 | |
| *** jamesmcarthur has quit IRC | 13:02 | |
| *** oidgar has joined #openstack-infra | 13:03 | |
| *** markvoelker has quit IRC | 13:03 | |
| oidgar | hi, for both tripleo-common and tripleo-heat-templates I'm getting timeouts from several gates - for instance most of times it happens in "tripleo-ci-centos-7-ovb-ha-oooq" | 13:05 |
| oidgar | Is there something we can do to improve it? | 13:05 |
| *** bobh has joined #openstack-infra | 13:07 | |
| *** adarazs is now known as adarazs_lunch | 13:08 | |
| *** amoralej is now known as amoralej|lunch | 13:08 | |
| *** spzala has joined #openstack-infra | 13:09 | |
| *** jamesmcarthur has joined #openstack-infra | 13:09 | |
| *** nicolasbock has quit IRC | 13:11 | |
| *** trown|outtypewww is now known as trown | 13:12 | |
| *** spzala has quit IRC | 13:13 | |
| *** jamesmcarthur has quit IRC | 13:13 | |
| *** shardy_lunch is now known as shardy | 13:16 | |
| *** jamesmcarthur has joined #openstack-infra | 13:20 | |
| *** markvoelker has joined #openstack-infra | 13:21 | |
| *** olaph1 has joined #openstack-infra | 13:23 | |
| *** jamesmcarthur has quit IRC | 13:24 | |
| *** olaph has quit IRC | 13:25 | |
| *** rlandy has joined #openstack-infra | 13:30 | |
| *** kiennt26 has quit IRC | 13:30 | |
| *** jamesmcarthur has joined #openstack-infra | 13:31 | |
| *** spzala has joined #openstack-infra | 13:35 | |
| *** jamesmcarthur has quit IRC | 13:35 | |
| *** hrw has joined #openstack-infra | 13:37 | |
| *** spzala has quit IRC | 13:39 | |
| *** bobh has quit IRC | 13:40 | |
| *** ankkumar has quit IRC | 13:40 | |
| AJaeger | SamYaple: all your loci requirements jobs fail, please see http://zuulv3.openstack.org/builds.html?job_name=publish-loci-requirements | 13:42 |
| *** jamesmcarthur has joined #openstack-infra | 13:45 | |
| *** edmondsw has joined #openstack-infra | 13:45 | |
| *** alexchadin has quit IRC | 13:46 | |
| *** kiennt26_ has quit IRC | 13:46 | |
| *** jpena|lunch is now known as jpena | 13:48 | |
| *** jamesmcarthur has quit IRC | 13:49 | |
| *** esberglu has quit IRC | 13:54 | |
| *** jamesmcarthur has joined #openstack-infra | 13:55 | |
| *** andreas_s has quit IRC | 13:56 | |
| *** Goneri has joined #openstack-infra | 13:56 | |
| *** andreas_s has joined #openstack-infra | 13:56 | |
| *** kgiusti has joined #openstack-infra | 13:57 | |
| *** kgiusti has quit IRC | 13:58 | |
| *** pgadiya has quit IRC | 13:58 | |
| *** kgiusti has joined #openstack-infra | 13:58 | |
| *** spzala has joined #openstack-infra | 13:59 | |
| *** jamesmcarthur has quit IRC | 14:00 | |
| *** jamesmcarthur has joined #openstack-infra | 14:02 | |
| *** armaan has joined #openstack-infra | 14:03 | |
| *** spzala has quit IRC | 14:03 | |
| *** andreas_s has quit IRC | 14:05 | |
| *** spzala has joined #openstack-infra | 14:05 | |
| *** andreas_s has joined #openstack-infra | 14:05 | |
| *** hashar is now known as hasharAway | 14:06 | |
| *** jamesmcarthur has quit IRC | 14:06 | |
| *** sree has joined #openstack-infra | 14:09 | |
| *** spzala has quit IRC | 14:10 | |
| *** camunoz has joined #openstack-infra | 14:10 | |
| *** esberglu has joined #openstack-infra | 14:12 | |
| openstackgerrit | Merged openstack-dev/pbr master: deprecations: Deprecate support for '-py{N}' requirements https://review.openstack.org/512306 | 14:14 |
| *** spzala has joined #openstack-infra | 14:16 | |
| *** kiennt26 has joined #openstack-infra | 14:16 | |
| *** jamesmcarthur has joined #openstack-infra | 14:17 | |
| *** lathiat has quit IRC | 14:17 | |
| *** bobh has joined #openstack-infra | 14:18 | |
| *** spzala has quit IRC | 14:21 | |
| *** jamesmcarthur has quit IRC | 14:21 | |
| *** spzala has joined #openstack-infra | 14:23 | |
| mgagne | we enabled this feature in inap-mtl01 to counter out of sync quota usages: http://www.dorm.org/blog/nova-max_age-and-until_refresh-settings-for-easing-quotas-pain/ | 14:23 |
| mgagne | lets see how it goes | 14:23 |
| *** smatzek has quit IRC | 14:24 | |
| *** smatzek has joined #openstack-infra | 14:25 | |
| *** amoralej|lunch is now known as amoralej | 14:28 | |
| *** spzala has quit IRC | 14:28 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Rename _useBuilder method to useBuilder https://review.openstack.org/531883 | 14:29 |
| *** smatzek has quit IRC | 14:29 | |
| *** jamesmcarthur has joined #openstack-infra | 14:31 | |
| *** spzala has joined #openstack-infra | 14:31 | |
| *** lathiat has joined #openstack-infra | 14:32 | |
| *** vsaienk0 has quit IRC | 14:35 | |
| *** jamesmcarthur has quit IRC | 14:35 | |
| *** spzala has quit IRC | 14:36 | |
| *** vsaienk0 has joined #openstack-infra | 14:36 | |
| *** jamesmcarthur has joined #openstack-infra | 14:37 | |
| *** david-lyle has quit IRC | 14:37 | |
| *** jamesmcarthur has quit IRC | 14:41 | |
| *** bobh has quit IRC | 14:42 | |
| *** jcoufal has joined #openstack-infra | 14:42 | |
| *** dhill_ has joined #openstack-infra | 14:43 | |
| *** adarazs_lunch is now known as adarazs | 14:45 | |
| *** sshnaidm is now known as sshnaidm|mtg | 14:46 | |
| *** spzala has joined #openstack-infra | 14:46 | |
| *** jamesmcarthur has joined #openstack-infra | 14:46 | |
| *** ianychoi has quit IRC | 14:48 | |
| openstackgerrit | Merged openstack-dev/hacking master: Transition to flake8 2.6.x https://review.openstack.org/514934 | 14:50 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking master: Updated from global requirements https://review.openstack.org/520377 | 14:51 |
| *** ianychoi has joined #openstack-infra | 14:52 | |
| *** spzala has quit IRC | 14:52 | |
| *** spzala has joined #openstack-infra | 14:52 | |
| *** andreas_s has quit IRC | 14:54 | |
| *** andreas_s has joined #openstack-infra | 14:54 | |
| *** sree has quit IRC | 14:54 | |
| *** sree has joined #openstack-infra | 14:55 | |
| *** felipemonteiro has joined #openstack-infra | 14:55 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:57 | |
| *** sree has quit IRC | 15:00 | |
| *** jaosorior has quit IRC | 15:00 | |
| *** felipemonteiro has quit IRC | 15:01 | |
| mordred | dhellmann, AJaeger: https://review.openstack.org/#/c/534768/1 is the ironic patch that fixed things fr them | 15:02 |
| mordred | I don't know if that applies to the keystone fail case though | 15:03 |
| dhellmann | mordred : no, that's a different problem | 15:03 |
| mordred | kk | 15:03 |
| *** mdbooth has quit IRC | 15:03 | |
| *** ari[m] has quit IRC | 15:03 | |
| dhellmann | when I run the openstackclient doc build it doesn't generate any api reference files at all with 1.6.6 | 15:03 |
| *** andreas_s has quit IRC | 15:03 | |
| dhellmann | oh, hrm, or 1.6.5 | 15:03 |
| mordred | awesome | 15:03 |
| dhellmann | so maybe that's not what broke that build | 15:03 |
| *** ykarel is now known as ykarel|away | 15:04 | |
| dhellmann | oh, I think we're relying on pbr to auto-generate those files? | 15:05 |
| openstackgerrit | Merged openstack-infra/release-tools master: bugs-fixed-since: add argument to list StoryBoard entries https://review.openstack.org/533730 | 15:05 |
| openstackgerrit | Bernard Cafarelli proposed openstack-infra/release-tools master: Add StoryBoard filter and tag tools https://review.openstack.org/534808 | 15:06 |
| AJaeger | dhellmann: yes, pbr should autogenerate them | 15:06 |
| *** ari[m] has joined #openstack-infra | 15:06 | |
| *** mdbooth has joined #openstack-infra | 15:06 | |
| *** wolverineav has quit IRC | 15:06 | |
| dhellmann | AJaeger : I wonder if this is because we're using sphinx-build instead of python setup.py build_sphinx? | 15:06 |
| *** wolverineav has joined #openstack-infra | 15:07 | |
| cmurphy | in keystone's case we're using python setup.py build_sphinx | 15:07 |
| dhellmann | cmurphy : not in the gate | 15:07 |
| AJaeger | dhellmann: depending on settings, we use setup.py - mordred ? | 15:07 |
| dhellmann | oh, really? | 15:07 |
| cmurphy | http://logs.openstack.org/25/534025/13/check/build-openstack-sphinx-docs/babfe96/job-output.txt.gz#_2018-01-17_07_21_26_546587 | 15:08 |
| cmurphy | "legacy pbr runner" | 15:08 |
| AJaeger | dhellmann: http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/sphinx/tasks/main.yaml#n48 | 15:08 |
| dhellmann | well, harumph | 15:08 |
| *** sean-k-mooney has joined #openstack-infra | 15:09 | |
| *** felipemonteiro_ has quit IRC | 15:09 | |
| dhellmann | so how does one set that for a project? which of the various zuul config files do I need to edit for python-openstackclient? | 15:09 |
| *** felipemonteiro has joined #openstack-infra | 15:10 | |
| AJaeger | dhellmann: http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/sphinx/library/sphinx_check_warning_is_error.py figures out whether autodoc is used | 15:10 |
| *** smatzek has joined #openstack-infra | 15:10 | |
| AJaeger | dhellmann: so, it should just work... | 15:10 |
| sean-k-mooney | dhellmann: smcginnis hi o/ could ye take a look at https://review.openstack.org/#/c/534807/ when ye get a change. we need to rev os-vif again before the non-client lib freeze tomorow | 15:11 |
| *** links has quit IRC | 15:11 | |
| dhellmann | AJaeger : ok | 15:11 |
| *** wolverineav has quit IRC | 15:11 | |
| *** bobh has joined #openstack-infra | 15:12 | |
| *** armax has joined #openstack-infra | 15:14 | |
| *** efried_ has joined #openstack-infra | 15:14 | |
| *** jamesmcarthur has quit IRC | 15:14 | |
| *** rosmaita has joined #openstack-infra | 15:16 | |
| *** ykarel|away has quit IRC | 15:17 | |
| *** andreas_s has joined #openstack-infra | 15:17 | |
| *** sree has joined #openstack-infra | 15:17 | |
| dhellmann | AJaeger : ok, switching tox.ini to run setup.py fixes that part of the problem and now I'm getting the "not included in toctree" error | 15:18 |
| AJaeger | ;( | 15:18 |
| pabelanger | mgagne: thanks, will keep an eye out | 15:20 |
| *** jamesmcarthur has joined #openstack-infra | 15:21 | |
| dhellmann | AJaeger : the generated rst files for 1.6.5 and 1.6.6 are different | 15:22 |
| *** sree has quit IRC | 15:22 | |
| AJaeger | argh ;( | 15:22 |
| dhellmann | under 1.6.6 the toctree directive for the submodules is not present at all | 15:23 |
| *** jamesmcarthur has quit IRC | 15:25 | |
| *** andreas_s has quit IRC | 15:25 | |
| corvus | ianw, dmsimard: replied on 531242 | 15:26 |
| *** andreas_s has joined #openstack-infra | 15:26 | |
| openstackgerrit | Merged openstack/os-testr master: Avoid tox_install.sh for constraints support https://review.openstack.org/524611 | 15:27 |
| *** sree has joined #openstack-infra | 15:28 | |
| ttx | infra-core: please give https://review.openstack.org/#/c/534370/ some love as we currently have stale links on the contributor portal that point to the wrong (not redirected) document, and therefore the wrong top-5 items... | 15:29 |
| *** hemna_ has quit IRC | 15:29 | |
| *** hongbin has joined #openstack-infra | 15:29 | |
| *** yamamoto has quit IRC | 15:31 | |
| *** jamesmcarthur has joined #openstack-infra | 15:33 | |
| *** sree has quit IRC | 15:33 | |
| *** ramishra has quit IRC | 15:33 | |
| sean-k-mooney | smcginnis: hi regarding https://review.openstack.org/#/c/534807/ i can bump to 1.9 if you prefer. i was going to simply blacklist 1.8.0 in the global requirements when the auto generated patch was submitted | 15:34 |
| sean-k-mooney | smcginnis: would you prefer me to resping the release patch instead to 1.9.0 | 15:35 |
| pabelanger | okay, I'm starting to work on nb01.o.o this morning | 15:36 |
| smcginnis | sean-k-mooney: Yeah, I think it would make sense to respin that, just to make it clear there are somewhat significant differences between that and 1.8.0. Even if 1.8.0 is blacklisted. | 15:36 |
| sean-k-mooney | smcginnis: ok will do thanks | 15:37 |
| *** wolverineav has joined #openstack-infra | 15:37 | |
| smcginnis | Cool, thanks sean-k-mooney. | 15:37 |
| *** sree has joined #openstack-infra | 15:38 | |
| fungi | pabelanger: aside from ttx's request to review 534370, would you also mind taking a look at 533782 and 534463 so we can move forward with the larger replacement zuul scheduler instance? | 15:39 |
| pabelanger | fungi: sure | 15:40 |
| *** jamesmcarthur has quit IRC | 15:40 | |
| *** coolsvap has joined #openstack-infra | 15:41 | |
| *** wolverineav has quit IRC | 15:42 | |
| *** jamesmcarthur has joined #openstack-infra | 15:42 | |
| pabelanger | +3 all a round | 15:42 |
| fungi | much appreciated | 15:43 |
| fungi | i need to get the repo keys copied over too | 15:44 |
| fungi | will hack on that here in just a bit | 15:44 |
| pabelanger | was thinking about that, could we not move the volume between servers? | 15:45 |
| sean-k-mooney | smcginnis: done, i also added the change ids for the 2 refenced changes in the commit message for clarity. | 15:45 |
| fungi | pabelanger: oh, i suppose we could, i forgot it's on a cinder volume | 15:45 |
| dhellmann | AJaeger : sphinx is now ignoring modules when __init__.py is "empty" (defined as having fewer than 2 bytes) | 15:46 |
| fungi | biggest risk is making sure uid/gid gets remapped on everything if neded | 15:46 |
| smcginnis | sean-k-mooney: Perfect, thanks! | 15:46 |
| *** yamamoto has joined #openstack-infra | 15:46 | |
| fungi | dhellmann: yipes | 15:46 |
| dhellmann | yeah | 15:47 |
| fungi | empty init is... way common | 15:47 |
| dhellmann | so we could put "# please document this sphinx" comments in our files | 15:47 |
| dhellmann | while we wait for a fix upstream | 15:47 |
| larsks | fungi: recommended, even :) | 15:47 |
| dhellmann | or just block 1.6.6 | 15:47 |
| fungi | heh | 15:47 |
| dhellmann | or both | 15:47 |
| *** jamesmcarthur has quit IRC | 15:47 | |
| fungi | dhellmann: we could add apache license headers in empty files! ;) | 15:47 |
| dhellmann | fungi : that's where I started, but I figured someone would go remove them :-) | 15:48 |
| fungi | indeed | 15:48 |
| *** dhill_ has quit IRC | 15:48 | |
| fungi | i hereby declare this newline byte redistributable under the terms of the apache software license, version 2 | 15:48 |
| *** caphrim007 has quit IRC | 15:48 | |
| *** oidgar has quit IRC | 15:49 | |
| *** jaosorior has joined #openstack-infra | 15:50 | |
| *** yamamoto has quit IRC | 15:51 | |
| *** dhill_ has joined #openstack-infra | 15:52 | |
| rosmaita | fungi | 15:52 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/openstack-zuul-jobs master: Restore branch conditional on tempest-full https://review.openstack.org/531058 | 15:52 |
| rosmaita | if you GPL'd it, would that put all files containing newlines under the GPL? | 15:52 |
| *** efried_ is now known as efried | 15:53 | |
| fungi | only if they got the idea of using newlines from me | 15:53 |
| rosmaita | it does make the code easier to read | 15:53 |
| *** dsariel has quit IRC | 15:53 | |
| *** alexchadin has joined #openstack-infra | 15:54 | |
| * fungi thinks back to all the one-liners he's written in the past which wrapped around long enough to fill half a terminal screen | 15:54 | |
| dhellmann | AJaeger, fungi , cmurphy : https://github.com/sphinx-doc/sphinx/issues/4446 | 15:54 |
| *** slaweq has quit IRC | 15:54 | |
| *** slaweq has joined #openstack-infra | 15:55 | |
| cmurphy | thanks dhellmann | 15:55 |
| *** kiennt26 has quit IRC | 15:56 | |
| *** ralonsoh_ has quit IRC | 15:56 | |
| dhellmann | cmurphy : thanks for finding the change in sphinx that causes the problem | 15:56 |
| *** ralonsoh_ has joined #openstack-infra | 15:56 | |
| AJaeger | dhellmann: thanks | 15:58 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Stabilize git driver tests https://review.openstack.org/534818 | 15:58 |
| pabelanger | Umm, we have a little issue. There doesn't appear to be a firewall running on nodepool.o.o | 15:58 |
| pabelanger | infra-root:^ | 15:58 |
| pabelanger | I am going to restart iptables now | 15:58 |
| *** andreas_s has quit IRC | 15:59 | |
| *** slaweq has quit IRC | 15:59 | |
| pabelanger | okay, I think I see the issue | 15:59 |
| pabelanger | placing it into emergency file | 16:00 |
| corvus | pabelanger: i don't see one on zuulv3 either | 16:00 |
| pabelanger | the old dns for nb01 and nb02 are the reason I think | 16:00 |
| corvus | pabelanger: that doesn't explain zuulv3 | 16:01 |
| pabelanger | okay, nodepool.o.o firewall up after I removed nb01 / nb02 | 16:01 |
| pabelanger | corvus: right, it shouldn't have builder dns | 16:02 |
| corvus | and it doesn't | 16:02 |
| pabelanger | I am going to push up fix for nodepool.o.o firewalls, then convert to new system. | 16:03 |
| corvus | pabelanger: ++ | 16:03 |
| fungi | yeah, zuul01.o.o iptables rules are also empty | 16:03 |
| corvus | i suspect all xenial hosts have no firewalls | 16:03 |
| corvus | or rather, all xenial hosts with dns entries in their rules | 16:03 |
| *** makowals has quit IRC | 16:03 | |
| corvus | zuulv3's firewall failed to start at boot, likely because the resolver wasn't up | 16:03 |
| openstackgerrit | Merged openstack-infra/system-config master: Allow governance site content to include redirects https://review.openstack.org/534370 | 16:04 |
| corvus | so if we continue to convert to the new puppet-resolving system, we should be good | 16:04 |
| openstackgerrit | Merged openstack-infra/system-config master: Update firewalls, zookeeper and cacti for zuul01 https://review.openstack.org/533782 | 16:04 |
| *** makowals has joined #openstack-infra | 16:04 | |
| *** yamamoto has joined #openstack-infra | 16:04 | |
| *** makowals has quit IRC | 16:04 | |
| fungi | logstash-worker01 has iptables rules and runs on xenial | 16:04 |
| fungi | ahh, right, dns entries | 16:04 |
| *** makowals has joined #openstack-infra | 16:05 | |
| *** makowals has quit IRC | 16:05 | |
| *** olaph has joined #openstack-infra | 16:05 | |
| openstackgerrit | Merged openstack-infra/system-config master: Glob zuulv3 and zuul01 as zuul* in playbooks https://review.openstack.org/534463 | 16:05 |
| fungi | hrm, well, logstash-worker01 does have an iptables rule referencing the cacti server | 16:05 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Remove nb01 / nb02 DNS entries from nodepool.o.o https://review.openstack.org/534823 | 16:05 |
| *** makowals has joined #openstack-infra | 16:05 | |
| *** b_bezak has quit IRC | 16:05 | |
| fungi | but may have simply won that rac | 16:06 |
| *** makowals has quit IRC | 16:06 | |
| fungi | e | 16:06 |
| corvus | s/all/many/ i guess? | 16:06 |
| *** makowals has joined #openstack-infra | 16:06 | |
| fungi | or got the netfilter-persistent systemd unit restarted some time after boot | 16:06 |
| *** olaph1 has quit IRC | 16:06 | |
| *** makowals has quit IRC | 16:06 | |
| *** makowals has joined #openstack-infra | 16:07 | |
| *** makowals has quit IRC | 16:07 | |
| *** yamamoto has quit IRC | 16:08 | |
| fungi | the elasticsearch servers seem to have their rules in place (thankfully or they'd be thoroughly hacked by now) even though they're on xenial | 16:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Remove nb01 / nb02 DNS entries from nodepool.o.o https://review.openstack.org/534823 | 16:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Switch nodepool.o.o to use iptables_allowed_hosts https://review.openstack.org/534824 | 16:09 |
| pabelanger | okay, should fix nodepool.o.o, I'll start working on converting other hosts | 16:10 |
| fungi | thanks pabelanger! | 16:11 |
| *** tpsilva has joined #openstack-infra | 16:11 | |
| *** janki has quit IRC | 16:12 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Use new firewall syntax for zookeeper cluster https://review.openstack.org/533791 | 16:12 |
| *** mlavalle has joined #openstack-infra | 16:13 | |
| mlavalle | Hi, I've experiencing problems with my Vagrant script to build devstacks. Specifically, it continously fails to clone the devstack repo from git.openstack.org. Are others experiencing the same problem? | 16:14 |
| fungi | mlavalle: continuously as in consistently or randomly? | 16:15 |
| mlavalle | fungi: I have been unable to build a devstack since Sunday | 16:15 |
| mlavalle | I waited for a while to see if it was a transient thingh, but this morning I decided to ask :-) | 16:16 |
| fungi | have you tried cloning the devstack repo by any other means? can you reproduce the problem outside your vagrant script? | 16:16 |
| mlavalle | no I cannot reporduce it. but that vagrant script has been working for years | 16:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Switch zuul01.o.o to use iptables_allowed_hosts https://review.openstack.org/534829 | 16:17 |
| fungi | mlavalle: certainly sounds strange. which protocol is it using? http? https? git(9418/tcp)? | 16:18 |
| *** jamesmcarthur has joined #openstack-infra | 16:18 | |
| mlavalle | fungi: https and the error I get is: Could not resolve host: git.openstack.org | 16:19 |
| *** sshnaidm|mtg is now known as sshnaidm | 16:19 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Switch zuulv3.o.o to use iptables_allowed_hosts https://review.openstack.org/534830 | 16:20 |
| fungi | mlavalle: weird, that sounds like a dns problem | 16:20 |
| mlavalle | indeed | 16:20 |
| fungi | fwiw, i'm not having any trouble cloning the devstack repo via any of thee above protocols (nor do i see any issues resolving that name in dns) | 16:21 |
| mlavalle | fungi: cool, I'll dig on my side. I just wanted to make sure others weren't seeing the same problem | 16:22 |
| fungi | yeah, i'd start by looking at your local dns configuration | 16:22 |
| openstackgerrit | Brian Rosmaita proposed openstack-infra/openstack-zuul-jobs master: Remove glance_store legacy jobs https://review.openstack.org/526957 | 16:23 |
| pabelanger | topic:iptables-allowed-hosts should get us started on firewall fixes | 16:23 |
| fungi | mlavalle: is the git clone happening within vagrant? what does it use for dns resolution? a local recursing/forwarding cache on the host? maybe a service there has crashed/stopped? | 16:23 |
| *** shardy has quit IRC | 16:23 | |
| openstackgerrit | Brian Rosmaita proposed openstack-infra/openstack-zuul-jobs master: Remove glance_store legacy jobs https://review.openstack.org/526957 | 16:24 |
| openstackgerrit | Brian Rosmaita proposed openstack-infra/project-config master: Remove legacy jobs for glance_store https://review.openstack.org/526955 | 16:24 |
| *** slaweq has joined #openstack-infra | 16:25 | |
| *** shardy has joined #openstack-infra | 16:25 | |
| mlavalle | fungi: yeah, the git clone happens within Vagrant, so yes I might have a problem there | 16:25 |
| *** wolverineav has joined #openstack-infra | 16:28 | |
| *** b_bezak has joined #openstack-infra | 16:30 | |
| *** slaweq has quit IRC | 16:32 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Remove usage of iptables_rules4 / iptables_rules6 https://review.openstack.org/534833 | 16:32 |
| pabelanger | not sure if puppet will like that syntax, but lets see what tests say^ | 16:33 |
| pabelanger | then we can remove iptables_rules4 / iptables_rules6 support all together | 16:33 |
| *** alexchadin has quit IRC | 16:34 | |
| *** vsaienk0 has quit IRC | 16:38 | |
| *** gyee has joined #openstack-infra | 16:39 | |
| dmsimard | fungi: how crazy would it be for OpenStack to maintain a fork of hound ? I feel like it's a pretty critical tool for us and a lot of people have the same opinion -- that it's largely unmaintained: https://github.com/etsy/hound/pull/275#issuecomment-358362526 | 16:44 |
| dmsimard | fungi: By maintaining, I mean hosting -- we'd find people willing to be core on it and start merging things | 16:44 |
| dmsimard | (I don't have the bandwidth -- or the Go skills -- to take on that) | 16:45 |
| *** pcaruana has quit IRC | 16:46 | |
| *** david-lyle has joined #openstack-infra | 16:49 | |
| fungi | dmsimard: that's basically my concern with it too. forking something when we don't have people versed in the language who are interested in maintaining it would be hard | 16:50 |
| dmsimard | fungi: the author just replied to the PR, not sure if that's inside the context of your reply | 16:51 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Drop iptables_rules4 / iptables_rules6 for server.pp https://review.openstack.org/534840 | 16:51 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Document connection information for components https://review.openstack.org/534841 | 16:51 |
| fungi | dmsimard: by author you mean the author of hound or the author of the pr? | 16:52 |
| mordred | author of hound | 16:52 |
| dmsimard | fungi: author of hound | 16:52 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove legacy jobs for glance_store https://review.openstack.org/526955 | 16:52 |
| fungi | k | 16:52 |
| rosmaita | mordred: ty | 16:53 |
| *** Goneri has quit IRC | 16:53 | |
| dmsimard | forking a Go project is actually a bit tricky (it probably doesn't help that I'm a noob at Go) -- you have to change the location of the imports *in the code* or it will pick them up from elsewhere anyway https://github.com/dmsimard/hound/commit/8be668c6e1a892eaa95cc4fc167ad6d79e407b66 | 16:54 |
| *** sree has quit IRC | 16:55 | |
| pabelanger | is there something else to migration to, over forking hound? | 16:56 |
| *** rfolco is now known as rfolco_doctor | 16:56 | |
| *** armaan has quit IRC | 16:56 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Document connection information for components https://review.openstack.org/534841 | 16:57 |
| openstackgerrit | Merged openstack-infra/system-config master: Remove nb01 / nb02 DNS entries from nodepool.o.o https://review.openstack.org/534823 | 16:57 |
| *** pcichy has joined #openstack-infra | 16:59 | |
| openstackgerrit | Merged openstack-infra/system-config master: Switch nodepool.o.o to use iptables_allowed_hosts https://review.openstack.org/534824 | 17:01 |
| pabelanger | okay, I've removed nodepool.o.o from emergency file | 17:01 |
| *** david-lyle has quit IRC | 17:02 | |
| fungi | thanks pabelanger! | 17:02 |
| *** david-lyle has joined #openstack-infra | 17:03 | |
| *** david-lyle has quit IRC | 17:03 | |
| *** dklyle has joined #openstack-infra | 17:03 | |
| openstackgerrit | Merged openstack-infra/system-config master: Use new firewall syntax for zookeeper cluster https://review.openstack.org/533791 | 17:04 |
| * clarkb feels weird as a mostly non hound user | 17:04 | |
| mordred | dmsimard: yah - if it were to happen we'd want buy-in from the author as well as working with esty to do a github repo move | 17:05 |
| mordred | pabelanger: last I checked hound was still the best option out there | 17:05 |
| dmsimard | I can bring it up in a TC or openstack-infra meeting to see if we're really interested in it first, I was just bringing it up | 17:06 |
| openstackgerrit | Merged openstack-infra/system-config master: Switch zuul01.o.o to use iptables_allowed_hosts https://review.openstack.org/534829 | 17:06 |
| dmsimard | we need to know if we're really interested in it before proposing it :) | 17:06 |
| clarkb | I find it always returns too many results and using git grep locally is easier, but thats me | 17:06 |
| clarkb | I also have a dir with all the things cloned | 17:06 |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Do pep8 housekeeping according to zuul rules https://review.openstack.org/522945 | 17:07 |
| *** yamamoto has joined #openstack-infra | 17:08 | |
| *** e0ne has quit IRC | 17:09 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Use same flake8 config as in zuul https://review.openstack.org/509715 | 17:09 |
| corvus | i also have a dir, but find hound very convenient and it works well | 17:10 |
| *** caphrim007 has joined #openstack-infra | 17:11 | |
| *** honza has joined #openstack-infra | 17:11 | |
| *** kien-ha has joined #openstack-infra | 17:11 | |
| *** caphrim007 has quit IRC | 17:12 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool feature/zuulv3: Add test_launcher test https://review.openstack.org/533771 | 17:12 |
| *** caphrim007 has joined #openstack-infra | 17:12 | |
| *** b_bezak has quit IRC | 17:14 | |
| dmsimard | mordred, clarkb: I guess this is more of a TC thing ? | 17:14 |
| *** rfolco_doctor is now known as rfolco | 17:15 | |
| clarkb | dmsimard: only if you want ot make it an openstack project | 17:15 |
| dmsimard | ¯\_(ツ)_/¯ | 17:15 |
| dmsimard | It's helping maintain a software we're pulling good value from where it would otherwise bitrot | 17:15 |
| clarkb | dmsimard: right my point is the TC would only care if you wanted to make it an openstack project | 17:16 |
| *** yamamoto has quit IRC | 17:17 | |
| dmsimard | clarkb: It's more of a "do we want to make it an openstack project" rather than "I want to make it an openstack project" -- little nuance there :) | 17:17 |
| corvus | dmsimard: if you don't want to, the tc won't care. | 17:17 |
| corvus | dmsimard: since you don't want to do it all yourself, i'd recommend finding volunteers first | 17:18 |
| *** dtantsur is now known as dtantsur|afk | 17:18 | |
| dmsimard | corvus: yeah that's my main concern.. I don't have the bandwidth to take on that by myself :) | 17:18 |
| corvus | dmsimard: if you get a group of people and you think it'll be viable, then there might be a question for the infra PTL or the tc. | 17:19 |
| mordred | I'd think it's a questoin for the infra PTL rather than the TC - I don't think it's an appropriate OpenStack service. I do think it's potentially an appropriate Infra service | 17:19 |
| mordred | but I also agree, I don't have bandwidth to do anything about it | 17:20 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: fix rst heading styles https://review.openstack.org/533356 | 17:20 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: import blog post "Things that StoryBoard does differently" https://review.openstack.org/534412 | 17:20 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: separate worklist instructions from theory https://review.openstack.org/534413 | 17:20 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: fix document cross-link syntax https://review.openstack.org/534414 | 17:20 |
| *** vsaienk0 has joined #openstack-infra | 17:20 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: fix syntax for toctree https://review.openstack.org/534415 | 17:20 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: fix literal block markup for blocks within bullet lists https://review.openstack.org/534416 | 17:20 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: escape an example URL as literal text to avoid build warning https://review.openstack.org/534417 | 17:20 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: fix field list markup syntax https://review.openstack.org/534418 | 17:20 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: highlight notes about permissions on API endpoints https://review.openstack.org/534419 | 17:20 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: import blog post "Mapping Launchpad to StoryBoard" https://review.openstack.org/534420 | 17:20 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: import blog post "Why StoryBoard for OpenStack?" https://review.openstack.org/534421 | 17:20 |
| dhellmann | tfw you change a small thing at the bottom of a big series of changes | 17:21 |
| *** tesseract has quit IRC | 17:21 | |
| mordred | dhellmann: see the last day of backscroll in #openstack-sdks to see how much I feel you on that one | 17:21 |
| * dhellmann nods | 17:22 | |
| clarkb | I don't think it would be a prolem to host it under infra we did similar with our paste server (lodgeit). But I agree we should make sure we actually have people willing to maintain it and do so in a way that makes our upstream happy (eg don't just fork out from under them and surprise them) | 17:24 |
| *** oidgar has joined #openstack-infra | 17:25 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-iptables master: Ensure service is running https://review.openstack.org/534845 | 17:26 |
| mordred | clarkb: ++ | 17:26 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove glance_store legacy jobs https://review.openstack.org/526957 | 17:27 |
| pabelanger | clarkb: mordred: corvus: fungi: ^ should also help ensure iptables is running, oddly we never set the service to running. | 17:27 |
| clarkb | in the lodgeit case they striaght up said we are done with the software aiui so it was pretty clear then | 17:27 |
| clarkb | pabelanger: thats because its not a "real" service aiui it just applies the rules to the kernel when you kick it | 17:28 |
| *** sree has joined #openstack-infra | 17:29 | |
| pabelanger | clarkb: oh, so you think it won't matter the setting? | 17:29 |
| *** vsaienk0 has quit IRC | 17:30 | |
| dhellmann | dmsimard : it sounds like maybe there are some other potential contributors on github. Maybe you can convince etsy to set up a "hound" org and move the existing repo there to let other folks take it over. That might be easier than losing bug tracking data by importing the repo into gerrit. | 17:30 |
| *** r-daneel has joined #openstack-infra | 17:31 | |
| *** slaweq has joined #openstack-infra | 17:31 | |
| *** shardy is now known as shardy_afk | 17:32 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Document connection information for components https://review.openstack.org/534841 | 17:33 |
| *** sree has quit IRC | 17:33 | |
| pabelanger | okay, I've started firewalls on nodepool.o.o and zuul01.o.o, still waiting for zuluv3.o.o changes to land | 17:34 |
| *** jpich has quit IRC | 17:34 | |
| *** oidgar has quit IRC | 17:34 | |
| openstackgerrit | Matthew Treinish proposed openstack/os-testr master: Fix load command in pdb/no-discover path https://review.openstack.org/534365 | 17:35 |
| *** jpich has joined #openstack-infra | 17:35 | |
| clarkb | pabelanger: ya there is no real service/process to ensure is running | 17:35 |
| clarkb | the process is the kernel | 17:35 |
| *** beagles is now known as beagles_afk | 17:35 | |
| pabelanger | also, https://review.openstack.org/534833/ and https://review.openstack.org/534840/ are the last 2 patchsets to remove support for DNS into our firewall rules | 17:35 |
| *** slaweq has quit IRC | 17:36 | |
| openstackgerrit | Merged openstack-infra/system-config master: Switch zuulv3.o.o to use iptables_allowed_hosts https://review.openstack.org/534830 | 17:36 |
| pabelanger | clarkb: with systemd, we now can use sudo service netfilter-persistent status which returns true / false if rules have been loaded | 17:37 |
| pabelanger | on trusty, we still don't get that | 17:37 |
| *** florianf has quit IRC | 17:37 | |
| *** jpich has quit IRC | 17:40 | |
| *** caphrim007_ has joined #openstack-infra | 17:44 | |
| *** esberglu has quit IRC | 17:44 | |
| openstackgerrit | Merged openstack-infra/storyboard master: update documentation build for new PTI https://review.openstack.org/533306 | 17:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Don't fetch coverage report from failing tests https://review.openstack.org/534853 | 17:45 |
| clarkb | pabelanger: but trusty also doesn't have this issue either right? | 17:46 |
| mordred | AJaeger, clarkb: ^^ got annoyed with the POST_FAILURE I was seeing on zuul patches for tox-cover here: https://review.openstack.org/#/c/534818 | 17:46 |
| pabelanger | clarkb: yah, so far only seen the issue on xenial | 17:46 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Don't fetch coverage report from failing tests https://review.openstack.org/534853 | 17:47 |
| mordred | rebased. wasn't related to those other patches | 17:47 |
| *** caphrim007 has quit IRC | 17:47 | |
| pabelanger | okay, zuulv3.o.o firewall back online now too | 17:49 |
| pabelanger | I'm going to try rebuilding nb01.o.o again | 17:50 |
| *** luzC_ is now known as luzC | 17:51 | |
| fungi | jgr: witek: looks like your monasca-ui pike branch tarballs/wheels did update correctly yesterday. let me know if you see any other issues | 17:52 |
| pabelanger | clarkb: Shrews: corvus: Is there anything we need to check on zookeeper because firewall is down? I think gearman was a little more protected because of SSL certs, guess we could start using them on zk too | 17:52 |
| pabelanger | s/is/was | 17:52 |
| dmsimard | dhellmann: that's a good idea | 17:52 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Stabilize git driver tests https://review.openstack.org/534818 | 17:54 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Document connection information for components https://review.openstack.org/534841 | 17:54 |
| jgr | fungi: it did, yes. Thanks again! | 17:56 |
| corvus | pabelanger: i don't think so | 17:56 |
| *** kjackal has quit IRC | 17:58 | |
| pabelanger | mordred: I just got this error trying to install nodepool: http://paste.openstack.org/show/646535/ any thoughts? | 17:59 |
| *** kien-ha has quit IRC | 17:59 | |
| *** derekh has quit IRC | 18:00 | |
| *** CrayZee has joined #openstack-infra | 18:00 | |
| *** dbecker has quit IRC | 18:02 | |
| *** dklyle has quit IRC | 18:02 | |
| *** CrayZee is now known as snapiri- | 18:03 | |
| *** sbra has joined #openstack-infra | 18:04 | |
| *** Goneri has joined #openstack-infra | 18:04 | |
| snapiri- | Infra, could someone from system-config could approve https://review.openstack.org/#/c/531720/ ? | 18:04 |
| *** olaph1 has joined #openstack-infra | 18:04 | |
| dmsimard | corvus: been in meeting hell all morning.. looking at your reply on the irc spec now. | 18:05 |
| fungi | pabelanger: getting a lot of error e-mails from the zk* servers because they can't resolve their shortnames... looks like their names aren't in /etc/hosts at all? | 18:05 |
| corvus | dmsimard: i'm here if you want to chat | 18:05 |
| fungi | zuul01 by contrast has its name in its /etc/hosts file | 18:05 |
| fungi | and was just built yesterday | 18:05 |
| *** olaph has quit IRC | 18:05 | |
| *** felipemonteiro has quit IRC | 18:06 | |
| fungi | looks like zk01 was probably built on december 5 | 18:06 |
| *** trown has quit IRC | 18:06 | |
| dmsimard | corvus: I wonder if the 120 (?) channel limit is a technical limitation and as such if Sigyn could just be in all channels or something | 18:06 |
| dmsimard | There's also apparently https://github.com/ncoevoet/chantracker and https://github.com/ProgVal/Supybot-plugins/tree/master/AttackProtector which are a thing | 18:07 |
| corvus | dmsimard: it's possible they special cased that. i don't know how many channels she's in. but i do know she leaves them. she sometimes shows up in ours, and then leaves after a while. | 18:07 |
| AJaeger | mordred: thansk for https://review.openstack.org/#/c/534853 - let's fix failures and merge ;) | 18:07 |
| fungi | dmsimard: freenode sets chanmax:120 globally but in theory they could override it per-nick i expect. they've just said in the past they're not willing to take requests to override it | 18:07 |
| corvus | dmsimard: yes. my spec does not take an opinion on what plugin should be used to accomplish the spam protection. only that we have something e can use. | 18:07 |
| corvus | dmsimard: however, i looked, and i don't think either of those are suitable out of the box to deal with our unique situtation of having 200 channels. | 18:08 |
| AJaeger | clarkb: could you review https://review.openstack.org/529341 for devstack, please? This is a roles rename (fetch-subunit) | 18:08 |
| corvus | dmsimard: i think the idea of "this nick misbehaved in one channel, so ban it from these 200 other channels" is not something i've seen support for. | 18:09 |
| pabelanger | fungi: oh, maybe. I believe I had to remove for zookeeper service to start properly. I can stop it for now and look again shortly | 18:09 |
| pabelanger | since we are not using it | 18:09 |
| dmsimard | corvus: Has any of us (recently) discussed with any of the freenode staff about this in general ? I know I have to some extent but I didn't reach any technical discussions, it was mostly reactive to ongoing spam waves. | 18:09 |
| clarkb | AJaeger: done | 18:09 |
| AJaeger | thanks, clarkb | 18:10 |
| fungi | dmsimard: it's been about a year i think | 18:10 |
| *** shardy_afk has quit IRC | 18:10 | |
| corvus | dmsimard: i asked recently in the group advisory board channel if we could assist in any way; no staff responded (though i did not direct my query at them directly), and the only suggestions i got was to run the bots you pointed out. | 18:10 |
| dmsimard | We have got to be one of the largest communities on freenode ? They should at least be able to discuss with us | 18:10 |
| corvus | dmsimard: what would you want to say? | 18:11 |
| corvus | i mean, i'm pretty sure they're aware and doing all they can. | 18:11 |
| *** ekcs has joined #openstack-infra | 18:11 | |
| pabelanger | fungi: do you have an example mail failure? | 18:12 |
| fungi | also, i'll note, while it may be tempting to revisit moving to oftc because of the spam problem... i've seen it happening there too | 18:12 |
| fungi | so it wouldn't help in this case | 18:12 |
| corvus | fungi: :( | 18:12 |
| fungi | corvus: i've even seen spammers blasting in channels on irc.gnome.org which is a remarkably small network as irc networks go | 18:13 |
| fungi | pabelanger: yeah, it was from sudo. let me see if i saved any | 18:13 |
| dmsimard | corvus: The "if we could assist in any way" is one thing, but I'm more interested in the technical challenges of that assitance -- could sigyn be in all the freenode channels (like chanserv?), could sigyn's code be improved (ianw's suggestions in the spec comments), etc | 18:13 |
| persia | amusingly, some of the spam traffic on gimpnet is explicit freenode-related spam | 18:13 |
| fungi | hah | 18:14 |
| dmsimard | that's funny. | 18:14 |
| fungi | that's sad | 18:14 |
| fungi | funny-sad | 18:14 |
| dmsimard | it's sad too. | 18:14 |
| *** ianychoi has quit IRC | 18:14 | |
| *** e0ne has joined #openstack-infra | 18:15 | |
| *** ianychoi has joined #openstack-infra | 18:15 | |
| fungi | pabelanger: http://paste.openstack.org/show/646536/ | 18:15 |
| pabelanger | fungi: ah, yes. that was me then | 18:15 |
| corvus | dmsimard: i haven't had any discussions with them about that, but i don't think those topics are things that are unique to openstack, so i don't think they need to funnel through me, or otherwise be had in any kind of 'official' openstack context. anyone can do that. | 18:15 |
| pabelanger | I see the warning now | 18:15 |
| dmsimard | corvus: we're having a discussion on how to solve this problem within an "official" openstack context but I agree :p | 18:16 |
| pabelanger | fungi: I believe the issue is, zookeeper seems to use the hostname to look up IP information about which interface to bind too. And with zk01 pointing to localhost, it was causing zookeeper cluster to bind elaction / admin ports only to 127.0.0.1. So, we need to come up with a way to address that | 18:16 |
| persia | corvus: For social reasons, group contacts get special support from staff. If you want to delegate, explicitly introducing someone as important can help ensure they get a response. Many staff just don't want to answer random folk because $foo (ask any of them at a conference sometime if you want a list of $foo) | 18:17 |
| *** jpena is now known as jpena|off | 18:17 | |
| fungi | pabelanger: we can switch from using loopback addresses to whatever's bound to eth0 | 18:17 |
| fungi | pabelanger: in /etc/hosts | 18:17 |
| dmsimard | persia: I sort of assumed it worked that way as well but I didn't know for sure | 18:17 |
| persia | dmsimard: I don't believe it to be policy that it works that way, but that was my experience when I was active in channel management in another community on freenode. There has been staff turnover since then, but there are still many familiar nicks, so I presume the same unofficial model. | 18:18 |
| dmsimard | We could move to slack, there's no spam on slack is there ? (just kidding.) | 18:18 |
| pabelanger | fungi: okay, i wasn't sure if we used localhost for a specific reason in puppet | 18:18 |
| corvus | let's try to use our time productively. | 18:19 |
| corvus | dmsimard: is there anything else related to the spec you wish to discuss? | 18:19 |
| *** dsariel has joined #openstack-infra | 18:19 | |
| dmsimard | corvus: no, I'll +1 the spec and I'll try and reach out to *someone* to get more information on sigyn in general | 18:20 |
| openstackgerrit | Merged openstack-infra/system-config master: Remove usage of iptables_rules4 / iptables_rules6 https://review.openstack.org/534833 | 18:20 |
| dmsimard | The initiatives are not necessarily mutually exclusive, we still need something to manage all of our channels effectively | 18:20 |
| dmsimard | Regardless of spam or not | 18:21 |
| corvus | dmsimard: indeed. if sygyn can remain in all the channels indefinitely, then that's just less work for us. i assume she can't because the documentation says she leaves, and we've seen her do it. but if that changes, great. | 18:22 |
| fungi | pabelanger: loopback addresses are an easy way to make sure the hostname resolves to "something" when you don't know in advance what global addresses it might get assigned | 18:23 |
| fungi | pabelanger: more traditionally (in my experience at least) you would add all your interface addresses into /etc/hosts so that reverse lookups on them work without having to hit dns (especially since some might be rfc-1918 addresses with no reverse zones known to your resolver) | 18:24 |
| fungi | pabelanger: "the cloud" has however broken with tradition in many ways, not the least of which is trying to reduce the number of pieces of unique information you need on your filesystem | 18:25 |
| fungi | putting a loopback address reference for your hostname in /etc/hosts was mostly a reaction to dealing with dynamic addressing, so that e.g. dhcpclient didn't need to have permission to modify that file | 18:26 |
| fungi | and also so that services which depended on gethostbyname() calls at startup could still function even if you weren't on a proper network at that time | 18:27 |
| *** vsaienk0 has joined #openstack-infra | 18:27 | |
| fungi | but not really the best option for a server with static addressing | 18:28 |
| pabelanger | fungi: okay, let me finish up nb01.o.o and I'll look back to zk cluster | 18:29 |
| *** yamahata has quit IRC | 18:29 | |
| fungi | that said, it also sounds like zookeeper has some weird assumptions about host naming and addresses baked into it | 18:29 |
| openstackgerrit | Merged openstack-infra/system-config master: Add openstack-dragonflow channel to statusbot https://review.openstack.org/531720 | 18:29 |
| *** e0ne has quit IRC | 18:30 | |
| corvus | dmsimard: we could also probably run sigyn ourselves -- it being a limnoria plugin. | 18:30 |
| corvus | (part of why i suggested that) | 18:30 |
| *** olaph has joined #openstack-infra | 18:30 | |
| *** felipemonteiro has joined #openstack-infra | 18:31 | |
| dmsimard | corvus: that's an interesting thought -- also I would have to guess we'd need to run a slightly modified version of it since we can't k-line etc | 18:31 |
| *** olaph1 has quit IRC | 18:31 | |
| corvus | ya | 18:31 |
| dmsimard | Looking at the code, though, I can't help but cringe at the things like hand-written SQL queries and such | 18:31 |
| corvus | hand-written sql is the best kind :) | 18:32 |
| *** sambetts is now known as sambetts|afk | 18:33 | |
| dmsimard | Well there's nothing inherently bad about writing SQL queries by hand, but when doing it in code it tends to be ... fragile | 18:34 |
| *** ralonsoh_ has quit IRC | 18:34 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: suppress warnings from wsmeext.sphinxext https://review.openstack.org/534872 | 18:34 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/storyboard master: treat doc build warnings as errors https://review.openstack.org/534873 | 18:35 |
| Shrews | my entire 2007 career was spent tuning hand-written queries for folks who shouldn't be writing queries by hand at all | 18:36 |
| Shrews | and then i met mordred, and things just got worse from there | 18:36 |
| Shrews | :) | 18:36 |
| mordred | yah. then you moved on to hand-writing C++ code that represents the actions a SQL engine takes after compiling SQL | 18:38 |
| mordred | which is really way more better than hand-writing SQL itself | 18:38 |
| dmsimard | I think the sqlalchemy author hangs around here somewhere, I forget what his nickname is :) | 18:38 |
| mordred | zzzeek: ^^ dmsimard is trying to mention your name | 18:38 |
| snapiri- | clarkb: when you have time, could you please review and approve https://review.openstack.org/#/c/526053/ ? | 18:39 |
| snapiri- | clarkb: Sorry, meant https://review.openstack.org/#/c/505069/ | 18:40 |
| *** openstackstatus has quit IRC | 18:40 | |
| AJaeger | infra-root, https://review.openstack.org/534779 is currently failing in the gate - and needed to fix other failures (blocks sphinx 1.6.6). Can we easily reenqueue/promote that one? Or should I ask dhellmann to abandon/restore ? | 18:40 |
| *** kien-ha has joined #openstack-infra | 18:41 | |
| *** vsaienk0 has quit IRC | 18:41 | |
| *** openstackstatus has joined #openstack-infra | 18:41 | |
| *** ChanServ sets mode: +v openstackstatus | 18:41 | |
| *** slaweq has joined #openstack-infra | 18:42 | |
| clarkb | snapiri-: that is necessary becuse you can use a subnet pool instead? | 18:43 |
| fungi | AJaeger: if it's breaking jobs for multiple projects i have no problem promoting it | 18:43 |
| clarkb | snapiri-: put another way in what cases is it valid to not specify the range there? | 18:44 |
| AJaeger | dhellmann: do you know how many it broke? I'm aware of keystone, python-openstackclient, ironic (has fixes) | 18:44 |
| fungi | AJaeger: dhellmann: it's more than one project broken... i've gone ahead and promoted it | 18:45 |
| AJaeger | thanks, fungi | 18:45 |
| dhellmann | AJaeger : no. It looks like any project using the sphinx auto api doc thing may be broken | 18:45 |
| dhellmann | but I don't know of any others than the 3 you mention | 18:45 |
| snapiri- | clarkb: to be honest, I do not exactly remember the use-case. I had a configuration I used with devstack that failed on that parameter. After patching it the setup was working. I can try to re-create it. | 18:45 |
| fungi | otherwise everything ahead of it in the integrated gate queue gets to fail before it merges anyway, so nicer to everyone if we avoid that | 18:46 |
| dhellmann | I mean, all of oslo uses that, but I don't know if we have patches to show they're broken | 18:46 |
| dhellmann | fungi : ++ | 18:46 |
| dhellmann | thanks | 18:46 |
| fungi | i'll try to keep an eye on that one in case it doesn't merge | 18:46 |
| fungi | do we need anything similar for stable branches? | 18:46 |
| snapiri- | clarkb: I am pretty sure I used a subnet pool, but not 100% :-/ | 18:46 |
| *** slaweq has quit IRC | 18:46 | |
| *** wolverineav has quit IRC | 18:48 | |
| *** wolverineav has joined #openstack-infra | 18:48 | |
| *** dsariel has quit IRC | 18:49 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-nodepool master: Set pidfile for nodepool-builder https://review.openstack.org/534876 | 18:49 |
| snapiri- | clarkb: IMHO if this parameter is required, then we should set it as such and add a clear error message if it is not set, but if it is possible to omit it, the devstack should not fail on it. | 18:49 |
| AJaeger | fungi, hope not - constraints should help. dhellmann, or do you thing we need the block of the version for the others? | 18:49 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Add SQL reporter to Zuul experiemental and tripleo pipelines https://review.openstack.org/534877 | 18:49 |
| dmsimard | infra-root: I noticed this when looking over sql reporter data ^ | 18:50 |
| *** kien-ha has quit IRC | 18:50 | |
| pabelanger | infra-root: I'd please review 534876 for pidfile changes needed in nodepool to support nodepool 0.5.0 and before | 18:50 |
| clarkb | snapiri-: ya, I agree, but I also don't know enough about subnet creation to know if it should be required or not (which is why I was asking my questions earlier. basically is there a valid case for not setting it? guessing its subnet pools) | 18:50 |
| dhellmann | AJaeger : the constraint change also blocks 1.6.6 so future constraint updates don't bring it back in | 18:50 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Add SQL reporter to Zuul experiemental and tripleo pipelines https://review.openstack.org/534877 | 18:50 |
| pabelanger | I'd like to also push up systemd service files for nodepool, I'd work on that this week | 18:50 |
| dhellmann | AJaeger , fungi : stable/pike is constrained to 1.6.3 so I think we're ok in stable branches for now | 18:51 |
| *** psachin has quit IRC | 18:52 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Don't fetch coverage report from failing tests https://review.openstack.org/534853 | 18:54 |
| AJaeger | mordred: fixed failure ^ | 18:54 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add docs, api-ref and releasenotes jobs for masakari https://review.openstack.org/534878 | 18:54 |
| mordred | AJaeger: thanks! | 18:54 |
| mordred | AJaeger: I have noticed ^^ while investigating something else | 18:55 |
| pabelanger | Shrews: do you have a moment to clean up infracloud-vanilla entries in zookeeper for images? | 18:55 |
| AJaeger | mordred: do those jobs work? | 18:56 |
| zzzeek | mordred: yesterday I put raw SQL queries into an ansible .yml file :) | 18:56 |
| clarkb | pabelanger: left a comment | 18:58 |
| *** priteau has quit IRC | 18:58 | |
| *** olaph1 has joined #openstack-infra | 18:59 | |
| dmsimard | zzzeek: oh no! You know, googling a bit I actually found https://github.com/larsks/ansible-sql-query who also participates in the OpenStack community :) | 18:59 |
| larsks | dmsimard: o/ | 18:59 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove trove experimental jobs https://review.openstack.org/534880 | 19:00 |
| AJaeger | mordred: could you review this, please? the change is in the gate right now ^ | 19:00 |
| *** olaph has quit IRC | 19:00 | |
| pabelanger | clarkb: sure, I can do that | 19:00 |
| mordred | AJaeger: lgtm | 19:01 |
| mordred | AJaeger: I tested api-ref locally - let me test doc build and releasenotes real qiuck | 19:01 |
| Shrews | pabelanger: i'll take a look | 19:01 |
| snapiri- | clarkb: you can either create a subnet-pool, and set it via SUBNETPOOL_PREFIX_V4, or disable it and use the FIXED_RANGE... What I did is not disable USE_SUBNETPOOL, so I encountered the issue | 19:02 |
| *** david-lyle has joined #openstack-infra | 19:02 | |
| clarkb | snapiri-: gotcha so if you don't explicitly disabled subnet pools you must provide a fixed range | 19:03 |
| mordred | AJaeger: releasenotes and docs builds using the PTI commands all work locally as well | 19:04 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-nodepool master: Don't assume pidfile location https://review.openstack.org/534876 | 19:05 |
| *** iyamahat has joined #openstack-infra | 19:05 | |
| Shrews | pabelanger: fyi, i'm going to spend some time writing a tool to do this | 19:05 |
| Shrews | so don't expect the cleanup to happen immediately | 19:06 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-nodepool master: Don't assume pidfile location https://review.openstack.org/534876 | 19:06 |
| AJaeger | mordred: then I'll +2 | 19:06 |
| *** yamahata has joined #openstack-infra | 19:06 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove Trove legacy jobs https://review.openstack.org/511150 | 19:06 |
| snapiri- | clarkb: if you *do* disable you should provide the fixed_range, if you do not then you should provide the subnet pool prefix. the use case I encountered was not disabling the subnet pool, but the command line still required the fixed_range | 19:06 |
| snapiri- | clarkb: note there is subnet range and subnet pool that are kind of opposites :) | 19:07 |
| snapiri- | a bit confusing | 19:08 |
| *** david-lyle has quit IRC | 19:08 | |
| *** coolsvap has quit IRC | 19:09 | |
| pabelanger | clarkb: dmsimard: ^updated | 19:09 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove trove experimental jobs https://review.openstack.org/534880 | 19:10 |
| clarkb | snapiri-: one last thing. In the bug it says subnet pool id and fixed range are both unset. Devstack should fail in that case right? | 19:11 |
| clarkb | snapiri-: because without a subnet pool and without a fixed range it won't know where to create the subnet? | 19:11 |
| snapiri- | clarkb: checking, it was long ago... | 19:12 |
| *** e0ne has joined #openstack-infra | 19:13 | |
| corvus | zuul/nodepool don't have a backlog -- should we restart them to pick up the CSD changes? | 19:18 |
| *** vsaienk0 has joined #openstack-infra | 19:18 | |
| clarkb | would just be a zuul restart right? nodepool is unaffected? | 19:18 |
| clarkb | (just thinking it would be nice to get my fix for cloud outages into nodepool too) | 19:18 |
| corvus | er, yep, sorry. | 19:18 |
| corvus | we can do both. | 19:19 |
| corvus | a zuul restart is a fine time for a nodepool restart :) | 19:19 |
| *** esberglu has joined #openstack-infra | 19:19 | |
| snapiri- | clarkb: OK, this refers to a scenario where we reuse the provider network as the public network, so in this case we do not want to use a fixed range or a subnet pool. what happens is that we only take the interface ip and set it on our br-ex. this magic happens due to Q_USE_PROVIDER_NETWORKING=True | 19:19 |
| AJaeger | mordred: could you review https://review.openstack.org/534880 again, please? Any other config-core to review this change to remove experimental trove jobs, please? | 19:20 |
| *** armaan has joined #openstack-infra | 19:21 | |
| pabelanger | corvus: clarkb: if we are planning restarts, it would also be a good time to pick up finger port change on executors too ( and drop user to zuul) | 19:21 |
| corvus | pabelanger: ++ | 19:21 |
| clarkb | snapiri-: but won't the subnet create fail if you don't provide either of those values though? like even with provider networks neutron needs to know what the range is? | 19:21 |
| AJaeger | corvus: can we wait a bit over an hour to have the top of integrated gate merged? That fixes failures in the docs jobs for projects due to broken sphinx | 19:22 |
| corvus | clarkb, pabelanger: can you two pitch in? there's a bunch of stuff lining up for a restart now :) | 19:22 |
| *** jamesmcarthur has quit IRC | 19:22 | |
| clarkb | corvus: ya I can help out | 19:22 |
| clarkb | let me know what I can do | 19:22 |
| corvus | clarkb, pabelanger: will you be available in 1 hour? | 19:22 |
| pabelanger | yes | 19:23 |
| clarkb | corvus: yes I think so | 19:23 |
| corvus | AJaeger: okay. we'll give it until 20:30 :) otherwise, it'll probably need a re-enqueue anyway | 19:24 |
| *** jamesmcarthur has joined #openstack-infra | 19:24 | |
| snapiri- | clarkb: if you look at line 184, we do create a network based on the specification of the provider network | 19:24 |
| clarkb | snapiri-: for example how do intsances know what the subnet mask is if you don't set the range | 19:24 |
| * AJaeger crosses fingers | 19:24 | |
| clarkb | snapiri-: ya but that is l2 you still need l3 | 19:25 |
| AJaeger | corvus: thanks | 19:25 |
| pabelanger | clarkb: replied to 534876, unsure the best way to support both locations of pidfile now. Guess we'd need to expose that in puppet some how | 19:25 |
| clarkb | which is what the subnet pool and/or fixed range does | 19:25 |
| snapiri- | hmm... sorry, I am a bit rusty, it is quite old patch... | 19:25 |
| corvus | pabelanger, clarkb: can we use the same /etc/defaults thing we use for zuul? | 19:26 |
| *** kjackal has joined #openstack-infra | 19:26 | |
| clarkb | corvus: ya that was my suggestion but Iguess the problem here is we use the same puppet code for v2 and v3 but don't in zuul? | 19:27 |
| clarkb | for zuul we provide different default file contents iirc | 19:27 |
| corvus | yeah, we'd need a switch | 19:27 |
| pabelanger | ya, switch | 19:27 |
| pabelanger | I'll add zuulv3 flag | 19:27 |
| *** vsaienk0 has quit IRC | 19:28 | |
| corvus | well... | 19:28 |
| *** jamesmcarthur has quit IRC | 19:29 | |
| corvus | nm | 19:29 |
| *** rosmaita has quit IRC | 19:29 | |
| pabelanger | k | 19:29 |
| *** jamesmcarthur has joined #openstack-infra | 19:29 | |
| Shrews | corvus: if you're restarting things, https://review.openstack.org/534333 might be useful | 19:30 |
| clarkb | snapiri-: I'm not sure my grasp of neutron's expectations there is good enough to vote on that change. My hunch is that in your cse it should've failed because it was an invalid case | 19:31 |
| clarkb | since you need to know your netmask iirc | 19:31 |
| clarkb | maybe someone like ihrachys can confirm? | 19:31 |
| fungi | pabelanger: returning to your earlier suggestion that instead of copying the repo keys over the network from zuulv3 to zuul01 we could move the cinder volume... that volume is mounted at /var/log/zuul while the keys and times are in /var/lib/zuul (lib, not log) and so not in cinder (though we could change that if it makes sense i suppose?) | 19:32 |
| snapiri- | clarkb: The VM I tested with is not available at the moment. I will re-check my data and when I will be ready with all the info I will re-ask for review? | 19:33 |
| clarkb | snapiri-: sure | 19:33 |
| snapiri- | clarkb: I am a bit embarrassed for this :-/ | 19:33 |
| *** slaweq has joined #openstack-infra | 19:33 | |
| fungi | pabelanger: corvus: also, /var/log/zuul is only 11% used... should we do a new volume on zuul01 and carve it up with lvm to keep log and lib on? | 19:34 |
| clarkb | snapiri-: you shouldn't be. I just want to make sure I understand the bug well enough to vote on whether or not the fix should fix it :) | 19:34 |
| corvus | Shrews: +3 | 19:34 |
| snapiri- | clarkb: I am all for it. | 19:34 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-nodepool master: Don't assume pidfile location https://review.openstack.org/534876 | 19:34 |
| pabelanger | corvus: clarkb: ^how is that? not to best flag name, but open to suggestions | 19:35 |
| AJaeger | config-core, could you review https://review.openstack.org/534880 and https://review.openstack.org/511150 to remove trove jobs, please? | 19:35 |
| pabelanger | fungi: oh, right. I was confusing with executors | 19:35 |
| *** iyamahat has quit IRC | 19:35 | |
| fungi | though /var/lib/zuul is a mere 261M so wouldn't take too long to rsync over the 'net | 19:35 |
| fungi | oh, and 2/3 of that is in /var/lib/zuul/www anyway (status dumps) | 19:36 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool feature/zuulv3: Add test_launcher test https://review.openstack.org/533771 | 19:36 |
| *** dhill_ has quit IRC | 19:37 | |
| fungi | so /var/lib/zuul/{keys,times} is right at 100mb | 19:37 |
| corvus | fungi: hrm. i agree due to its content, a volume seems warranted, but maybe overkill since it's so easy to rsync. if we had automated volume management for replacement servers, that'd be more compelling i think. | 19:37 |
| pabelanger | fungi: yah, rsync might be best now. I incorrectly assumed keys were on volume | 19:37 |
| corvus | fungi: i could go either way. :| | 19:37 |
| corvus | hth | 19:37 |
| fungi | heh | 19:37 |
| fungi | also, looks like /var/log/zuul may just be the ephemeral disk, not a cinder volume | 19:38 |
| *** e0ne has quit IRC | 19:38 | |
| *** trown has joined #openstack-infra | 19:38 | |
| fungi | yeah, it's ephemeral | 19:38 |
| *** slaweq has quit IRC | 19:38 | |
| fungi | i'll make sure to remount the one for zuul01 there | 19:38 |
| fungi | instead of /opt | 19:38 |
| *** dhill_ has joined #openstack-infra | 19:39 | |
| *** dhill_ has quit IRC | 19:39 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-openstackci master: Expose zuulv3 setting for nodepool_builder.pp https://review.openstack.org/534887 | 19:40 |
| *** iyamahat has joined #openstack-infra | 19:40 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Toggle zuulv3 settings for nb01.o.o https://review.openstack.org/534889 | 19:42 |
| *** ykarel|away has joined #openstack-infra | 19:42 | |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr master: future-proof invocation of apidoc https://review.openstack.org/534890 | 19:43 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Stabilize git driver tests https://review.openstack.org/534818 | 19:43 |
| *** david-lyle has joined #openstack-infra | 19:43 | |
| *** rosmaita has joined #openstack-infra | 19:44 | |
| pabelanger | corvus: clarkb: https://review.openstack.org/#/q/topic:nb01-fixes is the stack to expose pidfile location now | 19:44 |
| *** amoralej is now known as amoralej|off | 19:46 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool feature/zuulv3: Only fail requests if no cloud can service them https://review.openstack.org/533372 | 19:47 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool feature/zuulv3: Add test_launcher test https://review.openstack.org/533771 | 19:47 |
| *** agopi has joined #openstack-infra | 19:48 | |
| *** e0ne has joined #openstack-infra | 19:49 | |
| *** ldnunes has quit IRC | 19:51 | |
| *** ldnunes has joined #openstack-infra | 19:52 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Update fingergw init script for command socket https://review.openstack.org/534333 | 19:56 |
| *** ykarel|away has quit IRC | 19:58 | |
| fungi | i have keys and times rsync'd over to zuul01 now, but will obviously do one final resync before we cut anything over just in case there have been changes on zuulv3.o.o | 19:58 |
| fungi | what else do we need besides the config change setting the gearman server for all the other services? | 19:59 |
| fungi | probably would also be a good idea for someone else who's familiar with the current zuulv3 server to hop on zuul01 and take a look around to make sure i haven't missed anything silly | 20:00 |
| *** hasharAway is now known as hashar | 20:04 | |
| *** dhill_ has joined #openstack-infra | 20:05 | |
| *** cshastri has quit IRC | 20:06 | |
| AJaeger | tobiash, corvus, do you want to review https://review.openstack.org/#/c/534853/ again? The change to the coverage job... I just added a name line to fix linters | 20:08 |
| clarkb | fungi: firewall on zookeeper server | 20:08 |
| corvus | fungi: oh should we plan on cutting over as part of the upcoming restart? | 20:09 |
| clarkb | fungi: access to wherever we are hosting the sql db for the sql reporter? | 20:09 |
| corvus | heh, it's turning into a do-everything event | 20:09 |
| fungi | clarkb: did i miss updating the zk server firewall rules? | 20:09 |
| clarkb | fungi: not sure, just thinking out loud what changes need doing | 20:09 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove Neutron legacy jobs definition https://review.openstack.org/531496 | 20:09 |
| fungi | and yeah, i guess the db may need to get dumped/imported if it's not trove. checking | 20:10 |
| clarkb | just checked firewall on nodepool.o.o lgtm | 20:10 |
| pabelanger | same :) | 20:10 |
| fungi | clarkb: cool, thanks. and yeah, the new server got a copy of the hiera variables and any lists in system-config which included zuulv3 (for firewall rules or whatever) for zuul01 added afaik | 20:11 |
| *** wolverineav has quit IRC | 20:11 | |
| fungi | looks like the sql reporter is using a trove instance | 20:11 |
| *** wolverineav has joined #openstack-infra | 20:11 | |
| *** pcichy has quit IRC | 20:11 | |
| fungi | correct dburi appears in zuul01's zuul.conf | 20:11 |
| fungi | so shouldn't pose a problem | 20:12 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Rename legacy-tempest-dsvm-neutron-linuxbridge https://review.openstack.org/534896 | 20:13 |
| pabelanger | if we think zuul01.o.o is ready, happy to support doing it now | 20:14 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove Neutron legacy jobs definition https://review.openstack.org/531496 | 20:15 |
| *** ldnunes has quit IRC | 20:15 | |
| *** b_bezak has joined #openstack-infra | 20:15 | |
| fungi | lemme get the wip cutover change pushed up | 20:15 |
| *** slaweq has joined #openstack-infra | 20:17 | |
| snapiri- | clarkb: I have looked a bit into it, and updated all the information in the bug. If you have time I would appreciate your feedback. | 20:17 |
| pabelanger | clarkb: fungi: corvus: dmsimard: do you mind adding https://review.openstack.org/#/q/topic:nb01-fixes to your review pipeline. Will help bring nb01 online as feature/zuulv3 branch, to prepare for upcoming merge to master | 20:18 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Switch production from zuulv3.o.o to zuul01.o.o https://review.openstack.org/534897 | 20:19 |
| fungi | infra-root: ^ cut-over change, should coincide with changing the cname for zuul.o.o | 20:19 |
| clarkb | snapiri-: in your use case you sitll have to provide the range for the netmask right? gateway and mask are the two pieces of info you need I think? | 20:19 |
| *** b_bezak has quit IRC | 20:19 | |
| clarkb | snapiri-: I'm not sure what it means to create a layer 3 subnet with no subnet | 20:19 |
| pabelanger | fungi: +2 | 20:20 |
| fungi | i've wip'd with notes on what manual actions need to happen in concert with 534897 | 20:20 |
| clarkb | snapiri-: but maybe that means something to neutron? ihrachys do you know? | 20:20 |
| AJaeger | config-core, please put https://review.openstack.org/534896 on your review queue | 20:21 |
| snapiri- | clarkb: I guess not too many people set Q_USE_PROVIDER_NETWORKING :) | 20:22 |
| *** Keitaro has quit IRC | 20:23 | |
| AJaeger | corvus: the requirements change merged, let's merge the top of gate - and change zuul as planned at 20:30 | 20:23 |
| clarkb | snapiri-: but even if they did they have to provide the subnet details to neutron right? thats what I am confused about | 20:23 |
| snapiri- | clarkb: me too. starting a VM to test | 20:23 |
| clarkb | snapiri-: provider networking doesn't remove the need to tell neutron what the subnet is | 20:23 |
| ihrachys | snapiri-, what's 'that'? | 20:24 |
| clarkb | ihrachys: is it valid to not set a subnet pool id or subnet range when creating a subnet for provider networks? | 20:25 |
| clarkb | ihrachys: you still have to tell neutron what the subnet range is when creating the network right? | 20:25 |
| snapiri- | clarkb: in what context? | 20:25 |
| clarkb | in the context of openstack subnet create | 20:25 |
| clarkb | a subnet resource in neutron without a subnet makes no sense to me | 20:25 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking master: Updated from global requirements https://review.openstack.org/520377 | 20:26 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/pbr master: Updated from global requirements https://review.openstack.org/534900 | 20:26 |
| ihrachys | clarkb, from neutron code for create_subnet: | 20:27 |
| ihrachys | msg = _('A cidr must be specified in the absence of a ' | 20:27 |
| ihrachys | 'subnet pool') | 20:27 |
| ihrachys | if that's what you mean | 20:27 |
| clarkb | snapiri-: ya ^ so I think it is still going to be a failure even with your fix | 20:27 |
| openstackgerrit | Kiran Thyagaraja proposed openstack-infra/project-config master: Add ansible-role-k8s-cinder https://review.openstack.org/534594 | 20:27 |
| openstackgerrit | Brian Haley proposed openstack-infra/project-config master: Add Neutron Tempest Plugin Failure Rate dashboard https://review.openstack.org/534902 | 20:27 |
| snapiri- | clarkb: /me going back to testing and getting more info | 20:28 |
| snapiri- | clarkb: I believe I should fix the bug description | 20:29 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements https://review.openstack.org/533958 | 20:31 |
| *** dprince has quit IRC | 20:31 | |
| corvus | AJaeger: i'm assuming you'd like the propose-updates job to finish as well? | 20:32 |
| snapiri- | clarkb, ihrachys: Sorry for the mess... updated the bug once more. If we DO use subnet pool, we do not define the fixed_range_v4 (as we test -z $SUBNETPOOL_V4_ID), thus get incomplete command | 20:32 |
| AJaeger | corvus: those can run with next requirements merge ;) | 20:33 |
| snapiri- | clarkb: does it make sense? | 20:33 |
| corvus | AJaeger: oh, i assumed it was important for all the projects to update or something to fix the sphinx problem | 20:33 |
| AJaeger | corvus: yes, that would be ideal... | 20:33 |
| clarkb | snapiri-: yup, so this is a case where you need either subnet pool or fixed range but in the case of subnet pool we are failing because fixed range isn't set | 20:34 |
| ihrachys | snapiri-, you refer to bug, but you need to understand I haven't followed your discussion before. what's the link? | 20:34 |
| corvus | AJaeger: it's your call :) | 20:34 |
| AJaeger | but every requirements merge runs this - the important part is the upper-constraints files | 20:34 |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr master: future-proof invocation of apidoc https://review.openstack.org/534890 | 20:34 |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr master: emit warning correctly https://review.openstack.org/534927 | 20:34 |
| snapiri- | clarkb: https://bugs.launchpad.net/devstack/+bug/1718111 | 20:34 |
| openstack | Launchpad bug 1718111 in devstack "stack process fails in case we use provider network" [Undecided,In progress] - Assigned to Shachar Snapiri (snapiri) | 20:34 |
| corvus | clarkb, pabelanger: ready? | 20:34 |
| AJaeger | corvus: if you're ready go ahead - there's another requirements job in gate queue, once it merges it will do the rest... | 20:34 |
| corvus | AJaeger: ok | 20:35 |
| clarkb | corvus: yes | 20:35 |
| corvus | clarkb: you want to handle nodepool; pabelanger you want to handle ze*? | 20:35 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Don't fetch coverage report from failing tests https://review.openstack.org/534853 | 20:35 |
| clarkb | oh did nodepool need restarting? I thought it didn't | 20:35 |
| AJaeger | corvus: #status message? | 20:35 |
| corvus | clarkb: i thought you wanted to? | 20:35 |
| ihrachys | snapiri-, the patch seems to make sense | 20:35 |
| clarkb | corvus: I did but then discovered that for a variety of reasons my changes weren't any closer to merging and needed rebases and now need rereview :( | 20:36 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Add winrm certificate handling https://review.openstack.org/529821 | 20:36 |
| clarkb | we changed a test suite api in nodepool | 20:36 |
| clarkb | and that merged this morning | 20:36 |
| fungi | and we need to approve or hand-patch 534897 into the executors and mergers if we want to do the zuul01 cut-over at the same time | 20:36 |
| pabelanger | clarkb: corvus ready here | 20:36 |
| AJaeger | SamYaple: are you around? | 20:36 |
| corvus | status notice Zuul will be offline for a few minutes; existing changes will be re-enqueued; approvals during the downtime will need to be re-added. | 20:36 |
| corvus | how's that look? | 20:36 |
| fungi | lgtm | 20:37 |
| clarkb | corvus: lgtm | 20:37 |
| corvus | fungi: maybe we should hold on the zuul01 move? | 20:37 |
| fungi | fine by me | 20:37 |
| corvus | ok. so it's just the scheduler and executors. | 20:37 |
| fungi | there's no urgency other than the increased risk of running out of ram | 20:37 |
| corvus | #status notice Zuul will be offline for a few minutes; existing changes will be re-enqueued; approvals during the downtime will need to be re-added. | 20:37 |
| snapiri- | ihrachys: Thanks. | 20:37 |
| *** corvus is now known as jeblair | 20:37 | |
| jeblair | #status notice Zuul will be offline for a few minutes; existing changes will be re-enqueued; approvals during the downtime will need to be re-added. | 20:37 |
| openstackstatus | jeblair: sending notice | 20:37 |
| *** jeblair is now known as corvus | 20:37 | |
| corvus | while we're waiting.... https://review.openstack.org/533758 | 20:38 |
| fungi | just noting we'll need another separate outage for that one when we're ready | 20:38 |
| corvus | maybe we can do it and nodepool together | 20:38 |
| ihrachys | clarkb, for the record, I +2d the patch, it seems fine to me | 20:38 |
| fungi | that at least gets us only two outages instead of three, so sounds good | 20:38 |
| corvus | pabelanger: okay, zuul is stopped, you can proceed with ze* | 20:38 |
| pabelanger | okay | 20:39 |
| -openstackstatus- NOTICE: Zuul will be offline for a few minutes; existing changes will be re-enqueued; approvals during the downtime will need to be re-added. | 20:39 | |
| AJaeger | config-core, could you review https://review.openstack.org/534880 and https://review.openstack.org/511150 to remove trove jobs, please? I can +A once Zuul is back online... | 20:39 |
| clarkb | ihrachys: snapiri- thank you for helping me understand that I will approve it when zuul is back up | 20:39 |
| snapiri- | clarkb: I appreciate your patience :) | 20:39 |
| openstackstatus | jeblair: finished sending notice | 20:40 |
| *** dsariel has joined #openstack-infra | 20:41 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Don't gather host keys for non ssh connections https://review.openstack.org/503166 | 20:41 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Add connection-port to provider diskimage https://review.openstack.org/504112 | 20:41 |
| SamYaple | AJaeger: yes | 20:42 |
| SamYaple | i see your message from before now | 20:42 |
| AJaeger | tobiash: you need to recheck those once Zuul is back up again ^ | 20:42 |
| SamYaple | its wierd, its like docker-ce isnt mirrored | 20:42 |
| pabelanger | okay, zuul-executor service on ze* are stopping will take a moment to finish | 20:42 |
| AJaeger | SamYaple: ok | 20:42 |
| SamYaple | which obviously isnt the case | 20:42 |
| tobiash | AJaeger: ah, thanks for the information | 20:42 |
| AJaeger | SamYaple: didn't check log files, just noticed that it's broken for some time ;( | 20:42 |
| tobiash | those are just rebases due to merge conflicts | 20:43 |
| tobiash | will recheck later or tomorrow then | 20:43 |
| SamYaple | AJaeger: yea its been a few weeks, havent gotten back around to fixing the gates | 20:43 |
| AJaeger | SamYaple: if you can't, please disable the post jobs. No sense in having broken jobs - we're often at our limit of nodes... | 20:43 |
| SamYaple | AJaeger: yes, thats reasonable. it will be fixed or disabled by end of week | 20:44 |
| SamYaple | probably wednesday | 20:44 |
| AJaeger | SamYaple: thanks, that works for me | 20:44 |
| SamYaple | errrr thursday* | 20:44 |
| AJaeger | ;) | 20:44 |
| pabelanger | executors still closing SSH_AUTH_SOCK | 20:45 |
| *** wolverineav has quit IRC | 20:47 | |
| pabelanger | okay, few have fully stopped | 20:47 |
| fungi | a few, or few-to-none? | 20:48 |
| pabelanger | 3 stopped, 7 still shutting down | 20:48 |
| *** wolverineav has joined #openstack-infra | 20:49 | |
| pabelanger | sorry, 2 stopped, 8 still shutting down | 20:50 |
| pabelanger | we're dependant on network right now I think, since everything is trying to upload logs | 20:51 |
| clarkb | do those jobs matter? | 20:51 |
| clarkb | if scheduler is stopped we won't vote back based on their results right? | 20:52 |
| pabelanger | right, we likely need to fix that | 20:52 |
| pabelanger | stop right now is gracefully stop, we need a hard stop | 20:52 |
| pabelanger | 6 still shutting down | 20:52 |
| pabelanger | 5 | 20:53 |
| pabelanger | 4 now | 20:53 |
| * tosky braces for the impact | 20:54 | |
| tosky | :) | 20:54 |
| corvus | pabelanger: what do you mean it's a graceful stop? | 20:54 |
| corvus | graceful stop is unimplemented in zuulv3 | 20:55 |
| corvus | this *is* the hard stop | 20:55 |
| pabelanger | right, executor is stopped, but ansible is still running until is finishes it's playbooks list | 20:56 |
| pabelanger | logs are being uploaded to logs.o.o | 20:56 |
| pabelanger | 2 left | 20:56 |
| pabelanger | okay, we are only waiting for ze04 now | 20:57 |
| fungi | but as indicated, if these aren't going to report back to gerrit and the database, then they're effectively dead logs anyway (and likely for aborted jobs) | 20:57 |
| fungi | nor do i expect we care if the connections to the nodes are cleanly shut down since they're just getting deleted | 20:58 |
| corvus | pabelanger: they aren't supposed to continue running playbooks | 20:59 |
| pabelanger | all executors stopped now | 20:59 |
| pabelanger | corvus: something was still running, zuul-executor was still closing SSH_AGENT_SOCK | 21:01 |
| corvus | pabelanger: let's discuss this later | 21:01 |
| *** dhill_ has quit IRC | 21:01 | |
| pabelanger | sure, are we ready to start executors now? | 21:01 |
| corvus | pabelanger: you've updated all of them? | 21:02 |
| *** dhill_ has joined #openstack-infra | 21:02 | |
| pabelanger | shouldn't be anything to update, we just needed to stop / start thenm | 21:02 |
| corvus | pabelanger: oh i thought you had to chown something | 21:02 |
| corvus | pabelanger: start at will | 21:02 |
| ihrachys | with all the jobs forgotten to be executed by zuulv3 lately, and checking each patchset with zuul UI manually is a pita, I was wondering if we could have indication of active zuul job runs in gerrit when you open a patch. I know it's probably slightly tricky but would help projects to detect those stuck patches quicker | 21:02 |
| fungi | ihrachys: it's been implemented but turned off for now because of the added load it was putting on the status api at the time | 21:03 |
| pabelanger | starting | 21:03 |
| ihrachys | fungi, oh nice to hear it was on radar at least! | 21:03 |
| fungi | since people tended to have dozens (or more) gerrit review tabs open in their browsers all polling the status api | 21:03 |
| *** eharney has quit IRC | 21:03 | |
| corvus | ihrachys: if you're good at javascript, you're welcome to take over implementation. i think the person working on it lost interest. | 21:04 |
| fungi | i expect more work is needed to improve efficiency there, but we also haven't tried again with zuulv3 yet | 21:04 |
| * AJaeger waves good night | 21:04 | |
| *** jamesmcarthur has quit IRC | 21:04 | |
| corvus | pabelanger: let me know if they look like they've started okay. i'll wait for that before starting the executor | 21:05 |
| *** jamesmcarthur has joined #openstack-infra | 21:05 | |
| ihrachys | corvus, I am not | 21:05 |
| ihrachys | fungi, maybe fetching it once | 21:06 |
| pabelanger | corvus: yes, they look correct waiting on gearman | 21:06 |
| ihrachys | fungi, I just want to open a patch and see if it's worth waiting for job results, or those are dead | 21:06 |
| ihrachys | then I will recheck and move on with my life | 21:06 |
| ihrachys | currently I need to open zuul, filter there, check if job is running, get back to patch and recheck | 21:06 |
| corvus | our zuul has 5 github installations... | 21:06 |
| ihrachys | I guess I could automate it with a script... :) | 21:07 |
| fungi | ihrachys: yeah, the status api allows you to query specific changesets (or at least did under zuul 2.x so i assume it still can) without having to grab the whole json blob | 21:07 |
| pabelanger | corvus: confirmed all executors look correct | 21:08 |
| fungi | ihrachys: pretty sure that got implemented specifically to satisfy the gerrit webui embedding use case | 21:08 |
| clarkb | corvus: five different package installs for github? | 21:08 |
| *** wolverineav has quit IRC | 21:09 | |
| fungi | clarkb: i'm assuming 5 gh orgs using the zuul app | 21:09 |
| corvus | clarkb: no the app has been "installed" in 5 orgs or projects -- maybe it's just all our orgs + ansible? not sure it just emits numbers not names. | 21:09 |
| *** rfolco has quit IRC | 21:09 | |
| *** wolverineav has joined #openstack-infra | 21:10 | |
| *** jamesmcarthur has quit IRC | 21:10 | |
| *** anticw has joined #openstack-infra | 21:10 | |
| corvus | scheduler is up; restarted zuul-web cause it was doing it's thing where it was hung again | 21:10 |
| corvus | re-enqueuing now | 21:10 |
| pabelanger | things look good on executors | 21:11 |
| pabelanger | stream seems to be working | 21:12 |
| corvus | pabelanger: zuul should abort running ansible as quickly as possible and not run any more ansible instances as soon as a job is canceled, which includes during shutdown. there may be a bug there, but it's a bug, not a missing feature. | 21:12 |
| corvus | pabelanger: it's also possible that it just takes that long to signal all of those processes at once, especially with some of them swapped out. | 21:12 |
| corvus | pabelanger: it might be worth looking at the logs for a particular job to see when it started to abort and what happened after that | 21:13 |
| corvus | (keep in mind that at the same time this is happening, a *lot* of files are being deleted from the job dirs, which is also bound to occupy the system a bit) | 21:14 |
| pabelanger | corvus: agree, I just had somebody come to the door, need to step away for that. But would like to look at logs and see what is happening after we issue stop | 21:15 |
| *** hashar has quit IRC | 21:16 | |
| *** eharney has joined #openstack-infra | 21:16 | |
| *** jamesmcarthur has joined #openstack-infra | 21:19 | |
| corvus | re-enqueue is complete | 21:21 |
| *** kien-ha has joined #openstack-infra | 21:21 | |
| *** rfolco has joined #openstack-infra | 21:22 | |
| *** jamesmcarthur has quit IRC | 21:23 | |
| *** smatzek has quit IRC | 21:24 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config master: Add logstash worker to services table https://review.openstack.org/534953 | 21:25 |
| mtreinish | fungi, AJaeger, clarkb, mordred, pabelanger: ^^^ that should be an easy review | 21:26 |
| *** kjackal has quit IRC | 21:26 | |
| *** hashar has joined #openstack-infra | 21:27 | |
| mtreinish | are there any numbers anywhere on how many different services and/or hosts we are running in infra? | 21:28 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Document connection information for components https://review.openstack.org/534841 | 21:28 |
| fungi | not really, though those of us with access to the ansible inventory can do a grep -c | 21:29 |
| mtreinish | fungi: heh ok. I'm just looking for a big number to put in the updated firehose slides | 21:29 |
| fungi | `sudo ansible '*' --list-hosts|wc -l` says 281 so that's going to be our control plane plus the infra-cloud systems | 21:30 |
| mtreinish | fungi: cool, thanks | 21:31 |
| corvus | hopefully all the services have an entry in that document's index | 21:31 |
| fungi | mtreinish: 127 are in the ic.openstack.org subdomain so call it ~150 in the control plane | 21:31 |
| corvus | er, toc rather | 21:31 |
| clarkb | I count 126 in control plane | 21:31 |
| *** jamesmcarthur has joined #openstack-infra | 21:32 | |
| fungi | perhaps there's some ~25 servers worth of lint in between infracloud and the control plane then | 21:32 |
| * mtreinish wonders how much 25 servers costs on rax | 21:33 | |
| clarkb | this was looking at my meltdown patching lists | 21:33 |
| fungi | though we just cleaned the lint trap recently | 21:33 |
| fungi | mtreinish: i don't want to think about it | 21:33 |
| fungi | pretty sure "lots" is the answer | 21:33 |
| *** aeng has joined #openstack-infra | 21:34 | |
| fungi | mtreinish: out of morbid curiosity i just checked the billing dashboard for our control plane account there, but they're zeroing it automatically (as opposed to some other providers who "charge" us and then "credit" the same) so no idea really | 21:36 |
| pabelanger | corvus: okay, I can the executor still git cloning repo after stop is received via command socket, I'll dive into why that is this evening | 21:37 |
| fungi | i know how much i personally pay them for 3 very small instances and a couple of the smallest cinder volumes you can create and almost no network traffic. it's expensive enough that i should find the time to consider alternatives but their service so far has been excellent and it's hard to find good ipv6 support, reverse dns management, et cetera | 21:38 |
| pabelanger | I'll have to wrap early as family has stopped by | 21:38 |
| mtreinish | fungi: according to https://www.rackspace.com/en-us/calculator 25 2GB general purpose servers on 24/7 would cost $1350.50/month | 21:38 |
| corvus | pabelanger: yeah, i think we don't short-circuit git cloning. that would be nice to fix. | 21:38 |
| fungi | mtreinish: sounds about right. also, almost none of our control plane servers are that small | 21:38 |
| fungi | there are a handful | 21:38 |
| mtreinish | fungi: firehose is iirc :) | 21:39 |
| fungi | yeah, we try to size appropriately when we can, but a lot of what we run just needs more resources | 21:39 |
| * mtreinish checks the slides | 21:39 | |
| mtreinish | yeah 2gb | 21:39 |
| fungi | free says it's still the same 2gb on firehose01.o.o | 21:39 |
| fungi | cacti presumably agrees | 21:40 |
| mtreinish | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=4927&rra_id=all | 21:40 |
| * mtreinish had it up in a tab | 21:41 | |
| clarkb | rerunning `ansible -i /etc/ansible/hosts/openstack '*' -m shell -a "dmesg | grep 'Kernel/User page tables isolation: enabled'"` its interesting to see which hotss have had dmesg buffers roll over | 21:41 |
| pabelanger | corvus: yah, it actually likes like we only short-circuit on git today because gearmans was down and we raised an exception in sendWorkData() | 21:42 |
| *** slaweq_ has joined #openstack-infra | 21:42 | |
| *** threestrands_ has joined #openstack-infra | 21:44 | |
| *** hashar has quit IRC | 21:44 | |
| pabelanger | I'll be back later this evening | 21:44 |
| *** threestrands_ has quit IRC | 21:45 | |
| *** threestrands_ has joined #openstack-infra | 21:45 | |
| *** kien-ha has quit IRC | 21:46 | |
| *** slaweq_ has quit IRC | 21:47 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Handle secrets in branches https://review.openstack.org/534956 | 21:50 |
| corvus | clarkb: ^ that should fix the issues inc0 uncovered | 21:51 |
| corvus | fungi: ^ i'm pretty sure i haven't created a new oracle in that, but it's a particular concern worth looking for | 21:53 |
| fungi | thanks for the heads up | 21:53 |
| fungi | corvus: not really an oracle, but slight loosening of the separation of concerns with regard to the possibility that some branches have different review teams from others so when adding a secret to a branch you need to be sure you trust the reviewers of all other branches of the same repo i guess? | 21:55 |
| corvus | fungi: yes. though i don't think it was ever a concious intent to restrict secrets to a single branch; i think that was an accident. | 21:56 |
| fungi | e.g., adding a "sandbox" branch to your repo where you give out approval rights willy-nilly looks like an increasingly bad idea ;) | 21:56 |
| *** jamesmcarthur has quit IRC | 21:56 | |
| corvus | yeah. we could go the other way on this, and make secrets branch-specific. that ends up being a little more complicated. | 21:57 |
| corvus | but totally doable. i'd be happy to go that direction if we think it's better. | 21:57 |
| fungi | i think the intention to make them branch-agnostic is fine, just need to be clear on what the risks are | 21:58 |
| mordred | corvus: I dunno - I think branch-specific secrets might be hard to reason about generally | 21:58 |
| corvus | fungi: ya, might be worth an explicit callout in the docs | 21:58 |
| clarkb | especially with the way we cut branches | 21:58 |
| clarkb | it means every branch cut you have to rename a bunch of stuff | 21:58 |
| clarkb | (I think) | 21:58 |
| corvus | mordred: i agree -- that's why i started with this direction. | 21:58 |
| mordred | corvus: ++ | 21:58 |
| fungi | yep, i do agree it's the more workable option | 21:58 |
| *** jamesmcarthur has joined #openstack-infra | 21:59 | |
| corvus | clarkb: i expect if we did secrets-per-branch, we'd allow multiple values there, so the master branch foo secret would be distinct from the stable branch foo secret. | 21:59 |
| clarkb | ah | 21:59 |
| corvus | and continuing that thought -- we actually don't have the problem that we do with jobs -- since secrets can only be used in the same repo, we don't have to figure out what branch to use for an unbranched secret. | 22:00 |
| *** david-lyle has quit IRC | 22:00 | |
| corvus | so it's not terrible. but still slightly magic. probably more magic than necessary. | 22:00 |
| corvus | i do think, however, if we find we're wrong about this, this solution is forward-compatible with per-branch secrets. | 22:01 |
| corvus | the inverse is not true. | 22:01 |
| *** trown is now known as trown|outtypewww | 22:01 | |
| dhellmann | when someone has time, and it's safe to do so, I would appreciate another +2 on this patch to create a new tools repo for the community goals: https://review.openstack.org/#/c/533761/ | 22:01 |
| *** rcernin has joined #openstack-infra | 22:02 | |
| *** sbra has quit IRC | 22:08 | |
| *** slaweq_ has joined #openstack-infra | 22:14 | |
| *** jamesmcarthur has quit IRC | 22:15 | |
| *** claudiub has quit IRC | 22:15 | |
| *** jamesmcarthur has joined #openstack-infra | 22:16 | |
| *** slaweq_ has quit IRC | 22:20 | |
| smcginnis | Stuck job? http://zuulv3.openstack.org/stream.html?uuid=cff7982546a444479d1129bcf78e0681&logfile=console.log | 22:20 |
| smcginnis | No update for ~25 minutes now. | 22:20 |
| *** e0ne has quit IRC | 22:20 | |
| clarkb | smcginnis: its running now | 22:22 |
| fungi | that build is entrusted to ze05 which saw a bit of a load spike and started swapping, but doesn't look super severe | 22:23 |
| *** slaweq has quit IRC | 22:23 | |
| smcginnis | clarkb: Hmm, must have just been nap time. :) | 22:23 |
| fungi | in the past we have seen increases in system load and swap activity cause delays between playbooks in a build | 22:24 |
| fungi | PRE-RUN END RESULT_TIMED_OUT: [trusted : git.openstack.org/openstack-infra/project-config/playbooks/base/pre.yaml@master] | 22:24 |
| fungi | so i guess the fetch-zuul-cloner task hit a timeout | 22:25 |
| fungi | maybe network hiccough | 22:25 |
| smcginnis | Ah, finally hit timeout I guess. | 22:25 |
| *** e0ne has joined #openstack-infra | 22:26 | |
| fungi | since it was in the pre phase, it likely got a new build enqueued | 22:26 |
| smcginnis | fungi: Yep, I see it in there again with just the one to rerun. | 22:26 |
| smcginnis | Beats a full recheck at least. | 22:26 |
| clarkb | I womder if we see more compounding load due to that | 22:26 |
| fungi | better than the zuul 2.x days, for sure | 22:26 |
| clarkb | in the old system we didn't retry as aggressivly after a failure | 22:26 |
| smcginnis | Seems like it would be net less load. At least in this case, it just has to rerun the pep8 check rather than all the unit test and tempest jobs. | 22:27 |
| smcginnis | But I suppose it could work the other way. | 22:27 |
| *** e0ne_ has joined #openstack-infra | 22:27 | |
| clarkb | smcginnis: except in the old system it wouldn't do anything | 22:27 |
| clarkb | until someone noticed a day later and rechecked | 22:28 |
| fungi | well, but it is more rapidly applied since rechecking introduces a necessary (human and other) delay | 22:28 |
| fungi | yeah, what clarkb said | 22:28 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Make ZuulDaemonApp an abstract base class https://review.openstack.org/530204 | 22:28 |
| smcginnis | Yeah, that's why I say net it's less. Assuming those other ones do get rechecked at some point. But yep, short term I could see it creating more of a load, especially if the failures are happening due to high load, it could compound things in some cases. | 22:30 |
| fungi | and ultimately, we do still eject it if it gets rerun too many times in a row | 22:30 |
| *** e0ne has quit IRC | 22:30 | |
| fungi | so yes, on balance, probably fewer builds in the long run than the number which would be started fresh on a recheck (especially taking clean check with pre-phase failures on a gate job into account) | 22:32 |
| *** e0ne_ has quit IRC | 22:32 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Handle secrets in branches https://review.openstack.org/534956 | 22:40 |
| corvus | fungi, clarkb, mordred: if we wanted distinct secrets per-branch, we would also need distinct keys, as it would be trivial to simply copy the secret over otherwise. *that* gets much more complicated, and puts us right back in the place where a branch-creation causes a config error. | 22:47 |
| *** david-lyle has joined #openstack-infra | 22:51 | |
| openstackgerrit | Merged openstack-infra/project-config master: create goal-tools repository https://review.openstack.org/533761 | 22:52 |
| *** slaweq has joined #openstack-infra | 22:54 | |
| fungi | corvus: agreed. excellent reason not to | 22:54 |
| *** jkilpatr has quit IRC | 22:54 | |
| *** slaweq has quit IRC | 22:55 | |
| *** wolverineav has quit IRC | 22:59 | |
| *** jamesmcarthur has quit IRC | 23:00 | |
| *** jamesmcarthur has joined #openstack-infra | 23:01 | |
| *** edmondsw has quit IRC | 23:02 | |
| openstackgerrit | Merged openstack-infra/puppet-nodepool master: Don't assume pidfile location https://review.openstack.org/534876 | 23:05 |
| openstackgerrit | Merged openstack-infra/system-config master: Allow corvus to use statusbot https://review.openstack.org/533758 | 23:05 |
| *** hongbin has quit IRC | 23:06 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackci master: Expose zuulv3 setting for nodepool_builder.pp https://review.openstack.org/534887 | 23:06 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Register term_handler for all zuul apps https://review.openstack.org/530205 | 23:07 |
| *** r-daneel has quit IRC | 23:11 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] GPT partitioning support https://review.openstack.org/533490 | 23:11 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Don't fstrim vfat partitions https://review.openstack.org/534969 | 23:11 |
| *** Goneri has quit IRC | 23:16 | |
| *** persia has quit IRC | 23:18 | |
| *** persia has joined #openstack-infra | 23:18 | |
| *** jamesmcarthur has quit IRC | 23:20 | |
| *** jamesmcarthur has joined #openstack-infra | 23:22 | |
| *** slaweq has joined #openstack-infra | 23:26 | |
| *** ganso has quit IRC | 23:26 | |
| *** jamesmcarthur has quit IRC | 23:27 | |
| *** felipemonteiro has quit IRC | 23:27 | |
| *** felipemonteiro has joined #openstack-infra | 23:27 | |
| *** slaweq has quit IRC | 23:31 | |
| openstackgerrit | Merged openstack-infra/system-config master: Toggle zuulv3 settings for nb01.o.o https://review.openstack.org/534889 | 23:32 |
| fungi | pabelanger: ^ looks like it's ready! | 23:33 |
| *** smatzek has joined #openstack-infra | 23:35 | |
| *** smatzek has quit IRC | 23:39 | |
| *** rlandy has quit IRC | 23:40 | |
| *** dhill_ has quit IRC | 23:43 | |
| *** jamesmcarthur has joined #openstack-infra | 23:50 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Handle nodesets in branches https://review.openstack.org/534974 | 23:51 |
| *** persia has quit IRC | 23:53 | |
| *** jamesmcarthur has quit IRC | 23:57 | |
| *** gyee has quit IRC | 23:58 | |
| *** slaweq has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!