| *** Apoorva_ has quit IRC | 00:04 | |
| *** gmann has quit IRC | 00:04 | |
| *** gmann has joined #openstack-infra | 00:05 | |
| *** Apoorva has joined #openstack-infra | 00:05 | |
| *** neiljerram has quit IRC | 00:09 | |
| *** sflanigan has joined #openstack-infra | 00:10 | |
| *** sflanigan has joined #openstack-infra | 00:10 | |
| *** liujiong has joined #openstack-infra | 00:11 | |
| *** jkilpatr has quit IRC | 00:12 | |
| *** mriedem1 has joined #openstack-infra | 00:13 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Revert sync from latest command from ansible https://review.openstack.org/474808 | 00:14 |
|---|---|---|
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Use python2 for ansible on remote hosts https://review.openstack.org/474810 | 00:14 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Store journal in export format not native https://review.openstack.org/468705 | 00:16 |
| *** mriedem has quit IRC | 00:16 | |
| *** ijw has joined #openstack-infra | 00:18 | |
| *** bobh has joined #openstack-infra | 00:20 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Revert "Revert sync from latest command from ansible" https://review.openstack.org/474814 | 00:21 |
| *** zz_dimtruck is now known as dimtruck | 00:22 | |
| *** mriedem1 is now known as mriedem | 00:23 | |
| *** dave-mccowan has quit IRC | 00:24 | |
| *** tuanluong has joined #openstack-infra | 00:24 | |
| *** ijw has quit IRC | 00:27 | |
| openstackgerrit | Steve Baker proposed openstack-infra/tripleo-ci master: Don't capture quickstart.tar.gz https://review.openstack.org/474815 | 00:29 |
| *** masber has quit IRC | 00:32 | |
| *** masber has joined #openstack-infra | 00:32 | |
| *** zhurong has joined #openstack-infra | 00:34 | |
| ianw | clarkb: fatal: unable to connect to git.openstack.org: | 00:38 |
| *** hongbin has quit IRC | 00:38 | |
| ianw | git.openstack.org: Temporary failure in name resolution | 00:38 |
| ianw | that is from my external host ... first time i've ever seen it | 00:39 |
| ianw | but ... maybe it means it's not provider specific? | 00:39 |
| ianw | or, it could just be a glitch in the matrix :/ | 00:39 |
| *** cuongnv has joined #openstack-infra | 00:44 | |
| *** ijw has joined #openstack-infra | 00:47 | |
| *** thorst has quit IRC | 00:47 | |
| *** amotoki is now known as amotoki_away | 00:48 | |
| clarkb | ianw: do you use googl dns? | 00:49 |
| clarkb | tripleo said google dns had problems for them too | 00:49 |
| clarkb | change went in to use opendns first and fallback to google | 00:49 |
| ianw | hmm, this is all in the cloud | 00:50 |
| ianw | but, it's an internal cloud, and they banned outgoing dns, so 98.5% sure it must be using internal redhat servers | 00:50 |
| clarkb | we also noticed it affected non openstack.org names too | 00:51 |
| *** xarses_ has joined #openstack-infra | 00:52 | |
| clarkb | like cirros' hosting location | 00:52 |
| clarkb | so pretty sure its not on our nameserver side | 00:52 |
| *** amotoki_away is now known as amotoki | 00:52 | |
| ianw | yeah, could just be a packet gone missing, of course no replication :/ anyway, a data point i guess | 00:52 |
| *** ijw has quit IRC | 00:55 | |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Implement Depends-On for github [wip] https://review.openstack.org/474401 | 00:56 |
| *** Goneri has quit IRC | 01:00 | |
| *** namnh has joined #openstack-infra | 01:01 | |
| *** Swimingly has quit IRC | 01:05 | |
| *** ijw has joined #openstack-infra | 01:06 | |
| *** rossella_s has joined #openstack-infra | 01:07 | |
| *** Swimingly has joined #openstack-infra | 01:08 | |
| *** Swimingly has quit IRC | 01:08 | |
| *** Swimingly has joined #openstack-infra | 01:08 | |
| *** bobh has quit IRC | 01:10 | |
| *** esberglu has quit IRC | 01:12 | |
| *** aeng has quit IRC | 01:12 | |
| *** jamesmcarthur has joined #openstack-infra | 01:13 | |
| *** markvoelker has quit IRC | 01:13 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: executor: run trusted playbook in a bubblewrap https://review.openstack.org/474460 | 01:15 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: bubblewrap: adds --die-with-parent option https://review.openstack.org/473164 | 01:15 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: config: refactor config get default https://review.openstack.org/474484 | 01:15 |
| *** rossella_s has quit IRC | 01:22 | |
| *** liusheng has joined #openstack-infra | 01:23 | |
| *** dave-mccowan has joined #openstack-infra | 01:23 | |
| *** aeng has joined #openstack-infra | 01:25 | |
| openstackgerrit | Nam Nguyen Hoai proposed openstack-infra/project-config master: Add the grenade test to gate https://review.openstack.org/474824 | 01:28 |
| *** zhurong has quit IRC | 01:30 | |
| *** armax_ has joined #openstack-infra | 01:40 | |
| *** xinliang has quit IRC | 01:41 | |
| *** armax has quit IRC | 01:41 | |
| *** armax_ is now known as armax | 01:41 | |
| *** jamesmcarthur has quit IRC | 01:42 | |
| *** jamesmcarthur has joined #openstack-infra | 01:42 | |
| *** dingyichen has quit IRC | 01:45 | |
| *** dingyichen has joined #openstack-infra | 01:46 | |
| *** zhurong has joined #openstack-infra | 01:49 | |
| openstackgerrit | Nam Nguyen Hoai proposed openstack-infra/project-config master: Add the grenade test to gate https://review.openstack.org/474824 | 01:50 |
| *** dhinesh has quit IRC | 01:52 | |
| *** xinliang has joined #openstack-infra | 01:54 | |
| *** xinliang has quit IRC | 01:54 | |
| *** xinliang has joined #openstack-infra | 01:54 | |
| *** Sukhdev has quit IRC | 01:57 | |
| *** larainema has quit IRC | 02:02 | |
| *** dingyichen has quit IRC | 02:02 | |
| openstackgerrit | Nam Nguyen Hoai proposed openstack-infra/project-config master: Add the grenade test to gate https://review.openstack.org/474824 | 02:05 |
| *** aeng has quit IRC | 02:07 | |
| *** Julien-zte has joined #openstack-infra | 02:07 | |
| *** gomarivera has joined #openstack-infra | 02:07 | |
| *** dingyichen has joined #openstack-infra | 02:10 | |
| *** Apoorva_ has joined #openstack-infra | 02:11 | |
| *** Apoorva has quit IRC | 02:11 | |
| *** gmann_ has joined #openstack-infra | 02:12 | |
| *** ramishra has joined #openstack-infra | 02:14 | |
| *** markvoelker has joined #openstack-infra | 02:14 | |
| *** yland has joined #openstack-infra | 02:16 | |
| *** yland is now known as Guest43898 | 02:17 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Fix unicode encoding gotcha in streamer https://review.openstack.org/474827 | 02:21 |
| *** Apoorva has joined #openstack-infra | 02:21 | |
| *** jamesmcarthur has quit IRC | 02:22 | |
| *** Apoorva_ has quit IRC | 02:24 | |
| *** jamesmcarthur has joined #openstack-infra | 02:24 | |
| *** jamesmcarthur has quit IRC | 02:24 | |
| *** jamesmcarthur has joined #openstack-infra | 02:25 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: config: refactor config get default https://review.openstack.org/474484 | 02:25 |
| *** Apoorva has quit IRC | 02:26 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Add some release notes we forgot to add https://review.openstack.org/474385 | 02:27 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Go back to deleting volumes serially https://review.openstack.org/474783 | 02:27 |
| *** Julien-zte has quit IRC | 02:27 | |
| *** Julien-zte has joined #openstack-infra | 02:28 | |
| *** hoai has joined #openstack-infra | 02:29 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Add log copier to dib jobs https://review.openstack.org/474828 | 02:29 |
| *** hoai has quit IRC | 02:31 | |
| *** jamesmcarthur has quit IRC | 02:32 | |
| *** Julien-zte has quit IRC | 02:33 | |
| *** Julien-zte has joined #openstack-infra | 02:34 | |
| *** mriedem has quit IRC | 02:36 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Properly expand server dicts after rebuild and update https://review.openstack.org/473972 | 02:36 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Break early from volume cleanup loop https://review.openstack.org/474027 | 02:36 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Migrate non-list server interactions to REST https://review.openstack.org/473971 | 02:36 |
| *** jamesmcarthur has joined #openstack-infra | 02:38 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add timestamp output filter https://review.openstack.org/474830 | 02:41 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing individual log files https://review.openstack.org/474831 | 02:41 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Add log copier to dib jobs https://review.openstack.org/474828 | 02:42 |
| ianw | http://mirror.sto2.citycloud.openstack.org/centos/7/os/x86_64/repodata/repomd.xml: [Errno 14] curl#7 - "Failed connect to mirror.sto2.citycloud.openstack.org:80; No route to host" | 02:44 |
| ianw | hmm | 02:44 |
| *** markvoelker has quit IRC | 02:48 | |
| *** jamesmcarthur has quit IRC | 02:49 | |
| *** tuanluong_ has joined #openstack-infra | 02:50 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing individual log files https://review.openstack.org/474831 | 02:59 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add timestamp output filter https://review.openstack.org/474830 | 02:59 |
| *** yamahata_ has quit IRC | 03:02 | |
| *** ykarel has joined #openstack-infra | 03:03 | |
| tonyb | ... How does one get a new library from pypi installed as part of the std. nodepool image? | 03:05 |
| *** gomarivera has quit IRC | 03:06 | |
| ianw | tonyb: that probably is not what we would want to do ... what's the problem? | 03:06 |
| *** namnh has quit IRC | 03:06 | |
| ianw | ^ mirror.std2.citycloud.openstack.org seems to have got itself into an oopsy situation with AFS issues. i'm rebooting it | 03:07 |
| tonyb | It seems like we could drop http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/project-requirements-change.py#n120 is we just had openstack_requirements installed | 03:07 |
| *** namnh has joined #openstack-infra | 03:07 | |
| tonyb | ianw: ^ | 03:07 |
| ianw | hmm, now it's not talking to the metadata server as it boots :/ | 03:07 |
| *** gomarivera has joined #openstack-infra | 03:08 | |
| tonyb | ianw: I found that whiel tryign to untangle the dib update you asked about this morning | 03:09 |
| openstackgerrit | Steve Baker proposed openstack-infra/tripleo-ci master: Use undeprecated heat commands in get_host_info.sh https://review.openstack.org/474834 | 03:09 |
| ianw | mirror.std2.citycloud is not happy with it's network -> http://paste.openstack.org/show/612811/ | 03:11 |
| tonyb | ianw: which I now understand BTW | 03:11 |
| ianw | tonyb: what is that function doing in english? :/ ... | 03:12 |
| *** chlong has quit IRC | 03:12 | |
| tonyb | ianw: manually loads openstack_requirements from the files on disk cloned by zuul | 03:13 |
| tonyb | ianw: historically there wasn't a library we could just install so it wasn't *that* bonkers but now we can ditch it if the library was just there | 03:14 |
| ianw | ok, re mirror.std2.citycloud ... i don't know what was up, but i detached the interface, reattached it and added back the floating IP and I can talk to it now ... | 03:15 |
| ianw | citycloud people maybe you want to look at the logs there ... | 03:16 |
| *** gyee has quit IRC | 03:17 | |
| *** hongbin has joined #openstack-infra | 03:17 | |
| ianw | tonyb: it seems like it's doing the right thing? it's using zuul-cloner to get that, so that Depends-On: works for example | 03:17 |
| ianw | we would not want that installed on every host? | 03:17 |
| tonyb | ianw: Hmm now I have a doubt, I think we want the zuul-cloner to work as is the the *data* but the code is logically seperate | 03:19 |
| tonyb | so I *think* we'll still load the data correctly but the code will come form the tagged version on pypi | 03:19 |
| *** gmann_ has quit IRC | 03:20 | |
| ianw | oh wow, yeah i see what it's up to i think | 03:21 |
| *** Sukhdev has joined #openstack-infra | 03:22 | |
| ianw | it installs requirements into a virtualenv, then finds the sys-path, adds it to itself, then imports | 03:22 |
| tonyb | ianw: Yeah | 03:22 |
| ianw | urgh. you can actually activate the virtualenv within yourself which would at least be a bit nicer | 03:22 |
| ianw | https://git.openstack.org/cgit/openstack/diskimage-builder/tree/diskimage_builder/disk_image_create.py#n33 is an example | 03:23 |
| *** jamesmcarthur has joined #openstack-infra | 03:24 | |
| ianw | why would we not create the virtualenv in the gate-{name}-requirements job, and then run this script with it? | 03:25 |
| tonyb | huh I didn't know that was a thing | 03:25 |
| ianw | it -- being the python from that virtualenv | 03:25 |
| openstackgerrit | Steve Baker proposed openstack-infra/tripleo-ci master: Use undeprecated heat commands in get_host_info.sh https://review.openstack.org/474834 | 03:25 |
| tonyb | ianw: that'd work too | 03:25 |
| ianw | tonyb: it would look something like http://paste.openstack.org/show/612812/ i'd imaginge | 03:27 |
| tonyb | so virtualenv .foo ; .foo/bin/pip install openstack_requirements and_$stuff ; .foo/bin/python project-requiremnts-changes ? | 03:27 |
| ianw | yep, that's the gist | 03:28 |
| ianw | and as a bonus it would be python3 safe | 03:28 |
| tonyb | ianw: okay I think we're looking at it from different angles. | 03:29 |
| ianw | probably :) | 03:29 |
| tonyb | hehe | 03:29 |
| tonyb | I'll much around with it and see how it looks | 03:30 |
| *** ramishra has quit IRC | 03:41 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Remove some unused mocks https://review.openstack.org/474840 | 03:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert list servers tests to requests_mock https://review.openstack.org/474841 | 03:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert list_servers to REST https://review.openstack.org/474842 | 03:41 |
| *** ramishra has joined #openstack-infra | 03:42 | |
| *** dave-mccowan has quit IRC | 03:43 | |
| *** yamahata_ has joined #openstack-infra | 03:44 | |
| *** jamesmcarthur has quit IRC | 03:46 | |
| *** markvoelker has joined #openstack-infra | 03:46 | |
| *** jamesmcarthur has joined #openstack-infra | 03:47 | |
| *** jamesmcarthur has quit IRC | 03:48 | |
| *** yamahata_ has quit IRC | 03:51 | |
| *** yamahata_ has joined #openstack-infra | 03:52 | |
| *** armax has quit IRC | 03:52 | |
| *** hongbin has quit IRC | 03:52 | |
| *** jaosorior_away is now known as jaosorior | 03:53 | |
| *** ykarel has quit IRC | 03:58 | |
| *** s-shiono has joined #openstack-infra | 04:01 | |
| *** s-shiono_ has joined #openstack-infra | 04:02 | |
| *** s-shiono has quit IRC | 04:05 | |
| *** aeng has joined #openstack-infra | 04:08 | |
| *** prateek has joined #openstack-infra | 04:09 | |
| *** hichihara has joined #openstack-infra | 04:11 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing individual log files https://review.openstack.org/474831 | 04:16 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add timestamp output filter https://review.openstack.org/474830 | 04:16 |
| *** markvoelker has quit IRC | 04:18 | |
| *** mattmceuen has joined #openstack-infra | 04:22 | |
| *** prateek has quit IRC | 04:22 | |
| *** prateek has joined #openstack-infra | 04:23 | |
| *** zhurong has quit IRC | 04:25 | |
| *** gmann_ has joined #openstack-infra | 04:25 | |
| *** gildub has quit IRC | 04:27 | |
| *** zhurong has joined #openstack-infra | 04:30 | |
| *** larainema has joined #openstack-infra | 04:33 | |
| *** hamzy has joined #openstack-infra | 04:36 | |
| *** thorst has joined #openstack-infra | 04:38 | |
| *** Julien-zte has quit IRC | 04:39 | |
| *** gildub has joined #openstack-infra | 04:44 | |
| *** thorst has quit IRC | 04:46 | |
| *** jamesmcarthur has joined #openstack-infra | 04:48 | |
| *** salv-orlando has joined #openstack-infra | 04:50 | |
| *** jamesmcarthur has quit IRC | 04:53 | |
| *** dingyichen has quit IRC | 05:04 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: executor: add support for custom ansible_port https://review.openstack.org/468710 | 05:08 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Add support for custom ssh port https://review.openstack.org/468752 | 05:08 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Abstract Nodepool request handling code https://review.openstack.org/468748 | 05:08 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Abstract Nodepool provider management code https://review.openstack.org/468749 | 05:09 |
| *** cody-somerville has joined #openstack-infra | 05:10 | |
| *** tushar has quit IRC | 05:10 | |
| *** csomerville has quit IRC | 05:10 | |
| *** cody-somerville has quit IRC | 05:10 | |
| *** cody-somerville has joined #openstack-infra | 05:11 | |
| *** tumbarka has joined #openstack-infra | 05:11 | |
| *** Sukhdev has quit IRC | 05:13 | |
| *** mattmceuen has quit IRC | 05:14 | |
| *** salv-orl_ has joined #openstack-infra | 05:15 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Collect request handling implementation in an OpenStack driver https://review.openstack.org/468750 | 05:15 |
| *** markvoelker has joined #openstack-infra | 05:15 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Extend Nodepool configuration syntax to support multiple drivers https://review.openstack.org/468751 | 05:16 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement a static driver for Nodepool https://review.openstack.org/468624 | 05:16 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing individual log files https://review.openstack.org/474831 | 05:17 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add timestamp output filter https://review.openstack.org/474830 | 05:17 |
| *** jbadiapa has quit IRC | 05:18 | |
| *** salv-orlando has quit IRC | 05:18 | |
| openstackgerrit | Kazuhiro Suzuki proposed openstack-infra/project-config master: Create tap-as-a-service-dashboard project https://review.openstack.org/468747 | 05:19 |
| *** gomarivera has quit IRC | 05:20 | |
| *** gouthamr has quit IRC | 05:25 | |
| *** mhickey has joined #openstack-infra | 05:26 | |
| *** gomarivera has joined #openstack-infra | 05:27 | |
| *** ykarel has joined #openstack-infra | 05:31 | |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Implement Depends-On for github [wip] https://review.openstack.org/474401 | 05:32 |
| *** david-lyle has quit IRC | 05:34 | |
| *** dingyichen has joined #openstack-infra | 05:35 | |
| *** ltomasbo|away is now known as ltomasbo | 05:36 | |
| *** winggundamth has joined #openstack-infra | 05:37 | |
| *** kornicameister has joined #openstack-infra | 05:39 | |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Implement pipeline requirement of github labels https://review.openstack.org/473962 | 05:41 |
| *** pgadiya has joined #openstack-infra | 05:41 | |
| *** dhajare has joined #openstack-infra | 05:44 | |
| *** tushar has joined #openstack-infra | 05:45 | |
| *** tumbarka has quit IRC | 05:45 | |
| *** tuanluong has quit IRC | 05:46 | |
| *** tuanluong_ has quit IRC | 05:46 | |
| *** markvoelker has quit IRC | 05:49 | |
| *** tumbarka has joined #openstack-infra | 05:53 | |
| *** tushar has quit IRC | 05:53 | |
| *** prateek has quit IRC | 05:56 | |
| *** tushar has joined #openstack-infra | 05:56 | |
| *** prateek has joined #openstack-infra | 05:56 | |
| *** tumbarka has quit IRC | 05:58 | |
| *** thorst has joined #openstack-infra | 06:01 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing individual log files https://review.openstack.org/474831 | 06:02 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add timestamp output filter https://review.openstack.org/474830 | 06:02 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Add support for zuul.d configuration split https://review.openstack.org/473764 | 06:02 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/openstack-zuul-jobs master: Add tox/py34 job https://review.openstack.org/472583 | 06:02 |
| *** thorst has quit IRC | 06:05 | |
| *** xinliang has quit IRC | 06:06 | |
| *** xinliang has joined #openstack-infra | 06:08 | |
| *** xinliang has joined #openstack-infra | 06:09 | |
| *** Hal has quit IRC | 06:09 | |
| *** namnh has quit IRC | 06:14 | |
| *** namnh has joined #openstack-infra | 06:15 | |
| *** cshen has quit IRC | 06:19 | |
| *** rcernin has joined #openstack-infra | 06:19 | |
| *** rcernin has quit IRC | 06:24 | |
| *** tushar_ has joined #openstack-infra | 06:29 | |
| *** mhickey has quit IRC | 06:32 | |
| *** e0ne has joined #openstack-infra | 06:33 | |
| *** jbadiapa has joined #openstack-infra | 06:34 | |
| *** markus_z has joined #openstack-infra | 06:37 | |
| *** sflanigan has quit IRC | 06:39 | |
| *** rcernin has joined #openstack-infra | 06:39 | |
| *** hrubi has quit IRC | 06:39 | |
| *** e0ne has quit IRC | 06:43 | |
| *** pcaruana has joined #openstack-infra | 06:43 | |
| *** hrubi has joined #openstack-infra | 06:44 | |
| *** gmann_ has quit IRC | 06:45 | |
| *** markvoelker has joined #openstack-infra | 06:46 | |
| *** dimtruck is now known as zz_dimtruck | 06:46 | |
| *** florianf has joined #openstack-infra | 06:46 | |
| *** hrubi has quit IRC | 06:49 | |
| *** mtanino has quit IRC | 06:51 | |
| *** kjackal_ has joined #openstack-infra | 06:52 | |
| *** hrubi has joined #openstack-infra | 06:55 | |
| *** Hal has joined #openstack-infra | 06:57 | |
| *** aeng has quit IRC | 06:57 | |
| openstackgerrit | Adrian Turjak proposed openstack-infra/project-config master: new project - Adjutant https://review.openstack.org/474867 | 06:59 |
| *** jamesmcarthur has joined #openstack-infra | 07:00 | |
| *** tushar has quit IRC | 07:00 | |
| *** tushar has joined #openstack-infra | 07:01 | |
| *** amoralej|off is now known as amoralej | 07:01 | |
| *** NileshSawant has joined #openstack-infra | 07:02 | |
| NileshSawant | Hello, Our CI is failing | 07:03 |
| NileshSawant | http://52.35.51.88/52/474852/1/check/dsvm-veritas-hyperscale-cinder-driver/f6746e2/logs/devstacklog.txt.gz#_2017-06-16_05_51_30_490 | 07:03 |
| *** Hal has quit IRC | 07:03 | |
| *** hrubi has quit IRC | 07:04 | |
| NileshSawant | die 535 'Cloning not allowed in this configuration' for horizon | 07:04 |
| NileshSawant | is there any workarround for this ? | 07:04 |
| *** jamesmcarthur has quit IRC | 07:06 | |
| *** hrubi has joined #openstack-infra | 07:08 | |
| *** tesseract has joined #openstack-infra | 07:09 | |
| *** ccamacho has left #openstack-infra | 07:10 | |
| *** jtomasek has joined #openstack-infra | 07:10 | |
| *** ralonsoh has joined #openstack-infra | 07:13 | |
| *** watersoul_ has joined #openstack-infra | 07:13 | |
| *** watersoul has quit IRC | 07:17 | |
| *** markvoelker has quit IRC | 07:19 | |
| *** hashar has joined #openstack-infra | 07:21 | |
| *** gildub has quit IRC | 07:26 | |
| *** shardy has joined #openstack-infra | 07:32 | |
| openstackgerrit | Merged openstack-infra/subunit2sql master: Disable SmartyPants for docs https://review.openstack.org/452048 | 07:44 |
| *** NileshSawant has quit IRC | 07:49 | |
| *** dtantsur|afk is now known as dtantsur | 07:49 | |
| *** jpich has joined #openstack-infra | 07:50 | |
| *** alexchadin has joined #openstack-infra | 07:55 | |
| *** martinkopec has joined #openstack-infra | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** thorst has joined #openstack-infra | 08:02 | |
| *** zzzeek has joined #openstack-infra | 08:02 | |
| *** jbadiapa has quit IRC | 08:03 | |
| *** hichihara has quit IRC | 08:04 | |
| *** thorst has quit IRC | 08:06 | |
| *** JudeC has joined #openstack-infra | 08:07 | |
| *** Julien-zte has joined #openstack-infra | 08:08 | |
| *** mhickey has joined #openstack-infra | 08:12 | |
| *** JudeC has quit IRC | 08:14 | |
| *** andreww has joined #openstack-infra | 08:14 | |
| *** andreww has quit IRC | 08:15 | |
| *** xarses_ has quit IRC | 08:15 | |
| *** andreww has joined #openstack-infra | 08:15 | |
| *** xarses has quit IRC | 08:15 | |
| *** xarses_ has joined #openstack-infra | 08:15 | |
| *** andreww has quit IRC | 08:16 | |
| *** Julien-z_ has joined #openstack-infra | 08:16 | |
| *** andreww has joined #openstack-infra | 08:16 | |
| *** markvoelker has joined #openstack-infra | 08:16 | |
| *** ccamacho has joined #openstack-infra | 08:17 | |
| *** dingyichen has quit IRC | 08:18 | |
| *** Julien-zte has quit IRC | 08:18 | |
| *** e0ne has joined #openstack-infra | 08:18 | |
| *** jbadiapa has joined #openstack-infra | 08:19 | |
| *** rcernin has quit IRC | 08:21 | |
| *** rcernin has joined #openstack-infra | 08:22 | |
| *** gomarivera has quit IRC | 08:22 | |
| *** Julien-z_ has quit IRC | 08:23 | |
| *** Julien-zte has joined #openstack-infra | 08:28 | |
| *** jbadiapa has quit IRC | 08:29 | |
| *** florianf has quit IRC | 08:34 | |
| *** zhurong has quit IRC | 08:37 | |
| *** Julien-zte has quit IRC | 08:38 | |
| *** electrofelix has joined #openstack-infra | 08:39 | |
| *** lucas-afk is now known as lucasagomes | 08:39 | |
| *** neiljerram has joined #openstack-infra | 08:40 | |
| *** zhurong has joined #openstack-infra | 08:44 | |
| *** jbadiapa has joined #openstack-infra | 08:44 | |
| *** Julien-zte has joined #openstack-infra | 08:47 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Don't capture quickstart.tar.gz https://review.openstack.org/474815 | 08:49 |
| *** markvoelker has quit IRC | 08:50 | |
| *** florianf has joined #openstack-infra | 08:51 | |
| *** salv-orl_ has quit IRC | 08:51 | |
| *** tosky has joined #openstack-infra | 08:57 | |
| *** liujiong has quit IRC | 08:59 | |
| *** salv-orlando has joined #openstack-infra | 09:05 | |
| *** kornicameister has quit IRC | 09:07 | |
| *** dizquierdo has joined #openstack-infra | 09:08 | |
| *** sflanigan has joined #openstack-infra | 09:11 | |
| *** sflanigan has joined #openstack-infra | 09:11 | |
| *** makowals has quit IRC | 09:14 | |
| *** tumbarka has joined #openstack-infra | 09:16 | |
| *** tushar has quit IRC | 09:16 | |
| *** NileshSawant has joined #openstack-infra | 09:16 | |
| NileshSawant | Hello, Our CI is failing, http://52.35.51.88/52/474852/1/check/dsvm-veritas-hyperscale-cinder-driver/f6746e2/logs/devstacklog.txt.gz#_2017-06-16_05_51_30_490 | 09:17 |
| *** makowals has joined #openstack-infra | 09:17 | |
| *** efoley has joined #openstack-infra | 09:19 | |
| openstackgerrit | Markus Zoeller (markus_z) proposed openstack-infra/shade master: docs: make the first example easier to understand https://review.openstack.org/474920 | 09:22 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Cleanup usused meeting slots https://review.openstack.org/474473 | 09:25 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Fix osops meeting handle https://review.openstack.org/474471 | 09:26 |
| *** sambetts|afk is now known as sambetts | 09:28 | |
| *** tumbarka has quit IRC | 09:29 | |
| *** tushar has joined #openstack-infra | 09:29 | |
| *** andreww has quit IRC | 09:30 | |
| openstackgerrit | Unana Okpoyo proposed openstack-infra/project-config master: A Devstack-plugin that installs a VMAX backend https://review.openstack.org/474924 | 09:31 |
| *** jamesmcarthur has joined #openstack-infra | 09:31 | |
| *** tumbarka has joined #openstack-infra | 09:33 | |
| namnh | ianw: sorry to bother you. But the Technical committee require that we need to add the grenade test to gate. So I had to push this patch: https://review.openstack.org/#/c/474824/. could you please review it for me. Thanks so much | 09:33 |
| *** tushar has quit IRC | 09:36 | |
| *** jamesmcarthur has quit IRC | 09:36 | |
| *** Julien-zte has quit IRC | 09:40 | |
| *** yamahata_ has quit IRC | 09:47 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Use undeprecated heat commands in get_host_info.sh https://review.openstack.org/474834 | 09:47 |
| *** markvoelker has joined #openstack-infra | 09:47 | |
| *** stakeda has quit IRC | 09:50 | |
| *** hashar_ has joined #openstack-infra | 09:58 | |
| *** zhurong has quit IRC | 09:59 | |
| *** hashar has quit IRC | 09:59 | |
| *** jascott1 has quit IRC | 10:00 | |
| *** jascott1 has joined #openstack-infra | 10:01 | |
| *** thorst has joined #openstack-infra | 10:03 | |
| *** Julien-zte has joined #openstack-infra | 10:03 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/474147 | 10:03 |
| *** mhickey has quit IRC | 10:04 | |
| *** jascott1 has quit IRC | 10:05 | |
| *** thorst has quit IRC | 10:07 | |
| openstackgerrit | Unana Okpoyo proposed openstack-infra/project-config master: A Devstack-plugin that installs a VMAX backend https://review.openstack.org/474924 | 10:13 |
| frickler | NileshSawant: well it tells you the solution right away: add horizon to $PROJECTS in your job definition, according to http://52.35.51.88/52/474852/1/check/dsvm-veritas-hyperscale-cinder-driver/f6746e2/console.html it is missing currently | 10:18 |
| robcresswell | frickler: Oh you and your expecting people to read logs XD | 10:19 |
| frickler | robcresswell: I don't expect others to read logs, but I like doing it myself for fun, just like solving a couple of sudokus in the morning ;) | 10:20 |
| *** markvoelker has quit IRC | 10:21 | |
| *** kornicameister has joined #openstack-infra | 10:24 | |
| *** panda|ko is now known as panda | 10:28 | |
| *** NileshSawant has quit IRC | 10:30 | |
| *** rhallisey has joined #openstack-infra | 10:32 | |
| *** jamesmcarthur has joined #openstack-infra | 10:33 | |
| openstackgerrit | Unana Okpoyo proposed openstack-infra/project-config master: A Devstack-plugin that installs a VMAX backend https://review.openstack.org/474924 | 10:34 |
| *** ivyyy has quit IRC | 10:37 | |
| *** ivyyy has joined #openstack-infra | 10:38 | |
| *** s-shiono_ has quit IRC | 10:38 | |
| *** andreww has joined #openstack-infra | 10:39 | |
| *** jamesmcarthur has quit IRC | 10:40 | |
| *** xarses has joined #openstack-infra | 10:42 | |
| robcresswell | frickler: I always describe programming as being the same type of enjoyment as solving a sudoku or a puzzle. | 10:43 |
| *** hashar_ is now known as hashar | 10:43 | |
| robcresswell | frickler: And I generally expect people to read logs before asking for help, but I'm grumpy these days :) | 10:43 |
| *** andreww has quit IRC | 10:44 | |
| *** Julien-zte has quit IRC | 10:48 | |
| *** katkapilatova has joined #openstack-infra | 10:50 | |
| *** pgadiya has quit IRC | 10:51 | |
| *** thorst has joined #openstack-infra | 10:55 | |
| *** sdague has joined #openstack-infra | 10:56 | |
| *** dmanchad has quit IRC | 10:56 | |
| *** dmanchad has joined #openstack-infra | 10:56 | |
| *** cuongnv has quit IRC | 10:57 | |
| *** thorst has quit IRC | 10:58 | |
| *** thorst has joined #openstack-infra | 10:58 | |
| *** alexchadin has quit IRC | 10:58 | |
| *** jkilpatr has joined #openstack-infra | 10:59 | |
| *** nicolasbock has joined #openstack-infra | 11:02 | |
| *** thorst has quit IRC | 11:02 | |
| *** tushar_ has quit IRC | 11:04 | |
| *** sflanigan has quit IRC | 11:04 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement an OpenContainer driver https://review.openstack.org/468753 | 11:07 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 11:11 |
| *** salv-orl_ has joined #openstack-infra | 11:15 | |
| *** salv-orlando has quit IRC | 11:17 | |
| *** markvoelker has joined #openstack-infra | 11:18 | |
| *** lucasagomes is now known as lucas-hungry | 11:22 | |
| *** namnh has quit IRC | 11:31 | |
| *** jamesmcarthur has joined #openstack-infra | 11:37 | |
| *** askb has quit IRC | 11:39 | |
| *** jamesmcarthur has quit IRC | 11:41 | |
| *** hashar has quit IRC | 11:43 | |
| *** ericyoung has joined #openstack-infra | 11:45 | |
| *** ldnunes has joined #openstack-infra | 11:45 | |
| *** wolverineav has joined #openstack-infra | 11:48 | |
| *** markvoelker has quit IRC | 11:51 | |
| *** MasterofJOKers has joined #openstack-infra | 11:56 | |
| *** ykarel has quit IRC | 11:58 | |
| *** ykarel has joined #openstack-infra | 11:58 | |
| openstackgerrit | Darragh Bailey proposed openstack/python-jenkins master: Pass form data as body instead of in the url https://review.openstack.org/474952 | 12:00 |
| *** jascott1 has joined #openstack-infra | 12:01 | |
| *** jascott1 has quit IRC | 12:06 | |
| *** alexchadin has joined #openstack-infra | 12:07 | |
| *** winggundamth has quit IRC | 12:07 | |
| *** hashar has joined #openstack-infra | 12:08 | |
| *** dprince has joined #openstack-infra | 12:20 | |
| *** thorst has joined #openstack-infra | 12:21 | |
| *** eharney has joined #openstack-infra | 12:24 | |
| *** hashar has quit IRC | 12:29 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Go back to deleting volumes serially https://review.openstack.org/474783 | 12:29 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Add some release notes we forgot to add https://review.openstack.org/474385 | 12:30 |
| openstackgerrit | Gavin Brebner proposed openstack-infra/subunit2sql master: Dailycount should not need build_queue to exist. https://review.openstack.org/474701 | 12:32 |
| *** arxcruz is now known as arxcruz|off | 12:32 | |
| *** trown|outtypewww is now known as trown | 12:37 | |
| *** jamesmcarthur has joined #openstack-infra | 12:37 | |
| *** rfolco has joined #openstack-infra | 12:39 | |
| *** rlandy has joined #openstack-infra | 12:40 | |
| *** prateek has quit IRC | 12:42 | |
| *** jamesmcarthur has quit IRC | 12:42 | |
| *** markvoelker has joined #openstack-infra | 12:42 | |
| *** HeOS has quit IRC | 12:43 | |
| *** lucas-hungry is now known as lucasagomes | 12:44 | |
| *** gcb has quit IRC | 12:46 | |
| *** HeOS has joined #openstack-infra | 12:50 | |
| *** hashar has joined #openstack-infra | 12:51 | |
| *** zengchen has quit IRC | 12:54 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] toci_gate_test: handle tripleo-ci specific feature configuration https://review.openstack.org/474966 | 12:56 |
| *** dave-mccowan has joined #openstack-infra | 13:00 | |
| *** jcoufal has joined #openstack-infra | 13:03 | |
| *** gouthamr has joined #openstack-infra | 13:03 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add mailing list for API Users and SDK authors https://review.openstack.org/468046 | 13:03 |
| mordred | clarkb, fungi: ^^ how's that - took clarkb's name suggestion | 13:04 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] toci_gate_test: handle tripleo-ci specific feature configuration https://review.openstack.org/474966 | 13:04 |
| openstackgerrit | Merged openstack-infra/shade master: docs: make the first example easier to understand https://review.openstack.org/474920 | 13:08 |
| *** esberglu has joined #openstack-infra | 13:08 | |
| openstackgerrit | Merged openstack-infra/shade master: Migrate non-list server interactions to REST https://review.openstack.org/473971 | 13:08 |
| *** MatthewLi has quit IRC | 13:08 | |
| *** MatthewLi has joined #openstack-infra | 13:10 | |
| *** gomarivera has joined #openstack-infra | 13:11 | |
| openstackgerrit | Merged openstack-infra/shade master: Properly expand server dicts after rebuild and update https://review.openstack.org/473972 | 13:16 |
| *** jcoufal_ has joined #openstack-infra | 13:17 | |
| *** kgiusti has joined #openstack-infra | 13:18 | |
| *** jcoufal has quit IRC | 13:19 | |
| *** alexchadin has quit IRC | 13:23 | |
| *** gomarivera has quit IRC | 13:25 | |
| *** dtantsur is now known as dtantsur|brb | 13:25 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Remove item.layout https://review.openstack.org/474188 | 13:25 |
| *** gomarivera has joined #openstack-infra | 13:26 | |
| *** HeOS has quit IRC | 13:26 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Move dependency cycle detection into pipelines https://review.openstack.org/451423 | 13:27 |
| *** jamesmcarthur has joined #openstack-infra | 13:27 | |
| *** mdrabe has joined #openstack-infra | 13:29 | |
| *** amoralej is now known as amoralej|lunch | 13:30 | |
| *** gomarivera has quit IRC | 13:30 | |
| *** baoli has joined #openstack-infra | 13:31 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Revert "Revert sync from latest command from ansible" https://review.openstack.org/474814 | 13:31 |
| *** jamesmcarthur has quit IRC | 13:32 | |
| openstackgerrit | Gavin Brebner proposed openstack-infra/subunit2sql master: Dailycount should not need build_queue to exist. https://review.openstack.org/474701 | 13:35 |
| *** yamamoto_ has joined #openstack-infra | 13:41 | |
| *** HeOS has joined #openstack-infra | 13:43 | |
| *** yamamoto has quit IRC | 13:44 | |
| *** ihrachys has joined #openstack-infra | 13:46 | |
| *** xarses_ has quit IRC | 13:48 | |
| *** xarses has quit IRC | 13:48 | |
| *** shardy is now known as shardy_afk | 13:51 | |
| *** xarses has joined #openstack-infra | 13:52 | |
| *** xarses_ has joined #openstack-infra | 13:52 | |
| *** xarses has quit IRC | 13:52 | |
| *** xarses has joined #openstack-infra | 13:53 | |
| *** mriedem has joined #openstack-infra | 13:55 | |
| *** NileshSawant has joined #openstack-infra | 13:56 | |
| *** xarses_ has quit IRC | 13:58 | |
| *** rbrndt has joined #openstack-infra | 13:58 | |
| *** dtantsur|brb is now known as dtantsur | 14:01 | |
| *** jascott1 has joined #openstack-infra | 14:02 | |
| apuimedo | dims: sdague: please, take a look at https://review.openstack.org/#/c/474986/ | 14:06 |
| sdague | apuimedo: if dims likes it, I'm fine with it | 14:07 |
| *** jascott1 has quit IRC | 14:07 | |
| *** shardy_afk is now known as shardy | 14:09 | |
| *** jamesmcarthur has joined #openstack-infra | 14:09 | |
| *** zz_dimtruck is now known as dimtruck | 14:12 | |
| *** chlong has joined #openstack-infra | 14:14 | |
| apuimedo | ok ;-) | 14:15 |
| apuimedo | Thanks | 14:15 |
| *** yamahata_ has joined #openstack-infra | 14:16 | |
| *** bobh has joined #openstack-infra | 14:17 | |
| *** kjackal_ has quit IRC | 14:19 | |
| NileshSawant | frickler: can you please help me fixing CI failures ? | 14:20 |
| *** dhajare has quit IRC | 14:21 | |
| *** bobh has quit IRC | 14:23 | |
| *** katkapilatova has left #openstack-infra | 14:24 | |
| dhellmann | does anyone have any idea why jenkins wasn't triggered for this patch series? https://review.openstack.org/#/c/474746/1 | 14:24 |
| dhellmann | not jenkins, zuul. whatever -- there are no test jobs | 14:24 |
| *** gomarivera has joined #openstack-infra | 14:25 | |
| dhellmann | is it because of the depends-on? | 14:25 |
| dhellmann | well, that would only apply to the next patch in the series, so that mustn't be it | 14:25 |
| *** amoralej|lunch is now known as amoralej | 14:26 | |
| fungi | dhellmann: well, if zuul finds a dependency loop anywhere between direct parent/child git relationships and depends-on footers in commit messages, it aborts calculating dependencies as a safety measure | 14:28 |
| dhellmann | hmm, I wonder if I have a loop | 14:28 |
| dhellmann | the next patch should depend on the spec | 14:28 |
| *** jroll has joined #openstack-infra | 14:29 | |
| dhellmann | and then there's a project-config change that will depend on that patch | 14:29 |
| dhellmann | and that project-config patch may also depend on an infra change that depends on the spec | 14:29 |
| fungi | i can check the zuul logs to try and spot the loop, if there is one | 14:29 |
| dhellmann | but I don't think that's a loop | 14:29 |
| dhellmann | it's a diamond, I guess? | 14:29 |
| dhellmann | that would help | 14:30 |
| jroll | quick question, does JJB support reading existing config and outputting that to yaml? | 14:30 |
| dhellmann | fungi: I'd hate to be lining up all of these patches in a way we can't land | 14:30 |
| fungi | jroll: i don't believe it has an xml parser, so wouldn't be able to do that | 14:30 |
| fungi | jroll: just parses yaml and emits xml | 14:30 |
| jroll | fungi: nod, thanks :) | 14:31 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add CA service to puppetmaster.o.o for zuul https://review.openstack.org/474255 | 14:31 |
| *** electrofelix has quit IRC | 14:35 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: can_promote function: fix case for oooq when ZUUL_CHANGES is not defined https://review.openstack.org/474504 | 14:36 |
| *** jaosorior has quit IRC | 14:37 | |
| openstackgerrit | Daniel Mellado proposed openstack-infra/project-config master: [WIP] Create tempest non-voting gate in kuryr-kubernetes https://review.openstack.org/474993 | 14:37 |
| *** jroll has left #openstack-infra | 14:38 | |
| *** xarses_ has joined #openstack-infra | 14:39 | |
| *** andreww has joined #openstack-infra | 14:40 | |
| *** jcoufal has joined #openstack-infra | 14:40 | |
| *** dhajare has joined #openstack-infra | 14:41 | |
| *** jcoufal_ has quit IRC | 14:41 | |
| openstackgerrit | Daniel Mellado proposed openstack-infra/project-config master: [WIP] Create tempest non-voting gate in kuryr-kubernetes https://review.openstack.org/474993 | 14:42 |
| openstackgerrit | Brian Haley proposed openstack-infra/devstack-gate master: Support an IPv6 underlay network https://review.openstack.org/343041 | 14:43 |
| *** xarses_ has quit IRC | 14:43 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/release-tools master: README: Rename --no_dry_run to --no-dry-run https://review.openstack.org/474995 | 14:48 |
| *** dansmith is now known as superdan | 14:49 | |
| *** funzo has quit IRC | 14:50 | |
| *** lbragstad has quit IRC | 14:51 | |
| fungi | dhellmann: sorry for the delay, took me a while to remember how loops present themselves in the logs, and the production zuul debug output is a massive haystack for such a small needle | 14:52 |
| fungi | dhellmann: Exception: Dependency cycle detected: 473553 in [u'473553', u'473559'] | 14:52 |
| openstackgerrit | Daniel Mellado proposed openstack-infra/project-config master: [WIP] Create tempest non-voting gate in kuryr-kubernetes https://review.openstack.org/474993 | 14:53 |
| fungi | dhellmann: looks like a loop between an oslo.config change and a project-config change | 14:53 |
| *** lbragstad has joined #openstack-infra | 14:56 | |
| *** martinkopec has quit IRC | 15:00 | |
| dhellmann | fungi : thanks, I'll look into breaking that cycle | 15:01 |
| *** eharney has quit IRC | 15:02 | |
| *** Julien-zte has joined #openstack-infra | 15:09 | |
| *** jamesdenton has joined #openstack-infra | 15:09 | |
| *** felipemonteiro has joined #openstack-infra | 15:12 | |
| *** Julien-zte has quit IRC | 15:12 | |
| openstackgerrit | Sean McGinnis proposed openstack-infra/project-config master: Add functional test runs for glance https://review.openstack.org/475002 | 15:14 |
| *** gomarivera has quit IRC | 15:14 | |
| pabelanger | infra-root: apologies for mass ping, but I'd love to be able to do https://review.openstack.org/#/c/474255/ this morning | 15:15 |
| *** electrofelix has joined #openstack-infra | 15:15 | |
| *** eharney has joined #openstack-infra | 15:15 | |
| *** rcernin has quit IRC | 15:15 | |
| openstackgerrit | Sean McGinnis proposed openstack-infra/project-config master: Add functional test runs for glance https://review.openstack.org/475002 | 15:16 |
| *** jcoufal has quit IRC | 15:17 | |
| *** electrofelix has quit IRC | 15:17 | |
| *** jcoufal has joined #openstack-infra | 15:18 | |
| *** mdrabe has quit IRC | 15:18 | |
| *** electrofelix has joined #openstack-infra | 15:18 | |
| inc0 | can I have please last review?:( I'm eager to kick off this work...https://review.openstack.org/#/c/471428/ | 15:20 |
| *** pcaruana has quit IRC | 15:20 | |
| mordred | pabelanger: could we do a followup docs patch that adds a line about running the script in /etc/zuul-ca? | 15:21 |
| mordred | pabelanger: oh - you fixed it | 15:21 |
| mordred | pabelanger: thank you! that makes so much more sense to me today | 15:21 |
| *** jamesden_ has joined #openstack-infra | 15:21 | |
| pabelanger | Ya, was a little confusing! Thanks | 15:22 |
| *** jamesdenton has quit IRC | 15:22 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Stop running python2 jobs on zuulv3 https://review.openstack.org/475005 | 15:25 |
| *** jaypipes is now known as leakypipes | 15:27 | |
| cmurphy | clarkb: https://review.openstack.org/#/c/473996/ never got merged so jeepyb is probably broken | 15:27 |
| *** jbadiapa has quit IRC | 15:28 | |
| *** NileshSawant has quit IRC | 15:28 | |
| *** Julien-zte has joined #openstack-infra | 15:29 | |
| *** rakhmerov has quit IRC | 15:29 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Stop supporting python2 https://review.openstack.org/475009 | 15:29 |
| *** mdrabe has joined #openstack-infra | 15:30 | |
| openstackgerrit | Daniel Mellado proposed openstack-infra/project-config master: [WIP] Create tempest non-voting gate in kuryr-kubernetes https://review.openstack.org/474993 | 15:31 |
| *** rakhmerov has joined #openstack-infra | 15:31 | |
| fungi | cmurphy: thanks for the heads up! approved nopw | 15:33 |
| fungi | er, now i mean | 15:33 |
| cmurphy | ty fungi | 15:34 |
| *** e0ne has quit IRC | 15:34 | |
| openstackgerrit | Merged openstack-infra/project-config master: add python 3.5 unit test job for release-tools repository https://review.openstack.org/470352 | 15:35 |
| *** aarefiev is now known as aarefiev_afk | 15:39 | |
| *** yamamoto_ has quit IRC | 15:39 | |
| openstackgerrit | Daniel Mellado proposed openstack-infra/project-config master: [WIP] Create tempest non-voting gate in kuryr-kubernetes https://review.openstack.org/474993 | 15:39 |
| *** Goneri has joined #openstack-infra | 15:40 | |
| *** Apoorva has joined #openstack-infra | 15:40 | |
| *** yamamoto has joined #openstack-infra | 15:40 | |
| *** dizquierdo has quit IRC | 15:41 | |
| openstackgerrit | Merged openstack-infra/puppet-jeepyb master: Properly escape % in cron command https://review.openstack.org/473996 | 15:41 |
| pabelanger | fungi: here is the issue with CATOP: http://paste.openstack.org/show/612879/ | 15:43 |
| pabelanger | we also need to configure openssl.cnf | 15:43 |
| fungi | ahh, yeah we probably should not be using the example openssl.cnf anyway | 15:43 |
| *** markus_z has quit IRC | 15:44 | |
| *** yamamoto has quit IRC | 15:44 | |
| pabelanger | fungi: do you mind creating an openssl.cnf file and uploading it to our review? I am not sure which settings we'd want to default too. | 15:45 |
| fungi | sure, just a sec i can distill one | 15:45 |
| pabelanger | great! | 15:45 |
| *** dizquierdo has joined #openstack-infra | 15:46 | |
| *** funzo has joined #openstack-infra | 15:51 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Stop supporting python2 https://review.openstack.org/475009 | 15:51 |
| *** reed_ has joined #openstack-infra | 15:55 | |
| *** reed_ has quit IRC | 15:56 | |
| *** funzo has quit IRC | 15:56 | |
| *** ykarel has quit IRC | 15:56 | |
| openstackgerrit | Sean McGinnis proposed openstack-infra/project-config master: Add functional test runs for glance https://review.openstack.org/475002 | 15:57 |
| *** armax has joined #openstack-infra | 15:57 | |
| *** bnemec is now known as beekneemech | 16:01 | |
| *** ccamacho has left #openstack-infra | 16:01 | |
| *** jpich has quit IRC | 16:01 | |
| *** dtantsur is now known as dtantsur|afk | 16:03 | |
| *** jascott1 has joined #openstack-infra | 16:03 | |
| *** ijw has joined #openstack-infra | 16:07 | |
| *** ramishra has quit IRC | 16:08 | |
| *** jascott1 has quit IRC | 16:08 | |
| *** ltomasbo is now known as ltomasbo|away | 16:10 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Ensure gather_subset is a list https://review.openstack.org/474321 | 16:10 |
| mordred | pabelanger: mind +3ing https://review.openstack.org/#/c/468046/ real quick? | 16:10 |
| *** yamamoto has joined #openstack-infra | 16:13 | |
| *** trown is now known as trown|lunch | 16:13 | |
| *** eharney has quit IRC | 16:19 | |
| *** gomarivera has joined #openstack-infra | 16:19 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add mailing list for API Users and SDK authors https://review.openstack.org/468046 | 16:20 |
| *** csomerville has joined #openstack-infra | 16:21 | |
| *** cody-somerville has quit IRC | 16:24 | |
| *** yamahata_ has quit IRC | 16:24 | |
| *** felipemonteiro has quit IRC | 16:24 | |
| *** rbrndt has quit IRC | 16:27 | |
| *** rbrndt has joined #openstack-infra | 16:28 | |
| *** rbrndt has quit IRC | 16:28 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: Create configure-mirrors role https://review.openstack.org/473845 | 16:28 |
| *** hashar has quit IRC | 16:29 | |
| openstackgerrit | Michael Johnson proposed openstack/diskimage-builder master: Fix mkfs failure when loop device is not ready https://review.openstack.org/475022 | 16:30 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add known_hosts to bubblewrap jobir.work_root https://review.openstack.org/473100 | 16:31 |
| *** eharney has joined #openstack-infra | 16:34 | |
| *** rbrndt has joined #openstack-infra | 16:35 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: Create configure-mirrors role https://review.openstack.org/473845 | 16:36 |
| *** yamamoto has quit IRC | 16:38 | |
| pabelanger | clarkb: fungi: mordred: jeblair: https://review.openstack.org/#/c/473850/ and https://review.openstack.org/#/c/473845/ is the first stab at creating a configure_mirrors role for openstack-zuul-jobs. Right now I've only added support for ubuntu nodes, mostly because I have no way to test ATM. Would appreciate some feedback | 16:38 |
| *** jascott1 has joined #openstack-infra | 16:43 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/project-config master: Add py35 job to instack-undercloud https://review.openstack.org/475026 | 16:44 |
| *** shardy has quit IRC | 16:44 | |
| *** florianf has quit IRC | 16:46 | |
| *** amotoki is now known as amotoki_away | 16:47 | |
| clarkb | pabelanger: left some initial thoughts | 16:48 |
| pabelanger | thanks | 16:49 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add known_hosts to bubblewrap jobir.work_root https://review.openstack.org/473100 | 16:51 |
| *** panda is now known as panda|bbl | 16:51 | |
| openstackgerrit | Michael Johnson proposed openstack/diskimage-builder master: Fix mkfs failure when loop device is not ready https://review.openstack.org/475022 | 16:52 |
| jeblair | clarkb, fungi: i'll be largely afk next week traveling to/attending ansiblefest london | 16:54 |
| jeblair | however, i do plan on spending a considerable amount of the lengthy time i'm stuck in an airplane writing zuulv3 documentation. so hopefully we'll be ready for some fun the week after. :) | 16:56 |
| *** dhajare has quit IRC | 16:56 | |
| *** lucasagomes is now known as lucas-afk | 16:56 | |
| fungi | pabelanger: it's becoming quickly apparent that /usr/lib/ssl/misc/CA.sh is meant not as a utility but as an example script to be copied and modified for your local needs. it hard-codes and duplicates a bit of configuration in ways that indicate it is meant for local modification | 16:58 |
| fungi | and the CA.pl script similarly (they both do the same thing, just in different languages) | 16:59 |
| *** felipemonteiro has joined #openstack-infra | 16:59 | |
| *** jamesmcarthur has quit IRC | 16:59 | |
| pabelanger | fungi: right, talking with jeblair I noted that. But we seemed okay with using the default. One option is to fork it into system-config and modify if we wanted to go that route | 16:59 |
| fungi | i'm trying to overcome my concerns about this certificate authority living in a directory which indicates it's a demo | 17:00 |
| *** felipemonteiro_ has joined #openstack-infra | 17:00 | |
| *** yamahata_ has joined #openstack-infra | 17:00 | |
| fungi | most instructions i find for using CA.sh start out with "first modify the script to set CATOP to a reasonable value..." | 17:01 |
| *** bexelbie has quit IRC | 17:02 | |
| *** jamielennox has quit IRC | 17:03 | |
| *** jamielennox has joined #openstack-infra | 17:03 | |
| *** felipemonteiro has quit IRC | 17:04 | |
| *** bexelbie has joined #openstack-infra | 17:05 | |
| fungi | ooh, i think i hit on the way to pass in the custom config (finally!) | 17:05 |
| fungi | need to set SSLEAY_CONFIG="-config /path/to/your/ca.cnf" | 17:06 |
| fungi | before invoking the script | 17:06 |
| *** tosky has quit IRC | 17:07 | |
| fungi | hideous, but seems to work | 17:08 |
| pabelanger | oh, nice | 17:09 |
| fungi | still trimming down the ca.cnf but have it pretty close now | 17:11 |
| fungi | i'll adjust the instructions for the command-line invocation too | 17:12 |
| *** neiljerram has quit IRC | 17:12 | |
| *** eharney has quit IRC | 17:13 | |
| *** jtomasek has quit IRC | 17:14 | |
| pabelanger | clarkb: jeblair: mordred: One thing I am trying to figure out, and haven't been able too. Is with nodepoolv2 configure_mirror, we did some DNS validation, this helped prevent jobs from getting servers with bad / no DNS. Which means, more launch failures in nodepool. However, zuulv3, we lose some of the protection and will possible result in more job failures, since we cannot stop bad / no dns any | 17:14 |
| pabelanger | more. We do retry the job upto 3 times, but if that is a bad cloud the job will still fail, | 17:14 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-roles master: Create configure-mirrors role https://review.openstack.org/473845 | 17:15 |
| *** gomarivera has quit IRC | 17:15 | |
| *** salv-orlando has joined #openstack-infra | 17:15 | |
| jeblair | pabelanger: we retry it on different nodes | 17:15 |
| clarkb | pabelanger: I thought the plan was to treat pre playbook failures as retryable in all cases, then go up to the retry limit | 17:15 |
| jeblair | clarkb: exactly | 17:15 |
| *** gomarivera has joined #openstack-infra | 17:15 | |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Use 'build_reno' setuptools extension if available https://review.openstack.org/475034 | 17:16 |
| jeblair | pabelanger: so it will have to fail on 3 different nodes before the user sees an error | 17:16 |
| *** jamesden_ has quit IRC | 17:16 | |
| mordred | right - but I think what pabelanger is saying is that if, say, you've got a big cloud like osic and it starts going belly-up- that it's not inconceivable that the retry nodes wouldhappen there too | 17:16 |
| * jeblair should start saying nodesets instead of nodes | 17:16 | |
| mordred | jeblair: ++ | 17:16 |
| *** gomarivera has quit IRC | 17:17 | |
| jeblair | mordred: yeah, but, i mean -- we've got an entire cloud going belly up. maybe it's okay to not try to hide that? | 17:17 |
| *** gomarivera has joined #openstack-infra | 17:17 | |
| *** gomarivera has quit IRC | 17:17 | |
| pabelanger | Ya, if for some reason osic had bad DNS, currently no nodes come online and we get some protect. zuulv3 job will eventually fail because of it | 17:17 |
| *** gomarivera has joined #openstack-infra | 17:17 | |
| mordred | jeblair: maybe -but with the nodepool method it just results in a loss of overall quota and user's jobs are processed just less quickly | 17:17 |
| *** salv-orl_ has quit IRC | 17:18 | |
| clarkb | speaking of, time to check if images have the new dns settings yet | 17:18 |
| *** dprince has quit IRC | 17:18 | |
| jeblair | yeah, this is something that we could probably make more seamless. do we want to do that now? | 17:19 |
| cloudnull | is the osic on fire? | 17:19 |
| mordred | jeblair: what if we allowed zuul to pass information about the source of the previous node in a noderequest when it goes to retry? | 17:19 |
| mordred | cloudnull: it's not - we'r ejust yusing you as an example | 17:19 |
| cloudnull | ah, was nearly in panic mode :) | 17:19 |
| jeblair | mordred: how about we defer this until the next time we're in a design phase? | 17:19 |
| mordred | jeblair: so that nodepool could decide to give a node from a diffrent provider in case of a pre failure | 17:19 |
| mordred | jeblair: kk | 17:19 |
| jeblair | i mean we did talk about this, and we decided on this. i'm happy to revisit it, but i don't see the urgency. | 17:20 |
| mordred | ++ - I think it's unlikley this will be a blocker problem in the short-term | 17:20 |
| NobodyCam | Good morning infra folks... might I ask if anyone could point me to a good reference about moving an existing zuul to a new server? | 17:20 |
| mordred | after all, our curent DNS issues are happening even with the nodepool check | 17:21 |
| *** esberglu has quit IRC | 17:21 | |
| clarkb | cloudnull: we've doubled down on google dns http://paste.openstack.org/show/612883/ :) I think we may be setting that dns var somewhere so it gets set to google over the opendns default | 17:22 |
| *** esberglu has joined #openstack-infra | 17:22 | |
| pabelanger | jeblair: not urgent. just something I was looking at for configure_mirror role | 17:22 |
| jeblair | NobodyCam: i'm unaware of such a reference. however, there is almost no state in zuul whatsoever, so it should just be a matter of copying the config files over and updating. | 17:22 |
| jeblair | pabelanger: maybe file a story about it; maybe time to start using a zuulv3-backlog tag? | 17:23 |
| *** jlk has quit IRC | 17:23 | |
| jeblair | mordred: ^ | 17:23 |
| *** funzo has joined #openstack-infra | 17:23 | |
| *** sambetts is now known as sambetts|afk | 17:23 | |
| *** jlk has joined #openstack-infra | 17:23 | |
| *** jlk has quit IRC | 17:24 | |
| *** jlk has joined #openstack-infra | 17:24 | |
| NobodyCam | :) just looking to make sure I grab all the files. I was not the one who set it up.. :p | 17:24 |
| mordred | jeblair: yah. oh - I have an email about that I was gonna send | 17:24 |
| NobodyCam | and thank you jeblair :) | 17:24 |
| clarkb | cloudnull: I see the issue will haev patch up shortly | 17:24 |
| NobodyCam | morning mordred clarkb fungi :) | 17:24 |
| cloudnull | oh, sorry. | 17:24 |
| jeblair | NobodyCam: zuul.conf and any files it points to, like layout.yaml should be about all you need | 17:24 |
| NobodyCam | sweet :) | 17:25 |
| fungi | NobodyCam: hey there! glad to see you around again | 17:25 |
| NobodyCam | never really left.. just hiding under my rock :) | 17:25 |
| *** esberglu has quit IRC | 17:26 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Actually use opendns https://review.openstack.org/475037 | 17:29 |
| clarkb | cloudnull: and infra-root ^ that should do it | 17:29 |
| *** SumitNaiksatam_ has joined #openstack-infra | 17:30 | |
| *** SumitNaiksatam has quit IRC | 17:32 | |
| *** SumitNaiksatam_ is now known as SumitNaiksatam | 17:32 | |
| *** jcoufal_ has joined #openstack-infra | 17:34 | |
| *** esberglu has joined #openstack-infra | 17:34 | |
| *** jcoufal has quit IRC | 17:36 | |
| *** ijw has quit IRC | 17:36 | |
| *** tosky has joined #openstack-infra | 17:36 | |
| *** ijw has joined #openstack-infra | 17:36 | |
| *** jcoufal has joined #openstack-infra | 17:37 | |
| *** darvon has quit IRC | 17:37 | |
| *** darvon has joined #openstack-infra | 17:37 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-sphinx master: Initial commit https://review.openstack.org/475041 | 17:38 |
| *** rbrndt has quit IRC | 17:38 | |
| *** yamamoto has joined #openstack-infra | 17:39 | |
| *** esberglu has quit IRC | 17:39 | |
| *** jcoufal_ has quit IRC | 17:39 | |
| *** felipemonteiro_ has quit IRC | 17:41 | |
| *** felipemonteiro_ has joined #openstack-infra | 17:41 | |
| *** ijw has quit IRC | 17:41 | |
| clarkb | if another infra-root can review 475037 I'll work on manually triggering the xenial image build and upload so that we can get that out of the way before the weekend | 17:42 |
| fungi | clarkb: i think it's already double-approved? | 17:42 |
| clarkb | oh, must've just happened then (I just checked it) | 17:43 |
| *** yamamoto has quit IRC | 17:43 | |
| clarkb | or maybe gerrit didn't refresh like I thought it did | 17:44 |
| clarkb | anyways thank you, will work on getting that into images today so that we can confirm dns is changed then track using e-r next week | 17:44 |
| *** esberglu has joined #openstack-infra | 17:47 | |
| openstackgerrit | Merged openstack-infra/project-config master: Actually use opendns https://review.openstack.org/475037 | 17:49 |
| *** jcoufal_ has joined #openstack-infra | 17:49 | |
| *** jcoufal has quit IRC | 17:51 | |
| *** trown|lunch is now known as trown | 17:55 | |
| clarkb | pabelanger: dirk it has been a few days since we successfully built a leap image, do we know what is causing the opensuse builds to fail? | 17:59 |
| *** dprince has joined #openstack-infra | 18:01 | |
| *** pcaruana has joined #openstack-infra | 18:04 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 18:04 |
| clarkb | http://paste.openstack.org/show/612889/ looks like bad package names | 18:04 |
| *** jcoufal has joined #openstack-infra | 18:04 | |
| *** JudeC has joined #openstack-infra | 18:05 | |
| *** armax has quit IRC | 18:05 | |
| *** ralonsoh has quit IRC | 18:05 | |
| *** eharney has joined #openstack-infra | 18:06 | |
| odyssey4me | oh dear, two of these failures: http://logs.openstack.org/65/474765/4/gate/gate-openstack-ansible-tests-linters-ubuntu-xenial/c1d17fa/console.html#_2017-06-16_18_01_28_686758 | 18:06 |
| odyssey4me | http://logs.openstack.org/65/474765/4/gate/gate-openstack-ansible-tests-ansible-func-ubuntu-xenial/09822e9/console.html#_2017-06-16_18_01_28_601393 | 18:06 |
| *** electrofelix has quit IRC | 18:06 | |
| *** jcoufal_ has quit IRC | 18:06 | |
| clarkb | odyssey4me: I'm working on getting the switch to opendns rolled out | 18:07 |
| odyssey4me | clarkb ah, that explains it | 18:07 |
| *** ldnunes has quit IRC | 18:07 | |
| odyssey4me | what sort of timeline are we looking at? | 18:07 |
| clarkb | odyssey4me: image build time + upload time, hopefully just a couple hours | 18:07 |
| odyssey4me | ok, so I'll just recheck and hope for the best :) | 18:08 |
| pabelanger | clarkb: first I have seen it | 18:10 |
| pabelanger | clarkb: there was a new dib release recently | 18:10 |
| *** rmcall has joined #openstack-infra | 18:10 | |
| clarkb | pabelanger: ya looks like the debuntu package names got mixed in somehow, I'll take a look in a few | 18:11 |
| *** rmcall has quit IRC | 18:11 | |
| pabelanger | clarkb: I think build-essential: "' is missing from pkg-map, but not sure what changed | 18:13 |
| *** ldnunes has joined #openstack-infra | 18:13 | |
| clarkb | pabelanger: Ia9dd061fa46a514781808d62e5e93b03f75c6745 also we install both python-devel and python2-devel | 18:13 |
| clarkb | so something up with ^ | 18:13 |
| *** gibi has quit IRC | 18:14 | |
| clarkb | on tumbleweed it is python-devel not python2-devel | 18:15 |
| *** efoley has quit IRC | 18:15 | |
| openstackgerrit | Darragh Bailey proposed openstack/python-jenkins master: Migration to using requests https://review.openstack.org/205637 | 18:15 |
| clarkb | and suse package saerch is failing me | 18:16 |
| *** dhinesh has joined #openstack-infra | 18:16 | |
| clarkb | https://software.opensuse.org/package/python-devel | 18:17 |
| *** esberglu has quit IRC | 18:19 | |
| *** esberglu has joined #openstack-infra | 18:19 | |
| openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: Retry to fetch paginated volumes if we get 404 for next link https://review.openstack.org/475049 | 18:19 |
| clarkb | pabelanger: dirk I think I see what needs fixing. Part of it is in infra's elements and part of it is fixing that change above | 18:20 |
| clarkb | I will get patches up shortly | 18:20 |
| pabelanger | clarkb: cool, I'm still trying to debug DIB | 18:21 |
| dirk | clarkb: sorry, I wasn't aware. is there a way to get notified about that? | 18:21 |
| dirk | clarkb: where#s the log? | 18:21 |
| *** burgerk has joined #openstack-infra | 18:22 | |
| clarkb | dirk: you can check http://nb03.openstack.org/ and http://nb04.openstack.org. I think ianw has an aggregation page somewhere but I'm not sure where anymoer | 18:22 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Define package map for suse build essential https://review.openstack.org/475050 | 18:26 |
| clarkb | pabelanger: dirk ^ thats the infra side, now to push the dib fix | 18:26 |
| openstackgerrit | Clark Boylan proposed openstack/diskimage-builder master: On suse the python2 dev package is python-devel https://review.openstack.org/475051 | 18:27 |
| clarkb | and there is the dib fix | 18:27 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Add CA service to puppetmaster.o.o for zuul https://review.openstack.org/474255 | 18:29 |
| fungi | pabelanger: ^ | 18:29 |
| fungi | it turned into a bit of a rathole, testing against your instructions to make sure it all matches up. should be all good now | 18:31 |
| *** jamesmcarthur has joined #openstack-infra | 18:37 | |
| *** nicolasbock has quit IRC | 18:38 | |
| *** jamesmcarthur has quit IRC | 18:38 | |
| *** jamesmca_ has joined #openstack-infra | 18:38 | |
| pabelanger | fungi: thanks! | 18:39 |
| *** yamamoto has joined #openstack-infra | 18:40 | |
| fungi | pabelanger: also, being able to hard-code every value into the config aside from the cn means much less typing (at the expense of needing to pass the cn as an envvar now) | 18:40 |
| pabelanger | Ya, less error prone for sure. thanks for doing that | 18:41 |
| *** pcaruana has quit IRC | 18:41 | |
| clarkb | ok ubuntu-xenial image is built and is uploading now | 18:41 |
| pabelanger | I have to head down to passport office for a pick up, but hopefully we can land that and start on gearman certs | 18:42 |
| *** armax has joined #openstack-infra | 18:42 | |
| lbragstad | curious for any feedback regarding https://review.openstack.org/#/c/471419/6 if anyone is interested in reviewing it | 18:43 |
| *** xyang1 has joined #openstack-infra | 18:44 | |
| *** yamamoto has quit IRC | 18:44 | |
| *** persia has quit IRC | 18:47 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: testing featurset of containers https://review.openstack.org/473082 | 18:52 |
| clarkb | lbragstad: it doesn't look like that will properly test a change against ocata in test with a change against master | 18:52 |
| lbragstad | clarkb: the idea would be to take stable/ocata and upgrade to master + a patch in review | 18:53 |
| clarkb | lbragstad: to do the gate properly you should be able to handle stable/ocata + change in review upgrade to master + change in review | 18:54 |
| clarkb | lbragstad: I'm trying to actually confirm it can't do ^ | 18:54 |
| lbragstad | clarkb: oh - i think i see what you mean | 18:55 |
| lbragstad | cc andymccr ^ | 18:55 |
| *** SumitNaiksatam_ has joined #openstack-infra | 18:55 | |
| fungi | grenade, in contrast, uses devstack-gate to set up two source trees for keystone, one under /opt/stack/old and one under /opt/stack/new | 18:56 |
| clarkb | I'm also trying to make sure it doesn't install master to upgrade to master | 18:56 |
| lbragstad | and it places the patch in review in both trees? | 18:56 |
| fungi | lbragstad: it places patcheS in review for each branch in both trees | 18:56 |
| *** SumitNaiksatam has quit IRC | 18:57 | |
| *** SumitNaiksatam_ is now known as SumitNaiksatam | 18:57 | |
| lbragstad | ah - i think that's where i went wrong then. i was thinking the new source only needed the patch | 18:57 |
| fungi | lbragstad: consider the case where you have several changes in the gate and we're trying to make sure that change A to stable/ocata can be upgraded to change B on master | 18:57 |
| lbragstad | fungi: oh - sure, that makes sense, so it's testing two patches against two different branches with the same upgrade | 18:58 |
| *** ilpianista_ has quit IRC | 18:58 | |
| fungi | lbragstad: so assuming A enters the gate ahead of B, then you're first in the context of change A testing A on stable/ocata can be upgraded to current master state, and then in the context of change B that testing that B can be upgraded from A on stable/ocata to B on master | 18:59 |
| *** masayukig[m] has quit IRC | 18:59 | |
| fungi | lbragstad: rather than testing against the current state of stable/ocata, having A merge ahead of B which in some way breaks teh ability to upgrade from A to B, and then you're wedged once B lands | 19:00 |
| lbragstad | aha - sure | 19:00 |
| clarkb | I'm having a hard time finding where it actually installs keystone (to determien what version of keystone will be installed in the old and new versions) | 19:00 |
| fungi | tl;dr, upgrade testing in a predictive state pipeline is challenging, and this is one of the big reasons why devstack-gate (in service of grenade) is complicated | 19:01 |
| clarkb | keystone is in keystone_pip_packages impying it is installing from pypi? | 19:01 |
| lbragstad | clarkb: there should be a venv for each keystone version on the system | 19:01 |
| lbragstad | the openstack-ansible playbook provides a way to override that if a version of keystone source exists locally on the deployment host though | 19:01 |
| clarkb | lbragstad: from what I read it is just doing the equivalent of pip install keystone though | 19:03 |
| lbragstad | so, for example, the playbooks will go through and install the last stable release, then checkout a change locally on the deployment host (which is hosting the keystone cluster in containers) and then install the containers with a venv created from the source checked out from git | 19:03 |
| clarkb | it uses the ansible pip module to install 'keystone' I don't see anything to specify the source | 19:03 |
| clarkb | so I'm not sure how the ocata side would install ocata keystone and the master side install master + change | 19:03 |
| lbragstad | hmm - let me dig through the role and see if i can find it | 19:03 |
| lbragstad | clarkb: so this is the upgrade test commands from osa-keystone https://github.com/openstack/openstack-ansible-os_keystone/blob/master/tox.ini#L114-L115 | 19:04 |
| *** jamesmca_ has quit IRC | 19:05 | |
| odyssey4me | lbragstad clarkb you rang? | 19:05 |
| lbragstad | odyssey4me: o/ | 19:05 |
| clarkb | lbragstad: ya so repo clone pulls in the ansible tests (thats fine) | 19:05 |
| lbragstad | odyssey4me: fungi and clarkb are enlightening me on some interesting upgrade testing edge cases | 19:05 |
| lbragstad | clarkb: yep | 19:05 |
| odyssey4me | ah | 19:05 |
| *** jamesmcarthur has joined #openstack-infra | 19:05 | |
| clarkb | lbragstad: what I'm confused about is where in this role does the magic to install the /opt/keystone you put int place happen | 19:05 |
| odyssey4me | clarkb the source is set using a constraints file | 19:06 |
| clarkb | and related on the stable/ocata version of the role how does that know to install from a different source | 19:06 |
| odyssey4me | if you do 'pip install keystone -c constraints.txt' and constraints.txt has git+<git URL>#egg=keystone then it will install from the git URL | 19:06 |
| odyssey4me | if you want to install from a dirty git repo in a folder, skip the git+ | 19:07 |
| odyssey4me | that's what we're doing for all our repositories if there's a zuul change dep | 19:07 |
| *** jamesmcarthur has quit IRC | 19:08 | |
| clarkb | odyssey4me: and that works for a random checkout of a fetch_head? | 19:08 |
| *** jamesmca_ has joined #openstack-infra | 19:08 | |
| lbragstad | so - zuul cloner places the changes in a directory that osa looks for automatically | 19:08 |
| clarkb | "git+{{ keystone_git_repo }}@{{ keystone_git_install_branch }}#egg=keystone" <- specifically | 19:08 |
| odyssey4me | if we find a folder in the right place, we install it verbatim | 19:08 |
| clarkb | odyssey4me: where is that code? | 19:08 |
| clarkb | keystone_git_repo is set to the git.openstack.org url | 19:08 |
| odyssey4me | if there's no folder, we install from the head of a branch, set here: https://github.com/openstack/openstack-ansible-os_keystone/blob/master/defaults/main.yml#L27-L34 | 19:09 |
| odyssey4me | so a standard build in our test will use those | 19:09 |
| odyssey4me | keystone_developer_constraints is written to a file | 19:09 |
| odyssey4me | pip can't take constraints from the CLI | 19:09 |
| clarkb | right I get the default case there | 19:09 |
| clarkb | I'm still not understanding where the just install it from dir verbatim if that exists happens | 19:09 |
| *** jtomasek has joined #openstack-infra | 19:10 | |
| clarkb | since that would need to go into the constraints file right? | 19:10 |
| odyssey4me | for zuul we do this: https://github.com/openstack/openstack-ansible-tests/blob/master/get-ansible-role-requirements.yml#L90-L114 | 19:10 |
| odyssey4me | ie any openstack zuul dep change goes into {{ homedir }}/git/openstack/\1 | 19:10 |
| clarkb | odyssey4me: right but what writes /opt/keystone into the constraints file? | 19:10 |
| clarkb | (everything ends up on disk just fine as far as I can tell, I still don't understand what tells ansible's pip module to install off of the disk repo if it is there | 19:11 |
| odyssey4me | see https://github.com/openstack/openstack-ansible-tests/commit/d061f2dacd9489b1bd22b9c26c81b7a135c33c3a | 19:11 |
| odyssey4me | in test-repo-setup.yml we create an extra constraints file | 19:11 |
| odyssey4me | then we ensure that's in the constraints for any role | 19:12 |
| odyssey4me | it's a bit complicated, but it works | 19:12 |
| clarkb | odyssey4me: https://github.com/openstack/openstack-ansible-tests/commit/d061f2dacd9489b1bd22b9c26c81b7a135c33c3a#diff-e1d7d80a3334e14bbf701d7a42952aecR468 that specifically worries me, I'm not sure how pip resolves two constraints files with differing entries for the same package | 19:12 |
| odyssey4me | oh pip is not that clever | 19:13 |
| odyssey4me | it takes the first it finds | 19:13 |
| clarkb | in this case you'd have the file:/// entry for the local developer keystone and you'd have the git+https:// from defaults | 19:13 |
| odyssey4me | it ignores everything else | 19:13 |
| odyssey4me | we discovered that the hard way | 19:13 |
| clarkb | ok so order very much matters here, this feels fragile... | 19:13 |
| odyssey4me | oh sure, it's a little funky - but it works | 19:13 |
| clarkb | so that will work for the master case | 19:13 |
| *** dimtruck is now known as zz_dimtruck | 19:14 | |
| clarkb | what prevents your stable/ocata role from also installing the /opt/keystone version | 19:14 |
| odyssey4me | ho yes, for now we can't cater for anything like this in a stable branch | 19:14 |
| odyssey4me | right now the stable branch has none of this tooling, so it just won't | 19:14 |
| odyssey4me | we have some thoughts on how to deal with it, but it's just not a problem right now | 19:14 |
| clarkb | gotcha, so when pike releases and we go to queens you'll have to update the jobs or tooling (maybe both) to differentiate) | 19:15 |
| odyssey4me | we will deal with it in our own repositories, because it'll matter to just about every upgrade job we have | 19:15 |
| odyssey4me | so we will have to | 19:15 |
| clarkb | ok thanks, so that confirms my initial concern, this won't handle the stable + change to master + change case | 19:15 |
| *** MatthewLi has quit IRC | 19:15 | |
| odyssey4me | we only just got cross-project testing for our own repositories working in this cycle | 19:15 |
| odyssey4me | oh no, it absolutely won't - for now | 19:16 |
| odyssey4me | so it's not perfect, but it's a start | 19:16 |
| clarkb | lbragstad: ultimately its probably up to qa and keystone, but considering we've alerady solved these problems elsewhere I'd personally just use the existing tools... | 19:16 |
| lbragstad | clarkb: ok | 19:16 |
| *** jtomasek has quit IRC | 19:16 | |
| odyssey4me | you have other implementations of upgrade tests including load balancers? | 19:17 |
| lbragstad | clarkb: so that case is a testing requirement in order to assert the rolling upgrade tag? | 19:17 |
| *** MatthewLi has joined #openstack-infra | 19:17 | |
| clarkb | odyssey4me: no we have implementations of upgrade tests that test the correct code | 19:17 |
| clarkb | lbragstad: I don't know, thats a tc thing? | 19:17 |
| odyssey4me | ok, so how does that test a rolling upgrade? | 19:17 |
| odyssey4me | or a zero-downtime upgrade | 19:17 |
| clarkb | odyssey4me: right now it doesn't as far as I know. but it will test the correct code | 19:17 |
| clarkb | odyssey4me: we've actually separated the code from the testing | 19:18 |
| odyssey4me | what we've implemented tests that | 19:18 |
| lbragstad | clarkb: yeah - looking at the requirements here https://governance.openstack.org/tc/reference/tags/assert_supports-rolling-upgrade.html | 19:18 |
| clarkb | odyssey4me: so you could in theory use devsatck-gate to get all the correct code then run openstack ansible to deploy and test | 19:18 |
| fungi | sounds like an excellent opportunity to graft openstackansible testing into devstack-gate | 19:18 |
| fungi | yeah, that | 19:18 |
| odyssey4me | clarkb by 'correct code' what does that mean? | 19:18 |
| clarkb | odyssey4me: I don't actually care about the tests themselves, from infra's perspective I care about making sure you install the correct code | 19:18 |
| fungi | odyssey4me: my example further up with change A on stable/ocata and change B on master in the gate together | 19:19 |
| odyssey4me | ok, I doubt that will be too difficult to do | 19:19 |
| fungi | avoiding testing master change B against the branch tip of stable/ocata not realizing that change B on stable/ocata ahead of it will wedge your jobs once B lands | 19:19 |
| fungi | er, change A on stable/ocata ahead of irt | 19:20 |
| rm_work | Do all of the run-logs from the gate get pushed to logstash or something? | 19:20 |
| rm_work | or are they only in these txt.gz files | 19:20 |
| clarkb | rm_work: not all of them, a subset. | 19:20 |
| rm_work | hmm ok | 19:20 |
| odyssey4me | can you point me at where devstack does that reconciliation? | 19:20 |
| odyssey4me | or does zuul do it? | 19:20 |
| rm_work | clarkb: i'm looking for a good way to search for any occurrences of an error message | 19:20 |
| odyssey4me | if zuul does it, all we need is to cater for n-1 - which is likely a small extension of this work | 19:20 |
| clarkb | odyssey4me: devstack-gate does it by having /opt/stack/new and /opt/stack/old checkouts, it will use old/ first to deploy, then new/ to deploy the upgrade | 19:20 |
| fungi | odyssey4me: zuul pre-bakes git refs across all braches involved and they're passed under a consistent name in an envvar | 19:21 |
| rm_work | clicking through these job runs individually is not fun | 19:21 |
| clarkb | rm_work: we explicitly whitelist known files that we can parse and index, and within those we only index >= INFO level messages | 19:21 |
| rm_work | hmmm k | 19:21 |
| *** bobh has joined #openstack-infra | 19:21 | |
| *** liusheng has quit IRC | 19:21 | |
| rm_work | wait isn't >=INFO all of them? | 19:21 |
| clarkb | rm_work: no, DEBUG is the vast majority | 19:21 |
| rm_work | ah | 19:22 |
| odyssey4me | fungi hmm, ok, that's what we do for our roles for the upgrade tests... it makes sense for us to do the same for other repositories | 19:22 |
| *** liusheng has joined #openstack-infra | 19:22 | |
| fungi | odyssey4me: so you just make sure to checkout that ref on every branch involved in your job if it exists and fall back on the branch tip (and also zuul-cloner and devstack-gate both do this automatically) | 19:22 |
| clarkb | rm_work: but DEBUG is just too much to index due to volume | 19:22 |
| rm_work | I thought INFO was even more verbose than DEBUG for some reason | 19:22 |
| *** e0ne has joined #openstack-infra | 19:22 | |
| rm_work | ok, well, i doubt the octavia worker screen log goes to logstash then | 19:22 |
| odyssey4me | fungi yep, z-c does the heavy lifting - it's awesome :) | 19:22 |
| rm_work | probably not whitelisted | 19:22 |
| odyssey4me | we just need to implement seperation for the code folders | 19:23 |
| openstackgerrit | Sorin Sbârnea proposed openstack-infra/jenkins-job-builder master: fixed tests https://review.openstack.org/475059 | 19:23 |
| odyssey4me | although... | 19:23 |
| clarkb | odyssey4me: right the important thing here is that your first deployment installs from ocata + any possible changes, then your master deployment uses master + any changes | 19:23 |
| clarkb | odyssey4me: one way to do that is separate git repos and checkouts (thats d-g's method) | 19:23 |
| odyssey4me | nvm the although - I just realised that we are on the right track | 19:23 |
| fungi | odyssey4me: for dealing with multiple branches if you're using zuul-cloner you need some additional logic to let it know what branch you're working with for a given tree if it's not the branch for the change being tested in that context | 19:23 |
| clarkb | anotehr way is to checkout the appropriate ref in the same repo, its nice having separate repos beacuse of setup.py develop though (which you appear to have support for) | 19:23 |
| odyssey4me | I'll need to take a peek at an example job's ZUUL_ env vars - I guess there're likely some clues there | 19:24 |
| clarkb | (since setup.py develop and pip install -e rely on files in the git repo swapping out checkouts can be messy and not super safe) | 19:24 |
| odyssey4me | I'll fire up a test some time soon. | 19:24 |
| odyssey4me | We happen to be doing rolling upgrade implementations for any service that supports it in the next few weeks. | 19:25 |
| *** amoralej is now known as amoralej|off | 19:25 | |
| fungi | odyssey4me: http://logs.openstack.org/30/471630/3/gate/gate-puppet-tripleo-puppet-syntax-4-centos-7/42fff2c/_zuul_ansible/vars.yaml | 19:26 |
| odyssey4me | That includes upgrade tests in each of there roles. | 19:26 |
| fungi | all the keys under environment should be present for your job to take advantage of | 19:26 |
| odyssey4me | just as I thought, ZUUL_CHANGES has a branch name ref | 19:26 |
| mordred | fungi: the API-WG specs related to service-types landed, so I figure I should get service-types.o.o up and going - do you think just a vhost on static for now? | 19:26 |
| odyssey4me | ok cool, we'll evolve this to do a little better | 19:27 |
| fungi | mordred: that's what i figured we'd do at least initially, yes | 19:27 |
| mordred | fungi: cool. I'll get some patches up | 19:27 |
| *** jamesmca_ has quit IRC | 19:27 | |
| odyssey4me | you mentioned some sort of connection between devstack-gate and what we're doing - what're your thoughts there? | 19:27 |
| odyssey4me | I guess this is more of a PTG discussion. :) | 19:27 |
| odyssey4me | but hey, there's no time like a friday night :p | 19:28 |
| clarkb | cloudnull: we are starting to see instances boot with correct unbound config now | 19:28 |
| mordred | odyssey4me: well - devstack-gate, although having devstack in the name, is REALLY "get these nodes set up" | 19:28 |
| clarkb | cloudnull: osic has xenial images for it | 19:28 |
| clarkb | right people should just use devstack-gate | 19:28 |
| fungi | devstack-gate sets up an /opt/stack/old and /opt/stack/new in preparation for grenade to use in upgrading from one version to another, and pre-does the checkouts in all involved git repos under both sets | 19:28 |
| clarkb | and stop reinventing this wheel | 19:28 |
| mordred | clarkb, fungi: I've been thinking about d-g and zv3 - and that as we refactor that, ultimately winding up with a thing that has less devstack in its name so it doesnt' scare people I think will be super handy | 19:29 |
| fungi | odyssey4me: basically, for all projects you include in te PROJECTS list, it sets up appropriate git checkouts for the relevant branches under /opt/stack/old/<projectname> and /opt/stack/new/<projectname> | 19:30 |
| fungi | the fallback logic in zuul-cloner is inherited from devstack-gate's algorithm | 19:30 |
| odyssey4me | ok, that's fair enough for CI purposes - our use case is broader though | 19:31 |
| odyssey4me | but sure, we can at least adopt the model there and possibly use it in the gate | 19:32 |
| fungi | the job could simply tell devstack-gate the list of projects openstackansible cares about, and then you could update your constraints list in the job to point to the paths on /opt/stack/old or /opt/stack/new depending on what's being installed | 19:32 |
| clarkb | cloudnull: I've also confirmed that I can locally resolve google.com so things look good. Thanks for helping on that and we'll have to watch elastic-recheck over the next ltitle while to see if it helps fix the problem | 19:33 |
| odyssey4me | fungi if that makes using some of our implementation tests more amenable to be used in other projects, I'm absolutely on board with giving it a go | 19:34 |
| fungi | devstack-gate itself can be hollowed out by overriding its default hooks so all it's really responsible for is setting up your git trees, firing your testing entrypoint, and then collecting logs at the end | 19:34 |
| fungi | odyssey4me: also it has a built-in solution for setting up the overlay networking for an arbitrary number of nodes in a multinode group, so you basically get that for free | 19:36 |
| *** armax has quit IRC | 19:36 | |
| *** dizquierdo has quit IRC | 19:36 | |
| clarkb | there is even a change up to make ^ an asnible playbook or role. But it needs some love beacuse it isn't quite right yet | 19:36 |
| clarkb | (potentially makign it easier to reconsume those bits that you need rather tahn invoking the whole thing) | 19:37 |
| fungi | yeah, there's ongoing work to decompose devstack-gate into independent ansible playbooks | 19:37 |
| *** thorst has quit IRC | 19:37 | |
| fungi | or roles i guess? | 19:37 |
| jeblair | odyssey4me: if we can somehow trick you into working on that with us, that would make my day! :) | 19:37 |
| jeblair | fungi: yeah, roles, which, for the moment, are called by essentially one-line or very simple playbooks for ease of transition from current devstack-gate. | 19:38 |
| fungi | right, in fact it actually already uses ansible to do all the network overlay setup (since we needed a way to run similar commands across all nodes in the group) | 19:38 |
| odyssey4me | jeblair fungi we might feel a strong urge to rewrite it all an ansible though :p | 19:39 |
| clarkb | fungi: no not yet | 19:39 |
| clarkb | thats the chagne rcarrillocruz wrote that needs love (I've reviewed it and it is close) | 19:39 |
| *** thorst has joined #openstack-infra | 19:39 | |
| odyssey4me | ha, I didn't read all the way through | 19:39 |
| mordred | odyssey4me: funny story ... that's actualy a current important task :) | 19:39 |
| odyssey4me | ok, I'm definitely keen to re-use whatever we can to cut our code base for testing | 19:39 |
| fungi | clarkb: oh, for some reason i thought devstack-gate was already using ansible to drive the remote setup? | 19:40 |
| clarkb | fungi: it does for chunks of it, but the network setup was sufficiently complicated that once it got working with just ssh we left it alone :) | 19:40 |
| jeblair | and yeah, the vision for the end state of this in zuulv3 is: all jobs get repo setup for free. we have central roles (which don't have 'devstack' in their names, as mordred says) to do things like set up multinode networking, or set up old/new git repo pairs. then we have devstack-gate jobs which actually run devstack. those are the only things that will belong in the devstack-gate repo when we're all done. | 19:40 |
| odyssey4me | and if there's room for us to share roles, testing tools, etc or at least work towards a common goal to share some things then I am most definitely up to participate, and I expect the rest of us would too | 19:40 |
| fungi | clarkb: oh, right, it's ansible running shell commands | 19:40 |
| fungi | which is what i meant | 19:40 |
| *** yamamoto has joined #openstack-infra | 19:41 | |
| fungi | the setup_host operation | 19:41 |
| jeblair | but the interim state is that we keep all of this in devstack-gate and decompose it into ansible roles, so we can transition. | 19:41 |
| clarkb | https://review.openstack.org/#/c/435933/ is teh change btw | 19:42 |
| *** bobh has quit IRC | 19:43 | |
| fungi | oh, yeah that'll be nice when it lands | 19:43 |
| odyssey4me | ok, this all sounds like a good progression | 19:43 |
| *** thorst has quit IRC | 19:44 | |
| openstackgerrit | Doug Hellmann proposed openstack-dev/cookiecutter master: update documentation layout and theme https://review.openstack.org/475066 | 19:44 |
| odyssey4me | our role test process right now is a hodge podge that works, but we'd love to simplify it and re-use whatever we can - andymccr's been on holiday for a week and is back next week, we'll have a chat and figure out a plan | 19:44 |
| *** bobh has joined #openstack-infra | 19:44 | |
| odyssey4me | we're a little tight on time and people, but this will help with that so I think we can make the time | 19:45 |
| fungi | and next week is ansiblefest, i gather | 19:45 |
| *** bobh has quit IRC | 19:45 | |
| *** yamamoto has quit IRC | 19:45 | |
| openstackgerrit | Doug Hellmann proposed openstack-dev/cookiecutter master: update documentation layout and theme https://review.openstack.org/475066 | 19:45 |
| clarkb | odyssey4me: looking at the upgrade job as is so far, I'm not sure I see the rolling aspect of it? it seems to update the virtualenv then restart the services which wouldn't be rolling would it? | 19:46 |
| lbragstad | clarkb: it orchestrates that between containers behind a load balancer i believe | 19:47 |
| clarkb | ah ok so node here is a logical node | 19:48 |
| *** burgerk has quit IRC | 19:48 | |
| fungi | so it sets up haproxy and tells tempest (or whatever the api tester is) to hit that? | 19:48 |
| dirk | clarkb: right, I meant notification though. If it doesn't end up in my inbox I maybe only manage to look at that once a week at most | 19:48 |
| clarkb | dirk: yes we don't currently have notifications for that | 19:48 |
| clarkb | (or anything else really other than cert expiry) | 19:48 |
| fungi | there's always enough things broken at any given point in time that we already have a full plate trying to fix tehm, so as we discover some new broken thing is more important we reprioritize as needed ;) | 19:49 |
| lbragstad | fungi: i think so - but i'll let odyssey4me keep me honest here :) | 19:52 |
| dirk | clarkb: maybe the other devils advocate question is that changes touching project-config/nodepool/elements should have test ci jobs for all distros we care about | 19:52 |
| odyssey4me | clarkb yeah - two containers, LB on the host | 19:53 |
| *** tesseract has quit IRC | 19:53 | |
| dirk | fungi: sure, but I'm happy to maintain some parts of the infrastructure, I just need sone way of being notified that there is stuff to do | 19:53 |
| clarkb | dirk: the problem is that that has in the past taken up to an hour or two, not great for testing. However, by dropping the image outputs we can likely cut that down a bit (as image conversion is the big cost) | 19:53 |
| clarkb | dirk: so definitely something we should look into | 19:53 |
| odyssey4me | I happen to have just found a bug in testing and fixed it up to *really* be rolling, including a LB drain: https://review.openstack.org/475040 | 19:53 |
| odyssey4me | lbragstad clarkb ^ | 19:53 |
| odyssey4me | the dependent patch has the playbook | 19:53 |
| dirk | clarkb: is that an issue for the nodepool/elements subdir? | 19:54 |
| clarkb | dirk: yes, the things that are done in there have resulted in long builds, particularly the git repo and other artifact caching | 19:54 |
| clarkb | dirk: if we do it smartly we can take the existing cache on the test instance and shove it where dib expects it to reduce that cost though | 19:54 |
| *** e0ne has quit IRC | 19:55 | |
| clarkb | dirk: and then if we use the tarball image output we avoid the qemu-img slowness of converting 20GB raw to 8GB qcow2 | 19:55 |
| *** zz_dimtruck is now known as dimtruck | 19:55 | |
| mmedvede | Anyone knows how can a new v3.2.0 release of etcd be added to tarballs.o.o? Asking because of https://review.openstack.org/#/c/474825/ | 19:55 |
| *** ericyoung has quit IRC | 19:55 | |
| fungi | mmedvede: once dims automates that like he was going to, it should be fine | 19:56 |
| fungi | mmedvede: in the meantime, we can just continue testing with the one that's there, right? | 19:56 |
| dims | mmedvede : fungi : was just about to reply to that email (that i have a TODO) | 19:56 |
| mmedvede | The patch I referenced is a bump to 3.2.0, so it obviously fails tests without the new binary | 19:56 |
| fungi | tarballs.o.o is not intended as a place we manually publish things, it's for automation to publish things in a repeatable and hands-off fashion | 19:57 |
| dims | mmedvede : i will be adding a job that looks for new releases and uploads them to tarballs periodically | 19:57 |
| clarkb | ubuntu-xenial has been updated across the boar with new images container new unbound config. I'm going to trigger other image builds now to speed up the deployment process | 19:57 |
| mmedvede | dims: fungi: understood and thanks! | 19:57 |
| *** rhallisey has quit IRC | 19:57 | |
| lbragstad | odyssey4me: cool - reviewing | 19:58 |
| *** jcoufal has quit IRC | 19:58 | |
| *** thorst has joined #openstack-infra | 19:59 | |
| *** rhallisey has joined #openstack-infra | 20:00 | |
| *** Apoorva_ has joined #openstack-infra | 20:01 | |
| odyssey4me | fungi clarkb do you have some sort of how to for implementing devstack-gate's stuff for a non devstack purpose that we can borrow from? | 20:03 |
| clarkb | fungi: care to review https://review.openstack.org/#/c/475051/ and https://review.openstack.org/#/c/475050/ to make suse builds happy again (dib change will need a release too probably do that monday) | 20:04 |
| odyssey4me | all the way from setting up a test vm that I can poke at through to how a job is setup to use it | 20:04 |
| clarkb | odyssey4me: devstack-gate's readme should haev details on setting up a test vm and poking at it | 20:04 |
| *** Apoorva has quit IRC | 20:05 | |
| clarkb | but apparently the hooks are not in that doc | 20:05 |
| fungi | yes, it looks like the hook functions need documentation | 20:06 |
| clarkb | odyssey4me: the basic idea is that devstack-gate unconditionally runs the base setup, then you can define 3 hooks (as bash functions) to run at predetermined times. there is the pre_test_hook which can be used to perform additional setup, the gate_hook this is what should deploy your software and run tests, and the post_test_hook which runs if the tests succeed | 20:07 |
| *** zzzeek has quit IRC | 20:07 | |
| clarkb | if you define a gate_hook then devstack and tempest are not run | 20:07 |
| clarkb | so that is likely the thing you will want to use to do your own thing | 20:07 |
| pabelanger | and back, catching up | 20:09 |
| notmyname | is it possible to link to a line in a proposed patch? | 20:09 |
| clarkb | notmyname: #linenumber or something iirc. But the ui won't do it for you when clicking on things | 20:11 |
| clarkb | hrm no thats not it, there is a way though its just hidden because gerrit | 20:11 |
| lbragstad | yeah - it's a manual thing | 20:11 |
| lbragstad | i thought it used @, but i could be wrong | 20:12 |
| pabelanger | clarkb: mordred: jeblair: did you want to review fungi changes for zuul-ca on puppet master? https://review.openstack.org/#/c/474255 | 20:12 |
| clarkb | @linenumber | 20:12 |
| clarkb | lbragstad: ya thats it | 20:12 |
| clarkb | notmyname: eg https://review.openstack.org/#/c/475050/1/nodepool/elements/infra-package-needs/pkg-map@34 the highlighting is pretty subtle too | 20:12 |
| fungi | sad that's not clickable somehow | 20:13 |
| fungi | doesn't seem to work with ,unified either | 20:14 |
| * lbragstad just tried toggling to side-by-side | 20:14 | |
| lbragstad | clarkb: do you get highlighting when referencing specific line numbers in a patch? | 20:15 |
| fungi | i see the line number in question highlighted in lavender with a little black bar just to the right of it | 20:16 |
| clarkb | yup it just highlights the line number itself | 20:16 |
| fungi | it doesn't highlight the entire line of code | 20:16 |
| odyssey4me | fungi clarkb ok, I'll take a peek at it and we'll discuss more once I'm a little more informed | 20:16 |
| notmyname | clarkb: thanks | 20:16 |
| lbragstad | fungi: clarkb oh - yeah it appears that only works for side-by-side, interesting | 20:17 |
| lbragstad | that's good to know | 20:17 |
| *** e0ne has joined #openstack-infra | 20:18 | |
| clarkb | a lot of things only work in side by side :/ | 20:18 |
| clarkb | like [ and ] | 20:18 |
| clarkb | I find ^ most frustrating when I unify diffs to look at a really long line | 20:18 |
| fungi | i wish there were a way to turn off the keyboard shortcuts and pointer integration entirely | 20:18 |
| fungi | the keyboard shortcuts, in particular, light to fight with my keyboard-driven browser workflow | 20:19 |
| * smcginnis still missed 'f' for popping up file lists. | 20:19 | |
| clarkb | smcginnis: ++ | 20:19 |
| fungi | s/light/like/ | 20:19 |
| fungi | but also it's a pain not to be able to just leftclick+drag to copy content from a change directly into my x11 middleclick paste buffer | 20:20 |
| lbragstad | fungi: that'd be handy | 20:21 |
| fungi | there's a key you can hold on the keyboard or something to make it possible, but i never can remember what it is so end up just using unified where the pointer integration isn't nearly so overbearing | 20:21 |
| clarkb | its also completely unusable on mobile (fixed supposedly if I ever get around to upgrading gerrit) | 20:21 |
| *** jtomasek has joined #openstack-infra | 20:22 | |
| fungi | also on some systems i rely on keyboard-based pointer emulation so holding down another unrelated key on the keyboard while clicking and dragging is basically a no-go | 20:23 |
| lbragstad | odyssey4me: so it sounds like that one edge case is the only thing preventing the upgrade testing case | 20:23 |
| clarkb | fungi: the mobile issues are related to the pointer issues I think so maybe that will get fixed too | 20:23 |
| clarkb | though they are doing browser detection so you might have to lie and say ou are a mobile browser | 20:24 |
| *** yland has joined #openstack-infra | 20:24 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add CA service to puppetmaster.o.o for zuul https://review.openstack.org/474255 | 20:27 |
| *** gouthamr has quit IRC | 20:28 | |
| *** zzzeek has joined #openstack-infra | 20:31 | |
| clarkb | poking at dns more, dnsviz says one of the .org servers refused to respond to udp queries for dnskey | 20:32 |
| clarkb | possibly that makes google angry? | 20:32 |
| clarkb | not sure if opendns will care though our unbound is configured to check such things, we may have to consider disabling it if that is indeed the problem | 20:33 |
| *** thorst has quit IRC | 20:33 | |
| clarkb | also users report that google dns is not working in brazil, possible that it is completely unrelated but if not working there could be not working well here (for various values of here0 | 20:37 |
| *** xarses_ has joined #openstack-infra | 20:38 | |
| clarkb | the ovb containers oooq job is still running on changes | 20:40 |
| clarkb | fungi: EmilienM ^ any idea if there are things I can review to help address that? | 20:40 |
| *** Apoorva_ has quit IRC | 20:40 | |
| EmilienM | clarkb: we've done some changes | 20:40 |
| EmilienM | gimme a chance to share links : | 20:40 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Stop supporting python2 https://review.openstack.org/475009 | 20:41 |
| *** Apoorva has joined #openstack-infra | 20:41 | |
| *** andreww has quit IRC | 20:41 | |
| EmilienM | https://review.openstack.org/#/q/topic:bug/1698172 | 20:41 |
| EmilienM | all are in gate or merged | 20:41 |
| EmilienM | clarkb: is http://logs.openstack.org/96/474896/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq-nv/e29358a/ better? | 20:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add node to README about Python3 https://review.openstack.org/475070 | 20:42 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add ROADMAP.rst file https://review.openstack.org/475071 | 20:42 |
| clarkb | checking | 20:42 |
| clarkb | EmilienM: it is 111MB | 20:43 |
| clarkb | so ya thats much better | 20:43 |
| *** neiljerram has joined #openstack-infra | 20:43 | |
| EmilienM | wow still a lot | 20:43 |
| EmilienM | clarkb: how much was it before? I don't know sorry | 20:43 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add note to README about Python3 https://review.openstack.org/475070 | 20:43 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add ROADMAP.rst file https://review.openstack.org/475071 | 20:43 |
| clarkb | EmilienM: it was just under a gigabyte ~960-980MB | 20:45 |
| clarkb | EmilienM: notice that 96/474896/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq-nv/e29358a/logs/oooq/undercloud/etc still has a bunch of redundant info in it | 20:45 |
| EmilienM | mhh ok | 20:46 |
| clarkb | EmilienM: also 96/474896/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq-nv/e29358a/logs/oooq/undercloud/var/log/journal/d255600c344e44cabba945632ed144db doesn't gzip well. In devstack-gate we actually switched to xz'ing those as it gets the files much smaller and they aren't readable in your browser anyways | 20:46 |
| clarkb | EmilienM: so you might consider using xz on journald stuff | 20:46 |
| clarkb | looks like the other two hosts do the same thing, so that could potentially shave off a bit more | 20:47 |
| clarkb | so ya that looks a lot better, but there are at least a few more things we can do (continue to stop grabbing everything out of /etc, its redundant just check what centos installs) and maybe use xz on non human readable files, particularly journald contents | 20:48 |
| *** felipemonteiro_ has quit IRC | 20:49 | |
| clarkb | EmilienM: oh and /var/log/ has logs that probably aren't necessary, maillog, anaconda, tally, spooler, cloud init | 20:51 |
| EmilienM | true | 20:51 |
| EmilienM | because we use exclude instead of include iirc | 20:51 |
| clarkb | yes I've asked repeatedly that you switch the logic around | 20:52 |
| therve | EmilienM, Also open bugs when services spew up garbage :/ | 20:52 |
| clarkb | because most of these issues come from not understanding what you are logging and then you get a bunch of java jars from alternatives on the log server :) | 20:52 |
| EmilienM | therve: we enable debug for all services we can I think | 20:53 |
| therve | EmilienM, Like nova compute being filled with 7M of 'End of file while reading data: Input/output error' from libvirt | 20:53 |
| therve | EmilienM, Yeah I mean debug is fine, useless tracebacks all other the place are not | 20:53 |
| EmilienM | I agree | 20:54 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Stop running python2 jobs for Zuul v3 https://review.openstack.org/475005 | 20:54 |
| therve | EmilienM, https://bugs.launchpad.net/ironic-inspector/+bug/1691971 is another one I opened a few weeks back | 20:55 |
| openstack | Launchpad bug 1691971 in Ironic Inspector "ironic-inspector logs broken pipe errors on OPTIONS requests" [Low,Confirmed] | 20:55 |
| therve | EmilienM, And gnocchi is logging 30M of swift 404 | 20:55 |
| therve | That'll made some quicker/bigger wins than some files in etc, IMO | 20:55 |
| clarkb | therve: sure, the thing is that fixing your /etc logging is trivial and because it grabs everything it has led to nasty surprises in the past | 20:56 |
| clarkb | you don't need all of /etc/ from three different hsots that are all the same | 20:56 |
| clarkb | please only grab what you need | 20:56 |
| therve | clarkb, I guess you already have the logic to filter out stuff ? | 20:56 |
| clarkb | therve: no | 20:56 |
| clarkb | therve: we whitelist instead of blacklisting | 20:56 |
| clarkb | so the logic is literally just getting what we need | 20:56 |
| therve | clarkb, Right, you have that whitelist? | 20:57 |
| mordred | jeblair, pabelanger: ^^ updated project-config patch https://review.openstack.org/475005 | 20:57 |
| clarkb | therve: devstack-gate does | 20:57 |
| therve | OK cool, it's indeed trivial if you do | 20:57 |
| clarkb | therve: its basically kernel log, syslog, journald for openstack services, /etc for openstack services, package listings (pip and distro manager), then mysql, libvirt, rabbit | 20:57 |
| *** yland has quit IRC | 20:57 | |
| clarkb | its not a very big list | 20:57 |
| fungi | but also, whitelists are trivial over time anyway. you start by saving nothing, you find a job failing on some error and you realize "if i had this particular log/file i could probably figure it out" so you add it | 20:58 |
| fungi | lather, rinse, repeat | 20:58 |
| *** yland has joined #openstack-infra | 20:58 | |
| fungi | that's how our current whitelists came into being | 20:58 |
| *** yland is now known as Guest48992 | 20:58 | |
| therve | That's fair | 20:58 |
| fungi | sometimes it's not even necessary to grab files, just echo some piece of information to stdout so it appears in the console log | 20:59 |
| therve | I guess my point was to not stop once we did that, and we could clear that much garbage later on | 20:59 |
| fungi | for example, we now include network interface configurations reported by `ip ad sh;ip ne sh;ip ro sh` and friends | 20:59 |
| therve | Which can end up being real issues on users later on | 20:59 |
| fungi | in a lot of our job console logs | 20:59 |
| *** kgiusti has left #openstack-infra | 20:59 | |
| fungi | rather than copying all the /etc/network/** | 21:00 |
| *** esberglu has quit IRC | 21:00 | |
| jeblair | fungi: wow are you okay? there was some unreadable gibberish that came over your line there... | 21:00 |
| *** Guest48992 has quit IRC | 21:02 | |
| fungi | the iproute2 commands example? | 21:03 |
| jeblair | fungi: ah yeah. if i squint, it does kind of look like commands. :) | 21:03 |
| fungi | it does indeed allow you to abbreviate subcommands into unreadable gibberish, i'll grant you that | 21:04 |
| clarkb | what was the genesis of that? I ran into it first with cisco shells but I am pretty sure cisco wasn't first at that | 21:04 |
| jeblair | reminds me of "fs la; fs lq; vos re" and friends. :) | 21:05 |
| fungi | it was popular with muds too... make the parser handle any starting subset of a command and define priority ordering for ambiguity/collisions | 21:05 |
| *** ijw has joined #openstack-infra | 21:05 | |
| jeblair | i imagine the afs example takes us back to the early 80s at least, but seems very likely it wasn't the first either... | 21:06 |
| jeblair | we need a unix reference librarian | 21:07 |
| jeblair | i don't think google's going to cut it for this | 21:07 |
| *** gouthamr has joined #openstack-infra | 21:08 | |
| fungi | trying to remember whether the z-machine parser also allowed that too, which now has me down the rabbit hole of z-machine specs and release history | 21:08 |
| *** dprince has quit IRC | 21:08 | |
| openstackgerrit | Merged openstack-infra/project-config master: Stop running python2 jobs for Zuul v3 https://review.openstack.org/475005 | 21:09 |
| clarkb | oh ya muds shortened everything | 21:10 |
| openstackgerrit | Merged openstack-infra/zuul-sphinx master: Initial commit https://review.openstack.org/475041 | 21:11 |
| *** gaurangt has quit IRC | 21:14 | |
| *** gaurangt has joined #openstack-infra | 21:15 | |
| *** Dinesh_Bhor has quit IRC | 21:16 | |
| *** ldnunes has quit IRC | 21:16 | |
| *** Dinesh_Bhor has joined #openstack-infra | 21:17 | |
| *** eharney has quit IRC | 21:18 | |
| fungi | apparently the z-machine (starting in v2.0 it seems) had an abbreviation feature, but it was not for input to the parser, it was a rudimentary form of text compression to reduce repeated words or phrases to short indices which got looked up in real time | 21:19 |
| fungi | trading some additional cpu and i/o for a reduced memory footprint | 21:20 |
| fungi | so that's a dead end | 21:20 |
| openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: Retry to fetch paginated volumes if we get 404 for next link https://review.openstack.org/475049 | 21:21 |
| *** e0ne has quit IRC | 21:24 | |
| clarkb | centos-7 images are slowly coming online with the dns switch | 21:25 |
| clarkb | also query in logstash has no hits over last couple hours | 21:25 |
| *** jamesmcarthur has joined #openstack-infra | 21:27 | |
| jeblair | clarkb, fungi, mordred: so... i have this lovely* x1 carbon supplied by my employer. (* not lovely). i have entered the bios and disabled the trackpad, the fingerprint reader, and intel AMT. | 21:28 |
| jeblair | clarkb, fungi, mordred: after doing so, when i boot, the trackpad accepts my input and the fingerprint reader lights up on the login screen. | 21:28 |
| jeblair | clarkb, fungi, mordred: what are the chances intel AMT is actually disabled? | 21:29 |
| clarkb | jeblair: you can always hit it with the exploits to find out >_> | 21:29 |
| clarkb | jeblair: best I can tell amt on my thinkpad had to be explicitly enabled but I didn't get it from an employer who might have enabled it for me. | 21:29 |
| clarkb | jeblair: to disable amt you go through the amt management system not your bios though, it should be a separate magic key combo (^P maybe?) | 21:30 |
| *** masayukig[m] has joined #openstack-infra | 21:30 | |
| *** chlong has quit IRC | 21:30 | |
| *** jtomasek has quit IRC | 21:31 | |
| jeblair | clarkb: oh look: https://github.com/mjg59/mei-amt-check | 21:31 |
| *** jkilpatr has quit IRC | 21:31 | |
| fungi | jeblair: i read accounts suggesting amt doesn't actually get completely disabled by some bioses claiming to be able to do so, and that some systems with amt may not even have any bios indication it's there at all much less give you an option to turn it off | 21:32 |
| *** askb has joined #openstack-infra | 21:32 | |
| *** dave-mccowan has quit IRC | 21:32 | |
| *** jamesmcarthur has quit IRC | 21:32 | |
| clarkb | fungi: ya amt has a completely separate management system and processor things. so you have to enter that at boot not the bios | 21:32 |
| jeblair | clarkb: right, though this bios *claims* to be able to disable it... | 21:32 |
| jeblair | (of course, it *claims* to disable far more mundane things and has failed to do so) | 21:32 |
| fungi | got it, so separate boot-time configuration interface provided by the amt firmware? | 21:33 |
| *** Julien-zte has quit IRC | 21:33 | |
| jeblair | next boot i will try some ^P and matthew garrett's stuff. | 21:33 |
| clarkb | fungi: ya | 21:33 |
| clarkb | jeblair: as far as I can tell my amt is in the second state described on mjg59s thing. It is enabled but unprovisioned. I know this because when I go to disable it it requires me to set the initial password. Which errored silently when I didn't give it a good enough password, which is extra funny because the amt system itself then ignored checking that password for any work it performed on your | 21:34 |
| clarkb | machine :) | 21:34 |
| clarkb | jeblair: its the most secure system, one that checks you are doing the right thing as a user. Then completely ignores all of its own advice | 21:34 |
| *** Julien-zte has joined #openstack-infra | 21:35 | |
| clarkb | also you should test if your amt does that too, try setting the password to password or similar and it will likely silenty fail on you | 21:35 |
| clarkb | but thats ok because you can provide it any password when you want it to remote wipe your disk | 21:35 |
| *** mdrabe has quit IRC | 21:35 | |
| jeblair | clarkb: must be a PCI requirement that the password have at least one number. not that the password is checked. :) | 21:35 |
| *** xyang1 has quit IRC | 21:39 | |
| clarkb | looks like we had a dns fail on osic ubuntu xenial images at ~2100UTC, it was on a multinode lable so possibly using old image if we weren't recycling those multinode images | 21:41 |
| clarkb | however, if not I am beginning to suspect the actual issue is with that .org nameserver not responding and things being unhappy as a result | 21:41 |
| clarkb | 2001:500:c::1 is the sad server | 21:42 |
| *** yamamoto has joined #openstack-infra | 21:42 | |
| *** ilpianista_ has joined #openstack-infra | 21:43 | |
| clarkb | aka b2.org.afilias-nst.org | 21:44 |
| openstackgerrit | Merged openstack-dev/pbr master: fix tests based on API change in Sphinx https://review.openstack.org/473982 | 21:45 |
| clarkb | though if I direct query it it is fine so maybe not a consistent issue? | 21:45 |
| *** yamamoto has quit IRC | 21:47 | |
| *** ijw has quit IRC | 21:49 | |
| *** bobh has joined #openstack-infra | 21:50 | |
| *** andreww has joined #openstack-infra | 21:51 | |
| *** andreww has quit IRC | 21:52 | |
| *** andreww has joined #openstack-infra | 21:53 | |
| *** ijw has joined #openstack-infra | 21:54 | |
| *** xarses_ has quit IRC | 21:54 | |
| fungi | quite possible that's a load balancer and your query is getting answered by different backend servers only one of which is broken | 21:56 |
| openstackgerrit | Merged openstack-dev/pbr master: allow user to override the output location of api docs https://review.openstack.org/473983 | 21:58 |
| *** thorst has joined #openstack-infra | 21:59 | |
| *** MatthewLi has quit IRC | 21:59 | |
| *** MatthewLi has joined #openstack-infra | 22:00 | |
| *** ihrachys has quit IRC | 22:00 | |
| clarkb | ya | 22:03 |
| *** dimtruck is now known as zz_dimtruck | 22:03 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Make unbound log errors https://review.openstack.org/475079 | 22:04 |
| *** thorst has quit IRC | 22:04 | |
| clarkb | fungi: ^ possible way to go about doing further debugging | 22:05 |
| fungi | heck, they could even be announcing that address space from disconnected facilities and it's a toss up which place your queries are going | 22:05 |
| clarkb | yay anycast | 22:05 |
| fungi | yup | 22:05 |
| clarkb | fungi: that would explain why infracloud and osic seem to bit hit hardest, they are geographically near each other | 22:06 |
| *** baoli has quit IRC | 22:06 | |
| *** Apoorva_ has joined #openstack-infra | 22:06 | |
| *** wolverineav has quit IRC | 22:07 | |
| *** wolverineav has joined #openstack-infra | 22:08 | |
| *** jamesmcarthur has joined #openstack-infra | 22:08 | |
| *** Apoorva has quit IRC | 22:09 | |
| *** wolverineav has quit IRC | 22:12 | |
| *** rlandy has quit IRC | 22:16 | |
| jeblair | pabelanger, jlk, russelb, rbergeron: i'm trying to run tox -epy35 on zuul on a fedora26 box, and ran into this error https://bugs.launchpad.net/openstack-gate/+bug/1424582 and installing redhat-rpm-config got me past it. | 22:19 |
| openstack | Launchpad bug 1424582 in OpenStack-Gate "Missing /usr/lib/rpm/redhat/redhat-hardened-cc1" [Undecided,New] | 22:19 |
| jlk | yeah | 22:20 |
| jeblair | pabelanger, jlk, russelb, rbergeron: is that, er, a fedora bug, or should we add that to zuul's bindep file or....? | 22:20 |
| jlk | there's an open bug about that bullcrap | 22:20 |
| *** thorst has joined #openstack-infra | 22:20 | |
| jlk | python-devel should depend on it | 22:20 |
| jlk | but, there's a bunch of hand wringing happening upstream and so it's not going anywhere :( | 22:20 |
| *** thorst has quit IRC | 22:20 | |
| *** ijw has quit IRC | 22:23 | |
| jeblair | jlk: :( should we put it in bindep.txt for the time being? | 22:23 |
| jlk | yeah, probably | 22:23 |
| mordred | jeblair: ++ | 22:24 |
| jlk | it's a build dep, but not a run dep | 22:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add os-service-types project https://review.openstack.org/475080 | 22:24 |
| jlk | how do you handle that? you don't list gcc and such in bin-dep do you? | 22:24 |
| *** neiljerram has quit IRC | 22:24 | |
| jeblair | jlk: i think there's a [test] tag for that | 22:24 |
| jeblair | though, we'd need this for "running" too | 22:24 |
| mordred | jeblair: we need it for running because of ffi right? | 22:25 |
| jeblair | (for anyone who wants to "run" using pypi packages) | 22:25 |
| pabelanger | interesting, haven't seen that before | 22:25 |
| jeblair | mordred: cryptography is where it broke for me | 22:25 |
| mordred | ah - yah | 22:25 |
| mordred | gcc [platform:rpm] is listed in the normal depends, not just the test depends for htat reason I'd imagine | 22:26 |
| jeblair | but hey, bubblewrap was already installed. :) | 22:26 |
| jlk | hrm, how? | 22:26 |
| mordred | so yah - I'd say redhat-rpm-config should go into [platform:rpm] generally | 22:26 |
| mordred | not just tagged with test | 22:26 |
| *** jamesmcarthur has quit IRC | 22:26 | |
| jlk | why do you need the rpmbuild file for runtime? | 22:26 |
| jlk | wasn't it just for compile reasons? | 22:26 |
| mordred | jlk: right - but to pip install the depends, you need to be able to compile | 22:26 |
| jlk | that's what I meant | 22:27 |
| jlk | you need it at _build_ time | 22:27 |
| mordred | yes | 22:27 |
| mordred | bindep is "what do I need to install that pip can't instal for me" | 22:27 |
| jlk | but once built, you don't need it to _run_? | 22:27 |
| jlk | gotcha | 22:27 |
| jlk | well. | 22:27 |
| mordred | we haven't encoded a build-deps vs. runtime-deps in bindep so far | 22:27 |
| jlk | we put zookeeperd in there, | 22:27 |
| jlk | which is runtime not even build time | 22:27 |
| mordred | yah | 22:27 |
| jlk | yeah okay. | 22:27 |
| jlk | my rpm spec lizard brain was kicking up again. | 22:28 |
| mordred | yup. believe me - I'm right there with you | 22:28 |
| mordred | it's taken me years of careful application of alcohol to stop twitching | 22:28 |
| openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: Retry to fetch paginated volumes if we get 404 for next link https://review.openstack.org/475049 | 22:29 |
| jeblair | mordred: or at least stop noticing that you're twitching :) | 22:29 |
| jlk | oh yeah I used to twitch hard at every "pip" install | 22:29 |
| jlk | but I've gotten over myself. | 22:29 |
| mordred | jlk: it almost feels normal now doens't it? | 22:29 |
| jlk | combined with containers, yeah | 22:29 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add redhat-rpm-config to rpm build deps https://review.openstack.org/475082 | 22:31 |
| pabelanger | fungi: jeblair: are we okay with ssl_ca, ssl_cert in public hiera and ssl_key in private? | 22:31 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Add some release notes we forgot to add https://review.openstack.org/474385 | 22:31 |
| fungi | pabelanger: fine by me if you want to split things up that way | 22:32 |
| jeblair | pabelanger: yeah, though, would probably be okay to just have them all in the group/fqdn private? | 22:32 |
| fungi | i do agree the less we stick in private hiera the better, but there is a balance for convenience too | 22:32 |
| fungi | i don't have strong feelings either way on this particular case | 22:33 |
| fungi | other than, of course, making sure that at least the private key is kept private ;) | 22:34 |
| mordred | fungi, jeblair, pabelanger: I also do not have a strong preference either way | 22:35 |
| fungi | pabelanger: though once you work out where in hiera things are going, update the ca instructions example accordingly or let me know what you went with so i can push up a change to do that, either wayt | 22:36 |
| fungi | s/wayt/way/ | 22:36 |
| pabelanger | k, I'll propose public / private hieradata. See if people like it | 22:38 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Break early from volume cleanup loop https://review.openstack.org/474027 | 22:40 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Remove some unused mocks https://review.openstack.org/474840 | 22:40 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert list servers tests to requests_mock https://review.openstack.org/474841 | 22:40 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert list_servers to REST https://review.openstack.org/474842 | 22:40 |
| *** panda|bbl is now known as panda|off | 22:42 | |
| *** yamamoto has joined #openstack-infra | 22:43 | |
| *** tosky has quit IRC | 22:44 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 22:47 |
| *** apetrich has quit IRC | 22:48 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix repositories for promotion jobs https://review.openstack.org/475084 | 22:49 |
| *** yamamoto has quit IRC | 22:49 | |
| *** bobh has quit IRC | 22:50 | |
| clarkb | mordred: jlk the good news is pip has come a long long way in the last 4 or 5 years so that you actually can rely on it | 22:51 |
| jlk | indeed. | 22:51 |
| clarkb | I've got sick kids demanding attention so may need to call ti a week early | 22:51 |
| jlk | pip + venv + throwaway containers == YOLO | 22:52 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix repositories for promotion jobs https://review.openstack.org/475084 | 22:56 |
| EmilienM | clarkb: just fyi I took notes of what we said on irc, we'll work on the items | 22:56 |
| *** gomarivera has quit IRC | 22:57 | |
| clarkb | EmilienM: thanks and improvement so far has been great so thanks for that too | 22:58 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-zuul master: Add gearman SSL support https://review.openstack.org/475087 | 22:58 |
| fungi | EmilienM: on a related note, as predicted blowing away the logs for that one nonvoting job did free up a solid 600-700gb on the logs site | 22:58 |
| fungi | so that was a big help in the near term | 22:59 |
| EmilienM | clarkb: tbh, I did nothing but getting feedback and making sure we work on it | 22:59 |
| EmilienM | fungi: excellent news | 22:59 |
| EmilienM | fungi: tbh, we didn't need these logs | 22:59 |
| EmilienM | the job starts to be more stable now, so we need them | 22:59 |
| fungi | took overnight for the deletes to complete, but not as long as i feared since i could just pass a (albeit complex) shell glob to rm -rf | 22:59 |
| EmilienM | I hope you ran it in a screen :D | 23:00 |
| fungi | oh, for sure! | 23:00 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Fix mkfs failure when loop device is not ready https://review.openstack.org/475022 | 23:00 |
| fungi | we have a culture of doing stuff like that in screen as root so anyone else can screen -x to follow along or take over when we get tired | 23:00 |
| jeblair | some of us tire easily | 23:02 |
| EmilienM | nice | 23:02 |
| * fungi raises his hand | 23:02 | |
| EmilienM | thanks for the work on infra, really awesome | 23:03 |
| fungi | EmilienM: you're welcome! it's fun to do regardless, but more fun when we know it's appreciated ;) | 23:04 |
| EmilienM | it's very appreciated | 23:05 |
| *** andreww has quit IRC | 23:06 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add SSL/TLS for gearman service https://review.openstack.org/475088 | 23:10 |
| *** Apoorva_ has quit IRC | 23:11 | |
| *** Apoorva has joined #openstack-infra | 23:12 | |
| *** csomerville has quit IRC | 23:12 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-zuul master: Add gearman server / client SSL support https://review.openstack.org/475087 | 23:14 |
| jeblair | pabelanger: i don't think we should have 2 copies of the gearman ca cert. can that just go in the global hiera? | 23:15 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Implement Depends-On for github https://review.openstack.org/474401 | 23:15 |
| pabelanger | jeblair: sure | 23:15 |
| *** salv-orl_ has joined #openstack-infra | 23:15 | |
| *** masuberu has joined #openstack-infra | 23:16 | |
| *** armax has joined #openstack-infra | 23:16 | |
| *** sdague has quit IRC | 23:17 | |
| fungi | yeah, one feature out current scheme seems to be missing is composable groups (you can't put a node in more than one group currently, right?) | 23:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add SSL/TLS for gearman service https://review.openstack.org/475088 | 23:17 |
| *** salv-orlando has quit IRC | 23:18 | |
| pabelanger | okay, lets see if tests pass | 23:18 |
| *** trown|brb has joined #openstack-infra | 23:20 | |
| *** SotK_ has joined #openstack-infra | 23:21 | |
| *** Vivek_ has joined #openstack-infra | 23:21 | |
| *** Vivek_ is now known as Guest45262 | 23:22 | |
| *** bramwelt1 has joined #openstack-infra | 23:22 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert list_servers to REST https://review.openstack.org/474842 | 23:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert keypairs tests to requests_mock https://review.openstack.org/475090 | 23:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Convert keypairs calls to REST https://review.openstack.org/475091 | 23:23 |
| *** Hunner_ has joined #openstack-infra | 23:24 | |
| *** Hunner_ has quit IRC | 23:24 | |
| *** Hunner_ has joined #openstack-infra | 23:24 | |
| *** therve_ has joined #openstack-infra | 23:24 | |
| *** sfinucan_ has joined #openstack-infra | 23:24 | |
| *** spotz_ has joined #openstack-infra | 23:24 | |
| *** bexelbie- has joined #openstack-infra | 23:24 | |
| *** manfred has joined #openstack-infra | 23:25 | |
| *** logan_ has joined #openstack-infra | 23:25 | |
| *** ddurst has joined #openstack-infra | 23:25 | |
| *** mmedvede_ has joined #openstack-infra | 23:25 | |
| *** mjblack- has joined #openstack-infra | 23:25 | |
| pabelanger | ianw: https://review.openstack.org/#/c/457875/ drops another epel dependency in devstack | 23:25 |
| *** bexelbie has quit IRC | 23:26 | |
| *** hamzy has quit IRC | 23:26 | |
| *** masber has quit IRC | 23:26 | |
| *** rwsu has quit IRC | 23:26 | |
| *** waynr has quit IRC | 23:26 | |
| *** therve has quit IRC | 23:26 | |
| *** Hunner has quit IRC | 23:26 | |
| *** aarefiev_afk has quit IRC | 23:26 | |
| *** laurelm has quit IRC | 23:26 | |
| *** peterstac has quit IRC | 23:26 | |
| *** tnarg has quit IRC | 23:26 | |
| *** schang has quit IRC | 23:26 | |
| *** dougshelley66 has quit IRC | 23:26 | |
| *** jgriffith has quit IRC | 23:26 | |
| *** bramwelt has quit IRC | 23:26 | |
| *** cschwede has quit IRC | 23:26 | |
| *** sshnaidm|off has quit IRC | 23:26 | |
| *** gtmanfred has quit IRC | 23:26 | |
| *** quakers has quit IRC | 23:26 | |
| *** sfinucan has quit IRC | 23:26 | |
| *** mmedvede has quit IRC | 23:26 | |
| *** jogo has quit IRC | 23:26 | |
| *** SotK has quit IRC | 23:26 | |
| *** spotz has quit IRC | 23:26 | |
| *** umbSublime has quit IRC | 23:26 | |
| *** apuimedo has quit IRC | 23:26 | |
| *** logan- has quit IRC | 23:26 | |
| *** jpena|off has quit IRC | 23:26 | |
| *** weshay has quit IRC | 23:26 | |
| *** trown has quit IRC | 23:26 | |
| *** jgrassler has quit IRC | 23:26 | |
| *** Daviey has quit IRC | 23:26 | |
| *** ilpianista has quit IRC | 23:26 | |
| *** mjblack has quit IRC | 23:26 | |
| *** mnaser has quit IRC | 23:26 | |
| *** Vivek has quit IRC | 23:26 | |
| *** yuval has quit IRC | 23:26 | |
| *** bradjones has quit IRC | 23:26 | |
| *** manfred is now known as gtmanfred | 23:26 | |
| *** bexelbie- is now known as bexelbie | 23:26 | |
| *** mjblack- is now known as mjblack | 23:26 | |
| *** jog0 has joined #openstack-infra | 23:26 | |
| *** mmedvede_ is now known as mmedvede | 23:26 | |
| *** jpena|off has joined #openstack-infra | 23:26 | |
| *** ilpianista has joined #openstack-infra | 23:26 | |
| pabelanger | fungi: jeblair: https://review.openstack.org/#/c/475088/ and https://review.openstack.org/#/c/475087/ are ready for review. SSL for gearman | 23:26 |
| *** waynr has joined #openstack-infra | 23:26 | |
| *** rwsu has joined #openstack-infra | 23:27 | |
| pabelanger | okay if we want to wait for monday for that, or I have time to monitor this evening | 23:27 |
| fungi | thanks, pabelanger! | 23:27 |
| *** raginbajin has quit IRC | 23:27 | |
| *** mrodden has quit IRC | 23:27 | |
| fungi | looking now | 23:27 |
| *** aarefiev_afk has joined #openstack-infra | 23:27 | |
| *** hamzy has joined #openstack-infra | 23:27 | |
| *** yuval has joined #openstack-infra | 23:27 | |
| *** sshnaidm|off has joined #openstack-infra | 23:28 | |
| *** umbSublime has joined #openstack-infra | 23:28 | |
| *** umbSublime has quit IRC | 23:28 | |
| *** umbSublime has joined #openstack-infra | 23:28 | |
| *** apuimedo has joined #openstack-infra | 23:28 | |
| jeblair | pabelanger: both lgtm, thanks! | 23:28 |
| *** toabctl has quit IRC | 23:28 | |
| *** Daviey has joined #openstack-infra | 23:28 | |
| *** jgrassler has joined #openstack-infra | 23:29 | |
| *** jgriffith has joined #openstack-infra | 23:29 | |
| *** logan_ is now known as logan- | 23:29 | |
| mordred | pabelanger: +A | 23:29 |
| *** toabctl has joined #openstack-infra | 23:30 | |
| *** mrodden has joined #openstack-infra | 23:30 | |
| mordred | jeblair, Shrews: this is exciting - it was so many years ago that we added SSL support to the gear lib - and we're finally using it! | 23:30 |
| *** weshay has joined #openstack-infra | 23:31 | |
| *** bradjones has joined #openstack-infra | 23:31 | |
| *** cschwede has joined #openstack-infra | 23:31 | |
| *** cschwede has quit IRC | 23:31 | |
| *** cschwede has joined #openstack-infra | 23:31 | |
| *** weshay has quit IRC | 23:31 | |
| *** weshay has joined #openstack-infra | 23:31 | |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Implement Depends-On for github https://review.openstack.org/474401 | 23:31 |
| fungi | pabelanger: lgtm too | 23:32 |
| *** bradjones has quit IRC | 23:32 | |
| *** bradjones has joined #openstack-infra | 23:32 | |
| pabelanger | great! | 23:32 |
| *** Apoorva has quit IRC | 23:34 | |
| *** raginbajin has joined #openstack-infra | 23:34 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Add gearman server / client SSL support https://review.openstack.org/475087 | 23:35 |
| openstackgerrit | Merged openstack-infra/system-config master: Add SSL/TLS for gearman service https://review.openstack.org/475088 | 23:36 |
| *** makowals_ has joined #openstack-infra | 23:39 | |
| *** mnaser has joined #openstack-infra | 23:40 | |
| *** makowals has quit IRC | 23:41 | |
| *** yamamoto has joined #openstack-infra | 23:45 | |
| ianw | pabelanger: I know, i wrote it ;) | 23:48 |
| pabelanger | ianw: Oh, AHA | 23:49 |
| *** yamamoto has quit IRC | 23:50 | |
| ianw | yeah, it's just been on the back-burner with the depends-on for a while | 23:51 |
| *** thorst has joined #openstack-infra | 23:51 | |
| *** zz_dimtruck is now known as dimtruck | 23:52 | |
| *** thorst has quit IRC | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!