| *** davideagnello has joined #openstack-infra | 00:05 | |
| *** davideagnello has quit IRC | 00:06 | |
| *** Qiming has joined #openstack-infra | 00:12 | |
| *** tzn has quit IRC | 00:22 | |
| *** lezbar has joined #openstack-infra | 00:23 | |
| *** lezbar has quit IRC | 00:28 | |
| *** masuberu has joined #openstack-infra | 00:31 | |
| *** watanabe_isao has quit IRC | 00:32 | |
| *** masber has quit IRC | 00:34 | |
| *** Qiming has quit IRC | 00:34 | |
| *** masber has joined #openstack-infra | 00:35 | |
| *** masuberu has quit IRC | 00:37 | |
| *** esker has joined #openstack-infra | 00:53 | |
| *** markvoelker has quit IRC | 01:01 | |
| *** dcentral has quit IRC | 01:03 | |
| *** dcentral has joined #openstack-infra | 01:16 | |
| *** tzn has joined #openstack-infra | 01:25 | |
| *** Qiming has joined #openstack-infra | 01:27 | |
| *** david-lyle has joined #openstack-infra | 01:27 | |
| *** tzn has quit IRC | 01:30 | |
| *** david-lyle has quit IRC | 01:37 | |
| *** jyuso1 has joined #openstack-infra | 01:41 | |
| *** moravec has joined #openstack-infra | 01:45 | |
| *** moravec has quit IRC | 01:54 | |
| *** zul has joined #openstack-infra | 02:00 | |
| *** zhurong has joined #openstack-infra | 02:01 | |
| *** esker has quit IRC | 02:04 | |
| *** esker has joined #openstack-infra | 02:06 | |
| *** esker has quit IRC | 02:06 | |
| *** esker has joined #openstack-infra | 02:06 | |
| *** davideagnello has joined #openstack-infra | 02:07 | |
| *** davideagnello has quit IRC | 02:11 | |
| *** lezbar has joined #openstack-infra | 02:12 | |
| *** lezbar has quit IRC | 02:16 | |
| *** zhenguo has joined #openstack-infra | 02:25 | |
| *** david-lyle has joined #openstack-infra | 02:27 | |
| *** esker has quit IRC | 02:29 | |
| *** david-lyle_ has joined #openstack-infra | 02:31 | |
| *** david-lyle has quit IRC | 02:32 | |
| *** masuberu has joined #openstack-infra | 02:33 | |
| *** masber has quit IRC | 02:37 | |
| *** gongysh_ has joined #openstack-infra | 02:43 | |
| *** rvasilets___ has quit IRC | 02:45 | |
| *** markvoelker has joined #openstack-infra | 02:47 | |
| *** markvoelker has quit IRC | 02:51 | |
| *** gongysh_ has quit IRC | 02:59 | |
| *** masuberu has quit IRC | 03:03 | |
| *** masber has joined #openstack-infra | 03:05 | |
| *** links has joined #openstack-infra | 03:06 | |
| *** coolsvap|away is now known as coolsvap | 03:15 | |
| *** Thelo has quit IRC | 03:21 | |
| *** Thelo has joined #openstack-infra | 03:24 | |
| *** zhurong has quit IRC | 03:24 | |
| *** zhurong has joined #openstack-infra | 03:25 | |
| *** esker has joined #openstack-infra | 03:29 | |
| *** yuanying has quit IRC | 03:30 | |
| *** links has quit IRC | 03:33 | |
| *** esker has quit IRC | 03:35 | |
| *** markvoelker has joined #openstack-infra | 03:48 | |
| *** hamzy_vacay has quit IRC | 03:49 | |
| *** hamzy_vacay has joined #openstack-infra | 03:50 | |
| *** markvoelker has quit IRC | 03:52 | |
| *** hamzy_vacay has quit IRC | 03:54 | |
| *** salv-orlando has joined #openstack-infra | 03:56 | |
| *** hamzy has joined #openstack-infra | 03:56 | |
| *** esker has joined #openstack-infra | 03:58 | |
| *** salv-orlando has quit IRC | 03:59 | |
| *** lezbar has joined #openstack-infra | 04:00 | |
| *** david-lyle_ has quit IRC | 04:03 | |
| *** lezbar has quit IRC | 04:05 | |
| *** yuanying has joined #openstack-infra | 04:07 | |
| *** links has joined #openstack-infra | 04:11 | |
| *** itzdilip has joined #openstack-infra | 04:15 | |
| *** esker has quit IRC | 04:23 | |
| *** Ramanjaneya has joined #openstack-infra | 04:25 | |
| *** yamahata has joined #openstack-infra | 04:44 | |
| *** _elmiko has quit IRC | 04:45 | |
| *** esker has joined #openstack-infra | 04:46 | |
| *** markvoelker has joined #openstack-infra | 04:49 | |
| *** zhurong has quit IRC | 04:49 | |
| *** sputnik13 has joined #openstack-infra | 04:49 | |
| *** zhurong has joined #openstack-infra | 04:50 | |
| *** markvoelker has quit IRC | 04:53 | |
| *** david-lyle has joined #openstack-infra | 04:55 | |
| *** esker has quit IRC | 04:57 | |
| *** hdd has joined #openstack-infra | 04:57 | |
| *** david-lyle has quit IRC | 05:03 | |
| *** otter768 has joined #openstack-infra | 05:05 | |
| *** zhurong has quit IRC | 05:17 | |
| *** zhurong has joined #openstack-infra | 05:18 | |
| *** esker has joined #openstack-infra | 05:23 | |
| *** david-lyle has joined #openstack-infra | 05:27 | |
| *** abregman has joined #openstack-infra | 05:27 | |
| *** esker has quit IRC | 05:28 | |
| *** abregman has quit IRC | 05:29 | |
| *** abregman has joined #openstack-infra | 05:29 | |
| *** _et_ has joined #openstack-infra | 05:36 | |
| *** masuberu has joined #openstack-infra | 05:39 | |
| *** masber has quit IRC | 05:41 | |
| *** unicell1 has quit IRC | 05:46 | |
| *** unicell has joined #openstack-infra | 05:46 | |
| *** unicell has quit IRC | 05:46 | |
| *** unicell has joined #openstack-infra | 05:46 | |
| *** lezbar has joined #openstack-infra | 05:49 | |
| *** markvoelker has joined #openstack-infra | 05:49 | |
| *** zhurong has quit IRC | 05:50 | |
| *** zhurong has joined #openstack-infra | 05:51 | |
| *** markvoelker has quit IRC | 05:54 | |
| *** lezbar has quit IRC | 05:54 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: check that osc plugins do not break openstackclient https://review.openstack.org/261828 | 06:06 |
|---|---|---|
| *** davideagnello has joined #openstack-infra | 06:08 | |
| *** davideagnello has quit IRC | 06:13 | |
| *** sputnik13 has quit IRC | 06:16 | |
| *** masuberu has quit IRC | 06:17 | |
| openstackgerrit | Eli Qiao proposed openstack-infra/project-config: Magnum: Add new pipe line to do mesos functional testing https://review.openstack.org/261894 | 06:21 |
| *** mase_x200 has joined #openstack-infra | 06:21 | |
| *** masuberu has joined #openstack-infra | 06:24 | |
| *** isaacb has joined #openstack-infra | 06:25 | |
| *** Qiming has quit IRC | 06:28 | |
| *** jaosorior has joined #openstack-infra | 06:30 | |
| *** mgrosz has joined #openstack-infra | 06:33 | |
| mgrosz | Good morning... I am trying to figure out how do projects documentation are displayed here: http://docs.openstack.org/developer/openstack-projects.html. Can someone please refer me to the steps? | 06:34 |
| mgrosz | Thnaks | 06:34 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/260895 | 06:37 |
| *** hdd has quit IRC | 06:39 | |
| openstackgerrit | Eli Qiao proposed openstack-infra/project-config: Magnum: Add new pipe line to do mesos functional testing https://review.openstack.org/261894 | 06:40 |
| stevemar | mgrosz: they are listed here: https://github.com/openstack/openstack-manuals/blob/d02c952a4e72e703a718749d3e3b1d4d7809e47f/www/developer/openstack-projects.html | 06:41 |
| *** _nadya_ has joined #openstack-infra | 06:44 | |
| *** mase_x200 has quit IRC | 06:46 | |
| mgrosz | stevemar: I know that, thanks... But how does the href link, for example "http://docs.openstack.org/developer/ironic/" points to the folder /docs under the ironic project repository (https://github.com/openstack/ironic/tree/master/doc/source) | 06:47 |
| mgrosz | ? | 06:47 |
| mgrosz | stevemar: I assume there is a configuration file in some openstack documentation infra project where I need to add my project (Vitrage, in my case) | 06:48 |
| *** HeOS has quit IRC | 06:49 | |
| *** otter768 has quit IRC | 06:49 | |
| *** cody-somerville has joined #openstack-infra | 06:49 | |
| *** cody-somerville has quit IRC | 06:49 | |
| *** cody-somerville has joined #openstack-infra | 06:49 | |
| *** markvoelker has joined #openstack-infra | 06:50 | |
| *** yamahata has quit IRC | 06:53 | |
| *** mgrosz has quit IRC | 06:54 | |
| *** markvoelker has quit IRC | 06:55 | |
| *** irenab has quit IRC | 06:55 | |
| *** gampel has joined #openstack-infra | 06:59 | |
| *** masber has joined #openstack-infra | 07:04 | |
| *** masuberu has quit IRC | 07:04 | |
| *** aopincar has joined #openstack-infra | 07:04 | |
| *** mgrosz has joined #openstack-infra | 07:05 | |
| *** lezbar has joined #openstack-infra | 07:05 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: check that osc plugins do not break openstackclient https://review.openstack.org/261828 | 07:05 |
| *** maishsk has joined #openstack-infra | 07:06 | |
| *** setuid has quit IRC | 07:08 | |
| *** xwizard_ has quit IRC | 07:09 | |
| *** skraynev has quit IRC | 07:09 | |
| *** skraynev has joined #openstack-infra | 07:09 | |
| *** lezbar has quit IRC | 07:10 | |
| *** xwizard_ has joined #openstack-infra | 07:10 | |
| *** setuid has joined #openstack-infra | 07:10 | |
| *** isaacb has quit IRC | 07:11 | |
| *** nikil89_ has joined #openstack-infra | 07:12 | |
| *** nikil89_ is now known as naggappan | 07:12 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: check that osc plugins do not break openstackclient https://review.openstack.org/261828 | 07:14 |
| *** kushal has joined #openstack-infra | 07:18 | |
| *** [1]Thelo has joined #openstack-infra | 07:23 | |
| *** _nadya_ has quit IRC | 07:23 | |
| *** Thelo has quit IRC | 07:25 | |
| *** [1]Thelo is now known as Thelo | 07:25 | |
| *** esker has joined #openstack-infra | 07:27 | |
| *** irenab has joined #openstack-infra | 07:27 | |
| *** esker has quit IRC | 07:32 | |
| *** amotoki has joined #openstack-infra | 07:36 | |
| *** kambiz has quit IRC | 07:42 | |
| *** kuromagi has quit IRC | 07:43 | |
| *** lyz has quit IRC | 07:43 | |
| *** trey has quit IRC | 07:43 | |
| *** Clint has quit IRC | 07:43 | |
| *** cburgess_ has quit IRC | 07:43 | |
| *** waynr has quit IRC | 07:43 | |
| *** pleia2 has quit IRC | 07:43 | |
| *** esikachev has joined #openstack-infra | 07:45 | |
| *** links has quit IRC | 07:46 | |
| *** masber has quit IRC | 07:47 | |
| *** jaosorior has quit IRC | 07:50 | |
| *** zhurong has quit IRC | 07:50 | |
| *** jaosorior has joined #openstack-infra | 07:50 | |
| *** zhurong has joined #openstack-infra | 07:52 | |
| *** _nadya_ has joined #openstack-infra | 07:54 | |
| *** daemontool_ has joined #openstack-infra | 07:59 | |
| *** rcernin has joined #openstack-infra | 08:00 | |
| *** lyz has joined #openstack-infra | 08:01 | |
| *** pleia2 has joined #openstack-infra | 08:01 | |
| *** kambiz has joined #openstack-infra | 08:01 | |
| *** cburgess has joined #openstack-infra | 08:01 | |
| *** salv-orlando has joined #openstack-infra | 08:01 | |
| *** gampel1 has joined #openstack-infra | 08:01 | |
| *** Clint has joined #openstack-infra | 08:02 | |
| *** daemontool has quit IRC | 08:02 | |
| *** kuromagi has joined #openstack-infra | 08:02 | |
| *** waynr has joined #openstack-infra | 08:03 | |
| *** trey has joined #openstack-infra | 08:03 | |
| *** gampel has quit IRC | 08:05 | |
| *** isaacb has joined #openstack-infra | 08:08 | |
| *** davideagnello has joined #openstack-infra | 08:09 | |
| *** davideagnello has quit IRC | 08:14 | |
| *** dims has quit IRC | 08:19 | |
| *** dims has joined #openstack-infra | 08:19 | |
| *** yuanying has quit IRC | 08:20 | |
| *** gampel1 has quit IRC | 08:25 | |
| *** gampel has joined #openstack-infra | 08:26 | |
| *** mgrosz has quit IRC | 08:27 | |
| openstackgerrit | Eli Qiao proposed openstack-infra/project-config: Magnum: Add new job to do mesos functional testing https://review.openstack.org/261894 | 08:28 |
| *** jaosorior has quit IRC | 08:28 | |
| *** maishsk has quit IRC | 08:29 | |
| *** david-lyle has quit IRC | 08:30 | |
| *** pkarikh_ is now known as pkarikh | 08:31 | |
| *** binbincong has quit IRC | 08:32 | |
| *** maishsk has joined #openstack-infra | 08:33 | |
| *** sshnaidm has joined #openstack-infra | 08:34 | |
| *** HeOS has joined #openstack-infra | 08:41 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Add instructions on how to troubleshoot bots https://review.openstack.org/260068 | 08:41 |
| *** maishsk has quit IRC | 08:45 | |
| *** salv-orlando has quit IRC | 08:49 | |
| *** otter768 has joined #openstack-infra | 08:50 | |
| *** markvoelker has joined #openstack-infra | 08:51 | |
| *** maishsk has joined #openstack-infra | 08:51 | |
| openstackgerrit | Merged openstack-infra/project-config: ec2api experimental job rework https://review.openstack.org/261640 | 08:52 |
| Thelo | Hi all, I am facing one issue with nodepool ( described here : https://ask.openstack.org/en/question/86697/nodepool-image-build-failed/) and cannot figure out whats going wrong | 08:53 |
| *** rossella_ has quit IRC | 08:53 | |
| Thelo | If someone has time to look at this I would very much appreciate | 08:53 |
| *** ociuhandu has quit IRC | 08:54 | |
| *** lezbar has joined #openstack-infra | 08:54 | |
| *** otter768 has quit IRC | 08:55 | |
| *** rossella_ has joined #openstack-infra | 08:55 | |
| *** markvoelker has quit IRC | 08:55 | |
| openstackgerrit | Merged openstack-infra/project-config: retire keystoneauth-saml2 https://review.openstack.org/261779 | 08:56 |
| *** ashishb has joined #openstack-infra | 08:56 | |
| openstackgerrit | Merged openstack-infra/project-config: do not run releasenotes for liberty branches on osc https://review.openstack.org/261777 | 08:57 |
| *** lezbar has quit IRC | 08:58 | |
| *** gampel has quit IRC | 09:03 | |
| openstackgerrit | Merged openstack-infra/project-config: Do not run dsvm jobs on releasenotes changes for IPA and inspector https://review.openstack.org/260963 | 09:04 |
| openstackgerrit | Merged openstack-infra/project-config: Adding voting Bandit on Bandit gate https://review.openstack.org/260135 | 09:05 |
| *** gampel has joined #openstack-infra | 09:12 | |
| *** sshnaidm has quit IRC | 09:13 | |
| *** maishsk has quit IRC | 09:15 | |
| *** e0ne has joined #openstack-infra | 09:17 | |
| *** _et_ has quit IRC | 09:17 | |
| *** zhurong has quit IRC | 09:17 | |
| *** ociuhandu has joined #openstack-infra | 09:18 | |
| *** zhurong has joined #openstack-infra | 09:18 | |
| *** salv-orlando has joined #openstack-infra | 09:22 | |
| *** zhurong has quit IRC | 09:23 | |
| *** e0ne has quit IRC | 09:23 | |
| *** sshnaidm has joined #openstack-infra | 09:26 | |
| dulek | Hi, just want to inform that I'm getting timeouts on Gerrit. I think that last time it happened it was connected with unusual delays in Zuul. | 09:30 |
| *** _et_ has joined #openstack-infra | 09:35 | |
| *** maishsk has joined #openstack-infra | 09:36 | |
| *** dims has quit IRC | 09:46 | |
| *** dims has joined #openstack-infra | 09:48 | |
| *** tzn has joined #openstack-infra | 09:53 | |
| *** links has joined #openstack-infra | 09:58 | |
| *** vgridnev has joined #openstack-infra | 10:04 | |
| *** vgridnev has quit IRC | 10:05 | |
| *** sshnaidm has quit IRC | 10:07 | |
| *** davideagnello has joined #openstack-infra | 10:10 | |
| *** akscram has quit IRC | 10:11 | |
| *** davideagnello has quit IRC | 10:14 | |
| *** dkehn has quit IRC | 10:15 | |
| *** e0ne has joined #openstack-infra | 10:24 | |
| *** david-lyle has joined #openstack-infra | 10:26 | |
| *** AJaeger has joined #openstack-infra | 10:26 | |
| AJaeger | infra-root, I received again a 502 proxy error on review.openstack.org but a reload fixed it... | 10:27 |
| *** treaki_ has joined #openstack-infra | 10:27 | |
| *** vgridnev has joined #openstack-infra | 10:29 | |
| AJaeger | mgrosz, to answer your question: you need to add a job to project-config to publish to docs.openstack.org - but only projects in the big tent can do so - as long as vitrage is not part of big tent, you cannot publish there | 10:33 |
| *** marcusvrn_ has joined #openstack-infra | 10:36 | |
| *** akuznetsova_ is now known as akuznetsova | 10:39 | |
| *** jyuso1 has quit IRC | 10:41 | |
| *** lezbar has joined #openstack-infra | 10:43 | |
| *** amotoki has quit IRC | 10:44 | |
| *** lezbar has quit IRC | 10:47 | |
| *** maishsk has quit IRC | 10:47 | |
| *** _et_ has quit IRC | 10:47 | |
| *** salv-orl_ has joined #openstack-infra | 10:49 | |
| *** otter768 has joined #openstack-infra | 10:51 | |
| *** maishsk has joined #openstack-infra | 10:51 | |
| *** markvoelker has joined #openstack-infra | 10:52 | |
| *** salv-orlando has quit IRC | 10:53 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add new experimental Tempest job for Manila https://review.openstack.org/247551 | 10:53 |
| *** Qiming has joined #openstack-infra | 10:53 | |
| *** _nadya_ has quit IRC | 10:56 | |
| *** otter768 has quit IRC | 10:56 | |
| *** treaki_ has quit IRC | 10:56 | |
| *** markvoelker has quit IRC | 10:57 | |
| AJaeger | infra-root, there really seems to be a problem with gerrit ;( the proxy errors happen more often now. | 10:57 |
| *** AJaeger has quit IRC | 10:58 | |
| vdrok | yep, same problem for me | 11:01 |
| vdrok | 502 proxy error | 11:01 |
| *** maishsk has quit IRC | 11:02 | |
| *** maishsk has joined #openstack-infra | 11:04 | |
| *** gampel1 has joined #openstack-infra | 11:04 | |
| *** gampel has quit IRC | 11:05 | |
| *** Eva-i has joined #openstack-infra | 11:09 | |
| *** sshnaidm has joined #openstack-infra | 11:12 | |
| *** maishsk has quit IRC | 11:15 | |
| *** maishsk has joined #openstack-infra | 11:15 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add new experimental Tempest job for Manila https://review.openstack.org/247551 | 11:16 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add reno jobs for python-ironicclient https://review.openstack.org/261095 | 11:22 |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add new experimental Tempest job for Manila https://review.openstack.org/247551 | 11:26 |
| *** _et_ has joined #openstack-infra | 11:28 | |
| *** masber has joined #openstack-infra | 11:31 | |
| *** esker has joined #openstack-infra | 11:31 | |
| *** dstepanenko_ has joined #openstack-infra | 11:33 | |
| *** esker has quit IRC | 11:36 | |
| *** maishsk has quit IRC | 11:41 | |
| *** itzdilip has quit IRC | 11:41 | |
| *** claudiub has joined #openstack-infra | 11:43 | |
| *** links has quit IRC | 11:44 | |
| *** rfolco has joined #openstack-infra | 11:47 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add new experimental Tempest job for Manila https://review.openstack.org/247551 | 11:47 |
| *** david-lyle has quit IRC | 11:47 | |
| *** _nadya_ has joined #openstack-infra | 11:50 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added new repo for fuel-plugin-onosfw in Openstack NS https://review.openstack.org/261966 | 11:52 |
| *** Daisy has joined #openstack-infra | 11:56 | |
| *** maishsk has joined #openstack-infra | 12:03 | |
| *** akscram has joined #openstack-infra | 12:06 | |
| *** _et_ has quit IRC | 12:08 | |
| openstackgerrit | Eva Balycheva proposed openstack-infra/project-config: Fix Zaqar gate DSVM tests to make them work https://review.openstack.org/261482 | 12:08 |
| *** treaki_ has joined #openstack-infra | 12:10 | |
| *** zhurong has joined #openstack-infra | 12:11 | |
| openstackgerrit | Eva Balycheva proposed openstack-infra/project-config: Fix Zaqar gate DSVM tests to make them work https://review.openstack.org/261482 | 12:18 |
| *** Daisy has quit IRC | 12:19 | |
| *** jaypipes has joined #openstack-infra | 12:22 | |
| dstepanenko_ | Gentlemen, my patchset for nova failed pci tests. I tried to investigate the issue and found that pci_devices table in nova database is empty, i.e. it doesn't contain any data about pci devices. As far as I understand, this is not a valid state for he system. I didn't find all the code used for the testing, only https://github.com/intel-hw-ci/Intel-Openstack-Hardware-CI. Could anyone please take a look into this issue? | 12:22 |
| *** ashishb has quit IRC | 12:25 | |
| *** Daisy has joined #openstack-infra | 12:26 | |
| *** david-lyle has joined #openstack-infra | 12:27 | |
| mattymo | feels as though gerrit drank too much christmas eggnog and is stumbling about | 12:27 |
| *** lezbar has joined #openstack-infra | 12:28 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Use constraints based job to the gate of ofagent https://review.openstack.org/261982 | 12:29 |
| *** andreykurilin has quit IRC | 12:31 | |
| *** lezbar has quit IRC | 12:33 | |
| *** andreykurilin has joined #openstack-infra | 12:36 | |
| *** Daisy has quit IRC | 12:38 | |
| *** isaacb has quit IRC | 12:39 | |
| *** zhurong has quit IRC | 12:46 | |
| *** zhurong has joined #openstack-infra | 12:47 | |
| *** zul has quit IRC | 12:50 | |
| *** morgabra has quit IRC | 12:51 | |
| yolanda | hi AJaeger, still having problems? | 12:51 |
| *** otter768 has joined #openstack-infra | 12:52 | |
| *** blogan has quit IRC | 12:52 | |
| *** markvoelker has joined #openstack-infra | 12:52 | |
| *** openstackgerrit has quit IRC | 12:53 | |
| *** Sam-I-Am has quit IRC | 12:53 | |
| *** ptoohill has quit IRC | 12:53 | |
| *** Daisy has joined #openstack-infra | 12:55 | |
| *** otter768 has quit IRC | 12:56 | |
| *** markvoelker has quit IRC | 12:57 | |
| *** blogan has joined #openstack-infra | 12:57 | |
| *** ptoohill has joined #openstack-infra | 12:58 | |
| *** morgabra has joined #openstack-infra | 12:58 | |
| *** maishsk has quit IRC | 12:59 | |
| *** salv-orl_ has quit IRC | 13:00 | |
| *** maishsk has joined #openstack-infra | 13:01 | |
| *** Daisy has quit IRC | 13:02 | |
| *** openstackgerrit has joined #openstack-infra | 13:05 | |
| *** rhallisey has joined #openstack-infra | 13:05 | |
| *** tzn has quit IRC | 13:05 | |
| *** tzn has joined #openstack-infra | 13:07 | |
| *** Sam-I-Am has joined #openstack-infra | 13:08 | |
| *** abregman has quit IRC | 13:08 | |
| *** esikachev has quit IRC | 13:10 | |
| *** esikache1 has joined #openstack-infra | 13:10 | |
| *** AJaeger has joined #openstack-infra | 13:17 | |
| AJaeger | yolanda: I'm not reviewing currently - but this is a problem that is sporadic | 13:18 |
| *** esikache1 has quit IRC | 13:18 | |
| *** zul has joined #openstack-infra | 13:19 | |
| AJaeger | I just opened quite a few reviews, everything looks fine right now | 13:20 |
| AJaeger | did you change anything? | 13:20 |
| *** Daisy has joined #openstack-infra | 13:22 | |
| *** zeih has joined #openstack-infra | 13:22 | |
| *** claudiub has quit IRC | 13:24 | |
| *** Guest4815 is now known as zeus | 13:24 | |
| *** zeus has joined #openstack-infra | 13:25 | |
| *** esikache1 has joined #openstack-infra | 13:26 | |
| *** Daisy has quit IRC | 13:27 | |
| AJaeger | yolanda: just recevied again a 502 proxy error | 13:30 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use linters job for keystone starting with mitaka https://review.openstack.org/261994 | 13:31 |
| AJaeger | stevemar: Now i need your help with reviewing, please check 261994 and 261993 ^ | 13:32 |
| *** esker has joined #openstack-infra | 13:35 | |
| *** esker has quit IRC | 13:40 | |
| *** aopincar has quit IRC | 13:41 | |
| *** zeih has quit IRC | 13:44 | |
| *** jsavak has joined #openstack-infra | 13:47 | |
| *** zhurong has quit IRC | 13:49 | |
| AJaeger | stevemar, project-config reviewers: Should we backport the linters change from keystone (261993) to make infra setup easier? I'd like to find a good pattern here... | 13:50 |
| *** markvoelker has joined #openstack-infra | 13:53 | |
| *** esker has joined #openstack-infra | 13:54 | |
| dhellmann | AJaeger, yolanda : I'm seeing some errors from gerrit, too | 13:54 |
| yolanda | i noticed it quite slow this morning | 13:56 |
| *** maishsk has quit IRC | 13:56 | |
| *** daemontool has joined #openstack-infra | 13:57 | |
| AJaeger | yolanda: that slowness might be the same issue | 13:57 |
| dhellmann | yeah, I've noticed that, too | 13:57 |
| yolanda | i restarted apache because i see some errors in log, but problem looks in the gerrit service really | 13:57 |
| *** daemontool_ has quit IRC | 13:58 | |
| *** markvoelker has quit IRC | 13:58 | |
| *** esker has quit IRC | 13:59 | |
| AJaeger | dhellmann: what do you want to do with https://review.openstack.org/#/c/254372/ - this is an important reno change. Ping another core to approve? | 13:59 |
| yolanda | a | 13:59 |
| yolanda | o | 13:59 |
| yolanda | oops | 13:59 |
| dhellmann | AJaeger : ttx will be back next week, I was going to wait for him | 13:59 |
| AJaeger | yolanda: is there any debug information to get ? | 13:59 |
| AJaeger | dhellmann: ok | 13:59 |
| yolanda | AJaeger, no relevant errors in gerrit.log | 14:00 |
| yolanda | however, cpu is at 735% usage, by java | 14:00 |
| *** esikache1 has quit IRC | 14:00 | |
| tsufiev | hello there! | 14:00 |
| tsufiev | today I've seen again gerrit changes not getting into zuul pipeline | 14:00 |
| tsufiev | for example, https://review.openstack.org/#/c/260237 | 14:01 |
| tsufiev | this time no circular dependencies | 14:01 |
| *** salv-orlando has joined #openstack-infra | 14:01 | |
| *** jsavak has quit IRC | 14:02 | |
| AJaeger | yolanda: I have no clue what to do... | 14:02 |
| AJaeger | tsufiev: let me check... | 14:02 |
| AJaeger | tsufiev: that change is based on https://review.openstack.org/#/c/249316, isn't it? | 14:04 |
| AJaeger | and 249316 is not approved... | 14:04 |
| AJaeger | tsufiev: see "related changes" on the top right | 14:05 |
| tsufiev | AJaeger, oh, sorry, I read it in the opposite direction (thinking that not approved one is the tail) :) | 14:05 |
| tsufiev | never mind then | 14:05 |
| * tsufiev is still getting used to new gerrit ui | 14:05 | |
| *** esikache1 has joined #openstack-infra | 14:05 | |
| *** bexelbie_ has joined #openstack-infra | 14:06 | |
| *** bexelbie_ is now known as bexelbie | 14:07 | |
| *** maishsk has joined #openstack-infra | 14:09 | |
| dulek | I think Gerrit just died… Seems like problems I've reported at 10:30 escalated. | 14:09 |
| *** davideagnello has joined #openstack-infra | 14:11 | |
| AJaeger | dulek: try again, please | 14:11 |
| AJaeger | dulek: there are indeed problems but they seem to be temporary so far | 14:12 |
| *** Ramanjaneya has quit IRC | 14:12 | |
| dulek | AJaeger: Yeah, cccasional proxy errors seem to not show anymore. | 14:15 |
| *** bastelfreak has quit IRC | 14:15 | |
| *** davideagnello has quit IRC | 14:16 | |
| AJaeger | dulek: until next time ;( | 14:16 |
| *** lezbar has joined #openstack-infra | 14:17 | |
| pabelanger | morning! | 14:19 |
| AJaeger | morning, pabelanger ! | 14:19 |
| *** lezbar has quit IRC | 14:21 | |
| *** naggappan has quit IRC | 14:26 | |
| anteaya | morning all | 14:27 |
| anteaya | git remote update is stalled at "Fetching gerrit" | 14:27 |
| anteaya | finished now but hung there awhile | 14:28 |
| anteaya | seems to be in line with the backscroll of gerrit is off today | 14:28 |
| *** bastelfreak has joined #openstack-infra | 14:29 | |
| AJaeger | morning, anteaya | 14:30 |
| anteaya | and here's a fun one, 249984 needs rebasing, I haven't touched in in 4 weeks, seems gerrit can't find the refs for it: http://paste.openstack.org/show/482772/ :( | 14:31 |
| anteaya | AJaeger: how are you today? | 14:31 |
| AJaeger | anteaya: relaxed ;) Had to cycle to customs today to get a late christmas present - 2.5 hours cycling was fun ;) | 14:32 |
| AJaeger | anteaya: how ar you? | 14:32 |
| anteaya | AJaeger: sounds nice | 14:33 |
| AJaeger | anteaya: 24998 is for system-config but you checked out in project-config - the message is correct "Does specified change number belong to this project?" | 14:33 |
| anteaya | AJaeger: good thanks, had a lovely low key no-over-eating holiday | 14:34 |
| *** irenab has quit IRC | 14:34 | |
| anteaya | AJaeger: oh good | 14:34 |
| anteaya | AJaeger: glad the fault lies with me | 14:34 |
| * anteaya tries it with system-config now | 14:34 | |
| smcginnis | Did the Toggle CI button go away? | 14:37 |
| *** coolsvap is now known as coolsvap|away | 14:37 | |
| *** dkehn has joined #openstack-infra | 14:37 | |
| AJaeger | anteaya: a review of https://review.openstack.org/261743 would be nice - documenting some depends-on caveats. Nothing urgent, just a change I hope we can use as reference to reduce questions... | 14:37 |
| AJaeger | smcginnis: it's still there, scroll to the bottom | 14:38 |
| smcginnis | Oh, found it. It goes away if you do a version diff. | 14:38 |
| AJaeger | ah;( | 14:38 |
| smcginnis | AJaeger: Doesn't like things like "10..11" in the URL I guess. | 14:38 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:39 | |
| mkoderer | hi folks, could someone help me to find out why all tempest-kilo test are failing? | 14:40 |
| mkoderer | http://logs.openstack.org/85/255385/6/check/gate-tempest-dsvm-full-kilo/0b46f76/console.html | 14:40 |
| AJaeger | anteaya: and a reviews of 260711 would be nice as well - not critical either. Thanks | 14:41 |
| openstackgerrit | Anita Kuno proposed openstack-infra/system-config: Add openstack-meeting-cp to statusbot https://review.openstack.org/249984 | 14:41 |
| Thelo | Hi all, I am facing one issue with nodepool ( described here : https://ask.openstack.org/en/question/86697/nodepool-image-build-failed/) and cannot figure out whats going wrong | 14:42 |
| Thelo | [16:53] *** rossella_ quit (Ping timeout: 255 seconds) | 14:42 |
| Thelo | [16:53] <Thelo> If someone has time to look at this I would very much appreciate | 14:42 |
| Thelo | [16:54] *** ociuhandu quit (Quit: ociuhandu) | 14:42 |
| Thelo | [16:54] *** lezbar (~lezbar@5.40.248.8.static.user.ono.com) joined | 14:42 |
| Thelo | oops wrong copy pasrw | 14:42 |
| Thelo | but the question is still valid | 14:42 |
| AJaeger | mkoderer: " ImportError: No module named testrepository" | 14:43 |
| *** claudiub has joined #openstack-infra | 14:43 | |
| AJaeger | http://logs.openstack.org/85/255385/6/check/gate-tempest-dsvm-full-kilo/0b46f76/logs/devstacklog.txt.gz#_2015-12-26_09_03_17_536 | 14:43 |
| AJaeger | mkoderer: something changed and testrepository is not installed automatically in some cases anymore | 14:43 |
| mkoderer | AJaeger: ok thx.. I will have a look | 14:44 |
| anteaya | Thelo: how about you put your error stacktrace in a paste service and bring the url of the paste back here | 14:45 |
| Thelo | ok I didnt know about stacktrace | 14:46 |
| Thelo | I will next time | 14:46 |
| Thelo | is there a workaround for this problem? | 14:46 |
| anteaya | Thelo: or your error or your build log | 14:46 |
| yolanda | AJaeger sorry, still on holiday and I have to go | 14:46 |
| yolanda | is there any other infra-root? i see a high load and some ssh errors, but no jetty errors now as we were seeing on previous version | 14:47 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use linters job for keystone starting with mitaka https://review.openstack.org/261994 | 14:47 |
| anteaya | yolanda: thanks for your help, enjoy your holiday | 14:47 |
| Thelo | anteaya: what do you mean? | 14:47 |
| *** mriedem has joined #openstack-infra | 14:47 | |
| AJaeger | yolanda: It's not completely broken ;) Hope somebody else looks in. Enjoy! | 14:47 |
| *** mriedem is now known as mriedem_vaca | 14:48 | |
| anteaya | Thelo: oh you put it in ask | 14:48 |
| anteaya | Thelo: I'm not used to people posting questions to ask and then linking them in channel | 14:48 |
| anteaya | Thelo: what you did is fine and I personally don't know the answer to your question | 14:50 |
| Thelo | ok, thanks anyway | 14:51 |
| anteaya | AJaeger: can we go with a shorter title to your edit? in the menu is is line wrapping: http://docs-draft.openstack.org/43/261743/1/check/gate-infra-manual-docs/b13ace6//doc/build/html/developers.html | 14:51 |
| *** otter768 has joined #openstack-infra | 14:52 | |
| AJaeger | anteaya: we could just use "Caveats"... | 14:53 |
| anteaya | AJaeger: that would work | 14:53 |
| *** markvoelker has joined #openstack-infra | 14:54 | |
| AJaeger | the title is really short, problem is the level... | 14:54 |
| AJaeger | but let me fix the title... | 14:54 |
| anteaya | AJaeger: yes | 14:55 |
| anteaya | yes because I don't think we can do anything about the level | 14:55 |
| AJaeger | anteaya: we can do something about the level - it was at the wrong one ;) Let's move one up | 14:56 |
| openstackgerrit | Anita Kuno proposed openstack-infra/system-config: Edit the logstash pattern for apacheerror https://review.openstack.org/252007 | 14:57 |
| anteaya | well I liked it at the bottom of that section | 14:57 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies https://review.openstack.org/261743 | 14:57 |
| *** otter768 has quit IRC | 14:58 | |
| AJaeger | but not as subsection of Cycles IMHO. | 14:58 |
| *** markvoelker has quit IRC | 14:59 | |
| *** rlandy has joined #openstack-infra | 14:59 | |
| *** tzn has quit IRC | 15:00 | |
| *** salv-orlando has quit IRC | 15:00 | |
| *** tjcocozz has joined #openstack-infra | 15:01 | |
| *** masber has quit IRC | 15:02 | |
| EmilienM | AJaeger: Proxy Error on gerrit, is it wip? | 15:03 |
| AJaeger | EmilienM: it's occasional, reload... | 15:04 |
| mwhahaha | can someone go poke gerrit, i keep getting 502/503s :/ | 15:04 |
| AJaeger | EmilienM: most roots are on vacation... | 15:04 |
| AJaeger | mwhahaha: ^ | 15:04 |
| AJaeger | mwhahaha, EmilienM Sorry, nothing I can do besides acknowledging it. Reload - and let's wait for a root with some time to show up. | 15:05 |
| EmilienM | AJaeger: sure, no probblem, just wanted to know if you solved it :) | 15:05 |
| anteaya | Thelo: the third party meeting is currently underway in #openstack-meeting if you want to join | 15:06 |
| AJaeger | anteaya: this looks better IMHO: http://docs-draft.openstack.org/43/261743/2/check/gate-infra-manual-docs/55bc9ed//doc/build/html/developers.html | 15:06 |
| *** samueldmq1 has quit IRC | 15:06 | |
| anteaya | AJaeger: I'll look after the third party meeting | 15:06 |
| *** bdemers has quit IRC | 15:07 | |
| *** samueldmq1 has joined #openstack-infra | 15:07 | |
| anteaya | I was late starting as I was got distracted | 15:07 |
| *** bdemers has joined #openstack-infra | 15:07 | |
| AJaeger | anteaya: understood... | 15:09 |
| anteaya | thanks | 15:09 |
| *** Qiming has quit IRC | 15:11 | |
| *** dslev has joined #openstack-infra | 15:11 | |
| andreykurilin | AJaeger: hi! | 15:16 |
| anteaya | AJaeger: okay I was in the middle of commenting on patchset 1 so I continued, my comments are posted now | 15:16 |
| andreykurilin | AJaeger: sorry for delay with releasing rally with py26 and thank you for ability to do it:) https://github.com/openstack/rally/blob/0.1.2/doc/release_notes/archive/v0.1.2.rst#thanks | 15:17 |
| AJaeger | andreykurilin: you're welcome, glad to see this resolved | 15:17 |
| AJaeger | anteaya: thanks, will check after having some christmas cookies and tea... | 15:18 |
| *** lezbar has joined #openstack-infra | 15:18 | |
| anteaya | AJaeger: yup, enjoy cookies and tea | 15:18 |
| *** david-lyle has quit IRC | 15:18 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Bump APScheduler to >=3.0 https://review.openstack.org/262017 | 15:19 |
| *** davideagnello has joined #openstack-infra | 15:19 | |
| *** links has joined #openstack-infra | 15:19 | |
| *** lezbar has quit IRC | 15:22 | |
| *** bhunter71 has joined #openstack-infra | 15:22 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: [WIP] Uncap pyzmq requirements https://review.openstack.org/262019 | 15:29 |
| openstackgerrit | Merged openstack-infra/project-config: Use linters job for project-config-example https://review.openstack.org/260711 | 15:29 |
| *** links has quit IRC | 15:30 | |
| *** daemontool has quit IRC | 15:31 | |
| krotscheck | dstufft: Thanks. The more I think all the pieces together though, the more I realize we have to simulate the pip folder structure so that we don't run into the AFS folder limit. | 15:33 |
| krotscheck | (Which is somewhere around 64K, according to jeblair, but that's probably a naive explanation) | 15:33 |
| AJaeger | anteaya: your comment on line 650: " If the test job install packages from PyPI...". Let's say you have a change in python-novaclient that depends-on a change in python-keystoneclient. If a job installs packages from pypi, it will install keystoneclient from pypi and thus the change you want to test is not active. | 15:34 |
| AJaeger | Does that clarify it? | 15:34 |
| anteaya | AJaeger: yes it does, thank you | 15:35 |
| AJaeger | is there a way to word this better? | 15:35 |
| pabelanger | Hmm, this seems new: 2015-12-28 15:24:45.998 | os_client_config.exceptions.OpenStackConfigException: Region fake-region is not a valid region name for cloud envvars. Valid choices are . Please note that region names are case sensitive. | 15:35 |
| anteaya | AJaeger: and while using depends-on lower case in channel is fine as I am your audience and know what you mean, I do favour using Depends-On for the documentation | 15:35 |
| AJaeger | Let me add this as an example... | 15:35 |
| pabelanger | that's in the nodepool gate | 15:35 |
| AJaeger | anteaya: already changed ;) | 15:35 |
| anteaya | AJaeger: I think an example would be a great approach | 15:35 |
| anteaya | AJaeger: thanks :) | 15:36 |
| anteaya | pabelanger: what provider ran that job? | 15:37 |
| *** daemontool has joined #openstack-infra | 15:37 | |
| *** mriedem_vaca has quit IRC | 15:37 | |
| pabelanger | anteaya: hpcloud for that one | 15:38 |
| pabelanger | log ATM: https://jenkins05.openstack.org/job/gate-nodepool-python27/288/consoleFull | 15:38 |
| *** dcentral has quit IRC | 15:39 | |
| pabelanger | don't dive too deep. It could be my patchset | 15:39 |
| pabelanger | testing another to confirm | 15:39 |
| *** Hal has joined #openstack-infra | 15:40 | |
| *** Hal is now known as Guest15096 | 15:40 | |
| *** esker has joined #openstack-infra | 15:41 | |
| anteaya | I had thought you said this was in the gate, it is in the check queue | 15:42 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies https://review.openstack.org/261743 | 15:43 |
| *** maishsk has quit IRC | 15:44 | |
| anteaya | I'm wondering if this is related: AttributeError: 'NoneType' object has no attribute 'db' | 15:44 |
| *** unicell1 has joined #openstack-infra | 15:45 | |
| *** abregman has joined #openstack-infra | 15:46 | |
| *** unicell has quit IRC | 15:46 | |
| *** esker has quit IRC | 15:46 | |
| *** moravec has joined #openstack-infra | 15:48 | |
| anteaya | AJaeger: in 261743 in the first paragraph the first two sentences don't help me, the action picks up on the third sentence | 15:48 |
| anteaya | AJaeger: I don't know what to suggest | 15:49 |
| anteaya | and thanks for the changes, they are clearer to me now | 15:49 |
| *** salv-orlando has joined #openstack-infra | 15:49 | |
| AJaeger | anteaya: please add a comment and let's see what other reviewers say - or whether I have some inspiration later on. | 15:50 |
| AJaeger | thanks, anteaya | 15:50 |
| *** vgridnev has quit IRC | 15:50 | |
| *** dcentral has joined #openstack-infra | 15:50 | |
| anteaya | okay | 15:51 |
| *** rcernin has quit IRC | 15:59 | |
| *** zz_dimtruck is now known as dimtruck | 16:00 | |
| *** esikache1 has quit IRC | 16:01 | |
| *** angdraug has joined #openstack-infra | 16:01 | |
| *** salv-orlando has quit IRC | 16:02 | |
| *** e0ne_ has joined #openstack-infra | 16:03 | |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci: Wire up the new --overcloud-pingtest into the tripleo.sh heredoc https://review.openstack.org/262028 | 16:04 |
| *** e0ne has quit IRC | 16:08 | |
| clarkb | gerrit is spending all of its time garbage collecting. gerrit admins can see this at graphs found under /monitoring | 16:14 |
| clarkb | nodepool tests are broken due to os client config releasr | 16:14 |
| clarkb | I wrote fix for occ but that needs to merge and release too | 16:14 |
| *** david-lyle has joined #openstack-infra | 16:15 | |
| *** lezbar has joined #openstack-infra | 16:18 | |
| *** waynr has quit IRC | 16:20 | |
| *** waynr has joined #openstack-infra | 16:20 | |
| *** lezbar has quit IRC | 16:23 | |
| *** sputnik13 has joined #openstack-infra | 16:24 | |
| *** rcernin has joined #openstack-infra | 16:31 | |
| *** abregman has quit IRC | 16:34 | |
| *** isaacb has joined #openstack-infra | 16:35 | |
| AJaeger | clarkb: thanks for looking into it. What should be done with gerrit? | 16:36 |
| *** daemontool_ has joined #openstack-infra | 16:36 | |
| *** daemontool has quit IRC | 16:37 | |
| isaacb | clarkb: Hi, can you please look in: https://review.openstack.org/#/c/250374/ | 16:38 |
| *** e0ne_ is now known as e0ne | 16:39 | |
| *** moravec has quit IRC | 16:40 | |
| *** tjcocozz has quit IRC | 16:42 | |
| *** esker has joined #openstack-infra | 16:42 | |
| clarkb | AJaeger this is the issue we have been dealing with with restarts, seems more frequent with newer gerrit though so bumping heap size up from 8GB is probably appropriate | 16:43 |
| *** sputnik13 has quit IRC | 16:44 | |
| clarkb | isaacb what is wrong with 15 minute interval? | 16:45 |
| *** moravec has joined #openstack-infra | 16:45 | |
| clarkb | whether or not you have frequent changes thats the time to apply for any change so keeping the number smallish is desireable | 16:46 |
| isaacb | clarkb: You maybe want to apply the changes on request | 16:47 |
| isaacb | clarkb: especially on ci systems that fork the master | 16:47 |
| clarkb | sure but thats independent of any interval | 16:47 |
| *** esker has quit IRC | 16:47 | |
| isaacb | clarckb: In our ci system we apply changes whenever we rebase with upstream | 16:48 |
| clarkb | yes you can do that with the cron in place | 16:49 |
| *** hdd has joined #openstack-infra | 16:49 | |
| *** maishsk has joined #openstack-infra | 16:49 | |
| clarkb | or are ypu saying you only want updates in that case? | 16:49 |
| clarkb | the interval is useful for updating git repos and pip packages | 16:49 |
| *** tzn has joined #openstack-infra | 16:51 | |
| isaacb | clarckb: the 15 min interval is kind of busy waiting in a system that fork the upstream and don't have too many changes | 16:51 |
| *** sshnaidm has quit IRC | 16:52 | |
| clarkb | it isnt, there are updates that are made on that interval | 16:52 |
| clarkb | pip packages and git repos being the common ones | 16:52 |
| mattymo | Sorry if this is an inappropriate channel to ask this question, but can I use gerrit web to cherry pick patchset 1 to another branch (but patchset 2 got merged)? | 16:52 |
| *** bgmccollum has joined #openstack-infra | 16:52 | |
| *** rcernin has quit IRC | 16:53 | |
| *** _nadya_ has quit IRC | 16:53 | |
| isaacb | pip packages and git repoes are updated by run_all.sh script | 16:53 |
| clarkb | isaacb which runs on the interval | 16:53 |
| *** otter768 has joined #openstack-infra | 16:53 | |
| clarkb | (and only runs on your control machine) | 16:54 |
| isaacb | clarckb: you are right. by this review I only reduce conflicts with the upstream on every rebase. | 16:54 |
| *** markvoelker has joined #openstack-infra | 16:55 | |
| *** tzn has quit IRC | 16:55 | |
| isaacb | We rebase the ci system on a weekly basis. No changes are applied in between | 16:55 |
| *** tzn has joined #openstack-infra | 16:55 | |
| isaacb | By using hiera, I can control it without having conflicts on every rebase | 16:56 |
| clarkb | isaacb you dont make changes to your jenkins job config? or nodepool config? or zuul config? | 16:56 |
| clarkb | the 15 minute interval applies those updates even though there are not system-config changes | 16:56 |
| isaacb | Only once a week | 16:57 |
| clarkb | for everything? | 16:57 |
| isaacb | yes. Our CI system checks cinder | 16:57 |
| zaro | morning | 16:57 |
| clarkb | my suggestion would be to not use our puppetmaster config then? | 16:57 |
| isaacb | the infra code is for the ci-system itself. | 16:58 |
| *** otter768 has quit IRC | 16:58 | |
| *** Guest15096 has quit IRC | 16:58 | |
| clarkb | openstack_project is pretty openstack proejct specific | 16:58 |
| clarkb | we eant continuously deployed updates by design | 16:58 |
| pleia2 | good morning | 16:58 |
| isaacb | We tried not to use it, but then we found our not updated for a very long time | 16:59 |
| clarkb | yes because without an interval you get no updates | 16:59 |
| *** markvoelker has quit IRC | 16:59 | |
| *** salv-orl_ has joined #openstack-infra | 16:59 | |
| isaacb | I get all the updates once a week. | 17:00 |
| isaacb | and always stay close to updated system-config | 17:00 |
| timrc | pleia2: Good morning! | 17:01 |
| timrc | zaro: Good morning! | 17:01 |
| clarkb | I have long said that if you want to design and run things differently than upstream those changes dont belong in openstack_project | 17:01 |
| clarkb | its fine to do these things but those chamges need to be in the generic modules | 17:01 |
| clarkb | openstaxk_project is pretty explicitly how we run our system | 17:02 |
| timrc | pabelanger: I'm almost no longer burnt out on computers and would like to figure out what I can help you with grafana/grafyaml. | 17:02 |
| zaro | hmm, interesting adding jeblair as a reviewer shows @hp.com | 17:02 |
| isaacb | this has no impact on the upstream, it just reduce future conflicts | 17:02 |
| clarkb | isaacb the impact is it is a change to code that should not support this | 17:02 |
| clarkb | we arent in a position to ensure that use case continues to work over time | 17:03 |
| isaacb | If you don't add a parameter in your hiera files you don't have any impact on your system. | 17:04 |
| pleia2 | zaro: not sure where, but update in affiliation needed somewhere? | 17:04 |
| *** sdake has joined #openstack-infra | 17:04 | |
| clarkb | until we refactor how we run puppet | 17:04 |
| isaacb | Anyway why the interval is 15 min. Why not to use 10 min? or 1 day? | 17:04 |
| clarkb | so making the interval itself co figurablr I think I would be fine with. | 17:05 |
| clarkb | but boolean flagging the thing out I am not | 17:05 |
| zaro | pleia2: this would be nice for the puppeters, https://review.openstack.org/#/c/260324/ | 17:05 |
| clarkb | since the design is run puppet frequently | 17:05 |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: check that osc plugins do not break openstackclient https://review.openstack.org/261828 | 17:05 |
| clarkb | changing the frequency isnt at odds with that | 17:05 |
| clarkb | disabling it alltogethrr is | 17:06 |
| pleia2 | zaro: ah, nice, having a look | 17:06 |
| clarkb | I have to run, but will be back later today | 17:07 |
| *** esikache1 has joined #openstack-infra | 17:07 | |
| pleia2 | AJaeger: when you have a chance, can you have a look at my assessment on this one? https://review.openstack.org/#/c/261522/ | 17:07 |
| isaacb | ok. thanks. I'll look at it further | 17:07 |
| *** tjcocozz has joined #openstack-infra | 17:08 | |
| pleia2 | zaro: I don't really know anything about CodeMirror, is there a specific version or something we need for puppet support, and do we have it? | 17:10 |
| *** sdake has quit IRC | 17:10 | |
| *** Hal has joined #openstack-infra | 17:10 | |
| *** Hal is now known as Guest30958 | 17:11 | |
| AJaeger | hi pleia2 ! let me check... | 17:11 |
| openstackgerrit | janonymous proposed openstack-dev/hacking: Adding a new check for warn method deprecation. https://review.openstack.org/259729 | 17:11 |
| zaro | pleia2: i believe so and the correct version is already included as a dependency of Gerrit because I've verified that it works on review-dev.o.o, take a look:https://review-dev.openstack.org/#/c/5398/ | 17:12 |
| AJaeger | pleia2: could you check https://review.openstack.org/#/c/260405/ , please? | 17:12 |
| *** tjcocozz has quit IRC | 17:12 | |
| *** sdake has joined #openstack-infra | 17:12 | |
| *** bapalm has joined #openstack-infra | 17:12 | |
| AJaeger | lyz: yeah, that change troubled me a bit as well. I guess it's correct and what they want to do is: Handle stable/8.0 the same as master - and stable/7.0 etc special. | 17:12 |
| pleia2 | AJaeger: thank you, just wanted to make sure I wasn't crazy :) | 17:13 |
| AJaeger | fuel-astute and fuel-agent do the same. | 17:13 |
| pleia2 | AJaeger: nods, since they're "standardizing" all their files, it would be nice for them to standardize doing the right thing | 17:13 |
| AJaeger | But the commit message is not very clear. Let's wait for the owner to comment on the change... | 17:13 |
| pleia2 | AJaeger: agreed | 17:14 |
| *** isaacb has quit IRC | 17:14 | |
| AJaeger | stevemar: regarding https://review.openstack.org/#/c/261828/ - do you want to merge this - or wait and discuss with dhellmann ? | 17:15 |
| pleia2 | zaro: ah good, that is nice syntax highlighting on review-dev, thanks | 17:15 |
| pleia2 | AJaeger: re: 260405, can you stick around to see this land and confirm tests run as expected? | 17:16 |
| pleia2 | skeleton crew today, don't want to break system-config linting all alone ;) | 17:16 |
| *** hdd has quit IRC | 17:16 | |
| stevemar | AJaeger: i'd like to see how it acts in the wild :) and point dhellmann to real logs | 17:16 |
| AJaeger | pleia2: 260405 will only be used if https://review.openstack.org/260420 goes in... | 17:16 |
| openstackgerrit | janonymous proposed openstack-dev/hacking: Put py34 first in the env order of tox https://review.openstack.org/262044 | 17:16 |
| pleia2 | AJaeger: ah! even better | 17:16 |
| pleia2 | AJaeger: approving, and looking at the other one too | 17:17 |
| AJaeger | but I stick around and can revert 260420 if it breaks anything... | 17:17 |
| AJaeger | thanks, pleia2 ! | 17:17 |
| *** e0ne_ has joined #openstack-infra | 17:18 | |
| AJaeger | stevemar: then let me review it again and rate... | 17:20 |
| dhellmann | stevemar , AJaeger : commented | 17:20 |
| stevemar | a wild dhellmann appears | 17:20 |
| *** moravec has quit IRC | 17:20 | |
| AJaeger | stevemar: I wait until you fixed what dhellmann found ;) | 17:21 |
| *** FallenPegasus has joined #openstack-infra | 17:21 | |
| *** devananda has quit IRC | 17:21 | |
| AJaeger | dhellmann: stevemar's comment on patch set 6 was "One small issue is that I think the behaviour changed. Now when I make a conflicting command in a project, and run the script from there, I see the new command override the old one, instead of the expected error message. I may have to pull in dhellmann to see if something in cliff or stevedore changed." | 17:21 |
| *** e0ne has quit IRC | 17:22 | |
| AJaeger | dhellmann: So, we're wondering whether the test still catches the breakage... | 17:22 |
| dhellmann | stevemar , AJaeger : I'm not 100% sure that entry point load order is predictable | 17:22 |
| *** e0ne_ has quit IRC | 17:22 | |
| dhellmann | it might be better to write a script that explicitly checks that there are no duplicates | 17:23 |
| stevemar | dhellmann: If there is another way to catch these conflicting names then i'm all ears | 17:23 |
| stevemar | that was the other idea :( | 17:23 |
| *** FallenPegasus has quit IRC | 17:23 | |
| *** FallenPegasus has joined #openstack-infra | 17:24 | |
| *** [1]Thelo has joined #openstack-infra | 17:24 | |
| *** devananda has joined #openstack-infra | 17:25 | |
| stevemar | dhellmann: regarding install twice, won't it just override with the latest one | 17:25 |
| openstackgerrit | Merged openstack-infra/system-config: Create linters test target https://review.openstack.org/260405 | 17:25 |
| AJaeger | stevemar: your line is duplicated | 17:26 |
| *** morgabra has quit IRC | 17:26 | |
| *** morgabra has joined #openstack-infra | 17:26 | |
| AJaeger | stevemar: line 36 and 37 are the same | 17:26 |
| *** Thelo has quit IRC | 17:26 | |
| *** [1]Thelo is now known as Thelo | 17:26 | |
| dhellmann | stevemar : I think if you use an ExtensionManager it will let you load all of the entry points, and then you can iterate over them and check for duplicate names -- you'll want to do the same name conversion that cliff does to make sure you're comparing commands rather than entry point names | 17:26 |
| stevemar | AJaeger: woops | 17:26 |
| dhellmann | and yeah, what AJaeger said | 17:26 |
| openstackgerrit | Ondřej Nový proposed openstack-dev/hacking: Add a new check for warn method deprecation. https://review.openstack.org/259729 | 17:28 |
| *** vgridnev has joined #openstack-infra | 17:28 | |
| dhellmann | stevemar : if you don't want to write it in python, you might be able to do something with the output of https://pypi.python.org/pypi/entry_point_inspector | 17:28 |
| stevemar | dhellmann: AJaeger alright, i will poke around later tonight and see what i can do, gonna head out now | 17:28 |
| *** bgmccollum has left #openstack-infra | 17:28 | |
| AJaeger | stevemar: Enjoy! | 17:29 |
| openstackgerrit | Ondřej Nový proposed openstack-dev/hacking: Add a new check for warn method deprecation. https://review.openstack.org/259729 | 17:29 |
| *** maishsk has quit IRC | 17:30 | |
| openstackgerrit | Merged openstack-infra/system-config: Test for sorted modules as part of linting https://review.openstack.org/261082 | 17:30 |
| *** tlian has joined #openstack-infra | 17:30 | |
| waynr | stevedore++ | 17:31 |
| waynr | i'm currently using the stevedore ExtensionManager in two different projects to modularize subcommand loading | 17:32 |
| dhellmann | waynr : for a command line program? | 17:32 |
| waynr | yeah | 17:32 |
| dhellmann | have you looked at cliff? | 17:32 |
| salv-orl_ | UK | 17:33 |
| salv-orl_ | }|??_ | 17:33 |
| salv-orl_ | _}|?]_ | 17:33 |
| salv-orl_ | /////////////\\]/\]//////\]////] | 17:33 |
| AJaeger | salv-orl_: what's up? | 17:33 |
| AJaeger | salv-orl_: did you let your kids play with the keyboard? ;) | 17:33 |
| waynr | dhellmann: i did, but it didn't work as well as stevedore+argparse. some of the --help for various subcommands was missing when i tried it | 17:33 |
| salv-orl_ | AJaeger: right ;) | 17:34 |
| dhellmann | waynr : ok. it sounds like you're rebuilding what cliff is trying to do, though, so maybe you just found a bug | 17:34 |
| waynr | dhellmann: https://review.openstack.org/#/c/180252/ | 17:34 |
| *** vgridnev has quit IRC | 17:34 | |
| waynr | this is where the parser is created and extensions loaded: https://review.openstack.org/#/c/180252/8/jenkins_jobs/cli/entry.py | 17:35 |
| waynr | i have a few other commits i worked on in the past few days that rearrange that slightly since the _create_parser method is needed elsewhere | 17:36 |
| dhellmann | waynr : yeah, that all looks a lot like what's already in cliff | 17:36 |
| AJaeger | salv-orl_: I prefer to let them use hangouts to my wife - the smilies and icons are much more interesting - And it's even more random ;) | 17:36 |
| dhellmann | waynr : I'd be curious to see the code that you had with cliff that wasn't doing what you wanted | 17:36 |
| waynr | dhellmann: i took a look at the cliff code and didn't like the way it tried to redo some of argparse's work | 17:36 |
| *** FallenPegasus has quit IRC | 17:37 | |
| * dhellmann shrugs | 17:37 | |
| waynr | dhellmann: can you link me to the cliff bug tracker real quick? i forgot how to find it... | 17:37 |
| dhellmann | I think I did it that way to get multi-word subcommands, but I'm not 100% sure | 17:37 |
| dhellmann | https://launchpad.net/python-cliff | 17:38 |
| *** woodster_ has joined #openstack-infra | 17:39 | |
| waynr | hmm, i thought there was a bug listed there that described the problem i ran into, maybe it was fixed already (this was a few months ago) | 17:40 |
| *** tzn has quit IRC | 17:40 | |
| *** vgridnev has joined #openstack-infra | 17:40 | |
| *** hdd has joined #openstack-infra | 17:41 | |
| *** krtaylor has quit IRC | 17:41 | |
| *** tzn has joined #openstack-infra | 17:41 | |
| *** esker has joined #openstack-infra | 17:43 | |
| *** vgridnev_ has joined #openstack-infra | 17:43 | |
| *** daemontool has joined #openstack-infra | 17:44 | |
| *** vgridnev has quit IRC | 17:45 | |
| waynr | I wonder how difficult it will be to switch tack and use cliff later on | 17:46 |
| openstackgerrit | Ryan Hallisey proposed openstack/diskimage-builder: Building instack is timing out on installing epel https://review.openstack.org/262050 | 17:46 |
| *** daemontool_ has quit IRC | 17:46 | |
| *** rhallisey has quit IRC | 17:48 | |
| *** esker has quit IRC | 17:49 | |
| *** rossella_ has quit IRC | 17:49 | |
| *** ruhe has joined #openstack-infra | 17:49 | |
| openstackgerrit | Ruslan Kamaldinov proposed openstack-infra/project-config: Fix to recover gate-sahara-dashboard-dsvm-integration https://review.openstack.org/262051 | 17:49 |
| *** esikache1 has quit IRC | 17:49 | |
| *** unicell1 has quit IRC | 17:52 | |
| *** krtaylor has joined #openstack-infra | 17:53 | |
| *** moravec has joined #openstack-infra | 17:55 | |
| *** moravec has quit IRC | 17:56 | |
| *** FallenPegasus has joined #openstack-infra | 17:57 | |
| *** FallenPegasus has quit IRC | 17:58 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to configure the Gerrit's sshd.batchThreads option https://review.openstack.org/262053 | 18:00 |
| *** amrith has joined #openstack-infra | 18:02 | |
| *** sabeen has joined #openstack-infra | 18:05 | |
| *** vgridnev_ has quit IRC | 18:07 | |
| *** ashishb has joined #openstack-infra | 18:09 | |
| *** sabeen3 has joined #openstack-infra | 18:09 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to configure the Gerrit's sshd.batchThreads option https://review.openstack.org/262053 | 18:10 |
| openstackgerrit | Ian Cordasco proposed openstack-dev/hacking: Put py34 first in the env order of tox https://review.openstack.org/262044 | 18:11 |
| *** sabeen has quit IRC | 18:12 | |
| *** abregman has joined #openstack-infra | 18:13 | |
| *** dcentral has quit IRC | 18:16 | |
| *** david-lyle_ has joined #openstack-infra | 18:17 | |
| *** Volundr is now known as whoops | 18:18 | |
| *** unicell has joined #openstack-infra | 18:20 | |
| *** e0ne has joined #openstack-infra | 18:22 | |
| *** eil397 has joined #openstack-infra | 18:25 | |
| *** otter768 has joined #openstack-infra | 18:26 | |
| *** dcentral has joined #openstack-infra | 18:28 | |
| *** rhallisey has joined #openstack-infra | 18:28 | |
| *** HeOS has quit IRC | 18:28 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Put non-interactive user ssh requests onto a seperate queue https://review.openstack.org/262058 | 18:35 |
| *** rlandy has quit IRC | 18:35 | |
| *** moravec has joined #openstack-infra | 18:36 | |
| *** rlandy has joined #openstack-infra | 18:37 | |
| *** daemontool has quit IRC | 18:38 | |
| openstackgerrit | Merged openstack-dev/hacking: Put py34 first in the env order of tox https://review.openstack.org/262044 | 18:38 |
| openstackgerrit | Merged openstack-infra/project-config: Use linters for system-config https://review.openstack.org/260420 | 18:39 |
| *** vgridnev has joined #openstack-infra | 18:40 | |
| *** daemontool has joined #openstack-infra | 18:40 | |
| zaro | pleia2: would it be possible for you to provide me with review.o.o cpu & memory specs? | 18:41 |
| *** ashishb has quit IRC | 18:42 | |
| *** claudiub has quit IRC | 18:43 | |
| pleia2 | zaro: need more than cacti shows? | 18:44 |
| *** maishsk has joined #openstack-infra | 18:45 | |
| * zaro looks | 18:45 | |
| *** daemontool has quit IRC | 18:46 | |
| *** ybathia has joined #openstack-infra | 18:50 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove redundant node declarations https://review.openstack.org/260400 | 18:50 |
| *** FallenPegasus has joined #openstack-infra | 18:50 | |
| *** daemontool has joined #openstack-infra | 18:50 | |
| *** vgridnev has quit IRC | 18:50 | |
| *** dims_ has joined #openstack-infra | 18:51 | |
| greghaynes | mordred: https://review.openstack.org/#/c/262062/ for your rubber stamping to fix nodepool (when youre not holidaying) | 18:51 |
| greghaynes | clarkb: ^ you too | 18:52 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/system-config: Remove pep8/bashate targets https://review.openstack.org/260916 | 18:52 |
| *** dims has quit IRC | 18:52 | |
| zaro | pleia2: i see memory stats, but no info on # of VCPUs | 18:52 |
| pleia2 | zaro: /proc/cpuinfo is showing me 8 | 18:53 |
| zaro | thanks | 18:54 |
| *** vgridnev has joined #openstack-infra | 18:54 | |
| zaro | interesting that review cpu is really high today. i guess more peeps working than i though. | 18:56 |
| *** salv-orl_ has quit IRC | 18:56 | |
| *** ildikov has quit IRC | 18:57 | |
| AJaeger | zaro, see clarkb's comment from earlier "gerrit is spending all of its time garbage collecting." | 18:57 |
| AJaeger | he suggested to increase memory usage to 8 GB - not sure whether anybody is on that | 18:58 |
| zaro | ahh, ok. i didn't think it should be so busy :) | 18:59 |
| AJaeger | zaro: We have frequent 502 proxy errors, so something is up ;( | 18:59 |
| dhellmann | waynr : it sounds like your plugin API is going to be different enough that switching later would require work in external plugins | 19:04 |
| zaro | notmorgan: ^ would you know if this is related to this change? https://review.openstack.org/#/c/252054/ | 19:06 |
| notmorgan | zaro: looking | 19:06 |
| zaro | notmorgan: i mean proxy error | 19:06 |
| amrith | anyone on infra-core around, I need a favor and would like to PM if possible. | 19:06 |
| notmorgan | zaro: i don't think the CPU stuff is proxy changes. | 19:06 |
| amrith | tried to pm fungi a while ago but I think he's not around. | 19:07 |
| notmorgan | i'm guessing that java is being cranky | 19:07 |
| zaro | AJaeger, clarkb : will look into upping the memory | 19:07 |
| notmorgan | and the proxy is not properly closing connections when java is stuck in GC | 19:07 |
| notmorgan | zaro: we can tune down timeouts. | 19:08 |
| *** rguillebert has joined #openstack-infra | 19:08 | |
| zaro | notmorgan: thanks, we'll up the memory and see if it goes away. | 19:08 |
| AJaeger | thanks, zaro | 19:08 |
| zaro | notmorgan: which timeouts? | 19:08 |
| notmorgan | zaro: but likely we're blocking [last time this happened] on "sending reply" which means we were likely blocking on gerrit's response | 19:09 |
| notmorgan | zaro: the proxy timeout in apache could be tuned down to drop connections sooner, but i don't think that will really solve this | 19:09 |
| notmorgan | http://httpd.apache.org/docs/2.2/mod/mod_proxy.html#proxytimeout | 19:09 |
| notmorgan | so right now we're waiting. so instead we'd drop the connection | 19:10 |
| notmorgan | we may also want to adjust http://httpd.apache.org/docs/2.2/mod/mod_proxy.html#proxyreceivebuffersize but i'm not convinced it will make a difference | 19:11 |
| notmorgan | zaro: ^ | 19:11 |
| notmorgan | ooh we should turn this on http://httpd.apache.org/docs/2.2/mod/mod_proxy.html#proxystatus | 19:12 |
| zaro | notmorgan: propose something that makes sense? or you can wait for me to try and fix the server so it's more responsive. | 19:12 |
| notmorgan | zaro: so let me propose turning on proxystatus | 19:12 |
| notmorgan | zaro: lets up the ram and then look at the timeouts, i'm thinking 30s is likely a good choice. | 19:13 |
| notmorgan | but... | 19:13 |
| *** tristanC_ is now known as tristanC | 19:13 | |
| notmorgan | memory 1st. | 19:13 |
| zaro | sounds good | 19:13 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/system-config: TESTING: Linters - DO NOT MERGE https://review.openstack.org/262064 | 19:13 |
| AJaeger | pleia2: linters in system-config looks fine but I'm testing now a bit as well ^ | 19:13 |
| pleia2 | AJaeger: thank you! | 19:15 |
| AJaeger | first test failed as expected ;) | 19:15 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/system-config: TESTING: Linters - DO NOT MERGE https://review.openstack.org/262064 | 19:16 |
| notmorgan | zaro: if you can tell what the connections being managed in java in gerrit that would be good. know if we're holding too many connections open. | 19:17 |
| *** anthonyper has quit IRC | 19:17 | |
| notmorgan | not sure how we can find that info out | 19:17 |
| *** anthonyper has joined #openstack-infra | 19:17 | |
| waynr | dhellmann: i think it won't be too difficult to switch to cliff after looking at cliffdemo examples but right now i have at least one requirement that it appears may not be easy with cliff, specifically i want to be able to easily obtain an ArgumentParser object and use it to generate defaults with an empty list of arguments for a given subcommand | 19:17 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/puppet-gerrit: Add proxy status to server-status page https://review.openstack.org/262065 | 19:18 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/puppet-gerrit: WIP -DO NOT MERGE-: ProxyTimeout set to 30s https://review.openstack.org/262066 | 19:18 |
| notmorgan | zaro, corvus, clarkb, mordred, fungi: https://review.openstack.org/#/c/262065/1 useful info added to server-status for gerrit | 19:19 |
| waynr | this requirement is currently necessary for the refactors I am doing in JJB since much of the initialization code for JJB assumes that defaults are set on individual arguments rather than somewhere more generic (like merging arguments into a dictionary of defaults) | 19:19 |
| AJaeger | pleia2: ^ | 19:20 |
| pleia2 | AJaeger: the WIP? | 19:20 |
| AJaeger | pleia2: notmorgan's 262065 ;) | 19:20 |
| AJaeger | sorry | 19:20 |
| notmorgan | pleia2: the other one :) | 19:21 |
| pleia2 | ah, yeah, saw that :) | 19:21 |
| AJaeger | great! | 19:21 |
| *** ociuhandu has quit IRC | 19:21 | |
| *** esker has joined #openstack-infra | 19:22 | |
| *** edmondsw has joined #openstack-infra | 19:22 | |
| *** edmondsw has quit IRC | 19:22 | |
| notmorgan | zaro: also we'll look at http://httpd.apache.org/docs/2.2/mod/mod_proxy.html#proxyiobuffersize | 19:22 |
| notmorgan | zaro: once we're through with the other bits | 19:23 |
| waynr | one of my goals for the JJB refactor is to put all JJB initialization code into either the jenkins_jobs.cli.entry.JenkinsJobs class or jenkins_jobs.config.JJBConfig class, ideally the use of cliff or stevedore+argparse will just be an implementation detail of these two classes | 19:23 |
| *** rlandy has quit IRC | 19:23 | |
| dhellmann | waynr : I'm not sure what you mean about "generate defaults with an empty list of arguments for a given subcommand" | 19:24 |
| *** zul has quit IRC | 19:24 | |
| dhellmann | waynr : each cliff command plugin creates its own ArgumentParser instance, so you can do whatever you want to initialize it. | 19:24 |
| *** moravec has quit IRC | 19:26 | |
| *** esker has quit IRC | 19:27 | |
| *** HeOS has joined #openstack-infra | 19:27 | |
| waynr | dhellmann: in https://review.openstack.org/#/c/180252/8/jenkins_jobs/cli/entry.py JenkinsJobs._create_parser will create an ArgumentParser, all I have to do is call .parse_args([test]) for example to get an argparse Namespace object that has all the defaults specified in both the 'test' subcommand and the supercommand parsers | 19:28 |
| waynr | but like i mentioned earlier that code is different in the latest commit (which isn't ready to submit for review yet) | 19:28 |
| *** rlandy has joined #openstack-infra | 19:29 | |
| dhellmann | oh, so you want to pull the defaults from the parser rather than pushing them into the parser? | 19:29 |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added new repo for fuel-plugin-onosfw in Openstack NS https://review.openstack.org/261966 | 19:30 |
| waynr | yeah, but it's more like i have to pull the defaults from the parser since that's how JJB initialization code is currently written (initialization code for that revision of the code is in https://review.openstack.org/#/c/180252/8/jenkins_jobs/cmd.py starting at line 114) | 19:31 |
| *** _nadya_ has joined #openstack-infra | 19:31 | |
| waynr | in my current work I have begun consolidating initialization code from that function (and from other places throughout JJB where the ConfigParser object is accessed directly) into a "JJBConfig" class | 19:32 |
| dhellmann | got it | 19:33 |
| *** tswanson_ has quit IRC | 19:33 | |
| dhellmann | I guess the problem is there isn't just one argument parser in cliff, so you'll need to get any global options from the app and then any command options from the command's parser | 19:34 |
| dhellmann | it wouldn't take a lot of work to get the objects you need, I think, but it hasn't been a requirement up to this point | 19:34 |
| waynr | yeah for now it's simpler for me to just continue with the approach i've taken so far, but I think once it's easier to refactor implementation details of JJB's initialization code it would be a good idea to use cliff since JJB is ultimately an openstack project and it seems like cliff is aimed at making command line interfaces more consistent across openstack projects | 19:36 |
| dhellmann | yeah, the wheel you need isn't shaped all that differently from the one we have, so we ought to be able to make it work :-) | 19:37 |
| *** dstanek has quit IRC | 19:42 | |
| waynr | cool | 19:43 |
| *** AJaeger has quit IRC | 19:43 | |
| *** setuid has quit IRC | 19:43 | |
| *** setuid has joined #openstack-infra | 19:45 | |
| *** FallenPegasus has quit IRC | 19:46 | |
| *** FallenPegasus has joined #openstack-infra | 19:47 | |
| *** david-lyle_ has quit IRC | 19:48 | |
| *** dstanek has joined #openstack-infra | 19:49 | |
| *** FallenPegasus has quit IRC | 19:52 | |
| *** Guest30958 has quit IRC | 19:54 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Allocate more java memory for Gerrit https://review.openstack.org/262068 | 19:55 |
| zaro | clarkb: ^ | 19:55 |
| *** david-lyle has quit IRC | 19:56 | |
| *** david-lyle has joined #openstack-infra | 20:02 | |
| *** bdemers has left #openstack-infra | 20:04 | |
| *** hamzy is now known as hamzy_vacay | 20:08 | |
| *** abregman has quit IRC | 20:09 | |
| *** ociuhandu has joined #openstack-infra | 20:10 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Allow java to allocate more memory for Gerrit https://review.openstack.org/262068 | 20:15 |
| *** gampel1 has quit IRC | 20:15 | |
| *** markmcclain has quit IRC | 20:17 | |
| *** hdd has quit IRC | 20:18 | |
| *** markmcclain has joined #openstack-infra | 20:18 | |
| *** _nadya_ has quit IRC | 20:20 | |
| *** hdd has joined #openstack-infra | 20:21 | |
| anteaya | zaro: I clicked you link from your commit message: http://ctf-dev-environment-vagrant.s3.amazonaws.com/ I get an xml doc tree without style telling me Access Denied | 20:22 |
| anteaya | your* | 20:22 |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to configure the Gerrit's garbage collection options https://review.openstack.org/262072 | 20:22 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Allow java to allocate more memory for Gerrit https://review.openstack.org/262068 | 20:23 |
| zaro | anteaya: ^ please try again? | 20:23 |
| *** esikache1 has joined #openstack-infra | 20:24 | |
| timrc | Oh nice a 503 from review.o.o | 20:24 |
| timrc | Was intermittent at least. | 20:24 |
| timrc | Oh gosh, this is my first time reviewing in the web app since it got upgraded. Much confusion. | 20:25 |
| anteaya | yup | 20:25 |
| zaro | timrc: we've noticed the 503, looking at some possible tuning to get gerrit working better | 20:26 |
| anteaya | zaro: oh look a link to a gerrit cheat sheet pdf, how wonderful | 20:26 |
| * timrc sticks with gertty | 20:27 | |
| *** hdd has quit IRC | 20:27 | |
| openstackgerrit | Kirill Zaitsev proposed openstack-infra/project-config: Add translation jobs to murano-dashboard https://review.openstack.org/262073 | 20:30 |
| anteaya | zaro: the last item on page one, repository size, seems to be making a connection between number of repositories and time spent in garbage collection | 20:30 |
| zaro | anteaya: yes, i'm going to configure the gc interval now. so maybe that will help the garbage collector not get stuck. | 20:31 |
| *** e0ne has quit IRC | 20:31 | |
| anteaya | zaro: okey dokey | 20:32 |
| *** bdemers has joined #openstack-infra | 20:34 | |
| *** david-lyle has quit IRC | 20:36 | |
| * anteaya advocates for getting statusbot in #openstack-meeting-cp by waving https://review.openstack.org/#/c/249984/ around | 20:37 | |
| *** angdraug has quit IRC | 20:37 | |
| * pleia2 has a look | 20:38 | |
| pleia2 | between gerrit slowness and my own home internet being wobbly, it's been quite a day over here | 20:38 |
| anteaya | pleia2: :( | 20:38 |
| anteaya | and thanks for looking | 20:39 |
| *** kzaitsev_mb has joined #openstack-infra | 20:39 | |
| openstackgerrit | Kirill Zaitsev proposed openstack-infra/project-config: Add translation jobs to murano-dashboard https://review.openstack.org/262073 | 20:41 |
| *** sdake has quit IRC | 20:48 | |
| *** rcernin has joined #openstack-infra | 20:49 | |
| *** bdemers has quit IRC | 20:52 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Schedule Gerrit's git garbage collection https://review.openstack.org/262075 | 21:00 |
| zaro | clarkb, pleia2, anteaya ^ this may help the garbage collection issue that's making gerrit slow | 21:00 |
| *** salv-orlando has joined #openstack-infra | 21:00 | |
| *** bdemers has joined #openstack-infra | 21:01 | |
| zaro | that and the memory bump. | 21:01 |
| *** maishsk has quit IRC | 21:02 | |
| *** esikache1 has quit IRC | 21:03 | |
| anteaya | zaro: is 4:30 04:30 utc? | 21:06 |
| zaro | it is if review.o.o timezone is set to utc which it should be. | 21:08 |
| *** amrith is now known as _amrith_ | 21:09 | |
| zaro | anteaya: it's scheduled in conjuction with these: https://git.openstack.org/cgit/openstack-infra/puppet-gerrit/tree/manifests/cron.pp | 21:09 |
| anteaya | zaro: great thanks | 21:12 |
| *** e0ne has joined #openstack-infra | 21:13 | |
| *** maishsk has joined #openstack-infra | 21:17 | |
| *** _nadya_ has joined #openstack-infra | 21:20 | |
| *** FallenPegasus has joined #openstack-infra | 21:21 | |
| *** esker has joined #openstack-infra | 21:24 | |
| *** vgridnev has quit IRC | 21:24 | |
| *** _nadya_ has quit IRC | 21:25 | |
| *** vgridnev has joined #openstack-infra | 21:25 | |
| *** daemontool has quit IRC | 21:26 | |
| *** kzaitsev_mb has quit IRC | 21:27 | |
| *** esker has quit IRC | 21:29 | |
| *** david-lyle has joined #openstack-infra | 21:31 | |
| *** kzaitsev_mb has joined #openstack-infra | 21:34 | |
| pleia2 | ah, nice email from ajaeger about translations (saw related review on the meeting agenda, good to have background) | 21:38 |
| *** bdemers has quit IRC | 21:39 | |
| jhesketh | Morning | 21:44 |
| pleia2 | morning jhesketh | 21:47 |
| jhesketh | o/ | 21:47 |
| zaro | jhesketh: morning! | 21:47 |
| zaro | jhesketh, pleia2 : should we try to fixing gerrit? | 21:48 |
| jhesketh | zaro: what's wrong with it? | 21:49 |
| * jhesketh has been away | 21:49 | |
| pleia2 | zaro: it's running slowly, but I'm not hugely comfortable with making big changes that we haven't tested since I can't do much to fix things if Things Go Wrong | 21:49 |
| pleia2 | jhesketh: high cpu usage that we think is linked to garbage collection, proxy errors and related slowness in the webui | 21:50 |
| zaro | well. we can restart to get it working normally again. until it starts to slow again. | 21:50 |
| pleia2 | load average has gone down a bit | 21:51 |
| pleia2 | zaro: wasn't it restarted a few hours ago? | 21:51 |
| zaro | not that i'm aware of | 21:51 |
| pleia2 | ah, maybe just apache | 21:51 |
| *** moravec has joined #openstack-infra | 21:52 | |
| pleia2 | yeah, just apache (saw when I loaded up the server-status page) | 21:52 |
| jhesketh | How long has it been slow for? | 21:52 |
| pleia2 | AJaeger reported proxy errors yesterday, load's been higher just today http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=26&rra_id=all | 21:53 |
| zaro | cacti seems to indicate that it's slowness started today, but you can probably tell better looking at review.o.o javamelody graphs | 21:54 |
| pleia2 | those are the ones at /monitoring (I think just for admins) | 21:56 |
| zaro | jhesketh: i've added changes to maybe fix the slownes issue, https://review.openstack.org/262075 and https://review.openstack.org/262068 but we don't have to apply today. | 21:56 |
| zaro | pleia2: yes, it should be at review.o.o/monitoring | 21:57 |
| pleia2 | zaro: Java memory used: 6,196 Mb / 7,997 Mb | 21:57 |
| pleia2 | so I'm not sure increasing it to 12 will help | 21:57 |
| pleia2 | unless it's doing something to reserve memory (or we're just not hitting the max right now for some reason, and did earlier) | 21:58 |
| zaro | pleia2: i'm guessing your correct. i think the garbage collection change might help more. if indeed what clarkb says is true | 21:59 |
| *** e0ne has quit IRC | 21:59 | |
| zaro | but memory change wouldn't hurt either. | 22:00 |
| pleia2 | yeah, the server does seem to have enough free that we could probably give java a bit more if we think it would help | 22:01 |
| notmorgan | pleia2: can you snag me a snapshot of the server-status if it starts to slow down again | 22:01 |
| notmorgan | since i can't see it externally (needs to come from infra-root) | 22:01 |
| pleia2 | notmorgan: indeed, I loaded it up in links via ssh | 22:02 |
| notmorgan | pleia2: ++ | 22:02 |
| notmorgan | and the proxy-timeout might also help so we don't stack connections up | 22:02 |
| notmorgan | as much | 22:02 |
| notmorgan | but, that one is a bit more iffy on a holiday-ish time to add | 22:02 |
| notmorgan | once we have real info on the slowness i can also look at tuning the buffers for mod_proxy if needed | 22:03 |
| * notmorgan is guessing it's acombo of GC + connection stacking | 22:03 | |
| pleia2 | unfortunately I'm not hugely familiar with what the *normal* details of this javamelody status page are so it's really hard for me to pinpoint problems (I'll make myself familiar after today, though!) | 22:06 |
| *** masber has joined #openstack-infra | 22:09 | |
| *** vgridnev has quit IRC | 22:09 | |
| notmorgan | pleia2: yeah | 22:09 |
| *** moravec has quit IRC | 22:14 | |
| *** e0ne has joined #openstack-infra | 22:20 | |
| *** rvasilets___ has joined #openstack-infra | 22:27 | |
| *** e0ne has quit IRC | 22:27 | |
| *** salv-orlando has quit IRC | 22:28 | |
| jhesketh | pleia2: do you know when gerrit was last restarted? | 22:33 |
| jhesketh | we had similar issues with the older gerrit that we were hoping would be resolved in the upgrade | 22:34 |
| pleia2 | jhesketh: dec 22 | 22:34 |
| jhesketh | but restarting gerrit periodically helped with that | 22:34 |
| *** dkranz has quit IRC | 22:35 | |
| pleia2 | I was sick that day though, not sure why it was done then | 22:35 |
| *** dkranz has joined #openstack-infra | 22:35 | |
| *** bharathm has joined #openstack-infra | 22:37 | |
| *** sdake has joined #openstack-infra | 22:39 | |
| *** dkranz has quit IRC | 22:40 | |
| jhesketh | maybe we should just give it a restart for now to allow more time to review/discuss zaro's tuning | 22:40 |
| *** dkranz has joined #openstack-infra | 22:41 | |
| clarkb | pleia2 gc tike should be <1% | 22:41 |
| clarkb | *time | 22:41 |
| clarkb | melody was saying it was over 10% | 22:42 |
| pleia2 | clarkb: where was that? I couldn't find anything about garbage collection (aside from a link to run it) | 22:43 |
| *** bharathm has quit IRC | 22:43 | |
| clarkb | pleia2 in the more graphs dropdown thing | 22:43 |
| pleia2 | and time it took, I think | 22:43 |
| pleia2 | ah, there it is, more charts | 22:45 |
| pleia2 | it's around 7 now, but has been high all day and usually isn't | 22:45 |
| clarkb | it does that when it needs more memory than is available | 22:47 |
| clarkb | because garbage collector must collect in order to allocate memory | 22:47 |
| clarkb | I dont know that the git gcing is related this is all jvm | 22:47 |
| pleia2 | and yet we're not using all the memory given to java | 22:48 |
| pleia2 | then again, I don't know how java uses memory, maybe it's maxxed out on some secret memory | 22:49 |
| *** bexelbie has quit IRC | 22:50 | |
| clarkb | its possiblen it needs a ton whenwver someone pushes to nocva too | 22:50 |
| clarkb | and so spikes | 22:51 |
| *** rcernin has quit IRC | 22:54 | |
| *** kzaitsev1mb has joined #openstack-infra | 22:54 | |
| *** masber has quit IRC | 22:55 | |
| *** kzaitsev_mb has quit IRC | 22:57 | |
| zaro | clarkb: why do you think gc won't help? | 22:59 |
| clarkb | because git gcis unrelated to jvm gc | 23:01 |
| *** masber has joined #openstack-infra | 23:01 | |
| zaro | my theory is that the infrequency of the gc requires the jvm to do more work/memory by the jvm. if we increase the frequency then it will reduce the workload | 23:02 |
| *** tzn has quit IRC | 23:03 | |
| zaro | clarkb: hmm, maybe i'm reading it incorrectly. i thought gerrit-gc was doing both. | 23:03 |
| clarkb | I think gerrit gc is just git gc | 23:04 |
| clarkb | of the repos on disk | 23:04 |
| bkero | That can be pretty heavy | 23:06 |
| bkero | especially if it's doing --aggressive and are pruning | 23:06 |
| *** tzn has joined #openstack-infra | 23:09 | |
| *** tzn has quit IRC | 23:12 | |
| *** dslev has quit IRC | 23:14 | |
| *** tzn has joined #openstack-infra | 23:18 | |
| *** kzaitsev1mb has quit IRC | 23:18 | |
| *** tzn has quit IRC | 23:23 | |
| zaro | clarkb: looks like you are correct. so the slowness is isolated to jvm gc then? | 23:25 |
| *** esker has joined #openstack-infra | 23:27 | |
| *** david-lyle has quit IRC | 23:28 | |
| *** bhunter71 has quit IRC | 23:30 | |
| *** masber has quit IRC | 23:31 | |
| *** esker has quit IRC | 23:31 | |
| *** masber has joined #openstack-infra | 23:32 | |
| *** david-lyle has joined #openstack-infra | 23:33 | |
| *** masber has quit IRC | 23:35 | |
| zaro | clarkb: there's some tuning info here that might help, https://groups.google.com/d/msg/repo-discuss/VQbVFmZKWUE/LegaisjT4KAJ but seems to indicate that we need more memory? | 23:36 |
| *** woodster_ has quit IRC | 23:36 | |
| *** Qiming has joined #openstack-infra | 23:39 | |
| *** angdraug has joined #openstack-infra | 23:39 | |
| pleia2 | zaro: hm, yeah, it does that way | 23:39 |
| *** masber has joined #openstack-infra | 23:40 | |
| *** dims has joined #openstack-infra | 23:48 | |
| *** dims_ has quit IRC | 23:49 | |
| *** jaypipes has quit IRC | 23:51 | |
| *** ybathia has quit IRC | 23:52 | |
| *** Hal has joined #openstack-infra | 23:53 | |
| *** Hal is now known as Guest73518 | 23:53 | |
| *** Daisy has joined #openstack-infra | 23:58 | |
| *** rfolco has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!