14:00:14 <jaosorior> #startmeeting tripleo
14:00:15 <openstack> Meeting started Tue Oct  9 14:00:14 2018 UTC and is due to finish in 60 minutes.  The chair is jaosorior. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:00:16 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
14:00:18 <openstack> The meeting name has been set to 'tripleo'
14:00:33 <jaosorior> #topic agenda
14:00:35 <jaosorior> * Review past action items
14:00:37 <jaosorior> * One off agenda items
14:00:39 <jaosorior> * Squad status
14:00:41 <jaosorior> * Bugs & Blueprints
14:00:43 <jaosorior> * Projects releases or stable backports
14:00:45 <jaosorior> * Specs
14:00:47 <jaosorior> * open discussion
14:00:49 <jaosorior> Anyone can use the #link, #action and #info commands, not just the moderatorǃ
14:00:51 <jaosorior> Hey folks! who's around?
14:00:53 <Tengu> \o/
14:01:04 <mwhahaha> hi2u
14:01:11 <beagles> o/
14:01:11 <quiquell> o/
14:01:12 <marios|rover> o/
14:01:23 <asbishop> o/
14:01:28 <jbadiapa> o/
14:01:40 <ksambor> o/
14:01:49 <dpeacock> o7
14:01:56 <Tengu> :]
14:02:33 <jtomasek> o/
14:02:47 <owalsh> o/
14:03:10 <jaosorior> \o
14:03:24 <jaosorior> #topic review past action items
14:03:28 <matbu> o/
14:03:32 <jaosorior> None.
14:03:37 <chem`> o/
14:03:43 <jaosorior> #topic one off agenda items
14:03:45 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-meeting-items
14:03:47 <naturalblue> if trying to import overcloud nodes using manual power management should I use fake, fake_pxe or manual-management. I have tried to get my server imported using ipmi but i keep getting an error "No valid host was found. Reason: No conductor service registered which supports driver....". this has happened with fake, fake_pxe, ipmi, ipmitool. Nothing seems to working. I have tried configuring the enabe_drivers and
14:03:47 <naturalblue> enable_hardware_types in ironic.conf as well as adding the m to undercloud.conf and re-running openstack undercloud install still i am getting nowhere
14:04:31 <jaosorior> Not sure if this would go in this topic... or open discussion. But, I won't be around next week (PTO). Can someone take over this meeting just for next week?
14:04:33 <naturalblue> has anyone any ideas, I can tell the ype of server if needed. i ahve set the BMC ip, username and password for the server
14:05:23 <mwhahaha> yea i can run it
14:05:29 <d0ugal> o/
14:05:30 <jaosorior> thanks mwhahaha!
14:06:44 <jaosorior> naturalblue: can you wait until after the weekly meeting? (there is also a section on Open discussion if you want to bring your issue there).
14:07:12 <naturalblue> which channel is open discussion
14:07:19 <jaosorior> naturalblue: This channel, just gotta wait
14:07:32 <jaosorior> And folks, the weekly reminder:      CI Community Meeting starts immediately upon this meeting closing in #oooq. This is our team's weekly "open office hours." All are welcome!  Ask/discuss anything, we don't bite. Agenda (add items freely) --> https://etherpad.openstack.org/p/tripleo-ci-squad-meeting.
14:07:36 <naturalblue> ok, when is the meeting, is it right now :s
14:07:46 <jaosorior> naturalblue: yes.
14:07:59 <naturalblue> ok sorry. i ddint know, please proceed
14:08:05 <jaosorior> #topic Squad status
14:08:07 <jaosorior> ci
14:08:09 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting
14:08:11 <jaosorior> upgrade
14:08:13 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status
14:08:15 <jaosorior> containers
14:08:17 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-containers-squad-status
14:08:19 <jaosorior> integration
14:08:21 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-integration-squad-status
14:08:23 <jaosorior> ui/cli
14:08:25 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status
14:08:27 <jaosorior> validations
14:08:29 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-validations-squad-status
14:08:31 <jaosorior> networking
14:08:33 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-networking-squad-status
14:08:35 <jaosorior> workflows
14:08:37 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-workflows-squad-status
14:08:39 <jaosorior> security
14:08:41 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-security-squad
14:08:43 <jaosorior> edge
14:08:45 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-edge-squad-status
14:08:47 <jaosorior> Anything the squads would like to bring up to the general community?
14:09:15 <Tengu> jaosorior: some work about the validation framework?
14:09:35 <jaosorior> Tengu: sure
14:09:43 <Tengu> jaosorior: we can expect near to 0 job on  that field until milestone 2, as there are a lot of more important things to do.
14:10:08 <Tengu> so basically we will validate the things we want to see in the tech-prev for that framework, and once we get some time, bam, dev.
14:10:15 <ooolpbot> URGENT TRIPLEO TASKS NEED ATTENTION
14:10:16 <ooolpbot> https://bugs.launchpad.net/tripleo/+bug/1796710
14:10:17 <ooolpbot> https://bugs.launchpad.net/tripleo/+bug/1796756
14:10:17 <ooolpbot> https://bugs.launchpad.net/tripleo/+bug/1796764
14:10:17 <openstack> Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged]
14:10:18 <openstack> Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,Triaged]
14:10:19 <Tengu> one thing though: it is decided to go with ansible-runner
14:10:20 <openstack> Launchpad bug 1796764 in tripleo "undercloud install failing for containers-multinode in the gate "OperationalError: (sqlite3.OperationalError) database is locked "" [Critical,Triaged]
14:10:37 <Tengu> this might be an important thing to note, as it will require some refactoring in tripleo_common.
14:10:52 <Tengu> so yeah. basically, that's it for now :).
14:11:01 <jaosorior> Tengu: thanks for the update
14:11:02 <Tengu> #link https://trello.com/b/x3h5FrnX/validation-framework
14:11:10 <Tengu> if you guys want to follow and have a look.
14:12:36 <jaosorior> ack, checking it out
14:12:43 <jaosorior> Any other squad wanting to bring up updates?
14:14:39 <jaosorior> #topic bugs & blueprints
14:14:41 <jaosorior> #link https://launchpad.net/tripleo/+milestone/stein-1
14:14:44 <jaosorior> For Stein we currently have 31 blueprints open in Launchpad.
14:14:46 <jaosorior> Bugs: 763 (-15) stein-1.  102 (0) open Storyboard bugs.
14:14:46 <openstack> bug 763 in zope2.7 (Ubuntu) "Something wrong on mkzope2.7instance" [Medium,Invalid] https://launchpad.net/bugs/763
14:14:47 <jaosorior> #link https://storyboard.openstack.org/#!/project_group/76
14:16:41 <jaosorior> #topic projects releases or stable backports
14:16:54 <mwhahaha> we released the rocky ga last week
14:17:00 <mwhahaha> to the unhappiness of the upgrade jobs in master
14:17:13 <mwhahaha> we've also done an initial tagging for stein to bump the version numbers
14:17:30 <mwhahaha> EmilienM is visiting the land of Brno so we'll probably do a stable release next week as needed
14:18:08 <mwhahaha> that is all unless folks have specific needs
14:19:17 <jaosorior> ack, thanks mwhahaha
14:20:07 <jaosorior> #topic specs
14:20:09 <jaosorior> #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open
14:21:15 <jaosorior> zzzeek_: could you revisit your zzzeek_ to address the comment there https://review.openstack.org/#/c/600555/ ? after that we can merge it
14:23:03 <jaosorior> #topic open discussion
14:23:14 <jaosorior> Anything else that folks want to bring up to the meeting?
14:23:38 <Tengu> just a small news regarding podman: we're about to get a working "standalone" deploy with selinux :D
14:23:52 <jaosorior> wooo! :D
14:23:59 <Tengu> last patch is in the Gate.
14:24:26 <jaosorior> Tengu: have you taken a look at the custom capabilities to limit the containers that are currently set as privileged?
14:24:51 <Tengu> jaosorior: yeah, in a really quick way. Did not work on that part for now.
14:25:01 <jaosorior> just curiosity
14:25:13 <Tengu> that's the next step I think. Dropping "privileged" is a must.
14:27:01 <zzzeek_> jaosorior: will do later today
14:27:31 <jaosorior> zzzeek_: thanks
14:29:39 <weshay> jaosorior, we have a number of layered bugs on ovb deployments
14:30:19 <jaosorior> weshay: I was aware of the TLS-related bug
14:30:24 <weshay> https://review.openstack.org/#/c/608589/ will help but still seeing deployment failures
14:30:42 <jaosorior> weshay: that timed out.
14:31:13 <marios|rover> jaosorior: yes that is one issue... latest isssues/status tracked in https://review.rdoproject.org/etherpad/p/ruckrover-sprint20 we are alerting in chan for those top 3 for example (these aren't ovb related, these are for check/gate)
14:31:16 <weshay> just fyi.. we have a number of tripleo, ironic, heat bugs we're looking at w/ ovb jobs atm
14:31:39 <weshay> we could use some help in diagnosis
14:32:05 <mwhahaha> weshay: it looks like we need to disable ara as it's running into multi threading issues with the container prep stuff
14:32:32 <marios|rover> jaosorior: in particular     https://bugs.launchpad.net/tripleo/+bug/1796764   https://bugs.launchpad.net/tripleo/+bug/1796710     the patch is affected by mirror/network issues: https://bugs.launchpad.net/tripleo/+bug/1796849
14:32:32 <openstack> Launchpad bug 1796764 in tripleo "undercloud install failing for containers-multinode in the gate "OperationalError: (sqlite3.OperationalError) database is locked "" [Critical,Triaged]
14:32:34 <openstack> Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged]
14:32:35 <openstack> Launchpad bug 1796849 in tripleo "Mirror/network issues at mirror.us-west-1.packethost.openstack.org" [Undecided,New]
14:32:54 <marios|rover> jaosorior: sorry for spam i wont post the rest they are in that status etherpad thanks
14:33:07 <jaosorior> marios|rover, weshay: thanks for bringing it up
14:33:10 * jaosorior reading
14:33:20 <mwhahaha> i think the solution for 1796764 is to disable ara for now
14:33:38 <marios|rover> mwhahaha: if you're referring to https://bugs.launchpad.net/tripleo/+bug/1796764 yeah i was looking into it. i thought perhaps https://review.openstack.org/#/c/604664/ related but not sure still
14:33:38 <openstack> Launchpad bug 1796764 in tripleo "undercloud install failing for containers-multinode in the gate "OperationalError: (sqlite3.OperationalError) database is locked "" [Critical,Triaged]
14:34:16 <weshay> mwhahaha, ya.. marios|rover is looking at that now
14:34:17 <mwhahaha> marios|rover: no it's a concurrency problem with out image prepare because it launches multiple ansible playbooks which is causing problems with ara
14:34:24 <mwhahaha> s/out/our
14:34:39 <marios|rover> mwhahaha: ack thanks maybe join community call in a minute if you can?
14:34:40 <weshay> I'm fine w/ turning it off until we fix
14:34:49 <mwhahaha> yea
14:35:19 * weshay finds patch
14:35:40 <weshay> https://review.openstack.org/#/c/606986/
14:36:06 <marios|rover> weshay: heh did you see into the future and post the patch one week ago !
14:36:40 <mwhahaha> we likely need to turn it off every where
14:36:43 <mwhahaha> but we can chat
14:36:45 <weshay> marios|rover, I have powers
14:37:10 <jaosorior> well that was quick :O
14:37:18 <ajo> have you folks experienced this with standalone? https://paste.fedoraproject.org/paste/99N2WnuJ2t2U6qbWVghx2Q
14:37:23 <marios|rover> before it started, like 1 week ago you might say jaosorior
14:38:01 <mwhahaha> ajo: is this under python3?
14:38:14 <marios|rover> not somethign ive seen in ci fwiw ajo
14:38:15 <ajo> mwhahaha: I think it's python2
14:38:24 <ajo> marios|rover: I specified neutron_driver: ovn
14:38:29 <ajo> I can retry with "null"
14:38:29 <weshay> marios|rover, https://bluejeans.com/4113567798
14:38:35 <weshay> mwhahaha, https://bluejeans.com/4113567798
14:38:42 <ajo> but seems like downloading the playbooks or something
14:38:44 * ajo looks at the code
14:38:54 <marios|rover> weshay: you changed the number? (was folcos in the invite)
14:39:03 <mwhahaha> ajo: would be helpful to have the full traceback but it seems like an issue with a character somewhere
14:39:06 <weshay> marios|rover, he's not here, and we need moderator
14:39:08 <jaosorior> I'll end the meeting so folks can join the CI meeting if needed
14:39:17 <jaosorior> Thanks for joining folks!
14:39:21 <jaosorior> #endmeeting'