Tuesday, 2018-09-11

*** jangutter_ has joined #softwarefactory00:01
*** jangutter has quit IRC00:01
*** jangutter_ has quit IRC00:04
*** jangutter has joined #softwarefactory00:12
*** jangutter has quit IRC00:22
*** jangutter has joined #softwarefactory00:22
*** jangutter has quit IRC00:27
*** sfbender has quit IRC02:18
*** jangutter has joined #softwarefactory03:09
*** jangutter has quit IRC07:38
*** jangutter has joined #softwarefactory07:38
*** jpena|off is now known as jpena07:39
*** jangutter has quit IRC07:42
tristanCmatburt: here is a wip demo of a job deploying openshift and an awx-install job to verify it install on openshift https://github.com/ansible/zuul-jobs/pull/6/files08:46
tristanCdmsimard: ^08:46
*** sfbender has joined #softwarefactory10:00
sfbenderMerged logreduce master: react: fix typo and add build time  https://softwarefactory-project.io/r/1358010:00
sfbenderMerged software-factory/sfinfo master: Remove old packages  https://softwarefactory-project.io/r/1188510:13
tristanCmatburt: dmsimard: here you go, the job last task was to list available roles: https://ansible.softwarefactory-project.io/logs/6/6/c783dc05e3f9e17602c78fe90ed871588947a55a/check/openshift-awx-install/1c3f63b/ara-report/10:16
sfbenderMerged software-factory/sf-docs master: slightly improve the secret section  https://softwarefactory-project.io/r/1333210:17
sfbenderMerged software-factory/sfinfo master: Remove uwsgi from sf-master sfinfo  https://softwarefactory-project.io/r/1134210:57
*** jpena is now known as jpena|lunch11:25
dmsimardtristanC: very helpful, thanks!11:47
*** jangutter has joined #softwarefactory11:50
*** jpena|lunch is now known as jpena12:28
sfbenderMerged software-factory/managesf master: bind: add logging statement to the controller  https://softwarefactory-project.io/r/1274313:03
*** jangutter has quit IRC13:27
*** jangutter has joined #softwarefactory13:34
*** jangutter has quit IRC13:35
*** jangutter has joined #softwarefactory13:35
*** jangutter has quit IRC13:40
*** jangutter has joined #softwarefactory13:44
*** jangutter has quit IRC13:48
pabelangermhu: nhicher: fbo: is there an outage in RDO cloud?13:51
pabelangerhttps://softwarefactory-project.io/grafana/d/000000005/nodepool-status?orgId=1&from=now-1h&to=now&refresh=5s13:51
pabelangeris showing launch errors for nodepool13:51
mhupabelanger, the outage mails come and go, they all look the same now ... brb let me check when was the last one13:52
mhupabelanger, yeah we got a notification about 6 hours ago, no resolution yet13:53
mhualthough the internal semaphore is all greem13:54
mhugreen13:54
pabelangerokay, let me try a node in vexxhost13:55
pabelangermhu: is it possible to echo the outages here too? cc gundalow13:56
fbopabelanger: some minutes ago issues were reported to rhos-ops14:19
pabelangerthanks14:21
jruzickatristanC, heya! gertty is completely awesome, thanks again for that. Comments on the blog would be nice, I think there is a US and ongoing research on that but I got one more crazy idea14:24
jruzickatristanC, sf could generate gertty config for it's config so you could copy it like API key...14:25
jruzickaprobably at least GERTTY_HOME would need an input field, but you could generate .gertty.yaml with all fields filled. It would should relevant servers: section and offer to download full .gertty.yaml file.14:30
jruzickawe're supposed to support best practices, right? :)14:30
*** jangutter has joined #softwarefactory14:41
*** jangutter has joined #softwarefactory14:41
matburttristanC: sorry I haven't been able to catch up so far this week... we have a big release going this week and there's a hurricane bearing down on North Carolina. I'll drop you an email later today.14:56
sfbenderMerged rdopkg master: meta: update setup.cfg summary  https://softwarefactory-project.io/r/1341715:06
tristanCjruzicka: glad you like it, it really improves review workflow... and having a 'download .gertty configuration' button is a good idea :)15:08
tristanCmatburt: alright, no hurries, the job works, but it's just a demo. let me know when you want to delve into the detail and what type of funtional job you would like to set first15:09
matburtI'm super excited to do that, as soon as I can15:09
mhuFYI, we're stopping nodepool for a little while to allow some cleanup in the nodepool tenant15:24
pabelangermhu: can we create a 2nd nodepool-launcher? so we don't bring down vexxhost when rdocloud outages?15:27
pabelangerwe are looking to start using vexxhost most today in ansible-network15:27
mhupabelanger, good idea15:29
pabelangermhu: or, can we set max-server: 0 for rdo-cloud then bring nodepool-launcher back online15:30
pabelangerto not affect ansible-network15:30
pabelangermhu: any ETA on nodepool-launcher coming back online? Did you see my comment about setting max-servers: 016:05
mhupabelanger, we're still in the middle of cleaning16:05
pabelangermhu: ack, can we look to set max-server then for clouds that are broken16:06
fbowe have restarted nodepool16:20
pabelangerthanks, it would be helpful if we stand up a 2nd launcher, as not to block jobs running in vexxhost, or look to have set max-server: 0 for affects providers next time. We're going to start experimenting more with vexxhost in ansible-network moving forward16:23
*** sshnaidm has joined #softwarefactory16:38
pabelangerfbo: mhu: nhicher: is anybody able to help debug why zuul isn't starting to run a job on vexxhost: https://ansible-network.softwarefactory-project.io/zuul/status.html17:01
pabelangerI cannot remember if we properly opened all the ports in the vexxhost tenant17:03
pabelangerI can check that first17:03
nhicherpabelanger: yes, I don't remember working on security groups for this project17:07
*** jangutter_ has joined #softwarefactory17:07
*** jangutter has quit IRC17:08
*** jpena is now known as jpena|off17:09
pabelangeryah, I'm going to manually check, then setup a zuul job for cloud launcher to manage it17:09
*** sshnaidm has quit IRC17:14
*** jangutter_ has quit IRC17:14
pabelangernhicher: okay, I've run cloud launcher against the tenant, it should have right settings now17:30
pabelangerwill try PR again17:31
pabelanger2018-09-11 17:37:45,196 WARNING zuul.Repo: Retry 1: Clone /var/opt/rh/rh-python35/lib/zuul/executor/softwarefactory-project.io/sf-jobs17:39
pabelangerguess RDO cloud is down again17:40
nhicherpabelanger: yes, rhos-ops is cleaning the tenants17:48
pabelangernhicher: this looks to be networking, since zuul executor cannot clone a git repo from gerrit17:49
pabelangernhicher: do we mirror sf-jobs to github today?17:49
nhicherpabelanger: not sure for sf-jobs, let me check17:51
nhicherpabelanger: no17:52
pabelangernhicher: k, we should consider mirroring them outside of rdocloud. I don't usually suggest github, but will be the better in this case18:38
pabelangernhicher: tristanC: mhu: can we update the redirect for https://ansible-network.softwarefactory-project.io to be https://ansible-network.softwarefactory-project.io/zuul/status.html not projects.html?19:48
*** jangutter has joined #softwarefactory20:01
pabelangerssh_exchange_identification: read: Connection reset by peer20:30
pabelangerI get that when I try to propose a review to sf.io20:30
pabelangerguessing networking still out20:30
pabelangermhu: nhicher: ^20:31
nhichercould you try again pabelanger, I propose a review few minutes ago without issue20:58
*** jangutter has quit IRC21:00
pabelangernhicher: no, fails here21:01
pabelangernhicher: what is the output of:21:01
pabelangerssh -v softwarefactory-project.io -p2941821:01
pabelangerfor you21:01
nhicherdebug1: Connecting to softwarefactory-project.io [38.145.34.47] port 29418.21:02
nhicherdebug1: Connection established.21:02
pabelangerssh_exchange_identification: read: Connection reset by peer21:02
pabelangerso, could be my route to rdocloud21:02
pabelangerbut, given I can ssh into port 2221:03
pabelangermakes me think something on cloud side is the issue21:03
pabelangerlet me get to another box and try21:04
pabelangernhicher: fails from rackspace, so routing for sure21:04
nhicherpabelanger: ok, do you think you use different routes for differents ports ?21:05
pabelangernhicher: are you routing over the VPN?21:06
pabelangeror using public21:06
*** jangutter has joined #softwarefactory21:06
nhicherpublic21:06
pabelangerokay, I'll have to drop to eat with family. Do you mind confirming with rhos-ops things are okay?21:07
pabelangeror maybe try from another system21:07
pabelangerI'll check back in an hour or so21:08
nhicherfor rdocloud, nodepool provider are okay21:08
nhicherproviders21:08
*** sshnaidm has joined #softwarefactory21:34
*** sshnaidm has quit IRC23:31
*** sshnaidm has joined #softwarefactory23:40
*** sshnaidm is now known as sshnaidm|afk23:40
*** jangutter has quit IRC23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!