Wednesday, 2021-03-10

*** jinyuanliu has quit IRC01:03
*** jinyuanliu has joined #openstack-helm01:04
*** subbareddy has quit IRC01:11
jinyuanliuhttps://review.opendev.org/c/openstack/openstack-helm/+/77885201:15
*** sangeet has quit IRC03:20
*** sangeet has joined #openstack-helm03:20
*** jinyuanliu has quit IRC03:34
*** jinyuanliu has joined #openstack-helm03:34
*** sangeet has quit IRC04:50
openstackgerritFrank Ritchie proposed openstack/openstack-helm-infra master: Add support for rgw placement targets  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77929005:04
openstackgerritMerged openstack/openstack-helm master: Lint and package chart About Magnum  https://review.opendev.org/c/openstack/openstack-helm/+/77885205:22
*** sangeet has joined #openstack-helm05:22
*** sangeet has quit IRC11:47
*** nicolasbock has quit IRC13:11
*** nicolasbock has joined #openstack-helm13:11
*** sangeet has joined #openstack-helm13:12
*** sangeet has quit IRC13:23
*** outbrito has joined #openstack-helm13:25
*** thiagop has quit IRC13:25
openstackgerritJeremy Houser proposed openstack/openstack-helm-deployments master: (WIP) Remove extraneous overrides  https://review.opendev.org/c/openstack/openstack-helm-deployments/+/77623314:17
*** jinyuanliu has quit IRC14:28
*** jinyuanliu has joined #openstack-helm14:28
openstackgerritJeremy Houser proposed openstack/openstack-helm-deployments master: Feature: Add Rabbitmq to Openstack-Helm-Deployments  https://review.opendev.org/c/openstack/openstack-helm-deployments/+/76588414:53
openstackgerritJeremy Houser proposed openstack/openstack-helm-deployments master: Feature: Add Rabbitmq to Openstack-Helm-Deployments  https://review.opendev.org/c/openstack/openstack-helm-deployments/+/76588414:54
*** miniroy has joined #openstack-helm14:56
openstackgerritSofiia Tavrovska proposed openstack/openstack-helm-infra master: Fix elasticsearch issue with JVM 14  https://review.opendev.org/c/openstack/openstack-helm-infra/+/75064716:03
openstackgerritSteven Fitzpatrick proposed openstack/openstack-helm-infra master: WIP: Support multiple snapshot repositories  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77912716:39
openstackgerritJeremy Houser proposed openstack/openstack-helm-deployments master: Feature: Add Rabbitmq to Openstack-Helm-Deployments  https://review.opendev.org/c/openstack/openstack-helm-deployments/+/76588416:42
openstackgerritChi Lo proposed openstack/openstack-helm-infra master: feat(tls) [WIP] Add internal tls to prometheus  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77529517:11
openstackgerritSteven Fitzpatrick proposed openstack/openstack-helm-infra master: WIP: Support multiple snapshot repositories  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77912717:15
openstackgerritFrank Ritchie proposed openstack/openstack-helm-infra master: Add support for rgw placement targets  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77929017:22
openstackgerritSteven Fitzpatrick proposed openstack/openstack-helm-infra master: WIP: Support multiple snapshot repositories  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77912717:24
openstackgerritFrank Ritchie proposed openstack/openstack-helm-infra master: Add support for rgw placement targets  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77929017:29
*** outbrito has quit IRC17:33
openstackgerritFrank Ritchie proposed openstack/openstack-helm-infra master: Add support for rgw placement targets  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77929017:36
openstackgerritChi Lo proposed openstack/openstack-helm-infra master: feat(tls) [WIP] Add internal tls to prometheus  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77529518:11
openstackgerritJeremy Houser proposed openstack/openstack-helm-deployments master: Feature: Add Rabbitmq to Openstack-Helm-Deployments  https://review.opendev.org/c/openstack/openstack-helm-deployments/+/76588418:18
openstackgerritMerged openstack/openstack-helm-infra master: [ceph-client] enhance logic to enable and disable the autoscaler  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77771118:39
*** zul has quit IRC18:54
openstackgerritFrank Ritchie proposed openstack/openstack-helm-infra master: Add support for rgw placement targets  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77929019:15
openstackgerritFrank Ritchie proposed openstack/openstack-helm-infra master: Add support for rgw placement targets  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77929019:16
*** irclogbot_0 has quit IRC19:44
*** sreejithp has joined #openstack-helm19:49
openstackgerritJeremy Houser proposed openstack/openstack-helm-deployments master: Update Gates for Airship Changes  https://review.opendev.org/c/openstack/openstack-helm-deployments/+/77985319:56
openstackgerritFrank Ritchie proposed openstack/openstack-helm-infra master: Add support for rgw placement targets  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77929020:31
openstackgerritMohammed Naser proposed openstack/openstack-helm master: Use first IP address for interface  https://review.opendev.org/c/openstack/openstack-helm/+/77929520:47
mnasergagehugo / portdirect: we're starting to look at the elasticsearch helm charts -- i see some fluent-bit charts and also beat charts, which ones do you currently use for your deployments (or something entirely different?)20:57
gagehugostevthedev ^20:57
portdirectstevthedev: ^20:57
portdirectlol20:57
mnaserwell i've found the logging specialist20:57
mnaser:P20:57
portdirectmnaser: its currently el+fluentd21:01
portdirectbut stevthedev will be able to elaborate further - we should probably also decide what to do with the beats charts etc - afaik no one has ever used them21:02
portdirectsrwilkers may have some input as well21:02
mnaserportdirect: gotcha, i'll be running those charts through their paces in that case and it would be good to 'archive' them so to be less confusing for new potential users \o/21:02
portdirectpeople who do logging in the midwest have to be called steve21:02
mnaserhaha21:02
portdirectits an odd rule, but it is the law apparently21:03
srwilkersoh hello21:03
srwilkersGoogle Cloud Logging is great - i don't have to do logging anymore21:04
stevthedevHahaha, it seems to be portdirect21:04
mnasersrwilkers: ahh, wouldnt it just be nice to be able to use the cloud to solve our problems :p21:05
srwilkersthe beats charts are a bit outdated, but i preferred them over fluentd personally - some of the dashboards the beats provide out of the box are really great21:05
stevthedevmnaser: Portdirect is correct, we don't use the beats or fluentbit chart currently21:05
srwilkersbut i wont lose sleep if they get 'archived' or go away entirely21:06
mnaserso fluentd straight to es21:06
srwilkersyep21:06
mnaserok i guess i am going to work on getting ES up first, and then after that fluentd and then we might push patches to 'cleanup' way logging happens21:08
mnaseresp because oslo.log has a native fluent logger21:08
srwilkersyeah, we had that enabled once upon a time21:08
srwilkersbut it's a blocking operation, at least it was at the time when we tried using it21:08
srwilkersso in situations where fluentd became unresponsive, keystone would barf and die21:08
mnaserthat explains a lot of when i tried it the last time.21:09
srwilkerswhich made everything else barf and die21:09
openstackgerritJeremy Houser proposed openstack/openstack-helm-deployments master: Update Gates for Airship Changes  https://review.opendev.org/c/openstack/openstack-helm-deployments/+/77985321:09
mnaserthen i guess the other alternative would be using json logger to stdout and having fluentd parse that json21:09
mnaserthat would make the k8s native logs gross21:09
mnaserbut if you're using logging you probably dont care21:09
srwilkersyeah - you can get fancy with the fluentd filters to transform the json entries with additional tags or other things you'd want to do to process them further21:10
srwilkersbut that sounds like a lot of work21:10
mnaseryeah im just thinking a bare minimum of toggling enabling json logs inside openstack services and making fluentd try to parse it as json once21:11
srwilkersyeah, it's worth a shot21:12
stevthedevYou should be able to set up a filter matching just the openstack logs, and do the json parsing in that block21:12
mnasermy first 'mission' is to just get the cluster sending raw logs and once thats up and rolling i may pursue that effort21:13
srwilkersyeah, that should be fairly simple - unless it's changed, the fluentd chart should be set up by default to tail everything in /var/log/containers/*, so as long as you're logging to stdout/stderr, it should pick it up and forward it to elasticsearch21:14
mnaseri've got auth and some stuff to sort out, may be pushing a patch to enable oauth2_proxy support too21:14
mnaseror maybe figure out oauth using apache221:15
openstackgerritFrank Ritchie proposed openstack/openstack-helm-infra master: Add support for rgw placement targets  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77929021:15
srwilkersim sure stevthedev would appreciate any fluentd enhancements you can provide ;)21:26
openstackgerritMohammed Naser proposed openstack/openstack-helm-infra master: Stop using fsGroup inside container securityContext  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77987321:51
mnasersrwilkers / stevthedev ^ it has begun :-)21:51
stevthedev:D21:55
srwilkersmnaser: slapped my lowly +1 on it22:03
openstackgerritFrank Ritchie proposed openstack/openstack-helm-infra master: Add support for rgw placement targets  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77929022:12
openstackgerritchinasubbareddy mallavarapu proposed openstack/openstack-helm-infra master: Add support for rgw placement targets  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77929022:13
openstackgerritJeremy Houser proposed openstack/openstack-helm-deployments master: Feature: Add Rabbitmq to Openstack-Helm-Deployments  https://review.opendev.org/c/openstack/openstack-helm-deployments/+/76588422:13
openstackgerritJeremy Houser proposed openstack/openstack-helm-deployments master: (WIP) Remove extraneous overrides  https://review.opendev.org/c/openstack/openstack-helm-deployments/+/77623322:14
openstackgerritChi Lo proposed openstack/openstack-helm-infra master: feat(tls) [WIP] Add internal tls to prometheus  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77529522:31
openstackgerritMohammed Naser proposed openstack/openstack-helm-infra master: Pin a few Java configuration values to 8-13  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77987722:48
openstackgerritGage Hugo proposed openstack/openstack-helm-infra master: Don't fail bootstrap if entry already exists  https://review.opendev.org/c/openstack/openstack-helm-infra/+/75860122:58
openstackgerritGage Hugo proposed openstack/openstack-helm-infra master: Don't fail bootstrap if entry already exists  https://review.opendev.org/c/openstack/openstack-helm-infra/+/75860122:58
openstackgerritGage Hugo proposed openstack/openstack-helm-infra master: Don't fail bootstrap if entry already exists  https://review.opendev.org/c/openstack/openstack-helm-infra/+/75860123:02
openstackgerritGage Hugo proposed openstack/openstack-helm-infra master: Don't fail bootstrap if entry already exists  https://review.opendev.org/c/openstack/openstack-helm-infra/+/75860123:04
openstackgerritJeremy Houser proposed openstack/openstack-helm-deployments master: Update Gates for Airship Changes  https://review.opendev.org/c/openstack/openstack-helm-deployments/+/77985323:09
openstackgerritMerged openstack/openstack-helm-infra master: Replace brace expansion with more standardized Posix approach  https://review.opendev.org/c/openstack/openstack-helm-infra/+/77959123:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!