Thursday, 2019-06-13

*** schwicht has quit IRC00:25
*** schwicht has joined #openstack-helm00:53
*** schwicht has quit IRC01:12
*** happyhemant has quit IRC01:28
*** schwicht has joined #openstack-helm01:33
*** michael-beaver has joined #openstack-helm01:38
*** jamesgu has quit IRC02:12
*** cheng1 has quit IRC02:51
*** cheng1 has joined #openstack-helm02:53
*** cfriesen has quit IRC03:00
*** KeithMnemonic has quit IRC03:08
*** cheng1 has quit IRC03:20
*** cheng1 has joined #openstack-helm03:25
*** michael-beaver has quit IRC03:48
*** jaypipes has quit IRC05:47
*** spsurya has joined #openstack-helm06:07
*** jaypipes has joined #openstack-helm06:11
*** bobmel has joined #openstack-helm06:32
*** bobmel has quit IRC06:35
*** bobmel has joined #openstack-helm06:42
*** pgaxatte has joined #openstack-helm06:49
*** JangwonLee has joined #openstack-helm06:49
*** ianychoi has joined #openstack-helm07:02
*** HagunKim has quit IRC07:05
*** rihbb has joined #openstack-helm07:39
*** lemko has joined #openstack-helm07:58
*** jsuchome has joined #openstack-helm08:01
*** rihbb has quit IRC08:05
*** bobmel has quit IRC08:06
*** gkadam has joined #openstack-helm08:16
*** bobmel has joined #openstack-helm08:17
*** gkadam has quit IRC08:17
*** bobmel has quit IRC08:21
*** bobmel has joined #openstack-helm08:21
*** dpawlik has joined #openstack-helm08:40
*** bobmel has quit IRC08:43
lemkoHi. In prometheus, I've a high number of node_high_network_drop_rcv on nodes with openvswitch label. I don't really feel anything is wrong with my instances in OpenStack. Is it normal? There are packets dropped by the kernel, what could it be?09:32
*** gmann has quit IRC09:33
openstackgerritRihab Banday proposed openstack/openstack-helm-images master: Add bionic based build jobs to Zuul build configuraton  https://review.opendev.org/66510210:09
openstackgerritvaragini karthik proposed openstack/openstack-helm-images master: Added Dockerfile for postgresql-Utility container.  https://review.opendev.org/66009510:12
openstackgerritRihab Banday proposed openstack/openstack-helm-images master: Add bionic based build jobs to Zuul build configuraton  https://review.opendev.org/66510210:34
*** sthussey has quit IRC10:40
*** gmann has joined #openstack-helm11:09
*** nicolasbock has joined #openstack-helm11:21
*** schwicht has quit IRC11:57
*** arunkant has quit IRC11:59
*** arunkant has joined #openstack-helm12:00
*** spsurya has quit IRC12:18
*** aaronsheffield has joined #openstack-helm12:56
*** howell has joined #openstack-helm13:10
openstackgerritKoffi Nogbe proposed openstack/openstack-helm-infra master: Add enhancement to mariadb backup  https://review.opendev.org/66185313:11
*** roman_g has joined #openstack-helm13:19
*** schwicht has joined #openstack-helm13:33
openstackgerritKoffi Nogbe proposed openstack/openstack-helm-infra master: Add enhancement to mariadb backup  https://review.opendev.org/66185314:16
*** sreejithp has joined #openstack-helm14:17
*** cfriesen has joined #openstack-helm14:55
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Add openstack-exporter tp openstack-helm-infra-aio-monitoring job  https://review.opendev.org/66515414:59
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Add openstack-exporter to openstack-helm-infra-aio-monitoring job  https://review.opendev.org/66515414:59
*** sthussey has joined #openstack-helm15:02
*** dpawlik has quit IRC15:35
*** pgaxatte has quit IRC15:36
openstackgerritTarshavardhan Somepalli proposed openstack/openstack-helm-infra master: test for changes  https://review.opendev.org/66516015:39
evrardjpsrwilkers: portdirect: just an FYI. a script I just wrote for the renames and delete of the old images starting with change_<id>_ is currently running.15:59
srwilkersevrardjp: oh, that sounds good16:07
evrardjpit's in ansible due to manipulation of tokens, and I didn't want to write my own exceptions :p16:10
evrardjpbut it works. Very serially and slowly, but works.16:11
evrardjpit as stripped like 20 tags per loci image we build. keeping only one per date16:11
evrardjpper date/branch/etc.16:11
evrardjpI will tag all the rest with a date today -- sorry for the spam on this channel, but I rather be explicit in what's going on, and logging it here.16:12
evrardjpand now all the opensuse_15 are frozen (with today's date, on top of "latest")16:41
evrardjpIf you want me to do the same for the xenial ones, i can reuse my script16:41
evrardjpbut I don't think you have an urgent need for it, am I right?16:41
*** lemko has quit IRC16:47
srwilkersevrardjp: sorry, just catching up.  so it results in having a tag for the current date and still one for latest?17:07
srwilkersor am i misunderstanding? (multitasking is bad)17:08
*** nicolasbock has quit IRC17:10
*** rihbb has joined #openstack-helm17:33
openstackgerritOm Prakash proposed openstack/openstack-helm master: Extending Neutron chart with support for OVS DPDK  https://review.opendev.org/64328418:07
*** ianychoi has quit IRC18:13
*** arunkant has quit IRC18:16
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Add openstack-exporter to aio-monitoring & openstack-support jobs  https://review.opendev.org/66515418:20
*** kskels has joined #openstack-helm18:22
kskelsHi all, here is an error that appears after cluster reboot for ingress18:22
kskelshttps://www.irccloud.com/pastebin/fa2Ezhgx/18:22
kskelshave things changed in the ingress chart?18:22
kskelsif pod is deleted - it will recover..18:22
*** michael-beaver has joined #openstack-helm18:23
kskelsportdirect: could it be related to https://opendev.org/openstack/openstack-helm-infra/commit/2abf62ff4dbb2997174a1957172217c1540b9e7718:25
kskelshave you guys tested reboot of node/server with this change?18:25
kskelsand there is also 2nd issue with cluster reboot now18:37
kskelshttps://www.irccloud.com/pastebin/Vg8mRb3a/18:37
srwilkerskskels: at the moment, there are no upstream jobs that exercise/simulate a node reboot for openstack-helm-*18:38
kskelsyes-  seems there are now 2 issues with this18:38
kskelslet me know if you want me to report these as bugs18:39
kskelsthis is broken compared to 1month old build - that survived a reboot18:39
portdirectare you sure the issue is with the ingress chart?18:39
portdirectbut - yes - that ps could be a candidate for sure18:40
kskelsyes - as once you delete the ingress pod - it recovers nicely18:40
kskelsin other words - deployment goes well, then I do full node restart - ingress never recovers18:40
portdirectok - so yeah I'd put my suspicion there18:40
kskels(as well as ceph-rgw - all other pods are happy)18:41
portdirectcan you just add a `rm -f /tmp/prometheus-nginx.socket` to the start script ?18:41
srwilkersyou can recreate that behavior by force deleting one of the kube-system ingress pods with no grace period -- the replacement pod shows that same behavior, which then can be addressed by deleting that subsequent pod18:41
srwilkersportdirect: was going to be my suggestion too18:42
kskelslet me know if you want any more input on ceph-rgw part - I still have the env up18:46
kskelse.g.18:46
kskelshttps://www.irccloud.com/pastebin/EPhjjt81/18:46
*** dpawlik has joined #openstack-helm18:54
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Ingress: Remove prometheus-nginx.socket on start  https://review.opendev.org/66521619:04
srwilkersportdirect: ^19:04
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Add missing affinity keys to chart pod specs  https://review.opendev.org/66280219:15
*** rihbb has quit IRC19:43
*** spiette has quit IRC20:43
*** spiette has joined #openstack-helm20:48
*** dpawlik has quit IRC21:01
*** jsuchome has quit IRC21:19
*** howell has quit IRC21:33
*** schwicht has quit IRC21:35
*** sreejithp has quit IRC21:43
*** schwicht has joined #openstack-helm22:39
*** aaronsheffield has quit IRC22:45
*** schwicht has quit IRC23:00
openstackgerritAlexander Noskov proposed openstack/openstack-helm-infra master: Ingress: Fix security context for pod/container  https://review.opendev.org/66381223:26
*** sthussey has quit IRC23:48

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!