Thursday, 2017-11-09

portdirectCheers dude, same here :)00:00
portdirectI'm off to katoomba today to see where my grandad grew up, need a break from anything nautically themed for a couple of days!00:02
ianwsounds fun, look out for jeblair, i think he's gone bush up there too00:03
*** MarkBaker has joined #openstack-helm00:05
*** yamamoto has joined #openstack-helm00:08
*** MarkBaker has quit IRC00:14
*** huxinhui_ has quit IRC01:45
openstackgerritSungil Im proposed openstack/openstack-helm master: Fluent-logging helm chart  https://review.openstack.org/51462201:50
*** julim has joined #openstack-helm02:00
*** jdandrea_ has joined #openstack-helm02:49
*** alraddarla has quit IRC02:50
*** jdandrea has quit IRC02:51
*** jaypipes has quit IRC02:51
*** leifmadsen has quit IRC02:51
*** leifmadsen has joined #openstack-helm02:57
*** jaypipes has joined #openstack-helm03:08
*** coolsvap has joined #openstack-helm03:23
*** alraddarla has joined #openstack-helm03:26
*** lukepatrick has joined #openstack-helm03:29
*** pyvpx_ has joined #openstack-helm03:55
*** pyvpx has quit IRC03:56
*** lukepatrick has quit IRC04:20
srwilkersportdirect: you don’t get to avoid nautical04:36
srwilkers+ Themed things04:36
*** hachi_ has joined #openstack-helm06:15
*** pyvpx has joined #openstack-helm06:20
*** pyvpx_ has quit IRC06:22
*** hachi_ has quit IRC06:22
*** MarkBaker has joined #openstack-helm07:04
*** MarkBaker has quit IRC07:14
*** yamamoto has quit IRC07:19
*** yamamoto has joined #openstack-helm07:21
*** hachi_ has joined #openstack-helm07:22
*** yamamoto has quit IRC07:26
*** sghosh has quit IRC07:33
*** sghosh__ has joined #openstack-helm07:33
*** MarkBaker has joined #openstack-helm07:53
*** MarkBaker has quit IRC08:04
*** yamamoto has joined #openstack-helm08:24
*** yamamoto has quit IRC08:34
*** jistr is now known as jistr|mtg08:48
*** yamamoto has joined #openstack-helm09:04
*** yamamoto has quit IRC09:13
*** yamamoto has joined #openstack-helm09:25
*** jklare has quit IRC09:30
*** yamamoto has quit IRC09:31
*** jklare has joined #openstack-helm09:32
*** yamamoto has joined #openstack-helm09:38
*** korzen has quit IRC09:38
*** jistr|mtg is now known as jistr10:15
*** MarkBaker has joined #openstack-helm10:20
*** yamamoto has quit IRC10:26
*** yamamoto has joined #openstack-helm10:31
*** MarkBaker has quit IRC10:44
*** yamamoto has quit IRC10:55
*** hachi_ has quit IRC10:57
*** hachi_ has joined #openstack-helm10:57
*** hachi__ has joined #openstack-helm10:59
*** hachi_ has quit IRC11:01
jayahnIt was good to see at Sydney. It was a fantastic workshop.11:14
*** yamamoto has joined #openstack-helm11:14
*** korzen has joined #openstack-helm11:35
*** yamamoto has quit IRC11:38
openstackgerritMateusz Blaszkowski proposed openstack/openstack-helm master: ElastAlert: pushing notifications to Nagios  https://review.openstack.org/51871111:38
*** krypto has joined #openstack-helm12:01
*** yamamoto has joined #openstack-helm12:31
*** julim has quit IRC12:33
*** krypto has quit IRC12:52
*** krypto has joined #openstack-helm12:53
*** krypto has quit IRC13:19
*** krypto has joined #openstack-helm13:20
*** krypto has quit IRC13:20
*** krypto has joined #openstack-helm13:20
*** coolsvap has quit IRC13:21
*** schwicht has joined #openstack-helm13:32
*** schwicht has quit IRC13:50
*** lukepatrick has joined #openstack-helm14:10
*** julim has joined #openstack-helm14:18
*** krypto has quit IRC14:20
*** hachi_ has joined #openstack-helm14:35
*** hachi__ has quit IRC14:37
osh-chatbot<kperr> @v1k0d3n I noticed that even though mariadb pod is in running state `kubectl describe` shows ` Readiness probe failed: ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2 "No such file or directory") Could not SELECT 1   Warning  Unhealthy  Readiness probe failed: ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) Could not SELECT 1`14:38
osh-chatbot<kperr> Is this warning normal?14:38
osh-chatbot<kperr> Inside the pod there isn't any directory /var/run/mysqld/mysqld.sock14:39
*** lukepatrick has quit IRC14:43
*** hachi__ has joined #openstack-helm15:00
*** hachi_ has quit IRC15:02
*** yamamoto has quit IRC15:05
*** yamamoto has joined #openstack-helm15:07
*** yamamoto has quit IRC15:11
*** alraddarla has quit IRC15:14
*** alraddarla_ has joined #openstack-helm15:17
*** yamamoto has joined #openstack-helm15:22
osh-chatbot<v1k0d3n> hey @kperr…so some errors are expected even in perfectly fine environments. like, you will definitely see errors like `[Warning] Access denied for user 'root'@'localhost' (using password: YES)` while the cluster is coming up.15:25
osh-chatbot<v1k0d3n> but you will also see messages that are good, like `Member 1.0 (mariadb-1.mariadb-discovery) requested state transfer from '*any*'. Selected 0.0 (mariadb-0.mariadb-discovery)(SYNCED) as donor.`15:26
osh-chatbot<v1k0d3n> and..15:26
osh-chatbot<v1k0d3n> File uploaded https://kubernetes.slack.com/files/U0A333J23/F7YNSAU07/-.txt / https://slack-files.com/T09NY5SBT-F7YNSAU07-cbfc4ddeb315:26
osh-chatbot<v1k0d3n> do you get these messages?15:27
osh-chatbot<kperr> Well I only see `Member 0.0 (mariadb-0.mariadb-discovery) synced with group` but somewhere in the logs above I see15:35
osh-chatbot<kperr> File uploaded https://kubernetes.slack.com/files/U1UPJN457/F7XQRB413/-.txt / https://slack-files.com/T09NY5SBT-F7XQRB413-e12c327b6e15:35
osh-chatbot<v1k0d3n> how many mariadb members are you trying to deploy? 1 or 3?15:36
osh-chatbot<v1k0d3n> also, is this AIO or multi-node?15:37
osh-chatbot<kperr> This is a multinode and from the values.yaml file I see three replicas defined15:37
osh-chatbot<v1k0d3n> and can you `kubectl get pods -o wide -n openstack` for me?15:38
osh-chatbot<kperr> File uploaded https://kubernetes.slack.com/files/U1UPJN457/F7XQTM405/-.txt / https://slack-files.com/T09NY5SBT-F7XQTM405-39249489de15:38
*** hachi__ has quit IRC16:01
*** julim_ has joined #openstack-helm16:03
*** julim has quit IRC16:04
osh-chatbot<v1k0d3n>  So the resolv.conf changes...you made/verifies those on all the nodes?16:07
*** lukepatrick has joined #openstack-helm16:14
*** yamamoto has joined #openstack-helm16:23
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: WIP - Move prometheus to osh-infra  https://review.openstack.org/51764516:29
*** yamamoto has quit IRC16:32
*** lukepatrick has quit IRC16:37
*** Guest53223 has joined #openstack-helm16:38
*** lukepatrick has joined #openstack-helm16:46
*** julim has joined #openstack-helm16:51
*** julim_ has quit IRC16:51
*** Guest53223 has quit IRC16:53
*** yamamoto has joined #openstack-helm17:27
*** yamamoto has quit IRC17:33
osh-chatbot<srwilkers> @kperr -- are you using calico?17:44
*** hachi_ has joined #openstack-helm18:33
osh-chatbot<kperr> @v1k0d3n well I just have the entries mentioned in http://openstack-helm.readthedocs.io/en/latest/install/multinode.html#activating-control-plane-namespace-for-ceph in resol.conf files plus an entry for the ceph-mon svc as discussed yesterday. Do I need to add a new entry?18:48
osh-chatbot<kperr> @srwilkers yes calico18:49
osh-chatbot<raymaika> @kperr @v1k0d3n was asking to be sure that the /etc/resolv.conf changes you made to ensure that your host could resolve ceph-mon.ceph were also done on node3 (where they mariadb-0 pod is)18:50
osh-chatbot<v1k0d3n> ^^ that for sure.18:51
osh-chatbot<kperr> yes that  host can resolvee ceph-mon.ceph18:51
osh-chatbot<v1k0d3n> all of them in your multi-node cluster you mean?18:53
osh-chatbot<kperr> yes18:53
osh-chatbot<kperr> And as soon as I start deploying new services http://openstack-helm.readthedocs.io/en/latest/install/multinode.html#installation-of-other-services, the mariadb pod goes into crashloopback state with restarts19:04
*** jaypipes has quit IRC19:29
*** jaypipes has joined #openstack-helm19:30
*** hachi_ has quit IRC19:47
*** jdandrea_ is now known as jdandrea20:11
osh-chatbot<portdirect> Hey @kperr what discs are you using to back the directory ceph is using on your hosts? And what is the spec of those hosts themselves?20:51
*** julim has quit IRC21:56
*** julim has joined #openstack-helm21:57
*** dayou has joined #openstack-helm21:57
*** julim has quit IRC22:00
*** hpl2000 has joined #openstack-helm22:04
*** hpl2000 has quit IRC22:06
*** HPL has joined #openstack-helm22:07
*** HPL has quit IRC22:08
*** HPL has joined #openstack-helm22:08
*** jdandrea has quit IRC22:16
*** jdandrea has joined #openstack-helm22:24
*** lukepatrick has quit IRC22:51
*** julim has joined #openstack-helm23:47

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!