Tuesday, 2017-12-05

*** sapan2211 has quit IRC00:05
*** julim has joined #openstack-helm00:10
*** yamamoto has quit IRC00:36
*** yamamoto has joined #openstack-helm00:38
*** yamamoto has quit IRC00:44
*** duonghq has joined #openstack-helm00:48
*** felipemonteiro has quit IRC00:51
*** gouthamr has quit IRC01:24
*** julim has quit IRC01:28
*** yamamoto has joined #openstack-helm01:41
*** gouthamr has joined #openstack-helm01:45
*** yamamoto has quit IRC01:46
*** felipemonteiro has joined #openstack-helm01:58
*** felipemonteiro_ has joined #openstack-helm02:17
*** felipemonteiro has quit IRC02:20
*** felipemonteiro_ has quit IRC02:20
*** felipemonteiro_ has joined #openstack-helm02:21
*** felipemonteiro_ has quit IRC02:25
*** mihdih has joined #openstack-helm02:46
*** gouthamr has quit IRC02:46
*** gouthamr has joined #openstack-helm02:46
*** lukepatrick has quit IRC03:14
*** lukepatrick has joined #openstack-helm03:18
*** gouthamr has quit IRC03:23
*** yamamoto has joined #openstack-helm03:49
*** mihdih has quit IRC04:04
*** lrensing has joined #openstack-helm04:06
*** coolsvap has joined #openstack-helm04:08
gmmahaHello, i am new to the community and looking into helm from a ceph standpoint and i was curious why https://github.com/openstack/openstack-helm/blob/master/tools/gate/setup_gate.sh#L59 check is in place04:11
gmmahathere is a ceph patch we are looking into and it curently fails all the non-voting jobs as this check was removed04:12
*** lukepatrick has quit IRC04:27
*** lukepatrick has joined #openstack-helm04:35
*** mihdih has joined #openstack-helm04:42
*** lrensing has quit IRC04:59
jayahnportdirect: hi05:10
*** krypto has joined #openstack-helm05:25
*** lukepatrick has quit IRC05:35
openstackgerritSeungkyu Ahn proposed openstack/openstack-helm master: auto recovery when all mariadb crashed  https://review.openstack.org/52272906:08
kryptoheyy all i am still stuck in aio.. i know it was suppose to be easy ... install.sh is successful but kubectl returns forbidden06:18
kryptonot sure whether its an rbac issue06:18
kryptoalso tiller part of helm is not installed06:19
kryptosorry helm list also returns forbidden06:19
*** julim has joined #openstack-helm06:37
*** julim has quit IRC06:42
*** krypto has quit IRC06:43
*** krypto has joined #openstack-helm08:00
*** krypto has joined #openstack-helm08:00
*** goldenfri has quit IRC08:04
*** krypto has quit IRC08:10
*** krypto has joined #openstack-helm08:10
*** julim has joined #openstack-helm08:30
*** julim has quit IRC08:35
*** julim has joined #openstack-helm09:28
*** julim has quit IRC09:33
*** bjolo has quit IRC09:54
*** krypto has quit IRC10:06
*** krypto has joined #openstack-helm10:13
*** krypto has quit IRC10:13
*** krypto has joined #openstack-helm10:13
*** krypto has quit IRC10:17
*** krypto has joined #openstack-helm10:18
*** krypto has quit IRC10:18
*** krypto has joined #openstack-helm10:18
osh-chatbot3<krypto> Unable to connect to the server: Forbidden ./tools/kubeadm-aio/kubeadm-aio-launcher.sh: line 90: [: ==: unary operator expected10:37
*** yamamoto has quit IRC11:28
*** MarkBaker has quit IRC11:41
*** MarkBaker has joined #openstack-helm11:48
kryptosorry my bad... its stupid proxy environment variable.. its working now Thanks :)11:49
*** julim has joined #openstack-helm12:02
*** julim has quit IRC12:06
*** yamamoto has joined #openstack-helm12:28
*** yamamoto has quit IRC12:31
*** yamamoto has joined #openstack-helm12:31
*** yamamoto has quit IRC12:38
*** yamamoto has joined #openstack-helm12:40
*** mihdih has quit IRC12:44
*** krypto has quit IRC13:23
*** roman_g has joined #openstack-helm13:27
*** roman_g has quit IRC13:34
*** roman_g has joined #openstack-helm13:39
*** yamamoto has quit IRC13:47
*** yamamoto has joined #openstack-helm14:11
openstackgerritdave kormann proposed openstack/openstack-helm master: Ceph OSD disk targeting  https://review.openstack.org/45775414:14
*** mihdih has joined #openstack-helm14:21
*** goldenfr_ has joined #openstack-helm14:26
*** julim has joined #openstack-helm14:32
*** julim has quit IRC14:36
*** lrensing has joined #openstack-helm14:44
srwilkersmorning o/14:45
*** goldenfr_ is now known as goldenfri14:47
jayahnmorning o/14:52
jayahnI will be a bit late for today's irc meeting14:53
jayahnAbout 20min14:53
mattmceuenGM!  Agenda: https://etherpad.openstack.org/p/openstack-helm-meeting-2017-12-0514:59
*** lrensing has quit IRC15:00
mattmceuenReminder: srwilkers, lrensing, alraddarla, dulek, v1k0d3n, lamt, portdirect, renmak, jayahn, korzen, alanmeadows, raymaika meeting time15:01
*** lrensing has joined #openstack-helm15:03
*** lrensing_ has joined #openstack-helm15:11
*** lrensing has quit IRC15:14
*** lrensing_ is now known as lrensing15:14
*** gouthamr has joined #openstack-helm15:29
*** krypto has joined #openstack-helm15:48
*** openstackgerrit has quit IRC15:48
*** krypto has quit IRC15:50
*** lrensing_ has joined #openstack-helm15:58
*** lrensing_ has quit IRC15:59
*** lrensing has quit IRC16:00
*** coolsvap has quit IRC16:08
*** openstackgerrit has joined #openstack-helm16:36
openstackgerritdave kormann proposed openstack/openstack-helm master: Ceph OSD disk targeting  https://review.openstack.org/45775416:36
*** lukepatrick has joined #openstack-helm16:39
srwilkershttp://www.businesswire.com/news/home/20171205005634/en/Kata-Containers-Project-Launches-Build-Secure-Container18:52
SamYaplesrwilkers: cool.... but what is it lol18:59
*** roman_g has quit IRC19:00
SamYapleah https://katacontainers.io/19:00
SamYaplemuch cleaerer19:00
srwilkers“Much clearer”. I️ see what you did there19:04
SamYapleright... yea... totally planned that i did19:05
*** yamamoto has quit IRC19:27
*** lukepatrick has quit IRC19:33
openstackgerritdave kormann proposed openstack/openstack-helm master: Ceph OSD disk targeting  https://review.openstack.org/45775419:35
osh-chatbot3<gmmaharaj> @multics the wait for docker containers to die should be added to tools/gate/provision_gate_worker_node.sh also isn't it?19:49
osh-chatbot3<gmmaharaj> this is regarding https://review.openstack.org/#/c/457754/19:50
*** lukepatrick has joined #openstack-helm19:51
osh-chatbot3<portdirect> @gmmaharaj and multics - i think you should probably migrate this to a new PS19:53
osh-chatbot3<gmmaharaj> @portdirect pardon my ignorance, but what is PS?19:53
osh-chatbot3<portdirect> i think many of the problems you are encountering is as a result of this code having been wip for ~6 months19:53
osh-chatbot3<portdirect> PS - patch set - https://review.openstack.org/#/c/457754/19:54
osh-chatbot3<gmmaharaj> aaah patchset.. got it.. :)19:54
osh-chatbot3<portdirect> as this is now at 96 ps's and counting - its very hard to track/review19:54
osh-chatbot3<portdirect> but i think you could probably split into a couple of smaller, simpler patch sets that we could merge very simply19:54
osh-chatbot3<portdirect> multics has already split out the livelyness script into a separate ps for example - and this makes it simpler to see whats going on19:56
srwilkers++19:57
osh-chatbot3<gmmaharaj> @portdirect let me work with @multics and see how many small patches we can split this into19:57
osh-chatbot3<portdirect> i woulnt go crazy - but make just focus each ps on a topic19:57
osh-chatbot3<gmmaharaj> this particular issue with the non-voting jobs failing seems to be cause we are removing the ZUUL_VERSION == v3 check.19:57
osh-chatbot3<portdirect> and if we got checks in it would be apprecated19:58
osh-chatbot3<portdirect> now we use zuul v3 to launch the gates - it should be simple to add one that exercises the disc targetting feature19:58
osh-chatbot3<portdirect> which is a big win over the old scripts that you are having to wade through19:58
osh-chatbot3<multics> i think the actual change in this patch is fairly small19:59
osh-chatbot3<gmmaharaj> @portdirect zuul v3 is also using the same tools to test a patch right? if not, could you point me to the new way of running tests under zuul v3?20:00
osh-chatbot3<multics> the gate scripts are unusually unwieldy, i think, because of the creation of loopback devices to test device-backed OSDs.20:00
SamYaple@multics portdirect writing something unwieldy? never!20:01
osh-chatbot3<multics> but yeah, the point that an awful lot of the trouble we're having is because we've iterated on this for so long is well-taken.20:01
osh-chatbot3<multics> nah, @portdirect isn't responsible for this shambling horror.20:01
osh-chatbot3<multics> my fault.20:01
osh-chatbot3<portdirect> @gmmaharaj you can add a check using this file - https://github.com/openstack/openstack-helm/blob/master/.zuul.yaml20:01
osh-chatbot3<multics> i can't speak to OTHER shambling horrors.20:01
SamYaplehaha20:01
osh-chatbot3<portdirect> lol - my horrors are lumbering, not shambling @samyaple!20:02
SamYaplei said nothing20:02
SamYaplei mean we were all thinking it, so it didnt need to be said20:02
osh-chatbot3<portdirect> but it would be possible to make the loopbac much cleaner in ansible than the bash used today20:02
osh-chatbot3<multics> fair point.20:03
osh-chatbot3<gmmaharaj> @portdirect will look into adding a disk based job. thanks20:04
*** yamamoto has joined #openstack-helm20:28
*** yamamoto has quit IRC20:35
*** roman_g has joined #openstack-helm20:39
*** kelv_ has joined #openstack-helm20:55
openstackgerritSam Yaple proposed openstack/openstack-helm master: [WIP] etcd mariadb  https://review.openstack.org/52575220:56
kelv_How are mariadb-[012].mariadb-discovery created? When bringing up the second mariadb instance, wsrep fails on "no address to connect"? mariadb-discovery.openstack.svc.cluster.local does resolve to A entries of the pod IPs21:00
portdirectkelv_: they are created via the headless service, and use of statefulsets21:00
portdirectfor it to function you need kube-dns to resolve ips to pods21:01
kelv_Yeah, I do have kube-dns, which seems to be resolving service IPs correctly21:02
kelv_For example, querying kube-dns:21:04
kelv_mariadb-discovery.openstack.svc.cluster.local has address 10.68.11.6721:04
kelv_mariadb-discovery.openstack.svc.cluster.local has address 10.68.4.19421:04
portdirectbut it is not resolving `mariadb-0.mariadb-discovery.openstack.svc.cluster.local` ?21:05
kelv_correct, it is not resolving21:05
portdirectdoes your kube-dns to resolve ips to pods ?21:05
portdirectif so it wont work21:05
kelv_do you mean reverse lookups?21:07
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Helm: update to 2.7.2  https://review.openstack.org/52575721:08
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: WIP: Gather deployment information after checks run  https://review.openstack.org/52576221:18
openstackgerritPete Birley proposed openstack/openstack-helm master: [WIP] etcd mariadb  https://review.openstack.org/52575221:22
portdirectSamYaple: re this: https://review.openstack.org/#/c/525752/21:23
portdirectyou want an etcd in each pod? or a single etcd service that all pods talk to?21:24
SamYapleshared etcd21:24
SamYaplepreferably ha21:24
SamYaplecheckthat salt repo for an easy ha etcd setup21:24
portdirectcool - the update i pushed sets up a single etcd21:24
SamYaple:+1:21:24
portdirectwhich we need to get ha, but for now this should work21:24
SamYapleyup21:25
SamYaplethe code should be safe for single etcd, i did test "losing" etcd data without mariadb dataloss21:25
portdirectetcd ha is easy, dynamically scaling and recovery is not :/21:25
SamYaplebut you know, ha is good21:25
SamYaplehmm fair enough. dont know ive tested that as much21:26
portdirectas time goes on - I'm getting more fond of the etcd operator21:26
portdirectabout the only time I'll ever say that21:26
SamYapleill use whatever as long as i can do gets/puts/locks21:26
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: WIP: Gather deployment information after checks run  https://review.openstack.org/52576221:31
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: WIP: Gather deployment information after checks run  https://review.openstack.org/52576221:47
*** lrensing has joined #openstack-helm21:50
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: WIP: Gather deployment information after checks run  https://review.openstack.org/52576222:01
srwilkershang on22:03
srwilkersdid i just see portdirect say hes fond of an operator?22:03
srwilkersmy eyes must deceive me22:03
osh-chatbot3Action: portdirect i never said that.22:03
osh-chatbot3<portdirect> more fond != fond22:03
*** gouthamr has quit IRC22:04
srwilkersmore fond means that even if you were not fond at all, there has to be some fondness there22:04
osh-chatbot3<portdirect> leave me alone steve!22:04
osh-chatbot3<v1k0d3n> who’s fond?22:04
srwilkersits too late anyway, already screen capped it and locked it away forever22:04
osh-chatbot3<portdirect> but yeah - its a nice bit of kit - and i think before too long I'd love to see a `etcdadm` or similar22:05
osh-chatbot3<portdirect> as this would really close the loop on k8s management22:06
srwilkersyeah, operators aren't all bad.  while it does seem like magic at times, that magic may have the potential to make some very real pains less painful22:06
srwilkersportdirect: yep22:06
osh-chatbot3<v1k0d3n> big fan of the etcd operator22:07
osh-chatbot3<portdirect> once the kubelet checkpoint comes in i think it will be a lot more viable in bm senarios22:08
osh-chatbot3<v1k0d3n> i think operators just need to keep good boundaries. etcd op does a good job of that.22:09
osh-chatbot3<v1k0d3n> ++ i agree with that @portdirect for sure.22:09
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: WIP: Gather deployment information after checks run  https://review.openstack.org/52576222:12
srwilkerscurrently having one of those dilemmas where theres no power cord in sight, im at 7% battery, and i just started another osh-infra run.  to move or not to move22:14
portdirectsrwilkers: focus! you can do it22:22
* srwilkers grumbles22:25
*** MarkBaker has quit IRC22:29
*** MarkBaker has joined #openstack-helm22:31
*** MarkBaker has quit IRC22:31
openstackgerritSamuel Gil Jonesi proposed openstack/openstack-helm master: WIP: Updated developer documentation to use -infra repo  https://review.openstack.org/52317322:33
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: WIP: Gather deployment information after checks run  https://review.openstack.org/52576222:35
*** gouthamr has joined #openstack-helm22:42
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: WIP: Gather deployment information after checks run  https://review.openstack.org/52576223:00
*** roman_g has quit IRC23:01
*** roman_g has joined #openstack-helm23:02
*** roman_g has quit IRC23:02
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: WIP: Gather deployment information after checks run  https://review.openstack.org/52576223:14
*** lrensing has quit IRC23:16
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: WIP: Gather deployment information after checks run  https://review.openstack.org/52576223:26
*** lrensing has joined #openstack-helm23:40
*** julim has joined #openstack-helm23:42
*** lukepatrick has quit IRC23:47
*** julim has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!