Tuesday, 2018-06-19

*** ericho has quit IRC00:12
*** caoyuan has joined #openstack-helm00:38
*** julim has joined #openstack-helm00:41
*** yamamoto has joined #openstack-helm00:47
*** yamamoto has quit IRC00:51
*** caoyuan has quit IRC00:57
*** julim has quit IRC00:58
*** julim has joined #openstack-helm00:59
openstackgerritPete Birley proposed openstack/openstack-helm master: Ingress TLS for keystone  https://review.openstack.org/56635001:05
*** zhangfei has joined #openstack-helm01:28
*** yamamoto has joined #openstack-helm01:47
*** yamamoto has quit IRC01:53
*** caoyuan has joined #openstack-helm01:58
*** unicell has quit IRC02:12
*** zhangfei has quit IRC02:14
*** roman_g has quit IRC02:22
*** zhangfei has joined #openstack-helm02:26
*** sthussey has quit IRC02:28
*** caoyuan has quit IRC02:34
*** caoyuan has joined #openstack-helm02:35
*** unicell has joined #openstack-helm02:35
*** unicell has quit IRC02:39
*** caoyuan has quit IRC02:40
*** caoyuan has joined #openstack-helm02:40
portdirectrwellum: how is it still unhappy?02:49
portdirectwhat are your symptoms?02:49
*** yamamoto has joined #openstack-helm02:49
osh-chatbot<xiaods> hi eam02:51
osh-chatbot<xiaods> hi team02:51
osh-chatbot<xiaods> i have pr a patch for support macos environment. https://review.openstack.org/#/c/570658/  anyone give a review02:51
osh-chatbot<mattmceuen> o/ @xiaods02:51
osh-chatbot<mattmceuen> Very cool - I think we have a couple folks with macs who can give that a try!  Thank you for contributing this02:52
portdirecthave you tested this on macos?02:52
osh-chatbot<xiaods> yeah02:53
portdirectim very surprised it works :)02:54
portdirectis this just using docker for mac?02:54
osh-chatbot<xiaods> yeah02:54
portdirectwith the standard xhyve vm02:54
osh-chatbot<xiaods> yeah02:54
portdirectvery cool02:54
osh-chatbot<xiaods> we are in openstack-helm hackthon in beijing.02:54
osh-chatbot<mattmceuen> Nice!!02:54
portdirectawesome - what are you guys working on?02:55
*** yamamoto has quit IRC02:55
osh-chatbot<xiaods> this is #8 openstack hackthon events in beijing. sponsor by intel, 99cloud…02:55
osh-chatbot<xiaods> we are do promote openstack-helm project in china’s openstack community02:56
osh-chatbot<mattmceuen> That's really great - let us know what we can do to support you guys in this02:57
osh-chatbot<xiaods> @mattmceuen yeah, if we need some help, i will let u know02:59
osh-chatbot<xiaods> File uploaded https://kubernetes.slack.com/files/UAPN4SV8C/FB95A4BNU/img_20180619_105654.jpg / https://slack-files.com/T09NY5SBT-FB95A4BNU-1fa72b4c3202:59
osh-chatbot<xiaods> File uploaded https://kubernetes.slack.com/files/UAPN4SV8C/FB9K0P0N8/img_20180619_105913.jpg / https://slack-files.com/T09NY5SBT-FB9K0P0N8-00c316ba7902:59
osh-chatbot<mattmceuen> Now you're making me jealous @xiaods :slightly_smiling_face:03:00
osh-chatbot<mattmceuen> looks like fun03:00
osh-chatbot<xiaods> haha03:00
osh-chatbot<xiaods> just fun03:00
portdirectthats cool xiaods03:01
portdirectif theres anything we can do to help feel free to reach out03:01
portdirectI'll get that ps running on my laptop soon as i can03:01
portdirecttheres a whole raft of things we would like to do03:02
portdirectleading up to our 1.0 release03:02
portdirectin storyboard03:02
osh-chatbot<mattmceuen> Good thought portdirect - if anyone wants to hack at any of these it would be really valuable to the project as well: https://storyboard.openstack.org/#!/worklist/34103:03
portdirectesp these: https://storyboard.openstack.org/#!/story/2002201 https://storyboard.openstack.org/#!/story/2002207 that we would love to get help on03:03
osh-chatbot<xiaods> cool03:04
osh-chatbot<xiaods> let us try it03:05
portdirectin particular getting help with helm-tests for charts would be a super nice way to get into the charts03:05
osh-chatbot<xiaods> yeah03:07
osh-chatbot<xiaods> hi buddy, howto write helm tests,  could you do me a favor to guide the steps03:16
portdirectsure - so for some services we use rally03:16
portdirecteg glance03:16
portdirecthttps://github.com/openstack/openstack-helm/blob/master/glance/values.yaml#L83-L10903:17
portdirectwhich are then run using this pod: https://github.com/openstack/openstack-helm/blob/master/glance/templates/pod-rally-test.yaml03:17
portdirectfor other services - a scripted test is better03:18
osh-chatbot<xiaods> cool03:18
portdirectie - in cases where rally does not have suitable scenarios to run:03:18
portdirectand here we can just use a script: https://github.com/openstack/openstack-helm/blob/master/barbican/templates/bin/_barbican-test.sh.tpl03:19
osh-chatbot<xiaods> got it03:19
* portdirect that gets run via this pod: https://github.com/openstack/openstack-helm/blob/master/barbican/templates/pod-test.yaml03:19
osh-chatbot<mattmceuen> Same goes for non-openstack services like rabbit: pod: https://github.com/openstack/openstack-helm/blob/master/rabbitmq/templates/pod-test.yaml script: https://github.com/openstack/openstack-helm/blob/master/rabbitmq/templates/bin/_rabbitmq-test.sh.tpl03:20
osh-chatbot<mattmceuen> All the plumbing can be modeled after those examples above -- the custom part is putting the right stuff in the test script to check and see whether the service is up and running03:21
portdirectwhats nice about this is you can see - apart from the env vars (https://github.com/openstack/openstack-helm/blob/master/rabbitmq/templates/pod-test.yaml#L40-L41) and script itself, the rabbit and barbican one are identical03:21
*** unicell has joined #openstack-helm03:36
*** unicell has quit IRC03:40
*** yamamoto has joined #openstack-helm03:51
*** caoyuan has quit IRC03:55
*** caoyuan has joined #openstack-helm03:55
*** yamamoto has quit IRC03:57
openstackgerritMatt McEuen proposed openstack/openstack-helm master: Update Multinode guide  https://review.openstack.org/57634203:57
*** yamamoto has joined #openstack-helm04:01
*** caoyuan has quit IRC04:03
*** caoyuan has joined #openstack-helm04:07
*** mdih has joined #openstack-helm04:09
*** jgu has quit IRC04:35
*** unicell has joined #openstack-helm04:37
*** unicell has quit IRC04:42
openstackgerritzhulingjie proposed openstack/openstack-helm master: Remove the duplicated words  https://review.openstack.org/57635205:06
openstackgerritzhulingjie proposed openstack/openstack-helm-infra master: Remove the duplicated word  https://review.openstack.org/57635405:11
*** sgrasley has quit IRC05:29
osh-chatbot<xiaods> in helm-infra, how to reproduce roles , eg .  TASK [build-helm-packages : checking if local helm server is running]05:31
osh-chatbot<xiaods> i want to debug the role05:32
*** unicell has joined #openstack-helm05:38
*** unicell has quit IRC05:42
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP/RFC: Add configuration for oslo fluent handler and formatter  https://review.openstack.org/57600105:49
*** unicell has joined #openstack-helm06:18
*** julim has quit IRC06:36
*** julim has joined #openstack-helm06:36
*** unicell1 has joined #openstack-helm06:39
*** ispp has joined #openstack-helm06:39
*** unicell has quit IRC06:40
openstackgerritXiao Deshi proposed openstack/openstack-helm-infra master: enhance: support macos devel environment  https://review.openstack.org/57065807:37
*** gkadam has joined #openstack-helm07:54
*** roman_g has joined #openstack-helm08:05
*** gkadam has quit IRC08:13
*** gkadam has joined #openstack-helm08:13
openstackgerritJaesang Lee proposed openstack/openstack-helm master: Add ceph configuration for cinder-backup  https://review.openstack.org/57414608:21
*** caoyuan has quit IRC08:50
*** caoyuan has joined #openstack-helm08:51
*** radek__ has joined #openstack-helm08:53
*** gkadam has quit IRC08:54
*** caoyuan has quit IRC08:58
*** caoyuan has joined #openstack-helm08:59
*** caoyuan has quit IRC09:03
*** caoyuan has joined #openstack-helm09:08
*** caoyuan has quit IRC09:12
openstackgerritXiao Deshi proposed openstack/openstack-helm-infra master: enhance: support macos devel environment  https://review.openstack.org/57065809:14
*** goutham has joined #openstack-helm09:19
*** caoyuan has joined #openstack-helm09:22
gouthamHi all is there any documentation so as to deploy multinode openstack-helm using armada ??10:10
gouthamhttps://github.com/openstack/openstack-helm/blob/master/tools/deployment/armada/020-armada-render-manifests.sh or does this take care of the deployment??10:12
*** radek__ has quit IRC10:18
*** yamamoto has quit IRC10:50
*** roman_g has quit IRC10:56
*** roman_g has joined #openstack-helm10:56
*** yamamoto has joined #openstack-helm10:58
osh-chatbot<maciej.naruszewicz> where can I find Dockerfiles for openstackhelm/* Docker images?11:05
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP/RFC: Add configuration for oslo fluent handler and formatter  https://review.openstack.org/57600111:23
*** yamamoto has joined #openstack-helm11:48
*** julim has quit IRC12:03
*** yamamoto has quit IRC12:15
*** jistr is now known as jistr|mtg12:28
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Update toolkit to support ingress TLS  https://review.openstack.org/56813212:28
openstackgerritPete Birley proposed openstack/openstack-helm master: Ingress TLS for keystone  https://review.openstack.org/56635012:29
portdirectmaciej.naruszewicz: the source for these images is here: https://github.com/openstack/openstack-helm/tree/master/tools/images/openstack12:29
portdirectwe use the LOCI project to build them: https://github.com/openstack/loci12:30
portdirectgoutham: this part of our documentation is severely lacking atm12:31
portdirectthe gate scripts you found would be the best place to start12:31
rwellummorning portdirect12:31
rwellumMariadb describe:12:31
rwellumhttps://www.irccloud.com/pastebin/sR01xfwM/12:31
portdirectbut i hope over the next month we really start to round out this picture with the work rwellum and mattmceuen are doing12:31
gouthamhmm ok portdirect if i can do it i will document it thanks BTW12:31
goutham:)12:31
portdirectrwellum: did you set up your resolv conf to be able to resolve cluster addresses from your host?12:32
portdirectline 6 in that event output above looks like its not?12:35
osh-chatbot<maciej.naruszewicz> @rwellum - thanks!12:35
rwellumportdirect: nope - probably another step I missed12:36
rwellumI see this:12:38
rwellumhttps://www.irccloud.com/pastebin/my2BJTix/12:38
portdirectrwellum: we already discussed this, https://github.com/openstack/openstack-helm-infra/blob/master/tools/images/kubeadm-aio/assets/opt/playbooks/roles/deploy-kubelet/templates/resolv.conf.j212:39
portdirectif you look through the playbook you'll find all you need thats missing from the doc atm for what your trying to do12:39
portdirectyou will need to make sure that this: https://github.com/openstack/openstack-helm-infra/blob/master/tools/images/kubeadm-aio/assets/opt/playbooks/roles/deploy-kubelet/templates/resolv.conf.j2#L212:41
portdirectmatches the same service ip you are using for your cluster dns ip12:41
*** sgrasley has joined #openstack-helm12:42
rwellumGot it - thanks. I see a couple other things I missed too. I didn't dig into that roles dir.12:43
portdirectcan you try to add anything else you come across to the etherpad: https://etherpad.openstack.org/p/openstack-helm-multinode-doc12:44
portdirectas it will really help with the doc update work12:44
rwellumportdirect: Yes I am writing everything down - will update when I get a successful deployment12:45
*** yamamoto has joined #openstack-helm12:46
portdirectok - though id really recommend you use the etherpad you made12:46
portdirectits super useful for both us, and other people wanting to get involved12:46
rwellumOh sure - yeah good point indeed12:47
*** goutham has quit IRC12:54
openstackgerritPete Birley proposed openstack/openstack-helm master: Ingress TLS for keystone  https://review.openstack.org/56635012:58
*** caoyuan has quit IRC13:00
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Update toolkit to support ingress TLS  https://review.openstack.org/56813213:03
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP/RFC: Add configuration for oslo fluent handler and formatter  https://review.openstack.org/57600113:03
srwilkersmorning13:04
*** julim has joined #openstack-helm13:08
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Rally-Tests: allow os-interface to be defined  https://review.openstack.org/57651613:09
rwellumportdirect: updated etherpad with progress so far and restarting next run with the various changes - see how far I get.13:11
rwellumMorning srwilkers !13:11
srwilkershey rwellum :)13:12
*** radek__ has joined #openstack-helm13:27
*** aaronsheffield has joined #openstack-helm13:31
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Keystone: use internal interface by default  https://review.openstack.org/57652313:33
*** yamamoto has quit IRC13:34
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Keystone: use internal interface by default  https://review.openstack.org/57652313:34
*** eeiden has joined #openstack-helm13:40
*** jistr|mtg is now known as jistr13:42
*** d|k has quit IRC13:45
*** d|k has joined #openstack-helm13:45
rwellumsrwilkers: got a very basic qn :) If I create a single node osh, then use kubeadm to join more nodes, labeling them as computes, the k8s scheduler starts moving things around based on it's scheduling algorithm - does this work well/at all in the osh context? I'm thinking ceph at a minimum would be not well distributed - but not sure.13:52
*** yamamoto has joined #openstack-helm13:55
*** yamamoto has joined #openstack-helm13:57
*** ethfci has joined #openstack-helm13:58
*** ethfci has quit IRC13:59
*** ethfci has joined #openstack-helm14:01
*** jgu has joined #openstack-helm14:01
*** ethfci has quit IRC14:01
portdirectrwellum: works perfectly :)14:03
portdirectthough as you correctly point out - ceph is the slight expetion to this14:03
portdirecthere, as you need to have knowelge of the number of osd's etc14:04
portdirectyou will only be able to expand the cluster vir athis method by about 25% before needing to run a ceph update, taking into account the increased number of osd's14:05
portdirects/vir athis/by this14:05
rwellumAh fantastic. Something else to try and document then :)14:05
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add logging.conf files to enabled loggers/handlers/formatters  https://review.openstack.org/57600114:07
*** jgu_ has joined #openstack-helm14:08
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Update toolkit to support ingress TLS  https://review.openstack.org/56813214:08
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add logging.conf files to enabled loggers/handlers/formatters  https://review.openstack.org/57600114:08
*** jgu has quit IRC14:11
*** jgu_ has quit IRC14:11
rwellumportdirect: seeing one chart issue:14:12
rwellumhttps://www.irccloud.com/pastebin/kvOk0nR2/14:12
*** felipemonteiro_ has joined #openstack-helm14:15
*** yamamoto has quit IRC14:16
*** felipemonteiro__ has joined #openstack-helm14:17
*** caoyuan has joined #openstack-helm14:18
*** felipemonteiro_ has quit IRC14:21
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add fluentbit sidecars to ceph mon and ceph osd charts  https://review.openstack.org/57583214:22
srwilkersrwellum: that looks like you're running make in a place that has directories not excluded by the makefile14:24
srwilkershttps://github.com/openstack/openstack-helm-infra/blob/master/Makefile#L2114:24
rwellumHmm I just cloned the repo and did a make all14:25
rwellumWell I've done a few git pulls in-between, trying again with new pulls14:27
rwellumThat did it - sorry for noise14:29
*** yamamoto has joined #openstack-helm14:30
*** yamamoto has quit IRC14:35
openstackgerritSamuel Pilla proposed openstack/openstack-helm master: Passwordless sudo Documentation  https://review.openstack.org/57521514:37
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add logging.conf files to enabled loggers/handlers/formatters  https://review.openstack.org/57600114:39
openstackgerritSamuel Pilla proposed openstack/openstack-helm master: Passwordless sudo Documentation  https://review.openstack.org/57521514:40
*** felipemonteiro__ has quit IRC14:43
*** sthussey has joined #openstack-helm14:44
*** yamamoto has joined #openstack-helm14:46
*** yamamoto has quit IRC14:50
mattmceuenSeven minutes till team meeting!  Here's the agenda, please find great joy and inner peace by adding things you'd like to discuss to it.  https://etherpad.openstack.org/p/openstack-helm-meeting-2018-06-1914:54
rwellumportdirect: having an issue with the cleanup steps for ceph14:56
rwellumhttps://www.irccloud.com/pastebin/3iUP5aJo/14:56
portdirectWhat did you run prior to that?14:57
rwellumIn terms of cleanup nothing14:59
rwellumI cleaned up my cluster though14:59
rwellumIf that makes sense sorry14:59
portdirectFrom the error, helm cannot reach tiller14:59
rwellumAh - well that makes sense.15:00
mattmceuenMeeting time15:00
portdirectWhich cannot be the case unless some other action was performed before running the cleanup commands.15:00
*** yamamoto has joined #openstack-helm15:01
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Update armada multinode manifests  https://review.openstack.org/57619815:02
*** jgu has joined #openstack-helm15:03
*** yamamoto has quit IRC15:05
*** zhangfei has quit IRC15:15
*** yamamoto has joined #openstack-helm15:16
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add logging.conf files to enabled loggers/handlers/formatters  https://review.openstack.org/57600115:18
*** yamamoto has quit IRC15:20
openstackgerritcaoyuan proposed openstack/openstack-helm master: Update the path of vars.yaml  https://review.openstack.org/57655915:26
*** caoyuan has quit IRC15:28
*** caoyuan has joined #openstack-helm15:29
*** yamamoto has joined #openstack-helm15:31
*** yamamoto has quit IRC15:35
*** ispp has quit IRC15:41
openstackgerritMerged openstack/openstack-helm-infra master: Rally-Tests: allow os-interface to be defined  https://review.openstack.org/57651615:50
openstackgerritMerged openstack/openstack-helm-infra master: Keystone: use internal interface by default  https://review.openstack.org/57652316:00
*** jgu has quit IRC16:00
osh-chatbot<xiaods> File uploaded https://kubernetes.slack.com/files/UAPN4SV8C/FB9MZ3HB3/ansible_install_k8s_on_macos.sh / https://slack-files.com/T09NY5SBT-FB9MZ3HB3-e229e1dab316:12
*** caoyuan has quit IRC16:15
*** yamamoto has joined #openstack-helm16:15
*** jgu has joined #openstack-helm16:16
*** yamamoto has quit IRC16:20
*** jgu_ has joined #openstack-helm16:21
*** jgu has quit IRC16:24
osh-chatbot<xiaods> macos environment , python 3.616:27
*** yamamoto has joined #openstack-helm16:30
*** yamamoto has quit IRC16:35
osh-chatbot<xiaods> got the root cause: openstackhelm/kubeadm-aio:dev image have no docker-py package16:35
osh-chatbot<xiaods> sign16:35
osh-chatbot<xiaods> :i_love_you_hand_sign:16:35
openstackgerritMerged openstack/openstack-helm master: Remove the duplicated words  https://review.openstack.org/57635216:37
*** unicell1 has quit IRC16:41
*** yamamoto has joined #openstack-helm16:45
*** yamamoto has quit IRC16:50
*** goutham has joined #openstack-helm17:00
*** yamamoto has joined #openstack-helm17:01
*** yamamoto has quit IRC17:05
openstackgerritMerged openstack/openstack-helm-infra master: Kube-State-Metrics: Change default image used  https://review.openstack.org/57515717:07
portdirectxaiods: docker-py should be on the host, not in the image17:13
*** yamamoto has joined #openstack-helm17:15
*** yamamoto has quit IRC17:20
*** julim_ has joined #openstack-helm17:30
*** yamamoto has joined #openstack-helm17:31
*** julim has quit IRC17:31
*** yamamoto has quit IRC17:35
*** goutham has quit IRC17:43
*** yamamoto has joined #openstack-helm17:45
*** yamamoto has quit IRC17:50
*** yamamoto has joined #openstack-helm18:00
*** unicell has joined #openstack-helm18:02
*** yamamoto has quit IRC18:05
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add fluentbit sidecars to ceph mon and ceph osd charts  https://review.openstack.org/57583218:09
openstackgerritRenis Makadia proposed openstack/openstack-helm master: WIP - Test/Fix Ceph upgrade  https://review.openstack.org/57659918:13
rwellumhey portdirect  - so I added my cluster dns addr to resolv.conf but getting same issue as before18:13
*** yamamoto has joined #openstack-helm18:15
*** yamamoto has quit IRC18:20
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add logging.conf files to enabled loggers/handlers/formatters  https://review.openstack.org/57600118:21
*** yamamoto has joined #openstack-helm18:30
*** yamamoto has quit IRC18:35
*** yamamoto has joined #openstack-helm18:36
openstackgerritRenis Makadia proposed openstack/openstack-helm master: WIP - Test/Fix Ceph upgrade  https://review.openstack.org/57659918:51
openstackgerritSangeet Gupta proposed openstack/openstack-helm-infra master: Add annotation.  https://review.openstack.org/57661418:58
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Helm-toolkit: Updates to support openstack logging.conf  https://review.openstack.org/57661619:03
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add logging.conf files to enabled loggers/handlers/formatters  https://review.openstack.org/57600119:04
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Helm-toolkit: Updates manifests to support openstack logging.conf  https://review.openstack.org/57661619:10
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add logging.conf files to enabled loggers/handlers/formatters  https://review.openstack.org/57600119:21
*** jgu_ has quit IRC19:21
openstackgerritMerged openstack/openstack-helm master: Passwordless sudo Documentation  https://review.openstack.org/57521519:29
*** Romik has joined #openstack-helm19:34
*** yamamoto has joined #openstack-helm19:36
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Helm-toolkit: Updates manifests to support openstack logging.conf  https://review.openstack.org/57661619:36
portdirectrwellum: can you try dig or another util to see if its working?19:37
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add logging.conf files to enabled loggers/handlers/formatters  https://review.openstack.org/57600119:37
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Update toolkit to support ingress TLS  https://review.openstack.org/56813219:41
openstackgerritPete Birley proposed openstack/openstack-helm master: Ingress TLS for keystone  https://review.openstack.org/56635019:42
*** yamamoto has quit IRC19:42
openstackgerritSangeet Gupta proposed openstack/openstack-helm-infra master: kubernetes-keystone-webook: add missing annotation  https://review.openstack.org/57661419:44
rwellumwhat's 'dig' portdirect ?19:49
*** radek__ has quit IRC19:49
rwellumI'm thinking it might be my rbac rules - I haven't changed them in a while.19:50
anticwdig is use to query dns19:52
anticwrwellum: `dig google.com` works?19:52
*** Romik has quit IRC19:55
rwellumOh - cool. Yeah dig to google and my cluster ip is happy19:56
anticwyou can also use @ip or @host to query something directly19:59
anticwdig kubernetes.default.svc.cluster.local.  @10.96.0.1020:00
anticwfor example20:00
rwellumAh so dig 10.96.0.10 is fine, but the above you suggested isn't20:02
anticwif you don't use @ ... it will use whatever is in resolv.conf ... is that correct?20:08
rwellumSo the complaint is:20:10
rwellumhttps://www.irccloud.com/pastebin/NoLxJXa5/20:11
rwellumserver name not found: ceph-mon.ceph.svc.cluster.local20:11
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Helm-toolkit: Updates manifests to support openstack logging.conf  https://review.openstack.org/57661620:12
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add logging.conf files to enabled loggers/handlers/formatters  https://review.openstack.org/57600120:13
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add fluentbit sidecars to ceph mon and ceph osd charts  https://review.openstack.org/57583220:18
anticwwhat is resolv conf?20:19
anticwrwellum: /etc/resolv.conf20:19
anticwrwellum: also what is kubectl -n kube-system get svc kube-dns -o json | jq -r .spec.clusterIP20:23
openstackgerritRenis Makadia proposed openstack/openstack-helm master: WIP - Test/Fix Ceph upgrade  https://review.openstack.org/57659920:24
rwellumhttps://www.irccloud.com/pastebin/d63qay5w/20:31
rwellumhttps://www.irccloud.com/pastebin/H8GW1izi/20:31
rwellumThat's not good :)20:32
anticwok ... so you resolv.conf really needs to point and kube-dns ... which for you is 10.3.3.1020:33
anticwbefore changing you can test with dig20:33
anticwdig kubernetes.default.svc.cluster.local. @10.3.3.1020:34
anticwshould work...20:34
portdirectalso - you'll need to order the lookups20:34
anticwalso ... i having 
192.168.122.1before20:34
anticwwon't work20:34
rwellumIt does work - thanks anticw20:34
rwellumI changed the addr to 10.3.3.10 - for some reason way back in time..20:35
rwellumMaybe there was a clash or something20:35
portdirectyou'll really want this in there as well: https://github.com/openstack/openstack-helm-infra/blob/master/tools/images/kubeadm-aio/assets/opt/playbooks/roles/deploy-kubelet/templates/resolv.conf.j2#L620:36
portdirectat least the `timeout:1 attempts:1` part20:36
portdirectas this ensures that your dns servers are used in order20:36
portdirectotherwise there is no gtee that you will hit the k8s dns service, and then fall back to `192.168.122.1` if its not active20:37
*** yamamoto has joined #openstack-helm20:38
rwellumOk cool - retrying, and added this to the etherpad20:40
*** yamamoto has quit IRC20:47
anticwrwellum: in most cases any pending PVs will get created now20:48
anticwecho "**CLAIMS**" ; kubectl get pvc --all-namespaces ; echo;echo "** PV ** "; kubectl get pv ; echo20:49
anticwsort of think can be useful20:49
anticwanything pending you can describe on, you did that about it seems20:49
rwellumGreat - also adding these steps to TS guide20:52
anticwwhere does that live at present?20:53
rwellumhttps://etherpad.openstack.org/p/openstack-helm-troubleshooting20:54
rwellumSeems like you could contribute effectively :)20:54
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Update toolkit to support ingress TLS  https://review.openstack.org/56813220:58
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: WIP: Use Elasticsearch to gather logs in post-run jobs  https://review.openstack.org/57300721:00
*** aaronsheffield has quit IRC21:03
anticwthanks21:06
openstackgerritPete Birley proposed openstack/openstack-helm master: Ingress TLS for keystone  https://review.openstack.org/56635021:11
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Update armada multinode manifests  https://review.openstack.org/57619821:13
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Update armada multinode manifests  https://review.openstack.org/57619821:14
*** jgu has joined #openstack-helm21:18
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Helm-toolkit: Updates manifests to support openstack logging.conf  https://review.openstack.org/57661621:21
*** jgu_ has joined #openstack-helm21:22
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Add logging.conf files to enabled loggers/handlers/formatters  https://review.openstack.org/57600121:22
*** mihdih_ has joined #openstack-helm21:23
*** mdih has quit IRC21:26
*** jgu has quit IRC21:26
openstackgerritPete Birley proposed openstack/openstack-helm master: Ingress TLS for keystone  https://review.openstack.org/56635021:27
*** julim_ has quit IRC21:35
*** yamamoto has joined #openstack-helm21:43
*** yamamoto has quit IRC21:48
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Update toolkit to support ingress TLS  https://review.openstack.org/56813222:26
openstackgerritPete Birley proposed openstack/openstack-helm master: Ingress TLS for keystone  https://review.openstack.org/56635022:26
*** yamamoto has joined #openstack-helm22:44
osh-chatbot<xiaods> hi team, docker run --entrypoint=/bin/bash -it --rm openstackhelm/kubeadm-aio:dev , the image should be pip install docker-py22:49
osh-chatbot<xiaods> but i found the Dockerfile not install docker-py22:49
*** yamamoto has quit IRC22:49
osh-chatbot<xiaods> anyone can confirm this limit?22:50
*** julim has joined #openstack-helm22:58
*** yamamoto has joined #openstack-helm23:46
*** yamamoto has quit IRC23:51
openstackgerritMerged openstack/openstack-helm master: Add fluentbit sidecars to ceph mon and ceph osd charts  https://review.openstack.org/57583223:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!