Tuesday, 2017-01-10

*** hashar has quit IRC00:02
*** armax has quit IRC00:02
*** claudiub has joined #openstack-infra00:03
openstackgerritHongbin Lu proposed openstack-infra/project-config: Fuxi: Add python35 dsvm non-voting jobs  https://review.openstack.org/41774100:04
*** wolverineav has joined #openstack-infra00:05
*** claudiub|2 has quit IRC00:06
*** wolverineav has quit IRC00:09
*** tjones has joined #openstack-infra00:11
*** dingyichen has joined #openstack-infra00:13
*** hongbin has quit IRC00:14
*** wolverineav has joined #openstack-infra00:14
ianwclarkb: i've refactored out most of that into what I think is a lot clearer a long time ago too -> https://review.openstack.org/#/c/364046/7/functions.sh00:15
ianwi could spend a bit of time re-merging it, if you think it's worth it and we can review it this time00:15
clarkbianw: I would sync up with sdague because he was saying this would enable the transition to local.conf away from localrc00:17
clarkbianw: so we probably want to make sure what ever we do doesn't hurt that effort, but ya I think cleanup in general is likely worthwhile00:17
ianwstackviz is also a bit broken https://review.openstack.org/#/c/364560/00:17
*** oomichi has quit IRC00:17
*** wolverineav has quit IRC00:19
*** oomichi has joined #openstack-infra00:19
ianwsdague: if you can drop a generic comment on https://review.openstack.org/#/c/364046 when around -- i'll re-merge it for proper review if you like the general direction, but it's fiddly work so i'd rather not waste time if it's just going to sit there.00:20
*** wolverineav has joined #openstack-infra00:24
openstackgerritMonty Taylor proposed openstack-infra/shade: DNM Testing a devstack revert patch  https://review.openstack.org/41792500:25
*** sdague has quit IRC00:26
*** rbuzatu has joined #openstack-infra00:27
*** xarses has quit IRC00:27
*** wolverineav has quit IRC00:29
*** rbuzatu has quit IRC00:30
*** vhosakot has joined #openstack-infra00:30
*** rbuzatu has joined #openstack-infra00:31
*** Julien-zte has joined #openstack-infra00:31
*** vhosakot has quit IRC00:32
*** mtanino_ has joined #openstack-infra00:33
*** vhosakot has joined #openstack-infra00:33
*** mtanino has quit IRC00:34
*** jmccrory has quit IRC00:37
*** jmccrory_ has joined #openstack-infra00:37
*** rm_work has quit IRC00:38
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483100:38
*** rm_work has joined #openstack-infra00:38
*** jmccrory_ is now known as jmccrory00:39
*** aeng has quit IRC00:41
jlvillalUnimportant gerritbot patch if anyone is bored: https://review.openstack.org/#/c/417450/   Will add the branch name of the patch announcement if it isn't master.00:42
*** wolverineav has joined #openstack-infra00:44
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611000:48
*** newmember has quit IRC00:48
*** wolverineav has quit IRC00:48
*** claudiub has quit IRC00:48
*** mriedem has joined #openstack-infra00:49
*** salv-orlando has joined #openstack-infra00:49
*** rbuzatu has quit IRC00:51
*** salv-orlando has quit IRC00:53
*** rbuzatu has joined #openstack-infra00:54
*** wolverineav has joined #openstack-infra00:54
*** aeng has joined #openstack-infra00:55
*** john-davidge has joined #openstack-infra00:55
*** wolverineav has quit IRC00:58
*** john-davidge has quit IRC01:00
*** thorst has joined #openstack-infra01:01
*** spzala has quit IRC01:01
*** wolverineav has joined #openstack-infra01:04
*** vhosakot has quit IRC01:06
*** oomichi has quit IRC01:07
*** wolverineav has quit IRC01:08
*** liujiong has joined #openstack-infra01:08
*** oomichi has joined #openstack-infra01:08
*** Swami__ has joined #openstack-infra01:09
*** rfolco has quit IRC01:11
*** lindycoder has joined #openstack-infra01:11
*** Swami_ has quit IRC01:12
*** Swami has quit IRC01:12
*** Swami has joined #openstack-infra01:12
*** inc0 has joined #openstack-infra01:12
*** rbuzatu has quit IRC01:13
*** rbuzatu has joined #openstack-infra01:13
*** rbuzatu has quit IRC01:15
*** rbuzatu has joined #openstack-infra01:15
*** rbuzatu has quit IRC01:16
*** rbuzatu has joined #openstack-infra01:16
*** thorst has quit IRC01:17
*** Swami has quit IRC01:18
*** Swami__ has quit IRC01:18
*** thorst has joined #openstack-infra01:20
*** rbuzatu has quit IRC01:20
*** yujunz has joined #openstack-infra01:21
*** yujunz has quit IRC01:21
*** yujunz has joined #openstack-infra01:22
*** camunoz has quit IRC01:22
*** wolverineav has joined #openstack-infra01:23
*** gyee has quit IRC01:24
*** inc0 has quit IRC01:27
*** wolverineav has quit IRC01:28
*** sdake has quit IRC01:29
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611001:29
*** david-lyle has joined #openstack-infra01:31
*** thorst has quit IRC01:32
*** MasterOfBugs has quit IRC01:32
*** yanyanhu has joined #openstack-infra01:32
*** wolverineav has joined #openstack-infra01:33
*** wolverin_ has joined #openstack-infra01:34
*** david-lyle has quit IRC01:37
*** wolverineav has quit IRC01:37
*** wolverin_ has quit IRC01:38
*** xarses has joined #openstack-infra01:46
*** rbuzatu has joined #openstack-infra01:46
*** markvoelker has quit IRC01:48
*** salv-orlando has joined #openstack-infra01:50
*** umeshksingla has quit IRC01:50
*** salv-orlando has quit IRC01:54
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611001:56
*** adrian_otto has quit IRC01:56
*** mtanino has joined #openstack-infra02:05
*** pahuang has quit IRC02:06
*** mtanino_ has quit IRC02:07
*** wolverineav has joined #openstack-infra02:07
*** yujunz is now known as yujunz[away]02:07
*** yujunz[away] is now known as yujunz02:09
*** yujunz is now known as yujunz[away]02:09
*** lindycoder has quit IRC02:10
*** wolverineav has quit IRC02:12
*** ijw has joined #openstack-infra02:16
*** ijw_ has quit IRC02:18
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes)  https://review.openstack.org/41809802:21
openstackgerritMerged openstack-infra/shade: Remove link to modindex  https://review.openstack.org/41548502:22
*** lennyb has quit IRC02:23
*** yonglihe has joined #openstack-infra02:23
*** pahuang has joined #openstack-infra02:24
*** lennyb has joined #openstack-infra02:24
*** kjorgens_ has quit IRC02:24
*** umeshksingla has joined #openstack-infra02:31
*** wolverineav has joined #openstack-infra02:31
openstackgerritjeck proposed openstack-infra/project-config: [TrivialFix] Fix comment typo error  https://review.openstack.org/41818102:33
openstackgerritMerged openstack/diskimage-builder: Change "Openstack" to "OpenStack"  https://review.openstack.org/41418602:34
*** umeshksingla has quit IRC02:35
*** wolverineav has quit IRC02:36
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611002:39
*** mtanino has quit IRC02:42
*** yujunz[away] has quit IRC02:42
*** yujunz has joined #openstack-infra02:45
*** rlandy has quit IRC02:45
*** gildub has quit IRC02:48
*** yujunz is now known as yujunz[away]02:50
*** salv-orlando has joined #openstack-infra02:51
*** yujunz[away] is now known as yujunz02:51
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: TripleO containers job with quickstart  https://review.openstack.org/41625902:53
*** hongbin has joined #openstack-infra02:54
*** salv-orlando has quit IRC02:55
*** winggundamth has joined #openstack-infra03:00
openstackgerritjeck proposed openstack-infra/project-config: Add Apache 2.0 license to source file  https://review.openstack.org/41818703:02
openstackgerritRabi Mishra proposed openstack-infra/project-config: Disable the correct service n-novnc  https://review.openstack.org/41818803:03
*** csomerville has quit IRC03:04
*** csomerville has joined #openstack-infra03:05
openstackgerritMerged openstack-infra/shade: Add support for using the default subnetpool  https://review.openstack.org/41631903:05
*** woodster_ has quit IRC03:05
*** adrian_otto has joined #openstack-infra03:09
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Create new TripleO experimental job for Heat convergence  https://review.openstack.org/41760203:11
*** rhallisey has quit IRC03:11
*** lindycoder has joined #openstack-infra03:15
*** adrian_otto has quit IRC03:16
*** adrian_otto has joined #openstack-infra03:18
openstackgerritMonty Taylor proposed openstack/os-client-config: Swap the order of interface and endpoint_type  https://review.openstack.org/41819203:19
*** mtanino has joined #openstack-infra03:19
*** vikrant has joined #openstack-infra03:23
*** dotplus has quit IRC03:25
*** gildub has joined #openstack-infra03:29
*** adrian_otto has quit IRC03:29
*** mtanino has quit IRC03:29
*** adrian_otto has joined #openstack-infra03:30
*** inc0 has joined #openstack-infra03:34
*** camunoz has joined #openstack-infra03:34
*** ramishra has joined #openstack-infra03:36
*** yamahata has quit IRC03:37
*** wolverineav has joined #openstack-infra03:37
*** ramishra has quit IRC03:42
*** mtanino has joined #openstack-infra03:43
*** wolverineav has quit IRC03:44
*** markvoelker has joined #openstack-infra03:48
*** ramishra has joined #openstack-infra03:50
*** salv-orlando has joined #openstack-infra03:52
*** nicolasbock has quit IRC03:53
*** links has joined #openstack-infra03:54
*** dave-mccowan has quit IRC03:55
*** yujunz has quit IRC03:55
*** yujunz has joined #openstack-infra03:56
*** yujunz has quit IRC03:56
*** salv-orlando has quit IRC03:57
*** inc0 has quit IRC04:03
*** lindycoder has quit IRC04:06
*** lindycoder has joined #openstack-infra04:07
*** hongbin has quit IRC04:12
*** psachin has joined #openstack-infra04:15
*** links has quit IRC04:21
*** links has joined #openstack-infra04:22
*** sdake has joined #openstack-infra04:23
*** cburgess has quit IRC04:25
*** cburgess has joined #openstack-infra04:25
openstackgerritMerged openstack/diskimage-builder: Update component docs to refer to ironic-agent  https://review.openstack.org/41637904:27
*** wolverineav has joined #openstack-infra04:29
*** lindycoder has quit IRC04:31
*** wolverineav has quit IRC04:34
*** adrian_otto1 has joined #openstack-infra04:34
*** adrian_otto has quit IRC04:37
*** bhavik1 has joined #openstack-infra04:39
*** bhavik1 has quit IRC04:43
*** sreeram_v has joined #openstack-infra04:45
*** mtanino has quit IRC04:46
*** gildub has quit IRC04:51
*** nadya has joined #openstack-infra04:51
*** salv-orlando has joined #openstack-infra04:53
*** ijw_ has joined #openstack-infra04:54
*** snarwade has joined #openstack-infra04:54
*** wolverineav has joined #openstack-infra04:56
*** ijw has quit IRC04:57
*** nadya has quit IRC04:57
*** salv-orlando has quit IRC04:57
*** adrian_otto1 has quit IRC05:00
*** adrian_otto has joined #openstack-infra05:01
*** itisha has quit IRC05:02
*** wolverineav has quit IRC05:03
*** camunoz has quit IRC05:06
*** nadya has joined #openstack-infra05:07
*** camunoz has joined #openstack-infra05:08
*** markvoelker_ has joined #openstack-infra05:12
*** adrian_otto has quit IRC05:12
openstackgerritIan Wienand proposed openstack/diskimage-builder: Update platform support to reality  https://review.openstack.org/41820405:14
*** markvoelker has quit IRC05:15
*** markvoelker has joined #openstack-infra05:17
*** nadya has quit IRC05:20
*** adriant has quit IRC05:20
*** markvoelker_ has quit IRC05:20
*** ihrachys has quit IRC05:21
*** umeshksingla has joined #openstack-infra05:23
*** yujunz has joined #openstack-infra05:26
*** umeshksingla has quit IRC05:30
openstackgerritJohn L. Villalovos proposed openstack-infra/gerritbot: For patch submitted/merged, announce the branch  https://review.openstack.org/41745005:30
*** sdake_ has joined #openstack-infra05:30
*** wolverineav has joined #openstack-infra05:30
*** bhavik1 has joined #openstack-infra05:31
*** sdake has quit IRC05:32
*** wolverineav has quit IRC05:41
*** pradk has quit IRC05:42
*** xarses has quit IRC05:46
*** xarses has joined #openstack-infra05:47
*** yamahata has joined #openstack-infra05:48
*** wolverineav has joined #openstack-infra05:50
*** yujunz is now known as yujunz[away]05:50
*** john-davidge has joined #openstack-infra05:50
openstackgerritJohn L. Villalovos proposed openstack-infra/gerritbot: For patch submitted/merged, announce the branch  https://review.openstack.org/41745005:50
*** yujunz[away] is now known as yujunz05:50
*** yujunz is now known as yujunz[away]05:51
*** yujunz[away] is now known as yujunz05:51
*** yujunz is now known as yujunz[away]05:51
*** yujunz[away] is now known as yujunz05:53
*** salv-orlando has joined #openstack-infra05:53
*** wolverineav has quit IRC05:54
*** john-davidge has quit IRC05:54
*** bhavik1 has quit IRC05:56
*** pradk has joined #openstack-infra05:56
*** salv-orlando has quit IRC05:58
*** yujunz-zte has joined #openstack-infra06:02
*** tuanluong has joined #openstack-infra06:04
*** yujunz has quit IRC06:05
*** xarses_ has joined #openstack-infra06:05
*** zzzeek has quit IRC06:06
*** xarses_ has quit IRC06:06
*** sdake has joined #openstack-infra06:06
*** xarses_ has joined #openstack-infra06:06
*** xarses has quit IRC06:07
*** sdake_ has quit IRC06:09
*** zzzeek has joined #openstack-infra06:10
*** salv-orlando has joined #openstack-infra06:18
*** wolverineav has joined #openstack-infra06:18
*** wolverineav has quit IRC06:23
*** pcaruana has quit IRC06:26
*** ekuris has joined #openstack-infra06:32
*** armax has joined #openstack-infra06:38
*** sreeram_v has quit IRC06:41
*** claudiub has joined #openstack-infra06:45
*** csomerville has quit IRC06:48
*** wolverineav has joined #openstack-infra06:49
*** Guest65629 has quit IRC06:49
jianghuawmordred, the floatIP assignment issue in my env is due to the shade in my lab is old. After upgrading it, it can work with now. Specially I have to set "default_interface: true" for my admin_internal_net, otherwise there is error as:06:49
jianghuawshade.exc.OpenStackCloudException: Error in creating instance (Inner Exception: Multiple possible networks found, use a Network ID to be more specific. (HTTP 409) (Request-ID: req-5bb4a00d-4250-4199-ae9d-eae0e17663a6))06:49
*** armax has quit IRC06:53
*** yujunz-zte is now known as yujunz[away]06:54
*** wolverineav has quit IRC06:54
*** sree has joined #openstack-infra06:56
*** mminesh has quit IRC06:57
*** rbuzatu has quit IRC07:00
*** rbuzatu has joined #openstack-infra07:00
*** rbuzatu has quit IRC07:00
*** rbuzatu has joined #openstack-infra07:00
*** yujunz[away] is now known as yujunz-zte07:00
*** rbuzatu has quit IRC07:00
*** rbuzatu has joined #openstack-infra07:01
*** rbuzatu has quit IRC07:01
*** rbuzatu has joined #openstack-infra07:01
*** pradk has quit IRC07:02
*** rbuzatu has quit IRC07:02
*** rbuzatu has joined #openstack-infra07:02
*** rbuzatu has quit IRC07:02
*** rbuzatu has joined #openstack-infra07:03
*** inc0 has joined #openstack-infra07:03
*** sdake_ has joined #openstack-infra07:03
*** inc0 has quit IRC07:03
*** rbuzatu has quit IRC07:04
*** rbuzatu has joined #openstack-infra07:04
*** rbuzatu has quit IRC07:04
*** rbuzatu has joined #openstack-infra07:04
*** sdake has quit IRC07:06
*** wolverineav has joined #openstack-infra07:06
openstackgerritjeck proposed openstack-infra/project-config: Add Apache 2.0 license to source file  https://review.openstack.org/41818707:06
*** rbuzatu has quit IRC07:07
*** rbuzatu has joined #openstack-infra07:07
*** rbuzatu has quit IRC07:07
*** rbuzatu has joined #openstack-infra07:07
*** tjones has quit IRC07:09
*** rbuzatu has quit IRC07:10
*** rbuzatu has joined #openstack-infra07:10
*** andreas_s has joined #openstack-infra07:12
*** markus_z has joined #openstack-infra07:13
*** wolverineav has quit IRC07:13
*** tesseract has joined #openstack-infra07:13
*** rcernin has joined #openstack-infra07:17
*** salv-orlando has quit IRC07:18
*** pradk has joined #openstack-infra07:18
*** drifterza has joined #openstack-infra07:18
*** makowals has quit IRC07:20
*** amotoki has joined #openstack-infra07:24
*** makowals has joined #openstack-infra07:26
*** csomerville has joined #openstack-infra07:27
*** yuval has joined #openstack-infra07:27
*** yamahata has quit IRC07:28
*** sdake has joined #openstack-infra07:30
*** sdake_ has quit IRC07:32
*** gildub has joined #openstack-infra07:32
*** cody-somerville has joined #openstack-infra07:32
*** yujunz-zte is now known as yujunz[away]07:33
*** wolverineav has joined #openstack-infra07:33
*** yujunz[away] is now known as yujunz-zte07:34
*** csomerville has quit IRC07:35
*** furlongm has quit IRC07:39
*** furlongm_ has joined #openstack-infra07:40
*** nherciu_ has joined #openstack-infra07:41
*** nherciu__ has joined #openstack-infra07:44
*** wolverineav has quit IRC07:44
*** nherciu_ has quit IRC07:47
*** eranrom has joined #openstack-infra07:49
*** wolverineav has joined #openstack-infra07:59
*** pgadiya has joined #openstack-infra08:00
*** wolverineav has quit IRC08:03
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611008:05
*** umeshksingla has joined #openstack-infra08:05
*** wolverineav has joined #openstack-infra08:06
*** pcaruana has joined #openstack-infra08:09
*** e0ne has joined #openstack-infra08:11
*** wolverineav has quit IRC08:11
*** salv-orlando has joined #openstack-infra08:11
*** umeshksingla has quit IRC08:12
*** umeshksingla has joined #openstack-infra08:13
*** florianf has joined #openstack-infra08:15
*** umeshksingla has quit IRC08:15
*** ralonsoh has joined #openstack-infra08:17
*** stakeda has quit IRC08:18
*** flepied has joined #openstack-infra08:20
*** Hal has joined #openstack-infra08:24
*** Hal is now known as Guest1156308:24
*** strigazi_AFK is now known as strigazi08:26
*** wolverineav has joined #openstack-infra08:31
*** hashar has joined #openstack-infra08:32
*** winggundamth has quit IRC08:34
*** panda|zZ is now known as panda08:35
*** yujunz-zte is now known as yujunz[away]08:35
*** yujunz[away] is now known as yujunz-zte08:35
*** wolverineav has quit IRC08:36
*** yujunz-zte is now known as yujunz[away]08:36
*** yujunz[away] is now known as yujunz-zte08:36
*** yujunz-zte is now known as yujunz[away]08:37
*** yujunz[away] is now known as yujunz-zte08:37
*** ccamacho has joined #openstack-infra08:37
*** e0ne has quit IRC08:40
*** dingyichen has quit IRC08:41
*** wolverineav has joined #openstack-infra08:42
*** timothyb89 has quit IRC08:43
*** timothyb89 has joined #openstack-infra08:44
*** wolverineav has quit IRC08:47
*** e0ne has joined #openstack-infra08:47
*** umeshksingla has joined #openstack-infra08:47
*** wolverineav has joined #openstack-infra08:50
*** spligak has quit IRC08:50
*** dimtruck is now known as zz_dimtruck08:50
*** eranrom has quit IRC08:52
*** jpich has joined #openstack-infra08:53
*** dtantsur has quit IRC08:53
rcarrillocruzclarkb: i've been poking at compute002.ch08:53
rcarrillocruzi can't get onto ssh via public ip08:54
*** flepied has quit IRC08:54
rcarrillocruzbut i got into the iLO and got a shell08:54
*** nmagnezi has joined #openstack-infra08:54
rcarrillocruzthe issue is a networking problem08:54
rcarrillocruzthe machien can't ping the default gw08:54
rcarrillocruzi think something's up with the switch port08:54
*** rcernin has quit IRC08:54
*** pblaho has quit IRC08:54
rcarrillocruzthis needs a ticket with networking08:54
*** tesseract has quit IRC08:54
*** priteau has joined #openstack-infra08:55
*** csaba has quit IRC08:55
*** pcaruana has quit IRC08:55
rcarrillocruzcheck with asselin if he can open one, the guy that can fix this from HPE NET side could be Abhishek Das08:55
*** eranrom has joined #openstack-infra08:55
rcarrillocruzfungi, pabelanger ^08:55
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611008:56
*** wolverineav has quit IRC08:56
*** rossella_s has joined #openstack-infra08:57
*** yujunz-zte is now known as yujunz[away]08:58
*** yujunz[away] is now known as yujunz-zte08:59
*** eranrom has quit IRC08:59
*** yujunz-zte is now known as yujunz[away]08:59
*** zzzeek has quit IRC09:00
*** dtantsur has joined #openstack-infra09:01
*** zzzeek has joined #openstack-infra09:02
*** rossella_ has joined #openstack-infra09:02
*** markus_z has quit IRC09:03
*** rossella_s has quit IRC09:03
*** yujunz[away] is now known as yujunz-zte09:04
*** yujunz-zte is now known as yujunz[away]09:05
*** yujunz[away] is now known as yujunz-zte09:05
*** yujunz-zte is now known as yujunz[away]09:06
*** jordanP has joined #openstack-infra09:06
*** gildub has quit IRC09:07
*** yujunz[away] is now known as yujunz-zte09:07
*** pblaho has joined #openstack-infra09:07
*** wolverineav has joined #openstack-infra09:07
*** tesseract has joined #openstack-infra09:07
*** rcernin has joined #openstack-infra09:08
*** csaba has joined #openstack-infra09:08
*** yujunz-zte is now known as yujunz[away]09:08
*** yujunz[away] is now known as yujunz-zte09:08
*** pcaruana has joined #openstack-infra09:08
*** yujunz-zte is now known as yujunz[away]09:08
*** yujunz[away] is now known as yujunz-zte09:09
*** yujunz-zte is now known as yujunz[away]09:09
*** aviau has quit IRC09:09
*** yujunz[away] is now known as yujunz-zte09:09
*** aviau has joined #openstack-infra09:09
*** yujunz-zte is now known as yujunz[away]09:10
*** yujunz[away] is now known as yujunz-zte09:10
*** yujunz-zte is now known as yujunz[away]09:10
*** yujunz[away] is now known as yujunz-zte09:11
*** yujunz-zte is now known as yujunz[away]09:11
*** yujunz[away] is now known as yujunz-zte09:11
*** yujunz-zte is now known as yujunz[away]09:12
*** yujunz[away] is now known as yujunz-zte09:12
*** yujunz-zte is now known as yujunz[away]09:12
*** yujunz[away] is now known as yujunz-zte09:13
*** yujunz-zte is now known as yujunz[away]09:13
*** yujunz[away] is now known as yujunz-zte09:13
*** yujunz-zte is now known as yujunz[away]09:14
*** yujunz[away] is now known as yujunz-zte09:14
*** derekh has joined #openstack-infra09:14
yolandagood morning09:14
*** yujunz-zte is now known as yujunz[away]09:14
*** yujunz[away] is now known as yujunz-zte09:15
*** wolverineav has quit IRC09:15
*** yujunz-zte is now known as yujunz[away]09:15
*** yujunz[away] is now known as yujunz-zte09:15
*** yujunz-zte is now known as yujunz[away]09:16
*** yujunz[away] is now known as yujunz-zte09:16
*** yujunz-zte is now known as yujunz[away]09:16
*** yujunz[away] is now known as yujunz-zte09:16
*** markus_z has joined #openstack-infra09:17
*** yujunz-zte is now known as yujunz[away]09:17
*** yujunz[away] is now known as yujunz-zte09:17
*** winggundamth has joined #openstack-infra09:17
*** lucas-afk is now known as lucasagomes09:18
*** yujunz-zte is now known as yujunz[away]09:18
*** yujunz[away] is now known as yujunz-zte09:18
*** yujunz-zte is now known as yujunz[away]09:18
*** yujunz[away] is now known as yujunz-zte09:19
*** yujunz-zte is now known as yujunz[away]09:19
*** yujunz[away] is now known as yujunz-zte09:19
*** yujunz-zte is now known as yujunz[away]09:20
*** yujunz[away] is now known as yujunz-zte09:20
*** yujunz-zte is now known as yujunz[away]09:20
openstackgerritMerged openstack-infra/project-config: Add fuel-ccp-grafana repository  https://review.openstack.org/41651809:21
*** yujunz[away] is now known as yujunz-zte09:21
*** yujunz-zte is now known as yujunz[away]09:21
*** yujunz[away] is now known as yujunz-zte09:21
*** yujunz-zte is now known as yujunz[away]09:22
*** yujunz[away] is now known as yujunz-zte09:22
openstackgerritMerged openstack-infra/project-config: Deprecate the amqp1 dsvm-functional test on centos 7  https://review.openstack.org/41797109:22
*** yujunz-zte is now known as yujunz[away]09:22
*** yujunz[away] is now known as yujunz-zte09:23
*** yujunz-zte is now known as yujunz[away]09:24
*** yujunz[away] is now known as yujunz-zte09:24
openstackgerritMerged openstack-infra/project-config: Create new TripleO experimental job for Heat convergence  https://review.openstack.org/41760209:24
*** yujunz-zte is now known as yujunz[away]09:24
*** yujunz[away] is now known as yujunz-zte09:24
openstackgerritMerged openstack-infra/project-config: Fuxi: get python35 jobs voting  https://review.openstack.org/41815709:25
openstackgerritMerged openstack-infra/project-config: Disable the correct service n-novnc  https://review.openstack.org/41818809:25
*** yujunz-zte is now known as yujunz[away]09:25
*** yujunz[away] is now known as yujunz-zte09:25
*** yujunz-zte is now known as yujunz[away]09:26
*** yujunz[away] is now known as yujunz-zte09:26
*** yujunz-zte is now known as yujunz[away]09:26
*** yujunz[away] is now known as yujunz-zte09:26
*** yujunz-zte is now known as yujunz[away]09:27
*** yujunz[away] is now known as yujunz-zte09:27
*** ccamacho has quit IRC09:27
*** yujunz-zte is now known as yujunz[away]09:27
*** yujunz[away] is now known as yujunz-zte09:28
*** yujunz-zte is now known as yujunz[away]09:28
*** yujunz[away] is now known as yujunz-zte09:28
*** yujunz-zte is now known as yujunz[away]09:29
*** yujunz[away] is now known as yujunz-zte09:29
*** yujunz-zte is now known as yujunz[away]09:29
*** yujunz[away] is now known as yujunz-zte09:30
*** yee379 has quit IRC09:30
*** yujunz-zte is now known as yujunz[away]09:30
*** yujunz[away] is now known as yujunz-zte09:30
*** yee379 has joined #openstack-infra09:30
*** flepied has joined #openstack-infra09:30
*** yujunz-zte is now known as yujunz[away]09:31
*** yujunz[away] is now known as yujunz-zte09:31
*** nadya has joined #openstack-infra09:31
*** yujunz-zte is now known as yujunz[away]09:31
*** yujunz[away] is now known as yujunz-zte09:31
*** yujunz-zte is now known as yujunz[away]09:32
*** lindycoder has joined #openstack-infra09:32
*** lindycoder has quit IRC09:32
*** yujunz[away] is now known as yujunz-zte09:32
*** yujunz-zte is now known as yujunz[away]09:33
*** yujunz[away] is now known as yujunz-zte09:33
*** yujunz-zte is now known as yujunz[away]09:34
*** yujunz[away] is now known as yujunz-zte09:34
*** dtantsur has quit IRC09:34
*** yujunz-zte is now known as yujunz[away]09:34
*** rcernin has quit IRC09:34
*** csaba has quit IRC09:35
*** pabelanger has quit IRC09:35
*** wznoinsk has quit IRC09:35
*** njohnston has quit IRC09:35
*** mmedvede has quit IRC09:35
*** abramley has quit IRC09:35
*** pblaho has quit IRC09:35
*** abramley has joined #openstack-infra09:35
*** wznoinsk has joined #openstack-infra09:35
*** pcaruana has quit IRC09:35
*** tesseract has quit IRC09:35
*** pabelanger has joined #openstack-infra09:35
*** csaba has joined #openstack-infra09:35
*** mmedvede has joined #openstack-infra09:36
*** njohnston has joined #openstack-infra09:36
*** yujunz[away] is now known as yujunz-zte09:36
*** yujunz-zte is now known as yujunz[away]09:36
*** yujunz[away] is now known as yujunz-zte09:37
*** Douhet has quit IRC09:37
*** hamzy has quit IRC09:37
*** oanson has quit IRC09:37
*** otherwiseguy has quit IRC09:37
*** ekhugen has quit IRC09:37
*** weshay has quit IRC09:37
*** rbergeron has quit IRC09:37
*** beisner has quit IRC09:37
*** slagle has quit IRC09:37
*** dalvarez has quit IRC09:37
*** masber has quit IRC09:37
*** ecksun has quit IRC09:37
*** bradm has quit IRC09:37
*** jbernard has quit IRC09:37
*** bapalm has quit IRC09:37
*** notmyname has quit IRC09:37
*** therve has quit IRC09:37
*** karthikp has quit IRC09:37
*** zeroDivisible has quit IRC09:37
*** gtmanfred has quit IRC09:37
*** stevemar has quit IRC09:37
*** honza has quit IRC09:37
*** sc` has quit IRC09:37
*** freerunner has quit IRC09:37
*** rakhmerov has quit IRC09:37
*** asilenkov has quit IRC09:37
*** tnarg has quit IRC09:37
*** jaranovich_ has quit IRC09:37
*** sigmavirus has quit IRC09:37
*** sfinucan has quit IRC09:37
*** andreykurilin has quit IRC09:37
*** kencjohnston has quit IRC09:37
*** clayg has quit IRC09:37
*** rakhmerov has joined #openstack-infra09:37
*** andreykurilin has joined #openstack-infra09:37
*** bradm has joined #openstack-infra09:37
*** honza has joined #openstack-infra09:37
*** therve has joined #openstack-infra09:37
*** sc` has joined #openstack-infra09:37
*** jbernard has joined #openstack-infra09:37
*** stevemar has joined #openstack-infra09:37
*** tnarg has joined #openstack-infra09:37
*** clayg has joined #openstack-infra09:37
*** yujunz-zte is now known as yujunz[away]09:37
*** slagle has joined #openstack-infra09:37
*** rbergeron has joined #openstack-infra09:37
*** gtmanfred has joined #openstack-infra09:37
*** kencjohnston has joined #openstack-infra09:37
*** yujunz[away] is now known as yujunz-zte09:37
*** oanson has joined #openstack-infra09:37
*** ekhugen has joined #openstack-infra09:37
*** freerunner has joined #openstack-infra09:37
*** masber has joined #openstack-infra09:37
*** hamzy has joined #openstack-infra09:37
*** beisner has joined #openstack-infra09:37
*** honza is now known as Guest4895509:37
*** zeroDivisible has joined #openstack-infra09:37
*** Douhet has joined #openstack-infra09:37
*** otherwiseguy has joined #openstack-infra09:37
*** dalvarez has joined #openstack-infra09:38
*** weshay has joined #openstack-infra09:38
*** bapalm has joined #openstack-infra09:38
*** sfinucan has joined #openstack-infra09:38
*** yujunz-zte is now known as yujunz[away]09:38
*** asilenkov has joined #openstack-infra09:38
*** yujunz[away] is now known as yujunz-zte09:38
*** asettle has joined #openstack-infra09:38
*** karthikp has joined #openstack-infra09:38
*** dulek has quit IRC09:38
*** migi has quit IRC09:38
*** hogepodge has quit IRC09:38
*** strigazi has quit IRC09:38
*** vi01et has quit IRC09:38
*** SpamapS has quit IRC09:38
*** igormarnat has quit IRC09:38
*** katyafervent_awa has quit IRC09:38
*** cardeois has quit IRC09:38
*** GregHouse has quit IRC09:38
*** katyafervent_awa has joined #openstack-infra09:38
*** jaranovich_ has joined #openstack-infra09:38
*** notmyname has joined #openstack-infra09:39
*** hogepodge has joined #openstack-infra09:39
*** strigazi has joined #openstack-infra09:39
*** GregHouse has joined #openstack-infra09:39
*** SpamapS has joined #openstack-infra09:39
*** openstack has joined #openstack-infra14:27
*** kzaitsev_ws has joined #openstack-infra14:28
yolandagoing to check zuul logs, as i see nodepool providing nodes correctly14:28
*** kzaitsev_ws has quit IRC14:28
*** kzaitsev_ws has joined #openstack-infra14:28
*** bswartz has joined #openstack-infra14:29
yolandai see activity in zuul as well, let's wait a bit to see if queue is processed14:30
*** tonytan4ever has joined #openstack-infra14:31
Zarayay, statusbot came back! thanks, yolanda14:32
yolandaglad to help14:32
*** drifterza has quit IRC14:33
*** markvoelker has quit IRC14:34
openstackgerritMonty Taylor proposed openstack-infra/shade: Log request ids when debug logging is enabled  https://review.openstack.org/41793114:37
*** jeckersb_gone is now known as jeckersb14:37
yolandahi mordred, can you take a look at nodepool logs as well? it seem to be back to life, but i see errors from chocolate, ovh, tripleo14:37
*** bh526r has joined #openstack-infra14:41
*** makowals_ has joined #openstack-infra14:42
*** makowals has quit IRC14:44
*** makowal__ has joined #openstack-infra14:44
*** mriedem has quit IRC14:44
*** adrian_otto has joined #openstack-infra14:44
openstackgerritMerged openstack-infra/shade: Add support for limits  https://review.openstack.org/39523514:47
*** makowals_ has quit IRC14:47
*** ralonsoh_ has joined #openstack-infra14:47
*** markvoelker has joined #openstack-infra14:48
*** beagles_ is now known as beagles14:49
*** sree has quit IRC14:49
*** salv-orlando has quit IRC14:49
*** ralonsoh__ has quit IRC14:51
*** nadya has quit IRC14:51
*** lennyb has joined #openstack-infra14:52
*** makowal__ has quit IRC14:53
*** makowals has joined #openstack-infra14:53
*** yujunz-zte has quit IRC14:53
*** BigWillie has joined #openstack-infra14:53
*** adrian_otto has quit IRC14:53
*** links has quit IRC14:54
lennybwznoinsk: do i need to install nodepool plugin to devstack provider ?14:55
*** pradk- has quit IRC14:56
*** yujunz has joined #openstack-infra14:56
*** nadya has joined #openstack-infra14:56
*** pradk- has joined #openstack-infra14:56
*** adrian_otto has joined #openstack-infra14:57
openstackgerritMonty Taylor proposed openstack-infra/shade: Honor image_endpoint_override for image discovery  https://review.openstack.org/41843214:59
*** jaosorior has joined #openstack-infra15:00
*** Guest63066 is now known as bramwelt15:03
*** bramwelt has quit IRC15:03
*** bramwelt has joined #openstack-infra15:03
*** yujunz has quit IRC15:03
*** pradk- has quit IRC15:03
*** ekuris has quit IRC15:04
*** cloader89 is now known as cjloader15:06
*** Guest90743 is now known as rook15:08
openstackgerritLenny Verkhovsky proposed openstack-infra/nodepool: Fixed typo in info msg  https://review.openstack.org/41843515:08
*** rbrndt has joined #openstack-infra15:09
*** markvoelker has quit IRC15:09
*** xarses_ has quit IRC15:09
*** zz_dimtruck is now known as dimtruck15:09
*** jeckersb is now known as jeckersb_gone15:10
*** umeshksingla has joined #openstack-infra15:11
*** Julien-zte has joined #openstack-infra15:12
*** markvoelker has joined #openstack-infra15:12
*** adrian_otto has quit IRC15:12
dimsyolanda : big thanks!15:13
yolandaanytime!15:14
fungircarrillocruz: yolanda: mugsie said we can also bug him for now if we need eyes on jira15:14
rcarrillocruzah nice15:14
rcarrillocruzthx mugsie !15:14
*** umeshksingla has quit IRC15:15
*** pcarver_ is now known as pcarver15:15
*** umeshksingla has joined #openstack-infra15:15
*** jeckersb_gone is now known as jeckersb15:16
mugsienp :)15:17
*** slaweq__ has joined #openstack-infra15:19
*** slaweq has quit IRC15:21
*** markvoelker has quit IRC15:21
*** dizquierdo has joined #openstack-infra15:22
openstackgerritLee Yarwood proposed openstack-infra/elastic-recheck: Update rbd snapshot busy query for bug 1648885  https://review.openstack.org/41844415:23
openstackbug 1648885 in Cinder "ceph: TestVolumeBootPattern.test_create_ebs_image_and_check_boot times out failing to delete volume due to snapshot is busy" [Undecided,In progress] https://launchpad.net/bugs/1648885 - Assigned to Jon Bernard (jbernard)15:23
*** hongbin has quit IRC15:23
*** kgiusti has quit IRC15:23
*** tosky has quit IRC15:25
*** tosky has joined #openstack-infra15:27
*** rossella_ has quit IRC15:28
*** rossella_ has joined #openstack-infra15:28
*** rhallisey has quit IRC15:29
*** trown is now known as trown|brb15:29
*** EricGonc_ has joined #openstack-infra15:29
*** EricGonczer_ has quit IRC15:31
pandahi, how is the maximum timeout for jobs calculated ? I see that the max timeout configured for any job is 190 minutes, and I may understand why, but we're trying to determine the possibility to launch a full tempest run on a deployment made with TripleO, and just the installation takes ~2 hours to complete, with a full tempest run we're talking about ~5 hours job. Only periodic, no gate.15:31
*** umeshksingla has quit IRC15:31
*** salv-orlando has joined #openstack-infra15:31
*** eharney has quit IRC15:32
fungipanda: it's entirely configurable15:32
fungipanda: you set the timeout wrapper in your job or job-template definition for the duration of timeout you require15:32
fungithat said, if a job (even a periodic job) runs for ~5 hours, that's a lot of opportunity for something to go wrong and kill the job15:33
pandafungi: so there's not contraint from infra on the maximum duration of the job ?15:34
pandaI thought there may be a resources problem.15:34
fungipanda: nope. we strongly encourage people to target <1 hour for most jobs, but of course there are always exceptions that need to run longer15:34
pandafungi: great, thanks.15:35
*** links has joined #openstack-infra15:35
fungiand certainly for a periodic job those tend to run at lower volume times, they get a lower node assignment priority and they don't run multiples in parallel so the resource consumption is pretty minimal15:35
*** BigWillie has quit IRC15:36
fungiour recommendation of <1 hour is less about resource consumption and more about being able to get check results and merge changes in a timely manner, which are also not a concern for periodic jobs15:37
*** burgerk has quit IRC15:37
*** spzala has joined #openstack-infra15:38
*** rhallisey has joined #openstack-infra15:38
*** trown|brb is now known as trown15:39
pandafungi: I see, that's perfectly reasonable15:40
*** hieulq_ has joined #openstack-infra15:42
ianychoiclarkb, good morning! Could you check what is going on translate-dev.o.o? I have tested a version creation functionality (creating "stable-newton" from openstack-manuals master) but I have got to see an "We're sorry" message on translate-dev.o.o. And then it now seems that translate-dev Zanata server is too slow..15:42
clarkbianychoi: Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded and the cpus are spinning15:43
clarkbianychoi: I think it ran out of memory and is now spending all its cpu time trying to garbage collect15:44
fungiwonder if we need to use a bigger flavor15:44
*** mtanino has joined #openstack-infra15:44
ianychoiclarkb, does translate-dev server has less memory than translate server? Then IMO testing with less resources for version creation would be fine15:44
clarkbeither that or we need to icnrease the jvm's heap size15:44
clarkbno they have the same amoutn of memory on the server15:45
*** burgerk has joined #openstack-infra15:45
fungiclarkb: also, i noticed the other day that translate-dev is in the emergency disable list on puppetmaster so it's possible the change to make it use openstackid.org never actually took effect unless it was added to the list later after than change merged15:45
fungis/than/that/15:45
JayFsdague: dtroyer: dansmith: Ironic is having sporatic Grenade failures, that we believe https://review.openstack.org/#/c/417406/ will fix. Your expedited review would be appreciated :)15:45
*** adrian_otto has joined #openstack-infra15:46
sdagueJayF: looking15:46
*** marst has joined #openstack-infra15:46
ianychoiclarkb, then.. how about the jvm's heap size between translate-dev and translate? In translate.o.o, I have not experienced such errors with more resources for version creation.15:46
clarkbalmost 5GB resident memory in the jvm on an 8GB instance. So I don't think the jvm is misconfigured (~half memory is about right for elasticsearch at least)15:46
*** eharney has joined #openstack-infra15:47
dtroyerJayF: so how about using the —wiat option as mentioned in the comment?  It'd be a bit more deterministic and we're well past 1.4.0 being the minumum version...15:47
dtroyer—wait option15:47
clarkbianychoi: translate-dev uses 4.8GB resident memory, translate.o.o uses 3.3GB resident memory15:47
clarkbianychoi: so pretty sure its not a misconfigured heap15:47
JayFvdrok: ^ Is there any reason you didn't do that in your patch?15:47
clarkbianychoi: possible that newer zanata just needs much more memory?15:47
JayFdtroyer: if vdrok doesn't have a good reason otherwise/isn't around, I'll push a competing patch15:48
jrollJayF: dtroyer: seems like that could be a separate patch, we'll still need a timeout15:48
vdrokJayF: yeah, no reason15:48
ianychoiclarkb, Zanata is now the same version but might it be possible that Zanata with Xenial needs more  memory?15:48
clarkbfungi: openstackid is in use according to the config at least15:48
openstackgerritMerged openstack/os-client-config: Update swift constructor to be Session aware  https://review.openstack.org/41408615:48
fungiokay, good15:48
*** adrian_otto has quit IRC15:49
JayFdtroyer: are we OK with completely doing away with a timeout for that? Or will openstackclient itself time out if it --wait(s) for too long?15:49
clarkbianychoi: ya either java8 needs more in general or zanata + java 8 needs more or just zanata needs more on the newer version15:49
fungiianychoi: clarkb: it's newer java right?15:49
clarkbianychoi: might be something to ask the zanata devs15:49
fungiyeah, that15:49
ianychoifungi, clarkb yep newer version, java815:49
*** amotoki has quit IRC15:50
*** john-davidge has quit IRC15:50
ianychoiclarkb, okay.. then could you pleased restart translate-dev server so that I can test remaining things with spending less resources?15:50
clarkbianychoi: yes I can do that now15:51
*** john-davidge has joined #openstack-infra15:51
ianychoiclarkb, wow please just let me know after the restart is done :)15:51
dtroyerjayf, jroll: —wait times out at 300 sec, there is currently not a setting for that15:52
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611015:52
dtroyerso the timeout in the shell script should not be necessary.15:52
JayFdtroyer: awesome, so there's still a timeout at all. Perfect. I'm pushing up the patch version you suggested.15:52
jrollah15:52
*** nadya has quit IRC15:52
clarkbianychoi: should be restarted now15:52
ianychoiclarkb, thanks a lot!15:53
*** john-davidge has quit IRC15:53
*** john-dav_ has joined #openstack-infra15:53
clarkbfungi: the emergency file keeps puppet from running on the old server which is called translate-dev.openstack.org. With the new server we added digits to it then CNAMEd the service over so it is translate-dev01.openstack.org15:53
clarkbfungi: that is why puppet ran on it15:53
JayFsdague: dtroyer: The alternative: https://review.openstack.org/418455 Replace now unneeded timeout with --wait on OSC15:54
fungiclarkb: d'oh, right i forgot we did that15:54
sdagueJayF: ok15:54
*** umeshksingla has joined #openstack-infra15:55
dtroyerJayF: thanks.  a timeout there should be pretty obvious in the logs…15:55
JayFYeah, I just wanted to make sure there was a shorter timeout than just the job timeout. 5 minutes is more than enough without being much too much :)15:56
*** xarses has joined #openstack-infra15:57
*** john-dav_ has quit IRC15:57
*** adrian_otto has joined #openstack-infra15:57
*** xarses_ has joined #openstack-infra15:58
*** markvoelker has joined #openstack-infra15:58
openstackgerritMerged openstack-infra/tripleo-ci: Install openstackclient on te-broker  https://review.openstack.org/41812915:58
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Neutron rally test with python3.5  https://review.openstack.org/41834215:58
*** mhickey has quit IRC15:58
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Cinder rally test with python3.5  https://review.openstack.org/41834315:59
*** hongbin has joined #openstack-infra15:59
*** xarses has quit IRC16:01
*** yuval has quit IRC16:01
*** amotoki has joined #openstack-infra16:02
*** rbuzatu has quit IRC16:02
*** rbuzatu has joined #openstack-infra16:02
*** gouthamr has joined #openstack-infra16:03
*** claudiub has joined #openstack-infra16:04
*** beagles is now known as beagles_brb16:04
*** cdent has quit IRC16:04
*** mtanino has quit IRC16:05
*** mptacekx has quit IRC16:05
*** rbuzatu has quit IRC16:06
*** rbuzatu has joined #openstack-infra16:06
*** claudiub|2 has quit IRC16:06
stevemarAJaeger: o/16:08
*** vgadiraj has joined #openstack-infra16:12
*** yarkot has joined #openstack-infra16:13
*** dargains has joined #openstack-infra16:13
*** dharinic has joined #openstack-infra16:14
*** hieulq_ has quit IRC16:16
*** aunnam has joined #openstack-infra16:16
*** rtheis has joined #openstack-infra16:17
pabelangerWas there an issue with nodepool.o.o today?16:18
*** rcernin has quit IRC16:18
pabelangerlooks like a 2 hour outage in grafana.o.o16:18
clarkbpabelanger: yes looks like server became unresponsive and yolanda restarted it16:19
pabelangerack16:19
fungii missed that in scrollback. nova reboot?16:19
clarkbfungi: I don't think that was clarified16:19
yolandayes, i rebooted through nova16:19
yolandait was not responding16:19
fungithat's pretty rough16:19
yolandaand then started nodepool processes16:19
fungithanks yolanda!16:19
yolandaglad to help... also, there seeems to be an issue with ovh-bhs116:20
fungimakes me curious what happened to leave the server in an unresponsive state16:20
bnemecSo ^ is why we have 40 orphaned nodepool nodes in rh1?16:20
yolandareturning No valid hosts error16:20
bnemecJust checking before I delete them.16:20
fungiis it possible the delete runner didn't get started?16:20
*** dtantsur is now known as dtantsur|afk16:20
yolandai started the deleter process16:20
pabelangerbnemec: nodepool should eventually delete them16:21
yolandanodepool, launcher and deleter16:21
*** baoli has quit IRC16:21
fungiyeah, i don't see a large volume of nodes stuck in delete state16:21
bnemecOkay, they're tying up about 2/3s of our capacity right now.16:21
sdagueclarkb: apparently this got borked in my save_file patch the other day - https://review.openstack.org/#/c/418367/16:21
fungipabelanger: bnemec: "eventually" is on the order of a few minutes16:21
yolandathere were tons of leaked ports in vanilla and chocolate, mordred created an script to cleanup, and i executed that on both clouds16:21
pabelangerAJaeger: fungi: Also, afs mirror sync is done.16:21
fungipabelanger: excellent!16:21
fungithanks for running that16:21
pabelangernp16:22
bnemecfungi: Hmm, it's been quite a while.16:22
fungibnemec: i wonder if we're getting errors trying to delete those16:22
*** salv-orl_ has joined #openstack-infra16:22
bnemecYou can see on the 24 hour view of http://grafana.openstack.org/dashboard/db/nodepool-tripleo-test-cloud that overnight we had a constant 40 nodes, even with few/no jobs running.16:22
funginodepoold is supposed to spot old nodes it's lost track of and clean them up16:22
*** fguillot has joined #openstack-infra16:22
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Fix exit codes for oooq job  https://review.openstack.org/41846816:22
pabelangerIIRC, after 8 hours though?16:22
fungii thought the alien detection was real-time16:23
fungi8 hours is how long it takes nodepoold to get around to deleting nodes that are stuck in a used state16:23
openstackgerritMonty Taylor proposed openstack-infra/system-config: Add utility script used to clean leaked ports  https://review.openstack.org/41846916:23
bnemecOh, is it possible that got turned off for rh1 because we have a bunch of alien vms running under the nodepool tenant?16:23
fungiif memory serves (and maybe in a ready state)16:23
bnemec(on purpose)16:23
mordredyolanda, pabelanger: ^^ there's the script I made, just for the record16:23
pabelangerfungi: yes, these are used state, from what I see16:24
clarkbya they wouldn't be aliens16:24
*** amotoki has quit IRC16:24
clarkbaliens are only VMs that weren't started by nodepool16:24
fungibnemec: well, nodepoold inserts instance metadata to identify that it created those nodes, so that it can avoid deleting nodes it didn't create16:24
*** yamahata has joined #openstack-infra16:24
bnemecAh, okay16:24
*** burgerk has quit IRC16:24
fungiso anyway, we need to correlate to nodepoold logs to see why it's not deleting those16:25
pabelangerI used to manually clean up used nodes, but now I just let nodepool do it :)16:25
*** salv-orlando has quit IRC16:25
bnemecThe oldest node I see has been sitting there for about 7 hours: http://paste.openstack.org/show/594443/16:25
funginodepool list isn't showing them16:26
fungithe only lingering delete nodes in its db are a couple of internap xenial 2-node ones which have been hanging around for a couple months16:27
pabelanger| 6565818 | tripleo-test-cloud-rh1 | None | tripleo-centos-7     | zuul   | zl03    | tripleo-centos-7-tripleo-test-cloud-rh1-6565818   | tripleo-centos-7-tripleo-test-cloud-rh1-6565818   | cf012e12-011a-4178-8db0-7994b9d5abd9 | 66.187.229.224                        | used     | 00:06:42:33 | None16:27
pabelangerbnemec: will clean upin 90mins16:27
*** jcoufal has quit IRC16:27
pabelangermaybe we should make NODE_CLEANUP configurable, drop it down to 4 hours?16:28
fungiso those aren't in a delete state, they're just used for hours and we never got the job completion16:28
*** kjorgensen has joined #openstack-infra16:28
fungiyeah, i bet those jobs ended while nodepoold was offline16:28
clarkbfungi: ya basically nodepool crashes and burns and those don't get a state transition16:28
pabelangerya16:28
clarkband 1/3 a day later we clean them up16:28
fungii would just manually delete any nodes in a used state >3 hours for now16:29
dimssdague : clarkb : hopefully quick py35 project-config reviews. they previously had AJaeger 's +2, but i had to fix a typo. https://review.openstack.org/#/c/418342/ and https://review.openstack.org/#/c/418343/ when you get a chance please.16:29
bnemecOkay, I can do that.  Just wanted to check in before I started blowing things away.16:29
bnemecThanks everyone.16:29
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: TripleO containers job with quickstart  https://review.openstack.org/41625916:29
fungiwell, by "manually" i mean from nodepool16:29
clarkbbnemec: we'd want to delete them on our side16:29
clarkbnot in the cloud16:29
bnemecOh, okay.16:29
pabelangerfungi: since we manually do it, why not update nodepool and lower it from 8 hours to a saner value?16:29
fungiif we mark them as delete in nodepool it will clean them up16:29
* bnemec desists16:29
fungipabelanger: because some jobs might run longer16:30
*** burgerk has joined #openstack-infra16:30
fungipanda was just asking about setting up a tripleo periodic job that will take ~5 hours16:30
pabelangerI thought 3 hours was the max?16:30
*** burgerk has quit IRC16:30
pabelangerwoah16:30
pabelanger5 hours?16:30
fungiwe haven't previously expressed concern over long-running periodic jobs16:30
pandapabelanger: install + full tempest16:30
*** panda is now known as panda|bbl16:31
*** newmember has joined #openstack-infra16:31
panda|bblpabelanger: sorry, tripleo install + full tempest16:31
pabelangerpanda|bbl: still a long time16:32
openstackgerritDarragh Bailey proposed openstack-infra/jeepyb: Make use of Gerrit CLI to retrieve group UUID  https://review.openstack.org/28484316:32
*** Guest11563 has quit IRC16:33
panda|bblpabelanger: I know, it would be a periodic job16:33
fungii have 535 nodes currently in a used state >3 hours16:33
fungii'll tell nodepool to delete those16:33
fungiactually, those are also >4 hours16:34
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Fix Gentoo builds on Ubuntu 16.04 Xenial hosts  https://review.openstack.org/41339516:34
*** rafaelss has joined #openstack-infra16:34
*** Goneri has quit IRC16:35
*** jcoufal has joined #openstack-infra16:35
*** dizquierdo has quit IRC16:36
fungithese would have started getting automatically cleaned up in another 3-4 hours, but this way we can reclaim capacity sooner16:36
*** amotoki has joined #openstack-infra16:37
dmsimardI'm trying to understand the meaning of jeepyb but I can't. Is it an acronym of something ?16:38
*** rafaels has quit IRC16:38
*** Hal has joined #openstack-infra16:38
clarkbdmsimard: jeepyb == GPB == Gerrit Project Builder16:39
*** Hal is now known as Guest4088916:39
dmsimardyikes16:39
dmsimardok :D16:39
fungithe phoneticization of that acronym was chosen in part to disambiguate it from git-buildpackage (a common packaging tool in debian and derivative distros)16:40
*** markus_z has quit IRC16:40
fungioh, though that would have been gbp not gpb16:40
*** vhosakot has joined #openstack-infra16:40
fungianyway, it's one of our more terrible package names16:40
clarkbI like it16:41
*** sdake has joined #openstack-infra16:41
clarkbchances that it will ever have a trademark conflict or otherwise require a rename seem to be about as close to 0 as possible16:41
fungiyeah, and it's memorable16:42
fungilike turbo-hipster16:42
openstackgerritAndreas Scheuring proposed openstack-infra/project-config: Add new project os-dpm  https://review.openstack.org/41355816:43
*** sdake_ has quit IRC16:43
*** mpaolino has joined #openstack-infra16:43
*** andreas_s has quit IRC16:44
SotKjeepyb and turbo-hipster are some of my favourite project names16:44
*** Goneri has joined #openstack-infra16:44
AJaegerpabelanger: great to hear tha AFS sync is done.16:45
bkeroUntil Jeep starts caring about openstack-infra16:45
AJaegerpabelanger: now we need to add the missing files to it - see step 1 of http://lists.openstack.org/pipermail/openstack-docs/2017-January/009440.html16:45
*** Julien-zte has quit IRC16:46
pabelangerAJaeger: let me see if I can do that now16:46
*** thiagolib has joined #openstack-infra16:47
pabelangerAJaeger: done16:50
*** links has quit IRC16:52
*** nadya has joined #openstack-infra16:55
wznoinsklennyb, I'm using somehow 'ancient' nodepool at this stage but IMO devstack should not know about nodepool16:57
*** umeshksingla has quit IRC17:00
*** hamzy has quit IRC17:00
*** rbrndt has quit IRC17:01
*** strigazi is now known as strigazi_AFK17:02
*** rtheis has quit IRC17:02
*** rfolco has quit IRC17:03
*** sergmelikyan has joined #openstack-infra17:03
*** inc0 has joined #openstack-infra17:04
*** umeshksingla has joined #openstack-infra17:04
*** rfolco has joined #openstack-infra17:04
*** dschultz has joined #openstack-infra17:04
AJaegerthanks, pabelanger. Let me check links now...17:06
*** nadya has quit IRC17:06
pabelangerAJaeger: sure, let me know which is the next steps17:07
*** snarwade has quit IRC17:07
AJaegerwill do, pabelanger17:07
*** rbrndt has joined #openstack-infra17:08
fungibnemec: looks like all the deletions should be processed and flushed now, so hopefully you no longer see a bunch of inactive nodes hanging around17:08
*** beagles_brb is now known as beagles17:09
jeblairit looks like mptacekx isn't here anymore17:10
jeblairdoes anyone know how to contact that person?17:10
fungii need to disappear to grab lunch and run some errands, but plan to be back in time to finish preparing for our team meeting at 19:00 utc17:10
bnemecfungi: Looks much better now.  Thanks.17:10
jeblairBobBall: i think there was some confusion in the conversation earlier with mptacekx and mordred17:11
fungijeblair: mptacekx seems to be https://launchpad.net/~michalx-ptacek17:11
* fungi really disappears now17:11
jeblairBobBall: the zuul v2.5 series is supported, including v2.5.1.  it still works with jenkins, and will continue to do so until zuulv3.  and indeed, that's the version i would recommend people run -- it has a lot of bugfixes (that's why we made the release)17:12
jeblairBobBall: so does 2.5.1 fix the issue you were seeing?17:12
*** xarses has joined #openstack-infra17:12
jeblairfungi: thx17:12
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Remove unsed variables  https://review.openstack.org/41849217:12
*** gyee has joined #openstack-infra17:13
*** david-lyle has joined #openstack-infra17:13
*** rbuzatu has quit IRC17:13
*** rbuzatu has joined #openstack-infra17:13
dtroyerI've got a review that appears to be unresponsive to +W or rechecks: https://review.openstack.org/#/c/399982/   Am I missing something?17:13
*** ggillies has quit IRC17:14
dtroyerunresponsive == no check/gate jobs seem to run17:14
jeblairBobBall: (the thing that we don't want to support is our prototype ansible launcher, which is in v2.5.1, but we didn't document it or recommend its use because it won't work for most people and will be superceded by zuul v3)17:14
*** kgiusti has joined #openstack-infra17:14
*** xarses_ has quit IRC17:15
BobBalljeblair: I suspect it doesn't fix it (but I'm not certain) - when suggesting the code fix I was referncing master17:15
*** ggillies has joined #openstack-infra17:16
clarkbdtroyer: it looks like the parent commit isn't known to gerrit17:16
clarkbdtroyer: at least if I put the sha1 for the parent in the search box I get back no results17:16
BobBalljeblair: I can certainly get upgrading to 2.5 looked into, but I believe we will still ideally propose the change (as a recap the change was to only run prepareRef if the change is going to run some jobs or is being added for a dependancy)17:16
*** Swami has joined #openstack-infra17:16
BobBalljeblair: just to reduce the resource demand to run zuul-merger on refs and projects that we will never touch17:17
dtroyerclarkb: is that what the orange dot under the 'Parent' label means?17:17
dtroyernevermind, other have it too...17:17
clarkbdtroyer: not completely. if you hover over the orange box it is just saying that the parent is not master17:17
dtroyerok, I'll rebase that and continue, thanks17:18
clarkbdtroyer: which is normally ok as long as it merges cleanly, so this is a special case on top of that where parent is not master and doesn't appear to be in gerrit17:18
*** rbuzatu has quit IRC17:18
*** asettle has quit IRC17:18
jeblairBobBall: why is the change being enqueued?  wouldn't you omit the project from the layout entirely in that case? (which should cause the change not to be enqueued, though with the foreign projects feature, it should still be enqueued as a dependency if needed)17:18
openstackgerritMonty Taylor proposed openstack-infra/shade: Honor image_endpoint_override for image discovery  https://review.openstack.org/41843217:18
BobBalljeblair: Ah yes - that might be fixed in 2.5.1  In 2.1.1 zuul will fail spectacularly if a depends-on project isn't in the layout.yaml17:19
BobBalljeblair: so we had to add all projects to layout.yaml to keep our CI running17:19
jeblairBobBall: yeah, i think that was one of the things we fixed up....  so if you have a moment to see if v2.5.1 with only the projects you're interested in works, that would be great17:20
*** e0ne has quit IRC17:20
*** ociuhandu has quit IRC17:20
*** trown is now known as trown|lunch17:20
BobBallUnderstood, thanks.17:20
*** tlian has quit IRC17:20
*** morgabra_ is now known as morgabra17:21
*** morgabra has joined #openstack-infra17:21
clarkbdtroyer: it may be worth asking the changes owner for more info on how they pushed code to gerrit17:21
clarkbdtroyer: I think if you use git review that should never happen17:22
*** sergmelikyan has quit IRC17:22
clarkbbut if it did happen with git review then maybe we have a bug that needs to be sorted out17:22
*** ijw_ has quit IRC17:23
*** umeshksingla_ has joined #openstack-infra17:24
*** umeshksingla has quit IRC17:25
*** umeshksingla_ is now known as umeshksingla17:25
*** pcaruana has quit IRC17:25
*** inc0 has quit IRC17:25
*** lucasagomes is now known as lucas-afk17:27
*** krtaylor has quit IRC17:28
*** dargains has quit IRC17:28
pabelangerclarkb: mind looking at https://review.openstack.org/#/c/415530/ again? Our fedora afs mirror17:28
ianychoiclarkb, thanks a lot! All test items for translate-dev have been completed except one error as we discussed a few hours ago. I have sent an e-mail to Zanata dev: http://lists.openstack.org/pipermail/openstack-i18n/2017-January/002642.html17:30
*** tesseract has quit IRC17:31
*** jpich has quit IRC17:33
*** winggundamth has quit IRC17:33
*** baoli has joined #openstack-infra17:33
*** ccamacho has left #openstack-infra17:33
clarkbdims: re https://review.openstack.org/#/c/418342/3 I think we want to have one of the neutron infra liasons ack that change since it affects neutron. I Approved the cinder change17:36
*** ociuhandu has joined #openstack-infra17:36
openstackgerritPaul Belanger proposed openstack-infra/nodepool: [WIP] Support AFS mirrors for nodepool diskimages  https://review.openstack.org/41427317:37
clarkboh nate is one of them according to the wiki /me approves that one too17:37
clarkbpabelanger: ya I can take a look. Just catching up on the backlog of things now17:37
*** jordanP has quit IRC17:38
*** john-davidge has joined #openstack-infra17:39
*** russellb has quit IRC17:40
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Allow nodepool-builder to only build diskimages  https://review.openstack.org/41216017:41
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: add default for ZUUL_PROJECT in toci_instack_ovb  https://review.openstack.org/41850417:41
openstackgerritMerged openstack-infra/project-config: Cinder rally test with python3.5  https://review.openstack.org/41834317:43
*** rbuzatu has joined #openstack-infra17:45
openstackgerritMerged openstack-infra/project-config: Neutron rally test with python3.5  https://review.openstack.org/41834217:45
*** russellb has joined #openstack-infra17:45
*** claudiub|2 has joined #openstack-infra17:47
*** chem has quit IRC17:47
*** claudiub has quit IRC17:49
jeblairpabelanger, clarkb: see my comment on 41813717:49
*** nadya has joined #openstack-infra17:49
*** nadya has quit IRC17:50
clarkbrcarrillocruz: I just left a comment on the bottom of the ansibly d-g stack. I +2'd anyways but if it is an easy change to make maybe you want to go ahead with it?17:51
rcarrillocruzI will amend, thanks17:52
*** raissa has quit IRC17:52
*** raissa has joined #openstack-infra17:52
clarkbjeblair: pabelanger maybe log both things based on args.builder?17:53
pabelangerjeblair: clarkb: That is how I am reading the comment17:53
*** skraynev_ has joined #openstack-infra17:54
*** rbuzatu has quit IRC17:54
*** BobBall is now known as BobBall_AWOL17:54
*** rbuzatu has joined #openstack-infra17:54
jeblairpabelanger: well, i don't like the idea that the program tells you something is wrong no matter what17:55
jeblairpabelanger, clarkb: so i advocate only warning if the option is present17:55
jeblairpabelanger, clarkb: and depending on release announcement to tell people the default is changing17:55
pabelangerokay, release announcement to explain people should be using nodepool-builder now, and if people are passing --no-builder, warn of the deprecated flag (that is a noop)17:56
jeblairthat's my vote17:57
jeblairpabelanger: we might be able to rephrase that existing warning if you wanted to do both17:57
*** thingee has quit IRC17:58
jeblairpabelanger, clarkb: maybe something more like "Note: nodepool no longer automatically builds images, please ensure the separate nodepool-builder process is running if you haven't already"17:58
openstackgerritIhar Hrachyshka proposed openstack-infra/irc-meetings: Added Artur as a co-chair for the neutron upgrades meeting  https://review.openstack.org/41789717:58
jeblair(but then the '--no-builder' option could emit a stronger warning since it's a known erroneous condition)17:59
*** derekh has quit IRC17:59
*** flepied has quit IRC18:00
*** thingee has joined #openstack-infra18:00
*** ijw has joined #openstack-infra18:01
clarkbthat sounds good to me18:01
dimsclarkb : looks like both went through. thanks!18:02
*** krtaylor has joined #openstack-infra18:02
*** hashar has quit IRC18:02
*** ihrachys has quit IRC18:03
*** Guest34220 is now known as medberry18:04
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Remove the ability for nodepoold to launch a builder  https://review.openstack.org/41813718:04
pabelangerclarkb: jeblair: ^18:04
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Instal jq before deploy.sh in OVB jobs  https://review.openstack.org/41850618:04
*** ralonsoh_ has quit IRC18:04
*** medberry has quit IRC18:04
*** medberry has joined #openstack-infra18:04
*** medberry is now known as med_18:04
jeblairpabelanger, clarkb: +218:04
*** thingee has quit IRC18:05
pabelangerjeblair: clarkb: did we also want to consider making config-drive: True the default for nodepool? https://review.openstack.org/#/c/349697/18:05
*** thingee has joined #openstack-infra18:05
clarkbpabelanger: its only necessary if you use glean and not cloud init (or $otherthinglikenovaagent). Its definitely a better default for us but I don't know how many of our other users are in the glean boat too18:06
*** thingee has quit IRC18:07
clarkbthough I guess a bunch of our users probably piggy back off of our dib stuff too so are probably using glean as well?18:08
*** thingee has joined #openstack-infra18:08
*** mpaolino has quit IRC18:09
clarkbpabelanger: the potential drawback to using config drive is that until newton/ocata you could not do live migration of VMs that have config drives attached18:09
clarkbpabelanger: for nodepool/CI testing that isn't a major issue so probably fine to have enabled by default18:09
*** yamahata has quit IRC18:10
sdaguepabelanger / jeblair / fungi - anyone want to help get this one landed - https://review.openstack.org/#/c/418367/ - the merge from yesterday did an incorrect naming of the grenade.log so it didn't get archived18:11
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921518:12
*** nadya has joined #openstack-infra18:13
pabelangerclarkb: ah, didn't know that18:14
jeblairsdague: +318:14
clarkbpabelanger: ya it was a limitation of nova that was recently fixed, not sure if in this release or last though18:14
sdaguejeblair: thank you18:15
jeblairsdague: np18:15
*** Guest40889 has quit IRC18:15
*** inc0 has joined #openstack-infra18:15
Shrewsjeblair: pabelanger: can we get this nodepool doc fix in before a release? https://review.openstack.org/41184418:16
jeblairShrews: yup18:17
*** nadya has quit IRC18:18
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611018:18
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Allow nodepool-builder to only build diskimages  https://review.openstack.org/41216018:18
*** tosky has quit IRC18:20
clarkbpabelanger: 418137 failed python27 testing18:20
*** asettle has joined #openstack-infra18:20
pabelangerclarkb: ya, needed to rebase18:20
pabelangerclarkb: err18:20
pabelanger1 sec18:20
pabelangerclarkb: Ah, yes. database drop issue18:21
*** tonytan4ever has quit IRC18:21
*** john-davidge has quit IRC18:21
*** tonytan4ever has joined #openstack-infra18:24
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Use rdo-qemu-ev repo in mitaka jobs  https://review.openstack.org/41851018:24
openstackgerritMerged openstack-infra/system-config: Correct bad image delete example  https://review.openstack.org/41184418:25
*** Swami has quit IRC18:28
*** EricGonc_ has quit IRC18:29
clarkbpabelanger: so it iwll just need to be rechecked then18:29
*** EricGonczer_ has joined #openstack-infra18:30
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Allow nodepool-builder to only build diskimages  https://review.openstack.org/41216018:31
clarkbas a heads up I have to pop out after the meeting today to go get my eyeballs examined by a medical professional. I don't expect they will do anything that prevents me from computering later today though (but who knows!)18:31
*** rbrndt has quit IRC18:32
AJaegerpabelanger: something is wrong with publishing the content - http://docs-beta.openstack.org/developer/python-manilaclient gives a 404. Did you put the tarball at the right place?18:32
sc68calclarkb: good luck18:34
pabelangerAJaeger: yes, I did.  Let me check if the volume has been released18:34
AJaegerpabelanger: it should get released every 5 mins.18:35
AJaegeryou need to untar this to /afs/.docs...18:36
AJaegeror somethign similar18:36
pabelangerAJaeger: should it been extracted to docs-old or docs?18:36
AJaegerdocs18:36
pabelangerah18:36
pabelangerthat is why18:36
pabelanger1 sec18:36
scottdaHi infra folks. How to I get history of gate tests (fail/pass), i.e. for gate-tempest-dsvm-full-drbd-devstack-ubuntu-xenial-nv   ?18:36
*** e0ne has joined #openstack-infra18:39
pabelangerAJaeger: okay, copied again18:39
*** skraynev_ has quit IRC18:39
pabelangermordred: care to look over our glean install for nodepool dsvm job?18:39
pabelangermordred: https://review.openstack.org/#/c/414662/18:40
*** yamahata has joined #openstack-infra18:40
AJaegerpabelanger: thanks, will test in a bit...18:40
AJaegerpabelanger: yes, it's there!18:41
AJaegernow checking all entries again...18:41
fungisdague: lgtm18:41
* fungi has returned from the burrito bar around the corner18:41
pabelangeryum18:41
*** erhudy has joined #openstack-infra18:41
fungithey have a relatively local ipa on tap brewed with agave cactus18:42
fungiawesome stuff, but it was unavailable for a year or so, and they just got it back18:42
*** dargains has joined #openstack-infra18:43
mordredpabelanger: lgtm18:44
*** trown|lunch is now known as trown18:44
pabelangermordred: danke18:45
*** Swami has joined #openstack-infra18:45
Shrewsfungi: sierra nevada makes a gose with cactus. it's pretty good18:46
Shrewsnot the best, but good 'nuf18:46
clarkbscottda: graphite.openstack.org has this info and you can use graphite api to retrive it18:48
openstackgerritMerged openstack-infra/shade: Honor image_endpoint_override for image discovery  https://review.openstack.org/41843218:48
scottdaclarkb: Thanks18:48
openstackgerritMerged openstack-infra/nodepool: Source glean installs in simple-init  https://review.openstack.org/41466218:48
openstackgerritPaul Belanger proposed openstack-infra/project-config: Have clean run non-voting nodepool dsvm jobs  https://review.openstack.org/41851818:48
*** pvaneck has joined #openstack-infra18:48
*** kzaitsev_mb has quit IRC18:49
*** ihrachys has joined #openstack-infra18:49
openstackgerritHonza Pokorny proposed openstack-infra/project-config: Upgrade nodejs for tripleo-ui jobs to 6.x  https://review.openstack.org/41851918:50
fungiShrews: yeah, i've had the sn stuff but even though they now have a brewery in nc they're not really a microbrewing operation any more18:51
*** EricGonczer_ has quit IRC18:51
openstackgerritMonty Taylor proposed openstack-infra/shade: Log request ids when debug logging is enabled  https://review.openstack.org/41793118:51
*** umeshksingla has quit IRC18:51
fungitheir nc brewery is just down the road from my parents18:52
*** umeshksingla has joined #openstack-infra18:52
fungiand i guess their original brewery is just down the road from jeblair18:52
*** xarses_ has joined #openstack-infra18:53
*** umeshksingla has quit IRC18:53
*** dargains_ has joined #openstack-infra18:54
fungihard to fault them for success and growth though. at least they haven't been acquired by any mass-market brewers18:54
AJaegerpabelanger: looks great, thanks! Now we can switch IP addresses if you dare ;)18:55
*** xarses has quit IRC18:55
*** zara_the_lemur__ has joined #openstack-infra18:56
*** dargains has quit IRC18:57
*** umeshksingla has joined #openstack-infra18:58
jeblairfungi: yeah, their [original] brewery is in chico (foothills of the sierra nevada, so their name is not an exaggeration), and they have a tasting room in berkeley18:59
*** ianychoi has quit IRC19:00
openstackgerritMerged openstack-infra/shade: Rework limits normalization  https://review.openstack.org/41704419:00
fungiwell, who cares about the brewery if it doesn't have a tasting room, right?19:00
openstackgerritPaul Belanger proposed openstack-infra/nodepool: [WIP] Support AFS mirrors for nodepool diskimages  https://review.openstack.org/41427319:00
fungiit's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour19:00
openstackgerritHonza Pokorny proposed openstack-infra/project-config: Upgrade nodejs for tripleo-ui jobs to 6.x  https://review.openstack.org/41851919:00
pabelangerAJaeger: sure19:00
*** Hal has joined #openstack-infra19:01
ianwpabelanger: so 414662 should fix the jobs?19:01
*** Hal is now known as Guest2644819:02
openstackgerritPaul Belanger proposed openstack-infra/project-config: Have glean run non-voting nodepool dsvm jobs  https://review.openstack.org/41851819:03
pabelangerianw: it gets us ^19:03
pabelangerianw: so we can test glean changes in the gate19:03
pabelangeras best as possible19:03
pabelangereg: systemd changes19:03
*** d0ugal has quit IRC19:04
ianwhmm, i just noticed they weren't working in dib late yesterday afternoon19:04
*** jamesdenton has joined #openstack-infra19:04
ianwimages build, but don't seem to get network19:04
dolphmanyone know how to query for stable/* branch reviews in gerrit? i expected this to work, according to the docs https://review.openstack.org/#/q/is:open+branch:%255Estable19:04
dolphm(without having to specify exact branch names each release)19:05
ianwpabelanger: hmm, maybe not i guess, overnight runs seem ok19:05
pabelangerianw: I believe that is fixed now, mordred was working on that yesterday19:05
pabelangerI want to say an issue with OSC19:05
ianwah, ok, that would explain, cool19:05
clarkbdolphm: https://review.openstack.org/#/q/is:open+branch:%255Estable.*19:06
clarkbdolphm: the regex has to match the whole line I guess19:06
*** bh526r has quit IRC19:06
dolphmclarkb: bah, thank you!19:06
*** rafaelss has quit IRC19:08
*** jamesden_ has joined #openstack-infra19:10
*** Guest26448 has quit IRC19:10
*** jamesdenton has quit IRC19:10
*** itisha has joined #openstack-infra19:11
*** umeshksingla has quit IRC19:12
*** electrofelix has quit IRC19:12
*** ociuhandu has quit IRC19:13
openstackgerritMerged openstack-infra/project-config: Add fuel-plugin-congress  https://review.openstack.org/41512619:13
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add DB API function to get multiple tests by test_id  https://review.openstack.org/41854119:13
*** nadya has joined #openstack-infra19:14
openstackgerritVladyslav Drok proposed openstack-infra/project-config: Remove deprecated neutron options  https://review.openstack.org/41854219:14
openstackgerritIan Wienand proposed openstack/diskimage-builder: Update platform support to reality  https://review.openstack.org/41820419:17
*** rhallisey has quit IRC19:17
*** e0ne has quit IRC19:19
*** d0ugal has joined #openstack-infra19:20
*** strigazi_AFK is now known as strigazi19:21
*** dargains has joined #openstack-infra19:22
openstackgerritHonza Pokorny proposed openstack-infra/project-config: Upgrade nodejs for tripleo-ui jobs to 6.x  https://review.openstack.org/41851919:24
*** flepied has joined #openstack-infra19:24
*** dargains_ has quit IRC19:25
*** jamesden_ has quit IRC19:27
*** dargains has quit IRC19:27
*** dargains has joined #openstack-infra19:28
*** tlian has joined #openstack-infra19:29
openstackgerritMerged openstack-infra/tripleo-ci: Use a more useful $PS4  https://review.openstack.org/41770519:30
*** rhallisey has joined #openstack-infra19:30
*** cody-somerville has quit IRC19:31
*** strigazi is now known as strigazi_AFK19:32
*** csomerville has joined #openstack-infra19:32
*** salv-orl_ has quit IRC19:32
*** dtardivel has quit IRC19:34
*** pcaruana has joined #openstack-infra19:37
*** ijw has quit IRC19:37
*** dargains has quit IRC19:39
*** rossella_ has quit IRC19:40
mordredpabelanger: feel like an easy +A ? https://review.openstack.org/#/c/41768519:41
*** rbrndt has joined #openstack-infra19:43
*** tnovacik has joined #openstack-infra19:44
*** odyssey4me has quit IRC19:46
*** odyssey4me has joined #openstack-infra19:46
*** asettle has quit IRC19:46
*** asettle has joined #openstack-infra19:47
openstackgerritHonza Pokorny proposed openstack-infra/project-config: Upgrade nodejs for tripleo-ui jobs to 6.x  https://review.openstack.org/41851919:47
*** rossella_ has joined #openstack-infra19:50
*** ociuhandu has joined #openstack-infra19:50
*** asettle has quit IRC19:51
*** mrtenio has quit IRC19:53
*** ociuhandu has quit IRC19:55
*** ijw has joined #openstack-infra19:57
*** rossella_ has quit IRC19:59
*** makowals has quit IRC19:59
*** spzala has quit IRC20:00
pabelangerAJaeger: jeblair: fungi: okay, changing docs.o.o to CNAME files.o.o, with 60 TTL20:00
openstackgerritJames E. Blair proposed openstack-infra/zuul: Separate driver interfaces and make abstract  https://review.openstack.org/41855420:00
pabelangereverybody good with that?20:00
fungipabelanger: thanks! i'm busy with the tc meeting but hopefully others are available to test20:01
*** panda|bbl is now known as panda20:01
clarkbpabelanger: I think when you change the name is when you change the ttl to 5 minutes20:01
AJaegeryes, pabelanger20:01
clarkbthen as jeblair described people that have the old dns record will trickle in over an hour whereas if you need to revert backto cloud sites anyone that got the new cname will update within 5 minutes20:02
pabelangerclarkb: okay, I can do that20:02
johnsomHi folks.  Is this the right place to discuss openstack-infra/system-config patches?20:03
clarkbjohnsom: it is20:03
johnsomExcellent, I have had two sitting for a while: https://review.openstack.org/407609 and https://review.openstack.org/40824620:03
pabelangerokay, docs.o.o changed to CNAME files.openstack.org TTL 520:04
johnsomOne is so we get those handy notifications like the up coming gerrit maintenance20:04
johnsomCan we get some reviews on those?  Much appreciated.20:05
AJaegerpabelanger: working for me ;)20:06
pabelangerI see traffic in apache log for files.o.o20:07
AJaegerpabelanger: I started my spider ;)20:07
clarkbjohnsom: have a link to example log files for screen-i-*?20:08
clarkbjohnsom: want to double check they match oslo format before +2ing that20:08
johnsomclarkb http://logs.openstack.org/50/415950/1/check/gate-neutron-lbaasv2-dsvm-scenario-ubuntu-xenial-nv/93ced48/logs/screen-o-cw.txt.gz20:09
openstackgerritMerged openstack-infra/devstack-gate: save off grenade.sh.log correctly  https://review.openstack.org/41836720:09
clarkbjohnsom: thanks, and that does indeed look like what we want.20:10
johnsomYep, we use oslo.logging the same way neutron does20:10
AJaegerpabelanger, jeblair, performance is the same  from here as for Cloud Sites (if I really hit the new site;)20:10
openstackgerritMerged openstack-infra/tripleo-ci: Fail multinode-oooq job fast until it is ready  https://review.openstack.org/41703220:11
pabelangerApache process looks happy20:12
AJaeger#success docs.openstack.org is served from the new Infra file server that is AFS based20:13
openstackstatusAJaeger: Added success to Success page20:13
AJaegerbefore we forget it to celebrate ^ ;)20:13
*** askb has joined #openstack-infra20:13
pabelangermy DNS is still pointing to original IP20:14
jeblair#status log docs.openstack.org served from afs via files01.openstack.org20:14
openstackstatusjeblair: finished logging20:14
pabelangerso need to wait a little longer20:14
jeblairi'm on the new server20:14
AJaegeripv6 is tried first for me ;)20:16
pabelangerya, still need to order some new hardware for ipv6 wifi20:17
*** ociuhandu has joined #openstack-infra20:18
*** adrian_otto has quit IRC20:20
openstackgerritMerged openstack-infra/tripleo-ci: Exclude CI project from DLRN building  https://review.openstack.org/41841520:21
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: neutron: pass 'dvr' to gate_hook to enable DVR tests  https://review.openstack.org/41303220:21
*** ociuhandu has quit IRC20:22
openstackgerritMerged openstack-infra/shade: Log request ids when debug logging is enabled  https://review.openstack.org/41793120:23
*** spzala has joined #openstack-infra20:23
*** asettle has joined #openstack-infra20:24
*** EricGonczer_ has joined #openstack-infra20:25
*** florianf has quit IRC20:28
openstackgerritAlex Schultz proposed openstack-infra/tripleo-ci: Use support report command to collect node logs  https://review.openstack.org/41856220:29
*** annegentle has joined #openstack-infra20:30
*** ociuhandu has joined #openstack-infra20:33
*** salv-orlando has joined #openstack-infra20:33
*** ociuhandu has quit IRC20:37
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Fix name of rally py35 neutron job  https://review.openstack.org/41856320:39
*** salv-orlando has quit IRC20:40
*** ldnunes has quit IRC20:41
openstackgerritAlex Schultz proposed openstack-infra/tripleo-ci: Use support report command to collect node logs  https://review.openstack.org/41856220:42
*** rbuzatu has quit IRC20:45
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: Use quickstart-extras checked out from zuul refs  https://review.openstack.org/41812320:47
fungistill don't have time to test closely, but brief browsing around docs.o.o seems fine to me20:47
fungigreat work, everyone!20:47
*** ociuhandu has joined #openstack-infra20:48
*** raildo has quit IRC20:48
*** salv-orlando has joined #openstack-infra20:49
*** ociuhandu has quit IRC20:52
*** oanson has quit IRC20:52
*** oanson has joined #openstack-infra20:53
openstackgerritPaul Belanger proposed openstack-infra/nodepool: [WIP] Support AFS mirrors for nodepool diskimages  https://review.openstack.org/41427320:53
*** annegentle has quit IRC20:53
*** rhallisey has quit IRC20:54
*** adriant has joined #openstack-infra20:54
*** annegentle has joined #openstack-infra20:54
*** dfflanders has joined #openstack-infra20:54
jeblairfungi, pabelanger, AJaeger: yeah, traffic is still ramping up, but it's been almost an hour, so we should be about done.  load average is nearly 0.4.  i think we'll be okay.  :)20:58
AJaegergreat!20:59
pabelangeragree, looks good20:59
*** sambetts is now known as sambetts|afk21:02
*** Goneri has quit IRC21:02
fungihttp://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=35421:02
*** ociuhandu has joined #openstack-infra21:03
*** dave-mccowan has quit IRC21:03
*** oanson has quit IRC21:04
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Fix name of rally py35 neutron job  https://review.openstack.org/41856321:05
*** oanson has joined #openstack-infra21:05
*** wolverineav has quit IRC21:06
AJaegeroh, we miss a few pages like http://docs.openstack.org/infra/publications/ . I'll tar up the content tomorrow and ask for adding it...21:06
AJaegersorry, have to leave now.21:06
*** tonytan4ever has quit IRC21:06
*** tonytan4ever has joined #openstack-infra21:06
*** wolverineav has joined #openstack-infra21:07
*** ociuhandu has quit IRC21:07
dimsAJaeger : everytime i think i understand what i am doing gate-project-config-layout reminds me who is the boss21:07
*** laurelm has quit IRC21:08
AJaegerdims: our tests are the boss - I gave a +2 ;)21:08
*** eglute has quit IRC21:08
dims:)21:08
*** irtermite has quit IRC21:08
*** laurelm_ has joined #openstack-infra21:08
*** eglute has joined #openstack-infra21:08
*** laurelm_ is now known as laurelm21:08
AJaegerdims, I still trust you ;)21:08
*** irtermite has joined #openstack-infra21:09
*** HenryG has quit IRC21:09
dimsthanks AJaeger :)21:09
pabelangerfungi: AJaeger: jeblair: I'll update the TTL for docs.o.o once I return from my errand, unless somebody else would like to change it21:11
*** wolverineav has quit IRC21:11
*** HenryG has joined #openstack-infra21:12
*** nadya has quit IRC21:16
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611021:16
*** ryotagami has quit IRC21:17
*** dimtruck is now known as zz_dimtruck21:18
*** ryotagami has joined #openstack-infra21:19
*** srobert has joined #openstack-infra21:22
*** kgiusti has left #openstack-infra21:22
*** oanson has quit IRC21:24
*** oanson has joined #openstack-infra21:25
*** srobert_ has quit IRC21:25
*** eharney has quit IRC21:27
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611021:29
openstackgerritfumihiko kakuma proposed openstack-infra/devstack-gate: Allow to run post_devstack_hook  https://review.openstack.org/39592221:31
*** nherciu__ has quit IRC21:32
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Fix name of rally py35 neutron job  https://review.openstack.org/41856321:34
*** gouthamr has quit IRC21:34
*** Jeffrey4l_ has joined #openstack-infra21:35
*** Jeffrey4l has quit IRC21:35
*** zz_dimtruck is now known as dimtruck21:36
*** wolverineav has joined #openstack-infra21:37
*** wolverineav has quit IRC21:37
*** wolverineav has joined #openstack-infra21:37
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add support for a new job testing Heat Convergence  https://review.openstack.org/41760121:38
*** jeckersb is now known as jeckersb_gone21:38
*** thiagolib has quit IRC21:38
openstackgerritAlex Schultz proposed openstack-infra/tripleo-ci: Use support report command to collect node logs  https://review.openstack.org/41856221:40
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add framework for handling node requests  https://review.openstack.org/41858521:45
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611021:46
jheskethMorning21:47
*** trown is now known as trown|outtypewww21:47
*** krtaylor has quit IRC21:47
*** pcaruana has quit IRC21:48
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Fix name of rally py35 neutron job  https://review.openstack.org/41856321:49
*** pradk has quit IRC21:49
*** annegentle has quit IRC21:50
*** sree has joined #openstack-infra21:51
*** annegentle has joined #openstack-infra21:52
*** zara_the_lemur__ has left #openstack-infra21:52
*** rafaels has joined #openstack-infra21:54
*** fguillot has quit IRC21:55
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add framework for handling node requests  https://review.openstack.org/41858521:55
*** sree has quit IRC21:55
*** ociuhandu has joined #openstack-infra21:55
*** flepied has quit IRC21:55
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add framework for handling node requests  https://review.openstack.org/41858521:58
fungiis https://pypi.python.org/pypi/curio what hummingbord needed out of go that python didn't provide?21:58
*** antonym has quit IRC21:58
fungi(granted, that's py3k-only)21:58
*** rbrndt has quit IRC21:59
*** dprince has quit IRC22:01
*** rbrndt has joined #openstack-infra22:03
*** hurgleburgler has joined #openstack-infra22:04
*** rhallisey has joined #openstack-infra22:04
*** rbrndt has quit IRC22:04
*** rbrndt has joined #openstack-infra22:04
*** rbrndt has quit IRC22:05
*** rbrndt has joined #openstack-infra22:06
dimsfungi : clarkb : hopefully a easy one if you get a chance (https://review.openstack.org/#/c/418563/) apparently neutron rally jobs are a bit special22:06
fungicolor me surprised ;)22:07
*** tonytan4ever has quit IRC22:07
openstackgerritIan Wienand proposed openstack-infra/project-config: Rename project Nomad to Cyborg based upon team voting and consensus  https://review.openstack.org/40111522:08
*** rafaels has quit IRC22:08
*** priteau has quit IRC22:08
*** adrian_otto has joined #openstack-infra22:09
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction  https://review.openstack.org/39173822:10
*** Goneri has joined #openstack-infra22:13
*** nadya has joined #openstack-infra22:16
openstackgerritIan Wienand proposed openstack-infra/project-config: Rename nimble to mogan (2)  https://review.openstack.org/41567522:18
openstackgerritMerged openstack-infra/project-config: Fix name of rally py35 neutron job  https://review.openstack.org/41856322:19
*** Sukhdev has joined #openstack-infra22:20
*** nadya has quit IRC22:21
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction  https://review.openstack.org/39173822:21
*** salv-orl_ has joined #openstack-infra22:23
*** ihrachys has quit IRC22:23
*** tnovacik has quit IRC22:24
*** dmanchad is now known as dmanchad|off22:24
*** salv-orlando has quit IRC22:25
*** ihrachys has joined #openstack-infra22:27
*** wolverineav has quit IRC22:27
*** annegent_ has joined #openstack-infra22:27
*** annegentle has quit IRC22:27
*** ihrachys has quit IRC22:28
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483122:30
*** antonym has joined #openstack-infra22:31
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483122:31
* jeblair salutes Major Upgrade22:32
*** rbuzatu has joined #openstack-infra22:32
openstackgerritIan Wienand proposed openstack-infra/project-config: Rename nimble to mogan (2)  https://review.openstack.org/41567522:32
*** jheroux has quit IRC22:33
*** krtaylor has joined #openstack-infra22:33
*** jcoufal has quit IRC22:36
*** rbuzatu has quit IRC22:36
*** mriedem has joined #openstack-infra22:37
*** antonym has quit IRC22:37
*** marst has quit IRC22:39
*** wolverineav has joined #openstack-infra22:39
clarkbok mostly back at this point, catching up now22:42
*** antonym has joined #openstack-infra22:42
*** antonym has quit IRC22:42
*** antonym has joined #openstack-infra22:42
clarkbthey take pictures of the inside of your eyeball, its pretty neat22:43
*** wolverineav has quit IRC22:44
*** thorst has quit IRC22:45
*** adrian_otto has quit IRC22:46
*** booleanfour has quit IRC22:47
*** gouthamr has joined #openstack-infra22:47
ianwit sounds neat when it's happening to someone else :)  otherwise a little terrifying22:47
*** kzaitsev_mb has joined #openstack-infra22:49
*** wolverineav has joined #openstack-infra22:49
*** asettle has quit IRC22:51
openstackgerritMerged openstack-infra/subunit2sql: Add get_run_count DB API function  https://review.openstack.org/41751922:52
clarkbianw: its non invasive, you put your face up against a thing and then bright green light goes off22:53
*** wolverineav has quit IRC22:54
*** aviau has quit IRC22:55
*** aviau has joined #openstack-infra22:55
*** srobert has quit IRC22:57
*** Sukhdev has quit IRC22:58
*** xyang1 has quit IRC23:00
*** Swami has quit IRC23:01
*** mriedem has quit IRC23:03
*** mriedem has joined #openstack-infra23:04
*** dave-mccowan has joined #openstack-infra23:05
*** isviridov_away has joined #openstack-infra23:06
*** vaidy has joined #openstack-infra23:06
*** winggundamth has joined #openstack-infra23:07
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Stop running if zuul job goes away  https://review.openstack.org/41861523:08
*** gordc has quit IRC23:08
pabelangerokay, docs.o.o TTL back to 6023:09
pabelangerup from 523:09
*** annegent_ has quit IRC23:10
*** ociuhandu has quit IRC23:10
*** asettle has joined #openstack-infra23:12
*** asettle has quit IRC23:12
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Stop running if zuul job goes away  https://review.openstack.org/41861523:14
*** rkukura has joined #openstack-infra23:15
*** hurgleburgler has quit IRC23:17
*** wolverineav has joined #openstack-infra23:19
vgadirajclarkb: Hi! I have a simple change that has been sitting on gerrit since mid november. https://review.openstack.org/#/c/396414/ I received a +2 from you :) and got another +1 as well, I was wondering if I could get another review from a core so we can get this merged? :)23:19
pabelangerclarkb: ianw: mind a review on https://review.openstack.org/#/c/418518/? Adds check jobs for nodepool dsvm for glean.  Plan on using https://review.openstack.org/#/c/365079/ as the smoke test23:20
*** EricGonczer_ has quit IRC23:20
*** MasterOfBugs has joined #openstack-infra23:20
*** mriedem has quit IRC23:20
pabelangervgadiraj: +323:20
*** larainema has quit IRC23:21
*** mattfarina has quit IRC23:21
*** asaprykin has quit IRC23:21
*** ediardo has quit IRC23:21
vgadirajpabelanger: thank you so much! :)23:21
*** dirk has quit IRC23:21
*** xgerman has quit IRC23:22
*** dougwig has quit IRC23:22
openstackgerritAlex Schultz proposed openstack-infra/tripleo-ci: Use support report command to collect node logs  https://review.openstack.org/41856223:22
*** jraim has quit IRC23:22
*** briancurtin has quit IRC23:22
*** skath has quit IRC23:23
*** morgan has quit IRC23:23
*** sdague has quit IRC23:23
*** wolverineav has quit IRC23:24
*** mattfarina has joined #openstack-infra23:24
*** asaprykin has joined #openstack-infra23:24
*** dougwig has joined #openstack-infra23:25
*** larainema has joined #openstack-infra23:25
pabelangervgadiraj: np23:25
*** jraim has joined #openstack-infra23:26
*** skath has joined #openstack-infra23:26
openstackgerritMerged openstack-infra/project-config: Have glean run non-voting nodepool dsvm jobs  https://review.openstack.org/41851823:27
*** jaosorior has quit IRC23:27
jlvillalfungi: Letsencrypt has issues because....  ?   I had some meetings and lunch I had to attend, so why I am late getting back to you.23:28
*** wolverineav has joined #openstack-infra23:29
openstackgerritMerged openstack-infra/subunit2sql: Add DB API function to get multiple tests by test_id  https://review.openstack.org/41854123:29
*** rhallisey has quit IRC23:31
*** thorst has joined #openstack-infra23:31
*** gildub has joined #openstack-infra23:33
*** wolverineav has quit IRC23:33
fungijlvillal: fewer as time goes on at least. main ones which impact us still are that we'll end up replacing certs 10x as often (literally), the volume of certs we need to replace will exceed their normal weekly limit and so will need to be staggered, and their protocol is still changing too rapidly to support client implementations in long-term stable distros23:33
*** john-davidge has joined #openstack-infra23:34
fungialso a lot of us still like to be present when updating certs, so automated cert replacement isn't a huge benefit (and we've seen it go horribly wrong for other early adopters so far)23:34
*** panda is now known as panda|zZ23:35
*** thorst has quit IRC23:35
*** ediardo has joined #openstack-infra23:35
fungii'm also still not entirely comfortable with mofo et all putting cacert.org through the wringer from an audit standpoint, only to turn around and set up their own free ca service instead of supporting a community-led effort23:36
*** dimtruck is now known as zz_dimtruck23:37
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Run with actual node count  https://review.openstack.org/41862223:37
fungiand a far less transparent one at that23:37
*** gildub has quit IRC23:37
jeblairclarkb, mordred: do you know how the nodepool integration test failure was fixed?23:38
*** john-davidge has quit IRC23:38
*** morgan_ has joined #openstack-infra23:38
*** wolverineav has joined #openstack-infra23:39
clarkbjeblair: I do!23:39
jeblairclarkb: ooh!  do tell!23:40
openstackgerritPaul Belanger proposed openstack-infra/nodepool: [WIP] Support AFS mirrors for nodepool diskimages  https://review.openstack.org/41427323:40
clarkbjeblair: I hopped on mordred's held node and poked around and noticed that the demo user had a network visible to it but it was only for floating IP type deals (external).23:40
clarkbjeblair: neutron doesn't let you direct attach to that so that appeared to be the underlying reason no IPs were attached to hosts. Digging further I noticed that there were private networks created but they were all created under the admin user/project23:41
clarkbjeblair: digging even further I found that one of these private networks had subnets that belonged to the demo user23:41
clarkbjeblair: so basically the "wires" got plugged into the "switch/router" all wrong23:41
openstackgerritMerged openstack-infra/nodepool: Remove the ability for nodepoold to launch a builder  https://review.openstack.org/41813723:41
clarkbjeblair: then I happened to by chance catch a discussion about how openstacksdk broke openstackclient networking things in a meeting23:42
* jeblair blames the network group23:42
clarkbjeblair: the revert was in process for that already and once it merged rechecks on nodepool tests were happy again23:42
clarkbI think sc68cal managed to track it down to a specific openstacksdk commit but basically they were interacting with the api in such a way that the admin user was used isntead of the demo user23:42
clarkband wires got cross and then boom no more networking23:43
clarkbthe reason this did not affect tempest just is that tempest bootstraps all that stuff itself using its own clients23:43
jeblairclarkb: cool... does openstacksdk need some openstackclient integration tests maybe?23:43
*** wolverineav has quit IRC23:43
clarkbjeblair: yes I think they need that and they also need tests that exercise sdk/client directly instead of tempest's bypass23:43
*** hurgleburgler has joined #openstack-infra23:44
*** stakeda has joined #openstack-infra23:44
*** rbrndt has quit IRC23:44
openstackgerritIan Wienand proposed openstack-infra/project-config: Rename nimble to mogan (2)  https://review.openstack.org/41567523:45
openstackgerritMerged openstack-infra/tripleo-ci: Instal jq before deploy.sh in OVB jobs  https://review.openstack.org/41850623:46
*** dingyichen has joined #openstack-infra23:47
*** wolverineav has joined #openstack-infra23:48
*** inc0 has quit IRC23:48
*** hurgleburgler has quit IRC23:49
ianwpleia2: you're clearly not running wayland / gnome-shell :) re t46023:49
*** nadya has joined #openstack-infra23:50
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Use rdo-qemu-ev repo in mitaka jobs  https://review.openstack.org/41851023:50
*** gildub has joined #openstack-infra23:50
jlvillalfungi: Thanks for the info. Sorry someone wandered into my cube right after I asked the question...23:51
*** sree has joined #openstack-infra23:51
*** wolverineav has quit IRC23:53
*** rfolco has quit IRC23:53
*** nadya has quit IRC23:54
pleia2ianw: heh, no, Xubuntu over here in old xorg land ;)23:54
*** sree has quit IRC23:55
clarkbhrm I wonder if wayland would make my monitor displayport issue less bad23:56
clarkbrestarting X seems to fix it typically23:56
*** ianychoi has joined #openstack-infra23:56
clarkbimplying it is at least part of the problem23:56
*** vhosakot has quit IRC23:56
ianwi think you have the very definition of out of the frying pan, into the fire there :)23:57
jeblairianw, clarkb: indeed -- you might not *notice* the displayport problem any more.... :)23:58
*** wolverineav has joined #openstack-infra23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!