Thursday, 2017-01-12

*** lindycoder has joined #openstack-infra00:01
*** wolverin_ has quit IRC00:02
*** spzala has joined #openstack-infra00:02
*** pvaneck has quit IRC00:03
*** fitoduarte has joined #openstack-infra00:05
*** xarses_ has joined #openstack-infra00:09
*** ianychoi has joined #openstack-infra00:10
*** gordc has quit IRC00:10
*** jcoufal has joined #openstack-infra00:10
*** xarses has quit IRC00:12
*** jcoufal has quit IRC00:12
*** tphummel has quit IRC00:13
*** annegentle has joined #openstack-infra00:13
*** dingyichen has joined #openstack-infra00:15
*** tphummel has joined #openstack-infra00:15
*** wolverineav has joined #openstack-infra00:17
*** xarses_ has quit IRC00:17
*** mriedem has quit IRC00:19
*** mriedem has joined #openstack-infra00:20
openstackgerritChris Krelle proposed openstack-infra/glean: Adjust the way we wait for interfaces to become available  https://review.openstack.org/35947100:22
*** wolverineav has quit IRC00:22
*** dprince has quit IRC00:22
*** wolverineav has joined #openstack-infra00:23
*** xarses has joined #openstack-infra00:24
*** xarses_ has joined #openstack-infra00:24
*** xarses has quit IRC00:28
*** gildub has quit IRC00:29
*** lindycoder has quit IRC00:30
*** pvaneck has joined #openstack-infra00:31
*** asettle has joined #openstack-infra00:35
*** rfolco has joined #openstack-infra00:37
*** rfolco has quit IRC00:37
*** asettle has quit IRC00:38
*** Julien-zte has joined #openstack-infra00:38
*** asettle has joined #openstack-infra00:38
*** sdake has joined #openstack-infra00:40
*** camunoz has quit IRC00:40
*** jkilpatr has joined #openstack-infra00:40
*** sdake_ has quit IRC00:41
*** wolverineav has quit IRC00:41
*** isviridov_away has joined #openstack-infra00:42
*** pcrews has joined #openstack-infra00:43
*** vaidy has joined #openstack-infra00:43
*** asettle has quit IRC00:44
*** andreww has joined #openstack-infra00:44
*** xarses has joined #openstack-infra00:46
*** sdake_ has joined #openstack-infra00:47
*** spligak has quit IRC00:47
*** xarses_ has quit IRC00:48
*** xarses_ has joined #openstack-infra00:49
*** andreww has quit IRC00:49
*** sdake has quit IRC00:49
*** jamielennox is now known as jamielennox|away00:50
*** stakeda has joined #openstack-infra00:51
*** wolverineav has joined #openstack-infra00:51
*** annegentle has quit IRC00:51
*** zz_dimtruck is now known as dimtruck00:51
*** xarses_ has quit IRC00:51
*** xarses has quit IRC00:51
*** xarses has joined #openstack-infra00:52
*** xarses has quit IRC00:53
*** xarses has joined #openstack-infra00:53
*** thorst_ has joined #openstack-infra00:53
*** xarses has quit IRC00:54
*** xarses has joined #openstack-infra00:54
*** wolverineav has quit IRC00:55
*** Julien-zte has quit IRC00:58
*** fitoduarte has quit IRC00:58
*** thorst_ has quit IRC00:58
*** Julien-zte has joined #openstack-infra00:58
*** lindycoder has joined #openstack-infra01:01
*** PramodJ has joined #openstack-infra01:03
*** MasterOfBugs has quit IRC01:05
*** sdague has quit IRC01:05
*** xarses_ has joined #openstack-infra01:06
*** xarses_ has quit IRC01:06
*** pvaneck has quit IRC01:07
*** pramodrj07 has quit IRC01:07
*** xarses has quit IRC01:07
*** xarses_ has joined #openstack-infra01:07
*** PramodJ has quit IRC01:08
*** pramodrj07 has joined #openstack-infra01:10
*** MasterOfBugs has joined #openstack-infra01:10
*** wolverineav has joined #openstack-infra01:11
*** mtanino has quit IRC01:11
*** tuanluong has joined #openstack-infra01:12
*** liujiong has joined #openstack-infra01:12
*** xarses_ has quit IRC01:12
*** pramodrj07 has quit IRC01:14
*** MasterOfBugs has quit IRC01:14
*** wolverineav has quit IRC01:15
*** thorst_ has joined #openstack-infra01:17
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: WIP: Multinode periodic tempest  https://review.openstack.org/37623701:17
*** rui has joined #openstack-infra01:18
*** wolverineav has joined #openstack-infra01:20
*** jamielennox|away is now known as jamielennox01:21
*** yanyanhu has joined #openstack-infra01:23
*** wolverineav has quit IRC01:25
ruihi all, could someone help change the owner of zvm-ci to zvm-driver-core group?01:26
*** spzala has quit IRC01:27
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: grafana/networking-odl:  remove graph for non-existing jobs  https://review.openstack.org/41869901:32
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: networking-odl: add experimental job with new vpnservice with  https://review.openstack.org/41923001:35
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: networking-odl: multinode job with ODL vpnservice  https://review.openstack.org/41923101:35
*** gouthamr has quit IRC01:36
openstackgerritzhurong proposed openstack-infra/project-config: Fix the missing quote lead to gate broken for solum  https://review.openstack.org/41923301:42
*** dimtruck is now known as zz_dimtruck01:42
*** rui has quit IRC01:44
*** yamamoto_ has joined #openstack-infra01:47
*** kjorgensen has quit IRC01:48
*** zz_dimtruck is now known as dimtruck01:49
*** wolverineav has joined #openstack-infra01:50
*** kjorgensen has joined #openstack-infra01:52
*** adrian_otto has quit IRC01:53
*** kjorgens_ has joined #openstack-infra01:53
*** camunoz has joined #openstack-infra01:54
*** wolverineav has quit IRC01:55
*** kjorgensen has quit IRC01:56
*** kjorgens_ has quit IRC01:57
fungii performed rui's request, though i see they've already dropped back off the channel again02:06
* fungi fades back into the shadows of the evening02:06
*** zhurong has joined #openstack-infra02:10
*** rkukura has quit IRC02:11
*** kaisers has quit IRC02:13
*** kaisers1 has quit IRC02:13
*** kzaitsev_mb has quit IRC02:15
*** ijw has quit IRC02:18
*** lindycoder has quit IRC02:18
*** tphummel has quit IRC02:19
*** rui has joined #openstack-infra02:23
*** kaisers has joined #openstack-infra02:30
*** kaisers1 has joined #openstack-infra02:30
*** gouthamr has joined #openstack-infra02:32
*** hongbin_ has joined #openstack-infra02:33
*** markvoelker has quit IRC02:38
*** thorst_ has quit IRC02:38
*** thorst_ has joined #openstack-infra02:39
*** markvoelker_ has joined #openstack-infra02:41
*** yamahata has quit IRC02:43
*** thorst_ has quit IRC02:43
*** gildub has joined #openstack-infra02:44
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Check for post_test_hook.sh in placement job  https://review.openstack.org/41924302:45
mriedemyou should totally fade back out for this ^02:45
*** spligak has joined #openstack-infra02:48
*** spzala has joined #openstack-infra02:51
*** markvoelker_ has quit IRC02:56
*** rbuzatu has joined #openstack-infra02:57
*** yamamoto_ has quit IRC02:59
*** rbuzatu has quit IRC03:02
*** rui has quit IRC03:04
*** yamamoto_ has joined #openstack-infra03:05
*** ijw has joined #openstack-infra03:08
*** sdake_ has quit IRC03:10
*** tuanluong_ has joined #openstack-infra03:10
*** tuanluong has quit IRC03:10
*** sdake has joined #openstack-infra03:11
*** dimtruck is now known as zz_dimtruck03:12
*** zz_dimtruck is now known as dimtruck03:12
*** ijw has quit IRC03:13
*** ijw_ has joined #openstack-infra03:13
*** jamesdenton has joined #openstack-infra03:14
*** ijw_ has quit IRC03:14
*** sdake_ has joined #openstack-infra03:15
*** adrian_otto has joined #openstack-infra03:15
*** adrian_otto has quit IRC03:15
*** adrian_otto has joined #openstack-infra03:16
*** sdake has quit IRC03:17
*** ijw has joined #openstack-infra03:17
*** ijw has quit IRC03:18
*** jamesdenton has quit IRC03:18
*** lindycoder has joined #openstack-infra03:18
*** sdake_ has quit IRC03:18
*** baoli has joined #openstack-infra03:20
*** sdake has joined #openstack-infra03:22
*** adrian_otto has quit IRC03:22
*** ijw has joined #openstack-infra03:22
*** lindycoder has quit IRC03:23
*** ijw_ has joined #openstack-infra03:23
*** tlian has quit IRC03:24
*** ramishra has quit IRC03:25
*** tlian has joined #openstack-infra03:25
*** spzala has quit IRC03:26
*** ijw has quit IRC03:27
*** ramishra has joined #openstack-infra03:27
*** apetrich has quit IRC03:28
*** apetrich has joined #openstack-infra03:28
*** vikrant has joined #openstack-infra03:31
*** rui has joined #openstack-infra03:31
*** zhurong has quit IRC03:39
*** links has joined #openstack-infra03:39
*** gildub has quit IRC03:51
*** hongbin_ has quit IRC03:55
*** baoli has quit IRC03:57
*** markvoelker has joined #openstack-infra03:57
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611004:04
*** sree has joined #openstack-infra04:04
*** sree has quit IRC04:04
*** sree has joined #openstack-infra04:04
*** psachin has joined #openstack-infra04:05
*** tphummel has joined #openstack-infra04:07
*** spzala has joined #openstack-infra04:08
*** tlian has quit IRC04:09
*** Jeffrey4l__ has joined #openstack-infra04:11
*** nicolasbock has quit IRC04:11
*** spzala has quit IRC04:12
*** Jeffrey4l_ has quit IRC04:14
*** lindycoder has joined #openstack-infra04:15
*** lindycoder has quit IRC04:17
*** umeshksingla has joined #openstack-infra04:19
*** hongbin_ has joined #openstack-infra04:21
*** amotoki has quit IRC04:22
*** amotoki has joined #openstack-infra04:22
*** xarses has joined #openstack-infra04:24
*** xarses_ has joined #openstack-infra04:25
*** tphummel has quit IRC04:26
*** adrian_otto has joined #openstack-infra04:28
*** kjorgensen has joined #openstack-infra04:28
*** xarses has quit IRC04:28
*** adrian_otto has quit IRC04:28
*** gildub has joined #openstack-infra04:32
*** kjorgensen has quit IRC04:32
*** umeshksingla has left #openstack-infra04:32
*** umeshksingla has joined #openstack-infra04:33
*** lindycoder has joined #openstack-infra04:33
*** xarses_ has quit IRC04:33
*** lindycoder has quit IRC04:34
*** nmathew- has joined #openstack-infra04:35
*** adriant has quit IRC04:47
*** dikonoor has joined #openstack-infra04:48
*** umeshksingla has quit IRC04:49
openstackgerritavnish proposed openstack/os-client-config: Use upper-constraints for tox envs  https://review.openstack.org/41927304:51
*** jamespage has quit IRC05:00
*** armax has quit IRC05:06
*** armax has joined #openstack-infra05:11
*** hongbin_ has quit IRC05:13
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611005:17
*** sc68cal has quit IRC05:18
*** icey has quit IRC05:18
*** sc68cal has joined #openstack-infra05:20
*** yamahata has joined #openstack-infra05:21
*** salv-orlando has joined #openstack-infra05:26
*** icey has joined #openstack-infra05:27
*** icey has quit IRC05:27
*** icey has joined #openstack-infra05:27
*** salv-orlando has quit IRC05:31
*** aeng has quit IRC05:35
*** thorst_ has joined #openstack-infra05:40
*** yamamoto_ has quit IRC05:42
*** thorst_ has quit IRC05:44
*** dkehn has quit IRC05:56
*** dkehn has joined #openstack-infra05:56
*** itisha has quit IRC06:02
*** andrewbogott has quit IRC06:04
*** andrewbogott has joined #openstack-infra06:04
*** armax has quit IRC06:07
*** armax has joined #openstack-infra06:07
*** armax has quit IRC06:08
*** rkukura has joined #openstack-infra06:08
*** reed_ has joined #openstack-infra06:18
*** reed_ has quit IRC06:19
*** rkukura has left #openstack-infra06:23
*** zhurong has joined #openstack-infra06:23
*** lindycoder has joined #openstack-infra06:23
*** salv-orlando has joined #openstack-infra06:28
*** rkukura has joined #openstack-infra06:29
*** salv-orlando has quit IRC06:32
*** rbuzatu has joined #openstack-infra06:34
*** yamamoto_ has joined #openstack-infra06:35
*** bhavik1 has joined #openstack-infra06:36
*** pahuang has quit IRC06:37
*** rbuzatu has quit IRC06:39
*** thorst_ has joined #openstack-infra06:40
*** nadya has joined #openstack-infra06:41
*** makowals has quit IRC06:43
*** lindycoder has quit IRC06:44
*** makowals has joined #openstack-infra06:44
*** rbuzatu has joined #openstack-infra06:45
*** thorst_ has quit IRC06:45
*** bhavik1 has quit IRC06:47
*** nadya has quit IRC06:49
*** lindycoder has joined #openstack-infra06:52
*** wolverineav has joined #openstack-infra06:53
*** e0ne has joined #openstack-infra06:55
*** lindycoder has quit IRC06:57
*** camunoz has quit IRC06:57
*** wolverineav has quit IRC06:57
*** e0ne has quit IRC06:57
*** salv-orlando has joined #openstack-infra06:57
*** snarwade has joined #openstack-infra06:59
*** ccamacho has left #openstack-infra06:59
*** nadya has joined #openstack-infra07:01
*** huanxie has joined #openstack-infra07:02
*** esikachev has joined #openstack-infra07:03
*** tnovacik has joined #openstack-infra07:03
*** Hal has joined #openstack-infra07:08
*** Hal is now known as Guest4032407:09
AJaegerinfra-root, gerrit is becoming unresponsive - time to restart it?07:09
*** tjones has quit IRC07:09
jheskethAJaeger: yeah, it's getting pretty slow07:10
jheskethI'll do a restart07:10
*** wolverineav has joined #openstack-infra07:12
jheskethdone07:12
jheskethseems more responsive again07:12
*** rkukura has quit IRC07:13
AJaegerthanks, jhesketh !07:13
*** florianf has joined #openstack-infra07:14
*** tesseract has joined #openstack-infra07:14
*** rkukura has joined #openstack-infra07:15
*** wolverineav has quit IRC07:17
*** andreas_s has joined #openstack-infra07:18
*** knangia has joined #openstack-infra07:21
*** pgadiya has joined #openstack-infra07:23
*** nadya has quit IRC07:25
*** psachin has quit IRC07:27
*** psachin has joined #openstack-infra07:29
*** winggundamth has joined #openstack-infra07:30
*** umeshksingla has joined #openstack-infra07:36
*** john-davidge has joined #openstack-infra07:37
*** nherciu has joined #openstack-infra07:38
*** ttx has quit IRC07:40
*** ttx has joined #openstack-infra07:40
*** nadya has joined #openstack-infra07:40
*** gouthamr has quit IRC07:42
*** john-davidge has quit IRC07:42
*** wolverineav has joined #openstack-infra07:43
*** mptacekx has joined #openstack-infra07:44
*** Julien-zte has quit IRC07:46
*** ttx has quit IRC07:47
*** ttx has joined #openstack-infra07:47
*** logan- has quit IRC07:47
*** wolverineav has quit IRC07:48
*** nherciu_ has joined #openstack-infra07:49
*** ralonsoh has joined #openstack-infra07:52
*** nherciu has quit IRC07:52
*** esikachev has quit IRC07:55
*** logan- has joined #openstack-infra07:56
*** tnovacik has quit IRC07:57
*** matrohon has joined #openstack-infra07:59
*** esikachev has joined #openstack-infra08:00
*** ccamacho has joined #openstack-infra08:02
*** rui has quit IRC08:04
yolandagood morning08:04
*** esikachev has quit IRC08:05
*** sflanigan has quit IRC08:05
*** wolverineav has joined #openstack-infra08:05
*** umeshksingla has quit IRC08:05
*** Guest40324 has quit IRC08:06
*** flepied has quit IRC08:07
*** Hal has joined #openstack-infra08:07
*** Hal is now known as Guest748108:08
*** esikachev has joined #openstack-infra08:08
*** wolverineav has quit IRC08:10
AJaegermorning, yolanda. Everything green again AFAIU ;)08:11
*** esikachev has quit IRC08:12
yolandaso we can review!08:13
*** pgadiya has quit IRC08:14
*** wolverineav has joined #openstack-infra08:15
*** hongbin has quit IRC08:16
AJaegerand approve ;)08:16
*** dingyichen has quit IRC08:20
*** wolverineav has quit IRC08:20
*** dimtruck is now known as zz_dimtruck08:22
*** csomerville has joined #openstack-infra08:23
*** cody-somerville has quit IRC08:23
*** Guest7481 has quit IRC08:24
*** rui has joined #openstack-infra08:24
*** markus_z has joined #openstack-infra08:26
*** strigazi_AFK is now known as strigazi08:28
*** esikachev has joined #openstack-infra08:29
*** jpich has joined #openstack-infra08:31
*** winggundamth has quit IRC08:33
*** john-davidge has joined #openstack-infra08:33
*** yamahata has quit IRC08:35
*** esikachev has quit IRC08:35
*** hashar has joined #openstack-infra08:36
*** jordanP has joined #openstack-infra08:37
*** jpich has quit IRC08:37
*** jordanP has quit IRC08:37
*** jpich has joined #openstack-infra08:38
*** esikachev has joined #openstack-infra08:38
*** umeshksingla has joined #openstack-infra08:40
*** thorst_ has joined #openstack-infra08:41
*** salv-orl_ has joined #openstack-infra08:43
*** salv-orlando has quit IRC08:43
*** nmathew- has quit IRC08:43
*** arxcruz has quit IRC08:45
*** arxcruz has joined #openstack-infra08:46
*** thorst_ has quit IRC08:46
*** pgadiya has joined #openstack-infra08:47
*** flepied has joined #openstack-infra08:48
*** tojuvone has quit IRC08:58
*** zzzeek has quit IRC09:00
*** zzzeek has joined #openstack-infra09:00
*** david-lyle has quit IRC09:01
*** pgadiya has quit IRC09:03
*** pgadiya has joined #openstack-infra09:06
*** e0ne has joined #openstack-infra09:07
openstackgerritMerged openstack-infra/project-config: Fix the missing quote lead to gate broken for solum  https://review.openstack.org/41923309:15
openstackgerritMerged openstack-infra/project-config: Check for post_test_hook.sh in placement job  https://review.openstack.org/41924309:16
openstackgerritMerged openstack-infra/project-config: Glance experimental  multinode grenade jobs  https://review.openstack.org/41432609:16
openstackgerritMerged openstack-infra/project-config: Add Karbor coverage jobs  https://review.openstack.org/41880809:16
openstackgerritMerged openstack-infra/project-config: OSA: Skip CentOS tests for OpenStack roles for Mitaka  https://review.openstack.org/41881809:16
openstackgerritMerged openstack-infra/project-config: Remove sheepdog jobs from cinder queue  https://review.openstack.org/41907509:16
openstackgerritMerged openstack-infra/project-config: Remove deprecated neutron options  https://review.openstack.org/41854209:16
openstackgerritMerged openstack-infra/project-config: Remove delay-release from Gnocchi and gnocchiclient  https://review.openstack.org/41907209:17
*** nmathew has joined #openstack-infra09:21
openstackgerritMerged openstack-infra/project-config: Make dragonflow fullstack tests voting  https://review.openstack.org/41770209:21
*** xnox has quit IRC09:22
openstackgerritMerged openstack-infra/project-config: Fuxi: Add python35 dsvm non-voting jobs  https://review.openstack.org/41774109:22
*** lucas-afk is now known as lucasagomes09:22
openstackgerritMerged openstack-infra/project-config: Add one new Fuel's plugin  https://review.openstack.org/41365609:22
openstackgerritMerged openstack-infra/project-config: Add new project os-dpm  https://review.openstack.org/41355809:22
*** david-lyle has joined #openstack-infra09:24
*** pgadiya has quit IRC09:24
*** shardy has joined #openstack-infra09:25
*** panda|Zz is now known as panda09:26
*** salv-orl_ has quit IRC09:26
*** OferBarber has joined #openstack-infra09:26
*** rui has quit IRC09:28
*** rossella_ has joined #openstack-infra09:29
*** dizquierdo has joined #openstack-infra09:30
*** mhickey_ has joined #openstack-infra09:32
*** jordanP has joined #openstack-infra09:33
openstackgerritAndrey Nikitin proposed openstack-infra/project-config: Add one new Fuel's plugin  https://review.openstack.org/41365109:35
*** esikachev has quit IRC09:36
openstackgerritJordan Pittier proposed openstack-infra/project-config: Layout: make gate-tempest-dsvm-full-devstack-plugin-ceph non-voting  https://review.openstack.org/41885109:38
*** esikachev has joined #openstack-infra09:38
*** pgadiya has joined #openstack-infra09:40
*** knangia has quit IRC09:40
*** asettle has joined #openstack-infra09:41
*** pgadiya_ has joined #openstack-infra09:41
*** esikachev has quit IRC09:42
*** dtardivel has joined #openstack-infra09:44
*** zhurong has quit IRC09:44
*** gildub has quit IRC09:44
*** pgadiya has quit IRC09:45
openstackgerritHonza Pokorny proposed openstack-infra/project-config: Upgrade nodejs for tripleo-ui jobs to 6.x  https://review.openstack.org/41851909:46
*** yuval has joined #openstack-infra09:54
*** yanyanhu has quit IRC09:54
*** rossella_ has quit IRC09:56
*** rossella_s has joined #openstack-infra09:56
openstackgerritPranav Salunke proposed openstack-infra/project-config: rst2bash: Remove revoke-sudo from the jenkins job.  https://review.openstack.org/41938009:59
dguitarbiteCan someone review https://review.openstack.org/#/c/419380/09:59
*** xnox has joined #openstack-infra10:00
*** nijaba has quit IRC10:04
*** nijaba has joined #openstack-infra10:05
*** nijaba has joined #openstack-infra10:05
*** stakeda has quit IRC10:06
*** e0ne has quit IRC10:06
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611010:07
*** derekh has joined #openstack-infra10:08
openstackgerritFrank Kloeker proposed openstack-infra/puppet-zanata: Optional configuration of mysql backups in Zanata  https://review.openstack.org/41938910:10
openstackgerritSam Betts proposed openstack-infra/devstack-gate: [WIP] Remove unessesary Ironic multinode configuration  https://review.openstack.org/41939110:11
*** e0ne has joined #openstack-infra10:12
*** sshnaidm|away is now known as sshnaidm10:12
*** liujiong has quit IRC10:13
*** sambetts|afk is now known as sambetts10:15
*** ralonsoh_ has joined #openstack-infra10:17
*** Hal has joined #openstack-infra10:18
*** Hal is now known as Guest5824410:18
*** ralonsoh has quit IRC10:20
*** thiagolib has joined #openstack-infra10:22
*** tosky has joined #openstack-infra10:23
*** zhurong has joined #openstack-infra10:25
*** electrofelix has joined #openstack-infra10:26
openstackgerritThierry Carrez proposed openstack-infra/project-config: Notify #openstack-architecture or arch-wg changes  https://review.openstack.org/41940210:26
*** ldnunes has joined #openstack-infra10:27
*** sree has quit IRC10:28
*** apetrich has quit IRC10:28
*** sree has joined #openstack-infra10:28
*** sree has quit IRC10:32
*** nadya has quit IRC10:37
*** thorst_ has joined #openstack-infra10:42
*** nmathew has quit IRC10:42
*** huanxie has quit IRC10:45
*** furlongm_ has quit IRC10:46
*** pgadiya_ has quit IRC10:47
*** furlongm has joined #openstack-infra10:47
*** thorst_ has quit IRC10:47
*** shardy has quit IRC10:51
*** jd__ has quit IRC10:52
*** claudiub|2 has joined #openstack-infra10:55
*** amotoki has quit IRC10:56
*** rbuzatu has quit IRC10:57
*** rbuzatu has joined #openstack-infra10:57
*** Jeffrey4l__ is now known as Jeffrey4l10:58
*** kzaitsev_mb has joined #openstack-infra10:58
*** tojuvone has joined #openstack-infra11:00
*** Guest58244 has quit IRC11:00
*** rbuzatu has quit IRC11:02
*** pgadiya_ has joined #openstack-infra11:03
*** nadya has joined #openstack-infra11:03
*** amotoki has joined #openstack-infra11:06
*** kjorgensen has joined #openstack-infra11:08
*** kjorgensen has quit IRC11:13
*** shardy has joined #openstack-infra11:14
*** zhurong has quit IRC11:15
*** jd__ has joined #openstack-infra11:19
*** rfolco has joined #openstack-infra11:21
*** dtantsur|afk is now known as dtantsur11:28
*** Hal has joined #openstack-infra11:30
*** Hal is now known as Guest1849211:31
*** nicolasbock has joined #openstack-infra11:34
*** vikrant has quit IRC11:37
*** crinkle_ is now known as crinkle11:38
*** umeshksingla has quit IRC11:41
*** ralonsoh_ is now known as ralonsoh11:42
*** sree has joined #openstack-infra11:46
*** jkilpatr has quit IRC11:49
*** ociuhandu has quit IRC11:50
*** vikrant has joined #openstack-infra11:50
*** wolverineav has joined #openstack-infra11:50
*** sree has quit IRC11:50
*** jamespag` has joined #openstack-infra11:53
*** amotoki has quit IRC11:53
*** rbuzatu has joined #openstack-infra11:53
*** jamespag` is now known as jamespage11:54
*** wolverineav has quit IRC11:55
*** ralonsoh_ has joined #openstack-infra11:55
*** shardy has quit IRC11:55
*** rbuzatu has quit IRC11:55
*** shardy has joined #openstack-infra11:56
*** rbuzatu has joined #openstack-infra11:56
*** masber has quit IRC11:56
*** amotoki has joined #openstack-infra11:58
*** yamamoto_ has quit IRC11:58
*** ralonsoh has quit IRC11:59
*** rbuzatu has quit IRC12:00
*** wolverineav has joined #openstack-infra12:01
*** amotoki_ has joined #openstack-infra12:03
*** wolverineav has quit IRC12:05
*** amotoki has quit IRC12:05
*** tuanluong_ has quit IRC12:06
*** lVathan[m] has left #openstack-infra12:07
*** M-docaedo_vector has left #openstack-infra12:07
*** jordanP has quit IRC12:07
*** rbuzatu has joined #openstack-infra12:08
*** jordanP has joined #openstack-infra12:08
*** amotoki_ has quit IRC12:10
*** rtheis has joined #openstack-infra12:11
*** links has quit IRC12:13
*** dave-mccowan has joined #openstack-infra12:13
*** sree has joined #openstack-infra12:13
*** baoli has joined #openstack-infra12:14
*** baoli has quit IRC12:15
*** baoli has joined #openstack-infra12:15
*** derekh has quit IRC12:16
*** derekh has joined #openstack-infra12:16
*** rbuzatu has quit IRC12:19
*** baoli has quit IRC12:21
*** jkilpatr has joined #openstack-infra12:21
*** umeshksingla has joined #openstack-infra12:23
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611012:24
*** lucasagomes is now known as lucas-hungry12:26
*** sdake_ has joined #openstack-infra12:27
*** sdake has quit IRC12:29
*** vikrant has quit IRC12:30
*** wolverineav has joined #openstack-infra12:30
*** ociuhandu has joined #openstack-infra12:33
*** Guest18492 has quit IRC12:33
*** wolverineav has quit IRC12:34
*** dprince has joined #openstack-infra12:35
*** wolverineav has joined #openstack-infra12:42
*** sdague has joined #openstack-infra12:43
*** sdake_ has quit IRC12:43
*** yamamoto has joined #openstack-infra12:44
*** bhavik1 has joined #openstack-infra12:45
*** thorst_ has joined #openstack-infra12:46
*** yamamoto_ has joined #openstack-infra12:47
*** wolverineav has quit IRC12:47
*** umeshksingla has quit IRC12:47
*** wolverineav has joined #openstack-infra12:48
*** sdake has joined #openstack-infra12:48
*** lindycoder has joined #openstack-infra12:49
*** yamamoto has quit IRC12:50
*** gongysh has joined #openstack-infra12:52
*** rbuzatu has joined #openstack-infra12:54
*** umeshksingla has joined #openstack-infra12:58
*** dgonzalez has quit IRC12:58
*** dtantsur is now known as dtantsur|brb12:58
openstackgerritThierry Carrez proposed openstack-infra/project-config: Notify #openstack-architecture or arch-wg changes  https://review.openstack.org/41940213:00
openstackgerritThierry Carrez proposed openstack-infra/project-config: Add #openstack-architecture to accessbot config  https://review.openstack.org/41945313:00
*** lucas-hungry is now known as lucasagomes13:02
*** salv-orlando has joined #openstack-infra13:04
*** vikrant has joined #openstack-infra13:05
*** dgonzalez has joined #openstack-infra13:05
*** vikrant has quit IRC13:06
*** gongysh has quit IRC13:07
*** arxcruz has quit IRC13:07
mordredfungi, AJaeger: someone made a constraints patch for OCC: https://review.openstack.org/#/c/419273/ and it fails in a way that I can reproduce locally but I don't understand13:09
mordredthe error is: InstallationError: Could not satisfy constraints for 'os-client-config': installation from path or url cannot be constrained to a version13:10
mordredoh. nevermind. I get it13:11
*** trown|outtypewww is now known as trown13:11
mordredit's that os-client-config is in upper-constratings13:11
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: Use "consistent" delorean repo instead of "current"  https://review.openstack.org/41945513:12
*** iremizov_ has joined #openstack-infra13:16
*** askb has quit IRC13:16
*** ggherdov-_ has joined #openstack-infra13:16
*** megm_ has joined #openstack-infra13:17
*** bhavik1 has quit IRC13:17
*** asingh_ has quit IRC13:17
*** iremizov has quit IRC13:17
*** ggherdov- has quit IRC13:17
*** ioden has quit IRC13:17
*** asingh_ has joined #openstack-infra13:17
*** megm has quit IRC13:17
*** aunnam has quit IRC13:17
*** asingh_ has quit IRC13:17
*** asingh_ has joined #openstack-infra13:17
*** iremizov_ is now known as iremizov13:17
*** dtantsur|brb has quit IRC13:17
openstackgerritMonty Taylor proposed openstack/os-client-config: Use upper-constraints for tox envs  https://review.openstack.org/41927313:17
openstackgerritMonty Taylor proposed openstack/os-client-config: Remove 3.4 from tox envlist  https://review.openstack.org/41945713:17
*** yolanda has quit IRC13:18
*** dtantsur has joined #openstack-infra13:18
*** yamamoto_ has quit IRC13:18
*** yamamoto has joined #openstack-infra13:18
*** yolanda has joined #openstack-infra13:18
*** aunnam has joined #openstack-infra13:19
*** ralonsoh_ is now known as ralonsoh13:23
*** links has joined #openstack-infra13:25
*** aarefiev_afk is now known as aarefiev13:26
openstackgerritThierry Carrez proposed openstack-infra/project-config: Notify #openstack-architecture or arch-wg changes  https://review.openstack.org/41940213:27
*** snarwade has quit IRC13:29
*** claudiub has joined #openstack-infra13:30
openstackgerritOleksii Zamiatin proposed openstack-infra/project-config: Add py35 zmq gate job  https://review.openstack.org/41889013:31
*** claudiub|2 has quit IRC13:33
*** ralonsoh_ has joined #openstack-infra13:33
*** pgadiya_ has quit IRC13:33
*** ralonsoh has quit IRC13:36
*** sree_ has joined #openstack-infra13:36
*** gongysh has joined #openstack-infra13:36
*** sree_ is now known as Guest6700913:36
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata  https://review.openstack.org/40483113:37
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add basic pre/post upgrade sanity checks  https://review.openstack.org/41184613:37
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add glance to major upgrade CI  https://review.openstack.org/41247513:37
*** sree has quit IRC13:39
*** salv-orlando has quit IRC13:39
*** sree has joined #openstack-infra13:39
*** rlandy has joined #openstack-infra13:41
*** Guest67009 has quit IRC13:41
*** gordc has joined #openstack-infra13:42
*** dizquierdo has quit IRC13:43
*** sree has quit IRC13:43
fungimriedem: aha! i didn't even notice it was a stable branch change that placement job was failing on13:47
*** sree has joined #openstack-infra13:47
*** EricGonczer_ has joined #openstack-infra13:47
*** eharney has quit IRC13:49
*** bh526r has joined #openstack-infra13:50
*** arxcruz has joined #openstack-infra13:50
*** HeOS has quit IRC13:51
*** umeshksingla has quit IRC13:51
fungi(because i hadn't read the subject line of your initial e-mail closely enough)13:54
*** timrchavez_ is now known as timrc_13:55
*** pradk has joined #openstack-infra13:55
*** bhunter71 has quit IRC13:56
openstackgerritMarc Gariépy proposed openstack-infra/project-config: Promote CentOS to voting for OSA projects  https://review.openstack.org/41947013:58
*** ihrachys has joined #openstack-infra13:58
*** ihrachys has quit IRC13:59
*** ihrachys has joined #openstack-infra14:00
*** sdake_ has joined #openstack-infra14:01
*** matt-borland has joined #openstack-infra14:03
*** umeshksingla has joined #openstack-infra14:03
*** rhallisey has joined #openstack-infra14:03
*** mdrabe has joined #openstack-infra14:04
*** yamamoto has quit IRC14:04
*** jcoufal has joined #openstack-infra14:05
*** yamamoto has joined #openstack-infra14:05
*** sdake has quit IRC14:05
*** shardy has quit IRC14:05
*** shardy has joined #openstack-infra14:06
dguitarbitefungi: Can you please review this one? https://review.openstack.org/#/c/419380/14:08
dguitarbiteI guess it is good to merge IMHO.14:08
*** amotoki has joined #openstack-infra14:09
fungidguitarbite: interesting, what is that script eventually going to do that needs root? looks like it's just a placeholder echo in your repo14:10
*** gouthamr has joined #openstack-infra14:10
*** eharney has joined #openstack-infra14:11
*** yamamoto has quit IRC14:12
dguitarbitefungi: It runs virsh to launch vm's14:12
openstackgerritMarc Gariépy proposed openstack-infra/project-config: Promote CentOS to voting for OSA projects  https://review.openstack.org/41947014:12
dguitarbitefungi: I need to sudo call because it is built in in training-labs14:12
fungidguitarbite: oh, neat. yeah that'll need elevated privs for sure14:12
dguitarbitefungi: But it got merged! Btw. I will need some help from you guys soonish. Right now I am just adding a review patch to figure out how to proceed with the tests.14:13
*** apetrich has joined #openstack-infra14:16
*** yamamoto has joined #openstack-infra14:16
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611014:18
*** Goneri has joined #openstack-infra14:19
*** yamamoto has quit IRC14:19
openstackgerritMerged openstack-infra/project-config: rst2bash: Remove revoke-sudo from the jenkins job.  https://review.openstack.org/41938014:19
*** yamamoto has joined #openstack-infra14:21
*** panda is now known as super-sleuth14:21
*** baoli has joined #openstack-infra14:23
*** amotoki has quit IRC14:24
*** yamamoto has quit IRC14:26
*** psachin has quit IRC14:28
*** mriedem has quit IRC14:28
*** super-sleuth is now known as panda14:28
*** yamamoto has joined #openstack-infra14:29
*** amotoki has joined #openstack-infra14:29
*** EricGonczer_ has quit IRC14:29
*** makowals has quit IRC14:29
*** amotoki has quit IRC14:31
*** makowals has joined #openstack-infra14:32
*** yamamoto has quit IRC14:32
*** amotoki has joined #openstack-infra14:33
*** tlian has joined #openstack-infra14:34
openstackgerritThierry Carrez proposed openstack-infra/project-config: Notify #openstack-architecture or arch-wg changes  https://review.openstack.org/41940214:36
*** yamamoto has joined #openstack-infra14:37
*** yamamoto has quit IRC14:38
*** salv-orlando has joined #openstack-infra14:39
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Use already patched repos cloned by zuul for build  https://review.openstack.org/41949114:41
*** salv-orlando has quit IRC14:41
*** yamamoto has joined #openstack-infra14:41
*** salv-orlando has joined #openstack-infra14:41
*** makowals has quit IRC14:41
openstackgerritMonty Taylor proposed openstack-infra/shade: Add support for listing compute usage  https://review.openstack.org/41949314:41
*** BobH_ has joined #openstack-infra14:42
*** yamamoto has quit IRC14:43
*** makowals has joined #openstack-infra14:43
BobH_Good moring. I'm considering going to the PTG in february and attending the infrastructre sessions as I'm working on the IBM z/VM third-party CI.14:43
openstackgerritMerged openstack-infra/irc-meetings: Update neutron-qos chairs  https://review.openstack.org/41884514:44
BobH_Can anyone point me to an agenda or anything that may have the topics being considered?14:44
openstackgerritMerged openstack-infra/irc-meetings: Change neutron-qos meeting time  https://review.openstack.org/41898514:44
*** baoli has quit IRC14:46
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: Use quickstart-extras checked out from zuul refs  https://review.openstack.org/41812314:47
sshnaidmis it possible to have additional pipeline to "experimental"? and running it as "check my_custom" ?14:47
*** gongysh has quit IRC14:48
*** dikonoor has quit IRC14:48
fungiBobH_: per our most recent weekly meeting, we're brainstorming what we'll work on at https://etherpad.openstack.org/p/infra-ptg-pike14:49
AJaegersshnaidm: possible: Sure, just define in zuul/layout.yaml. For OpenStack CI, this would need some discussion first14:49
AJaegersshnaidm: we're very reluctant to add new queues and complicate our setup14:49
sshnaidmAJaeger, ok, so it's worth to discuss it in ML?14:50
*** wfoster has quit IRC14:50
AJaegersshnaidm: try here first ;)14:50
sshnaidmAJaeger, ok, thanks :)14:51
*** flepied has quit IRC14:52
*** wfoster has joined #openstack-infra14:52
AJaegerfungi, what's the policy on what to add to #openstack-merges - could you comment on  https://review.openstack.org/419402 , please ?14:54
*** wolverin_ has joined #openstack-infra14:56
*** wolverineav has quit IRC14:59
fungii don't know of any "policy" but i think the general idea is we add whatever people think will be useful14:59
*** wfoster has quit IRC14:59
*** rook has quit IRC14:59
*** hongbin has joined #openstack-infra14:59
*** lucasagomes has quit IRC14:59
fungiit's really just where we moved the list of stuff that was being reported to #openstack-dev previously15:00
*** lucasagomes has joined #openstack-infra15:00
AJaegerso, let's remove that comment?15:02
*** mriedem has joined #openstack-infra15:02
*** sree has quit IRC15:02
fungiyeah, i think it was probably just added by whoever put together the initial list there15:03
fungigit blame will tell15:03
*** chlong has joined #openstack-infra15:03
AJaegerno, just randomly added in https://review.openstack.org/23599615:04
fungiput there by russellb three years ago ;)15:04
fungiyep15:04
*** amotoki has quit IRC15:05
*** rook has joined #openstack-infra15:05
fungioh, wait, i'm looking at the wrong line15:05
AJaegerah, yeah, that was readding it...15:05
*** rook is now known as Guest829815:05
*** wfoster has joined #openstack-infra15:05
dasmo/ infra team. i'm seeing very worrisome errors on one of gates.15:06
*** tlian has quit IRC15:06
dasmcinder-rootwrap is calling oom-killer and killing mysql15:06
openstackgerritMonty Taylor proposed openstack-infra/shade: Basic volume_type access  https://review.openstack.org/41456115:06
dasmare you familiar with similar issue?15:06
*** zeih has joined #openstack-infra15:06
dasmhttp://logs.openstack.org/59/382659/27/check/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/e41c90d/logs/syslog.txt.gz#_Jan_12_03_36_0015:06
fungidasm: we should be collecting memory utilization stats from those jobs15:07
fungidasm: how many instances of that error have you spotted? more than just that one?15:07
dasmfungi: i've seen it already 3 times for my patch. jlibosva (neutron core team) had it once.15:08
dasmfungi: i don't want to just blindly recheck it all the times, so wanted to know if there is some kind of problem with that15:08
*** bhunter71 has joined #openstack-infra15:09
*** adrian_otto has joined #openstack-infra15:09
fungidasm: probably best to start asking in #openstack-cinder if you're seeing something cinder-related tripping an out-of-memory condition in devstack-based jobs15:10
smcginnisdasm: I haven't seen that in tempest runs.15:10
dasmfungi: yeah, probably makes sense. thanks15:10
smcginnisdasm: We did have some unit test memory issues a while back, but it's gotten better since then.15:10
dasmsmcginnis: hmm15:10
smcginnisdasm: Or at least it had. Totally possible something else has cropped up.15:10
*** flepied has joined #openstack-infra15:11
dasmsmcginnis: thanks. will double check with cinder team15:11
dasmlike fungi suggested15:11
BobH_<fungi> I'll have a look. Thanks15:11
fungior the #openstack-qa channel may be tracking something. have you looked at http://status.openstack.org/elastic-recheck/ for possible matches?15:11
smcginnisdasm: Sure. we cam talk there.15:11
dasmsmcginnis: haha. didn't know you're also there :)15:12
smcginnis:)15:12
*** HeOS has joined #openstack-infra15:13
*** jamesdenton has joined #openstack-infra15:13
*** rbrndt has joined #openstack-infra15:13
*** zz_dimtruck is now known as dimtruck15:14
russellbfungi: what did i break?15:15
*** tlian has joined #openstack-infra15:15
fungirussellb: nothing at all, we were hunting down the reason for a comment added to the gerritbot config long ago15:15
fungirussellb: and then i misread git blame on my extremely narrow terminal and attributed it incorrectly to you15:16
*** claudiub|2 has joined #openstack-infra15:16
fungidasm: querying http://logstash.openstack.org/ for message:"cinder-rootwrap invoked oom-killer" over the last 7 days only turns up hits for a job run against change https://review.openstack.org/382659 (so far anyway, it hasn't finished querying)15:17
dasmfungi: that's mine... :(15:18
dasmalghough it also happened for this patch: https://review.openstack.org/#/c/373973/15:18
russellbfungi: ah ok :)15:18
dasmpatchset 1315:18
fungidasm: looks like logstash has finished querying and only finds the exact same job log you linked in channel15:18
* smcginnis will be releived if they only show up in neutron patches15:19
smcginnis:)15:19
*** claudiub has quit IRC15:19
dasmsmcginnis: i won't :P15:19
smcginnis*relieved15:19
smcginnisdasm: Yeah, sorry. :)15:19
*** zeih has quit IRC15:19
*** zeih has joined #openstack-infra15:19
openstackgerritMonty Taylor proposed openstack-infra/shade: Add support for listing compute usage  https://review.openstack.org/41949315:20
smcginnisdasm: So maybe a red herring with Cinder. Or not. Still open that it's something we're doing.15:20
dasmfungi: thanks. looking again at this issue15:20
dasmsmcginnis: sure. if i'll find something else, i'll definitely give you a shout15:20
*** yamahata has joined #openstack-infra15:20
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: neutron: disable dvr tests for linuxbridge-scenario job  https://review.openstack.org/41303215:20
fungidasm: a previous recheck of 373973 i guess? the current failure displayed for the neutron functional job looks unrelated15:21
dasmfungi: yes. didn't specify which recheck, sorry.15:22
*** jaosorior has joined #openstack-infra15:22
fungidasm: are you referring to this one? http://logs.openstack.org/73/373973/13/check/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/295d92f/logs/syslog.txt.gz#_Jan_11_13_56_3215:22
fungi"kthreadd invoked oom-killer"15:22
dasmyeah15:23
openstackgerritSean M. Collins proposed openstack-infra/project-config: Move OSA upgrade job from experimental queue to periodic  https://review.openstack.org/41951715:23
fungiso it's different processes tripping this15:23
*** mtanino has joined #openstack-infra15:24
*** zeih has quit IRC15:24
dasmyep, you're right. cinder-rootwrap was for one case (mine), this time kthreadd is for other patch.15:24
dasmsorry, i've just assumed the same process invoking oom-killer15:24
fungilooks like mysqld gets sacrificed in both examples15:24
dasmfailing tests were the same ;)15:24
smcginnisdasm: Good to start with the most obvious suspect. ;)15:25
dasmsmcginnis: haha15:25
fungieating ~4.7gb each time15:25
dasmnow i'm thinking about possible race condition with linuxbridge gate... but this problem appeared just on 2 unrelated patches15:26
*** adrian_otto has quit IRC15:27
*** adrian_otto1 has joined #openstack-infra15:27
*** kzaitsev_mb has quit IRC15:27
fungii've sometimes seen this when jobs get hung and run long for unrelated reasons, but these only ran for ~1hr each15:27
*** markvoelker has quit IRC15:27
*** rossella_s has quit IRC15:28
*** rossella_s has joined #openstack-infra15:28
*** Guest8298 is now known as rook-LOLLLL15:28
*** tphummel has joined #openstack-infra15:28
*** yuval has quit IRC15:30
*** adrian_otto1 has quit IRC15:30
*** kzaitsev_mb has joined #openstack-infra15:32
*** mdrabe has quit IRC15:32
*** dizquierdo has joined #openstack-infra15:33
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction  https://review.openstack.org/39173815:34
fungidasm: we've got logs/dstat-csv_log.txt.gz files from each of them you could probably plug into some simple analysis software and graph the total memory utilization over time for both of those jobs to see where it starts spiking up and then try to correlate that to logs of what's going on in the job itself (possibly comparing against other non-failing job runs)15:34
dasmfungi: will try, thanks for tip15:35
*** mtanino has quit IRC15:36
openstackgerritBob Fournier proposed openstack/diskimage-builder: Handle failure of carrier check in dhcp-all-interfaces.sh  https://review.openstack.org/41952715:38
*** mdrabe has joined #openstack-infra15:39
*** marst has joined #openstack-infra15:41
*** wolverin_ has quit IRC15:41
*** wolverineav has joined #openstack-infra15:43
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952915:45
*** apetrich has quit IRC15:45
openstackgerritMerged openstack/diskimage-builder: Run dhcp-interface@.service after network.target  https://review.openstack.org/41666415:47
*** strattao has joined #openstack-infra15:49
*** adrian_otto has joined #openstack-infra15:50
*** adrian_otto has quit IRC15:51
*** adrian_otto has joined #openstack-infra15:52
openstackgerritMonty Taylor proposed openstack-infra/shade: Basic volume_type access  https://review.openstack.org/41456115:52
*** spzala has joined #openstack-infra15:52
*** markvoelker has joined #openstack-infra15:52
*** Hal has joined #openstack-infra15:55
*** Hal is now known as Guest9838515:55
*** srobert has joined #openstack-infra15:56
*** xarses has joined #openstack-infra15:57
*** lseki has joined #openstack-infra15:58
*** pcaruana has joined #openstack-infra15:58
BobBallI'm trying to understand gearman's requests of nodepool: We've just renamed some of our nodes, yet "Demand from gearman" in nodepool's debug log is still showing demand for the old names.  Do we have to restart zuul in order to start using the new names?16:01
*** mptacekx has quit IRC16:01
*** wolverineav has quit IRC16:04
*** armax has joined #openstack-infra16:06
*** cody-somerville has joined #openstack-infra16:07
*** cody-somerville has joined #openstack-infra16:07
*** wolverineav has joined #openstack-infra16:07
*** knangia has joined #openstack-infra16:07
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction  https://review.openstack.org/39173816:08
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952916:08
Jeffrey4lhow can i get the logs in tag pipeline/16:09
*** csomerville has quit IRC16:09
clarkbJeffrey4l: http://logs.openstack.org/firsttwoofsha1/sha1 where sha1 is the sha1 for the tag object not the commit tagged16:10
*** rook-LOLLLL is now known as rook16:10
clarkbI believe git show-ref shows you that info16:10
*** rtheis has quit IRC16:10
Jeffrey4lyes. got it. thanks a lot.16:11
pabelangerBobBall: usually yes, when out of sync we usually restart zuul (gearman-server) to clean out old registrations16:11
*** Diziet has left #openstack-infra16:12
openstackgerritKaitlin Farr proposed openstack-infra/project-config: Castellan functional test now votes  https://review.openstack.org/41954616:12
BobBallI was hoping to get away without restarting zuul... :) okay.16:13
*** wolverineav has quit IRC16:13
*** rajinir has joined #openstack-infra16:14
*** wolverineav has joined #openstack-infra16:14
*** rbergeron has quit IRC16:14
*** pradk has quit IRC16:16
openstackgerritMerged openstack-infra/shade: Add compute usage support  https://review.openstack.org/39387316:16
*** annegentle has joined #openstack-infra16:19
*** dag_ has joined #openstack-infra16:20
*** dag_ is now known as rbergeron16:21
*** rbergeron has quit IRC16:21
*** rbergeron has joined #openstack-infra16:21
*** xhku_ has joined #openstack-infra16:22
HeOSHello, team! As far I can see, the following request was merged 7 hours ago (https://review.openstack.org/#/c/413656/), but the project still isn't created. Looks like, something went wrong.16:22
*** salv-orl_ has joined #openstack-infra16:23
*** ccamacho has quit IRC16:23
*** strattao has quit IRC16:24
*** tonytan4ever has joined #openstack-infra16:24
*** xhku has quit IRC16:25
*** dizquierdo has quit IRC16:25
*** salv-orlando has quit IRC16:26
*** ccamacho has joined #openstack-infra16:27
*** panda is now known as panda|bbl16:28
*** adrian_otto1 has joined #openstack-infra16:32
*** adrian_otto has quit IRC16:32
*** tonytan4ever has quit IRC16:33
*** tonytan4ever has joined #openstack-infra16:33
*** markus_z has quit IRC16:33
*** sdake has joined #openstack-infra16:33
*** wolverineav has quit IRC16:34
*** sdake_ has quit IRC16:35
*** raildo has joined #openstack-infra16:37
*** links has quit IRC16:37
*** ociuhandu has quit IRC16:38
*** ociuhandu has joined #openstack-infra16:39
*** ociuhandu has quit IRC16:39
*** rlandy is now known as rlandy|mtg16:39
*** mtanino has joined #openstack-infra16:39
*** tojuvone has quit IRC16:40
*** tojuvone has joined #openstack-infra16:41
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction  https://review.openstack.org/39173816:42
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952916:42
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611016:44
clarkbBobBall: gearman doesn't completely forget a label specific registration if no more workers exist for it. It just marks the total number of workers as 016:44
*** andreas_s has quit IRC16:44
clarkbBobBall: nodepool then has to assume its zero because nodepool isn't doing its job properly...16:44
pabelangerhttp://mirror.dfw.rax.openstack.org/fedora/releases/25/16:47
pabelangeryay16:47
clarkbHeOS: looks like a side effect of puppet not having run on review.o.o in a day or so16:47
HeOSclarkb, thank you!16:48
clarkbfatal: [git01.openstack.org]: FAILED! => {"changed": false, "disabled": false, "error": true, "failed": true, "msg": "puppet did not run", "rc": 1, "stderr": "", "stdout": "", "stdout_lines": []}16:49
clarkball the git0X hosts are exhibiting that16:49
clarkbwhich then causes puppet to not run on review.o.o16:49
*** hashar has quit IRC16:51
*** wolverineav has joined #openstack-infra16:51
*** chlong has quit IRC16:52
openstackgerritPaul Belanger proposed openstack-infra/nodepool: DNM: prepare for fedora-25  https://review.openstack.org/41955716:52
fungiwonder if a package update clobbered something on our centos servers16:52
jeblairhow would we know?16:53
jeblaircheck the logs?16:53
clarkbya I am trying to poke at it but not finding much16:53
jeblair[root@git01 log]# cat messages16:53
jeblairJan  9 03:25:01 git01 rsyslogd: [origin software="rsyslogd" swVersion="7.4.7" x-pid="21892" x-info="http://www.rsyslog.com"] rsyslogd was HUPed16:53
jeblair[root@git01 log]#16:53
jeblairthanks.16:53
clarkboh right journalctl16:54
clarkbya messages useless beacuse systemd16:54
* clarkb rereads manapage16:54
pabelangerthanks systemd16:54
jeblairdidn't we have a thing like 3-6 months ago where journal just stopped logging stuff, including the reason it stopped logging stuff?16:54
clarkbyup16:55
clarkbJan 12 13:02:04 git01.openstack.org puppet-user[1482]: Could not run: undefined method `each' for #<String:0x000000027b1a18>16:55
*** e0ne has quit IRC16:55
clarkbin this case it seems like it was logging though16:55
jeblairi thought it was configured to log to syslog too16:55
clarkbjeblair: I actually found out that journald doesn't log persistently by default, it uses a ring buffer16:55
clarkbIts on my list to fix ^16:55
*** rossella_s has quit IRC16:55
clarkbjeblair: I think we need to install rsyslog which doesn't appear to be installed for that16:55
jeblairclarkb: well, it hupped on jan 916:56
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Bump fedora-minimal release to 25  https://review.openstack.org/41955916:56
jeblairclarkb: anyway,  that's a nice cryptic error you found16:57
clarkbthat error was in sudo journalctl16:57
clarkbthat looks like a ruby error16:57
clarkbI wonder if one of our puppet modules updated to use ruby newer than is on centos16:58
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge  https://review.openstack.org/41912216:58
jeblairclarkb: with the help of someone who pulled their hair out already: https://github.com/mitchellh/vagrant/issues/3295  it seems related to facter16:58
jeblairfacter16:58
jeblairundefined method `each' for #<String:0x00000000c1e198>16:58
*** spzala has quit IRC17:01
jeblairclarkb: i don't see recent puppet/ruby related entries in yum.log17:02
*** strattao has joined #openstack-infra17:02
*** swatson has joined #openstack-infra17:02
clarkbfacter is its own package I think17:02
*** sdake_ has joined #openstack-infra17:02
fungiyeah, that's where i was going to look first, but i agree yum.log doesn't have much of interest17:02
jeblairnor facter.17:02
jeblairJan 10 10:56:51 Updated: 2:microcode_ctl-2.1-16.1.el7_3.x86_6417:03
jeblairJan 12 03:53:57 Updated: epel-release-7-9.noarch17:03
fungicurrently using facter-2.4.6-1.el7.x86_64 according to rpm -qa17:03
jeblairthose are the last 2 entries.  (note that systemd is complaining about an error in the microcode unit file about 10 times every second)17:03
*** sdake has quit IRC17:04
*** umeshksingla has quit IRC17:06
*** flepied has quit IRC17:06
*** wolverineav has quit IRC17:06
*** mtani____ has joined #openstack-infra17:07
*** mtanino has quit IRC17:07
*** chem has quit IRC17:07
*** chem has joined #openstack-infra17:07
*** purp has quit IRC17:08
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction  https://review.openstack.org/39173817:08
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952917:08
*** wolverineav has joined #openstack-infra17:08
*** peterlisak has quit IRC17:08
fungiwonder if we added a new puppet module or something which corresponds to the error starting17:09
*** purp has joined #openstack-infra17:09
*** peterlisak has joined #openstack-infra17:09
*** otherwiseguy has quit IRC17:10
*** dimak has quit IRC17:10
*** medberry has quit IRC17:10
fungifirst occurrence is probably 2017-01-11 19:02:2017:11
*** dimak has joined #openstack-infra17:11
*** ralonsoh_ has quit IRC17:13
*** otherwiseguy has joined #openstack-infra17:13
*** wolverineav has quit IRC17:13
*** med_ has joined #openstack-infra17:14
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: Use quickstart-extras checked out from zuul refs  https://review.openstack.org/41812317:14
*** tbh has joined #openstack-infra17:14
fungilooking at changes merged to our repos in the hours leading up to that, i'm not seeing anything17:14
*** med_ is now known as Guest8778317:14
*** Swami has joined #openstack-infra17:14
*** kjorgensen has joined #openstack-infra17:15
tbhHi, I need to download a fedora image which has heat-agent installed to run Functional tests in openstack Tacker project, any help on this?17:15
tbhI mean can we host that image openstack infra?17:16
*** kjorgens_ has joined #openstack-infra17:16
pabelangertbh: we don't host them, but you can build it17:16
pabelangertbh: look at tools/build-images.sh in openstack-infra/project-config17:16
pabelangerthat will allow you to use diskimage-builder to create a fedora-24 image17:16
*** trown is now known as trown|lunch17:16
fungiat one point we had a fedora image used by heat tests in tempest, though i think that was finally dropped from our worker caches17:17
*** otherwiseguy has quit IRC17:17
openstackgerritChris Krelle proposed openstack-infra/glean: Adjust the way we wait for interfaces to become available  https://review.openstack.org/35947117:17
*** otherwiseguy has joined #openstack-infra17:17
tbhpabelanger, you mean to download basic fedora-24 image and build using diskimage-builder everytime we run functional tests?17:17
clarkbcould it be related to the ansible upgrade?17:18
pabelangertbh: I am not familiar with Tacker test jobs, I assume your job is using a fedora-24 node?17:18
clarkbthat timestamp seems suspiciously close to when that got updated17:18
pabelangerclarkb: we have had issues with fedora and ansible-playbook in the past17:19
pabelangertrying to remember the issue17:19
pabelangerclarkb: err, never mind. Crossing streams17:19
*** kjorgensen has quit IRC17:20
*** tphummel has quit IRC17:20
fungicould try using the adhoc playbook to update one of the git servers both with the current ansible version and the previous one and see if the issue is consistent17:20
tbhpabelanger, you mean running tests? it runs tests on ubuntu. But in the FTs we need to launch VMs which has heat-agent installed for that we need to upload that image to glance17:20
jeblairclarkb: hrm -- the issue i mentioned earlier tied it to locale, though locale things i tried in my shell on the server didn't fix the problem.  however, much locale stuff has changed in that ansible upgrade.......17:20
*** wolverineav has joined #openstack-infra17:21
jeblair(i just figured if i was having problems from the shell, then it couldn't be anything external...however, what if it always did this, but the old version of ansible masked it)17:22
*** flepied has joined #openstack-infra17:22
pabelangertbh: Hmm, looking17:24
*** rlandy|mtg is now known as rlandy17:24
tbhpabelanger, sure17:24
*** kzaitsev_mb has quit IRC17:25
*** matrohon has quit IRC17:26
*** chlong has joined #openstack-infra17:26
*** ihrachys_ has joined #openstack-infra17:27
*** ccamacho has quit IRC17:28
clarkbjeblair: ya running facter as my login doesn't produce that error according to journalctl -f17:28
clarkbso possibly related to ansible locale things17:29
*** ihrachys has quit IRC17:30
clarkbjeblair: also odd that I think puppet is running on ubuntu just fine17:30
*** wolverineav has quit IRC17:31
*** nadya has quit IRC17:31
clarkb/etc/locale.conf says use en_US.UTF-8 is ansible overriding that?17:32
pabelangertbh: ya, not sure where that fedora image comes from17:33
jeblairclarkb: "sudo facter" produces it for me17:33
jeblairlocale is the same for corvus and root... :/17:33
openstackgerritChris Krelle proposed openstack-infra/glean: Adjust the way we wait for interfaces to become available  https://review.openstack.org/35947117:34
clarkbjeblair: I notice there is a difference in the locale string but both represent US english utf817:34
*** pradk has joined #openstack-infra17:34
*** gouthamr has quit IRC17:35
clarkbmine LANG=en_US.utf8 , roots LANG=en_US.UTF-817:35
jeblairoh weird, i don't see that.  ihave caps utf in both17:35
clarkboh I Bet thats ssh passing mine through17:36
clarkbyup thats my local tumbleweed LANG17:36
jeblairclarkb: strace says it's related to /etc/facter/facts.d/ansible.json17:37
jeblairclarkb: that's only readable by root, which is why our users don't show the error17:37
*** swatson has left #openstack-infra17:37
*** tnovacik has joined #openstack-infra17:37
clarkbhttp://stackoverflow.com/questions/10788770/ruport-undefined-method-each-for-string for ruby infos17:38
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction  https://review.openstack.org/39173817:38
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952917:38
*** wolverineav has joined #openstack-infra17:38
clarkbwe have ruby 2.0 on centos717:38
*** mhickey_ has quit IRC17:39
jeblairwhere does ansible.json fact come from?  does ansible-puppet lay it down?17:39
tbhpabelanger, ok17:39
clarkbjeblair: yes I think so let me dig that up17:40
pabelanger#status log fedora (25) AFS mirror now online.17:40
*** BobBall is now known as BobBall_AWOL17:40
jeblairyeah, i see it17:40
*** pabelanger has quit IRC17:41
*** pabelanger has joined #openstack-infra17:41
openstackgerritRoberto Polli proposed openstack-infra/shade: Added list_flavor_access.  https://review.openstack.org/41459417:41
clarkbjeblair: playbooks/remote_puppet_git.yaml17:41
pabelanger#status log fedora (25) AFS mirror now online.17:41
openstackstatuspabelanger: finished logging17:41
jeblairclarkb: ansible-role-puppet is responsible for actually writing that file17:41
clarkbyu17:41
* jeblair looks for differences between ours and upstream17:41
* jeblair looks for upstream17:42
jeblairanyone know where that is?17:42
*** tlian has quit IRC17:42
*** tlian has joined #openstack-infra17:42
*** yamahata has quit IRC17:43
clarkbI do not17:43
pabelangerhttps://github.com/ansible/ansible/blob/devel/lib/ansible/modules/system/puppet.py ?17:43
clarkbespecially after ansible just reorganized everything again in the source17:43
*** derekh has quit IRC17:43
jeblairclarkb: thanks17:43
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test with scheduler hints  https://review.openstack.org/37804017:44
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add feature testing matrix to readme  https://review.openstack.org/39926917:44
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add support for testing predictable placement  https://review.openstack.org/37801417:44
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test hostname map  https://review.openstack.org/37801717:44
clarkbjeblair: I just double checked that I can read the file back in as utf8 using python on git01 so the file itself seems fine17:45
*** wolverineav has quit IRC17:46
*** wolverineav has joined #openstack-infra17:46
*** claudiub has joined #openstack-infra17:46
jeblairclarkb: i'd like to see if the old version of ansible wrote out the file in a different format17:47
jeblairclarkb: like, perhaps not as a string17:47
jeblairthat's my guess17:47
clarkbhttp://paste.openstack.org/show/594746/ is the facter traceback17:47
clarkbjeblair: oh gotcha17:47
jeblairold: {'project_config_ref': 'd1af87e5ba9588b815ebaf6b1fc72ef4d979c41b'}17:47
openstackgerritJulia Kreger proposed openstack-infra/glean: Revise systemd determination to verify systemctl presence  https://review.openstack.org/27981817:47
jeblairnew: "{'project_config_ref': 'd1af87e5ba9588b815ebaf6b1fc72ef4d979c41b'}"17:47
jeblairthat ^ is what i'm guessing we will see.17:47
clarkbthat would certainly explain why ruby is trying to iterate on a string when it should be iterating on a dict17:48
jeblairclarkb: it may be related to the "everything is a string by default" argument change to ansible modules...17:48
clarkbout_file.write(json.dumps(data).encode('utf8')) is the line in the ansible-puppet module17:49
*** gouthamr has joined #openstack-infra17:49
clarkbjeblair: oh! I think that is probably it17:49
pabelangerjeblair: Ah, good thought17:49
*** jpich has quit IRC17:49
fungii need to head out to run some lunch errands, but will bbiaw17:49
clarkbbecause data would've been its native format a key value pair in a dict but now is a string17:49
*** lucasagomes is now known as lucas-afk17:50
*** claudiub|2 has quit IRC17:50
clarkbthough facts=dict(default=None) is how we have defined it in the params list17:50
jeblairyeah, we probably need a "type='dict'" or something there17:51
jeblairit looks like neither our version nor upstream have a type argument17:51
clarkbgroups=dict(required=True, type='list') is in a different params list17:51
clarkbI guess the wrapping dict is a container for info and the type is a piece of info that is used to actually determine the type17:52
jeblairclarkb: right, so we want (i think): facts=dict(default=None, type='dict')17:53
clarkb++17:53
jeblairso if we update our ansible-role-puppet, does that still take precedence over the built in one?17:53
clarkbjeblair: yes it does17:53
jeblairokay, i will make that change now17:53
jeblairclarkb: i now wonder even more why this isn't affecting other platforms -- oh!  maybe because we don't write project-config facts except in this grouping (ie, we would see this on review.o.o if we ever got there)17:57
clarkbyup tahts it17:57
clarkbwe only use the fact on git* and review.o.o to ensure that they are in sync off of the same project-config version17:58
clarkbthe rest of the servers are loosely coupled enough that we allow them to use potentially different versions of project-config17:58
openstackgerritJames E. Blair proposed openstack-infra/ansible-role-puppet: Set facts type to dict  https://review.openstack.org/41957617:59
jeblairclarkb, pabelanger: ^17:59
clarkbcan't find any docs on what the valid types are but based on existing code appears to be python types so str, list, dict, etc should all be fine +218:01
jeblairclarkb: yeah.  i found a blog post that said 'dict' is a real thing.  :)18:02
*** _Cyclone_ has joined #openstack-infra18:02
*** tphummel has joined #openstack-infra18:03
*** jordanP has quit IRC18:03
*** tphummel has quit IRC18:05
*** rods has quit IRC18:06
*** swatson has joined #openstack-infra18:08
*** ociuhandu has joined #openstack-infra18:09
swatsonHey channel! Is there a way to test a Jenkins job builder on a machine running devstack?18:09
openstackgerritSujitha proposed openstack-infra/project-config: Modify grenade-dsvm-neutron-multinode-zero-downtime  https://review.openstack.org/41958018:10
openstackgerritMerged openstack-infra/ansible-role-puppet: Set facts type to dict  https://review.openstack.org/41957618:11
clarkbswatson: JJB has a suite of unittests that work without jenkins and without devstack. If you want to do integration testing I don't think there is anything in devstack that will set up a Jenkins18:11
*** wolverineav has quit IRC18:12
*** wolverineav has joined #openstack-infra18:12
swatsonclarkb: I'm looking to update magnum's job for functional tests by adding the mysql-prep rule, so I wanted to make sure what I changed would be running correctly18:13
clarkbdoesn't look like the :15 puppet run will use the newly merged fix, probably will be used in the :30 run18:13
*** weshay is now known as weshay_bbiab18:13
clarkbswatson: we run general verification that the JJB itself is sound. We don't test that the jobs themselves will function before they run (this is a semi difficult chicken and egg to deal with particularly with Jenkins. zuulv3 will address it though)18:14
clarkbswatson: what you can do is run the shell that jjb produces on an instance and see that it all comes out ok in the end18:14
openstackgerritMerged openstack-infra/release-tools: move email destination handling logic into python  https://review.openstack.org/41915918:15
swatsonclarkb: Ah, so there's a way to see the script jjb would produce?18:15
clarkbswatson: sort of, you can genrate the xml (should be a tox target for that) then dig the shell out of the xml18:16
openstackgerritMerged openstack-infra/release-tools: add release candidate announcement template  https://review.openstack.org/41916018:16
openstackgerritMerged openstack-infra/release-tools: add option to specify a tarball directory  https://review.openstack.org/41916118:17
swatsonclarkb: OK cool. I'll dig around for the tox command. Thanks!18:17
openstackgerritMerged openstack-infra/release-tools: ignore alpha and beta release announcement requests  https://review.openstack.org/41916718:17
clarkbyup ansible puppet run ended at :18 so starting ~:30 we should see if git* and review.o.o get puppeted18:18
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction  https://review.openstack.org/39173818:18
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952918:18
*** chlong has quit IRC18:19
*** voldz1tic3n has joined #openstack-infra18:21
*** bhavik1 has joined #openstack-infra18:22
*** yamahata has joined #openstack-infra18:23
*** ijw_ has quit IRC18:24
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction  https://review.openstack.org/39173818:25
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952918:25
*** bhavik1 has quit IRC18:26
*** rkukura has quit IRC18:26
clarkbwatching the puppet run now18:32
*** chlong has joined #openstack-infra18:32
*** openstackgerrit has quit IRC18:33
*** florianf has quit IRC18:33
*** pcaruana has quit IRC18:34
clarkbpuppet appears to have run on git*18:34
*** openstackgerrit has joined #openstack-infra18:36
*** strattao has quit IRC18:36
openstackgerritFrédéric Guillot proposed openstack-infra/project-config: Enable Almanach gate  https://review.openstack.org/41959418:36
jeblairclarkb: \o/18:38
clarkbwaiting for review.o.o to report back now18:38
*** tphummel has joined #openstack-infra18:38
*** tphummel has quit IRC18:39
*** tonytan4ever has quit IRC18:39
*** bhunter71 has quit IRC18:39
*** tonytan4ever has joined #openstack-infra18:39
*** apetrich has joined #openstack-infra18:40
*** sambetts is now known as sambetts|afk18:41
*** jkilpatr has quit IRC18:43
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921518:44
pabelangerstarting to clean up old nodepool images from our cloud providers18:45
*** trown|lunch is now known as trown18:45
*** fguillot has joined #openstack-infra18:47
ianwmorning18:49
*** jkilpatr has joined #openstack-infra18:49
pabelangerearly morning18:50
*** tbh has quit IRC18:50
ianwtoo hot here anyway18:50
ianwansible 2.2 not working as expected?18:51
clarkbianw: one small issue that jeblair managed to track down and appears to be fixed with his patch18:51
AJaegerpabelanger, ianw, clarkb can I remove my -2 from the first rename change? And will one of you -2 to hold it? https://review.openstack.org/#/c/401115/18:51
*** tesseract has quit IRC18:51
ianwAJaeger: i can if you like18:51
AJaegerok, will change to +2 then18:52
*** rhallisey has quit IRC18:52
*** dtantsur is now known as dtantsur|afk18:53
*** rhallisey has joined #openstack-infra18:54
jeblairmordred: https://review.openstack.org/419576 needs to go 'upstream'.  or is it 'downstream'?  :)18:54
clarkbpuppet still going on review.o.o guess we gave it a lot of work to do18:55
*** tphummel has joined #openstack-infra18:56
pabelangerianw: do you have any patches up for fedora-25? In the process of getting a build going locally18:56
pabelangerianw: trying to see if we are ready for a nodepool.yaml update18:56
ianwpabelanger: not that i'm aware of, but i haven't tried in a while so bitrot possible18:57
pabelangerianw: okay, let me see the results of my builds18:58
fungiback and catching up18:59
*** ijw has joined #openstack-infra18:59
fungiso git/review puppet updates are flowing successfully again, no need to reschedule the rename maintenance?18:59
*** vern has quit IRC18:59
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul: Re-enable test_build_configuration_branch  https://review.openstack.org/41960918:59
*** ijw has quit IRC19:00
*** ijw has joined #openstack-infra19:00
clarkbfungi: as long as review.o.o finishes puppeting sometime soon19:00
*** strattao has joined #openstack-infra19:00
clarkbit is still going19:00
clarkbbeen half an hour ro so19:00
*** rkukura has joined #openstack-infra19:01
ianwi've got the following yaml if things come to life -> http://paste.openstack.org/show/594756/19:02
*** voldz1tic3n has quit IRC19:02
*** dharinic is now known as dharinic|lunch19:02
fungiclarkb: yeah, manage-projects, if it gets triggered, takes ages (where "ages" is half an hour or so)19:02
fungionce review.o.o puppet is confirmed updated successfully, we should probably go ahead and disable the puppet cron on puppetmaster in preparation for 20:0019:03
*** tosky has quit IRC19:03
*** tnovacik has quit IRC19:03
clarkbpuppet timed out on review.o.o19:04
*** kjorgens_ has quit IRC19:04
ianw:(19:04
clarkbfatal: [review.openstack.org]: FAILED! => {"changed": false, "failed": true, "msg": "/usr/bin/timeout -s 9 30m /usr/bin/puppet apply /opt/system-config/production/manifests/site.pp --logdest syslog --environment 'production' --no-noop --detailed-exitcodes failed with return code: -9", "rc": -9, "stderr": "", "stdout": "", "stdout_lines": []}19:04
clarkbapparently we bake in that time out?19:04
*** kjorgensen has joined #openstack-infra19:04
clarkbprobably fine to disable puppet cron at this point19:04
*** ociuhandu has quit IRC19:05
pabelangerya, 30min won't be long enough on review.o.o19:06
*** sdake_ is now known as sdake19:06
*** wolverin_ has joined #openstack-infra19:06
pabelangerI think that setting is in ansible-role-puppet19:06
fungipabelanger: i concur, the former bug seems to have been addressed. we likely need to manually rerun manage-projects and look into upping the timeout (or better, improving efficiency of manage-projects, there's a ton of low-hanging fruit in it)19:08
openstackgerritKaitlin Farr proposed openstack-infra/project-config: Castellan functional test now votes  https://review.openstack.org/41954619:08
pabelangerfungi: ++19:09
fungilast time i manually ran manage-projects in verbose/debug mode, i noticed it does a dozen or so relatively expensive git operations for every git repo we have in gerrit19:09
* clarkb needs to step out but will be back before 2000UTC19:09
*** wolverineav has quit IRC19:10
fungiwhich was probably an easy implementation several years ago when we had an order of magnitude fewer repos, but at our current scale is just plain crazy19:10
ianwok i disabled puppet19:10
fungithanks ianw!19:10
ianwso is the thought to bump that timeout and try again?19:10
fungiwhen we get closer to 20:00 let's remember to double-check so that it's not running any ansible19:11
*** john-davidge has quit IRC19:11
fungiianw: probably just need to `sudo manage-projects` on review.o.o for now to get it caught up in preparation for the maintenance-related project-config patches19:11
fungiand hopefully those will be a small enough delta to squeeze into the ansible timeout19:12
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add nova and neutron to major upgrade CI  https://review.openstack.org/41961419:12
ianwok, i'll run that in a screen now19:12
*** spzala has joined #openstack-infra19:14
*** spzala has quit IRC19:14
*** flip214_ is now known as flip21419:14
*** spzala has joined #openstack-infra19:15
openstackgerritPaul Belanger proposed openstack-infra/ansible-role-puppet: Expose puppet_timeout variable  https://review.openstack.org/41961519:15
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction  https://review.openstack.org/39173819:16
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952919:16
ianwok it's running, /root/screenlog.0 logging it19:16
openstackgerritPaul Belanger proposed openstack-infra/system-config: Allow puppet to run for 60m on review.o.o  https://review.openstack.org/41961619:16
pabelangerclarkb: ianw: fungi: ^ should let review.o.o run for 60mins19:16
pabelangerlet (puppet)19:17
openstackgerritPaul Belanger proposed openstack-infra/system-config: Allow puppet to run for 60m on review.o.o  https://review.openstack.org/41961619:17
*** shardy has quit IRC19:18
openstackgerritMonty Taylor proposed openstack-infra/shade: Add support to task manager for async tasks  https://review.openstack.org/41475819:19
*** nadya has joined #openstack-infra19:20
ianwpabelanger: ^ https://github.com/openstack-infra/ansible-role-puppet/blob/master/library/puppet#L158 it's just "timeout"?19:20
openstackgerritMonty Taylor proposed openstack-infra/shade: Add support to task manager for async tasks  https://review.openstack.org/41475819:23
pabelangerianw: https://review.openstack.org/#/c/419615/1/tasks/main.yml19:23
pabelangerianw: need to update ansible-role-puppet too19:23
*** weshay_bbiab is now known as weshay19:25
*** john-davidge has joined #openstack-infra19:26
*** rajinir has quit IRC19:26
*** nicolasbock has quit IRC19:28
openstackgerritsean mooney proposed openstack-infra/project-config: adds experimental os-vif tempest gate  https://review.openstack.org/41961819:28
openstackgerritsean mooney proposed openstack-infra/project-config: moves experimental job to check pipeline for os-vif  https://review.openstack.org/41961919:28
*** ianychoi has quit IRC19:30
*** rhallisey has quit IRC19:30
*** rhallisey has joined #openstack-infra19:30
*** nicolasbock has joined #openstack-infra19:31
*** makowals has quit IRC19:32
*** sean-k-mooney has joined #openstack-infra19:33
*** makowals has joined #openstack-infra19:33
*** migi has quit IRC19:39
*** pabelanger has quit IRC19:39
*** chlong has quit IRC19:41
*** electrofelix has quit IRC19:41
*** lucas-afk has quit IRC19:41
*** cgfielde has quit IRC19:42
*** wfoster has quit IRC19:42
ianwmanage-projects seems like something that could benefit from multiprocessing module19:42
*** jkilpatr has quit IRC19:43
clarkbok I am back19:43
*** rook has quit IRC19:43
clarkbianw: ++ or even forking itself with different subsets of the project list19:44
*** rook has joined #openstack-infra19:44
*** lucasagomes has joined #openstack-infra19:44
*** wfoster has joined #openstack-infra19:44
*** rook is now known as Guest8770619:44
*** Guest87706 is now known as rook-lollll19:45
*** rajinir has joined #openstack-infra19:45
*** gyee has joined #openstack-infra19:45
fungiianw: manage-projects could heavily benefit from some refactoring to only run things when necessary rather than every time for every repo we have19:46
jeblairfungi: yes, though i have a vague feeling a lot of that may still be necessary in order to find out when it's necessary...19:49
ianwok, manage-projects is done19:50
fungisome of the commands it runs, possibly. it needs someone to take a hard look at the overall flow though19:50
fungithanks ianw!19:50
jeblairfungi: ++19:50
ianwit went from 19:15 to 19:4919:50
fungii have a feeling we could speed it up by at least an order of magnitude19:50
jeblairfungi: and ideally not run away screaming after taking that hard look19:51
fungiwell, yeah, and that ;)19:51
fungiianw: did you have any lessons learned from last time, since you were on point then? anything we missed that didn't go so well?19:53
*** dharinic|lunch is now known as dharinic19:54
fungii vaguely remember the gerrit online reindex api command just ignores arguments and reindexes everything so only needs to be run once19:54
*** voldz1tic3n has joined #openstack-infra19:54
*** e0ne has joined #openstack-infra19:54
*** salv-orl_ has quit IRC19:54
ianwthere may have been one since then.  there were some changes merged by mordred after19:55
mordredI didn't do it19:55
fungi</bart>19:55
*** jkilpatr has joined #openstack-infra19:55
mordred:)19:55
mordredianw: I keep thinking that maybe adding a sqlite cache or something to manage-projects so that it can track what projects it has processed and what ones it hasn't would be helpful19:56
mordredianw: but then I never actually work on that19:56
sean-k-mooneyo/19:56
*** chlong has joined #openstack-infra19:57
sean-k-mooneyif people have some free time to review https://review.openstack.org/#/c/419618/1 i would like to do some testing to confim it works in the next few days19:57
fungilooking at http://git.openstack.org/cgit/openstack-infra/system-config/tree/playbooks/rename_repos.yaml#n12 i guess we never merged the patch to add in the missing slashes... anybody happen to know if there was one proposed?19:57
fungipresumably there's still a customized copy of that playbook lying in one or more of our homedirs on the puppetmaster19:58
*** tonytan4ever has quit IRC19:58
*** tonytan4ever has joined #openstack-infra19:58
AJaegersean-k-mooney: we'll have a downtime of gerrit soon and won't merge anything before it.19:58
clarkbI thought I Pushed one up let me check my older gerrit changes19:58
sean-k-mooneyAJaeger: ah ok no worries19:59
armaxHi folks, question from a newbie19:59
sean-k-mooneyi will be signing off for the evening soon anyway19:59
armaxchange https://review.openstack.org/#/c/408847/ recently merged but I am still unable to see the job artefacts in http://logs.openstack.org/periodic/19:59
fungiclarkb: https://review.openstack.org/#/q/file:playbooks/rename_repos.yaml doesn't turn up anything for me19:59
AJaegersean-k-mooney: I see what the change does but why is that beneficial? Would be nice to add to the change19:59
armaxI bet I must be missing something?19:59
*** e0ne has quit IRC19:59
clarkbfungi: ya I don't see anything19:59
clarkbI thought I had pushed that20:00
sean-k-mooneyAJaeger: currently do don test that the os-vif changes are compatible with nova untill after a new release of os-vif. i want to check that before we merge the change.20:00
sean-k-mooneyill add that to the commit message20:00
sean-k-mooneywhen we intergrate os-vif with neutron in pike we will likely extend this to run some neutron centric test also.20:01
*** pabelanger has joined #openstack-infra20:01
*** salv-orlando has joined #openstack-infra20:01
clarkbfungi: 65ed837e31c8a6d916f73a1da78b0e87f910fbbc I updated one of your changes and you seem to have retained owenership of it20:02
clarkbfungi: but I think its up to date20:02
*** e0ne has joined #openstack-infra20:02
ianwyeah that's right, we used the custom version then merged that20:03
fungi? #status alert Gerrit will be offline between now and 10:30 for scheduled maintenance: http://lists.openstack.org/pipermail/openstack-dev/2017-January/109910.html20:03
fungithat look good?20:03
ianw20:30 i think20:03
fungier, yep20:03
*** kjorgensen has quit IRC20:03
fungitypo20:03
clarkbya20:04
AJaegerok with 20:3020:04
*** zaitcev has joined #openstack-infra20:05
fungi#status alert Gerrit will be offline between now and 20:30 for scheduled maintenance: http://lists.openstack.org/pipermail/openstack-dev/2017-January/109910.html20:05
openstackstatusfungi: sending alert20:05
*** mmandel has joined #openstack-infra20:05
fungiclarkb: okay, so did we end up not needing slashes between like {{ item[0] }}{{ item[1].old }}.git?20:05
clarkbfungi: I think I put trailing slashes into the vars themselves20:06
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support  https://review.openstack.org/41611020:06
fungiahh, that would make sense20:06
fungiwfm then20:07
clarkbya /var/lib/git became /var/lib/git/20:07
fungid'oh, i see that in the commit now20:07
fungithanks20:07
zaitcevGuys, who is responsible for docs.openstack.org? Looks like a fresh 404 that I wish to report. I should not write to asettle personally, I presume. Is there a mailing list or whatnot?20:07
clarkbAJaeger: unrelated to downtime but apparently we lost git-review docs at http://docs.openstack.org/infra/git-review guessing its related to the afs switch20:07
-openstackstatus- NOTICE: Gerrit will be offline between now and 20:30 for scheduled maintenance: http://lists.openstack.org/pipermail/openstack-dev/2017-January/109910.html20:07
*** ChanServ changes topic to "Gerrit will be offline between now and 20:30 for scheduled maintenance: http://lists.openstack.org/pipermail/openstack-dev/2017-January/109910.html"20:07
pabelangerzaitcev: AJaeger has been working on it20:08
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: Add OOOQ multinode test support  https://review.openstack.org/41611020:08
zaitcevpabelanger: thanks!20:08
AJaegerclarkb: oh - let me check...20:08
AJaegerclarkb: seems we have no reference to them - what links to that?20:08
clarkbAJaeger: if you search for git-review on docs.o.o it gives you that url20:09
zaitcevAJaeger: If I go to the top docs.openstack.org and type "git-review" into the search, it finds the normal content, e.g. "git-review is a tool that helps submitting git branches to gerrit f"20:09
clarkbfungi: ianw pabelanger with the notice everywhere ish now. who is running the playbook?20:09
fungiokay, so ready to move forward with http://docs.openstack.org/infra/system-config/gerrit.html#renaming-a-project i guess? step 1 is already done. has the yaml file for step 2 been assembled?20:09
zaitcevAJaeger: I noticed this because it's mentioned in https://github.com/openstack-infra/git-review/blob/master/README.rst20:09
AJaegerclarkb: let me copy over the files...20:09
pabelangerclarkb: not I20:09
ianwclarkb: i can20:10
clarkbianw: ok20:10
clarkbother steps are zuul and github20:10
fungithanks ianw. i'm having cut-n-paste problems right now for some reason20:10
ianwok to stop zuul?20:10
AJaegermmh, why is there no index file at http://docs.openstack.org/infra/ ?20:10
clarkbianw: I think so20:10
fungiyeah, dump copies of the pipelines first of course20:10
fungii'll also give the release channel a heads up20:11
pabelangerianw: you are on step 4?20:11
ianwyep20:11
openstackstatusfungi: finished sending alert20:11
openstackgerritsean mooney proposed openstack-infra/project-config: adds experimental os-vif tempest gate  https://review.openstack.org/41961820:11
openstackgerritsean mooney proposed openstack-infra/project-config: moves experimental job to check pipeline for os-vif  https://review.openstack.org/41961920:11
pabelangerack20:11
clarkbianw: if you point me at your rename yaml file I will handle the github changes20:11
AJaegerclarkb, zaitcev I'll figure it out...20:11
fungirelease pipelines are empty so we're safe20:11
ianwpabelanger: puppetmaster:/root/ianw/rename-2017-01-12.yaml20:12
ianwsudo invoke-rc.d zuul stop happened very fast20:12
fungiit does20:13
pabelangerI see an issue on yaml file20:13
pabelangeropenstack/python-nimbleclient is missing20:13
*** dtardivel has quit IRC20:14
ianwok, neither of the /var/run files there, i think step 4 is complete20:15
sean-k-mooneyAJaeger: i updated the commit messages with some more detail as to why the change is being made. no worries if you cant review. im sure your busy with getting ready for the gerrit maintence20:15
ianwpabelanger: thanks20:15
*** tonytan4ever has quit IRC20:15
*** pblaho has quit IRC20:15
*** tonytan4ever has joined #openstack-infra20:15
pabelangerconfirmed: zuul is stopped20:16
ianwupdated the yaml20:16
pabelangerchecking20:16
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add AFS publish root-marker for infra/index.html file  https://review.openstack.org/41963520:16
AJaegerclarkb: that's the fix for the index file ^20:16
*** adrian_otto1 has quit IRC20:17
AJaegerwith that file, we would have noticed the missing git-review20:17
ianwok -> sudo ansible-playbook -f 10 /opt/system-config/production/playbooks/rename_repos.yaml -e repolist=/root/ianw/rename-2017-01-12.yaml20:17
ianwsomeone else want to double check that?20:17
pabelangerianw: looks right20:17
pabelangerianw: that was for yaml file20:17
pabelangernot sudo command20:17
fungii've dug up the syntax for the gerrit online indexing, and based on earlier analysis i'm going to try the more correct-looking parameter order indicated by its context help this time20:18
pabelangerianw: looks to be the same as step 520:18
clarkbyup based on docs that command lgtm20:18
*** Sukhdev has joined #openstack-infra20:18
clarkbgithub is almost done. doing python-nimbleclient now20:19
ianwok, here we go20:19
pabelangerclarkb: are you using your personal account or openstackgerrit?20:19
clarkbpabelanger: personal account20:19
pabelangerfor github things20:19
ianwsyntax error while reading yaml20:19
*** wolverin_ has quit IRC20:19
clarkbhow "funny" would it be if our playbook is 2.0 but not 2.2 compat :/20:20
ianwline 9 rename_repos.yaml20:20
*** wolverineav has joined #openstack-infra20:20
*** umeshksingla has joined #openstack-infra20:20
clarkboh because the {{ is there we may need to quote it20:20
ianwok, just quotes around {{20:20
pabelangeryup20:20
clarkbthere are a few places we will need that edit20:20
pabelangerthere is more lines that need it20:20
*** ldnunes has quit IRC20:20
fungiahh, yep, any values starting with { need to be quoted or yaml will parse them as inline associative arrays20:21
*** aeng has joined #openstack-infra20:22
ianwok running with hacked in quotes20:23
fungiwe'll get the patch for that merged once we're done20:23
fungithanks20:23
ianwhttp://paste.openstack.org/show/594760/20:24
*** admcleod_ is now known as admcleod20:24
fungioh, ick, it embedded quotes in the parameters20:25
ianwok, so we should do the moves by hand?20:25
fungimv \"~gerrit2/review_site/git/openstack/nomad\".git \"~gerrit2/review_site/git/openstack/cyborg\".git20:25
*** umeshksingla has quit IRC20:25
fungiwell, it stopped running the playbook20:25
fungiso there will be other commands it didn't get around to running after that20:26
*** tonytan4ever has quit IRC20:26
ianwoh, doh, yeah, ok20:26
*** e0ne has quit IRC20:26
clarkbmv {{ item[0] }}{{ item[1].old }}.git {{ item[0] }}{{ item[1].new }}.git20:26
fungilast time i incrementally worked through testing this playbook, i had to keep deleting any steps it had previously run successfully20:26
clarkbin this case it wouldn't have moved them right?20:27
fungicorrect20:27
fungiit failed and needs to rerun those20:27
sean-k-mooneyfungi: doesnt that defeat the idopotemcy of ansible20:27
fungisean-k-mooney: ansible is idempotent?20:27
clarkbits "idempotent" turns out if you rtfs it isn't at all in any way20:27
fungiwe're using ansible as a remote runner for non-idempotent shell commands20:28
sean-k-mooneyfungi: well if you right the playbook to be it can be20:28
ianwhang on, i put the quotes on the mv20:28
clarkbianw: ah20:28
clarkbianw: you only need the quotes if they start the yaml string20:28
clarkbianw: you can also put quota around the entirety of the ansible strings20:28
clarkbso "mv {{thing}} {{other_thing}}"20:28
clarkbrather than mv "{{thing}}" "{{other_thing}}"20:29
jeblairi'm around now if needed for any emergencies20:29
fungii'm going to extend our outage window by 15 more minutes20:29
*** Swanson has joined #openstack-infra20:29
*** john-davidge has quit IRC20:30
fungi#status alert Updated: Gerrit will be offline until 20:45 for scheduled maintenance (running longer than anticipated): http://lists.openstack.org/pipermail/openstack-dev/2017-January/109910.html20:30
openstackstatusfungi: sending alert20:30
*** umeshksingla has joined #openstack-infra20:30
*** john-davidge has joined #openstack-infra20:30
ianwok, let me try again, i'll remove the quotes and the steps before the mv20:30
-openstackstatus- NOTICE: Updated: Gerrit will be offline until 20:45 for scheduled maintenance (running longer than anticipated): http://lists.openstack.org/pipermail/openstack-dev/2017-January/109910.html20:33
*** ChanServ changes topic to "Updated: Gerrit will be offline until 20:45 for scheduled maintenance (running longer than anticipated): http://lists.openstack.org/pipermail/openstack-dev/2017-January/109910.html"20:33
ianwfatal: [review.openstack.org]: FAILED! => {"failed": true, "msg": "'repos' is undefined"}20:33
* bswartz shakes fist at gerrit20:34
ianwbah, my fault, hang on20:34
sean-k-mooneyi guess some of the plays you removed were needed20:34
pabelangerokay, I have ansible-lint work on system-config20:34
pabelangerwill include that with fixes for rename_repos.yaml20:35
*** john-davidge has quit IRC20:35
*** itisha has joined #openstack-infra20:35
fungipabelanger: thanks! that should help20:35
sean-k-mooneyansible-lint oh cool havent used that before. i wonder if we are running that on kolla-ansible...20:35
openstackstatusfungi: finished sending alert20:36
*** bh526r has quit IRC20:36
ianwnow what ... http://paste.openstack.org/show/594762/20:36
pabelangerfungi: likely going to need a review on the tox.ini changes20:36
fungiianw: that looks like an idempotency issue20:37
fungiit's trying to rename from names that don't exist on disk?20:37
fungiprobably already did that once20:38
pabelangeryes, it already did that in the previous paste20:38
clarkbls says that its already done and those are called mogan now20:38
fungiright, just need to remove that step from the playbook and fire again20:38
pabelangermaybe we should update our directions to --noop first, to make sure the playbook works properly20:39
pabelangerfrom ansibles POV20:39
*** cody-somerville has quit IRC20:39
ianwok, so just move on to the git host tasks20:39
fungiianw: yep, as long as the ~gerrit2/review_site/git/ and /opt/lib/git/ moves look complete20:40
ianwgit bit done20:40
ianwstoryboard bit done20:40
*** voldz1tic3n has quit IRC20:40
ianwmake sure gerrit api is accepting requests20:40
*** spzala has quit IRC20:41
ianwseems to be for me20:41
pabelangersame20:42
fungiyeah, i can ls-projects20:42
ianwok, going on20:42
ianwta-da, done20:42
fungii'll start the account reindexing, then the change reindexing20:43
ianwok to start zuul?20:43
fungishould be yes20:43
fungiyeah, confirmed, index start just reindexes everything afaict20:44
*** chlong has quit IRC20:44
ianwok, zuul started20:44
ianwit doesn't really put anything in the logs?20:45
ianwwhen it starts20:45
clarkbianw: it starts slowly20:45
clarkbin about a minute it should spam heavily20:45
openstackgerritStephen Watson proposed openstack-infra/project-config: Create MySQL DB for migration tests  https://review.openstack.org/41963820:45
ianwyeah, i would be nice to stamp a "hi there" message, i think i meant to put that in last time i did this20:45
fungithis time i did `gerrit index start accounts --force` instead of --force accounts, and it's still got "Index all changes of project <whatever>" over and over in the show-queue output20:45
*** Goneri has quit IRC20:46
fungi1127 repos left to reindex20:46
fungizuul status api looks like it's loading now20:47
pabelangerya20:47
fungiso probably safe to start requeuing the saved pipelines20:47
ianwok, requeing20:48
openstackgerritKarthik Prabhu Vinod proposed openstack-infra/project-config: Adding two other combinations of cinder multinode grenade job  https://review.openstack.org/38483620:48
*** e0ne has joined #openstack-infra20:48
*** mhickey_ has joined #openstack-infra20:48
jaosoriorwith the restarting of zuul, is it necessary to recheck jobs?20:48
ianwjaosorior: we should be restoring the queue as it was momentarily20:49
jaosorioralright, thanks20:49
fungijaosorior: any which were in the process of being tested when we stopped zuul are going to be put back in by us, but it's possible you pushed a change while gerrit was up and zuul was down (so if you don't see it show up on the zuul status page in a few more minutes, feel free to recheck)20:49
openstackgerritPaul Belanger proposed openstack-infra/system-config: Run ansible-lint on playbooks  https://review.openstack.org/41964120:49
pabelangeransible-lint patch^20:49
fungii guess we're in good enough shape for me to end the status alert?20:50
dimsyay, thanks for requeue-ing :)20:50
clarkbdid we approve the project-config changes before enqueuing? if not its not end of world but could slow down the merges of those20:50
pabelangerI don't think so20:50
ianwoh, damn20:50
*** adriant has joined #openstack-infra20:51
pabelangerdocs do say to enqueue first20:51
ianwdone now, i think they'll just work their way though20:51
clarkbpabelanger: indeed they do20:51
fungiyeah, i figured we'd get to them when we get to them. it's not really a race at this point20:51
fungi#status ok20:51
openstackstatusfungi: sending ok20:51
*** nadya has quit IRC20:52
ianwcheck queue still processing20:52
ianw ... and done20:52
fungizuul pipelines lgtm. nice and full20:52
ianw7 done20:52
*** d0ugal has quit IRC20:52
ianw8 pabelanger did right?20:52
pabelangerno, clarkb20:52
pabelangerI don't have access to github owership20:53
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/"20:53
ianwoh, but done?20:53
clarkbpabelanger: ?20:53
pabelangerclarkb: github rename20:53
fungiremember _not_ to do step 9 until the project-config changes are definitely merged20:53
pabelangerI believe you are doing that20:53
clarkbpabelanger: oh yup its all done20:53
clarkboh ya ianw and pabelanger are not in this list20:54
clarkbianw: pabelanger what are your github accounts?20:54
*** d0ugal has joined #openstack-infra20:54
*** d0ugal has quit IRC20:54
*** d0ugal has joined #openstack-infra20:54
fungipabelanger: ianw: want access to our github orgs? can add you now20:54
pabelangerpabelanger for me20:54
ianwianw20:54
clarkbfungi: you doing it ? if so I am going to eat lunch20:54
clarkbotherwise I can get it20:54
openstackstatusfungi: finished sending ok20:54
fungiclarkb: go eat lunch!20:54
clarkbthanks20:54
fungii'm already there anyway20:54
ianwok, puppet cron on puppetmaster running20:55
ianwor renabled at least20:55
AJaegerteam, could you review https://review.openstack.org/#/c/419635 to add docs.o.o/infra/index.html back, please?20:55
pabelangerianw: didn't fungi say wait20:55
fungiremember _not_ to do step 9 until the project-config changes are definitely merged20:55
pabelangerya, they haven't merged yet20:55
ianwahh, ok, stopped it again20:56
fungiotherwise we end up with duplicate projects we have to manually delete, and it's a mess20:56
pabelangerwe should likely add a nice warning for step 920:56
ianwyeah, i can add that warning20:56
*** mhickey_ has quit IRC20:56
*** mhickey has joined #openstack-infra20:57
fungithanks, i was thinking the same thing (actually thought we had one, but then saw there wasn't which is why i mentioned it in here just to be safe)20:57
*** chlong has joined #openstack-infra20:58
*** wolverin_ has joined #openstack-infra20:58
fungi477 projects still reindexing20:58
*** wolverineav has quit IRC20:58
*** panda|bbl is now known as panda20:58
openstackgerritMerged openstack-infra/project-config: Rename project Nomad to Cyborg based upon team voting and consensus  https://review.openstack.org/40111520:59
openstackgerritSteve Martinelli proposed openstack-infra/project-config: add functional test for osc that uses master libraries  https://review.openstack.org/41904721:00
*** david-lyle has quit IRC21:01
*** ianychoi has joined #openstack-infra21:01
openstackgerritPaul Belanger proposed openstack-infra/project-config: Start building fedora-25 DIBs  https://review.openstack.org/41964321:01
*** skelso has joined #openstack-infra21:01
pabelangerianw: okay, fedora-25 builds properly, brings it online^21:01
ianwpabelanger: ok, did you test boot?21:02
pabelangerianw: ya, worked locally21:02
AJaegerpabelanger: could you copy http://users.suse.com/~aj/missing-v4.tar.xz to docs.o.o for git-review and git-restack, please?21:02
ianwok, as long as it got on the network21:02
*** david-lyle has joined #openstack-infra21:02
pabelangerianw: yup, also tested with https://review.openstack.org/#/c/419559/21:02
*** d0ugal has quit IRC21:03
pabelangerAJaeger: k21:03
openstackgerritMerged openstack-infra/project-config: Rename nimble to mogan (2)  https://review.openstack.org/41567521:03
openstackgerritIan Wienand proposed openstack-infra/system-config: Updates for rename instructions  https://review.openstack.org/41964421:04
*** chlong has quit IRC21:04
*** kjorgensen has joined #openstack-infra21:04
ianwok, both rename changes merged21:05
ianwwill now re-enable puppet21:05
*** e0ne has quit IRC21:06
pabelangerfungi: if you'd like to review 419643 too21:06
pabelangerAJaeger: done21:06
AJaegerthanks, pabelanger .21:07
*** thiagolib has quit IRC21:08
*** kjorgensen has quit IRC21:09
openstackgerritKarthik Prabhu Vinod proposed openstack-infra/project-config: Adding two other combinations of cinder multinode grenade job  https://review.openstack.org/38483621:10
AJaegerpabelanger, clarkb, ianw, if you could review https://review.openstack.org/419635 please so that docs.openstack.org/infra/index.html stays, we should be in a much better shape ;)21:10
*** adrian_otto has joined #openstack-infra21:11
pabelanger+221:11
AJaegerthanks21:11
ianwok, i've proposed .gitreview updates for the affected projects21:12
ianwpabelanger has a change to fix the syntax issues21:12
ianwi think i declare this rename over?21:12
pabelanger++21:12
AJaegerGreat!21:13
AJaegerthanks!21:13
fungithanks ianw, clarkb, pabelanger!21:14
fungigreat work on the maintenance21:14
ianwnext time it's just going to all work, i can feel it21:15
*** eharney has quit IRC21:15
AJaegertime to retire fairy-slipper - anyone up for a +2A, please? https://review.openstack.org/#/c/41753621:15
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add jaosorior's key to tripleo-cd-admins  https://review.openstack.org/41965321:16
ianwAJaeger: heh, i thought that was a weird way of saying you're going to bed!21:16
AJaegerianw: not yet - docs meeting ongoing...21:17
*** cody-somerville has joined #openstack-infra21:17
*** cody-somerville has joined #openstack-infra21:17
*** spzala has joined #openstack-infra21:18
*** openstackgerrit has quit IRC21:18
*** chlong has joined #openstack-infra21:18
*** openstackgerrit has joined #openstack-infra21:18
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Easy diskimage-builder development environment setup  https://review.openstack.org/41965521:18
*** umeshksingla has quit IRC21:19
fungii approved the patch to the rename docs. was there also one coming for the broken bits of the playbook (the quoting issues in particular)?21:20
fungialso, we're down to just 4 projects reindexing now21:20
fungii bet you can guess at least two of them21:21
fungi(hint: two are service repos, one is a docs repo and one a qa repo)21:21
fungior, you could just look at the gerrit show-queue -w output i guess21:22
AJaegeropenstack-manuals, nova are the obvious ones21:22
ianwfungi: syntax fix rolled into the linting in -> https://review.openstack.org/#/c/419641/21:22
fungineutron and tempest are the other two21:22
fungiianw: thanks i missed that21:22
openstackgerritMerged openstack-infra/project-config: Add AFS publish root-marker for infra/index.html file  https://review.openstack.org/41963521:23
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add support to task manager for async tasks  https://review.openstack.org/41475821:23
fungipabelanger: looks like the linters job completed successfully and ran ansible-lint21:23
pabelangeryay21:23
*** dimtruck is now known as zz_dimtruck21:24
AJaegerzaitcev, clarkb : docs.openstack.org/infra/git-review is up again21:25
*** hamzy has quit IRC21:25
fungiAJaeger: i guess that one was missing from our earlier catch-up imports?21:27
zaitcevAJaeger: thanks a lot, verified21:27
*** kgiusti has left #openstack-infra21:27
funginow we're down to just neutron and nova getting reindexed21:27
AJaegerfungi, yeah git-review last update was 2015-06-12 - and we only have content generated after October 2016...21:27
AJaegerfungi: and my check for broken links didn't notice it since docs.o.o/infra/index.html had no root-marker and thus got deleted ;(21:28
AJaegerafter the next project-config docs publish run, we should be fine...21:28
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add support to task manager for async tasks  https://review.openstack.org/41475821:29
*** john-davidge has joined #openstack-infra21:31
*** umeshksingla has joined #openstack-infra21:31
*** skelso has quit IRC21:32
*** skelso has joined #openstack-infra21:33
*** mhickey has quit IRC21:33
*** jkilpatr has quit IRC21:33
*** Jeffrey4l has quit IRC21:34
pabelangernot back, 1153 nodes online right now21:34
pabelangerbad*21:34
pabelangerdoesn't include subnodes21:35
*** john-davidge has quit IRC21:35
*** zz_dimtruck is now known as dimtruck21:39
*** cody-somerville has quit IRC21:39
*** fguillot has quit IRC21:44
*** rhallisey has quit IRC21:44
*** ccamacho has joined #openstack-infra21:47
AJaegerianw: now I'm waving good night ;)21:47
*** cody-somerville has joined #openstack-infra21:47
*** cody-somerville has joined #openstack-infra21:47
ianwAJaeger: see ya!21:48
funginight AJaeger!21:48
*** eharney has joined #openstack-infra21:48
ianwhmm does my github timeline now show every change from openstack-gerrit?21:48
*** kjorgensen has joined #openstack-infra21:49
fungii guess so (i hardly touch github so hadn't really noticed)21:49
fungiwonder if there's a way to mute certain users from your timeline21:50
*** strattao has quit IRC21:50
*** _Cyclone_ has quit IRC21:50
*** knangia has quit IRC21:50
openstackgerritMerged openstack-infra/tripleo-ci: Stop running if zuul job goes away  https://review.openstack.org/41861521:51
*** jcoufal has quit IRC21:51
ianwi guess for some reason it's decided i want to "watch" every openstack repo21:51
fungiyeah, i think it does that for any repo in an org you're an owner of?21:51
ianwheh, so i can either click 300 times, or, "unwatch all" and then restore the ones i really do want to watch21:52
fungilooks like it can be controlled at https://github.com/watching21:52
fungiright, that21:52
*** askb has joined #openstack-infra21:52
fungirather an unfortunate github behavior21:53
*** strattao has joined #openstack-infra21:53
*** cody-somerville has quit IRC21:53
fungioh, also i only invited you and pabelanger to the openstack org. we have a few more i'll invite you on21:53
*** panda is now known as panda|Zz21:53
openstackgerritMerged openstack-infra/tripleo-ci: Re-enable graphite metrics  https://review.openstack.org/41146021:54
*** spzala has quit IRC21:54
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add support to task manager for async tasks  https://review.openstack.org/41475821:54
*** cody-somerville has joined #openstack-infra21:55
*** cody-somerville has joined #openstack-infra21:55
*** yamahata has quit IRC21:56
*** yamahata has joined #openstack-infra21:57
*** thorst_ has quit IRC21:57
*** matt-borland has quit IRC21:59
*** jtwill98_ has joined #openstack-infra22:00
openstackgerritMerged openstack-infra/system-config: Updates for rename instructions  https://review.openstack.org/41964422:00
*** amotoki has joined #openstack-infra22:01
*** trown is now known as trown|outtypewww22:01
fungii just "unwatched" 1627 repositories on github22:01
mordredfungi: nice!22:02
fungicurious to see if github auto-watches new projects created in our orgs22:02
fungii'm guessing it will22:02
*** annegentle has quit IRC22:02
openstackgerritIan Y. Choi proposed openstack-infra/system-config: Switch to openstackid-dev for translate-dev  https://review.openstack.org/41966722:05
*** voldz1tic3n has joined #openstack-infra22:05
*** ihrachys_ is now known as ihrachys22:05
nibalizerfungi: yep22:05
nibalizerit will22:05
jeblairfungi: that seems like a perfectly nice feature for a team with around 5 projects.22:05
nibalizerthere might be a setting we can toggle22:05
nibalizerbut ugh, github22:05
*** d0ugal has joined #openstack-infra22:06
nibalizeroh its not too bad22:07
nibalizerfungi: https://help.github.com/articles/watching-repositories/#disabling-automatic-watching22:07
nibalizerits per-user22:07
funginibalizer: thanks!22:07
*** darrenc is now known as darrenc_afk22:09
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921522:12
*** jamesdenton has quit IRC22:13
*** jkilpatr has joined #openstack-infra22:15
fungias usual, nova is the last repo still being reindexed22:19
fungipast the 90 minute mark so far22:19
dimsfungi : so far it's been 12 mins since i uploaded this review https://review.openstack.org/#/c/419668/ Should zuul have picked it up by now? (guess things are backed up)22:19
jeblairdims: i don't think anything's backed up22:21
*** john-davidge has joined #openstack-infra22:21
jeblairdims: i see a -1 from jenkins at 22:1322:22
dimsjeblair : weird :) thanks22:22
*** spzala has joined #openstack-infra22:22
jeblairdims: maybe it's not backed up enough? :)22:22
*** wolverineav has joined #openstack-infra22:22
dimsLOL22:23
dimsi should add more py35 jobs :)22:23
*** salv-orl_ has joined #openstack-infra22:23
openstackgerritPaul Belanger proposed openstack-infra/project-config: Remove script-dir from nodepool  https://review.openstack.org/41967222:24
pabelangerjeblair: fungi: ianw: ^ fixes our nodepool validation job22:25
clarkbAJaeger: thanks22:25
clarkbI have ended up.afk again to finish up shoveling (I can usr my gates again) and repair my fence that half fell over in the snow22:25
openstackgerritPaul Belanger proposed openstack-infra/project-config: Start building fedora-25 DIBs  https://review.openstack.org/41964322:25
*** salv-orlando has quit IRC22:25
*** annegentle has joined #openstack-infra22:26
*** wolverin_ has quit IRC22:26
ianwclarkb: i just turned the ac down a notch because it's too hot in here22:27
*** spzala has quit IRC22:27
*** spzala has joined #openstack-infra22:28
ianwpabelanger: ok, the important bit/subject seems to be more not to use the zuul3 branch, more than fixing the config :)22:28
*** chlong has quit IRC22:29
fungigot up to 21c here today. kinda warm for the middle of winter22:30
jeblairpabelanger: ah, thx, forgot that.22:30
*** thorst_ has joined #openstack-infra22:32
*** john-davidge has quit IRC22:33
*** john-davidge has joined #openstack-infra22:33
*** spzala has quit IRC22:34
*** dprince has quit IRC22:34
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Extract /etc from subnode logs for easy browser viewing  https://review.openstack.org/41770822:35
*** nherciu_ has quit IRC22:35
clarkbianw: we got almost 1/3 ameter of snow yesterday and isnt supposed to get above 0 C until monday ish22:36
clarkbso trying to dig out while the sun is helping me22:36
*** thorst_ has quit IRC22:37
clarkbI also cleared a couple branch grom my tree that frll off my neigh ors fence22:37
*** chlong has joined #openstack-infra22:37
*** john-davidge has quit IRC22:38
openstackgerritAntonio Ojea proposed openstack-infra/project-config: Remove python34 stats from midonet dashboard  https://review.openstack.org/41967622:38
clarkbI likrd that tree too RIP22:38
*** cgfielde has joined #openstack-infra22:40
*** annegentle has quit IRC22:40
*** cgfielde has left #openstack-infra22:41
*** darrenc_afk is now known as darrenc22:41
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction  https://review.openstack.org/39173822:41
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job  https://review.openstack.org/41952922:41
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Add spec for debootstrap-minimal element  https://review.openstack.org/41967922:41
fungiclarkb: is it the overgrown apple, or another one?22:42
*** Swami has quit IRC22:43
*** wolverin_ has joined #openstack-infra22:44
*** srobert has quit IRC22:44
*** skelso has quit IRC22:45
openstackgerritK Jonathan Harker proposed openstack-infra/project-config: Make trusty logstash-filter jobs voting  https://review.openstack.org/36966722:45
*** wolverin_ has quit IRC22:45
*** skelso has joined #openstack-infra22:45
*** wolverin_ has joined #openstack-infra22:46
clarkbfungi: a different one. we gave the applr a massicr haircut before the storm so it is happy22:47
*** wolverineav has quit IRC22:47
fungioh, good22:49
fungiand nova is still reindexing. past the 2 hour mark now22:50
*** wolverin_ has quit IRC22:50
*** wolverineav has joined #openstack-infra22:51
*** wolverineav has quit IRC22:54
ianychoiclarkb, oh you are still here (I have been confused timezone sometimes). Please see http://lists.openstack.org/pipermail/openstack-infra/2017-January/005040.html :)22:55
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Start with an empty environment for chroot  https://review.openstack.org/41386822:56
*** pahuang has joined #openstack-infra22:58
*** umeshksingla has quit IRC22:59
*** wolverineav has joined #openstack-infra22:59
*** annegentle has joined #openstack-infra22:59
*** mdrabe has quit IRC23:00
*** strattao has left #openstack-infra23:01
openstackgerritJesse Keating proposed openstack-infra/zuul: Add trigger capability on github pr review  https://review.openstack.org/41968423:02
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Start with an empty environment for chroot  https://review.openstack.org/41386823:02
*** wolverineav has quit IRC23:07
openstackgerritMerged openstack/diskimage-builder: Fix Gentoo builds on Ubuntu 16.04 Xenial hosts  https://review.openstack.org/41339523:07
*** lseki has quit IRC23:10
*** yamahata has quit IRC23:10
*** yamahata has joined #openstack-infra23:12
*** wolverineav has joined #openstack-infra23:16
*** dave-mccowan has quit IRC23:17
*** rkukura has quit IRC23:18
*** wolverineav has quit IRC23:21
*** cody-somerville has quit IRC23:21
*** jaosorior has quit IRC23:22
*** wolverineav has joined #openstack-infra23:22
*** dingyichen has joined #openstack-infra23:27
*** marst has quit IRC23:28
*** lcastell has quit IRC23:30
*** lcastell has joined #openstack-infra23:30
*** voldz1tic3n has quit IRC23:31
*** mriedem has quit IRC23:33
*** thorst_ has joined #openstack-infra23:33
*** mmandel has quit IRC23:36
*** wolverineav has quit IRC23:36
*** mmandel has joined #openstack-infra23:37
*** Jeffrey4l has joined #openstack-infra23:37
*** thorst_ has quit IRC23:37
*** rook-lollll is now known as rook23:37
*** mmandel has quit IRC23:37
*** rvba has quit IRC23:38
*** mmandel has joined #openstack-infra23:38
*** mmandel has quit IRC23:43
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Docker matrix build  https://review.openstack.org/41434723:45
*** cody-somerville has joined #openstack-infra23:46
*** cody-somerville has joined #openstack-infra23:46
*** annegentle has quit IRC23:46
*** wolverineav has joined #openstack-infra23:47
*** salv-orl_ has quit IRC23:48
*** wolverineav has quit IRC23:51
*** lindycoder has quit IRC23:51
*** lindycoder has joined #openstack-infra23:52
*** lindycoder has quit IRC23:52
*** Swami has joined #openstack-infra23:54
*** Swami_ has joined #openstack-infra23:54
*** wolverineav has joined #openstack-infra23:57
*** rvba has joined #openstack-infra23:57
*** rvba has quit IRC23:57
*** rvba has joined #openstack-infra23:57
*** rkukura has joined #openstack-infra23:58
*** voldz1tic3n has joined #openstack-infra23:58
*** cody-somerville has quit IRC23:59
*** Julien-zte has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!