Wednesday, 2016-05-04

*** kengo_sakai has joined #openstack-infra00:01
*** kengo_sakai has quit IRC00:06
*** amrith is now known as _amrith_00:09
*** Jeffrey4l has joined #openstack-infra00:10
*** pvaneck has quit IRC00:11
*** markvoelker has joined #openstack-infra00:14
*** bpokorny has quit IRC00:18
*** anteaya has quit IRC00:18
*** ddieterly has joined #openstack-infra00:22
*** _amrith_ is now known as amrith00:24
*** banix has joined #openstack-infra00:25
*** Sukhdev has joined #openstack-infra00:26
*** xarses has quit IRC00:27
*** mtanino has quit IRC00:28
*** nadya has joined #openstack-infra00:28
*** nadya has quit IRC00:32
*** baoli has joined #openstack-infra00:34
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Allow tox targets that need sudo (functional jobs)  https://review.openstack.org/31229100:34
*** baoli has quit IRC00:36
*** baoli has joined #openstack-infra00:36
*** flepied has quit IRC00:37
*** yamahata has joined #openstack-infra00:39
*** weshay has joined #openstack-infra00:42
*** gildub has joined #openstack-infra00:44
*** keedya has quit IRC00:50
openstackgerritSachi King proposed openstack-infra/zuul: Support post jobs by supporting rev checkout  https://review.openstack.org/29319400:54
*** Sukhdev has quit IRC00:56
*** madhu_ak has quit IRC00:56
*** xarses has joined #openstack-infra00:59
*** amrith is now known as _amrith_00:59
*** baoli has quit IRC00:59
*** kjorgensen has quit IRC01:02
*** baoli has joined #openstack-infra01:04
*** kjorgensen has joined #openstack-infra01:04
*** kjorgens_ has joined #openstack-infra01:08
*** kjorgensen has quit IRC01:09
*** amitgandhinz has joined #openstack-infra01:09
*** thorst has joined #openstack-infra01:09
*** zz_dimtruck is now known as dimtruck01:10
*** rfolco has joined #openstack-infra01:11
*** armax_ has joined #openstack-infra01:11
*** kjorgens_ has quit IRC01:12
*** armax has quit IRC01:12
*** armax_ is now known as armax01:12
*** sdake has quit IRC01:13
*** armax has quit IRC01:14
*** Sukhdev has joined #openstack-infra01:19
*** sflanigan_ has quit IRC01:20
*** vkmc is now known as Guest987401:20
*** sflanigan has joined #openstack-infra01:21
*** yamamoto has quit IRC01:21
*** jerryz has quit IRC01:22
*** Guest9874 is now known as cmkv01:22
*** cmkv is now known as violenciarivas01:22
*** fitoduarte has quit IRC01:23
*** violenciarivas is now known as vkmc01:23
*** zhurong has joined #openstack-infra01:23
*** armax has joined #openstack-infra01:26
*** Sukhdev has quit IRC01:27
*** baoli has quit IRC01:27
*** yamamoto has joined #openstack-infra01:36
*** ddieterly is now known as ddieterly[away]01:38
*** yamahata has quit IRC01:38
*** yamamoto has quit IRC01:41
*** yamamoto has joined #openstack-infra01:41
*** yamamoto has quit IRC01:42
*** hdd has quit IRC01:42
*** Keedya_ has joined #openstack-infra01:43
*** EricGonczer_ has joined #openstack-infra01:44
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Enable returning run id in get_test_runs_by_status_for_run_ids()  https://review.openstack.org/31229801:44
*** aviau has joined #openstack-infra01:47
*** flepied has joined #openstack-infra01:49
*** EricGonczer_ has quit IRC01:49
*** Keedya_ has quit IRC01:49
*** kengo_sakai has joined #openstack-infra01:50
*** Keedya_ has joined #openstack-infra01:52
*** kengo_sakai has quit IRC01:54
*** apoorvad has quit IRC01:56
*** thorst has quit IRC01:57
*** thorst has joined #openstack-infra01:58
*** Keedya_ has quit IRC01:59
*** thorst has quit IRC02:06
*** timl0101 has quit IRC02:07
*** woodster_ has quit IRC02:08
*** jaosorior has joined #openstack-infra02:09
*** ddieterly[away] has quit IRC02:11
*** gyee has quit IRC02:12
*** yamahata has joined #openstack-infra02:13
*** ianychoi has quit IRC02:18
*** asettle has quit IRC02:22
*** asettle has joined #openstack-infra02:22
*** asettle has quit IRC02:27
*** nadya has joined #openstack-infra02:29
openstackgerritMatthew Treinish proposed openstack-infra/puppet-openstack_health: WIP: Add elastic recheck to api server  https://review.openstack.org/31230802:30
*** nadya has quit IRC02:33
*** jaypipes has quit IRC02:40
*** yamamoto has joined #openstack-infra02:43
*** cody-somerville has joined #openstack-infra02:44
*** mriedem has quit IRC02:47
timrcDoes upstream store anything other than logs in swift containers?02:50
*** markvoelker has quit IRC02:52
*** sflanigan has quit IRC02:53
*** sflanigan has joined #openstack-infra02:53
clarkbrax test slave images02:53
clarkbthats it02:53
*** sflanigan has quit IRC02:53
*** sflanigan has joined #openstack-infra02:53
*** yamamoto has quit IRC02:54
*** akscram has quit IRC02:54
*** akscram has joined #openstack-infra02:54
timrcclarkb: How are those served?02:58
*** banix has quit IRC03:02
*** thorst has joined #openstack-infra03:04
clarkbthey arent really, its just for import into glance03:05
*** kjorgensen has joined #openstack-infra03:07
*** tphummel has quit IRC03:09
*** timl0101 has joined #openstack-infra03:10
*** thorst has quit IRC03:11
*** kjorgensen has quit IRC03:12
*** amitgandhinz has quit IRC03:16
*** vhosakot has quit IRC03:17
timrcclarkb: Ah okay.03:18
timrcI need something similar to the wsgi app os_loganalyze provides but for more generic Things.03:18
*** wanghua has joined #openstack-infra03:18
wanghuahi all, I am deploying a CI in my local env. I have a question, it is necessary to depoly nodepool and jenkins master in one node?03:23
*** fbo has quit IRC03:23
*** fbo has joined #openstack-infra03:25
*** rfolco has quit IRC03:26
openstackgerritTony Breeds proposed openstack-infra/project-config: Sort the freeze_venv output  https://review.openstack.org/30979303:27
*** coreyob has quit IRC03:28
*** jamielennox is now known as jamielennox|away03:28
*** baoli has joined #openstack-infra03:31
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Fix ssl_key relationships  https://review.openstack.org/31231803:33
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Upgrade to Mitaka  https://review.openstack.org/31231903:33
*** fbo has quit IRC03:36
crinkleclarkb: i finished working out the kinks that i was finding last week ^03:37
*** jamielennox|away is now known as jamielennox03:37
*** baoli has quit IRC03:37
*** fitoduarte has joined #openstack-infra03:38
*** fbo has joined #openstack-infra03:38
*** cody-somerville has quit IRC03:39
*** tlian has quit IRC03:40
*** jaosorior has quit IRC03:51
*** markvoelker has joined #openstack-infra03:52
*** fedexo has joined #openstack-infra03:54
*** yamamoto has joined #openstack-infra03:57
*** markvoelker has quit IRC03:57
*** e0ne has joined #openstack-infra03:59
*** nadya has joined #openstack-infra03:59
*** e0ne has quit IRC04:01
*** e0ne has joined #openstack-infra04:02
*** nadya has quit IRC04:04
*** e0ne has quit IRC04:05
*** jaosorior has joined #openstack-infra04:06
*** yamamoto has quit IRC04:09
*** thorst has joined #openstack-infra04:09
*** timl0101 has quit IRC04:10
*** thorst has quit IRC04:16
*** amitgandhinz has joined #openstack-infra04:17
*** Hal has joined #openstack-infra04:17
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Upgrade to Mitaka  https://review.openstack.org/31231904:17
*** Hal is now known as Guest9985104:18
*** fedexo has quit IRC04:20
*** amitgandhinz has quit IRC04:21
*** tphummel has joined #openstack-infra04:22
*** sputnik13 has quit IRC04:23
*** yamamoto has joined #openstack-infra04:24
*** links has joined #openstack-infra04:25
*** yamamoto has quit IRC04:26
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Add support for sqlalchemy reporter  https://review.openstack.org/22333304:29
*** yamamoto has joined #openstack-infra04:30
*** fedexo has joined #openstack-infra04:31
*** psachin has joined #openstack-infra04:31
*** yamamoto has quit IRC04:36
*** oanson has joined #openstack-infra04:38
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Add support for sqlalchemy reporter  https://review.openstack.org/22333304:40
*** dimtruck is now known as zz_dimtruck04:43
*** kaisers1 has left #openstack-infra04:44
*** amit213 has quit IRC04:44
*** asettle has joined #openstack-infra04:45
*** harlowja_at_home has joined #openstack-infra04:46
*** kaisers has quit IRC04:47
*** amitgandhinz has joined #openstack-infra04:47
*** asettle has quit IRC04:50
*** kaisers has joined #openstack-infra04:52
*** asettle has joined #openstack-infra04:54
*** amitgandhinz has quit IRC04:55
*** flwang1 has quit IRC04:59
*** sflanigan has quit IRC05:01
*** savihou has joined #openstack-infra05:01
*** harlowja_at_home has quit IRC05:02
*** sflanigan has joined #openstack-infra05:05
*** sflanigan has joined #openstack-infra05:05
*** thorst has joined #openstack-infra05:14
*** yolanda has joined #openstack-infra05:16
*** bnemec has quit IRC05:17
*** Guest99851 has quit IRC05:19
*** thorst has quit IRC05:21
*** akscram has quit IRC05:26
*** akscram has joined #openstack-infra05:28
openstackgerritColleen Murphy proposed openstack/diskimage-builder: Fix OpenSUSE support  https://review.openstack.org/31232505:28
*** ayoung has quit IRC05:31
*** kzaitsev_mb has joined #openstack-infra05:31
*** yamamoto has joined #openstack-infra05:37
openstackgerritfumihiko kakuma proposed openstack-infra/devstack-gate: Use local.conf instead of localrc in devstack configuration  https://review.openstack.org/31166805:39
*** jamielennox is now known as jamielennox|away05:40
*** mnaser has quit IRC05:41
*** yamamoto has quit IRC05:45
*** oanson has quit IRC05:46
openstackgerritMerged openstack-infra/project-config: Add job validation and latest link to magnum image upload  https://review.openstack.org/30832305:48
*** nadya has joined #openstack-infra05:49
*** netsin has quit IRC05:49
*** Sukhdev has joined #openstack-infra05:49
*** mnaser has joined #openstack-infra05:49
*** nadya has quit IRC05:50
*** amitgandhinz has joined #openstack-infra05:51
*** nadya has joined #openstack-infra05:54
openstackgerritMerged openstack-infra/project-config: Sort the freeze_venv output  https://review.openstack.org/30979305:54
*** amitgandhinz has quit IRC05:56
*** oanson has joined #openstack-infra05:59
openstackgerritMerged openstack-infra/puppet-ssh: Allow root logins from localhost  https://review.openstack.org/31206405:59
*** abregman has joined #openstack-infra06:00
*** nelsnelson has joined #openstack-infra06:03
*** nelsnels_ has quit IRC06:04
*** kzaitsev_mb has quit IRC06:04
*** david-lyle has quit IRC06:05
openstackgerritMerged openstack-infra/project-config: Add ceph-deb-hammer.list to both trusty and xenial  https://review.openstack.org/31216106:06
*** jaosorior_ has joined #openstack-infra06:07
*** savihou has quit IRC06:07
*** salv-orlando has joined #openstack-infra06:07
*** savihou has joined #openstack-infra06:07
*** jaosorior has quit IRC06:07
*** kjorgensen has joined #openstack-infra06:09
*** kzaitsev_mb has joined #openstack-infra06:09
openstackgerritMerged openstack-infra/project-config: Add manila-specs repo  https://review.openstack.org/31185306:11
*** jaosorior_ has quit IRC06:13
*** kjorgensen has quit IRC06:14
*** javeriak has joined #openstack-infra06:15
*** tphummel has quit IRC06:16
*** jaosorior_ has joined #openstack-infra06:17
*** openstackgerrit has quit IRC06:17
*** openstackgerrit has joined #openstack-infra06:18
*** thorst has joined #openstack-infra06:18
*** Sukhdev has quit IRC06:19
*** jaosorior_ is now known as jaosorior06:20
*** javeriak has quit IRC06:21
*** javeriak has joined #openstack-infra06:21
*** ccamacho has joined #openstack-infra06:22
*** jyuso has quit IRC06:24
*** thorst has quit IRC06:26
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Revert "Finished: Update deprecated commands in tripleo.sh (Old heat * calls)"  https://review.openstack.org/31232906:27
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/30927306:27
*** bradm_ has joined #openstack-infra06:28
yolandagood morning06:28
yolandaAJaeger, care reviewing https://review.openstack.org/312114 and https://review.openstack.org/312120 ?06:28
*** kzaitsev_mb has quit IRC06:29
*** rkukura has quit IRC06:31
*** sflanigan has quit IRC06:32
*** sflanigan has joined #openstack-infra06:33
*** sflanigan has joined #openstack-infra06:33
*** dizquierdo has joined #openstack-infra06:35
*** salv-orlando has quit IRC06:36
*** HeOS has joined #openstack-infra06:37
*** eliqiao has quit IRC06:38
*** eliqiao has joined #openstack-infra06:38
*** nadya has quit IRC06:39
*** vgridnev has joined #openstack-infra06:40
*** rkukura has joined #openstack-infra06:41
*** e0ne has joined #openstack-infra06:41
*** sputnik13 has joined #openstack-infra06:49
*** savihou has quit IRC06:52
*** amitgandhinz has joined #openstack-infra06:52
*** markvoelker has joined #openstack-infra06:54
*** sputnik13 has quit IRC06:55
*** oanson has quit IRC06:56
openstackgerritIvan Kolodyazhny proposed openstack/requirements: Add global requirement update on python-brick-cinderclient-ext project  https://review.openstack.org/30908406:56
*** sputnik13 has joined #openstack-infra06:56
*** amitgandhinz has quit IRC06:57
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Add support for sqlalchemy reporter  https://review.openstack.org/22333307:00
*** markvoelker has quit IRC07:00
*** tesseract has joined #openstack-infra07:01
*** tesseract is now known as Guest2331907:01
*** bradm_ has quit IRC07:07
*** Nikolay_St has joined #openstack-infra07:07
*** sputnik13 has quit IRC07:09
*** arxcruz has joined #openstack-infra07:09
*** yaume has joined #openstack-infra07:09
Nikolay_Stfungi: AJaeger hi. does community has any plans to update mysql version from 5.5 to 5.6 in gates?07:09
*** yaume has quit IRC07:14
*** matrohon has joined #openstack-infra07:14
abregmanmordred: hi. here?07:16
*** yaume has joined #openstack-infra07:17
*** rossella_s has joined #openstack-infra07:18
*** zeih has joined #openstack-infra07:21
*** jamielennox|away is now known as jamielennox07:22
*** ifarkas has joined #openstack-infra07:22
*** yolanda has quit IRC07:23
*** thorst has joined #openstack-infra07:24
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Lower the log level in tests  https://review.openstack.org/26336407:24
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Add support for sqlalchemy reporter  https://review.openstack.org/22333307:24
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Lower the log level in tests  https://review.openstack.org/26336407:26
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Add support for sqlalchemy reporter  https://review.openstack.org/22333307:26
*** savihou has joined #openstack-infra07:27
*** thorst has quit IRC07:31
*** yolanda has joined #openstack-infra07:32
*** salv-orlando has joined #openstack-infra07:36
*** jaosorior has quit IRC07:37
*** jaosorior has joined #openstack-infra07:37
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch  https://review.openstack.org/31235007:39
*** mikelk has joined #openstack-infra07:39
*** salv-orlando has quit IRC07:41
*** tlian has joined #openstack-infra07:43
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch  https://review.openstack.org/31235007:44
*** infra-red has joined #openstack-infra07:44
*** infra-red has quit IRC07:44
openstackgerritIvan Kolodyazhny proposed openstack/requirements: Add watchdog to global-requirements  https://review.openstack.org/31117307:45
*** nadya has joined #openstack-infra07:45
*** toabctl has quit IRC07:48
*** mkwiek has quit IRC07:48
*** mkwiek has joined #openstack-infra07:48
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch  https://review.openstack.org/31235007:48
*** ayoung has joined #openstack-infra07:49
*** toabctl has joined #openstack-infra07:52
*** amitgandhinz has joined #openstack-infra07:53
*** dmk0202 has joined #openstack-infra07:54
*** jlanoux has joined #openstack-infra07:55
*** shardy has joined #openstack-infra07:56
lennybHi Infra, is something wrong with the git? I am getting internal error #link http://paste.openstack.org/show/496032/07:56
*** kzaitsev_mb has joined #openstack-infra07:58
*** amitgandhinz has quit IRC07:58
*** gildub has quit IRC07:58
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-infra08:00
*** kushal has joined #openstack-infra08:01
*** jaosorior_ has joined #openstack-infra08:04
*** javeriak has quit IRC08:06
*** jaosorior has quit IRC08:07
*** tlian2 has joined #openstack-infra08:09
*** tlian has quit IRC08:10
*** yamahata has quit IRC08:11
*** xarses has quit IRC08:11
*** jaosorior_ is now known as jaosorior08:11
*** matrohon has quit IRC08:11
openstackgerrityolanda.robla proposed openstack/requirements: Upgrade betamax version  https://review.openstack.org/31236408:13
*** nmagnezi_ has joined #openstack-infra08:14
*** dingyichen has quit IRC08:21
*** hashar has joined #openstack-infra08:21
*** ilyashakhat has quit IRC08:21
*** javeriak has joined #openstack-infra08:21
*** oanson has joined #openstack-infra08:23
*** jistr has joined #openstack-infra08:24
*** lennyb has quit IRC08:24
*** jyuso has joined #openstack-infra08:24
*** fedexo has quit IRC08:26
*** thorst has joined #openstack-infra08:29
*** markus_z has joined #openstack-infra08:33
toabctlis the pypi mirroring working again?08:35
*** thorst has quit IRC08:36
*** salv-orlando has joined #openstack-infra08:38
*** chem has joined #openstack-infra08:41
*** salv-orlando has quit IRC08:42
*** zeih has quit IRC08:43
*** mhu has joined #openstack-infra08:45
*** xarses has joined #openstack-infra08:46
*** yamahata has joined #openstack-infra08:46
*** eezhova has quit IRC08:50
*** markvoelker has joined #openstack-infra08:50
*** amitgandhinz has joined #openstack-infra08:54
*** markvoelker has quit IRC08:55
*** zeih has joined #openstack-infra08:55
*** derekh has joined #openstack-infra08:56
*** jordanP has joined #openstack-infra08:58
*** amitgandhinz has quit IRC08:58
*** electrofelix has joined #openstack-infra09:01
*** javeriak has quit IRC09:03
*** |-paul-| has joined #openstack-infra09:05
*** zhurong has quit IRC09:10
*** zeih has quit IRC09:12
*** peterlisak has quit IRC09:13
*** zhurong has joined #openstack-infra09:13
*** asettle has quit IRC09:13
*** zhurong has quit IRC09:13
*** asettle has joined #openstack-infra09:14
*** peterlisak has joined #openstack-infra09:15
openstackgerritMerged openstack-infra/tripleo-ci: Don't remove the instack.qcow2 image  https://review.openstack.org/31228109:15
*** asettle has quit IRC09:18
*** asettle has joined #openstack-infra09:19
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Use the overcloud full images from the cache  https://review.openstack.org/31239709:21
openstackgerrityolanda.robla proposed openstack-infra/shade: Use keystoneauth1.betamax for shade mocks  https://review.openstack.org/29864709:23
*** zeih has joined #openstack-infra09:25
*** yamamoto has joined #openstack-infra09:28
*** thorst has joined #openstack-infra09:33
*** sdague has joined #openstack-infra09:33
*** yamamoto has quit IRC09:34
*** daemontool has joined #openstack-infra09:35
*** zeih has quit IRC09:35
*** yolanda has quit IRC09:36
*** sshnaidm has quit IRC09:37
*** salv-orlando has joined #openstack-infra09:38
*** yolanda has joined #openstack-infra09:41
*** thorst has quit IRC09:41
*** DevBox has quit IRC09:43
*** salv-orlando has quit IRC09:43
*** yamamoto has joined #openstack-infra09:44
*** javeriak has joined #openstack-infra09:45
*** peterlisak13 has joined #openstack-infra09:45
*** yamamoto has quit IRC09:50
*** tosky has joined #openstack-infra09:50
*** szaher has joined #openstack-infra09:54
*** amitgandhinz has joined #openstack-infra09:54
*** flwang has quit IRC09:54
*** vdrok_ is now known as vdrok09:55
szaherHi guys I have this patch https://review.openstack.org/#/c/300080/ which passed the CI tests and got +2 and +A and it isn't merged any ideas how to solve that ?09:55
*** peterlisak13 has quit IRC09:56
*** nadya has quit IRC09:57
*** nadya has joined #openstack-infra09:58
*** dmk0202 has quit IRC09:59
*** amitgandhinz has quit IRC09:59
rcarrillocruzszaher: your patch depends on other patch that has not merged yet10:00
rcarrillocruzin particular, https://review.openstack.org/#/c/300070/10:00
rcarrillocruzcheck in your patch the 'Depends-On' header, you'll see the link to the dependency10:01
szaheroh Thanks10:01
*** nadya has quit IRC10:02
rcarrillocruznp10:02
*** vikram has joined #openstack-infra10:04
*** e0ne has quit IRC10:06
*** e0ne has joined #openstack-infra10:06
*** _amrith_ is now known as amrith10:08
*** flwang has joined #openstack-infra10:08
*** nmagnezi_ has quit IRC10:10
*** dizquierdo has quit IRC10:17
*** zeih has joined #openstack-infra10:20
*** yamamoto has joined #openstack-infra10:21
*** nadya has joined #openstack-infra10:23
*** sshnaidm has joined #openstack-infra10:25
*** nmagnezi_ has joined #openstack-infra10:25
dimsAJaeger : for https://review.openstack.org/#/c/312291/ - yes i don't need the database portions10:26
*** vikram has quit IRC10:30
*** apuimedo has joined #openstack-infra10:33
*** yolanda has quit IRC10:33
*** lennyb has joined #openstack-infra10:34
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch  https://review.openstack.org/31235010:35
*** gildub has joined #openstack-infra10:35
*** oanson has quit IRC10:36
*** yolanda has joined #openstack-infra10:38
*** thorst has joined #openstack-infra10:39
*** salv-orlando has joined #openstack-infra10:40
*** links has quit IRC10:45
*** salv-orlando has quit IRC10:45
*** thorst has quit IRC10:46
apuimedodhellmann: ping10:48
openstackgerrityolanda.robla proposed openstack-infra/project-config: fix typo in magnum image validation  https://review.openstack.org/31244410:50
*** yottatsa has joined #openstack-infra10:54
*** amitgandhinz has joined #openstack-infra10:55
*** nadya has quit IRC10:56
*** lucasagomes is now known as lucas-hungry10:56
*** weshay has quit IRC10:56
*** baoli has joined #openstack-infra10:57
*** baoli has quit IRC10:57
*** baoli has joined #openstack-infra10:57
*** david-lyle has joined #openstack-infra10:58
*** baoli has quit IRC10:58
*** amitgandhinz has quit IRC11:00
*** nadya has joined #openstack-infra11:01
openstackgerritMerged openstack-infra/tripleo-ci: Revert "Finished: Update deprecated commands in tripleo.sh (Old heat * calls)"  https://review.openstack.org/31232911:05
*** asettle has quit IRC11:08
*** kushal has quit IRC11:08
*** asettle has joined #openstack-infra11:08
*** jaosorior has quit IRC11:10
*** jaosorior has joined #openstack-infra11:10
*** chmouel has left #openstack-infra11:12
*** ccamacho is now known as ccamacho|include11:15
*** ccamacho|include is now known as ccamacho|getting11:16
*** rodrigods has quit IRC11:16
*** rodrigods has joined #openstack-infra11:16
*** ccamacho|getting is now known as ccamacho|coffee11:16
*** deadnull_ has joined #openstack-infra11:19
openstackgerritHenry Gessau proposed openstack-infra/project-config: Fix neutron periodic jobs time series request  https://review.openstack.org/31245611:21
*** yamamoto has quit IRC11:22
*** yamamoto has joined #openstack-infra11:25
*** daemontool has quit IRC11:27
*** ldnunes has joined #openstack-infra11:28
*** yottatsa_ has joined #openstack-infra11:28
*** yottatsa has quit IRC11:29
openstackgerritMerged openstack-infra/tripleo-ci: Add aodh endpoints to enable-tls  https://review.openstack.org/31183311:30
*** banix has joined #openstack-infra11:33
*** javeriak has quit IRC11:33
*** javeriak has joined #openstack-infra11:33
*** esikachev has joined #openstack-infra11:34
*** rhallisey has joined #openstack-infra11:40
*** salv-orlando has joined #openstack-infra11:40
*** amrith is now known as _amrith_11:42
*** aysyd has joined #openstack-infra11:43
*** banix has quit IRC11:45
*** deadnull_ is now known as _deadnull11:45
*** salv-orlando has quit IRC11:46
*** thorst has joined #openstack-infra11:51
*** Hal has joined #openstack-infra11:53
*** Hal is now known as Guest1291211:53
*** weshay has joined #openstack-infra11:54
*** yamahata has quit IRC11:54
*** lucas-hungry is now known as lucasagomes11:55
*** amitgandhinz has joined #openstack-infra11:56
*** oanson has joined #openstack-infra11:58
*** _deadnull is now known as deadnull_11:59
*** wajdi has joined #openstack-infra11:59
*** links has joined #openstack-infra11:59
*** amitgandhinz has quit IRC12:00
*** ccamacho|coffee is now known as ccamacho12:03
*** coreyob has joined #openstack-infra12:04
*** markvoelker has joined #openstack-infra12:04
*** e0ne has quit IRC12:05
*** sree has joined #openstack-infra12:05
*** rfolco has joined #openstack-infra12:09
*** kushal has joined #openstack-infra12:09
*** matrohon has joined #openstack-infra12:10
*** jaypipes has joined #openstack-infra12:11
*** javeriak has quit IRC12:12
*** psilvad has joined #openstack-infra12:12
*** davidlenwell has quit IRC12:13
*** davidlenwell has joined #openstack-infra12:15
*** dprince has joined #openstack-infra12:17
*** psilvad has quit IRC12:17
*** timl0101 has joined #openstack-infra12:17
*** burgerk has joined #openstack-infra12:19
*** psilvad has joined #openstack-infra12:21
*** e0ne has joined #openstack-infra12:22
*** kgiusti has joined #openstack-infra12:22
*** deadnul__ has joined #openstack-infra12:24
*** asettle has quit IRC12:26
*** psilvad has quit IRC12:27
*** doug-fish has joined #openstack-infra12:27
*** wajdi has quit IRC12:27
*** burgerk has quit IRC12:27
*** deadnull_ has quit IRC12:27
*** psilvad has joined #openstack-infra12:27
*** peterlisak13 has joined #openstack-infra12:28
*** eharney has quit IRC12:29
*** peterlisak13 has quit IRC12:29
*** yamamoto has quit IRC12:30
pabelangermorning12:30
*** yamamoto has joined #openstack-infra12:31
*** psilvad has quit IRC12:32
*** psilvad has joined #openstack-infra12:32
rcarrillocruzo/12:33
*** pradk has quit IRC12:34
odyssey4meI've been seeing intermittent DNS solution failures of review.openstack.org during and after the summit. Is this something others are seeing?12:37
*** baoli has joined #openstack-infra12:38
*** signed8bit has joined #openstack-infra12:38
*** baoli_ has joined #openstack-infra12:40
EmilienMmorning!12:41
*** salv-orlando has joined #openstack-infra12:41
*** baoli has quit IRC12:43
*** fitoduarte has quit IRC12:45
*** docaedo2 has quit IRC12:45
*** matt-borland has joined #openstack-infra12:46
*** trown|outtypewww is now known as trown12:46
*** salv-orlando has quit IRC12:46
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch  https://review.openstack.org/31235012:46
*** links has quit IRC12:46
*** julim has joined #openstack-infra12:47
*** jsavak has joined #openstack-infra12:49
*** eharney has joined #openstack-infra12:49
*** jheroux has joined #openstack-infra12:50
*** akshai has joined #openstack-infra12:55
*** nadya has quit IRC12:55
openstackgerritSylwester Brzeczkowski proposed openstack-infra/project-config: Add fuel-extension-volume-manager project  https://review.openstack.org/31248712:56
*** andymaier has joined #openstack-infra12:56
*** nadya has joined #openstack-infra12:56
*** _amrith_ is now known as amrith12:57
*** amitgandhinz has joined #openstack-infra12:57
dhellmannapuimedo : pong12:58
*** jsavak has quit IRC12:58
openstackgerritLucas Dutra Nunes proposed openstack-infra/jenkins-job-builder: builders: update cmake to match CMake plugin versions 2.x  https://review.openstack.org/27975412:59
*** jsavak has joined #openstack-infra12:59
*** anteaya has joined #openstack-infra12:59
openstackgerritMerged openstack-infra/project-config: Install constrainted version of babel  https://review.openstack.org/30980913:00
*** Goneri has joined #openstack-infra13:00
apuimedodhellmann: could you take a look at https://review.openstack.org/#/c/312474/13:00
apuimedoIn Kuryr we have several integrations and I'm proposing this to have separate setup.py setup.cfg per integration (I'll also have separate requirements.txt probably13:01
apuimedothat's the only idea I had to avoid repository splitting13:01
apuimedoI thought you and lifeless may have some other idea13:01
apuimedoor advice13:01
dhellmannapuimedo : my advice is to create a separate repository for each thing. Most of the rest of the tools in our system assume that's how you're organized.13:01
*** amitgandhinz has quit IRC13:02
pabelanger++13:02
*** javeriak has joined #openstack-infra13:02
apuimedodhellmann: that's what I feared :P13:02
dhellmannapuimedo : we have some tools in oslo that we can use to help you extract only the files related to the lib, while holding their history, but it would also be relatively simple to clone what you have and delete the parts you don't want13:02
*** kushal has quit IRC13:03
apuimedowe'll have to abandon the comfort of a single repo, single community then :P13:03
dhellmannapuimedo : we have lots and lots of teams that work across multiple repositories13:03
apuimedodhellmann: yeah... I did this splitting for one internal thing some time ago13:03
dhellmannalmost all of them, in fact13:03
apuimedobut I did it manually13:03
*** abregman is now known as abregman|mtg13:03
apuimedodhellmann: the thing I don't like is that it's not possible to have github.com/openstack/kuryr/libnetwork13:04
apuimedo(one of the things)13:04
*** ddieterly has joined #openstack-infra13:04
*** |-paul-| has quit IRC13:04
dhellmannyou will probably want to make a better name than "libnetwork" in any case. that's not very descriptive, and likely to clash with other people's work on completely separate things13:04
mordredapuimedo: yah. it's one of the downsides to us replicating to github13:04
pabelangerproject-config-core: wouldn't mind a review of https://review.openstack.org/#/c/312239/ and https://review.openstack.org/#/c/312248 to enable ubuntu-precise builds in nodepool.  It will eventually be used to replace bare-precise (which is only launching on rax).13:05
apuimedodhellmann: it's a docker libnetwork driver13:05
apuimedoso the name would be kuryr.libnetwork13:05
apuimedokuryr.core13:05
apuimedokuryr.cni13:05
apuimedoetc13:05
dhellmannok13:07
yolandahi pabelanger, what's up with pypi mirror, you know? i see no process running, release finished, but still no updates on the mirror. And bandersnatch may be locked right?13:07
pabelangeryolanda: I believe we are waiting for jeblair to provide some input. I don't believe fungi restarted the process last night because we seen some AFS errors on the far side mirror13:08
pabelangeryolanda: there have been discussions to switch to the RW mirror if needed13:08
*** salv-orlando has joined #openstack-infra13:09
*** krotscheck_dcm is now known as krotscheck13:10
*** esikachev has quit IRC13:10
*** burgerk has joined #openstack-infra13:10
yolandapabelanger, thanks. If that's going to take time it can be a good idea so we don't block people13:13
openstackgerritVictor Stinner proposed openstack-infra/project-config: Make gate-murano-python34-db voting; add gate job  https://review.openstack.org/31249313:13
*** salv-orlando has quit IRC13:13
*** asettle has joined #openstack-infra13:14
pabelangeryolanda: personally, I think we're good for this week. It is the week after the summit after all. Still early in the newton release to have some bumps along the way13:15
*** ifarkas has quit IRC13:15
anteayawanghua: I believe that it is not required to deploy both nodepool and jenkins master on the same node13:16
*** mriedem has joined #openstack-infra13:16
rcarrillocruzanteaya is right, not required13:17
rcarrillocruzwanghua: ^13:17
anteayawanghua: if you are using the http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/ module, many services are deployed on one node for minimization of resource use13:17
anteayarcarrillocruz: thanks for the confirmation :)13:17
anteayaI believe zuul and gearman need to be on the same node13:18
anteayaand jenkins and a gearman slave13:18
anteayaneed to share a node13:18
*** asettle has quit IRC13:19
openstackgerritPaul Belanger proposed openstack-infra/system-config: Replace wget with curl  https://review.openstack.org/31249513:19
pabelangerAJaeger: if we want to go that path ^13:19
yolandapabelanger, i personally have a patch that needs a new release on pypi mirror, but can wait for a week13:19
*** armax has quit IRC13:19
wanghuaanteaya: Thank you13:19
anteayawanghua: thanks for asking13:19
*** mixos has joined #openstack-infra13:20
*** armax has joined #openstack-infra13:20
pabelangeryolanda: Ya, at this point the release team is also taking a week off, until openstack-infra and address the mirror issue.13:20
anteayaNikolay_St: I don't know of any conversation to upgrate the the mysql version in the gate from 5.5 to 5.6, when we begin testing with new versions of operating systems we usually begin with whatever versions are packaged by the operating system distribution13:22
*** xyang1 has joined #openstack-infra13:22
anteayaabregman|mtg: hello, nice to see you13:23
AJaegerpabelanger: I don't know what's better - and I'm busy for the next hours... So, I let others look at that. Thanks for the change.13:23
anteayaabregman|mtg: mordred is rarely online at 0700 utc but you never know, was there something someone else could help you with?13:24
*** mixos has quit IRC13:24
anteayalennyb: hello13:24
*** fitoduarte has joined #openstack-infra13:25
anteayalennyb: I haven't see that error before, are you still experiencing http://paste.openstack.org/show/496032/13:25
pabelangerAJaeger: WFM13:25
abregman|mtganteaya: hi Anita :), I head mordred was mentioning in the summit, openstack infra is looking for a way to detect which projects using a specific library, so I created something: https://github.com/bregman-arie/miko13:25
anteayaabregman|mtg: awesome!13:26
*** tonytan4ever has joined #openstack-infra13:26
anteayaabregman|mtg: you know who might really enjoy this? dims and dhellmann ^^13:26
anteayawell in addition to mordred13:26
abregman|mtganteaya, dims, dhellmann: great. so I wanted to check with him if that's the right direction or he meant something else. so any feedback would be great.13:27
*** esikachev has joined #openstack-infra13:27
anteayaabregman|mtg: fantastic thank you for listening and building a thing13:28
*** electrofelix has quit IRC13:28
dimsabregman|mtg : nice!13:28
anteayaabregman|mtg: you are doing a good job of sticking around in channel so hopefully folks with feedback can find you13:28
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Get translation jobs into healthcheck  https://review.openstack.org/31145913:28
mordredabregman|mtg: neat! looks great13:28
mordredabregman|mtg: feature request ...13:28
dimslol here we go mordred :)13:28
mordredabregman|mtg: a bunch of us have copies of all of the git repos locally already - it would be neat if you could point it at a directory of git repos and have the tool not need to hit github apis13:29
dimstransitive dependencies would be great on my list abregman|mtg13:29
*** hdaniel has joined #openstack-infra13:29
mordred(for people who have all the repos cloned, I think that would make it go much faster)13:29
dhellmannmordred : look at openstack/aeromancer -- that works that way13:29
abregman|mtghdaniel: " a bunch of us have copies of all of the git repos locally already - it would be neat if you could point it at a directory of git repos and have the tool not need to hit github apis"13:29
*** ifarkas has joined #openstack-infra13:29
*** esker has quit IRC13:29
abregman|mtghdaniel:13:29
abregman|mtghdaniel: "transitive dependencies would be great on my list "13:30
abregman|mtgmordred, dims: great!, we'll do it.13:30
anteayaodyssey4me: I haven't seen other people report seeing intermittent DNS solution failures of review.openstack.org during and after the summit13:30
dimsdhellmann : cool, i hadn't seen this before13:30
anteayaodyssey4me: if you are able to provide any additional data on what you are seeing, that would be helpful13:31
*** electrofelix has joined #openstack-infra13:31
dhellmanndims : it was mostly preempted by http://codesearch.openstack.org/13:31
dimsright dhellmann13:31
* dhellmann drops offline to take the car to the shop13:31
*** inc0 has joined #openstack-infra13:31
hdanielabregman|mtg, mordred: we did some testing with miko - there are ~800 projects. does everyone have it locally available ?13:32
anteayadhellmann: I hope it goes well13:32
anteayahdaniel: not everyone, but many13:32
anteayahdaniel: it would need to be optional13:32
openstackgerritMerged openstack-infra/project-config: fix typo in magnum image validation  https://review.openstack.org/31244413:33
*** BigWillie has joined #openstack-infra13:33
dimsabregman|mtg : hdaniel : for a practical problem, when i review bot proposed updates to upper constraints (example latest run - https://review.openstack.org/#/c/309273/13/upper-constraints.txt), new libraries popup and i have to manually figure out which library/version ended up pulling the new libraries.13:34
hdanielanteaya: ack  - putting it on a todo list13:34
*** gildub has quit IRC13:35
openstackgerritMerged openstack-infra/project-config: Remove keystone2+magnum job  https://review.openstack.org/31211413:35
*** nadya has quit IRC13:37
odyssey4meanteaya I haven't done much in the way of diagnostics. I'll try and gather some data next time around.13:37
*** oanson has quit IRC13:37
*** dkehn__ has joined #openstack-infra13:37
*** dkehn_ has quit IRC13:39
openstackgerritVitaly Gridnev proposed openstack-infra/project-config: [sahara] return acls for sahara-tests  https://review.openstack.org/31250313:41
mordredinfra-root, Shrews: it's well past time to cut 1.8.0 of shade. it's been effectively running in prod for 2 weeks now13:42
mordredany last minute concerns before I push a tag?13:43
hdanieldims, abregman|mtg: just making sure we're on the same page - did you mean that you need to figure out the new libraries, not the libraries version bump, right ?13:43
Shrewsmordred: none that i can recall post-conference13:43
yolandamordred, fine for me13:43
dimshdaniel : yep, we can start there13:44
anteayaodyssey4me: understood, thank you13:44
anteayahdaniel: thank you13:44
hdanieldims, anteaya: cool, np13:44
anteayahdaniel: if I can make the suggestion, use a config file that states a list of sources in decending order of preference, if the file doesn't exist or the repo isn't found at each of the sources, pull from default location13:45
*** yamamoto has quit IRC13:45
openstackgerrityolanda.robla proposed openstack-infra/project-config: Move shade+magnum neutron job to non-voting  https://review.openstack.org/31212013:46
*** d0ugal has quit IRC13:46
*** d0ugal has joined #openstack-infra13:47
openstackgerritMerged openstack-infra/project-config: Remove unused maven-package and maven-test  https://review.openstack.org/31113013:47
*** sdake has joined #openstack-infra13:48
*** sdake has quit IRC13:48
pabelangermordred: I'd would also not object to tagging nodepool if shade has stablized13:49
openstackgerritMerged openstack-infra/project-config: add xenial to the integration tests for openstack-chef projects  https://review.openstack.org/31091913:50
openstackgerritMerged openstack-infra/project-config: Allow tox targets that need sudo (functional jobs)  https://review.openstack.org/31229113:51
*** electrofelix has quit IRC13:52
*** electrofelix has joined #openstack-infra13:52
hdanielanteaya: I guess that'd mean a list of 2 tuples  [(local_dir, remote_path), ....] or something like that13:52
flip214trying to edit https://wiki.openstack.org/w/index.php?title=CinderSupportMatrix&action=submit I don't see any captcha displayed (in desktop mode; in mobile mode, the image href is broken)13:53
openstackgerritAlexey Weyl proposed openstack-infra/irc-meetings: Change time and irc channel  https://review.openstack.org/31250913:53
*** savihou has quit IRC13:53
smcginnisflip214: Check on the top of the page. Should just be a question with a textbox.13:54
*** savihou has joined #openstack-infra13:55
*** pt_15 has joined #openstack-infra13:55
flip214smcginnis: thanks. sorry, didn't check that the question *is* the image.13:55
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add release note doc to dev guide  https://review.openstack.org/31251013:55
anteayahdaniel: something like that, openstack-client-config goes looking for config files in a few places in order to find its yaml, it might be worth looking at13:55
smcginnisflip214: A little different than normal. ;)13:55
flip214with mobile I just got the "broken image" in my browser, therefore I didn't look.13:55
*** sigmavirus24_awa is now known as sigmavirus2413:56
anteayahdaniel: http://git.openstack.org/cgit/openstack/os-client-config/tree/13:56
flip214smcginnis: thanks!13:56
smcginnisflip214: No problem!13:56
anteayaflip214: I believe we disabled moblie wiki edits13:57
*** electrofelix has quit IRC13:57
pt_15Hi! I have been trying to submit a patch for the Solum dashboard - https://review.openstack.org/#/c/289021/ and i am running into a problem with the pbr version requirement. Can someone pls help me with this? :)13:57
anteayathe spammers were using mobile and getting around the captcha13:57
*** electrofelix has joined #openstack-infra13:57
*** amitgandhinz has joined #openstack-infra13:57
pt_15What i noticed till now was that if i change the requirement in my .tox folder and run the pep8 test locally, the test succeeds, but the pep8 gate in jenkins is still failing, showing the same problem as earlier13:59
*** hdd has joined #openstack-infra14:00
*** javeriak has quit IRC14:00
*** javeriak has joined #openstack-infra14:00
*** pilgrimstack1 has quit IRC14:01
*** jtomasek has quit IRC14:02
*** amitgandhinz has quit IRC14:03
*** jtomasek has joined #openstack-infra14:04
*** _ari_ has joined #openstack-infra14:04
*** xarses has quit IRC14:05
*** sdake has joined #openstack-infra14:06
*** mugsie has joined #openstack-infra14:06
openstackgerritDan Smith proposed openstack-infra/devstack-gate: WIP: Start up nova-api on the subnode during multinode upgrades  https://review.openstack.org/31222114:07
*** gordc has joined #openstack-infra14:09
*** salv-orlando has joined #openstack-infra14:10
*** pilgrimstack has joined #openstack-infra14:10
pabelangerpt_15: I can reproduce the failure locally14:13
*** dmk0202 has joined #openstack-infra14:14
pabelangerpt_15: I'd resync against openstack/requirements to ensure you have the right dependencies for both requirements.txt and test-requirements.txt14:14
*** zeih has quit IRC14:14
pabelangerpt_15: a quick look at your patch, seems hacking>=0.5.6,<0.8 is the issue14:14
*** rbrndt has joined #openstack-infra14:14
*** salv-orlando has quit IRC14:15
fungiit's their old hacking pin14:15
fungipt_15: you have http://git.openstack.org/cgit/openstack/solum-dashboard/tree/test-requirements.txt#n114:15
openstackgerritJoão Vale proposed openstack-infra/jenkins-job-builder: Add view management functionality  https://review.openstack.org/20617814:15
fungipt_15: which leads to http://git.openstack.org/cgit/openstack-dev/hacking/tree/requirements.txt?h=0.8.1#n114:15
*** mixos has joined #openstack-infra14:16
kzaitsev_mbdoes anyone know who runs data for this page http://www.openstack.org/software/project-navigator ?14:17
kzaitsev_mbthe info there is mostly outdated and I'm looking into finding someone, who knows how to update it )14:17
sdakehey folks, some community folks added kolla-kubernetes to pypi and added openstackci to the groups, but they maded an error of tagging 1.0.0 as the release, rather then 0.0.114:18
sdakecan anyone with openstackci permissions fix it?14:18
anteayakzaitsev_mb: the foundation has a contractor that deals with that page14:18
fungisdake: by "tagging" you mean pushed a release tag to the repo?14:18
anteayakzaitsev_mb: https://bugs.launchpad.net/openstack-org is the best way to communicate with them14:18
fungican't really unwind that safely if so14:18
fungiit's 1.0.0 now14:19
anteayakzaitsev_mb: file a bug14:19
sdakefugnni right14:19
sdakefungi its a totally fresh repo14:19
fungisounds like a nice round number to start from, at least14:19
sdakethe project creator guide says to start from 0.0.114:19
fungisdake: it was tagged before we imported it?14:19
* sdake wishes people would rtfm14:19
*** daemontool has joined #openstack-infra14:19
sdakewe haven't imported it yet14:19
sdakei'm working on that next14:20
sdakeit hasn't been tagged in git14:20
sdakeonly in pypi14:20
* anteaya wished folks would find ways to express themselves that didn't include swearing14:20
kzaitsev_mbanteaya: thanks, would try14:20
*** yamahata has joined #openstack-infra14:20
fungioh! so they only uploaded it to pypi? i can probably delete it from there, _but_ pypi will never let you upload another file with that name14:20
anteayakzaitsev_mb: best of luck, infra really has nothing to do with that page14:20
anteayakzaitsev_mb: I hope they are able to help you14:21
*** tosky has quit IRC14:21
fungipypi lets you delete files (mainly to deal with extreme circumstances like copyright infringement/dmca takedown), but doesn't allow you to reuse them if you do, so it can never have a 1.0.0 release on pypi later14:21
*** bnemec has joined #openstack-infra14:21
* sdake groans14:21
sdakefungi ok thanks for the information14:21
kzaitsev_mbanteaya: I know that it's not run by infra =) was just looking for some pointers, and got perfect ones )14:22
kzaitsev_mbthanks again! )14:22
fungisdake: you could make a note to skip that version number in the future i guess, but it's probably still safer to consider it water under the bridge and start from 1.0.014:22
anteayakzaitsev_mb: yup, thank you :)14:22
fungisdake: when i register projects on pypi, i never upload any files at all. i just set the version number to "0" and the project name. those are the only required fields14:22
sdakefungi so we can still release a 1.0.0 of kolla-kubernetes then?14:22
*** dynarro has joined #openstack-infra14:23
sdakefungi yes I know how to do the job, but someone else in the community did it (incorrectly unfortunately)14:23
fungisdake: i don't actually see any files uploaded at https://pypi.python.org/pypi/kolla-kubernetes so i may be able to just reset the version number there14:23
sdakefungi whatever magic powers you have ot fix it works for me :)14:24
*** salv-orlando has joined #openstack-infra14:24
*** tosky has joined #openstack-infra14:24
fungisdake: yep, looks like that worked14:24
fungisdake: i was confused when you said they "tagged" it14:24
sdakeya wrong term14:25
sdakesorry about confusion there14:25
fungino worries. hopefully you're all set there14:25
*** jaosorior has quit IRC14:25
sdakeyup thanks :)14:25
*** ldnunes has quit IRC14:25
fungiany time!14:25
*** jaosorior has joined #openstack-infra14:25
*** akshai has quit IRC14:26
*** zz_dimtruck is now known as dimtruck14:27
*** fitoduarte has quit IRC14:28
*** mtanino has joined #openstack-infra14:28
*** salv-orlando has quit IRC14:29
*** ldnunes has joined #openstack-infra14:29
EmilienMhi infra, can we have approval on https://review.openstack.org/#/c/311754/ and review on https://review.openstack.org/#/c/301375/ please? thanks14:30
*** jaosorior has quit IRC14:30
*** akshai has joined #openstack-infra14:30
*** BigWillie has quit IRC14:30
*** pradk has joined #openstack-infra14:31
*** ddieterly is now known as ddieterly[away]14:31
*** julim has quit IRC14:32
*** yamamoto has joined #openstack-infra14:32
*** yamamoto has quit IRC14:32
*** flepied has quit IRC14:32
*** dmk0202 has quit IRC14:33
*** Swami has joined #openstack-infra14:33
*** yamamoto has joined #openstack-infra14:33
*** zeih has joined #openstack-infra14:33
*** julim has joined #openstack-infra14:34
*** zeih has quit IRC14:36
*** zeih has joined #openstack-infra14:36
nibalizergood morning14:36
anteayanibalizer: good morning14:36
*** javeriak has quit IRC14:37
nibalizerhow are you anteaya ?14:37
anteayafungi: I'm going to defer to you on https://review.openstack.org/#/c/311754/2 it is a project config patch but changes the run tarball script, I just don't know enough about tarballs to feel comfortable approving14:37
anteayanibalizer: great, thanks, beautiful day here14:37
anteayahappy cat is outside enjoying sunshine14:38
anteayanibalizer: how are you?14:38
nibalizergood, blinking into the morning confused14:38
anteayanibalizer: that can be good14:38
anteayathe option for happiness still exists then14:38
*** dprince has quit IRC14:39
*** ddieterly[away] is now known as ddieterly14:39
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for keystone fernet token race bug 1577558  https://review.openstack.org/31257414:40
openstackbug 1577558 in OpenStack Identity (keystone) "v2.0 fernet tokens audit ids are inconsistent" [High,In progress] https://launchpad.net/bugs/1577558 - Assigned to Lance Bragstad (lbragstad)14:40
anteayanibalizer: thank you14:40
*** m1r4nt15_b0y is now known as d34dh0r5314:44
openstackgerritMerged openstack-infra/project-config: Update puppet logic for run-tarball.sh  https://review.openstack.org/31175414:45
*** signed8bit is now known as signed8bit_Zzz14:46
*** ramishra has quit IRC14:47
*** jamesmcarthur has joined #openstack-infra14:47
pt_15fungi: oh ok, that explains it. Thanks a lot! :D14:48
*** sree has quit IRC14:48
*** ramishra has joined #openstack-infra14:48
*** sree has joined #openstack-infra14:49
*** sshnaidm has quit IRC14:50
*** e0ne has quit IRC14:50
*** jbernard has joined #openstack-infra14:50
anteayazuul's io for xvda and xvdb look odd to me: http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=23&page=214:51
*** jbernard_ has left #openstack-infra14:51
*** amitgandhinz has joined #openstack-infra14:51
openstackgerrityolanda.robla proposed openstack-infra/shade: Move cloud fixtures to independent yaml files  https://review.openstack.org/31257914:52
openstackgerritMerged openstack-infra/elastic-recheck: Add query for keystone fernet token race bug 1577558  https://review.openstack.org/31257414:52
openstackbug 1577558 in OpenStack Identity (keystone) "v2.0 fernet tokens audit ids are inconsistent" [High,In progress] https://launchpad.net/bugs/1577558 - Assigned to Lance Bragstad (lbragstad)14:52
*** yamahata has quit IRC14:52
*** akshai has quit IRC14:53
*** yamahata has joined #openstack-infra14:53
*** esker has joined #openstack-infra14:54
*** salv-orlando has joined #openstack-infra14:54
*** sree has quit IRC14:54
mordredinfra-root, Shrews: ok. I have pushed 1.8.0 of shade14:54
anteayaand it appears we have 8G of space remaining on review..o.o /home/gerrit2 http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2839&rra_id=all14:54
*** akshai has joined #openstack-infra14:54
anteayamordred: congratulations14:54
anteayait appears that static.o.o /srv/static/tar is not reporting to cacti since yesterday: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=1055&rra_id=all14:56
anteayawhat runs on the status.openstack.org server?14:57
*** jamesmcarthur has quit IRC14:58
*** esker has quit IRC14:58
*** esker has joined #openstack-infra14:58
*** salv-orlando has quit IRC14:59
*** jsavak has quit IRC14:59
*** jsavak has joined #openstack-infra15:00
*** yolanda has quit IRC15:00
*** zeih has quit IRC15:00
openstackgerrityolanda.robla proposed openstack-infra/shade: Move cloud fixtures to independent yaml files  https://review.openstack.org/31257915:01
openstackgerritIfat Afek proposed openstack-infra/system-config: Add #openstack-vitrage to meetbot  https://review.openstack.org/31258515:02
*** nmagnezi_ has quit IRC15:02
*** Nikolay_St has quit IRC15:02
*** infra-red has joined #openstack-infra15:02
*** yolanda has joined #openstack-infra15:03
*** asettle has joined #openstack-infra15:03
*** nadya has joined #openstack-infra15:03
*** yamamoto has quit IRC15:04
*** jamesmcarthur has joined #openstack-infra15:05
*** sshnaidm has joined #openstack-infra15:05
dmsimardfyi, just a heads up, we had to temporarily kickban the openstack bot from #rdo because it clashes with the meetbot that we have .. I'll figure something out after our meeting15:05
openstackgerritDan Smith proposed openstack-infra/devstack-gate: WIP: Start up nova-api on the subnode during multinode upgrades  https://review.openstack.org/31222115:06
*** sputnik13 has joined #openstack-infra15:06
*** psachin has quit IRC15:07
*** asettle has quit IRC15:08
*** infra-red has quit IRC15:08
*** kushal has joined #openstack-infra15:08
mordreddmsimard: lovely15:10
*** vgridnev has quit IRC15:10
dmsimardmordred: didn't see that one coming -- thought the "meeting" part was only enabled on openstack-meeting.* channels15:11
dmsimardhow naive :)15:11
*** dizquierdo has joined #openstack-infra15:11
mordred:)15:11
mordreddmsimard: at least it was just conflicting meetings and not like, a runaway bot that deleted all your code ;)15:12
openstackgerritVitaly Gusev proposed openstack-infra/project-config: Add pep8 job to stacklight-integration-tests  https://review.openstack.org/31259015:12
anteayadmsimard: tonyb has patches up to have the meetup only conduct meetings in meeting channels15:12
fungidmsimard: yeah, i think we'd like to find a way to limit meeting features to specific channels, though we likely also need to announce that change when someone figures out how to do that because it's possible some teams have been (incorrectly) holding meetings in their own channels too15:12
*** sputnik13 has quit IRC15:12
anteayadmsimard: I don't know as that code has merged15:13
fungioh! tonyb already figured it out? excellent15:13
fungithat guy is pure genius15:13
anteayayes the patches have been up for about 6 months I think15:13
anteayafungi: he is indeed15:13
*** r-mibu has quit IRC15:13
mordredwe might be bad at reviewing meetbot changes15:13
anteayaI think the hold up was about the deprecation period15:13
*** r-mibu has joined #openstack-infra15:13
anteayafor as you say, folks who hold meetings in non meeting channels15:13
openstackgerrityolanda.robla proposed openstack-infra/shade: Use keystoneauth1.betamax for shade mocks  https://review.openstack.org/29864715:14
anteayabut he coded in warnings for that too15:14
openstackgerrityolanda.robla proposed openstack-infra/project-config: Move shade+magnum neutron job to non-voting  https://review.openstack.org/31212015:14
openstackgerritRyan Hallisey proposed openstack-infra/project-config: Kolla-kubernetes  https://review.openstack.org/31259215:14
*** yolanda has quit IRC15:15
mordredfungi: https://review.openstack.org/#/c/24669515:15
anteayahttps://review.openstack.org/#/q/topic:feature/Offical-channels15:15
openstackgerritTim Laszlo proposed openstack-infra/shade: Add support for server groups  https://review.openstack.org/31223715:15
fungiyeah, so other communities holding non-openstack meetings in their channels (e.g., #rdo) might still get annoyed by the warnings in that case15:16
*** armax has quit IRC15:17
*** yolanda has joined #openstack-infra15:17
anteayafungi: they might yes15:17
fungidmsimard: what was the primary reason for having the meetbot join? it does channel logging and meetings. what specific features of our bots were you actually wanting in #rdo?15:17
dmsimardfungi: logging15:17
fungiokay15:17
dmsimardwith that in mind15:17
dmsimardwe might kick the other meetbot next time15:18
dmsimardas in, we'd move to using the openstack meetbot15:18
*** jamesmcarthur has quit IRC15:18
fungididn't know whether you'd added it when you really just wanted the gerritbot and statusbot features15:18
dmsimardjust didn't have time to think it through, caught us off guard15:18
anteayadmsimard: well the patches that are up would remove the ablitiy for meetings to take place in non -meeting channels15:18
fungiwell, if you want to use the openstack meetbot for meetings, you'd ultimately need to move the meetings to openstack meeting channels15:18
dmsimardfungi: right, cause of that patch15:19
*** dronshaw has joined #openstack-infra15:19
*** Swami_ has joined #openstack-infra15:19
anteayawhich is the direction we want to head15:19
fungii guess unless we designated #rdo as an "official meeting channel" (which would be weird, but it might be a rational corner case anyway)15:19
openstackgerritVitaly Gusev proposed openstack-infra/project-config: Add pep8 job to stacklight-integration-tests  https://review.openstack.org/31259015:19
anteayathe regex matches on -meetings15:19
dmsimardWe'll discuss it after our meeting and see what we want to do, thanks (and sorry for banning the bot, hope it comes back when I unban him)15:19
dmsimardI kicked him and he came back, though, so there's that15:19
fungiyeah, i don't know whether supybot has a configuration option to respect non-ban kicks we just haven't turned on, or whether it's a missing feature15:20
dronshawwould this be the place to discuss stackalytics issues?15:21
fungidronshaw: probably not since we don't officially run stackalytics (yet anyway) nor are we core reviewers for it15:21
*** jamesmcarthur has joined #openstack-infra15:21
*** vhosakot has joined #openstack-infra15:21
fungidronshaw: i don't know whether they have their own irc channel for it, but i suspect they do not15:22
fungiit's written and operated by engineers at mirantis at the moment15:22
*** Swami has quit IRC15:22
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Use megabytes for overcloud image size  https://review.openstack.org/31259415:22
*** bpokorny has joined #openstack-infra15:23
dronshawfungi: ahh ok. wasn't sure when that transition was happening. #openstack-stackalytics is scarcely populated. anyway i noticed that stackalytics is only tracking contributions to nova. thanks :)15:23
*** stewie925 has joined #openstack-infra15:23
anteayafungi: have you ever seen a 412 Session expired error when someone tries to sign the cla?15:24
fungidronshaw: the stackalytics.com server has been dropping stale connections to gerrit which pile up and eventually exceed an internal max open connections limit in gerrit15:24
anteayathe conversation is in -dev15:24
*** xarses has joined #openstack-infra15:24
openstackgerritLucas Alvares Gomes proposed openstack-infra/project-config: Make ironic-{pxe,agent}_ipmitool jobs voting  https://review.openstack.org/31259615:24
fungidronshaw: however, i understand from a related mailing list thread that it's a holiday week in russia right now, so they're going to look into it when they all get back from vacation15:24
pleia2"During the last cycle, we've worked with Software Factory folks to build a new packaging workflow based on the very same foundations as upstream OpenStack (using gerrit, zuul, nodepool)"15:25
pleia2https://www.rdoproject.org/blog/2016/05/announcement-migration-to-reviewrdoprojectorg/15:25
pleia2neat15:25
anteayamorning pleia215:25
fungianteaya: that's a new one on me15:25
anteayame too15:25
anteayathere is a firewall in play, they insist it is not having an effect15:25
anteayaI beg to differ15:25
pleia2anteaya: morning (this is my week off, I'm not doing a good job of it)15:25
dronshawfungi: that is a much better explanation, thanks for the info15:26
anteayapleia2: away with you15:26
anteayapleia2: cats and zoos and sunshine for you15:26
pleia2anteaya: well, book writing, but maybe some of it on the roof deck :)15:26
clarkbit is not my week off but I am suffering post conference plague and will attempt to rest today15:26
anteayapleia2: book writing in sunshine, perfect!15:27
pleia2clarkb: I woke up with a sore throat and sniffles, hoping I'm just dehydrated :\15:27
anteayaclarkb: good call, may you have much water and sleep15:27
*** dronshaw has quit IRC15:27
anteayawater for everybody15:27
*** armax has joined #openstack-infra15:27
* anteaya goes to get a glass for herself15:27
pleia2water++15:27
*** fitoduarte has joined #openstack-infra15:28
*** jamesmcarthur has quit IRC15:29
*** yolanda has quit IRC15:29
fungii'm suffering from the post-conference "i just want to sleep" plague, but i'm fighting it to the best of my ability15:29
fungithough i'm also distracted by having the heating and cooling repair people here doing maintenance on our hvac15:29
anteayafungi: I just slept, feeling better now15:29
anteayaafternoon naps ftw15:30
anteayafungi: :/15:30
anteayathough a well maintained hvac unit is good15:30
* Zara has just woken up, but still has a cold. better luck to everyone else!15:30
anteayaI have my glass of water and took vitamin C while I was at it15:30
* SotK wishes he was having an afternoon nap15:30
anteayaSotK: have a nap!15:31
* anteaya hands out naps15:31
ZaraSotK: you can if you take my cold with you15:31
*** sshnaidm_ has joined #openstack-infra15:31
* SotK doesn't have time for a nap :(15:31
anteayaZara: I hear steak is good for that15:31
anteayaSotK: also I think that would be awkward in the office yeah?15:31
Zaraanteaya: but I mustn't give the steak-merchant (well, the aldi assistant) the plague.15:32
*** yaume_ has joined #openstack-infra15:32
SotKit would, but I'm working from home today which removes the awkwardness there15:32
*** yolanda has joined #openstack-infra15:32
*** yaume has quit IRC15:32
*** sshnaidm has quit IRC15:32
*** esikachev has quit IRC15:32
anteayaZara: yes, wash your hands before you go15:32
anteayaSotK: have a nap!15:32
* anteaya has to have a phone call15:33
Zara:) I can't taste anything anyway.15:34
* Zara stops whinging15:34
sdakerhallisey your kolla-kuberenetes repo add failed15:34
nibalizerZara: SotK i created https://review.openstack.org/#/c/312124/15:35
nibalizeris that in line with what yall were thinking?15:35
* SotK goes to read it15:36
openstackgerritDavid Lyle proposed openstack-infra/project-config: Adding tempest-horizon repo and job  https://review.openstack.org/31227215:36
nibalizeryou two would be able to create users in system-config and realize them on that sever15:36
*** jistr has quit IRC15:37
*** armax has quit IRC15:38
*** armax has joined #openstack-infra15:38
openstackgerritVitaly Gusev proposed openstack-infra/project-config: Add pep8 job to stacklight-integration-tests  https://review.openstack.org/31259015:39
openstackgerritRyan Hallisey proposed openstack-infra/project-config: Kolla-kubernetes  https://review.openstack.org/31259215:40
*** sdake_ has joined #openstack-infra15:40
*** sdake has quit IRC15:43
*** mikelk has quit IRC15:43
*** salv-orlando has joined #openstack-infra15:44
*** jamesmcarthur has joined #openstack-infra15:44
*** davideagnello has joined #openstack-infra15:46
*** sdake_ has quit IRC15:46
*** Guest23319 has quit IRC15:46
openstackgerritLucas Alvares Gomes proposed openstack-infra/project-config: Add pyghmi from source non-voting test  https://review.openstack.org/31260715:47
*** Sukhdev has joined #openstack-infra15:47
*** ccamacho is now known as ccamacho|away15:47
SotKnibalizer: that matches my expectations I think15:48
*** sshnaidm_ has quit IRC15:48
*** deadnul__ has quit IRC15:48
*** MarkAtwood has joined #openstack-infra15:49
*** matrohon has quit IRC15:49
nibalizerSotK: you are ok with it being precise?15:49
*** e0ne has joined #openstack-infra15:49
nibalizerseems dumb to make a precise server in 2016, but also dumb to make a dev server that doesn't run the same stuff as the prod server15:50
*** lakshmiS has joined #openstack-infra15:50
fungior we could plan to upgrade prod storyboard soon-like15:50
clarkbnibalizer: I would do trusty make sure it works then upgrade prod15:50
fungitoday for example15:50
fungibut yeah15:50
fungideploying on trusty doubles as a way to prove that upgrading to trusty will be mostly painless15:51
openstackgerritLucas Alvares Gomes proposed openstack-infra/project-config: Add pyghmi from source non-voting test  https://review.openstack.org/31260715:51
fungiwell, s/upgrading/migrating/15:51
* SotK would also prefer trusty15:51
Zarawfm. I think maybe our tests run on trusty anyway? I seem to recall we use both, somehow.15:51
nibalizerso you're saying roll out a trusty storyboard-dev, and if that works well, roll a new storyboard.o.o on trusty?15:51
fungiyep15:51
SotK+115:51
nibalizerthis works for me if the devs are in to it15:52
fungithat's basically what i did for openstackid-dev and openstackid.org a couple weeks before the summit15:52
*** andymaier has quit IRC15:52
fungispeaking of which, i should go ahead and redeploy openstackid-dev since rackspace lost it15:52
*** dizquierdo has quit IRC15:52
fungiunless somebody else wants a crack at that15:52
*** nadya has quit IRC15:53
*** apoorvad has joined #openstack-infra15:53
*** jlanoux has quit IRC15:55
nibalizerfungi: i don't need more things today15:55
nibalizerbut clarkb has a patch to launch node to make it work, hopefully15:56
nibalizerso do try that15:56
clarkbyes please try that patch15:56
fungii think that landed... clarkb?15:56
clarkbdid it?15:56
fungioh, maybe not. thought you said it merged a couple days ago15:56
*** asselin has joined #openstack-infra15:56
clarkbhttps://review.openstack.org/#/c/311872/15:57
*** banix has joined #openstack-infra15:57
clarkbthe earlier vhange was not rebased properly this change should address that15:58
*** kzaitsev_mb has quit IRC15:58
*** jistr has joined #openstack-infra15:58
openstackgerritSpencer Krum proposed openstack-infra/system-config: Add a storyboard-dev server  https://review.openstack.org/31212415:58
*** asselin__ has quit IRC15:58
*** salv-orlando has quit IRC15:59
*** kzaitsev_mb has joined #openstack-infra15:59
*** davideagnello has quit IRC15:59
nibalizerZara: SotK for shell access please read this http://docs.openstack.org/infra/system-config/sysadmin.html#ssh-access then submit your user/key reviews around here: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/users.pp#n18615:59
nibalizerthen i can whip up the change to 'realize' your users on the -dev server16:00
openstackgerritCurtis Collicutt proposed openstack-infra/irc-meetings: Adding a meeting for Operators Telco and NFV Working Group  https://review.openstack.org/31261416:00
*** salv-orlando has joined #openstack-infra16:00
*** lucasagomes is now known as lucas-afk16:01
Zaranibalizer: okay, thank you. :) I'll have a read tomorrow when I'm hopefully a bit better...16:01
anteayaZara: feel better16:01
* anteaya hands out more naps16:01
dougwigquestion for the wiki removal folks -- are we planning some kind of redirect server for the more common links, to their new doc homes?16:01
*** davideagnello has joined #openstack-infra16:01
*** amotoki has joined #openstack-infra16:02
*** salv-orlando has quit IRC16:03
*** jamesmcarthur has quit IRC16:03
fungidougwig: that has not been addressed so far. it's something we could consider perhaps, though it would mean turning the wiki into a massive hand-managed redirect farm16:03
fungifor previous documents which moved, we've simply linked the new location in the old wiki article (usually gutting the old content in the process)16:04
*** woodster_ has joined #openstack-infra16:04
dougwigfungi: i was just reading a few PDFs on openstack.org, and realized how often it's referenced.  we could use the last week or so of wiki logs, scrub out the most common references, generate an nginx redirect file, and put that in gerrit somewhere editable.  but yeah, half of that map will be pain for a bit.16:05
*** jamesmcarthur has joined #openstack-infra16:05
fungifor the most part we've just hoped that search engines regularly reindexing are finding the approriate locations16:05
*** yamamoto has joined #openstack-infra16:05
fungialso, pdfs uploaded to a wiki? really? that's terrible16:05
fungiat least we recently disabled pdf uploads16:05
fungiso shouldn't accumulate any new ones16:06
dougwigno, pdfs elsewhere.  example: https://www.openstack.org/assets/pdf-downloads/Containers-and-OpenStack.pdf   at the end, it has a nice reference link to the wiki.16:06
Shrewsfungi: i'm going to upload word docs16:06
fungiahh16:06
fungiShrews: i know you are... i know you are16:06
dougwigfungi: it's all the refs from elsewhere that will be no fun when they break.16:06
fungiyep. the web is made for hypertext16:06
fungii remember back in the early 90s i used to laugh at people buying those newsprint url indices... by the time they went to print half of the sites listed were already 40416:07
*** esikachev has joined #openstack-infra16:09
openstackgerrityolanda.robla proposed openstack-infra/shade: Move cloud fixtures to independent yaml files  https://review.openstack.org/31257916:10
openstackgerrityolanda.robla proposed openstack-infra/shade: Move cloud fixtures to independent yaml files  https://review.openstack.org/31257916:13
*** hashar has quit IRC16:13
*** kjorgensen has joined #openstack-infra16:14
*** hdaniel has quit IRC16:14
*** abregman|mtg is now known as abregman16:14
*** yamamoto has quit IRC16:14
mordredinfra-root: I spoke with jeblair on the phone about the AFS stuff16:14
mordredat this point the suggestion is that we switch to the rw volume until next week16:15
fungiwfm16:15
mordredI will work on that patch16:15
fungiand we can defer the cleanup/salvager/whatever discussion to next week16:15
mordredadditionally, I think short term we'd like to move ot having the second volume server also be in DFW so that we still get atomic releases and some amount of resiliency without the cross-region network cost16:16
*** jamesmcarthur has quit IRC16:16
*** roxanaghe has joined #openstack-infra16:16
mordredand that should buy us some time to think about the various options for dealing with multi-region for DR purposes16:16
fungicorrect that this, while getting us current content on the mirrors, will also mean we lose atomicity and possibly break things like package installs when indices are in the midst of being rewritten?16:16
*** dprince has joined #openstack-infra16:16
mordredyes16:16
fungii still agree that it's a worthwhile risk, just making sure we know what to expect16:17
mordredso we'll have pypi mirrors that behave a little bit more like pre-afs mirrors16:17
mordredand I think we can get atomicity back early next week16:17
nibalizermordred: so does tha tmean we basically use it like nfs?16:17
nibalizerjust a big mutable store?16:17
*** dtantsur is now known as dtantsur|afk16:17
mordredwell, we still have the afs clients with the caching on each mirror host16:17
mordredso it's still better in that sense16:18
nibalizerso are the clients writable then16:18
mordredthe clients could write to the readwrite volume if they want - although that isn't really changed, they've always been able to do that16:18
mordredthey just won't see atomic updates to the readonly volume16:18
*** nadya has joined #openstack-infra16:20
*** jordanP has quit IRC16:20
ansiwenAJaeger: https://review.openstack.org/#/c/311761/ is checked16:21
nibalizerbut only if they aklog or whatever yah16:21
nibalizeranonymous write access isn't enabled?16:21
nibalizeryah ok i think i understand what is being proposed16:22
ansiwenAJaeger: and then you can look at https://review.openstack.org/#/c/311753/ again16:22
electrofelixfungi: any word on the tarball/static volume?16:22
nibalizerbasically just scratch on the rw volume and skip any vos release shenanigans16:22
electrofelixor is that what is currently being discussed?16:22
fungielectrofelix: i fixed it after meetings ended yesterday once we caught up on the openssl update situation everywhere16:23
*** asselin has quit IRC16:23
fungiand then i reenqueued the tag in zuul and everything worked as intended16:23
*** sputnik13 has joined #openstack-infra16:24
*** sdake has joined #openstack-infra16:24
*** shashank_hegde has joined #openstack-infra16:24
electrofelixdoh! I should have just checked pypi16:24
*** sridhar_ram has joined #openstack-infra16:24
* fungi is a meat-based internet search engine16:25
electrofelixno automated anouncements?16:25
zaromorning16:26
*** madhu_ak has joined #openstack-infra16:26
fungielectrofelix: nope. not unless you want to set up reno support and start requesting releases through the openstack release team16:26
*** javeriak has joined #openstack-infra16:26
zaroclarkb: looks like gerrit unsecure download of libs was indeed a bug: https://gerrit-review.googlesource.com/#/c/7717916:27
fungiinstead, i'd recommend just sending an e-mail to places you think people likely to care about 1.5.0 will be reading letting them know there's a new version, and any important highlights16:27
*** daemontool_ has joined #openstack-infra16:27
*** daemontool_ has quit IRC16:28
*** daemontool has quit IRC16:28
*** daemontool has joined #openstack-infra16:29
*** arxcruz has quit IRC16:30
electrofelixwill do, might look at reno for the future, just seemed like the release emails sent to openstack-dev automatically might be useful, but don't see much in the line of release notes in them16:31
*** jtyr has joined #openstack-infra16:31
electrofelixlooks more like just a summary of what changed16:31
fungiit relies on you maintaining a set of release notes in the repo16:31
jtyrPlease could somebody review this small patch? ... https://review.openstack.org/#/c/311150/16:32
fungiso the usefulness of the release notes is mostly dependent on building that to contain useful details16:32
dansmithsdague: clarkb: in multinode mode, do we configure tempest before we've started devstack on the subnode or something?16:32
clarkbdansmith: yes, we run devstack on primary node first then on subnodes16:32
dansmithsdague: clarkb: I'm trying to do a thing, which causes tempest setup to fail, and I never get anything other than localrc on the subnode16:32
dansmithokay (damn)16:32
clarkbdansmith: this order was selected because of how nova's control plane works aiui. Basically sdague said I cannot run them concurrently16:32
pabelangerclarkb: nibalizer: fungi: regarding 312495, are we okay replacing wget with curl in install_puppet.sh? If not, 312239 adds wget as a pkg-map dependency to our puppet element16:33
clarkbpabelanger: I thought we tried both in install_puppet.sh16:33
pabelangerclarkb: only for pip16:33
clarkbzaro: yay we were helpful16:33
clarkbpabelanger: I think precedent then would be to try both elsewhere?16:33
pabelangerclarkb: Sure, I can add that16:34
clarkbpabelanger: basically the reason for that is you want to install_puppet.sh on more than just eg dib built image16:34
electrofelixfungi: and then the release team add the necessary meta info when tagging?16:34
clarkbpabelanger: and sometimes you get curl sometimes you get wget and sometimes you get both (and sometimes none)16:34
anteayamorning zaro16:35
*** johnny has joined #openstack-infra16:37
*** johnny is now known as Guest9280216:38
*** dynarro has quit IRC16:39
openstackgerritPaul Belanger proposed openstack-infra/system-config: Check for both curl and wget for puppetlabs deb  https://review.openstack.org/31249516:39
pabelangerclarkb: ^ fixed16:39
*** flwang has quit IRC16:39
*** jtyr has quit IRC16:39
pabelangerclarkb: also, the only thing we need to roll ubuntu-precise dibs16:39
*** signed8bit_Zzz is now known as signed8bit16:40
openstackgerritMonty Taylor proposed openstack-infra/system-config: Start using read/write AFS volume for PyPI mirror  https://review.openstack.org/31263016:40
anteayamordred: apparently adding an ansible role for building and uploading images is waiting on upstream to land a patch: https://review.openstack.org/#/c/166547/ has that patch landed, or do you know when it will land?16:41
mordredanteaya: I believe it has landed, but let me dig in a little bit more on that16:42
anteayamordred: thank you16:42
*** tpsilva has joined #openstack-infra16:42
fungielectrofelix: yeah, basically you keep up appending release notes as you go, and try to include some special headers in your commit messages to indicate whether minor/major version bumps are needed16:42
fungielectrofelix: then the release team runs a script which encodes that info into the tag comments and also generates a release announcement with the same16:43
*** abregman has quit IRC16:43
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add ubuntu-precise dib to nodepool  https://review.openstack.org/31224816:43
*** sshnaidm_ has joined #openstack-infra16:44
anteayaSpamapS: there are two project-config patches in merge conflict in this endeavour: https://review.openstack.org/#/q/topic:counter-inspection is this still a going concern?16:44
*** HeOS has quit IRC16:44
*** kzaitsev_mb has quit IRC16:45
*** kushal has quit IRC16:46
*** e0ne has quit IRC16:46
dhellmannelectrofelix : drop by #openstack-release if you want help setting up the release announce tools16:46
*** kdas_ has joined #openstack-infra16:46
*** nadya has quit IRC16:46
*** e0ne has joined #openstack-infra16:47
clarkbpabelanger: the curl/wget thing is required for precise?16:47
electrofelixfungi: thanks, dhellmann: seems like that might be a good idea16:47
*** kzaitsev_mb has joined #openstack-infra16:47
pabelangerclarkb: ya, we fail to find wget, and using the OS version of puppet breaks with our puppet manifests16:47
*** kdas_ is now known as kushal16:48
pabelangerclarkb: once I figure that out, image built correctly16:48
*** kushal has quit IRC16:48
*** kushal has joined #openstack-infra16:48
AJaegerinfra-root, could anybody create a stable/mitaka branch for openstack-manuals, please? Use current head as branch point.16:49
*** javeriak has left #openstack-infra16:49
*** Swami_ has quit IRC16:49
anteayaI'd appreciate more eyes on https://review.openstack.org/#/c/310093/1 which removes approval verified 1 from the gerrit trigger and adds a regex for a comment with Build Succeeded in its place16:50
anteayaI'm not a fan of monkeying with the pipeline triggers personally16:50
AJaegeransiwen: once 311761 is merged, it proposes the update to requirements - and thus obsoletes your requirements change in 753, so you need to change 753 then. Wait until 311761 is merged and the requirements update is merged...16:50
*** markus_z has quit IRC16:51
AJaegeranteaya: I know too little about this to give any comments - so agree with you: This needs some more eyes ;)16:51
clarkbanteaya: we don't need that, gerrit has fixed upstream16:51
clarkbzaro: ^ can you confirm?16:51
anteayaAJaeger: thanks :)16:51
anteayaclarkb: thank you16:51
clarkbzaro: if you can get me a link to the fix I will comment on the review with that info16:51
anteayaclarkb: thank you16:52
openstackgerritDan Smith proposed openstack-infra/devstack-gate: WIP: Start up nova-api on the subnode during multinode upgrades  https://review.openstack.org/31222116:52
AJaegeranteaya: thanks for asking here, that was the proper way, I just hadn't had good timing ;)16:52
anteayaAJaeger: oh I know, I appreciate all you do16:52
ansiwenAJaeger: oh, the requirement changes are automatically propagated to the projects?16:52
dmsimardfungi: so.. the openstack bot. It's not coming back to #rdo after unban :p16:52
fungielectrofelix: i strongly suspect we'll end up not using jjb for the openstack infrastructure past the 1.5.0 release (as part of the zuul 2.5 effort), and i don't personally mind the infra team being less involved in jjb releases once we're sure we're no longer reliant on it. should likely take the temperature of other early authors/contributors on that but seems reasonable to give you a lot more16:52
anteayathought I would do a bit of clean-up, got mordred to abandon the oldest project-config patch yesterday16:52
fungiautonomy and control over it at that point16:52
anteayaAJaeger: \o/16:52
AJaegeransiwen: yes, they are...16:53
*** jistr has quit IRC16:54
*** javeriak_ has joined #openstack-infra16:54
AJaegeransiwen: but need manual review and approval16:54
ansiwenAJaeger: ok, understood16:54
*** sdake has quit IRC16:55
*** ddieterly is now known as ddieterly[away]16:55
fungiAJaeger: loquacities: openstack/openstack-manuals branch stable/mitaka has been created from 87c5510a6e08247db810574d5b1092c6a5ca2dac (current master branch tip)16:55
melwittdoes anyone know what makes package auth get bypassed in builds? for example, when it says "WARNING: The following packages cannot be authenticated!" followed by "Authentication warning overridden."16:56
*** rbrndt has quit IRC16:56
anteayamelwitt: I personally do not know16:56
anteayamelwitt: but it is a good question16:56
pabelangeranteaya: AJaeger: do you mind helping land 312200. Need to help migrate tripleo from fedora-22 slave16:56
anteayapabelanger: I'll take a look16:56
fungimelwitt: our package mirrors do not include signed indices, so we add an option to apt-get to not perform/require signature verification16:56
*** trown is now known as trown|lunch16:57
openstackgerritAndreas Jaeger proposed openstack/requirements: Fix babel test  https://review.openstack.org/31263516:57
AJaegerthanks a lot, fungi!16:57
nibalizerpabelanger: i care very litte about wget vs curl16:57
*** derekh has quit IRC16:57
melwittfungi: cool, thank you16:57
pabelangernibalizer: sadly diskimage-builder does. Another route is 31223916:58
*** yaume_ has quit IRC16:58
fungimelwitt: that may change in the future, but for now we wanted to be able to ensure index consistency by generating our own indices, and didn't want to have to deal with maintaining and adding trusts for signing keys16:59
anteayapabelanger: in zuul/layout.yaml the job is on openstack/puppet-adoh, in jenkins/jobs/projects.yaml you have defined the job on ironic16:59
AJaegerpabelanger: will review 312200 now16:59
*** flwang has joined #openstack-infra16:59
anteayapabelanger: is this your intent, if yes, I am confused16:59
fungidmsimard: i'll check the meetbot logs16:59
pt_15Hey! I am facing a problem with a patch for Solum dashboard (https://review.openstack.org/#/c/289021). Can someone help me with this? :)17:00
pabelangeranteaya: correct, triple defines all jenkins job in ironic.  Since they only need to be defined once in JJB templates, they picked ironic17:00
pabelangertripleo*17:00
anteayawow17:00
anteayathis I did not know17:00
anteayaokay thank you17:00
*** akshai has quit IRC17:00
*** shashank_hegde has quit IRC17:00
*** e0ne has quit IRC17:01
AJaegerpt_15: what problem?17:01
*** e0ne has joined #openstack-infra17:02
anteayapabelanger: AJaeger says he is reviewing so I will wait for him17:02
openstackgerritDavid Lyle proposed openstack-infra/project-config: Adding tempest-horizon repo and job  https://review.openstack.org/31227217:02
*** akshai has joined #openstack-infra17:02
melwittfungi: I see. I was trying something locally running devstack with the ceph plugin and was getting stuck on the auth part for ceph packages, checked the upstream builds and they bypass it, and was curious to know what made that happen17:02
AJaegeranteaya: go ahead and +2a...17:02
anteayaAJaeger: okay17:02
anteayaAJaeger: pt_15 has a pbr installation issue17:02
clarkbpabelanger: I just realized that we are no longer XFS on centos \o/ which means we can do better fs things with ext4 for the swap file17:02
fungidmsimard: at 15:04 it logged that it attempted to rejoin #rdo, noticed it was banned, tried to get chanserv to unban it, was told that chanserv wouldn't authorize that, then gave up17:02
* clarkb pushes that patch17:02
AJaegerinfra-root, could we merge https://review.openstack.org/#/c/308731/ if it's ok? I guess it solves pt_15 's problem: requirements job fails but it's not visible in 28902117:02
anteayaclarkb: yay17:03
dmsimardfungi: interesting about chanserv, openstack-infra has founder access on #rdo17:03
AJaegerpt_15: is the -1 confusing you? Click on "Toggle CI" to see the error message17:03
bswartzare specs repos supposed to be licensed Apache 2.0 or Creative Commons? It's not clear from the cookiecutter specs repo because both licenses are mentioned...17:03
*** ddieterly[away] is now known as ddieterly17:03
dmsimardfungi: maybe it was trying the wrong mask or something, I did a fairly simply "/ban openstack"17:04
AJaegerdmsimard: why?17:04
dmsimardAJaeger: tl;dr we didn't expect the openstack bot to handle the meeting commands, we already had another meetbot instance in #rdo17:04
pt_15AJaeger yeah I checked that, its showing a problem with the requirements, although the problem its showing is with the fact that there is a u before the string for the package names17:05
AJaegerdmsimard: then revert Ibd1e6d9e87d1dfe41b40046f17b498ba2c11213817:05
dmsimardAJaeger: there are patches up to make the meeting commands only work on openstack-meeting-.* channels but I wrongly assumed it was already that way17:05
pabelangerAJaeger: anteaya: great, thanks17:06
AJaegerpt_15: u'hacking' ? That u stands for unicode...17:06
pabelangerclarkb: what things with the swap?17:06
*** kushal has quit IRC17:07
dmsimardAJaeger: meeting != logging, though, so I think it makes sense to try and get https://review.openstack.org/#/q/topic:feature/Offical-channels to merge17:07
AJaegerpt_15: you should use <0.11,>=0.10.2 - read the whole line...17:07
anteayapabelanger: welcome17:07
*** kushal has joined #openstack-infra17:07
pt_15Yeah, I saw that one, I meant the problem with the earlier packages like netaddr, it seems to be showing they don't match either17:07
AJaegerdmsimard: wasn't aware of those - great to see them!17:07
pt_15But I wasn't sure if that is actually causing a problem or not?17:07
AJaegerpt_15: for each line it's different ;)17:08
*** tosky_ has joined #openstack-infra17:08
AJaegerCopy the exact lines from requirements repository...17:08
AJaegeror compare all the entries in the fields. for netaddr, the comment is missing...17:09
*** tosky has quit IRC17:09
pt_15AJaeger: hmm, alright, I'll try that out. Thanks for your help! :)17:10
anteayaapparently I don't exist in stackalytics anymore, that's exciting17:10
openstackgerritBen Nemec proposed openstack-infra/project-config: Add publish-to-pypi job for tripleo-puppet-elements  https://review.openstack.org/31264217:10
odyssey4meheh, it appears that stackalytics is now only showing nova stats17:11
fungimelwitt: got it. for the ceph remote source you likely need to apt-key add their signing key assuming you don't want to ignore index signatures17:11
clarkbpabelanger: we make swap files in d-g that are slow because of centos 7 and xfs17:11
clarkbpabelanger: we cn make them fast again now that centos7 is ext4ing17:11
AJaegeranteaya: that's sad ;(17:11
anteayaand apparently mtreinish did 11 reviews in mitaka17:11
anteayaand dhellmann did 817:11
fungidmsimard: the meetbot doesn't use the openstack-infra account on freenode. only our accessbot uses that. we don't actually expect the meetbot to be able to unban itself17:11
anteayaAJaeger: eh, not so sad17:11
*** kzaitsev_mb has quit IRC17:12
anteayaone more reason to question the data17:12
anteayaany thing that tells me that dhellmann did 8 reviews in a release is not with the program17:12
dmsimardfungi: I was surprised it would even attempt to unban itself, that's kind of cool17:12
AJaegeranteaya: let's switch off stackalytics! If the data is that broken...17:12
*** Swami has joined #openstack-infra17:12
anteayaAJaeger: oh I wish17:12
anteayaI always liked russellb's stats best anyway17:12
* AJaeger would happily +2A such a change17:12
fungidmsimard: a lot of "traditional" irc bot frameworks have anti-takeover defenses built in and on by default17:12
*** salv-orlando has joined #openstack-infra17:12
mtreinishanteaya: am I winning?17:12
anteayamtreinish: 11 whole reviews in mitaka according to stackalytics.com17:13
fungidmsimard: anyway, i expect it won't rejoin until the next time the bot restarts, which i can do manually if there are no meetings going on17:13
anteayamtreinish: you beat me, I don't exist according to it17:13
dmsimardfungi: it restarts on every commit, I guess ?17:13
AJaegeranteaya: https://review.openstack.org/#/c/312198 needs +2A before https://review.openstack.org/#/c/312184 can merge - those are stacked...17:13
openstackgerritDavid Lyle proposed openstack-infra/project-config: Adding tempest-horizon repo and job  https://review.openstack.org/31227217:14
fungidmsimard: yep, which is also why system-config reviewers avoid approving meetbot channel list changes while meetings are going on or starting soon17:14
AJaegermtreinish: you beat me - I did 3 reviews ;)17:14
dmsimardfungi: makes sense, we'll wait it out :)17:14
fungianteaya: does stackalytics.openstack.org seem to be up to date?17:15
AJaegeranteaya: only in nova - so maybe it's not looking at all repos?17:15
anteayafungi: dunno, I can check17:15
fungii don't know the extent to which the missing lifecycle maintenance bits are influencing its up-to-dateness or lack thereof17:15
melwittfungi: yeah, exactly. that's what I ended up doing after I found the instructions http://docs.ceph.com/docs/master/install/get-packages/#apt and it worked after that17:15
anteayaI didn't specify nova: http://stackalytics.com/?company=hpe&release=mitaka17:15
anteayaperhaps it has defaulted to nova?17:16
openstackgerritMerged openstack-infra/project-config: Add gate-tripleo-ci-centos-7-nonha experimental job  https://review.openstack.org/31220017:16
fungipabelanger: you were still waiting for some additional input from the current stackalytics.com operators on how/when to restart and reindex right?17:16
anteayawell I exist in stackalytics.o.o http://stackalytics.openstack.org/?user_id=anteaya17:16
anteayaso that's a start17:17
*** esikachev has quit IRC17:17
fungianteaya: someone commented (can't remember if it was in irc or on an ml) that stackalytics.com is currently only listing changes for nova17:17
bswartzcd17:17
anteayaalthough as mikal pointed out last night it seems to have stopped updating in April and as fungi pointed out in reply is due to so many connections17:17
anteayafungi: ah I missed that17:18
anteayafungi: well I don't exist in nova17:18
openstackgerritBrent Eagles proposed openstack-infra/tripleo-ci: Fail pingtest more quickly  https://review.openstack.org/30848617:18
melwittfungi: now I'm looking at how/if a fix is needed for the plugin upstream. I thought it had worked in the past without the ceph package key, I'm not sure if something changed17:18
electrofelixfungi: regarding usage past 1.5.0 release, the 2.0.0 changes will be config compatible, just the internal api will be changed, so unless there is a need to pin it I imagine it'll be used until zuul v3 is fully ready?17:19
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use fallocate for swapfile if on ext  https://review.openstack.org/31264717:19
anteayamuch better: http://russellbryant.net/openstack-stats/infra-reviewers-365.txt17:19
clarkbpabelanger: ^ I made it general because maybe other people don't have images that are sane17:19
fungimelwitt: well, we used to use distro packages of ceph i think, and recently switched to mirroring more recent ceph so it could be installed in jobs needing it. i don't recall the exact details but someone here who worked more directly on it (clarkb?) likely can elaborate17:20
clarkbmelwitt: fungi is there a tl;dr of the issue?17:20
fungielectrofelix: well, zuul v2.5 (patches are already up) moves us off jenkins sooner17:20
melwittfungi: that's true, I meant locally with the plugin, the first time I ever tried it everything worked. and this last time it got hung up at the auth part17:20
fungiclarkb: melwitt was mostly wondering what changed recently to start using ceph packages which are not covered by the existing trusted source index keys provided by the distro17:21
clarkbah yup, ceph testing wants to use newer ceph packages from upstream so we added a mirror of the upstream ceph packages and now the ceph devstack plugin consumes them17:22
fungialso possible the plugin was relying on a different mechanism to retrieve and install ceph before17:22
clarkbI am not sure what the ceph devstack plugin was using before17:22
anteayaAJaeger: ah I had missed that, I'm sorry17:22
fungielectrofelix: basically we don't want to have to update a bunch of our tooling to work around csrf enforcement in jenkins, and it turns out it's decidedly unsafe to run a public-facing jenkins without csrf protection enabled, and since the long-term goal is to move off jenkins anyway this part of the plan has simply been accelerated17:24
*** jed56 has quit IRC17:24
AJaegeranteaya: I like my numbers for a change ;)17:24
anteayaAJaeger: oh? what are your numbers?17:24
anteayawhat does it attribute to you now?17:25
electrofelixfungi: is csrf the crumb used to ensure you auth'ed against jenkins for each subsequent action or am I thinking of something else?17:25
AJaegeranteaya: 3 reviews in total - http://stackalytics.com/?user_id=jaegerandi17:25
anteayaAJaeger: ha ha ha17:25
fungielectrofelix: yep, jjb works with it, but a lot of other stuff (nodepool, swift log uploader, et cetera) were decidedly sadder when we tried to turn it on17:26
anteayaAJaeger: the number you have been wanting all along17:26
electrofelixah17:26
melwittclarkb: oh, right, now using the mirror instead of what it was before. that's helpful, will dig into it more17:26
fungielectrofelix: so there's an ansible-based job runner and gearman job worker being added as an optional feature in zuul v2 which we hope to turn on very soon and start migrating jobs to use that instead of jenkins17:26
*** oanson has joined #openstack-infra17:26
*** shashank_hegde has joined #openstack-infra17:27
AJaegeranteaya: yeah!17:27
anteayayeah, any stats tool has to meet the AJaeger standard, 3 acknowledged reviews isnt' it17:27
fungielectrofelix: and "manager" support has already landed in nodepool now so that nodepool knows whether a jenkins master or a zuul worker owns a given node17:27
AJaegerfungi, could you review https://review.openstack.org/#/c/308731/ so that requirements failures are visible again in gerrit, please?17:28
*** esikachev has joined #openstack-infra17:28
*** roxanaghe has quit IRC17:29
*** ddieterly is now known as ddieterly[away]17:29
pabelangerfungi: yes, we need to figure out some sort of schedule for maintenance. But in general, we are ready for the cut over I believe17:29
pabelangerclarkb: looking17:30
electrofelixfungi: given the number of CI jobs run by openstack, I suspect if you switch to using ansible to run them all, you'll want to pick up a patch to the ssh connection plugin - see https://github.com/ansible/ansible/issues/1543617:30
openstackgerritMerged openstack-infra/project-config: Define job-groups for api-ref and api-guide  https://review.openstack.org/31219817:31
AJaegerthanks fungi.17:31
fungielectrofelix: yeah, we're running into similar issues with ansible and how we use it to run puppet apply right now17:32
*** javeriak_ has quit IRC17:32
fungielectrofelix: though the up side is that the zuul worker is horizontally scalable, so we can create as many of them as we need to mitigate some of that17:32
*** _ari_ is now known as _ari_|afk17:32
pabelangerfungi: ++17:33
*** roxanaghe has joined #openstack-infra17:33
*** inc0 has quit IRC17:33
*** akshai has quit IRC17:34
*** tonytan4ever has quit IRC17:34
*** thiagop has joined #openstack-infra17:34
electrofelixfungi: not sure that would help mitigate it really, it'll allow you to handle more rechecks, doesn't really solve the fact that the connection sometimes drops valid data resulting in a task failure17:34
fungielectrofelix: oh, different issue actually. we're just seeing scalability issues with ansible ssh memory consumption right now. yes this is different17:35
electrofelixbut you can drop in the file in that PR as a direct replacement for the existing ssh connection plugin17:35
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Allow the creation of private stories  https://review.openstack.org/31095217:35
fungielectrofelix: thanks for the heads up!17:35
openstackgerritMerged openstack-infra/project-config: Add api-ref jobs for ironic  https://review.openstack.org/31218417:36
*** jsavak has quit IRC17:36
fungiSotK: private stories in storyboard? yay!17:36
*** electrofelix has quit IRC17:36
anteayaSotK: how is private stories coming along?17:36
anteayaAJaeger: do you want to +A https://review.openstack.org/#/c/312184/2 again now?17:37
*** tqtran has joined #openstack-infra17:37
pabelangerelectrical: fungi: we're also doing async too, so that should help a little with zuul-launcher17:37
AJaegeranteaya: that one is merged...17:37
fungittx: https://review.openstack.org/31095217:37
*** infra-red has joined #openstack-infra17:38
anteayaAJaeger: oh good17:38
fungittx: not sure if you've seen that in progress yet17:38
fungittx: i discussed the vmt's embargoed vulnerability report workflow and corresponding feature needs with SotK and Zara for an hour or so on friday17:39
xnoxpleia2, what is an openstack option to trigger "/etc/networking/interfaces" file to be part of the openstack Juno config drive?17:39
xnoxif there is any?17:39
xnoxpleia2, also you should not be reading this and be on holiday ;-)17:40
EmilienMpabelanger: /me following 312656 -> should not it be "check experimental-tripleo" ?17:41
SotKfungi: yup!17:41
openstackgerritBen Nemec proposed openstack-infra/project-config: Add publish-to-pypi job for tripleo-puppet-elements  https://review.openstack.org/31264217:41
*** hdd has quit IRC17:41
SotKanteaya: I have it working properly on my test instance now, with UI too17:42
pabelangerEmilienM: no, check experimental17:42
*** Sukhdev has quit IRC17:42
pabelangerEmilienM: see zuul/layout.yaml17:42
anteayaSotK: yay!17:42
EmilienMpabelanger: ok cool17:42
anteayaSotK: well done17:42
* SotK tries to remember how depends-on works17:43
openstackgerritTim Laszlo proposed openstack-infra/shade: Add support for host aggregates  https://review.openstack.org/31093717:43
*** pvaneck has joined #openstack-infra17:44
*** akshai has joined #openstack-infra17:44
fungiSotK: add a line in the commit message containing only "Depends-On: I1234abcd5678ef00whatever" where the noun in that relationship is the full gerrit change id17:45
*** nadya has joined #openstack-infra17:45
fungifor the change you're depending on17:45
*** tonytan4ever has joined #openstack-infra17:45
*** javeriak has joined #openstack-infra17:46
fungiSotK: see http://docs.openstack.org/infra/manual/developers.html#cross-repository-dependencies17:46
SotKfungi: I thought it was that, thanks :)17:47
*** cap has joined #openstack-infra17:47
*** cap has quit IRC17:50
*** infra-red has quit IRC17:51
*** mriedem has quit IRC17:52
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add stable/mitaka to #openstack-doc  https://review.openstack.org/31266017:52
*** mriedem has joined #openstack-infra17:54
openstackgerritMerged openstack-infra/project-config: Move shade+magnum neutron job to non-voting  https://review.openstack.org/31212017:54
*** deadnull_ has joined #openstack-infra17:55
pabelangerclarkb: might be interested in the https://review.openstack.org/#/c/312170 stack too. Fixes our nodepool logging for snapshot builds, because we log at INFO not DEBUG with the ssh connection.17:56
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Add UI for making stories private to a list of people  https://review.openstack.org/31266317:56
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Show a warning when a story is private  https://review.openstack.org/31266417:56
clarkbpabelanger: hrm I thought that if you log at debug you get everything >=DEBUG including info17:57
*** tosky_ has quit IRC17:57
clarkbpabelanger: ya see https://docs.python.org/2/howto/logging.html#loggers17:58
pabelangerclarkb: Hmm...17:59
clarkbpabelanger: oh! if you keep reading the handlers have a slightl ydifferent behavior18:00
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: WIP: Complex priorities UI in stories  https://review.openstack.org/31266618:00
*** deadnull_ has quit IRC18:00
clarkbpabelanger: I think we wnt to remove the leve lfrom the handlers instead18:00
*** _ari_|afk is now known as _ari_18:00
clarkboh wait no thats not correct18:00
*** nmagnezi_ has joined #openstack-infra18:00
openstackgerrityolanda.robla proposed openstack-infra/project-config: Correct image name for generated magnum image  https://review.openstack.org/31266718:00
clarkbpabelanger: https://docs.python.org/2/library/logging.html#logging.Handler.setLevel18:01
*** salv-orlando has quit IRC18:01
clarkbpabelanger: vs https://docs.python.org/2/library/logging.html#logging.Logger.setLevel18:01
clarkbpabelanger: I think the old levels should work they basically say >=DEBUG gets logged, I wonder if the qualname is no longer accurate18:03
*** sambetts is now known as sambetts|afk18:03
openstackgerritMerged openstack-infra/system-config: Check for both curl and wget for puppetlabs deb  https://review.openstack.org/31249518:04
clarkbgrep against the debug log file says that qualname is correct18:05
pabelanger2016-05-04 14:15:16,830 INFO nodepool.image.build.rax-ord.bare-precise: + sudo bash -xe install_puppet.sh18:05
pabelangeris an example of what if showing up in debug.log18:05
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Add UI for making stories private to a list of people  https://review.openstack.org/31266318:05
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: WIP: Complex priorities UI in stories  https://review.openstack.org/31266618:05
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Show a warning when a story is private  https://review.openstack.org/31266418:05
*** jsavak has joined #openstack-infra18:06
*** jerryz has joined #openstack-infra18:06
AJaegerclarkb, pabelanger, could you review https://review.openstack.org/#/c/308731/ so that requirements failures are visible again in gerrit, please?18:07
mgagnemordred: looks like the network_data.json is actually named network_data.json, not network_info.json: https://github.com/openstack/nova/blob/master/nova/api/metadata/base.py#L90 vs https://github.com/openstack-infra/glean/blob/master/glean/cmd.py#L52518:08
clarkbAJaeger: that is a very dense change18:10
openstackgerritJames E. Blair proposed openstack/gertty: Add (quoted) reply button to change messages  https://review.openstack.org/31267218:11
openstackgerritJames E. Blair proposed openstack/gertty: Fix unicode in change messages  https://review.openstack.org/31267318:11
openstackgerritJames E. Blair proposed openstack/gertty: Default to prior approval values when (re-)reviewing  https://review.openstack.org/31267418:11
AJaegerOh, jeblair again flying? ;)18:11
clarkbAJaeger: did we change the report made by failed requirements?18:12
AJaegerclarkb: see for example 289021 - the requirements -1 is not visible.18:13
AJaegerThis is the case for quite some time, not sure when we introduced this ;(18:14
*** jheroux has quit IRC18:14
clarkbAJaeger: ok, my concern right now is the \w, bceause I notice we do \\s further down18:15
*** javeriak has quit IRC18:15
clarkbAJaeger: figuring out the right sequence of escapes is never fun18:15
AJaegerclarkb: please carefully double check...18:16
clarkbI think puppets string parser will convert \w to w18:16
clarkbwhich is why we have \\s which converts \\ to \ resulting in \s18:16
*** javeriak has joined #openstack-infra18:17
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Allow the creation of private stories  https://review.openstack.org/31095218:18
mordredmgagne: oh good18:18
jeblairi am briefly online-ish.18:18
AJaegerclarkb: you might be right - looking at line 16118:19
*** Kennan has quit IRC18:19
clarkbAJaeger: I left a -1 maybe nibalizer or crinkle can confirm18:20
AJaegerclarkb: let me fix quickly...18:20
clarkbit is also pretty easy to tes usin the print function (warn)18:20
AJaegerclarkb: looking at all other lines, I think you're right...18:20
*** Kennan has joined #openstack-infra18:20
*** kushal has quit IRC18:21
openstackgerritAndreas Jaeger proposed openstack-infra/system-config: Fix URL detection in testresult match  https://review.openstack.org/30873118:22
AJaegernibalizer, crinkle, clarkb, fungi, could you review (again), please? I changed \w to \\w ^18:22
crinkle@.@ my eyes are bleeding18:22
jeblairthat probably means it's correct18:23
sc`is there a size difference between the trusty and c7 images? trying to debug a strange failure18:24
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: openstack-manuals has stable branch.  https://review.openstack.org/31266018:24
* AJaeger sends some tissues to crinkle18:24
*** nadya has quit IRC18:25
crinkleAJaeger: clarkb puppet apply -e "notice('\\w')" and puppet apply -e "notice('\w')" produce the same thing for me18:25
crinklelet me see if templating is the same18:25
*** yolanda has quit IRC18:25
jeblairclarkb: i'm shocked.  shocked, i say, that there was a vulnerability in the asn parser.18:26
*** inc0 has joined #openstack-infra18:26
*** kzaitsev_mb has joined #openstack-infra18:27
clarkbjeblair: :)18:28
clarkbcrinkle: I can said baby pcitures if it helps the eye bleeding18:28
clarkbs/said/sned/18:28
clarkbsc`: no the raw images are within a gigabyte of each other in size iirc18:28
*** akshai has quit IRC18:28
clarkbsc`: we do have different flavors in differen tclouds because no two clouds agree on a consistent flavors18:29
crinkleclarkb: yesplz18:29
jeblaircrinkle, clarkb: ya, the escaping seems like what we would need for double quotes, but we have single quotes there, so we may hove just been over-cautious...18:29
*** nelsnels_ has joined #openstack-infra18:30
*** nelsnelson has quit IRC18:30
pabelangerclarkb: Ah, figured it out18:30
*** trown|lunch is now known as trown18:31
pabelangerclarkb: we need to add the snapshot loggers to nodepool.logging.conf18:31
pabelangercrinkle: not nodepool-builder18:31
sc`clarkb: ok. thanks for clarifying18:31
*** akshai has joined #openstack-infra18:31
*** adduarte has joined #openstack-infra18:31
mgagnemordred: will fix glean18:31
AJaegerjeblair: ah! so, we've been over-cautious in all these lines - at least we're now consistent...18:32
crinkleAJaeger: clarkb yeah it makes no difference18:32
*** fitoduarte has quit IRC18:33
*** kushal has joined #openstack-infra18:33
clarkbcrinkle: but would make a difference with ""?18:33
*** jsavak has quit IRC18:34
*** Jeffrey4l has quit IRC18:34
AJaegercrinkle, thanks for confirming!18:34
*** rbrndt has joined #openstack-infra18:34
pabelangerclarkb: not going to bother now, rather land ubuntu-precise, then migrate tripleo18:34
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use fallocate for swapfile if on ext  https://review.openstack.org/31264718:34
AJaegerSo, clarkb: do you want to +2 now?18:34
*** shardy has quit IRC18:34
clarkbpabelanger: isn't that what the logger_rax-iad_bare-precise is?18:35
crinkleclarkb: possibly18:36
*** hashar has joined #openstack-infra18:36
pabelangerclarkb: but we are only loading it on nodepool-builder, nodepoold has a different logging config file18:36
clarkbpabelanger: oh!18:36
openstackgerritMathieu Gagné proposed openstack-infra/glean: Nova exposes network info in network_data.json  https://review.openstack.org/31268318:37
pabelangerclarkb: and the snapshot is happening in nodepoold18:37
pabelangeryes18:37
clarkbpabelanger: ya I say let it die on the vine18:37
pabelangerclarkb: ++18:37
clarkbcrinkle: thank you for testing18:37
crinklenp18:37
*** ddieterly[away] is now known as ddieterly18:38
*** DevBox has joined #openstack-infra18:39
*** yottatsa_ has quit IRC18:39
*** asettle has joined #openstack-infra18:39
*** lakshmiS has quit IRC18:42
*** sdake has joined #openstack-infra18:42
*** lakshmiS has joined #openstack-infra18:42
*** cap_ has joined #openstack-infra18:42
*** roxanaghe has quit IRC18:42
*** DevBox has quit IRC18:43
*** sputnik13 has quit IRC18:44
mordredmgagne: yay!18:44
*** asettle has quit IRC18:44
mordredmgagne: so - glean should probably look for both filenames18:44
*** sdake has quit IRC18:44
mordredmgagne: as I think that we have a cloud provider providing us the other name too18:45
*** nmagnezi_ has quit IRC18:45
mgagnemordred: ok, will fix as suggested18:45
clarkbmordred: I can check that really quickly18:45
clarkblet me do that18:45
mordredclarkb: well, if that's not the case, then none of our rax nodes would work at all18:45
mordredbut checking is good18:45
mgagnebut if network_info.json is used, it's a wrong local implementation18:45
mordredoh - wait - our rax nodes are vendor_data.json18:45
mordrednevermind18:45
mordredlet's let clarkb check :)18:45
mgagnemordred: rax uses network_info key in vendor_data.json18:46
*** sdake has joined #openstack-infra18:46
mordred++18:46
*** cap_ has quit IRC18:46
clarkbhttp://paste.openstack.org/show/496132/18:46
*** roxanaghe has joined #openstack-infra18:46
*** MarkAtwood has quit IRC18:47
openstackgerritDavanum Srinivas (dims) proposed openstack-dev/pbr: Remember the insertion order for pbr.json  https://review.openstack.org/30740518:47
*** nmagnezi_ has joined #openstack-infra18:47
*** ldnunes has quit IRC18:48
*** vgridnev has joined #openstack-infra18:48
*** _ari_ has quit IRC18:48
*** _ari_ has joined #openstack-infra18:48
*** ldnunes has joined #openstack-infra18:49
*** bpokorny_ has joined #openstack-infra18:50
*** bpokorny_ has quit IRC18:51
*** salv-orlando has joined #openstack-infra18:51
*** bpokorny_ has joined #openstack-infra18:51
*** bardia has joined #openstack-infra18:52
*** adduarte has quit IRC18:53
*** bpokorny has quit IRC18:54
*** adduarte has joined #openstack-infra18:54
*** xiangxinyong has quit IRC18:54
*** xiangxinyong has joined #openstack-infra18:55
*** salv-orlando has quit IRC18:56
*** salv-orlando has joined #openstack-infra18:56
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use fallocate for swapfile if on ext  https://review.openstack.org/31264719:00
*** Nikolay_St has joined #openstack-infra19:00
openstackgerritSpencer Krum proposed openstack-infra/system-config: Add ssl upgrade playbook  https://review.openstack.org/31226119:01
openstackgerritBen Nemec proposed openstack-infra/project-config: Add publish-to-pypi job for tripleo-puppet-elements  https://review.openstack.org/31264219:02
openstackgerritMerged openstack-infra/system-config: Fix URL detection in testresult match  https://review.openstack.org/30873119:02
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Removed explicit references to node_modules/.bin  https://review.openstack.org/30455719:02
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Updated README  https://review.openstack.org/30455619:02
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Removed grunt test-unit in favor of just running karma  https://review.openstack.org/30455519:02
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Removed ineffective grunt target  https://review.openstack.org/30455419:02
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Removed grunt-bower  https://review.openstack.org/30456519:02
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Renamed karma-test.conf.js  https://review.openstack.org/30456219:02
*** flwang1 has joined #openstack-infra19:03
*** jsavak has joined #openstack-infra19:04
openstackgerritClark Boylan proposed openstack-infra/puppet-elasticsearch: Use current elasticsearch url  https://review.openstack.org/31269919:06
*** javeriak_ has joined #openstack-infra19:07
*** salv-orlando has quit IRC19:07
openstackgerritClark Boylan proposed openstack-infra/system-config: Upgrade elasticsearch to 1.7.5  https://review.openstack.org/31270119:07
rhalliseyAJaeger, what did you mean by your comment in https://review.openstack.org/#/c/312592/ ?19:08
*** salv-orlando has joined #openstack-infra19:08
rhalliseydo I need to add a Needed-By: <change ID of kolla governance change>19:09
clarkbpabelanger: anteaya ^ prep work for upgrading ES. https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-upgrade.html tells us that we can do this in a rolling upgrade. My rough plan is put all of the es cluster in emergency file for ansible, merge that change, then remove es hosts from emergency one by one to do a rolling upgrade19:09
*** javeriak_ has quit IRC19:09
clarkbrhallisey: yes I think AJaeger is asking you to have the governance change and when you do point to it in the other change so that there is linkage between the two19:09
krotscheckfungi: You around today? The governance patch for https://review.openstack.org/#/c/308662/ got quorum and +A.19:10
*** piet has joined #openstack-infra19:10
*** rockyg has joined #openstack-infra19:10
*** javeriak has quit IRC19:10
*** esikachev has quit IRC19:12
rhalliseyclarkb, just so I understand correctly, this repo should be under kolla's governance.  So I would point to kolla's governance change19:12
*** tphummel has joined #openstack-infra19:12
rhalliseydo I have that right?19:13
clarkbrhallisey: yes point to the governance change adding it to the kolla team19:13
*** salv-orlando has quit IRC19:13
rhalliseyclarkb, cool thanks19:13
*** bdemers has joined #openstack-infra19:14
AJaegerrhallisey: as clarkb said - and as it's documented in the infra manual section that I referenced19:15
AJaegerrhallisey: and you need kolla PTL +1 before we can merge it19:15
rhalliseyAJaeger, gotcha, thanks!19:17
*** tonytan4ever has quit IRC19:17
*** flwang1 has quit IRC19:17
fungikrotscheck: awesome. i've taken AJaeger's comment on ps1 as a +2 and approved it19:17
fungikrotscheck: once it merges, i'll ask ttx to toggle his approval again on 30866319:19
*** nadya has joined #openstack-infra19:19
fungii didn't realize the project-config patch was waiting on a +1 from me since i'd +1'd the corresponding governance patch anyway19:19
openstackgerritRyan Hallisey proposed openstack-infra/project-config: Kolla-kubernetes  https://review.openstack.org/31259219:20
fungibut it is what it is, approved now. apologies for that19:20
krotscheckfungi: Thanks :)19:20
*** HeOS has joined #openstack-infra19:20
fungithanks for working on it!19:20
krotscheckfungi: We were at the summit, I wasn't really expecting anything to happen.19:20
krotscheckfungi: Also, with jeblair out this week, _nothing_ is going to happen until he gets back :)19:20
fungias soon as the governance change merges, i'll rerun our gerrit group manglement script and then add you as an additional core reviewer on that repo19:21
*** shashank_hegde has quit IRC19:21
krotscheckfungi: unless you want to make me root on mirror. Which I recommend against, but will take full advantage of if you do :)19:21
krotscheckfungi: woot, thanks!19:21
fungii like to think we make progress on stuff even when jeblair takes a well-deserved rest, even if we only make progress on unimportant things ;)19:21
nibalizerfungi: hah19:22
krotscheckfungi: I agree! Important things like JavaScript however do require a jeblair :D19:22
nibalizerrolling the ball up the hill19:22
AJaegerfungi, argh - I always wait for the project-config one ;)19:22
*** e0ne has quit IRC19:23
krotschecknibalizer: Regarding that de-montyfy patch for puppet-phabricator, while it looks like everyone's leaning towards storyboard again, the UX team may still need Pholio, so it's still relevant.19:23
fungiAJaeger: yep, makes sense. i just wasn't thinking to check19:23
krotscheckBut it's a big one, so if you want to punt on it until we get a concrete decision that's cool.19:24
AJaegerclarkb has proposed a change to move nodepool cron earlier: https://review.openstack.org/311890 . It has two +2s. I can add a +2a - just wondering whether there'S a specific reason not to merge it.19:24
openstackgerritMerged openstack-infra/project-config: Add js-openstack-registry-hooks (openstack-registry-hooks) to openstack-infra  https://review.openstack.org/30866219:25
*** flwang1 has joined #openstack-infra19:25
*** sdake has quit IRC19:25
AJaegerotherwise I'll merge 311890 tomorrow...19:25
*** sdake has joined #openstack-infra19:26
AJaegerunless somebody beats me to it ;)19:26
*** signed8bit is now known as signed8bit_Zzz19:28
nibalizerkrotscheck: what are you asking me to do? review something?19:28
krotschecknibalizer: Remember the conversation at the summit where you got annoyed because you felt I was hitting you up for reviews, but really I wanted to show you the funzorz?19:29
krotscheckI'm just hitting you up for reviews now :)19:29
*** salv-orlando has joined #openstack-infra19:30
openstackgerritMerged openstack-infra/storyboard-webclient: Removed ineffective grunt target  https://review.openstack.org/30455419:30
*** oanson has quit IRC19:30
*** apoorvad has quit IRC19:31
mordredkrotscheck: I want funzorz19:32
krotscheckmordred: https://review.openstack.org/#/c/310319/19:32
*** sputnik13 has joined #openstack-infra19:32
mordredHAHAHAHAHAHAHAHAHAHA19:32
bkeroI love that 5042 line deletion19:33
fungittx: the dependency for governance change 308663 has merged, so if you're around it could stand a reapproval vote19:34
krotscheckmordred: You're welcome :D19:34
*** bdemers_ has joined #openstack-infra19:35
nibalizerkrotscheck: oh sorry if I came off as frustrated19:35
krotschecknibalizer: No worries, I'm just happy I got to share my joke :D19:35
mordredkrotscheck wins best commit subject19:36
nibalizerit is funny19:36
nibalizerlol19:36
krotscheckThe annoying thing about it all is that I committed that patch about... an hour before the ticket tracking session?19:36
* krotscheck facepalms19:37
*** bdemers has quit IRC19:37
*** bdemers has joined #openstack-infra19:37
*** tonytan4ever has joined #openstack-infra19:38
*** baoli_ has quit IRC19:39
openstackgerritJeremy Stanley proposed openstack-infra/bindep: Update PyPI trove classifiers preparing for 1.0.0  https://review.openstack.org/20272819:39
*** bdemers_ has quit IRC19:39
openstackgerritBen Nemec proposed openstack-infra/project-config: Add stable branch jobs for tripleo-ci  https://review.openstack.org/29739019:40
*** ddieterly is now known as ddieterly[away]19:40
*** rossella_s has quit IRC19:40
*** rossella_s has joined #openstack-infra19:41
*** nmagnezi_ has quit IRC19:44
*** piet has quit IRC19:44
*** kzaitsev_mb has quit IRC19:45
*** e0ne has joined #openstack-infra19:46
*** Nikolay_St has quit IRC19:46
*** openstackgerrit has quit IRC19:48
*** openstackgerrit has joined #openstack-infra19:48
*** e0ne has quit IRC19:48
*** piet has joined #openstack-infra19:49
*** hdd has joined #openstack-infra19:49
jeblairif only i were resting19:51
krotscheckjeblair: GO REST19:51
krotscheckBy which I mean, go do things that are relaxing, rather than go Implement a Web Standards Compliant API.19:52
jeblairi'd like to, but i'm not on vacation :)19:52
* krotscheck doesn't let that stop him :D19:52
krotscheckbabies do a right fine job of that already.19:52
jeblairbut yeah, this week is a bad time for me to commit to doing anything; next week should be better19:53
*** stewie925 has quit IRC19:54
funginote i didn't say you _were_ taking a rest, merely that one would be well-deserved19:54
*** flwang1 has quit IRC19:55
*** akshai has quit IRC19:55
krotscheckAnyone other than EmilienM working on xenial things? https://review.openstack.org/#/c/308530/619:56
*** infra-red has joined #openstack-infra19:56
*** infra-red has quit IRC19:56
*** nadya has quit IRC19:56
clarkbdmsimard: https://review.openstack.org/#/c/312647/ may interest you19:56
nibalizerso puppetlabs won't package puppet 3.x for xenial, because raisins19:56
nibalizerso we're gonna have to use the trusty package, which is reasonably up to date19:57
nibalizer3.8.5 vs 3.8.6 or something small like that19:57
*** gyee has joined #openstack-infra19:57
nibalizeroh sorry it's not called Pupet Labs any more its Puppet Inc19:57
EmilienMkrotscheck: thanks for your comment, the package looks new! cool stuff19:57
*** yamahata has quit IRC19:58
krotscheckEmilienM: YW! I have vested interest in xenial because Node4LTS :)19:58
dmsimardclarkb: didn't I revert from fallocate to dd because it didn't work with xfs which comes default in centos ?19:58
*** dprince has quit IRC19:58
dmsimardOur was that something else, I forget19:59
krotschecknibalizer: Good to know.19:59
nibalizerEmilienM: are you gonna drop puppet3 any time soon?19:59
EmilienMkrotscheck: I need some help, I'm having issues when deploying OpenStack services in SSL, not sure you saw our conversation about python-requests yesterday19:59
nibalizeryou can get 4 from the upstream repos19:59
EmilienMnibalizer: no no no! we won't do that !19:59
EmilienMlook https://docs.google.com/forms/d/1rJZxP52LyrFhFTy8w4J_5tnA7-A5g32YVhHSaCd7-F8/edit#responses19:59
EmilienMI ran a poll on Monday19:59
krotscheckEmilienM: I did not.19:59
EmilienMmost of people are running puppet320:00
pabelangerclarkb: ack20:00
EmilienMon 24 responses, only one person is running puppet4 actually20:00
*** salv-orlando has quit IRC20:00
*** regXboi has joined #openstack-infra20:00
EmilienMadoption is not here20:00
*** bdemers_ has joined #openstack-infra20:00
clarkbdmsimard: correct but we no longer use xfs and I kept the dd if others happen to have not ext20:00
EmilienMerr, actually 2/2420:01
dmsimardAh, ok20:01
nibalizerEmilienM: ok, so you're gonna have to find sources for puppet3 going forward then, because what I've heard is Puppet Inc is not packaging it for new distros20:01
clarkbdmsimard: upstream gate ahould be all ext4 now and doing the fallocate will.save a minute or two per job there20:01
EmilienMsigh20:01
EmilienMnibalizer: can I use trusty package?20:01
clarkbmultiply by a few ten thousand and its not insignificant20:01
nibalizerEmilienM: ya20:01
dmsimardclarkb: agreed20:01
nibalizerthat's what i expect infra will do, since they have 3.8.recent20:01
EmilienMnibalizer: better: I can use what xenial provides20:02
EmilienMit's puppet3 AFIK20:02
nibalizerer sorry trusy doesn't have 3.820:02
nibalizertrusty has old but xenial has 3.8.recent20:02
EmilienMhttps://launchpad.net/ubuntu/xenial/+source/puppet20:02
EmilienMpuppet 3.8.5-220:02
EmilienMwe'll use that!20:02
nibalizerEmilienM: yep20:02
nibalizerfor 5 years!20:02
*** shashank_hegde has joined #openstack-infra20:02
*** e0ne has joined #openstack-infra20:02
EmilienMwho knows where we are in 5 years20:02
*** ddieterly[away] is now known as ddieterly20:03
nibalizerhopefully still working together :)20:03
EmilienMnibalizer: I have so much fun working on CI stuffs20:03
pabelangernibalizer: should also note, we are using the OS package on debian-jessie of puppet too. But that was because wget was missing for install_puppet.sh20:03
regXboiI've got a question on why the use of neutron-debug in devstack-gate, who might be able to answer?20:03
*** bdemers has quit IRC20:04
clarkbdmsimard: maybe you can double check my changes still work on xfs?20:04
clarkbregXboi: usually best to ask then those that can help will know :)20:04
pabelangerugh, debian-jessie dib failed again... mirror :(20:04
pabelangercould I get a +A please: https://review.openstack.org/#/c/311883/20:04
regXboiclarkb: ok... why are we using it?  I'm running into job failures on neutron-debug and I'm not sure what it's trying to accomplish, which makes it a bit hard to figure out what is broken20:05
dmsimardclarkb: will try20:05
clarkbpabelanger: let me see20:05
clarkbregXboi: what is this neutron-debug?20:05
AJaegerdoes https://review.openstack.org/#/c/308731/ need a gerrit restart? It merged 63 mins ago and looking at https://review.openstack.org/#/c/312722/ it didn't make a difference ;)20:05
nibalizerpabelanger: ya we need to standards a bit20:05
nibalizerwe have several puppet versions from several sources20:06
regXboiclarkb: it's a command being run by devstack-gate because Q_USE_DEBUG_COMMAND is set to True whenever DEVSTACK_GATE_NEUTRON is set20:06
clarkbpabelanger: it has the +2s it needs you can self approve20:06
regXboiclarkb: and I'm not sure what it's trying to accomplish20:06
regXboior what it is supposed to accomplish20:06
pabelangernibalizer: ya, we need it for ubuntu-precise, for sure. OS puppet doesn't work with our manifests20:07
*** sdague has quit IRC20:07
*** bpokorny_ has quit IRC20:07
pabelangerclarkb: ah, guess I can20:07
pabelangerclarkb: thanks20:07
*** bpokorny has joined #openstack-infra20:07
*** e0ne has quit IRC20:07
pabelangerspeaking of ubuntu-precise! https://review.openstack.org/#/c/312248/20:08
pabelangerhappy it wasn't a lot of work20:08
pabelangerfamous last words20:08
regXboipabelanger: that sounded almost link a self-jinx20:08
regXboier *like*20:08
*** piet has quit IRC20:08
pabelangerregXboi: Yup, I've doomed myself20:09
*** harlowja has quit IRC20:09
clarkbregXboi: there are no results for git grep neutron-debug in devstack-gate20:09
*** signed8bit_Zzz is now known as signed8bit20:09
clarkbregXboi: there are however many resuts in devstack20:10
regXboiclarkb: true... what is set is Q_USE_DEBUG_COMMAND20:10
*** akshai has joined #openstack-infra20:10
regXboiclarkb: and that causes lib/neutron-legacy to run neutron-debug20:10
*** e0ne has joined #openstack-infra20:10
regXboiclarkb: which is causing devstack to fail20:10
*** jsavak has quit IRC20:11
*** salv-orlando has joined #openstack-infra20:11
*** jsavak has joined #openstack-infra20:11
regXboiclarkb: an example can be found at http://logs.openstack.org/08/281508/1/check/gate-tempest-dsvm-neutron-src-python-neutronclient/993cd9b/logs/devstacklog.txt.gz#_2016-04-30_13_55_59_03520:11
clarkbregXboi: nachi added it in Idee4199b03c2b25882307c0e571da54ebf66a77a20:12
regXboiclarkb: danke - let me go read the why20:12
*** akshai has quit IRC20:12
clarkbwell there isn't much there but its part of the thread20:12
*** esikachev has joined #openstack-infra20:13
EmilienMkrotscheck: done https://review.openstack.org/#/c/308530/7/run_tests.sh20:13
openstackgerritMerged openstack-infra/project-config: Pin debian-jessie deb mirror to ftp.us.debian.org  https://review.openstack.org/31188320:13
regXboiI think I'm almost tempted to propose taking it out20:14
*** dmk0202 has joined #openstack-infra20:14
*** akshai has joined #openstack-infra20:14
*** sdague has joined #openstack-infra20:14
clarkbregXboi: and Iebf8a0e9e2ed2bb56bee6533e69827e6caa2bc82 is where it started in devstack20:15
*** apoorvad has joined #openstack-infra20:15
clarkbregXboi: https://git.openstack.org/cgit/openstack/neutron/tree/setup.cfg#n44 is where it is defined in neutron20:16
regXboiya...20:16
clarkblooks like it is diagnostic20:16
krotscheckEmilienM: Added :)20:17
EmilienMkrotscheck: this repo is for puppet openstack CI only, not infra CI20:17
EmilienMerr, this patch20:18
clarkbregXboi: is it causing problems? took about 2 seconds to run. I guess the question is whether or not those probes are valuable20:18
EmilienMkrotscheck: we're already running puppet4 jobs (and they already work on centos7/trusty) in our periodic jobs20:18
EmilienMkrotscheck: this patch is only a transition to xenial20:18
regXboiclarkb: let me dig through the code some more and try and figure out - the failure statements in the log are less than helpful20:18
clarkbregXboi: ya but that has nothing to do with devstack or devstack gate :) its lal in neutron20:19
regXboiclarkb: ack... and I'll go back over there and ask then :)20:19
*** Guest12912 has quit IRC20:20
krotscheckEmilienM: Oh good, thanks for clarifying :)20:21
EmilienMkrotscheck: another FYI: once we have xenial passing our CI, we'll switch our openstack/puppet-* testing to gate on xenial from master (current newton) and keep trusty for stable/(kilo|liberty|mitaka)20:22
dimsanteaya : new repo for kolla seems ready - https://review.openstack.org/#/c/312592/20:23
dimsanteaya : AJaeger : so, the functional test with sudo CI was a success. worked like a charm20:24
AJaegerdims: great!20:25
dimsclarkb : fungi : i was asking you about this at the summit, i just added a way to run tox w/o the revoke-sudo, so scripts in tox.ini could setup docker+kubernetes20:25
dimsbefore running tests20:26
clarkbdims: just a new template?20:26
krotscheckEmilienM: Thanks - I don' tthink that affects me as much though.20:26
krotscheckEmilienM: Just for clarification though- we have xenial nodes ready to go?20:27
*** fawadkhaliq has joined #openstack-infra20:27
EmilienMkrotscheck: yes20:27
dimsclarkb : "gate-{name}-tox-with-sudo-{envlist}"20:27
krotscheckEmilienM: Excellent!20:27
*** gyee has quit IRC20:27
* krotscheck wadners off to do node things20:27
*** asettle has joined #openstack-infra20:28
*** banix has quit IRC20:28
*** amrith is now known as _amrith_20:28
*** roxanaghe has quit IRC20:29
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272520:29
openstackgerritJay Dobies proposed openstack-infra/project-config: Add api-ref jobs for Heat  https://review.openstack.org/31272620:30
*** gyee has joined #openstack-infra20:30
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add ubuntu-precise dib to nodepool  https://review.openstack.org/31224820:32
*** asettle has quit IRC20:32
*** brucet has joined #openstack-infra20:32
clarkbpabelanger: did you see my changes and message about the ES upgrade? that make sense?20:32
pabelangerwow, a little shocked that tripleo-ci has zero gate testing20:32
pabelangerclarkb: yes20:33
*** kushal has quit IRC20:33
greghaynespabelanger: yea, it cant be done with the current setup AIUI20:33
clarkbpabelanger: cool, I realize that it is still relatively early in the day for myself and we could start on the first host now if you like20:33
*** tonytan4ever has quit IRC20:33
pabelangerclarkb: you are planning to merge that tomorrow?20:33
clarkbgreghaynes: pabelanger something something thats what you get when you reinvent devstack-gate20:33
pabelangerclarkb: if anteaya is ready, I can be20:33
clarkbanteaya: you around? we can start the ES upgrade process now since it is actually pretty direct and simple20:34
*** salv-orlando has quit IRC20:35
pabelangergreghaynes: clarkb: Iam hoping Depends-On works in this case for my tripleo-ci patch20:35
*** bdemers has joined #openstack-infra20:37
*** e0ne has quit IRC20:37
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Zuul: Create api-ref-jobs and api-guide-jobs templates  https://review.openstack.org/31273120:38
*** yamahata has joined #openstack-infra20:38
regXboiclarkb: found my problem - thanks for your help!!20:39
clarkbregXboi: yay20:40
*** bdemers_ has quit IRC20:40
*** Hal has joined #openstack-infra20:42
*** Hal is now known as Guest6532620:42
*** Goneri has quit IRC20:42
*** salv-orlando has joined #openstack-infra20:44
pabelangerclarkb: greghaynes: I was mistake, tripleo pipeline picks up the patch20:45
pabelangerwe just noop in check20:45
clarkbpabelanger: if you want to edit the emergency file I think getting an early start would be good as each service restart will take time to settle so we may be doing this upgrade over the next few days20:47
*** sputnik13 has quit IRC20:47
clarkbanteaya: ^ we can catch you up when you around, process should be repetitive20:47
*** fawadk has joined #openstack-infra20:47
*** bpokorny has quit IRC20:47
pabelangerclarkb: sure, let me login20:47
*** doug-fis_ has joined #openstack-infra20:48
*** _amrith_ is now known as amrith20:48
clarkbpabelanger: we need to put elasticsearch02.openstack.org through elasticsearch07.openstack.org in ansible disabled mode20:48
*** esker has quit IRC20:48
clarkbthen I can approve my chang eand we can remove one of those hosts from the disabled list to get it upgraded20:48
clarkbpabelanger: I can show you how the ES adminy tools work while we wait for that to merge20:48
pabelangerclarkb: does regex work for emergency?20:48
pabelangerclarkb: either way, added them20:49
anteayaclarkb pabelanger I am around20:49
*** aysyd has quit IRC20:49
*** fawadkhaliq has quit IRC20:50
*** doug-fish has quit IRC20:50
openstackgerritSahdev Zala proposed openstack/requirements: Update to recent release of tosca-parser 0.5.0  https://review.openstack.org/31273920:50
clarkbpabelanger: not sure if regex works I would just add them individually20:50
* anteaya reads backscroll20:50
*** doug-fish has joined #openstack-infra20:51
pabelangerclarkb: ya, that's what I did for now20:51
clarkbpabelanger: ok I removed my -1 WIP, why don't you approve when you are ready20:51
*** Sukhdev has joined #openstack-infra20:52
*** aysyd has joined #openstack-infra20:52
*** doug-fi__ has joined #openstack-infra20:52
clarkbpabelanger: anteaya the two tools I like for admin checking of ES are https://github.com/mobz/elasticsearch-head.git and https://github.com/lukas-vlcek/bigdesk.git20:52
*** doug-fis_ has quit IRC20:52
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: NPM Jobs now run on Xenial  https://review.openstack.org/31274220:53
clarkbthey require more api access than we expose publicly so you need to ssh elasticserach02.openstack.org -L9200:localhost:9200 and connect to localhost:9200 using those two tools20:53
clarkbpabelanger: anteaya I use v2.5.0 of bigdesk and 7db19b1d6f4da7015b930f0a23b9a7a316495b4e of head20:53
pabelangerclarkb: anteaya: 312701 +A20:54
clarkbusually master chases latest elasticsearch so you have to dig through their change logs to find versions that work with the version we hvae running20:54
anteayaI can't ssh to es02.o.o so will just follow along, and thank you20:54
*** Sukhdev has quit IRC20:54
clarkbanteaya: ya it really is annoying they don't have proper authN20:54
clarkbpabelanger: let me know when you get those working against current cluster20:54
anteayaoh well, one thing at a time20:54
clarkband I can do my best to not butcher what each is showing them20:54
*** tphummel has quit IRC20:55
anteayathanks for including me in the instructions20:55
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272520:55
*** doug-fish has quit IRC20:55
clarkboh if I wasnt clear you clone those two repos and run their index.html's off local disk20:55
pabelangerAh20:56
*** jaypipes has quit IRC20:56
clarkbpabelanger: anteaya they are all html and js so you can run them off local disk in firefox or chrome or whatever20:56
*** doug-fi__ has quit IRC20:57
pabelangerokay, sshing to elasticsearch02.openstack.org20:57
*** madhu_ak has quit IRC20:57
clarkbfor head you have to go to _site/index.html but bigdesk has index.html at root20:57
clarkbpabelanger: let me know when you have each running of if you need more infos, should git clone, chekcout the refs above, then file:///path/to/index.html20:58
*** rhallisey has quit IRC20:59
*** julim has quit IRC20:59
pabelangerclarkb: does it matter which order I run elasticsearch-head and bigdesk?20:59
clarkbpabelanger: no they are separate tools that do separate things21:00
openstackgerritMerged openstack-infra/system-config: Upgrade elasticsearch to 1.7.5  https://review.openstack.org/31270121:00
clarkbbigdesk shows you performance data, head shows you shard allocations and shard info21:01
clarkbboth very useful21:01
*** julim has joined #openstack-infra21:01
openstackgerritMerged openstack-infra/zuul: Add ansible launch server  https://review.openstack.org/30738921:02
*** bkeller` has left #openstack-infra21:02
*** sputnik13 has joined #openstack-infra21:02
clarkbpabelanger: we can do them one at a time and I can walk you through the basic functionality of each21:02
anteayaclarkb pabelanger caught up now21:02
asselin_dstufft, you around? we're having bandersnatch update issues, and a bug is hinting at pypi issues:  https://github.com/brettcannon/caniusepython3/issues/11621:03
*** dizquierdo has joined #openstack-infra21:03
asselin_http://paste.openstack.org/show/496155/21:04
pabelangerclarkb: just getting npm working21:04
clarkbpabelanger: you don't need that21:04
clarkbpabelanger: its just git clone, git checkout, point browser at file21:05
dstufftashtokolov: huh21:05
dstuffter21:05
dstufftasselin_:21:05
pabelangerclarkb: ah21:05
pabelangerI was following: https://github.com/mobz/elasticsearch-head#running-with-built-in-server21:05
dstufftwonder what it's doing that is taking more than 30 seconds21:05
dstufftoh21:05
dstufftlist_packages_with_serial21:05
dstufftthis is gonna be where I get sad21:05
anteayaclarkb: elasticsearch-head doesn't appear to need to ssh into anything21:05
anteayaclarkb: I'll try it21:05
*** _ari_ has quit IRC21:05
clarkbanteaya: you can see how well it works against the public api but I expect it to fail pretty hard21:06
asselin_dstufft, that's trying to do a full mirror update21:06
*** gyee has quit IRC21:06
dstufftoh boy21:06
clarkbanteaya: it is also possible we can open the public api up more t oallow things to work we just have to avoid write access21:07
dstufftI bet it's this join21:07
anteayaclarkb: oh okay21:07
pabelangerclarkb: okay, bigdesk working. now to other21:07
anteayaclarkb: I'll try this, don't wait for me21:07
clarkbpabelanger: yay21:07
clarkbanteaya: ok21:07
openstackgerritMatthew Treinish proposed openstack/os-testr: Seperate regex builder logic into a seperate module  https://review.openstack.org/31274721:07
*** aeng has joined #openstack-infra21:07
asselin_dstufft, original issue is that bandersnatch failed to mirror oslo.i18n===3.6.021:07
asselin_dstufft, had a serial number and everything was fine....so trying a full resync.21:08
asselin_dstufft, 2 of our mirros missed that package for some reason21:08
*** psilvad has quit IRC21:08
dstuffthttps://bpaste.net/show/0555617c07df lol21:08
pabelangerclarkb: and elasticsearch-head working21:08
dstufftlookit all those sequence scans :(21:08
asselin_that's a lot of rows21:09
clarkbpabelanger: great lets start with bigdesk, when you tell it to connect it should show you the 6 instances and if you click on one you get performance data for that instance21:09
clarkbpabelanger: the one with the star badge is our master21:09
pabelangerclarkb: ack, I see it21:09
anteayaclarkb: do I git checkout sha to use the specific sha?21:10
clarkbpabelanger: data I like here is heap use, cpu/load avg info, and indexing requests per second21:10
clarkbanteaya: git checkout $sha121:10
anteayaclarkb: thank you21:10
*** banix has joined #openstack-infra21:10
*** aysyd has quit IRC21:10
dstufftasselin_: so.21:10
clarkbpabelanger: gives you a good sense for overall health both on rsources and perfomring the indexing21:10
pabelangerk21:10
dstufftI fear this is probably going to require a schema change to make this not braindead21:10
*** harlowja has joined #openstack-infra21:10
clarkbpabelanger: and thats about it for bigdesk its mostly a where are things potentially broken checker21:11
dstufftand I'm probably not going to be able to do that tonight21:11
*** tphummel has joined #openstack-infra21:11
clarkbelasticserach ehad on the othre had shows you each index, all of the shards for that index and detail sabout them like size and location21:11
clarkbcolumns are indexes, rows are hosts21:11
asselin_dstufft, :/ ok fair enough. I will manually add the missing file...21:11
clarkbpabelanger: the bolder boxes are primary shards and ligher boxes are secondary shards, green means happy, yellow means recovering21:11
clarkbpabelanger: you will notice we have a handful of yellow shards, this is the bug I am hoping newer ES fixes21:12
*** ddieterly is now known as ddieterly[away]21:12
dstufftasselin_: I promised my wife I'd take her to see Purple Rain at the theater that's only showing tonight21:12
pabelangerclarkb: yes, I see that21:12
clarkbpabelanger: basically there apperas to be deadlock on ownership of these shards and no on gets ownership of them to properly recovery so they do a round robin across the nodes trying to recover21:12
*** brucet has quit IRC21:13
asselin_dstufft, no problem, can wait a bit since I can work around.21:13
pabelangerclarkb: what does the number in the shard represent?21:13
*** ddieterly[away] is now known as ddieterly21:14
clarkbpabelanger: we have 5 shards per index, its just the designation of which of those 5 it is (well its 5*2 with the secondaries)21:14
anteayaclarkb: currently my elasticsearch-head page is pointing to http://localhost:9200/ I should have it point to http://elasticsearch02.openstack.org:localhost:9200 ?21:15
clarkbanteaya: http://logstash.openstack.org/elasticsearch21:15
anteayathank you21:15
openstackgerritMatthew Treinish proposed openstack/os-testr: Seperate regex builder logic into a seperate module  https://review.openstack.org/31274721:15
anteayaI see things21:15
clarkbpabelanger: once you are comfortable with the two tools we can remove one of the hosts from emergency file, maybe start with 0721:16
clarkbanteaya: neat21:16
anteayaI'm surprised21:16
pabelangerclarkb: sure, removing 07 now21:16
*** ldnunes has quit IRC21:16
pabelanger07 removed21:16
clarkbpabelanger: then when puppet runs it should grab the newer deb, intsall, restart elasticsearch and rejoin the cluster, you can tail /var/log/elasticsearch/elasticsearch.log to see that on host21:16
clarkbbut you will also see 07 disappera from both tools temporarily then come back21:17
clarkband it should cause a flurry of activity on the cluster to rebalance shards21:17
clarkbone thing we can do in addition to this is tell elasticserach to not reallocate thing stemporarily let me figure that out21:17
*** trown is now known as trown|outtypewww21:17
clarkbpabelanger: https://www.elastic.co/guide/en/elasticsearch/reference/current/rolling-upgrades.html#_step_1_disable_shard_allocation21:18
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet/experimental: enable puppet4 jobs on xenial  https://review.openstack.org/31275421:18
clarkbI am ging to run that really quickly21:18
jeblairpabelanger: on 308099 are you saying we have jobs without builders, or in your testing (not using our config), you didn't have one?21:18
pabelangerclarkb: ack21:18
anteayawhen I refresh my elasticsearch-head page the connection defaults back to localhost:920021:18
*** roxanaghe has joined #openstack-infra21:18
*** Sukhdev has joined #openstack-infra21:19
pabelangerjeblair: in my testing, my JJB template did not have a builder.  Adding one fixed the exception21:19
jeblairok, thx21:19
clarkbanteaya pabelanger: http://paste.openstack.org/show/496156/ output from that21:19
*** sputnik13 has quit IRC21:20
*** weshay has quit IRC21:20
*** |-paul-| has joined #openstack-infra21:20
clarkbanteaya: pabelanger then when puppet is done we run https://www.elastic.co/guide/en/elasticsearch/reference/current/rolling-upgrades.html#_step_5_reenable_shard_allocation I will let pabelanger run that one since it will be less time constrained21:20
*** gyee has joined #openstack-infra21:20
anteayawhen I tell bigdesk the REST endpoint is http://logstash.openstack.org/elasticsearch it says, No cluster connected.21:21
pabelangerclarkb: ack21:21
anteayaokay great21:21
clarkbanteaya: it may need bits of the api that are not exposed then21:21
*** piet has joined #openstack-infra21:21
clarkbanteaya: you can use your browser debug things to see what bits of the api it is hitting21:21
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Enable undercloud ssl on nonha job  https://review.openstack.org/27374321:21
anteayaclarkb: I can try21:21
*** bpokorny has joined #openstack-infra21:22
*** thiagop_ has joined #openstack-infra21:23
*** thiagop has quit IRC21:23
*** brucet has joined #openstack-infra21:25
clarkbpabelanger: oh neat elasticsearch's pacakges don't bounce the service, I like this21:25
clarkbpabelanger: you get to service elasticserach stop/start/restart/pick/your/poison21:26
clarkbpabelanger: aptitude show elasticsearch says it did upgrade to 1.7.521:26
*** gyee has quit IRC21:27
pabelangerMay  4 21:24:33 elasticsearch07 puppet-user[32826]: (/Stage[main]/Elasticsearch/Package[elasticsearch]/ensure) ensure changed '1.7.3' to '1.7.5'21:27
pabelangeryup21:27
*** ddieterly is now known as ddieterly[away]21:27
pabelangerclarkb: stopping service21:27
pabelangerstarting21:28
*** thorst has quit IRC21:28
*** thiagop_ has quit IRC21:29
*** thiagop has joined #openstack-infra21:29
clarkbwe should see it start saying things about discovery and the cluster that we are running21:29
clarkbyup just failed to join (its been doing that recently I think this is related to the derp shard situation)21:29
pabelangerack21:29
clarkbin the past it eventually joined21:29
anteayaclarkb: apparently I need addons and am getting mixed information on which addon to get so will return to it later21:31
clarkbpabelanger: if you refresh head you will see all those shards that were on 07 are currently unallocated21:31
*** lakshmiS has quit IRC21:32
clarkbpabelanger: if we hadn't done the curl thing to prevent allocation all of those shards would be assigned to the other 5 hosts then when 07 came back it would have to rebalance and get shards again which is slow21:32
pabelangerclarkb: right21:32
*** eharney has quit IRC21:32
clarkbyay it joined21:33
pabelangerhere we go21:33
*** thorst has joined #openstack-infra21:33
pabelangerneat21:33
clarkbso now you can run the command to renable allocatio nand bring 07 fully back in21:33
pabelangerlet me check URL21:33
clarkbpabelanger: I put the command in a file in my homedir on 0221:33
*** signed8bit has quit IRC21:33
clarkbpabelanger: transient_enable_allocation.txt21:33
clarkbpabelanger: there is also transient_disable_allocation.txt that we should run prior to each service restart21:34
pabelangerclarkb: an they should be run on the node we are working on correct?21:34
clarkbpabelanger: any of the cluster members will work21:35
anteayaclarkb: is 02 where you keep your scripts for all of them?21:35
clarkbabramley: it is a cluster wide install21:35
pabelangerclarkb: ah, I see21:35
clarkbanteaya: not really, I just copy pasta'd from elasticsearch's docs and put it in a file just now21:35
anteayaah21:35
clarkber sorry abramley bad tab completion21:35
abramleyno worries21:35
pabelangerclarkb: command run21:36
clarkbpabelanger: now thta you have run the allocatio nenable command if you refresh head you will see those shards start to recover21:36
*** sputnik13 has joined #openstack-infra21:36
clarkbpabelanger: eventually we should get back to a mostly steady state like the one we were in before at which point we can do 06 and so on21:36
anteayaall but one appears allocated to 07 now according to my view21:37
pabelangeranteaya: same21:37
*** roxanaghe has quit IRC21:37
*** thorst has quit IRC21:37
clarkbya I think it will only do 2 at a time per host21:38
clarkbso the two yellow ones of 07 right now are using all that capacity, when one of those finishes the last greyed out one should start21:38
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: change email topic tags based on summit feedback  https://review.openstack.org/31276221:38
*** gyee has joined #openstack-infra21:39
clarkbpabelanger: anteaya also if you click on those yellow shards on 07 the size in bytes should steadily go up21:39
anteayaclarkb: cool21:39
*** roxanaghe has joined #openstack-infra21:40
*** vgridnev has quit IRC21:40
*** inc0 has quit IRC21:40
anteayathe one marked 4 is increasing, the one marked 1 is not21:41
*** electrocucaracha has joined #openstack-infra21:43
electrocucarachahey there, I was checking some workflow of the gate jobs of neutron and I found this line https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L54021:43
electrocucarachaI just wondering if you're collecting metrics about those nodes21:44
clarkbelectrocucaracha: it is all indexed by elasticsearch so we have a rolling 10 day window view into that21:44
clarkbhowever 10 minutes is pretty quick for modern devstack so maybe we need to update that number21:45
*** chlong has quit IRC21:45
electrocucarachaclarkb: nice, so you're monitoring those numbers in case that the performance got impacted right?21:45
mtreinishclarkb: http://status.openstack.org/openstack-health/#/test/devstack?groupKey=project&resolutionKey=hour&end=2016-05-04T15:12:15.164Z&duration=P1M21:45
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272521:46
pabelangerclarkb: anteaya: okay, looks like unknown shard has been moved21:46
clarkbpabelanger: anteaya so ya tahts the basic process. If we do an upgrade that requires a full cluster restart its the same basic process except we do a persistent disable allocation, stop all nodes, start all nodes, let cluster discover itself, then persistent enable allocation21:46
*** degorenko is now known as _degorenko|afk21:46
clarkbelectrocucaracha: http://status.openstack.org/elastic-recheck/ that used to have a graph tracking it but I don't see it anymore21:46
mtreinishclarkb: we removed that query because it didn't mean anythign useful21:47
*** amrith is now known as _amrith_21:47
pabelangerclarkb: anteaya: very cool. I think have the basic process for a single server upgrade21:47
*** inc0 has joined #openstack-infra21:47
clarkbmtreinish: it would if we updated the string and check in d-g...21:47
anteayapabelanger: I confirm all nodes have been allocated21:47
electrocucarachaclarkb: the link that mtreinish shared has those numbers, I guess21:47
mtreinishclarkb: we can track the execute time better with openstack-health now anyway21:48
anteayaclarkb: shards have been allocated or nodes have been allocated? which is the correct term?21:48
clarkbpabelanger: anteaya it is possible this silly bug will survive the rolling upgrade, if that happens I/we/you can try a full  cluster upgrade later21:48
clarkbanteaya: shards21:48
anteayaclarkb: thank you21:48
*** DevBox has joined #openstack-infra21:48
anteayaclarkb pabelanger ack21:48
clarkbmtreinish: thats fair, it wasn't elasticsearch's fault the data wasn't meaningful, that is all devstack and devstack-gate21:48
clarkblike 10 minutes is fast these days :(21:49
anteayapabelanger: yay21:49
pabelangerclarkb: anteaya: great. I have to step away for a few minutes21:49
anteayapabelanger: ack21:49
*** mriedem has quit IRC21:50
*** bauzas is now known as bauzas_off21:50
clarkbpabelanger: ok, I think we are ready to remove 06 from the list whenever you are and we can iterate through the list. I will be mostly around but not fully here due to conference plague21:50
*** ddieterly[away] is now known as ddieterly21:50
anteayaclarkb: did you get any rest at all?21:50
*** sdague has quit IRC21:51
mtreinishclarkb: sure no argument there21:51
anteayain elasticsearch-head 05 has a star beside it21:51
clarkbanteaya: thta means it is the master21:51
anteayaall the other nodes have circles21:51
pabelangerclarkb: sure, I can do 06 now. Do we need to get through all of them today?21:51
anteayaclarkb: and the master moves around, right?21:51
clarkbpabelanger: no need to get through them all today, this is why I decided to get an earlier start so we could take our time21:52
anteayapabelanger: might as well if we can, then they are all in the same state21:52
anteayaoh okay21:52
clarkbanteaya: yes, any time the existing master goes away the others elect a new master21:52
anteayawell as long as they all get finished21:52
anteayaclarkb: ah21:52
clarkbya definitely wnat to get it done soonish but not necessarily today21:52
*** Sukhdev has quit IRC21:52
pabelangerclarkb: okay, 06 removed from emergenty21:52
pabelangeremergency*21:52
anteayaI wonder how they conduct their election21:52
*** Sukhdev has joined #openstack-infra21:52
anteayaI guess once we remove 05 we will see what happens21:53
openstackgerritMerged openstack/requirements: Fix babel test  https://review.openstack.org/31263521:54
anteayaclarkb: I'm looking at the info for 05, which parameter says it is the master?21:55
*** rockyg has quit IRC21:56
clarkbanteaya: its ephemeral and determined by the cluster, so the cluste ragreeing it is the master means it is the master21:56
anteayaah so it doesn't show up in the info about that node21:56
*** flwang1 has joined #openstack-infra21:56
anteayathanks21:56
*** Nemat has joined #openstack-infra21:56
*** bdemers has quit IRC21:58
*** bdemers_ has joined #openstack-infra21:58
NematI am trying to create a wiki page but i get error 50022:00
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: translations: Ignore version failures  https://review.openstack.org/31276522:00
*** dmk0202 has quit IRC22:01
anteayaNemat: we have disabled wiki services for new folks due to spamming22:02
anteayaNemat: had you interacted with our wiki prior to now?22:02
NematI would like to create workgroup and i need the wiki, is it possible to help me with this?22:03
Nematno22:03
anteayacan you sign into the wiki?22:03
*** Sukhdev has quit IRC22:04
EmilienMpabelanger: can we try again the tarballs you think?22:04
*** rockyg has joined #openstack-infra22:04
anteayaNemat: is Nemat your wiki username?22:05
EmilienMcould I have a review on my attempt to have periodic jobs for our puppet constraints please? https://review.openstack.org/#/c/301375/22:05
*** chlong has joined #openstack-infra22:05
rockygHey folks, I'm trying help Nemat, too. He's in my office.22:05
rockygAre you looking for his email address?  nematollah.bidokhti@huawei.com22:06
anteayaI can't find a wiki user with Nemat as a username22:06
anteayano I am looking for the wiki username22:06
*** Goneri has joined #openstack-infra22:06
anteayaand I too am trying to help this person22:06
*** julim has quit IRC22:06
*** regXboi has quit IRC22:07
anteayahaving this person reply to my questions would be a big help regarding my abiltiy to support them22:07
rockygHe was using his openID to sign in, and he got http 500\22:07
rockygHe22:07
*** ddieterly is now known as ddieterly[away]22:07
rockyg's standing over my shoulder as I type...22:07
anteayaso my question was can you log in22:07
*** flwang1 has quit IRC22:07
anteayaare you saying the answer to 'can you log in' is no?22:07
rockyggoing to wiki now and trying...22:08
anteayahe is or you are?22:08
rockyghe is...22:08
anteayafull sentences help me22:08
anteayathank you22:08
*** amitgandhinz has quit IRC22:08
rockygI hear your request for full sentences.22:09
anteayathank you, rockyg, I appreciate it22:09
*** kgiusti has left #openstack-infra22:10
rockygHe clicks on the "login/create account with OpenID" at the top of the page.22:10
rockyghe is taken the ubuntuOne personal data request page (https://login.launchpad.net/string of ascii"22:11
*** netsin has joined #openstack-infra22:11
rockygThere are three check boxes:  Full name, email address, preferred language.  All lines are filled out with his account info and the boxes are checked.22:12
rockygHe clicks on Yes, log me in, which goes to the http 500 page22:13
anteayaright22:13
anteayaso as I said at the beginning, we have disabled wiki services for new users22:13
anteayadue to spamming22:13
*** ccamacho|away has quit IRC22:13
anteayaso if this person has not interacted with our wiki prior to today22:13
anteayathey will not be able to22:14
anteayaclosing services for new accounts was the only way to shut down the spamming22:14
*** flepied has joined #openstack-infra22:14
rockygwould he be able to edit a page, once someone else creates it?22:14
anteayaas they kept creating new accounts faster than we could delete them22:14
anteayano22:14
anteayahe can't access the wiki at all as a new account22:14
rockygIs there any timeline for the mediawiki upgrade?22:15
anteayathis is less than ideal but this is the current status22:15
anteayawell actually we had a design summit session about it22:15
anteayaand long term we agreed to move off the wiki22:15
anteayashort term we agree to upgrade the wiki22:15
rockygI understand, I saw the firefight and the spam/spam traces.22:15
anteayabut we had to arm twist to get volunteers to do the work22:15
*** ccamacho has joined #openstack-infra22:15
rockygOuch22:16
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272522:16
*** asettle has joined #openstack-infra22:16
anteayathe first step is upgrade the os for the service, and that is tentitively scheduled for our infra sprint of upgrade to trusty for all services22:16
rockygDo you know what is being considered for an alternative?22:16
rockygCool.22:16
pabelangerEmilienM: images don't have the updated run_tarball.sh script yet22:16
anteayawe are hoping to do that sprint in R-19 but will talk again next infra meeting to finalize that date22:16
anteayarockyg: moving as much as possible within repos22:16
pabelangerEmilienM: we can try tomorrow afternoon22:17
rockygI'll make sure to make the meeting to get updated.22:17
anteayaso documentation, team pages, manuals, all within the project repo22:17
anteayarockyg: thank you22:17
rockygThanks so much, anteaya22:17
rockygAnd, Nemat now has one more skill, IRC :-)22:17
anteayathe agenda item is about picking the week for the os upgrade sprint for all our services on not trusty right now22:17
anteayanot specifically about the wiki22:17
anteayarockyg: yay for learning irc!22:18
anteaya:)22:18
rockygThat's ok.  Still good to have the earliest not impossible start date ;-)22:18
anteayarockyg: yup, understood22:18
*** Guest65326 has quit IRC22:19
rockygAnother question that has been raised is how to create a new mailing list for the working group he is forming.22:19
anteayarockyg: here is the etherpad for the wiki design summit session: https://etherpad.openstack.org/p/newton-infra-wiki-upgrades22:19
rockygI went looking for documentation and couldn't find any beyond the mail-info page.22:19
*** dimtruck is now known as zz_dimtruck22:19
rockygThank you!22:19
anteayahaving a new mailing list per working group usually signals the demise of the working group22:19
anteayawasn't it HPC that died that way?22:20
*** gordc has quit IRC22:20
anteayamy suggestion on the mailing list question is find a list that suits the working group and join that one22:20
pabelangerclarkb: anteaya: okay, 06 upgraded and back online, transient allocation enabled again22:20
anteayagoing off in a corner isolates the members22:20
anteayapabelanger: thank you22:20
*** asettle has quit IRC22:21
rockygI don't know.  But,this is a new group he wants to get off the ground and wants it very focused.  The problem space encompasses all of OpenStack and is both ops and users focused22:21
*** sigmavirus24 is now known as sigmavirus24_awa22:21
anteayathen I would start on either the ops list or the user committee list22:21
anteayaI really really really would not suggest a new list22:21
clarkbpabelanger: woot22:21
anteayareally really really22:21
*** flwang1 has joined #openstack-infra22:22
*** thorst has joined #openstack-infra22:22
* anteaya goes to start some dinner22:23
EmilienMpabelanger: cool nothing urgent22:23
*** baoli has joined #openstack-infra22:24
*** baoli_ has joined #openstack-infra22:25
pabelangerclarkb: so, once we talk jenkins05 offline, it will start the election process right?22:26
clarkbes05 and yes22:26
*** thorst has quit IRC22:26
*** tphummel has quit IRC22:27
openstackgerritSahdev Zala proposed openstack/requirements: Update to recent release of tosca-parser 0.5.0  https://review.openstack.org/31273922:27
*** tpsilva has quit IRC22:27
pabelangerclarkb: oh, haha. ya22:28
pabelangeres0522:28
*** inc0 has quit IRC22:28
*** piet has quit IRC22:28
*** baoli has quit IRC22:29
*** thiagop has quit IRC22:29
anteayapabelanger: ping before you do that, I'd like to see the election happen if I may22:30
pabelangeranteaya: okay, will do that tomorrow for sure22:30
*** mixos has quit IRC22:30
anteayawonderful thank you22:30
anteayapabelanger: so you want to stop after 06 for tonight?22:30
rockyganteaya, well, I've convinced him to at least *start* with the general email lists for his group.  I've got him getting the three lists he needs, so it's a start.  Again, thanks for your help.22:33
*** earlephilhower has quit IRC22:34
jheskethMorning22:34
*** ddieterly[away] is now known as ddieterly22:34
*** tphummel has joined #openstack-infra22:35
*** ddieterly has quit IRC22:35
*** burgerk has quit IRC22:37
*** esikachev has quit IRC22:40
*** |-paul-| has quit IRC22:42
*** timl0101 has quit IRC22:46
anteayarockyg: glad your guidance was heeded22:46
anteayarockyg: good work22:46
anteayajhesketh: morning22:46
*** gordc has joined #openstack-infra22:50
pabelangerclarkb: do you mind looking at es06 and the unassigned shards. Want to make sure everything is okay22:51
clarkbsure give me a minute22:51
*** harlowja has quit IRC22:52
*** harlowja has joined #openstack-infra22:53
*** adduarte has quit IRC22:53
*** adduarte has joined #openstack-infra22:54
*** banix has quit IRC22:54
*** vhosakot has quit IRC22:54
anteayapabelanger: yeah those shards aren't being assigned as fast as what happened on 0722:56
*** HeOS has quit IRC22:56
pabelangeranteaya: yes, my concern too22:56
anteayapabelanger: good call22:56
* clarkb grumps I think this is the bug biting us22:58
clarkbif you click on the shards and see their sizes they are both 022:58
anteaya:(22:58
clarkbwhich means they are not recovering22:58
clarkbI guess this means we get to do a full cluster restart tomorrow :)22:58
anteayaclarkb: I confirm22:58
pabelangerack22:58
anteayawoooo, more learning22:58
anteayapabelanger: glad you got to learn how to restart one node22:58
pabelangeronto the cluster now!22:59
pabelanger:)22:59
clarkbso ya lets aim for doing 02-05 all together tomorrow22:59
pabelangerwfm22:59
clarkbpabelanger: anteaya process for thta would be let puppet run on all of them which won't restart services. run persistent instead of transient command to disable allocation22:59
anteayasounds good22:59
clarkbthen restart services on entire cluster22:59
anteayaokey dokey22:59
clarkbincluding 06 and 0722:59
clarkbthen renable allocation23:00
anteayaglad we started tonight then23:00
*** _amrith_ is now known as amrith23:00
*** dizquierdo has quit IRC23:01
*** pradk has quit IRC23:01
clarkbbasically those shards are failing to allocate and I think it is due to the issues that hubcap says are fixed in this newer version23:02
clarkbthat said I half expect a full restart to clear the issue regardless23:02
anteayaokay23:02
* anteaya crosses her fingers23:03
pabelangerokay, works for me23:03
pabelangerIf both have another minute, I'd like to get another eyes on https://review.openstack.org/#/c/312248/23:04
pabelangerfor our ubuntu-precise dibs23:04
pabelangerwouldn't mind working on them tomorrow if possible23:04
*** asettle has joined #openstack-infra23:04
*** baoli_ has quit IRC23:05
anteayapabelanger: what is the purpose of https://review.openstack.org/#/c/312248/5/puppet-foo.tar.gz23:05
pabelangeranteaya: cruff :(23:06
pabelangeranteaya: let me fix23:06
anteayaah wondered if that was it23:06
anteayathanks23:06
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add ubuntu-precise dib to nodepool  https://review.openstack.org/31224823:07
pabelangeranteaya: thanks for spotting that23:07
*** sputnik13 has quit IRC23:07
*** sputnik13 has joined #openstack-infra23:07
*** baoli has joined #openstack-infra23:08
anteayapabelanger: thanks for fixing that :)23:09
*** ddieterly has joined #openstack-infra23:10
anteayadinner smells like it is ready23:10
*** sputnik13 has quit IRC23:11
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272523:11
*** Sukhdev has joined #openstack-infra23:13
*** sputnik13 has joined #openstack-infra23:13
*** banix has joined #openstack-infra23:15
*** akshai has quit IRC23:16
*** jsavak has quit IRC23:16
jamielennoxAJaeger: if you're around can you have another look at https://review.openstack.org/#/c/271127/ - dependant job has merged23:18
*** sputnik13 has quit IRC23:20
*** sputnik13 has joined #openstack-infra23:20
*** akshai has joined #openstack-infra23:20
*** gordc has quit IRC23:20
*** akshai has quit IRC23:21
*** xarses has quit IRC23:22
*** Nemat has quit IRC23:23
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: User right pipeline for neutron periodic jobs  https://review.openstack.org/31278323:25
openstackgerritMerged openstack-infra/project-config: Add ubuntu-precise dib to nodepool  https://review.openstack.org/31224823:29
*** hashar has quit IRC23:30
*** bapalm_ has quit IRC23:30
*** sputnik13 has quit IRC23:34
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272523:35
*** sdake has quit IRC23:37
*** dingyichen has joined #openstack-infra23:38
*** salv-orlando has quit IRC23:39
*** ddieterly is now known as ddieterly[away]23:40
*** ddieterly[away] is now known as ddieterly23:42
*** Guest92802 has quit IRC23:43
*** banix has quit IRC23:44
fungiunless anyone objects strongly, i'm planning to self-approve 202728 (cleaning up pypi metadata/classifiers) for bindep and then tag a 1.0.0 release for it23:44
fungithe only outstanding patches for it are my exit codes series, and the current plan won't introduce any backward imcompatibilities so i'm fine holding it back for a 1.1.0 later23:45
*** sridhar_ram has quit IRC23:47
*** Swami has quit IRC23:47
*** piet has joined #openstack-infra23:48
anteayaI do not object23:49
*** dkehn__ is now known as dkehn_23:49
anteayanot even mildly23:49
*** fawadkhaliq has joined #openstack-infra23:50
*** amit213 has joined #openstack-infra23:51
*** davideagnello has quit IRC23:51
*** fawadk has quit IRC23:52
*** davideagnello has joined #openstack-infra23:52
*** xyang1 has quit IRC23:55
*** davideagnello has quit IRC23:56
*** rbrndt has quit IRC23:57
*** mixos has joined #openstack-infra23:57
*** roxanaghe has quit IRC23:58
*** bpokorny has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!