Friday, 2017-05-26

*** sflanigan has joined #openstack-infra00:02
*** r-daneel has quit IRC00:02
*** markvoelker has joined #openstack-infra00:04
openstackgerritLingxian Kong proposed openstack-infra/project-config master: Config gerrit bot to Qinling  https://review.openstack.org/46820200:05
*** thorst has joined #openstack-infra00:06
openstackgerritClark Boylan proposed openstack-infra/nodepool feature/zuulv3: Drop -e for pip install for devstack plugin.sh  https://review.openstack.org/46812700:12
*** gomarivera has joined #openstack-infra00:13
*** markvoelker has quit IRC00:16
*** jamesmca_ has quit IRC00:17
*** brd has quit IRC00:20
*** adriant has joined #openstack-infra00:21
*** markvoelker has joined #openstack-infra00:21
*** thorst has quit IRC00:22
*** thorst has joined #openstack-infra00:22
*** gomarivera has quit IRC00:22
*** gomarivera has joined #openstack-infra00:23
*** brd has joined #openstack-infra00:25
*** brd has joined #openstack-infra00:25
*** gomarivera has quit IRC00:26
*** gomarivera has joined #openstack-infra00:26
*** esikachev has joined #openstack-infra00:27
*** markvoelker has quit IRC00:27
*** thorst has quit IRC00:27
*** xyang1 has quit IRC00:28
*** markvoelker has joined #openstack-infra00:30
*** markvoelker has quit IRC00:31
*** esikachev has quit IRC00:32
*** dimtruck is now known as zz_dimtruck00:32
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Stop running tests on trusty for ansible-role-zuul  https://review.openstack.org/46822200:33
*** gomarivera has quit IRC00:33
clarkbfungi: http://logs.openstack.org/07/468207/1/check/gate-grenade-dsvm-neutron-ubuntu-xenial/11421e0/logs/stackviz/#/stdin/timeline that is running off of compressed json in stackviz00:33
clarkbfungi: the grenade job doesn't have a ton of stackviz data though so not great for a cost savings comparison00:33
*** gomarivera has joined #openstack-infra00:34
clarkbit does show that it works00:34
fungiyep, i concur00:34
*** esikachev has joined #openstack-infra00:34
*** ym200 has joined #openstack-infra00:38
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Revert "Use devstack's zookeeper support"  https://review.openstack.org/46820500:38
*** esikachev has quit IRC00:39
*** esikachev has joined #openstack-infra00:40
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use networkx for digraph  https://review.openstack.org/46741900:41
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Adding unit testing for configuration  https://review.openstack.org/46695900:41
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add a more generic tree->graph parser  https://review.openstack.org/46541700:41
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move create_graph into config.py  https://review.openstack.org/46822400:41
*** jamesmca_ has joined #openstack-infra00:41
*** ym200 has quit IRC00:43
clarkbfungi: gets the py35 job stackviz dir to 3.5MB from 14MB00:45
*** esikachev has quit IRC00:47
*** Apoorva_ has joined #openstack-infra00:47
*** cuongnv has joined #openstack-infra00:48
*** jamesmca_ has quit IRC00:49
*** zz_dimtruck is now known as dimtruck00:49
fungiexcellent!00:51
*** markvoelker has joined #openstack-infra00:54
*** ram5391 has joined #openstack-infra00:55
*** Apoorva_ has quit IRC00:57
*** markvoelker has quit IRC00:58
*** markvoelker has joined #openstack-infra00:58
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Do not install recommended packages with zypper  https://review.openstack.org/46822500:59
clarkbAJaeger: shouldnt you be sleeping?01:00
*** yuanying_ has joined #openstack-infra01:01
AJaegerclarkb: That's what I'm asking myself as well ;) will do soonish again01:01
AJaegerdirk: ^01:01
*** ihrachys has joined #openstack-infra01:02
openstackgerritMerged openstack-infra/devstack-gate master: gzip the ARA report after generating it  https://review.openstack.org/46815201:02
*** yuanying has quit IRC01:02
*** gomarivera has quit IRC01:04
*** gomarivera has joined #openstack-infra01:05
*** rlandy has quit IRC01:05
*** baoli has joined #openstack-infra01:05
AJaegerpabelanger: thanks for removing ant - but I suggest to use 468225 as well, we're explicit and don't need recommended packages in general01:06
*** tuanluong has joined #openstack-infra01:06
*** ram5391 has quit IRC01:07
*** gomarivera has quit IRC01:08
*** gomarivera has joined #openstack-infra01:09
*** amotoki_away is now known as amotoki01:17
*** gouthamr has quit IRC01:20
*** dave-mccowan has joined #openstack-infra01:21
*** liujiong has joined #openstack-infra01:23
*** yolkfull_ has joined #openstack-infra01:24
*** gouthamr has joined #openstack-infra01:25
*** thorst has joined #openstack-infra01:27
*** ihrachys has quit IRC01:27
*** jascott1 has quit IRC01:28
*** yuanying_ has quit IRC01:30
*** ym200 has joined #openstack-infra01:31
pabelangerAJaeger: I'd rather see about setting up a global zypper config setting if possible, this is what we do for apt today: http://git.openstack.org/cgit/openstack/diskimage-builder/tree/diskimage_builder/elements/dpkg/pre-install.d/00-disable-apt-recommends01:32
*** thorst has quit IRC01:32
pabelangerAJaeger: does zypper support disabling it via a config file?01:32
clarkbyes01:33
clarkbhttps://github.com/openSUSE/zypper/blob/master/zypper.conf01:33
clarkbsee the install recommends line01:33
clarkbso we can edit that01:33
*** hichihara has joined #openstack-infra01:33
pabelangerk, we should update opensuse-minimal to do so01:33
*** yuanying has joined #openstack-infra01:34
pabelangerI can look tomorrow on how to do that01:34
clarkbcan do it for zypper alone or all libzypp users01:34
clarkbprobably want to do it for libzypp all together for consistency01:34
*** ym200 has quit IRC01:35
pabelangerlook like python35 for nodepool worked01:36
*** dave-mccowan has quit IRC01:36
pabelangerbut, I see an error in nodepool01:36
pabelangerhttp://logs.openstack.org/27/468127/2/experimental/gate-dsvm-nodepool-py35-src-nv/36548d9/logs/screen-nodepool-launcher.txt.gz#_May_26_01_17_52_86687901:36
*** bobh has joined #openstack-infra01:36
pabelangermust have missed that before01:37
*** mriedem has quit IRC01:38
*** markvoelker has quit IRC01:41
*** bobh has quit IRC01:47
*** thorst has joined #openstack-infra01:48
*** thorst has quit IRC01:48
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move create_graph into config.py  https://review.openstack.org/46822401:49
*** sflanigan is now known as sflanigan_afk01:50
ianwthat's about enough "git ate my homework" for one day :/01:51
*** zhurong has joined #openstack-infra01:51
ianwtoo easy to squish things together when doing a rebase that includes editing steps & merge failures01:52
*** gomarivera has quit IRC01:53
*** gomarivera has joined #openstack-infra01:54
*** esikachev has joined #openstack-infra01:58
*** rfolco has joined #openstack-infra01:58
*** gomarivera has quit IRC01:58
*** baoli has quit IRC02:02
*** esikachev has quit IRC02:04
*** gomarivera has joined #openstack-infra02:06
*** sflanigan_afk is now known as sflanigan02:08
*** esikachev has joined #openstack-infra02:08
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update keyscan for python3 compat  https://review.openstack.org/46825302:09
*** MatthewLi has quit IRC02:10
*** esikachev has quit IRC02:13
*** ijw has quit IRC02:15
*** ijw_ has joined #openstack-infra02:19
*** esikachev has joined #openstack-infra02:21
*** ijw_ has quit IRC02:22
*** ijw has joined #openstack-infra02:22
*** MatthewLi has joined #openstack-infra02:23
*** hongbin has joined #openstack-infra02:25
*** esikachev has quit IRC02:25
*** ijw has quit IRC02:27
*** larainema has quit IRC02:32
*** esikachev has joined #openstack-infra02:37
*** esikachev has quit IRC02:42
*** esikachev has joined #openstack-infra02:42
*** xinliang has quit IRC02:46
*** gouthamr has quit IRC02:46
*** gouthamr has joined #openstack-infra02:47
*** thorst has joined #openstack-infra02:49
*** mat128 has quit IRC02:49
*** bobh has joined #openstack-infra02:49
*** esikachev has quit IRC02:49
*** yuanying has quit IRC02:51
*** rfolco has quit IRC02:51
*** bobh has quit IRC02:52
*** gongysh has joined #openstack-infra02:53
*** thorst has quit IRC02:54
*** yuanying_ has joined #openstack-infra02:55
*** yamamoto_ has joined #openstack-infra02:55
*** larainema has joined #openstack-infra03:00
*** pradk has quit IRC03:11
*** psachin has joined #openstack-infra03:36
*** vikrant has joined #openstack-infra03:39
*** esikachev has joined #openstack-infra03:41
*** esikachev has quit IRC03:45
*** jamesmca_ has joined #openstack-infra03:49
*** thorst has joined #openstack-infra03:50
*** gomarivera has quit IRC03:51
*** jamesmca_ has quit IRC03:54
*** thorst has quit IRC03:54
*** esikachev has joined #openstack-infra04:02
*** hongbin has quit IRC04:04
*** SumitNaiksatam has joined #openstack-infra04:06
*** esikachev has quit IRC04:06
*** pfallenop has quit IRC04:07
*** zhurong has quit IRC04:07
*** yamamoto_ has quit IRC04:08
*** dimtruck is now known as zz_dimtruck04:12
*** gouthamr has quit IRC04:14
*** markvoelker has joined #openstack-infra04:19
*** ykarel has joined #openstack-infra04:21
*** esikachev has joined #openstack-infra04:23
*** xarses has joined #openstack-infra04:26
*** esikachev has quit IRC04:27
*** esikachev has joined #openstack-infra04:29
*** esikachev has quit IRC04:33
*** adreznec has quit IRC04:41
*** adreznec has joined #openstack-infra04:45
*** esikachev has joined #openstack-infra04:45
*** zhurong has joined #openstack-infra04:45
*** thorst has joined #openstack-infra04:51
*** esikachev has quit IRC04:52
*** ijw has joined #openstack-infra04:55
*** thorst has quit IRC04:55
*** yuanying_ has quit IRC04:57
*** yuanying has joined #openstack-infra04:57
*** ijw has quit IRC04:58
*** ramishra has joined #openstack-infra05:01
*** psachin has quit IRC05:01
*** armax has quit IRC05:02
*** psachin has joined #openstack-infra05:06
*** salv-orlando has joined #openstack-infra05:06
*** prateek has joined #openstack-infra05:07
*** prateek has quit IRC05:07
*** psachin has quit IRC05:07
*** prateek has joined #openstack-infra05:08
*** yamamoto_ has joined #openstack-infra05:08
*** psachin has joined #openstack-infra05:09
*** claudiub has joined #openstack-infra05:16
*** prateek has quit IRC05:18
*** yuanying has quit IRC05:23
ramishraHi guys, can we've this simple patch https://review.openstack.org/#/c/467703/ reviewed, it's a blocker for heat to move to use uwsgi in the gate jobs05:25
*** hichihara has quit IRC05:26
*** HeOS has joined #openstack-infra05:26
*** gyee has quit IRC05:26
*** kjackal_ has joined #openstack-infra05:29
*** yuanying has joined #openstack-infra05:29
openstackgerritIan Wienand proposed openstack-infra/irc-meetings master: Move dib meeting to even weeks  https://review.openstack.org/46827005:30
*** yolanda has joined #openstack-infra05:32
*** salv-orlando has quit IRC05:38
*** pcaruana has joined #openstack-infra05:43
*** esikachev has joined #openstack-infra05:44
*** cshastri has joined #openstack-infra05:44
*** armax has joined #openstack-infra05:48
*** adriant has quit IRC05:49
*** esikachev has quit IRC05:49
*** thorst has joined #openstack-infra05:52
*** yuanying has quit IRC06:02
openstackgerritIan Wienand proposed openstack-infra/project-config master: diskimage-builder python3 jobs to voting  https://review.openstack.org/46827506:03
*** amotoki is now known as amotoki_away06:03
*** amotoki_away is now known as amotoki06:03
*** yuanying has joined #openstack-infra06:05
*** shu-mutou-AWAY has quit IRC06:07
*** prateek has joined #openstack-infra06:08
*** thorst has quit IRC06:10
*** rcernin has joined #openstack-infra06:10
*** markvoelker has quit IRC06:12
*** amotoki is now known as amotoki_away06:13
*** amotoki_away is now known as amotoki06:19
openstackgerritIan Wienand proposed openstack-infra/project-config master: diskimage-builder python3 jobs to voting  https://review.openstack.org/46827506:21
*** armax has quit IRC06:25
*** gildub has quit IRC06:28
*** dhajare has joined #openstack-infra06:29
*** bulat has joined #openstack-infra06:30
openstackgerritMerged openstack-infra/project-config master: Allow nova servers to reach heat services on port 80  https://review.openstack.org/46770306:30
*** salv-orlando has joined #openstack-infra06:32
*** pfallenop has joined #openstack-infra06:34
*** sree has joined #openstack-infra06:37
*** esikachev has joined #openstack-infra06:38
openstackgerritIan Wienand proposed openstack-infra/project-config master: diskimage-builder python3 jobs to voting  https://review.openstack.org/46827506:40
*** markus_z has joined #openstack-infra06:42
*** markvoelker has joined #openstack-infra06:44
openstackgerritMerged openstack/diskimage-builder master: Adding unit testing for configuration  https://review.openstack.org/46695906:45
*** ltomasbo|away is now known as ltomasbo06:47
*** jamielennox is now known as jamielennox|away06:48
*** markvoelker has quit IRC06:49
openstackgerritMerged openstack-infra/project-config master: Stop running tests on trusty for ansible-role-zuul  https://review.openstack.org/46822206:50
openstackgerritMerged openstack-infra/project-config master: Explicitly clone requirements for bifrost  https://review.openstack.org/46806106:53
*** bhavik1 has joined #openstack-infra06:53
openstackgerritMerged openstack-infra/project-config master: explicitly configure the openSUSE mirror paths  https://review.openstack.org/46811806:53
*** pfallenop has quit IRC06:53
*** pfallenop has joined #openstack-infra06:53
*** zhurong has quit IRC06:54
*** ym200 has joined #openstack-infra06:55
*** markvoelker has joined #openstack-infra06:56
*** bhavik1 has quit IRC06:59
*** zhurong has joined #openstack-infra06:59
*** ym200 has quit IRC07:00
*** markvoelker has quit IRC07:02
*** salv-orl_ has joined #openstack-infra07:04
*** gongysh has quit IRC07:05
*** gongysh has joined #openstack-infra07:06
*** jaosorior has joined #openstack-infra07:06
*** salv-orlando has quit IRC07:06
*** gongysh has quit IRC07:07
*** shardy has joined #openstack-infra07:07
*** pgadiya has joined #openstack-infra07:07
*** thorst has joined #openstack-infra07:07
*** Dinesh_Bhor has quit IRC07:07
AJaegeryolanda: could you review https://review.openstack.org/467924 as well, please?07:09
*** pgadiya has quit IRC07:10
*** markvoelker has joined #openstack-infra07:11
*** thorst has quit IRC07:11
*** ralonsoh has joined #openstack-infra07:12
*** Dinesh_Bhor has joined #openstack-infra07:13
yolandasure, i had to stop with the review queue for a while07:13
*** markvoelker has quit IRC07:15
AJaegerthanks07:16
*** aviau has quit IRC07:19
*** aviau has joined #openstack-infra07:19
*** gongysh has joined #openstack-infra07:19
openstackgerritMerged openstack-infra/project-config master: Handle traceroute in /usr/sbin  https://review.openstack.org/46792407:21
openstackgerritMerged openstack-infra/project-config master: Add ansible-hardening repository  https://review.openstack.org/46733907:22
*** sree has quit IRC07:24
*** markvoelker has joined #openstack-infra07:25
*** salv-orl_ has quit IRC07:27
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Do not merge: Test Featureset 021  https://review.openstack.org/46547607:29
*** markvoelker has quit IRC07:30
*** jpena|off is now known as jpena07:33
*** dizquierdo has joined #openstack-infra07:39
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Do not merge - Testing featureset020  https://review.openstack.org/46500307:39
*** vikrant has quit IRC07:41
openstackgerritMerged openstack-infra/project-config master: tooz: gate on etcd3gw  https://review.openstack.org/46781407:46
openstackgerritMerged openstack-infra/project-config master: Remove .npm cache from stackviz element  https://review.openstack.org/46805907:47
*** openstackgerrit has quit IRC07:48
*** openstackgerrit has joined #openstack-infra07:48
openstackgerritMerged openstack-infra/project-config master: Remove 99-cache-testrepository-db from cache-devstack element  https://review.openstack.org/46807407:48
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: Disable recommended package installations for zypper-minimal  https://review.openstack.org/46830007:48
openstackgerritMerged openstack-infra/project-config master: jenkins: scripts: Sync the .gitignore file in the OpenStack Ansible projects  https://review.openstack.org/46802307:49
*** HeOS has quit IRC07:50
*** jamesmca_ has joined #openstack-infra07:50
openstackgerritDirk Mueller proposed openstack-infra/project-config master: DIB: stop testing precise builds in non-voting  https://review.openstack.org/46818307:51
*** camunoz has quit IRC07:54
openstackgerritDirk Mueller proposed openstack-infra/project-config master: Don't install bindep-fallbacks with recommends turned on  https://review.openstack.org/46830307:54
*** jamesmca_ has quit IRC07:55
*** sshnaidm is now known as sshnaidm|off07:55
AJaegerdirk: see pabelanger's comment above on how to handle the recommands - in diskimage builder (around 1:32 UTC)07:59
*** jascott1 has joined #openstack-infra07:59
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-infra08:00
*** jpich has joined #openstack-infra08:03
*** rossella__ has joined #openstack-infra08:04
*** rossella__ has quit IRC08:04
*** kjackal_ has quit IRC08:05
*** rossella_s has joined #openstack-infra08:05
*** thorst has joined #openstack-infra08:07
*** aarefiev_afk is now known as aarefiev08:10
*** thorst has quit IRC08:13
*** dizquierdo has quit IRC08:14
*** lucas-afk is now known as lucasagomes08:18
*** sshnaidm|off has quit IRC08:18
*** markvoelker has joined #openstack-infra08:19
*** efoley has joined #openstack-infra08:22
*** markvoelker has quit IRC08:28
*** pbourke has quit IRC08:30
*** pbourke has joined #openstack-infra08:30
*** salv-orlando has joined #openstack-infra08:31
*** derekh has joined #openstack-infra08:38
*** e0ne has joined #openstack-infra08:39
*** sflanigan has quit IRC08:43
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: [NO MERGE] test multinode containers  https://review.openstack.org/46710008:44
*** gomarivera has joined #openstack-infra08:55
*** jascott1 has quit IRC08:56
*** jascott1 has joined #openstack-infra08:57
*** gomarivera has quit IRC09:00
*** jascott1 has quit IRC09:02
*** electrofelix has joined #openstack-infra09:02
*** thorst has joined #openstack-infra09:08
*** thorst has quit IRC09:13
*** markvoelker has joined #openstack-infra09:13
*** markvoelker has quit IRC09:18
*** raissa_ has joined #openstack-infra09:18
*** raissa has quit IRC09:19
*** zhurong has quit IRC09:19
*** raissa_ is now known as raissa09:19
*** raissa is now known as Guest1382909:20
*** sambetts|afk is now known as sambetts09:20
openstackgerritSpyros Trigazis (strigazi) proposed openstack-infra/project-config master: [magnum] Add Centos DC/OS DIB  https://review.openstack.org/46832809:20
*** rossella_ has joined #openstack-infra09:22
*** rossella_s has quit IRC09:23
*** dizquierdo has joined #openstack-infra09:23
*** Guest13829 has quit IRC09:31
*** raissa has joined #openstack-infra09:32
*** markvoelker has joined #openstack-infra09:47
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/46833609:48
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config master: neutron-vpnaas: Make gate-neutron-dsvm-tempest-vpnaas-ubuntu-xenial voting  https://review.openstack.org/46833709:49
*** markvoelker has quit IRC09:52
*** mpaolino has joined #openstack-infra09:53
*** esikache1 has joined #openstack-infra09:58
*** esikachev has quit IRC09:59
*** MatthewLi has quit IRC10:00
*** stakeda has quit IRC10:02
dirkAJaeger: i did see that, and did fix it that way as well but I personally disagree with that approach. I think dib should be less opinionated and not override the distro defaults10:02
dirkAJaeger: the change in dib will take some time to roll out (new release to make, and dib is just being reworked)10:03
dirkSo i consider the fix in jenkins scripts quicker and more correct to roll out10:04
*** amotoki is now known as amotoki_away10:05
*** sdague has joined #openstack-infra10:07
*** thorst has joined #openstack-infra10:09
*** alekhya has joined #openstack-infra10:09
AJaegerdirk: let's discuss with pabelanger later10:09
*** panda|bbl is now known as panda10:11
alekhyahi, iam getting an error with cinder list in nodepool vm like ERROR: 'Namespace' object has no attribute 'os_domain_id'10:12
*** thorst has quit IRC10:13
*** markvoelker has joined #openstack-infra10:15
openstackgerritMerged openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/46833610:18
*** markvoelker has quit IRC10:19
*** liujiong has quit IRC10:21
*** yamamoto_ has quit IRC10:24
*** rook has quit IRC10:27
*** wfoster has quit IRC10:27
*** lucasagomes has quit IRC10:27
openstackgerritJens Rosenboom (frickler) proposed openstack-infra/project-config master: Make broken chef jobs experimental for now  https://review.openstack.org/46835210:29
*** lucasagomes has joined #openstack-infra10:29
*** wfoster has joined #openstack-infra10:30
*** salv-orlando has quit IRC10:30
*** rook has joined #openstack-infra10:30
*** jkilpatr has quit IRC10:30
*** rook is now known as Guest766710:30
*** salv-orlando has joined #openstack-infra10:30
*** markvoelker has joined #openstack-infra10:34
*** gongysh has quit IRC10:36
*** markvoelker has quit IRC10:39
*** lucasagomes has quit IRC10:41
*** cuongnv has quit IRC10:41
*** Guest7667 has quit IRC10:41
*** wfoster has quit IRC10:42
*** sshnaidm|off has joined #openstack-infra10:43
*** markvoelker has joined #openstack-infra10:43
*** markvoelker has quit IRC10:48
*** jkilpatr has joined #openstack-infra10:52
*** rook_ has joined #openstack-infra10:53
*** mriedem has joined #openstack-infra10:53
*** lucasagomes has joined #openstack-infra10:54
*** dtantsur|afk is now known as dtantsur10:55
*** ym200 has joined #openstack-infra10:56
*** esikache1 has quit IRC10:57
*** qba73 has joined #openstack-infra10:57
*** esikachev has joined #openstack-infra10:57
*** wfoster has joined #openstack-infra10:57
*** amotoki_away is now known as amotoki10:59
*** ym200 has quit IRC11:00
*** HeOS has joined #openstack-infra11:01
*** Qiming has quit IRC11:01
*** amotoki is now known as amotoki_away11:01
*** dizquierdo has quit IRC11:02
*** shardy has quit IRC11:03
*** Qiming has joined #openstack-infra11:06
*** cshastri has quit IRC11:06
*** yamamoto has joined #openstack-infra11:06
*** gomarivera has joined #openstack-infra11:06
*** yamamoto_ has joined #openstack-infra11:07
*** yamamoto_ has quit IRC11:08
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Test shared pipeline across multiple gerrits  https://review.openstack.org/46837411:08
*** cshastri has joined #openstack-infra11:08
*** thorst has joined #openstack-infra11:10
*** yamamoto has quit IRC11:10
*** gomarivera has quit IRC11:11
*** rwsu has quit IRC11:11
*** rhallisey has joined #openstack-infra11:13
*** dizquierdo has joined #openstack-infra11:14
*** thorst has quit IRC11:14
*** qba73 has quit IRC11:15
*** qba73 has joined #openstack-infra11:15
*** rossella_ has quit IRC11:16
*** gomarivera has joined #openstack-infra11:17
*** lucasagomes is now known as lucas-hungry11:17
*** salv-orlando has quit IRC11:18
*** Julien-zte has quit IRC11:21
*** Qiming has quit IRC11:22
*** tuanluong has quit IRC11:23
*** Julien-z_ has joined #openstack-infra11:24
openstackgerritSean Dague proposed openstack-infra/devstack-gate master: DNM: testing global_request_id  https://review.openstack.org/46741711:24
*** Qiming has joined #openstack-infra11:26
*** rwsu has joined #openstack-infra11:27
*** yolkfull_ has quit IRC11:29
*** markvoelker has joined #openstack-infra11:29
*** Qiming has quit IRC11:30
*** markvoelker has quit IRC11:34
*** bulat has quit IRC11:34
*** bulat has joined #openstack-infra11:34
*** Qiming has joined #openstack-infra11:34
*** rfolco has joined #openstack-infra11:35
*** qba73 has quit IRC11:36
*** qba73 has joined #openstack-infra11:36
*** qba73 has quit IRC11:41
*** Qiming has quit IRC11:41
*** thorst has joined #openstack-infra11:42
*** Qiming has joined #openstack-infra11:47
*** dingyichen has quit IRC11:49
*** eharney has joined #openstack-infra11:50
*** Qiming has quit IRC11:52
*** dprince has joined #openstack-infra11:53
*** Qiming has joined #openstack-infra11:53
*** Qiming_ has joined #openstack-infra11:54
*** ericyoung has joined #openstack-infra11:56
*** Qiming has quit IRC11:58
*** masber has quit IRC12:00
*** markvoelker has joined #openstack-infra12:00
*** amotoki_away is now known as amotoki12:00
*** d0ugal has quit IRC12:02
*** amotoki is now known as amotoki_away12:05
*** markvoelker has quit IRC12:05
*** yamamoto has joined #openstack-infra12:05
*** alexchadin has joined #openstack-infra12:06
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: [NO MERGE] test multinode containers  https://review.openstack.org/46710012:08
*** yamamoto has quit IRC12:08
*** markvoelker has joined #openstack-infra12:08
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Decode ssh output of gerrit connection  https://review.openstack.org/46839212:09
*** eharney has quit IRC12:11
*** rodrigopaiva has joined #openstack-infra12:12
*** qba73 has joined #openstack-infra12:13
*** markvoelker has quit IRC12:13
*** yamamoto has joined #openstack-infra12:15
*** gomarivera has quit IRC12:15
*** mat128 has joined #openstack-infra12:15
*** gomarivera has joined #openstack-infra12:16
*** rossella_ has joined #openstack-infra12:16
*** d0ugal has joined #openstack-infra12:18
*** pradk has joined #openstack-infra12:18
*** sshnaidm|off has quit IRC12:20
*** gomarivera has quit IRC12:20
*** Julien-z_ has quit IRC12:24
*** d0ugal has quit IRC12:24
*** rossella_ has quit IRC12:26
*** mat128 has quit IRC12:27
*** rossella_ has joined #openstack-infra12:27
*** baoli has joined #openstack-infra12:28
*** mat128 has joined #openstack-infra12:29
*** esikachev has quit IRC12:30
*** baoli_ has joined #openstack-infra12:30
*** lucas-hungry is now known as lucasagomes12:31
*** rcarrillocruz has quit IRC12:33
*** jpena is now known as jpena|lunch12:33
*** trown|outtypewww is now known as trown12:34
*** baoli has quit IRC12:34
*** xarses_ has joined #openstack-infra12:36
*** senk has joined #openstack-infra12:36
*** gordc has joined #openstack-infra12:36
*** rodrigopaiva has quit IRC12:37
*** d0ugal has joined #openstack-infra12:37
*** rlandy has joined #openstack-infra12:37
*** esikachev has joined #openstack-infra12:38
*** ccamacho is now known as ccamacho|lunch12:38
*** xarses has quit IRC12:38
*** yamamoto has quit IRC12:40
*** priteau has joined #openstack-infra12:41
*** yamamoto has joined #openstack-infra12:42
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Fix socket.error exception usage  https://review.openstack.org/46840512:44
*** esikachev has quit IRC12:44
sdaguelots of POST_FAILURES in the gate12:44
*** electrofelix has quit IRC12:44
*** esikachev has joined #openstack-infra12:45
fungiyep, we're out of space again12:45
*** thorst has quit IRC12:45
fungiwe were down to 40gb a few hours ago when i woke up and so i started an early log expiration pass right away, but we're apparently generating new logs faster than it can find and remove old ones12:46
*** yamamoto has quit IRC12:46
sdagueok, well if you want to stop archiving the journals at all, that's fine12:47
sdaguealthough I did find a bug this morning because I had them12:47
fungiwell, we merged the change to stop saving the entire journal and leaving it to just the devstack and kernel journals12:47
sdagueok12:47
fungii think12:47
fungichecking12:47
fungino, looks like clark's topic:less-log changes need more reviews12:48
fungier, topic:less-logs12:48
*** dtantsur is now known as dtantsur|brb12:49
*** rossella__ has joined #openstack-infra12:49
*** alekhya has quit IRC12:49
*** esikachev has quit IRC12:49
*** gomarivera has joined #openstack-infra12:50
sdagueyeh, approving12:50
fungii'm going to switch to a more aggressive 30-day expiration instead of our usual 45-day12:50
sdagueis there a reason stackviz isn't pulling it's JS from a common location?12:50
sdaguethat's seems kind of wasteful to put it in every run12:51
*** rossella_ has quit IRC12:51
fungii couldn't begin to tell you12:51
*** markvoelker has joined #openstack-infra12:51
* AJaeger hopes clarkb's changes will not run into POST_FAILURES ;)12:52
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: ovb playbook: add task to delete overcloud  https://review.openstack.org/46374012:53
sdagueyeh, really12:53
pabelangerAJaeger: dirk: Ya, DIB change means we works like APT today, and also means we don't have to pass --no-recommends everywhere12:53
*** fguillot has joined #openstack-infra12:53
fungicranking the expiration pass down by a couple more weeks will hopefully catch more we can delete faster12:54
sdaguefungi: honestly, I'd just delete all the journals right now for existing josbs12:54
AJaegerpabelanger: should we merge my change for now, update DIB, release DIB - and then revert mine?12:54
*** rossella__ has quit IRC12:54
sdaguefungi: I mean for existing test runs12:54
*** senk is now known as mist|senk12:54
fungisdague: i can give that a shot... might go faster than having find so the extra stat for dates12:54
AJaegerpabelanger: https://review.openstack.org/#/c/468300/ is dirk's dib change12:55
pabelangerAJaeger: is it needed now? when I looked last night, after removing ant / asciidoc bindep job for opensuse was reasonable12:55
pabelangerAJaeger: looking, we should be able to do a DIB release today to pick it up12:55
*** gouthamr has joined #openstack-infra12:55
AJaegerpabelanger: A day or two is not a problem... I feared it would take longer and thus wanted to have that in as safe guard.12:55
sdaguefungi: we still living in a 14 TB log world, or did that get bigger with AFS?12:55
fungideleting all collected logs matching devstack*.journal.gz now12:56
sdaguefungi: ++12:56
fungisdague: still limited (to 12tb actually, the server is limited to 14tb total but also hosts lots of other sites like tarballs, specs, governance, et cetera12:57
*** Goneri has joined #openstack-infra12:58
*** markvoelker has quit IRC12:58
*** jaypipes is now known as leakypipes13:00
fungisdague: we're in talks to relocate the logs to vexxhost where we could attach much larger volumes than rackspace allows13:01
fungialso, this wireless modem i'm trying to connect through isn't getting much signal here, so apologies if i'm not very responsive13:01
sdagueno worries, just curious13:02
*** alexchadin has quit IRC13:02
*** MatthewLi has joined #openstack-infra13:03
fungiahh, that's better. this place has guest wifi13:03
*** thorst has joined #openstack-infra13:04
*** Dinesh_Bhor has quit IRC13:05
*** xarses_ has quit IRC13:06
*** xarses_ has joined #openstack-infra13:07
*** dims has quit IRC13:07
*** chlong has joined #openstack-infra13:07
*** rossella__ has joined #openstack-infra13:07
*** psachin has quit IRC13:08
*** andreww has joined #openstack-infra13:08
fungithe journal deletion has freed up 30gb already so hopefully post failures will cease13:08
*** eharney has joined #openstack-infra13:08
pabelangerAJaeger: lets see if we can land a dib release today13:09
*** andreww has quit IRC13:10
*** andreww has joined #openstack-infra13:10
pabelangerAJaeger: trying to test DIB change now13:11
*** xarses_ has quit IRC13:12
*** markvoelker has joined #openstack-infra13:12
AJaegerthanks, pabelanger13:13
*** kgiusti has joined #openstack-infra13:13
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Fix removeCompletedRequests for dict iteration  https://review.openstack.org/46840913:13
*** trown is now known as trown|brb13:13
*** qba73 has quit IRC13:13
*** qba73 has joined #openstack-infra13:13
*** rhallisey has quit IRC13:13
pabelangerAJaeger: is there a concept of /etc/zypp.d ? or just a single config file13:14
*** mdrabe has joined #openstack-infra13:14
*** esberglu has joined #openstack-infra13:14
AJaegerpabelanger: a single file13:15
pabelangerk, confirmed it worked13:15
*** gouthamr has quit IRC13:15
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Use https to clone Github3.py  https://review.openstack.org/46841313:15
*** trown|brb is now known as trown13:15
pabelangerclarkb: when you are online https://review.openstack.org/#/c/468300 could use some feedback.13:15
*** eharney has quit IRC13:16
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Drop -e for pip install for devstack plugin.sh  https://review.openstack.org/46812713:17
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update keyscan for python3 compat  https://review.openstack.org/46825313:17
*** gouthamr has joined #openstack-infra13:18
*** shardy has joined #openstack-infra13:18
*** yamamoto has joined #openstack-infra13:21
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Fix removeCompletedRequests for dict iteration  https://review.openstack.org/46840913:21
*** sshnaidm|off has joined #openstack-infra13:22
*** prateek has quit IRC13:22
*** atarakt has quit IRC13:24
*** atarakt has joined #openstack-infra13:24
*** electrofelix has joined #openstack-infra13:25
*** e0ne has quit IRC13:26
*** electrofelix has quit IRC13:26
*** esikachev has joined #openstack-infra13:27
*** electrofelix has joined #openstack-infra13:27
*** mpaolino has quit IRC13:34
*** smcginnis is now known as ZenMaster13:34
*** ZenMaster is now known as smcginnis13:34
*** inc0 has quit IRC13:35
*** dansmith is now known as superdan13:39
*** deafult has joined #openstack-infra13:39
*** e0ne has joined #openstack-infra13:39
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Make zuul ansible dir self-contained  https://review.openstack.org/46820813:40
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Add support for bwrap  https://review.openstack.org/45385113:40
*** jpena|lunch is now known as jpena13:45
*** gouthamr_ has joined #openstack-infra13:47
*** gouthamr has quit IRC13:47
pabelangerHmm13:47
pabelangerseeing some POST_FAILURE again13:48
*** qba73 has quit IRC13:48
pabelangerokay, we already aware13:48
fungiyeah, should have cleared up again (for now)13:51
*** ykarel_ has joined #openstack-infra13:54
*** ykarel has quit IRC13:56
AJaegerunfortunately two of clarkb's devstack ones got POST_FaILURES ;/13:59
*** dizquierdo has quit IRC13:59
*** jascott1 has joined #openstack-infra14:00
sdagueAJaeger: doh14:00
*** dtantsur|brb is now known as dtantsur14:00
*** wolverineav has joined #openstack-infra14:00
*** bobh has joined #openstack-infra14:01
*** rbrndt has joined #openstack-infra14:01
*** isaacb has joined #openstack-infra14:02
*** dizquierdo has joined #openstack-infra14:02
*** dims has joined #openstack-infra14:04
*** jascott1 has quit IRC14:04
*** ykarel__ has joined #openstack-infra14:04
*** MatthewLi has quit IRC14:05
*** ccamacho|lunch is now known as ccamacho14:06
*** ykarel_ has quit IRC14:07
fungiwell, they shouldn't on recheck now (we're at 48GB free and climbing)14:08
cloudnullmornings14:08
cloudnullpabelanger: Just following up, have you had a chance to verify the osic is accepting images again?14:10
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: quickstart transition: add promotion logic  https://review.openstack.org/44546714:10
pabelangercloudnull: indeed, things look healthy again! Thanks again for keep osic running14:10
*** gouthamr_ has quit IRC14:11
cloudnullcool !14:11
cloudnullthanks for continuing to use it :)14:11
*** gouthamr has joined #openstack-infra14:13
*** felipemonteiro has joined #openstack-infra14:13
fungithanks a bunch, cloudnull!!!14:14
mnasersay someone wants to pick up a project which is sitting in stackforge right now and bring it back to life -- is there some sort of process or better off just start from scratch?14:15
*** markvoelker has quit IRC14:15
AJaegermnaser: no process defined. My suggestion: Do the "rename dance" with moving it from stackforge to openstack namespace.14:16
AJaegermnaser: note that a "rename dance" is a manual step, it needs a gerrit downtime14:16
AJaegermnaser: but it all depends what you want to do...14:16
openstackgerritDan Smith proposed openstack-infra/bindep master: Fix test_main and test_depends for systems missing lsb_release  https://review.openstack.org/46843214:17
openstackgerritDan Smith proposed openstack-infra/bindep master: Log an error when lsb_release cannot be executed  https://review.openstack.org/46843314:17
mnaserAJaeger cool.. i wanted to pick up where the work was left off (2 years ago!) for the puppet openstack composition modules.. i think there's great value in deployers using them together (and maybe infracloud could be one of those consumers too :-P)14:17
*** zz_dimtruck is now known as dimtruck14:19
fungiit's possible the openstack-infra/puppet-infracloud module could become even more lightweight in that case, yes14:19
*** salv-orlando has joined #openstack-infra14:19
*** priteau has quit IRC14:19
openstackgerritMerged openstack-dev/cookiecutter master: Update test-requirements.txt to latest  https://review.openstack.org/46758514:20
*** rossella_ has joined #openstack-infra14:20
openstackgerritMerged openstack-dev/cookiecutter master: Usage: install cookiecutter firstly  https://review.openstack.org/46699614:21
*** ramishra has quit IRC14:21
*** jascott1 has joined #openstack-infra14:21
fungimnaser: anyway, to elaborate a bit on process, submit a project-config change to correct the gerrit acl and whatever else you want set, and once that merges you can start submitting and reviewing changes for the repo again. immediately following (or even depending on) the acl change, submit another project-config change to rename it from the stackforge/ namespace into openstack/ and we'll work that14:21
fungiinto our next project renames batch maintenance14:21
mnaserfungi: fair enough, do you think it's better to pick up puppet-openstack-cloud from where it stands in stackforge or just go through starting a new one?14:22
mnaserhm, getting access to the CI and gerrit/etc is mostly what i need for now so i think we can do that14:23
*** aarefiev is now known as aarefiev_afk14:23
*** rossella__ has quit IRC14:23
*** hongbin has joined #openstack-infra14:24
cmurphymnaser: might be a good idea to bring it up with mwhahaha and EmilienM14:24
rosmaitafungi: when you have a minute, i seem to have lost the ability to set the topic in the glance channel14:24
fungimnaser: resurrecting the existing repo, if possible, is far better than leaving it abandoned and starting a clone of it14:24
fungirosmaita: are you identified to nickserv?14:24
EmilienMmnaser: puppet-openstack-cloud is not maintained since Juno14:24
rosmaitayes14:24
mnasercmurphy yup, i was planning to do that, i just wanted to understand the infra bits involved :)14:24
mnaserEmilienM yep, im aware, but i think there's value because there's so many puppet consumers that probably share all of the same codebase14:25
rosmaitafungi: 14:22:24 -NickServ(NickServ@services.)- You are already logged in as rosmaita.14:25
mnaserpuppet tripleo composition layer could take advantage (ok maybe getting ahead of myself, infracloud, and many other deployers) probably share that need (if it's extensible enough that is)14:25
EmilienMmnaser: we tried that a few years ago and folks have their own composition layers14:25
*** jascott1 has quit IRC14:25
EmilienMmnaser: and composition layer are very opinionated, we didn't see value of maintaining it14:26
mnaserbummer, seems like a lot of repeated work14:26
EmilienMyep14:26
mnaseri doubt that a "keystone" role would be much different across clouds for example14:26
EmilienMmnaser: it's not done yet but there is also some work to switch tripleo to use something else for configuration management (see the work with etcd, etc)14:27
fungirosmaita: strange... `/msg chanserv access #openstack-glance list` shows you're granted +Aefortv flags. are you doing `/msg chanserv topic #openstack-glance blah blah blah` or something else?14:27
openstackgerritMerged openstack-infra/devstack-gate master: Don't record lvmdump, its not useful  https://review.openstack.org/46816414:28
rosmaitafungi: something else, namely /topic #openstack-glance whatever14:28
rosmaitafungi: will try the msg way14:28
fungirosmaita: you may need to op yourself first if you want to do /topic but i don't exactly recall... i always set it through chanserv so that it's persisted through splits and what have you14:29
openstackgerritMerged openstack-infra/devstack-gate master: Compress stackviz data  https://review.openstack.org/46820714:29
mnaser(btw, continued the puppet convo in puppet-openstack)14:29
*** LindaWang has joined #openstack-infra14:29
andreykurilinhi folks! Our new contributor has problems with https://review.openstack.org/#/settings/contact14:30
rosmaitafungi: the /msg way works fine, will do that ... thanks!14:30
andreykurilinCan anybody help us?14:30
*** salv-orl_ has joined #openstack-infra14:30
andreykurilin> But when I open the link: https://review.openstack.org/#/settings/contact, and finsh the email address. The info shows that server error and the contact info can not be stored.14:30
fungiandreykurilin: make sure they follow https://docs.openstack.org/infra/manual/developers.html#account-setup14:31
fungiandreykurilin: in particular double-check that their foundation account is of the correct type and that their e-mail addresses match between foundation primary an gerrit preferred14:31
*** salv-orlando has quit IRC14:32
LindaWangfungi, andreykurilin:  I will check them.  Thank you.14:33
fungiandreykurilin: that server error almost always means either that their foundation account is not the correct level/type or that the e-mail addresses aren't matching14:34
andreykurilinfungi: user-friendly error :)14:34
fungiandreykurilin: the only kind of error gerrit can produce using that feature unfortunately14:35
andreykurilinfungi: thanks for suggestions!14:35
fungii've tried to work out an upstream-acceptable gerrit patch to improve that in such a way that the error can be customized or passed through from the external api it's calling, but my java-fu is weak14:35
rosmaitafungi: thanks for your help14:35
*** sbezverk has quit IRC14:37
fungirosmaita: any time!14:38
*** rosmaita has left #openstack-infra14:41
*** rosmaita has joined #openstack-infra14:41
*** markvoelker has joined #openstack-infra14:45
*** ramishra has joined #openstack-infra14:47
*** gomarivera has quit IRC14:48
*** gomarivera has joined #openstack-infra14:48
*** mdrabe has quit IRC14:51
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Collapse shade legacy and neutron jobs  https://review.openstack.org/46648914:51
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Collapse shade ansible job definitions  https://review.openstack.org/46648814:51
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Collapse shade legacy and non-legacy jobs  https://review.openstack.org/46649014:51
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Turn on voting for shade python35 functional jobs  https://review.openstack.org/46844014:51
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Also test shade patches zuulv3 branch of nodepool  https://review.openstack.org/46844114:51
fungii'm about to drop back offline again for another ~4 hours but should be back in time for the lists.o.o maintenance window at 20:0014:52
mordredAJaeger: I think maybe I got those right this time14:52
mordredpabelanger: also - you may want to take a peek at those ^^ when you get a sec14:52
*** gomarivera has quit IRC14:52
mordredpabelanger: I did a few things in them that stack (like migrating to local.conf) that may or may not be valuable in the nodepool job14:52
mordredpabelanger: but your head has been in the nodepool-dsvm job more recently than mine14:53
*** HeOS has quit IRC14:55
jeblairclarkb, bkero, pabelanger: i'm getting cronspam from bkero-lists-tests.o.o and zuulv3.o.o; can we disable bup on bkero-lists-tests and make sure exim is not running?  and can we set up correct dns for zuulv3.openstack.org?14:56
pabelangerjeblair: zuulv3.o.o was just a test yesterday, I can delete that now14:58
*** florianf has joined #openstack-infra14:58
pabelangerjeblair: it was a manual provision14:58
*** masuberu has joined #openstack-infra14:58
*** mdrabe has joined #openstack-infra14:58
*** salv-orl_ has quit IRC14:59
openstackgerritKen Giusti proposed openstack-infra/project-config master: Turn on voting for the AMQP 1.0 gate tests  https://review.openstack.org/46844515:02
*** jamesmca_ has joined #openstack-infra15:02
*** rossella_ has quit IRC15:02
*** ijw has joined #openstack-infra15:03
*** rcernin has quit IRC15:04
*** d0ugal has quit IRC15:04
*** amotoki_away is now known as amotoki15:05
*** gyee has joined #openstack-infra15:06
*** salv-orlando has joined #openstack-infra15:07
*** rhallisey has joined #openstack-infra15:09
*** sbezverk has joined #openstack-infra15:10
*** cshastri has quit IRC15:11
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Do not request nodes for which we have no images  https://review.openstack.org/46844715:11
*** amotoki is now known as amotoki_away15:15
*** armax has joined #openstack-infra15:15
*** d0ugal has joined #openstack-infra15:18
*** rossella_ has joined #openstack-infra15:18
*** efoley has quit IRC15:19
openstackgerritMerged openstack-infra/tripleo-ci master: Don't maintain stable scenario env in upgrade CI  https://review.openstack.org/46797315:20
*** ykarel__ has quit IRC15:21
*** jamesmca_ has quit IRC15:26
AJaegermordred: not quite - you only define the -nv job but need the voting one as well. I commented.15:27
openstackgerritMerged openstack/diskimage-builder master: Add a more generic tree->graph parser  https://review.openstack.org/46541715:27
mordredAJaeger: blerg15:27
mordredAJaeger: and thanks!15:27
*** dizquierdo has quit IRC15:33
*** jamesmca_ has joined #openstack-infra15:36
*** eharney has joined #openstack-infra15:38
openstackgerritMerged openstack-infra/jenkins-job-builder master: Add support for new option in s3 plugin.  https://review.openstack.org/46419315:38
openstackgerritSagi Shnaidman proposed openstack-infra/project-config master: Add experimental OVB ha job with tempest  https://review.openstack.org/46503015:39
*** marst has joined #openstack-infra15:39
*** jamesmca_ has quit IRC15:40
*** rossella_ has quit IRC15:41
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix missing source connections on merger  https://review.openstack.org/46845115:42
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Fix base64 encoding of server key  https://review.openstack.org/46845315:42
*** rossella_ has joined #openstack-infra15:44
*** e0ne has quit IRC15:45
*** florianf has quit IRC15:46
*** armax has quit IRC15:47
*** jamesmca_ has joined #openstack-infra15:48
*** dtantsur is now known as dtantsur|afk15:48
*** LindaWang has quit IRC15:52
*** armax has joined #openstack-infra15:53
*** gomarivera has joined #openstack-infra15:54
*** sshnaidm|off has quit IRC15:57
*** gardlt has joined #openstack-infra15:58
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Use https to clone Github3.py  https://review.openstack.org/46841315:58
openstackgerritMerged openstack-infra/subunit2sql master: Fix dailycount command  https://review.openstack.org/46729315:59
*** ralonsoh has quit IRC16:02
*** mriedem is now known as mriedem_bbq16:02
*** inc0 has joined #openstack-infra16:05
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Strip unneeded cmd, changed, stdout and stderr from results  https://review.openstack.org/46731016:09
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Display command/shell results in a banner  https://review.openstack.org/46760316:09
*** SumitNaiksatam has quit IRC16:09
openstackgerritSpyros Trigazis (strigazi) proposed openstack-infra/project-config master: [magnum] Add Centos DC/OS DIB  https://review.openstack.org/46832816:12
zxiirodoes anyone know if you can tell "tox" when building multiple test envs to create a separate log file for each env run?16:12
*** marst has quit IRC16:13
*** lucasagomes is now known as lucas-afk16:14
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Collapse shade ansible job definitions  https://review.openstack.org/46648816:15
mordredAJaeger: sigh. thank you. I'm going to try just that one this time instead of pushing up the whole rebased stack16:16
*** jpich has quit IRC16:16
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Fix base64 encoding of server key  https://review.openstack.org/46845316:17
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Do not request nodes for which we have no images  https://review.openstack.org/46844716:17
*** dprince has quit IRC16:17
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Fix removeCompletedRequests for dict iteration  https://review.openstack.org/46840916:17
*** jascott1 has joined #openstack-infra16:22
openstackgerritSpyros Trigazis (strigazi) proposed openstack-infra/project-config master: [magnum] Add Centos DC/OS DIB  https://review.openstack.org/46832816:22
*** gomarivera has quit IRC16:23
clarkbjeblair: I'll disable bup on the test list server16:23
*** gomarivera has joined #openstack-infra16:23
*** jascott1 has quit IRC16:26
clarkbjeblair: bup cron entry is commented out now. I do not see exim running16:26
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Remove windmill-trusty jobs  https://review.openstack.org/46846416:27
*** ltomasbo is now known as ltomasbo|away16:27
*** gomarivera has quit IRC16:27
clarkbsdague: fungi if we are going to delete all the journal files, do we have a change up to have d-g stop producing them?16:28
*** gomarivera has joined #openstack-infra16:28
sdagueclarkb: I meant all the existing ones16:29
sdagueclarkb: I approved your shrink change16:29
clarkbsdague: yes, but if we are deleting all existing ones why should we continue to produce new ones?16:29
sdagueclarkb: because they are still useful, it was a way to dig out quickly16:29
clarkbgotcha16:30
sdagueyour shrink change failed for logs16:30
*** kaisers has quit IRC16:30
*** david-lyle has joined #openstack-infra16:30
sdagueso, this morning I debugged Trove triggering a real Nova bug with 3 grep calls because of them16:30
sdaguewhich was pretty nice16:30
*** markvoelker has quit IRC16:30
jeblairsdague, clarkb: how crazy is it to have os-log-analyze process the journal and drop the regular text logs?16:31
*** ramishra has quit IRC16:31
sdaguejeblair: I actually thought about that16:31
sdaguethe biggest issue is you'd need to write a more comprehensive UI I think16:32
jeblairyeah, i guess an index page, then select by service would be the minimum.  of course, then you could do things like x-ref between them once you had that in place...16:33
jeblair(the web version of your grep commands)16:33
sdagueyeh, honestly, what you are really doing is building a log explorer. It would be a good project16:33
sdagueit's not a crazy idea, it's just one that takes time16:34
sdagueand motivation16:34
jeblairyeah.  it'd be a good standalone project i think.16:34
jeblair(not necessarily openstack-coupled)16:34
sdagueyep16:35
*** ianychoi has quit IRC16:35
*** ianychoi has joined #openstack-infra16:38
clarkbpabelanger: looks like there are at least a couple tracebacks in the nodepool py35 job that need tracking down? might be a good idea to make sure we have unittest coverage for those when they get fixed16:38
clarkbfungi: looks like we are up to 106GB free on the logs fs now16:40
pabelangerclarkb: ya, Shrews and I are working on them now. Agree, we should see about getting coverage for keyscan logic16:40
mordredjeblair, sdague: https://www.freedesktop.org/software/systemd/man/systemd-journal-gatewayd.service.html16:40
mordredjeblair, sdague: exposes journald entries over a socket - supports being pointed at a specific directory instead of the standard ones16:41
*** ramishra has joined #openstack-infra16:41
*** isaacb has quit IRC16:42
sdaguemordred: right... but that's not a webapp16:42
sdaguethat's just kind of reverse rsyslog iirc16:42
mordredI imagine that having a little wsgi that spins up a systemd-journal-gatewayd in a subprocess pointing to a dir and proxies the socket wouldnt' be super hard to write16:42
mordredThe following URLs are recognized:16:43
mordredInteractive browsing.16:43
mordredgah16:43
sdaguewell, honestly, you'd just query journalctl16:43
sdagueit takes a -D16:43
mordred"/browse" is the url for interactive browsing16:43
sdaguehmmm...16:43
*** gomarivera has quit IRC16:43
AJaegermordred: LGTM, now let's rebase...16:44
*** jascott1 has joined #openstack-infra16:44
*** kaisers has joined #openstack-infra16:45
*** inc01 has joined #openstack-infra16:45
*** inc0 has quit IRC16:45
AJaegerclarkb, what do you think of this openSUSE dib change to not install all recommended packages? Could you review, please? https://review.openstack.org/#/c/468300/16:45
*** sambetts is now known as sambetts|afk16:46
sdaguemordred: so, it's an interesting thing16:46
sdagueI just started it locall16:46
sdaguelocally16:46
sdaguehowever, it's got a couple of issues which I think would prevent it's use here16:46
sdague1) you'd need to run an instance per directory16:46
*** inc01 has quit IRC16:47
mordredyah- which is why I was thinking it would need to be triggered somehow by a url and proxied - rather than doing long-lived one per dir16:47
sdague2) the UX is an infinite scroll window, so normal search16:47
sdagueisn't so much a thing16:47
*** inc0 has joined #openstack-infra16:47
sdague3) no bookmarking16:47
sdaguethat line level bookmarking has been so good in terms of productivity gains in going through debug16:48
sdaguethat's actually currently the killer feature in os-loganalyze16:48
*** gomarivera has joined #openstack-infra16:49
*** jaosorior has quit IRC16:49
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Remove windmill-trusty jobs  https://review.openstack.org/46846416:50
*** jamesmca_ has quit IRC16:52
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Remove windmill-trusty jobs  https://review.openstack.org/46846416:52
*** trown is now known as trown|lunch16:52
*** jamesmca_ has joined #openstack-infra16:52
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Make zuul ansible dir self-contained  https://review.openstack.org/46820816:52
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Add support for bwrap  https://review.openstack.org/45385116:52
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Add SSH Agent Primitives and usage  https://review.openstack.org/46817316:52
clarkbAJaeger: done16:53
*** ramishra has quit IRC16:53
AJaegerthanks, clarkb16:53
*** kaisers has quit IRC16:54
AJaegerpabelanger: one curious question - http://nodepool.openstack.org/dib-image-list shows "nb03" - and "nb04.openstack.org". Why is only one of them a fqdn?16:55
clarkbAJaeger: I think they register as their hostnames to the cluster, so the clouds must be configuring the booted image differently as far as what they think their hostname is16:56
*** esberglu has quit IRC16:57
*** david-lyle has quit IRC16:58
*** derekh has quit IRC16:58
AJaegerinteresting16:58
*** florianf has joined #openstack-infra16:58
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Collapse shade legacy and neutron jobs  https://review.openstack.org/46648916:59
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Collapse shade legacy and non-legacy jobs  https://review.openstack.org/46649016:59
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Also test shade patches zuulv3 branch of nodepool  https://review.openstack.org/46844116:59
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Turn on voting for shade python35 functional jobs  https://review.openstack.org/46844016:59
pabelangerAJaeger: clarkb: also 2 different cloud images, different providers17:00
pabelangerwe could fix it in puppet17:00
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Fix socket.error exception usage  https://review.openstack.org/46840517:02
*** jascott1 has quit IRC17:02
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Remove windmill-trusty jobs  https://review.openstack.org/46846417:02
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Drop -e for pip install for devstack plugin.sh  https://review.openstack.org/46812717:03
*** jpena is now known as jpena|off17:05
*** sshnaidm|off has joined #openstack-infra17:07
clarkbhttp://logs.openstack.org/87/468187/1/gate/gate-tempest-dsvm-py35-ubuntu-xenial/29ceb92/ which ran with the last of my log reductions came in at 83MB which is 1/3 of where we started I think17:11
AJaegerclarkb: let's see in two hours what all 4 patches will do...17:12
*** kaisers1 has joined #openstack-infra17:13
*** florianf has quit IRC17:14
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Update keyscan for python3 compat  https://review.openstack.org/46825317:15
*** rbrndt has quit IRC17:16
*** ihrachys has joined #openstack-infra17:20
*** Swami has joined #openstack-infra17:20
openstackgerritMorgan Fainberg proposed openstack-infra/shade master: First Pass: De-client-ify list_users  https://review.openstack.org/46778417:20
*** electrofelix has quit IRC17:21
*** pblaho has quit IRC17:21
*** esikachev has quit IRC17:22
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Remove windmill-trusty jobs  https://review.openstack.org/46846417:23
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Fix removeCompletedRequests for dict iteration  https://review.openstack.org/46840917:24
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Do not request nodes for which we have no images  https://review.openstack.org/46844717:25
openstackgerritMerged openstack-infra/devstack-gate master: Save less journal data  https://review.openstack.org/46815017:25
*** HeOS has joined #openstack-infra17:26
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Remove unnecessary list()  https://review.openstack.org/46848917:27
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Fix base64 encoding of server key  https://review.openstack.org/46845317:27
*** salv-orlando has quit IRC17:30
*** salv-orlando has joined #openstack-infra17:31
*** rcarrillocruz has joined #openstack-infra17:32
openstackgerritMerged openstack/diskimage-builder master: Disable recommended package installations for zypper-minimal  https://review.openstack.org/46830017:34
*** dprince has joined #openstack-infra17:34
openstackgerritMerged openstack-infra/devstack-gate master: Use xz to compress the journal files  https://review.openstack.org/46818717:34
*** esikachev has joined #openstack-infra17:34
*** salv-orlando has quit IRC17:35
clarkb95MB on the regularl neutron tempest dsvm job. Under 100MB :)17:35
*** bobh has quit IRC17:36
mordredwoot!17:36
*** HeOS has quit IRC17:36
*** gomarivera has quit IRC17:36
AJaegerpabelanger: the openSUSE dib change merged - will you take care of tagging, please? Is that something for Monday?17:36
*** gomarivera has joined #openstack-infra17:36
AJaeger\o/17:36
pabelangerAJaeger: cool!17:37
pabelangerya, we might not want to tag today17:37
pabelangerfriday and all17:37
pabelangernot sure what I was thinking this morning17:37
pabelangerAJaeger: clarkb: aim for Monday for 2.4.2 I guess17:37
pabelangerianw: ^when do you think the next release of DIB is ready?17:38
pabelangerianw: something we could do on Monday?17:38
clarkbthere are only ~4 changes between head and 2.4.117:38
* clarkb looks at them17:39
clarkbone is docs, one is testing, one is zypper change, and the last is ianw's tree -> graph change17:39
clarkbthe tree -> graph change affects disk partitioning I think so ya monday is probably better (the other changes I wouldn't worry about making a release on)17:40
*** mriedem_bbq is now known as mriedem17:42
clarkbthat might also demand a 2.5.0 release17:42
AJaegerpabelanger: why is zuul giving a -1 on your windmill change https://review.openstack.org/#/c/468464/ - something looks broken, isn't it17:42
AJaegerclarkb: agreed, 2.5.0 on Monday17:43
pabelangerAJaeger: not sure, it should be okay to +2 we don't run any jobs on zuulv3-dev.o.o right now17:43
*** salv-orlando has joined #openstack-infra17:44
pabelangeroh, zuulv3-dev is erroring atm17:45
*** markus_z has quit IRC17:45
*** Goneri has quit IRC17:46
*** ihrachys has quit IRC17:47
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Collapse shade legacy and neutron jobs  https://review.openstack.org/46648917:47
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Collapse shade legacy and non-legacy jobs  https://review.openstack.org/46649017:47
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Test shade patches against zuulv3 branch of nodepool  https://review.openstack.org/46844117:47
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Turn on voting for shade python35 functional jobs  https://review.openstack.org/46844017:47
*** bobh has joined #openstack-infra17:49
*** yamahata has joined #openstack-infra17:50
clarkbjust to double check everything direct comparison against https://review.openstack.org/#/c/466935/ which is d-g change from earlier in the week to current logs from the d-g fixes. py35 job is 191MB -> 83MB and gate-tempest-dsvm-neutron-full-ubuntu-xenial is 266MB -> 95MB17:50
clarkbso around 1/3 less disk required for d-g jobs17:50
*** annegentle has joined #openstack-infra17:51
*** jascott1 has joined #openstack-infra17:51
clarkbspeaking of any other infra-root willing to review https://review.openstack.org/#/c/466935/ I think it may help address one of our failure cases for the gate (though a less frequent one, its a simple change)17:55
*** trown|lunch is now known as trown17:56
*** bnemec is now known as beekneemech17:57
pabelangerclarkb: so, if I an reading this right, it looks like both lon1 and la1 support ipv6 on their external router.  Maybe we should try to just use ipv6 there17:59
pabelangerclarkb: +217:59
*** pcaruana has quit IRC18:00
openstackgerritMerged openstack-infra/project-config master: Remove windmill-trusty jobs  https://review.openstack.org/46846418:01
clarkbpabelanger: ya we'll have t ofigure out how we need to configure it there too18:02
clarkbI'm not sure how you get it in a private v4 env. Do we direct attach to the external ipv6 network or have to create our own subnets that route out? something to look into18:02
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Fix missing source connections on merger  https://review.openstack.org/46845118:02
*** esikachev has quit IRC18:04
pabelangerclarkb: I think we need to change our network to dhcp ipv618:04
pabelangergoing to see if citycloud has some docs18:06
clarkbwell not the network as thats l2, but add a new subnet that is configured to dhcp ipv6 makes sense. Does glean support dhcpv6?18:06
pabelangerno, I think we'd have to update glean too18:06
mordredclarkb, pabelanger: it's not working via RA?18:08
*** eharney has quit IRC18:08
pabelangerhttp://logs.openstack.org/83/467783/1/experimental/gate-dsvm-nodepool-py35-src-nv/14d50fb/console.html18:09
mordredpabelanger: loking- thanks18:09
pabelangersuccess nodepool-dsvm py35 job^18:09
clarkbmordred: both are valid options in neutron land and I think you don't get to pick which one to use as the user18:09
clarkbso depends on how the cloud is configured18:09
pabelangermordred: re: glean. I need to check, I thought we did something to disable dhcp_v618:10
mordredwell, dhcp_v6 didn't necessarily mean dhcp_v618:10
clarkbright thats the other part of the mess18:11
pabelangerif we could get it working like osic, that would be nice18:11
pabelangerbut, not sure that is an option18:11
pabelangerneed to read up on docs18:11
clarkbosic works via RA which glean does grok18:11
*** eharney has joined #openstack-infra18:12
Shrewsclarkb: pabelanger: py35 job success!  https://review.openstack.org/46848918:12
mordredpabelanger: where are you seeing that city supports ipv6?18:12
pabelangerShrews: Yay18:12
pabelangermordred: I am looking at web UI for our networks / routers we created. Both lon1 and la1 have external IPv6 addresses18:13
pabelangerand citycloud website references ipv6 support18:13
clarkbpabelanger: their non openstack things apepar to have had ipv6 support for a while18:13
* clarkb pokes at openstack api in la118:14
mordredneat18:14
* mordred is looking at lon118:14
clarkbext-net does have an ipv6 address scope18:15
clarkbbut I can't show the subnets to actually learn how to ipv618:15
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Move gate-dsvm-nodepool-py35-src-nv to check for nodepool  https://review.openstack.org/46850918:16
*** ericyoung has quit IRC18:16
*** rbrndt has joined #openstack-infra18:16
bkeroclarkb, fungi: What do you think the plan-of-action would look like re: mailman upgrade. Create a script to upgrade and run it against the snapshot, then when confident it works do it on prod? Or update snapshot then swap it out?18:16
mordredclarkb: I believe a pattern is to make a second subnet for the same network and give it an ipv6 range18:16
pabelangerShrews: jeblair: clarkb: mordred: ^if we want to move py35-dsvm job to check for nodepool18:16
mordredpabelanger: merge fail18:16
*** mriedem1 has joined #openstack-infra18:16
*** mriedem1 has quit IRC18:16
pabelangermordred: only zuulv3-dev18:17
*** mriedem1 has joined #openstack-infra18:17
pabelangermordred: bug18:17
clarkbbkero: we just ran through the steps in that etherpad for the precise->trusty upgrade and did it in place. That seemed to work well18:17
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Remove unnecessary list()  https://review.openstack.org/46848918:17
bkeroclarkb: okay. Does that start at the top, or under the heading 'Things to do on production server'? https://etherpad.openstack.org/p/lists.o.o-trusty-upgrade18:18
*** mriedem has quit IRC18:18
pabelangerclarkb: mordred: so that would be openstackci-subnet1 with ipv6 too or openstackci-subnet2 along side openstackci-subnet1?18:18
pabelangertrying to learn18:18
clarkbbkero: things to do on the production server. The block above that was prep work to get a copy running for testing18:19
bkeroah okay18:19
bkeroclarkb: I looked in exim4 input queue and found files in there, so I wasn't sure it had been run.18:19
clarkbpabelanger: I think its either way, considering we already have a subnet1 if you want ot be non disruptive I think you need to make a new subnet18:19
clarkbpabelanger: but this is somewhat fuzzy to myself as well and I think the answer is more "you can do all the things because neutron doesn't prescribe much"18:19
openstackgerritFelipe Monteiro proposed openstack-infra/project-config master: Clean up patrole.yaml jenkins jobs  https://review.openstack.org/46851018:20
clarkbbkero: I had done everything up to boot the server off snapshot, and have since done the bup cron dissable18:20
clarkbbkero: you can remove the queues18:20
pabelangerclarkb: ya, would be cool to learn how others have a subnet support both ipv4/ipv618:20
bkeroAh okay18:20
bkeroclarkb: wfm18:21
openstackgerritFelipe Monteiro proposed openstack-infra/project-config master: Clean up patrole.yaml jenkins jobs  https://review.openstack.org/46851018:21
* pabelanger looks at docs18:21
clarkbpabelanger: in osic its two entirely separate networks which is why we have to have two different interfaces aiui18:21
clarkbpabelanger: so thats another option18:21
mordredpabelanger: along side18:21
mordredhaving a single network give you both ipv4 and ipv6 I believe is usually done with 2 subnets, one ipv4 and one ipv6 on that network18:22
pabelangerclarkb: ya, if we can keep networking consistent for osic and citycloud, I won't object :)18:22
mordredat least, that's how vexxhost does it - and I believe it's how dreamhost does it18:23
pabelangermordred: right, that seems to make sense18:23
openstackgerritFelipe Monteiro proposed openstack-infra/project-config master: Clean up patrole.yaml jenkins jobs  https://review.openstack.org/46851018:23
mordredof course, making sure we assign the right prefix is important I believe, no?18:23
clarkband I think there may be magic involved with the ipv6 address scope. Like if you create a v6 subnet you automatically get some chunk out of that?18:23
clarkbkevinbenton: ^ I'm sure you can clarify18:24
mordredoh yeah?18:24
clarkbya there is no ipv4 address scope beacuse you can do whatever since its nat'd18:24
clarkbbut with v6 you won't be nat'd so you need to carve out your piece of the valid pie18:24
*** mriedem1 is now known as mriedem18:24
pabelangerYa, I haven't been able to figure out the prefix we'd use18:25
mordredclarkb: the api seems to require a cidr18:25
clarkbpabelanger: its related to ipv6_address_scope        | 1ecc0c5e-21f0-42e0-ae84-90fa53376f57 in La1 I think18:25
openstackgerritFelipe Monteiro proposed openstack-infra/project-config master: Clean up patrole.yaml jenkins jobs  https://review.openstack.org/46851218:26
clarkbhttps://docs.openstack.org/newton/networking-guide/config-address-scopes.html looks like subnet pools get associated to that18:26
clarkbmordred: pabelanger see the "Create a subnet using a subnet pool associated with a address scope from an external network:" section18:27
clarkbmordred: thats how you do it without passing a cidr18:27
mordredclarkb: https://docs.openstack.org/ocata/networking-guide/config-ipv6.html <-- "Addresses for subnets"18:27
mordredah- gotcha18:27
clarkband it looks like we can choose slaac there rather than dhcpv618:28
clarkbto configure that in the cloud launcher is going to be a pita because every cloud will use a different subnet pool...18:29
clarkbbasically we can't really templatize that too much18:29
clarkbalso I would do something like openstackzuul-subnet1-ipv6 to separate them. (if I was smart the ipv4 subnet would be -ipv4 too)18:29
pabelangerya, I like that18:30
pabelangermaybe try with openstackci project first, see if we can get ipv6 on mirror18:30
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Make zuul ansible dir self-contained  https://review.openstack.org/46820818:30
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Add support for bwrap  https://review.openstack.org/45385118:30
clarkbpabelanger: ya thats probably the easiest way18:30
mordredclarkb: uhm ... if I'm reading this correctly ...18:30
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Cleanup failed upload records  https://review.openstack.org/46778318:31
mordredclarkb: it's possible that there is a way for us to use this feature to make a network that will route us through the external network without nat18:31
mordredeven with ipv418:31
clarkbmordred: yes, but only if your cloud sets it up that way18:31
clarkband citycloud does not configure ipv4 address scopes18:31
mordredah - so the cloud still has to let you ... gotcha18:31
clarkb(at least not in La1)18:31
clarkbmordred: ya because neutron has to manage the valid address ranges and then carve out chunks to users18:32
mordredBUT - I mean, maybe the thing we should be saying is "please set up ipv4 address scopes"18:32
clarkbbasically doing ipam18:32
clarkbmordred: also I think its a relatiely newer feature18:33
mordrednod18:33
clarkbwhen it got enabled in devstack we broke the things and that wasn't too long ago18:33
mordredkevinbenton: ^^ next time I complain about nat vs. non-nat - point me at things neutron may have already done to empower my use case :)18:34
* pabelanger starts reading os_subnet docs18:34
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Fetch server console log if ssh connection fails  https://review.openstack.org/45249418:35
pabelangerwe'll need to patch cloud-launcher too18:36
mordredpabelanger: well - we'll need to add features to shade18:39
mordredand a whole new ansible module18:39
mordredso we may just want to figure out the right thing by hand for now, and then we can add the shade feature once we understand it18:39
mordredand then the ansible module - and then cloud launcher support :)18:39
pabelangermordred: Oh, looking at os_subnet I thought that is what we'd use18:40
mordredwe also need to make subnetpool CRUD calls18:40
mordredwhich is awhole other resource18:40
mordredso we'll need a create_subnetpool call in shade I believe - whether that becomes its own ansible module or just an ooption on an existing one is likely a to-be-determined18:40
pabelangerI guess I am confused, I was looking at: Create a subnet using a subnet pool associated with a address scope from an external network:18:41
mordredpabelanger: yah - but we have to make the subnet pool associated with an address scope from an external network18:41
clarkbmordred: subnet pool management is for cloud admins18:41
mordredoh - nevermind18:42
mordredpabelanger: you have more smarts than me18:42
clarkbmordred: I think all you need is to interrogate subnet pools and to tell os_subnet create calls to use a subnodepool18:42
mordredyah - we'll need a list_subnetpools at least18:42
mordredfwiw: http://paste.openstack.org/show/610760/ is Lon118:43
mordredhttp://paste.openstack.org/show/610761/ is La118:44
mordredso - for now we can actually get by with hard-coding18:44
clarkband we want slaac18:45
*** felipemonteiro has quit IRC18:45
mordredwe do?18:45
*** felipemonteiro has joined #openstack-infra18:45
clarkbya thats the simple RA stuff that we should already be using in osic18:45
clarkbso it should just work(tm)18:45
mordredoh - yes18:45
mordredwe definitely do18:45
mtreinishfungi: finally got around to writing the readme on: https://github.com/mtreinish/pymqttbench do you think there is anything missing there?18:46
openstackgerritMerged openstack-infra/project-config master: Move gate-dsvm-nodepool-py35-src-nv to check for nodepool  https://review.openstack.org/46850918:46
pabelangermordred: okay, I think I see now. There is noway to pass subnetpool to create_subnet in shade18:46
pabelanger| 44e6e98d-078a-446d-a719-1bb3efeaf2d4 | ipv6_tenant_scope | 2a03:b000:902::/48 |18:46
pabelangerthat is from la118:46
mordredpabelanger: that's easy enough to fix18:46
mordredclarkb: osic is dhcpv6-stateless18:47
*** felipemonteiro has quit IRC18:47
pabelangermordred: ya, that looks to be the only setting18:47
mordredclarkb:   u'ipv6_address_mode': u'dhcpv6-stateless',18:47
mordred  u'ipv6_ra_mode': None,18:47
clarkbreally? I could've sworn we were raing there18:47
clarkbwhcih is why neutron disabling ras broke us18:47
*** felipemonteiro has joined #openstack-infra18:47
pabelangerthen, patch os_subnet18:47
openstackgerritKen Giusti proposed openstack-infra/project-config master: Turn on voting for the AMQP 1.0 gate tests  https://review.openstack.org/46844518:48
mordredclarkb: well - from my pov - the most important thing is that whatever we do to get an ipv6 address, it needs to show up in neutron for the server18:48
mordredclarkb: because if it doesn't show up properly on a port object, nodepool will never know to use it18:48
clarkbmordred: ya that should work regardless of the option you pick18:48
mordredk. as long as it does, we'll be happy18:48
clarkbI still think slaac is what we want18:49
clarkbfungi: ^ you likely have opinions18:49
pabelangerso, do we want to try running this by hand for la1 or lon1 today?18:49
mordredpabelanger: yah. I think so - since we're still learning about it18:50
pabelangerk, let me see if I can build a command18:50
*** neiljerram has quit IRC18:51
*** rbrndt has quit IRC18:51
*** felipemonteiro_ has joined #openstack-infra18:51
*** annegentle has quit IRC18:52
pabelanger$ openstack subnet create openstackci-subnet1-ipv6 --ip_version 6 --ipv6-ra-mode slaac --ipv6-address-mode slaac --subnetpool ipv6_tenant_scope ext-net18:53
pabelangeraccording to docs18:53
clarkbpabelanger: I don't think ext-net is what you want18:53
clarkbit will be our network18:54
clarkbopenstackci-network118:54
clarkb(I think)18:54
pabelangeryes, I think you are right18:54
pabelanger$ openstack subnet create openstackci-subnet1-ipv6 --ip_version 6 --ipv6-ra-mode slaac --ipv6-address-mode slaac --subnetpool ipv6_tenant_scope openstackci-network118:54
pabelangerwe ready to give that a try?18:54
clarkbya I think so. Then you'll want to see if mirror node picks up its new addr18:55
pabelangerright18:55
pabelangerokay, pasting command18:56
pabelangersyntax error18:56
pabelangerchecking18:56
clarkbpabelanger: oh ipv6_tenant_scope might be the address scope name but you need the subnetpool beloinging to that scope18:57
pabelanger$ openstack subnet create openstackci-subnet1-ipv6 --ip-version 6 --ipv6-ra-mode slaac --ipv6-address-mode slaac --subnet-pool ipv6_tenant_scope --network openstackci-network118:57
pabelangerupdated syntax18:57
*** kzaitsev_pi has quit IRC18:57
pabelangerhttp://paste.openstack.org/show/610763/18:58
*** felipemonteiro has quit IRC18:58
*** annegentle has joined #openstack-infra18:58
clarkboh looks like you need to do the router interface step in the doc I linked too18:58
clarkbpabelanger: "Connect a router to each of the project subnets that have been created, for example, using a router called router1"18:59
clarkbto connect the new subnet to the router18:59
*** kzaitsev_pi has joined #openstack-infra18:59
*** sdague has quit IRC18:59
pabelangerya, just reading docs still18:59
*** sdague has joined #openstack-infra18:59
pabelangerneutron router-interface-add == openstack router add port ?19:01
clarkbyes I think ports are basically interfaces19:01
clarkbosc is just trying to use common verbs and nouns and since the resource is a port not an interface...19:02
pabelangerrouter add subnet seems better19:02
pabelangertesting that19:02
*** xyang1 has joined #openstack-infra19:03
clarkb(I also rarely do any of this by hand because horizon has a wizard thing to do it and you do it once then enver remember again... I'm a bad cloud user)19:03
mordredpabelanger: when you're done - would you mind capturing the commands you ran that worked?19:03
pabelanger$ openstack router add subnet openstackci-router1 openstackci-subnet1-ipv619:03
pabelangermordred: sure19:03
clarkband now you wait for ras19:04
clarkbshould happen every 5 minutes or something like that19:04
*** salv-orl_ has joined #openstack-infra19:04
pabelangerMay 26 19:04:04 mirror ntpd[1021]: Listen normally on 6 eth0 2a03:b000:902:3:f816:3eff:fe6a:beb1 UDP 12319:05
clarkbmagic19:06
clarkbdoes an openstack server show show that address?19:06
*** salv-orlando has quit IRC19:06
openstackgerritMerged openstack-infra/shade master: Use catalog endpoint on any errors in image version discovery  https://review.openstack.org/46764419:07
pabelangerclarkb: I don't see it is openstack server show19:07
openstackgerritMerged openstack-infra/shade master: Log cloud name on Connection retry issues  https://review.openstack.org/46768619:07
openstackgerritMerged openstack-infra/shade master: Add time reporting to Connection Retry message  https://review.openstack.org/46768919:07
pabelanger| addresses                   | openstackci-network1=10.0.1.6, 89.46.82.21                               |19:07
clarkbpabelanger: ya worried it may only pick that up on boot? or maybe its delayed.19:07
clarkbpabelanger: we also need to update security groups19:08
pabelangerI can boot another instance quickly19:08
pabelangersecurity groups should be open by default19:08
pabelangerI think we added that into cloud launcher19:08
clarkbipv6 too?19:08
pabelangerya19:08
pabelangerosic19:08
clarkboh yup19:08
clarkbcool19:08
bkeroclarkb: So it looks like the puppet repo name got changed from trusty to xenial. http://paste.openstack.org/show/610764/19:13
clarkbpabelanger: there may also just be a delay with nova getting new info from neutron on the ipaddr beacuse of caching19:13
bkeroSure enough there isn't a 'main' at the URL19:13
*** Goneri has joined #openstack-infra19:14
bkeroWhat do the other servers use I wonder19:14
pabelangerclarkb: booting a new mirror:19:14
pabelanger| 015d9aa4-e1b0-4fe1-ace0-6a6bc392a100 | mirror.la1.citycloud.openstack.org | ACTIVE | openstackci-network1=10.0.1.8, 2a03:b000:902:3:f816:3eff:feb3:f8e6, 89.42.141.74 | Ubuntu 14.04 Trusty Tahr 20160304 |19:14
bkeropc1?19:14
clarkbbkero: its also puppet 4, I think we install puppet from distro packaging on xenial elsewhere19:14
clarkbbkero: check the system-config/install_puppet.sh script19:15
bkerookay19:15
bkeroSo probably best to remove it19:15
pabelangerlaunch failed, network is unreachable19:15
clarkbpabelanger: ya I am not able to hit it via ssh19:16
pabelangerusing --keep now to see19:16
fungimtreinish: your pymqttbench readme looks great. i can't think of anything it's missing other than to maybe be more explicit about the fact that the tool only needs one invocation and runs both publisher and subscriber threads from that simultaneously (as opposed to similar tools which need you to run two separate invocations for publisher mode and subscriber mode)19:16
clarkbpabelanger: I would double check the security group rules just to be sure its not them19:16
clarkbbkero: ya best to remove it if we get puppet from distro19:16
mordredmaybe the security group rules didn't generate v6 rules because of lack of v6 network?19:16
mtreinishfungi: oh, that's a good idea. I can adds something about that19:16
* mordred making up thoughts19:16
clarkbmordred: pabelanger or possible their image we are booting off of doesn't slaac properly19:17
clarkbwe'll want to ssh in via v4 and poke around so ++ to --keep19:17
pabelangersecurity groups look good19:17
pabelangerconfirmed19:17
fungiclarkb: if there's no ra then they must be statically configuring the default route somehow? dhcp6 relies on route advertisements rather than conveying gateway details directly (unlike dhcp for ipv4)19:18
clarkbfungi: oh then maybe we did want dhcp6 stateless?19:18
pabelangerclarkb: ssh -i /tmp/7d73b091-3b74-4b0d-98b7-a2ba59144994.id_rsa root@89.42.141.10219:18
pabelangerfrom puppetmaster if you also want to poke around19:19
fungialso slaac _is_ what stateless dhcp6 is normally used with since it doesn't perform address assignments (as opposed to stateful dhcp6)19:19
fungithough what those terms translate to in neutron's world is anybody's guess19:19
clarkbfungi: right probably more docs reading necessary19:20
clarkbpabelanger: that failed for me permission denied19:20
clarkboh because I am not pabelanger19:20
* clarkb su's19:20
*** salv-orl_ has quit IRC19:21
pabelangerya, routes don't look setup19:21
*** salv-orlando has joined #openstack-infra19:21
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Collapse shade legacy and non-legacy jobs  https://review.openstack.org/46649019:21
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Test shade patches against zuulv3 branch of nodepool  https://review.openstack.org/46844119:21
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Turn on voting for shade python35 functional jobs  https://review.openstack.org/46844019:21
*** dimtruck is now known as zz_dimtruck19:22
clarkbpabelanger: it didn't configre the interface for global ipv6 either19:22
clarkband /etc/network/interface is pretty bare19:22
pabelangerOh19:22
pabelangerI think I know19:23
pabelangeractually no19:23
pabelangerI didn't enable config-drive here, but that shouldn't matter19:23
pabelangerwe don't have glean19:23
clarkbya I think we need an iface eth0 inet6 auto19:24
pabelangeriface eth0 inet dhcp19:24
pabelangeris default19:24
clarkbya thats just for v4 which is what we want there19:25
pabelangerclarkb: sure, go for it19:25
*** salv-orlando has quit IRC19:25
pabelangerlaunch failed on ping6 -c5 -Q 0x10 review.openstack.org || ping6 -c5 -Q 0x10 wiki.openstack.org19:25
clarkbservice networking restart didn't quite do what I want there19:25
pabelangerwhich will always, since we didn't setup dhcp properly19:26
pabelangerwe should fix that19:26
clarkbreload: Job is not running: networking then start: Job is already running: networking19:28
clarkbmake up your mind upstart19:28
pabelangerya, it stinks19:28
clarkbifup --force eth0 did more but not working ipv619:30
clarkbpabelanger: you might try manually assiging the ip addr and see if that at least routes and all that19:30
clarkbI need to grab lunch19:31
pabelangerclarkb: k19:31
pabelangerwill reboot first19:31
pabelangeror hack our launch script19:31
clarkbgate-tempest-dsvm-neutron-dvr-ha-multinode-full-ubuntu-xenial-nv went from 786MB per job to 127MB as part of this logs cleanup. A good chunk of that was in neutron reverting the change that bloating logs but thats a nice improvement :)19:35
fungihere's hoping we'll see a steady downward slope on the disk utilization graph over the next six weeks as those age out of the retention19:39
mtreinishfungi: https://github.com/mtreinish/pymqttbench/commit/7b3bbd1a4de747492c3803667b2c48f9f432fb2d19:39
fungimtreinish: excellent addition!19:40
*** aviau has quit IRC19:41
*** aviau has joined #openstack-infra19:41
*** jkilpatr has quit IRC19:49
pabelangerclarkb: fungi: wasn't there something about accept_ra = 2 needed for osic19:50
pabelangeris that needed for slaac ?19:50
openstackgerritSean Dague proposed openstack-infra/project-config master: announce merged patches in nova channel  https://review.openstack.org/46852719:50
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Make zuul ansible dir self-contained  https://review.openstack.org/46820819:52
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Add support for bwrap  https://review.openstack.org/45385119:52
*** salv-orlando has joined #openstack-infra19:53
*** panda is now known as panda|travel19:57
clarkbpabelanger: yes you need ras enabled and you need neutron to not disable that default should work I think20:00
pabelangerclarkb: accept_ra is currently 120:00
clarkbits more of a nested cloud problem20:00
clarkbya that should be fine since no nested cloud20:00
bkeroclarkb: Okay, followed the instructions on the etherpad. The host seems to be up and running, with apache2 serving mailman.20:00
pabelangerclarkb: I can only guess that something is dropping 2a03:b000:902:3:f816:3eff:fe6a:beb120:01
clarkbpabelanger: did eth0 get configured with that adr?20:02
pabelangerclarkb: that is from our actually mirror20:02
clarkbah20:02
pabelangerand openstack does see it now20:02
fungiinfra-root: i'm getting started on the lists.o.o maintenance now20:03
fungifor reference: https://etherpad.openstack.org/p/lists.o.o-openstack-archive-import20:03
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Move config out of parameter YAML file  https://review.openstack.org/46324220:03
fungian initial step not mentioned there is that i'm adding the server to the emergency disable list so that puppet won't inadvertently restart services prematurely20:04
*** jamesmca_ has quit IRC20:04
jeblairfungi: ack20:05
fungialso, looking at the server list, we still have test precise and trusty servers in addition to the one bkero's working on. can probably clean those up20:05
*** bobh has quit IRC20:05
*** gouthamr has quit IRC20:05
pabelangerclarkb: YAY20:06
pabelangerworking20:06
clarkbpabelanger: did ypu change anything?20:06
pabelangerssh 2a03:b000:902:3:f816:3eff:fe6a:beb120:06
fungiand run_all.sh is not currently underway, so i'm starting to stop mailman now20:07
pabelangerclarkb: yes, subnet wasn't connected to router20:07
pabelangerguess command didn't work20:07
clarkbpabelanger: ah and that would prevent RAs too20:07
pabelangerso, that is our production mirror20:07
fungii'm backing up the general ml archive to /tmp/openstack_archive_backup.tar right now20:08
sdagueirc bot easy review - https://review.openstack.org/#/c/468527/ - just adding merged changes to #openstack-nova20:08
*** jkilpatr has joined #openstack-infra20:08
bkeroclarkb, fungi: What's next after the do-release-upgrade if we're not doing ext3->ext4? Some kind of validation?20:08
clarkbbkero: ya I think we want to try sending test mail?20:09
clarkbjeblair: ^ you set that up last time20:09
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Fix bad text wrap in status page  https://review.openstack.org/46853220:09
jeblairclarkb: we just poked around the web ui; i don't think we tried sending mail from the test server20:10
bkeroI curl'd the webserver, it seems to be responding correctly20:10
fungithough we did create a test ml on it and send e-mail to it either with a /etc/hosts addition on the client or via simulated smtp over netcat, right?20:11
fungiand subscribed a few people to it20:11
fungiand tested that subscription confirmation worked both via web and smtp20:11
bkerohttp://166.78.27.133/cgi-bin/mailman/listinfo20:11
bkeroNo lists found :/20:12
funginot that i'm saying we necessarily need to go to those extremes this time around, just recounting what i remember from the precise->trusty upgrade20:12
fungiokay, the general ml backup is completed. now working to append the old archive to the current one and then reindex it20:12
fungii expect the reindexing to take a while20:14
bkerohttp://166.78.27.133/pipermail/openstack-dev/ seems to be served as well20:15
jeblairfungi: oh, yeah, i think so20:16
jeblairbkero: yeah, the index not working is expected20:16
bkerojeblair: Yeah, it doesn't seem to be finding the index20:17
bkeroNo error's being thrown though. I'm guessing the lists aren't where it's expecting them.20:19
jeblairbkero: i think there's some hostname weirdness involved in the index.20:19
dirkAJaeger: pabelanger : how about simply merging the change in the project-config instead? I'd rather have the bindeos always installed without recommends outside the dib change20:19
pabelangerdirk: we don't do that for other operating system today, so I am reluctant to only do it for opensuse20:20
bkerojeblair: I see20:21
pabelangerdirk: also, bindep doesn't work for devstack, so devstack would also need to be updated for that too20:21
bkerojeblair: curling with Host: lists.openstack.org makes it work as expected20:22
pabelangerclarkb: odd, ipv6 route seems down again20:22
fungipabelanger: dirk: i guess suse doesn't treat recommendations the same way debian does (these are the packages we recommend you install with it under all but unusual circumstances)? as opposed to debian's suggestions (if you're using this package you might also be interested in installing these other packages)?20:23
dirkpabelanger: well, it's just globally turned off for all dpkg based distros and there is no recommends fornred hat afaik20:23
dirkpabelanger: so as such it is naturally opensuse specific20:24
pabelangerdirk: right, I think we also want to disable it globally for opensuse20:24
fungiwe have dpkg-based distros preconfigured to disable automatic installation of recommends? that seems like a poor choice to me20:24
pabelangerfungi: yes, been like that for a long time20:24
sdaguepabelanger: recommends or suggests?20:24
dirkpabelanger: why? That's a deviation from distro choices20:24
clarkbif using the -minimal elements20:24
fungiwe should be trying to follow distro defaults wherever possible, and at least debian and ubuntu default to automatically installing recommends20:25
pabelangerfungi: minimal elements20:25
pabelangerthe idea from DIB was to keep things it installed to minimal20:25
fungido we at least undo that configuration option after creating the chroot?20:25
dirkpabelanger: it's not a problem for devstack because it doesn't recommend texlive anywhere20:25
bkerojeblair: curl -s -H "Host: lists.openstack.org" http://166.78.27.133/cgi-bin/mailman/listinfo | elinks -dump20:26
fungii can understand minimizing what's preinstalled on the image, but altering a fairly fundamental default in the package manager for normal operation thereafter strikes me as a questionable choice20:26
pabelangerdirk: right, it is not an issue now too for bindep-fallback.txt, we removed the offending package right?20:26
dirkpabelanger: probably yes20:26
dirkWas my followup change also.merged? This morning it wasn't20:26
pabelangersdague: both: http://git.openstack.org/cgit/openstack/diskimage-builder/tree/diskimage_builder/elements/dpkg/pre-install.d/00-disable-apt-recommends20:27
openstackgerritHongbin Lu proposed openstack-infra/project-config master: Add new project gos-brick  https://review.openstack.org/46853620:27
sdaguepabelanger: yeh, well that explains why there have been so many extra things we had to call out in devstack after dib images got used20:27
fungithough i guess if we test with automatic installation of recommends disabled, then the result should cover people who configure their systems that way as well as people who choose the default (whereas the reverse may simplify our dependency listings but could take people who have non-default apt configurations by surprise)20:28
dirkFungi: +120:28
fungiarchive reindexing complete20:28
dirkMy current assumption was that dib images should be usable outside nodepool as well, but it looks like we want to opinionate it towards that20:29
*** senk has joined #openstack-infra20:29
fungihttp://lists.openstack.org/pipermail/openstack/ shows archives going back to july 2010 now!20:29
pabelangersdague: fungi: I mean, I would be okay with removing it, but I know dib folks pushed back on -minimal elements being, minimal.  Last time I discussed this, it was suggested we create -cloud elements.20:29
pabelangersdague: fungi: but, we could remove the file in project-config nodepool element20:29
*** senk has quit IRC20:29
pabelangerjust means more things get installed20:29
fungihttp://lists.openstack.org/pipermail/openstack/2013-August/000181.html still points to the same message it did before the archive import and reindexing20:30
dirkpabelanger: any concern about https://review.openstack.org/468130 ?20:30
dirkAre we going to run out of disk space on that afa share?20:30
dirkAfs20:31
pabelangerdirk: how large is the new repo?20:31
fungii'm going to continue browsing around http://lists.openstack.org/pipermail/openstack/ to make sure things look okay before and after (and especially during) july 2013, but anyone else feel free to do the same20:31
pabelangerdirk: I'll be able to look at it on monday20:31
dirkSimilar to the existing one20:31
pabelangerya, we have a fair bit of space now that we deleted ruby-gems20:31
*** ihrachys has joined #openstack-infra20:31
fungiwe have about 20 minutes we can poke around before i'll need to make the call to roll back the maintenance (if necessary)20:31
dirkI currently have the feeling that 42.3 might be easier to get working with devstack20:32
jeblairfungi: lgtm so far; i'm looking at messages with non-ascii encodings and they look good.20:32
*** mist|senk has quit IRC20:32
dirkAnd if that works we can remove 42.220:32
fungijeblair: oh! good call, after that last discovery during the upgrade20:32
dirkSo it would only be transitional. Product wise we are targeting pike with 42.3 anyway20:32
jeblairfungi: what's the date cutoff?20:33
fungijeblair: there's some overlap, but http://lists.openstack.org/pipermail/openstack/2013-July/date.html was the earliest message in the mailman archive before i began20:33
fungithere were ~5 days of overlap between the earliest message on the new ml and the last message on the old ml20:34
dirkCould anyone quickly review https://review.openstack.org/#/c/468132/ ? I would like to not be bored over the weekend :-)20:34
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Write inventory as yaml not ini  https://review.openstack.org/46763420:34
*** esikachev has joined #openstack-infra20:34
jeblairok, that might have been a post move msg; i'll look for older non-ascii20:34
*** jamesmca_ has joined #openstack-infra20:34
*** Swami has quit IRC20:34
jeblairhttp://lists.openstack.org/pipermail/openstack/2012-June/032283.html should be good then (and looks fine)20:35
jeblairas does http://lists.openstack.org/pipermail/openstack/2012-June/032688.html  and i just learned the characters for "Reply: Reply:" :)20:36
pabelangerclarkb: okay, booting another mirror server, this time to see if ipv6 works out of box20:37
clarkbpabelanger: default via fe80::f816:3eff:fe8b:e590 dev eth0  proto ra  metric 1024  expires 286sec hoplimit 64 may be the problem as that is our local addr not the global one as our default route20:37
jeblairway too easy to get stuck in nostalgia20:38
pabelangerclarkb: k, let see what happens in 286sec20:38
fungijeblair: yeah, this was the last message in the archive exported from the old ml: http://lists.openstack.org/pipermail/openstack/2013-July/000049.html20:39
*** jamesmca_ has quit IRC20:39
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add a space and a capital letter to success banner  https://review.openstack.org/46853920:39
*** thorst has quit IRC20:40
clarkb[spam]20:41
fungiactually, given the message count on that url, i think it's a duplicate which landed on the new ml20:41
*** jamesmca_ has joined #openstack-infra20:42
fungiand i pasted the wrong url for the oldest message in the new ml. it was: http://lists.openstack.org/pipermail/openstack/2013-July/000000.html20:44
pabelangerfungi: nice work20:44
fungias evidenced by the message id number of 000000 ;)20:44
clarkbfungi: no negative numbers?20:44
openstackgerritDean Troyer proposed openstack-infra/project-config master: Turn off Swift for py3 jobs  https://review.openstack.org/46854020:44
fungiso anyway, confirmed messages earlier than that have very high (higher than the latest message in the archive before the import) index numbers20:45
*** jascott1 has quit IRC20:45
fungithis looks to have worked as advertised20:45
fungidhellmann: your wish is granted! http://lists.openstack.org/pipermail/openstack/20:45
* dhellmann compares his long wishlist against that url20:46
fungiheh20:46
jeblairfungi: how many wishes does dhellmann have left?20:46
dhellmannfungi : you've imported the history?20:46
notmynamedtroyer: I've seen several patches about "disable swift in py3 testing" etc, but I want to check something...20:46
fungidhellmann: yep, all the way back to july 201020:46
*** d0ugal has quit IRC20:46
dhellmannjeblair : how many do I have, or how many are going to be granted?20:47
dhellmannfungi : woot! thanks!20:47
clarkbnotmyname: swift is enabled by default so we have to disable it when we enable the non default of running openstack under python320:47
jeblairor as it's known "the beginning of the openstack era"20:47
jeblairdhellmann: yes20:47
clarkbnotmyname: *enabled by default in devstack20:47
notmynamedtroyer: projects/services running under py3 can still *use* swift as a target, right? eg if glance is running under py3, it can still toally use swift that is running under py220:47
fungiopenstack year zero20:47
dhellmanneat it, 197020:47
fungioldest message in the archive is now mordred replying to termie about nova and swift dependencies... suggesting that there was a still earlier ml20:48
fungihttp://lists.openstack.org/pipermail/openstack/2010-July/019438.html20:49
bkeroThat could be where it all started.20:49
fungiboto is out, zope is in! i coulda told 'em that20:49
clarkbdid time exist when openstack used bzr?20:49
pabelangerclarkb: 2a03:b000:902:3:f816:3eff:fecb:a3df online and survived the reboot20:51
pabelangerclarkb: original mirror still down on ipv6 :(20:51
fungiif i'm reading that message correctly, mordred is arguing that he'd prefer tests not to be packaged in with the code they test ;)20:51
jeblairsomething i still subscribe to for applications (not libraries)20:52
dtroyernotmyname: maybe?  I just typed a 'I don't need swift here' and realized I totally do for OSC functional tests.  so it's a matter of soring out how to mix python versions in DevStack and it's been a while for me thereā€¦20:52
clarkbpabelanger: the route matches there so that writes off that idea20:52
jeblair(zuul has 3MiB of tests+data that don't need to be installed everywhere)20:52
clarkbpabelanger: however I can't ping6 google but can ping6 review.openstack.org. Perhaps there is some weird routing going on20:52
fungiokay, i've heard no concerns raised, so i'm moving forward with starting the mailman service and unblocking puppet for lists.o.o20:52
*** jascott1 has joined #openstack-infra20:53
pabelangerclarkb: maybe we should follow up with citycloud next week, see if we did it properly20:53
*** sshnaidm|off has quit IRC20:53
clarkbpabelanger: ya20:53
pabelangerfungi: ++20:53
clarkbpabelanger: and its possible we are the only peope using this :)20:53
pabelangerclarkb: ya, possible20:53
fungiipv6 is still very new and shiny, after all20:53
dhellmannfungi : if I come across any older archives, I'll definitely share them for importing20:54
mordredfungi: :)20:54
* fungi would be disappointed to discover we're the only people trying to openstack them some v6 up in citycloud20:54
mordredfungi, jeblair: although, my _actual_ message was "whatever thing we pick ultimately doesn't matter, let's pick one thing and do it consistently" :)20:54
notmynamewait, are you saying that the earliest archived email for openstack was about resolving some difference between swift and nova?20:55
notmyname;-)20:55
pabelangermordred: okay, only 2 commands were la1 ipv6: http://paste.openstack.org/show/610770/20:55
fungimordred: any clue where that message you replied to came from? was there a predecessor to the lp openstack ml, or are we missing still earlier archives?20:55
mordrednotmyname: SHOCKING I know20:55
jeblairnotmyname: glad we got that all sorted out :)20:55
*** zz_dimtruck is now known as dimtruck20:55
notmynamejeblair: lol20:55
mordredfungi: I don't think I have locally archived mailing list things from back then20:55
pabelangermordred: we likely can reproduce on lon1 next week20:55
mordredpabelanger: sweet20:56
*** jamesmca_ has quit IRC20:56
fungimordred: just curious whether the openstack ml on lp predated that message, or whether there was a migration from some still older ml to that on that date20:56
mordredjeblair, notmyname: yah. it's great that we at least achived consensus on that critical topic20:56
openstackgerritDean Troyer proposed openstack-infra/project-config master: Run Swift under py2 for py3 jobs  https://review.openstack.org/46854020:56
*** dimtruck is now known as zz_dimtruck20:57
jeblairmordred: the openstack org was private before then, right... maybe there was an lp list people were using, but the messages sent before it became public didn't make it into the archive/export?20:57
mordredfungi: there should not have been an older mailing list. HOWEVER - we did have some weirdness at the beginning because we set up nova and swift in launchpad as "private" projects - then discovered that un-privating a thing didn't work as well as might have been hoped20:57
mordredyah - what jeblair said20:57
fungimakes sense. thanks!20:58
clarkbpabelanger: traceroute says there is a 130ms or so black hole in dfw20:58
mordredfungi: at most we've lost approx 6 weeks of mailing list that was probably just the twisted v. eventlet argument20:58
fungi#status log OpenStack general mailing list archives from Launchpad (July 2010 to July 2013) have been imported into the current general archive on lists.openstack.org.20:58
openstackstatusfungi: finished logging20:58
fungi#success OpenStack general mailing list archives from Launchpad (July 2010 to July 2013) have been imported into the current general archive on lists.openstack.org.20:59
openstackstatusfungi: Added success to Success page20:59
fungibelongs both places ;)20:59
openstackgerritSlawek Kaplonski proposed openstack-infra/shade master: Remove designateclient from commands related to zones  https://review.openstack.org/46854220:59
kevinbentonclarkb, mordred: ahoy. i see some rumblings about address scopes in the backlog20:59
kevinbentonwhat was the question?20:59
pabelangerclarkb: oh noes20:59
mordredfungi: oh - I'm sorry - I counted wrong - at worst there were 20 days20:59
mordredmissing20:59
* dtroyer just seeing the ML discussionā€¦20:59
fungikevinbenton: we're casting chicken bones and trying to map neutron's v6 terminology to actual rfcs ;)20:59
jeblairmordred, fungi: matches the lp archive: https://lists.launchpad.net/openstack/thrd128.html21:00
*** thorst has joined #openstack-infra21:00
clarkbI htink we mostly have it figured out except some things work intermittently and other things don't work at all21:00
clarkbpossibly deployment bugs21:00
kevinbentonah21:00
dtroyerI've stashed all OpenStack public email in GMail since the beginning, what timeframe is missing?21:00
dtroyer(all I've received anyway)21:00
pabelangerclarkb: ya, good feedback for citycloud21:00
pabelangerclarkb: I'll see how lon1 looks on monday21:00
fungidtroyer: messages prior to http://lists.openstack.org/pipermail/openstack/2010-July/019438.html21:00
*** dprince has quit IRC21:01
kevinbentonso if you're familiar with VRFs, they closely map to address scopes21:01
kevinbentonthey are a way to indicate that all of the addresses are in the same l3 domain21:01
kevinbentonand should not have NAT between them21:01
dtroyerso, downloading 17406 messages over GoGo, there's something that'll make friends :)21:02
fungidtroyer: we're in no hurry to find the missing three weeks of discussion. also someone will need to find time to massage them into mbox format21:02
notmynameoldest openstack email I have is from Aug 221:03
* dtroyer wasn't serious :)21:03
jeblairif someone finds something older than that, i will happily fix up the archive :)21:03
jeblair(i'd love to see the eventlet discussion ;)21:03
kevinbentonclarkb: let me know if you run into anything that does look like a neutron bug21:03
*** trown is now known as trown|outtypewww21:03
fungiand yeah, now that https://etherpad.openstack.org/p/lists.o.o-openstack-archive-import is confirmed to have worked, we can add the earlier messages fairly easily as long as we have them in the appropriate format21:03
*** thorst has quit IRC21:04
clarkbpabelanger: there is another black hole between cogent in chicago and canada (ovh)21:04
clarkbyay ipv621:04
fungiand on that note, i'm heading out to find some grub... bbiaw21:04
*** gouthamr has joined #openstack-infra21:04
mordredjeblair: it does not seem to exist21:05
mordredjeblair: I went through to feb 2011 and didn't see it - so I'm guessing it's in the pre-message-1 set21:07
*** masuberu has quit IRC21:07
mordredI did find this gem from eday: http://lists.openstack.org/pipermail/openstack/2010-July/019441.html - which discusses whether or not we should share things between services via a proxy tier or via a set of libraries21:08
clarkband now the proxy approach is the new hotness in microservices :)21:11
*** fguillot has quit IRC21:14
clarkboh hey ianw's systemd short iso timestamp format for journalctl output merged21:14
mtreinishmordred: I'm more interested in whether you were gonna start the previous thread up again: http://lists.openstack.org/pipermail/openstack/2010-July/019439.html21:15
mtreinishmordred: iirc swift still has them out21:15
clarkbso now in the next lts of every distro we'll have it. Its not on tumbleweed yet21:16
mordredmtreinish: it's worth noting that in this case termie and I agreed, and also agreed with notmyname - yet we still somehow wound up going with soren and putting them in except for never actually moving swift21:17
mordredmtreinish: what a GREAT job we did there21:17
mordredAHA!21:18
mordredfungi: I believe I understand why we're missing messages21:18
mordredfungi: we're missing the emails from the merge requests themselves21:18
*** e0ne has joined #openstack-infra21:18
mordredfungi: https://code.launchpad.net/~termie/nova/move_tests/+merge/30739/comments/72584 is the thing I was email-responding to to the list21:19
*** gyee has quit IRC21:19
pabelangerclarkb: that with mtr?21:20
clarkbpabelanger: just traceroute621:20
clarkbalso I appear to have lost connectivity to the newly booted server21:20
jeblairmordred: oh, ha21:21
openstackgerritMerged openstack-infra/devstack-gate master: Preinstall pbr with pip  https://review.openstack.org/46693521:21
pabelangerclarkb: ya, same. It looks like we lost the router again on openstackci-subnet1-ipv621:21
pabelangerclarkb: openstack must be disconnecting it for some reason21:22
mtreinishmordred: it's not too late to get consistency, start a tc resolution for moving everything out :)21:23
*** tushar has quit IRC21:23
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Make bindep-fallback job for opensuse-422 voting  https://review.openstack.org/46855021:24
*** sdague has quit IRC21:25
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Release executor jobs on test exit  https://review.openstack.org/46855321:27
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add LoggerAdapter for executor jobs  https://review.openstack.org/46855421:27
*** bobh has joined #openstack-infra21:27
*** senk has joined #openstack-infra21:28
*** kgiusti has left #openstack-infra21:30
*** dhajare has quit IRC21:30
*** wolverineav has quit IRC21:31
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Actually check out the branch in the jobdir  https://review.openstack.org/46855621:32
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Enable test_multi_branch cloner/executor test  https://review.openstack.org/46855721:32
*** wolverin_ has joined #openstack-infra21:35
mordredjeblair: ok - because I can't let things go - I couldn't find the email thread - but I did find the blueprint: https://wiki.openstack.org/wiki/Obsolete:UnifiedServiceArchitecture21:35
*** esikachev has quit IRC21:36
*** asselin_ has joined #openstack-infra21:36
*** asselin has quit IRC21:38
*** wolverin_ has quit IRC21:39
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add a space and a capital letter to success banner  https://review.openstack.org/46853921:43
*** annegentle has quit IRC21:44
*** mdrabe has quit IRC21:45
*** e0ne has quit IRC21:48
*** senk has quit IRC21:49
*** salv-orlando has quit IRC21:51
*** salv-orlando has joined #openstack-infra21:51
*** rlandy has quit IRC21:53
ihrachysclarkb, still have that ban hammer for me for #openstack-neutron?21:54
*** mriedem is now known as mriedem_afk21:54
ihrachysclarkb, how do I get one permanently?21:54
clarkbihrachys: I think I tell chanserv to make you more permanent21:55
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Collapse shade legacy and non-legacy jobs  https://review.openstack.org/46649021:55
clarkbihrachys: I just temporaried you again21:55
clarkblet me see if I can sort out the more permanent setup21:55
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Turn on voting for shade python35 functional jobs  https://review.openstack.org/46844021:55
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Test shade patches against zuulv3 branch of nodepool  https://review.openstack.org/46844121:55
*** salv-orlando has quit IRC21:55
ihrachysok thanks. in the meantime, the latest cause of disruption was killed by services, but it would still be nice to have one for future21:56
*** jamesmca_ has joined #openstack-infra21:56
clarkbya looks like markmcclain has it so I'll just copy that over21:56
clarkbihrachys: there I think I have set it up properly21:59
clarkbkevinbenton: ^ just as an fyi I've done that since ihrachys has been on top of the trolls recently22:00
*** jamesmca_ has quit IRC22:01
*** rfolco has quit IRC22:02
*** rfolco has joined #openstack-infra22:03
*** rfolco has quit IRC22:03
*** ihrachys has quit IRC22:04
*** ihrachys has joined #openstack-infra22:05
bkeroclarkb, fungi, jeblair: FYI in do-release-upgrade on lists.o.o there was this traceback: http://paste.openstack.org/show/610771/22:05
*** esikachev has joined #openstack-infra22:06
clarkbbkero: guessing thats because the file actually has the real hostname in it?22:06
bkeroclarkb: http://paste.openstack.org/show/610772/22:07
clarkbperhaps the dir moved between releases?22:11
*** xyang1 has quit IRC22:12
*** esikachev has quit IRC22:12
clarkb/var/lib/mailman/locks is valid path on trusty server22:12
*** ihrachys has quit IRC22:12
bkeroGonna go install it in a vm and see where it puts it22:13
clarkbup to 400GB free on the logs fs22:16
bkeroclarkb: interesting, /var/lock/mailman exists when I install mailman in a new xenial vm22:16
clarkbbkero: huh22:17
bkerostated 2775 root:list22:17
bkeroSo maybe we just need to mkdir that when we do the upgrade22:17
clarkbmaybe?22:17
clarkbjeblair: ^ any idea why that may happen?22:17
clarkblike perhaps there is a remove old stale locks step that doesn't then put the dir back?22:18
*** gordc has quit IRC22:19
*** bobh has quit IRC22:22
jeblairlrwxrwxrwx  1 root     root     17 Jul 17  2012 locks -> /var/lock/mailman22:26
jeblairi think maybe the init system creates /var/lock/mailman, and if mm hasn't been started since server boot, it won't exist?22:27
jeblairclarkb, bkero: ^22:27
bkerojeblair, clarkb: line 200 https://anonscm.debian.org/viewvc/pkg-mailman/trunk/debian/rules?view=markup22:27
*** esikachev has joined #openstack-infra22:27
jeblairyeah, so it'll get created on install as well, but upgrade without having started mm since boot would pose a problem22:30
openstackgerritIsaku Yamahata proposed openstack-infra/project-config master: nteworking-odl: introduce nitrogen, retire beryllium  https://review.openstack.org/46856322:31
*** esikachev has quit IRC22:31
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Collapse shade legacy and non-legacy jobs  https://review.openstack.org/46649022:32
mordredI have had to iterate on that oneWAY too much22:32
fungimordred: okay, that makes sense. so the merge requests themselves weren't spewed onto the ml, they merely set the ml as the reply-to address?22:32
ianwpabelanger / clarkb : yep, i can do a release on my monday22:34
mordredfungi: I think neither, iirc. One could "subscribe" to a repo and you'd get emails from it22:38
mordredfungi: in that case, I believe I replied to the merge email and cc'd the mailing list - althugh I might be wrong about the specific mechanics22:39
mordredfungi: I'm also at leats mildly confused as to where some of the threads I remember existing are - so it's also possible there were other places that I just don't remember22:39
*** ryotagami has quit IRC22:44
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Verify executor branch checkout  https://review.openstack.org/46856422:45
*** jascott1 has quit IRC22:47
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Enable test_multi_branch cloner/executor test  https://review.openstack.org/46855722:47
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Verify executor branch checkout  https://review.openstack.org/46856422:47
*** ryotagami has joined #openstack-infra22:48
fungimordred: maybe we'll get our hands on dtroyer's gmail gold one of these days to fill in the blanks in the archive once and for all22:51
fungidebian stretch due for release june 17! (for those not subbed to dda@ldo)22:52
openstackgerritJohn Dickinson proposed openstack-infra/irc-meetings master: new swift team meeting  https://review.openstack.org/46856822:59
*** esikachev has joined #openstack-infra23:07
*** chlong has quit IRC23:10
*** esikachev has quit IRC23:12
*** jascott1 has joined #openstack-infra23:13
*** yamahata has quit IRC23:18
*** rhallisey has quit IRC23:19
*** hongbin has quit IRC23:21
*** salv-orlando has joined #openstack-infra23:22
*** dhinesh has joined #openstack-infra23:26
*** jamesmca_ has joined #openstack-infra23:27
*** salv-orlando has quit IRC23:27
*** david-lyle has joined #openstack-infra23:31
*** yamahata has joined #openstack-infra23:32
*** jamesmca_ has quit IRC23:35
*** david-lyle has quit IRC23:36
*** sree has joined #openstack-infra23:50
*** sree has quit IRC23:55
*** leakypipes has quit IRC23:57
*** rfolco has joined #openstack-infra23:57
*** rfolco has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!