Sunday, 2016-07-31

*** rossella_s has joined #openstack-infra00:00
*** jsavak has joined #openstack-infra00:00
*** jsavak has quit IRC00:05
*** jsavak has joined #openstack-infra00:06
*** claudiub|2 has joined #openstack-infra00:08
*** thorst has joined #openstack-infra00:15
*** jcoufal has quit IRC00:19
*** thorst has quit IRC00:22
*** elo has quit IRC00:25
*** cgalan has quit IRC00:30
*** claudiub|2 has quit IRC00:30
*** rbuzatu has joined #openstack-infra00:30
*** kzaitsev_mb has joined #openstack-infra00:31
*** asettle has joined #openstack-infra00:33
*** rbuzatu has quit IRC00:36
*** kzaitsev_mb has quit IRC00:37
*** jcoufal has joined #openstack-infra00:37
*** asettle has quit IRC00:38
*** jsavak has quit IRC00:41
*** claudiub|2 has joined #openstack-infra00:47
*** baoli has joined #openstack-infra00:50
*** zz_dimtruck is now known as dimtruck00:52
*** jcoufal has quit IRC00:54
*** markvoelker has joined #openstack-infra00:54
*** amitgandhinz has joined #openstack-infra00:55
*** baoli has quit IRC00:55
*** yamamoto has joined #openstack-infra00:56
*** jcoufal has joined #openstack-infra00:57
*** markvoelker has quit IRC00:59
*** amitgandhinz has quit IRC00:59
*** karthik__ has quit IRC01:00
*** abregman has joined #openstack-infra01:06
*** yamamoto has quit IRC01:08
*** baoli has joined #openstack-infra01:09
*** gouthamr has joined #openstack-infra01:12
*** baoli has quit IRC01:13
openstackgerritHenry Gessau proposed openstack-infra/project-config: Move neutron coverage job to check queue  https://review.openstack.org/34397901:14
*** yamamoto has joined #openstack-infra01:14
*** yamamoto has quit IRC01:14
*** claudiub|2 has quit IRC01:18
*** thorst has joined #openstack-infra01:19
*** jcoufal has quit IRC01:23
*** thorst has quit IRC01:26
*** claudiub|2 has joined #openstack-infra01:30
*** tqtran has joined #openstack-infra01:32
*** kzaitsev_mb has joined #openstack-infra01:32
*** rbuzatu has joined #openstack-infra01:34
*** dimtruck is now known as zz_dimtruck01:34
*** tqtran has quit IRC01:36
*** jcoufal has joined #openstack-infra01:37
*** rbuzatu has quit IRC01:38
*** rbuzatu has joined #openstack-infra01:39
*** kzaitsev_mb has quit IRC01:39
*** asettle has joined #openstack-infra01:41
openstackgerritAaron Rosen proposed openstack-infra/project-config: Add new project vmware-nsxlib  https://review.openstack.org/34911801:45
*** asettle has quit IRC01:46
*** cfarquhar has quit IRC01:47
*** karthikp_ has joined #openstack-infra01:51
*** jcoufal has quit IRC01:53
*** karthikp_ has quit IRC01:53
*** karthikp_ has joined #openstack-infra01:54
*** markvoelker has joined #openstack-infra01:55
*** amitgandhinz has joined #openstack-infra01:56
*** karthikp_ has quit IRC01:57
*** jcoufal has joined #openstack-infra01:57
*** karthikp_ has joined #openstack-infra01:57
*** tonytan_brb has joined #openstack-infra01:58
*** markvoelker has quit IRC02:00
*** karthikp_ has quit IRC02:00
*** amitgandhinz has quit IRC02:00
*** tonytan4ever has quit IRC02:01
*** zz_dimtruck is now known as dimtruck02:01
*** achanda has joined #openstack-infra02:02
*** mkoderer__ has quit IRC02:03
*** mkoderer__ has joined #openstack-infra02:06
*** thorst has joined #openstack-infra02:06
*** thorst has quit IRC02:07
*** karthikp_ has joined #openstack-infra02:08
*** gongysh has joined #openstack-infra02:09
*** thorst has joined #openstack-infra02:12
*** gongysh has quit IRC02:14
*** yamamoto has joined #openstack-infra02:15
*** achanda has quit IRC02:16
*** thorst has quit IRC02:16
*** jcoufal has quit IRC02:18
*** gouthamr has quit IRC02:21
*** yamamoto has quit IRC02:21
*** claudiub|2 has quit IRC02:27
*** yamamoto has joined #openstack-infra02:29
*** yamahata has joined #openstack-infra02:30
*** zhurong has joined #openstack-infra02:30
*** yamamoto has quit IRC02:34
*** kzaitsev_mb has joined #openstack-infra02:36
*** jcoufal has joined #openstack-infra02:36
*** gongysh has joined #openstack-infra02:37
*** claudiub|2 has joined #openstack-infra02:39
*** kzaitsev_mb has quit IRC02:41
*** jcoufal has quit IRC02:53
*** markvoelker has joined #openstack-infra02:56
*** amitgandhinz has joined #openstack-infra02:56
*** jcoufal has joined #openstack-infra02:57
*** gongysh has quit IRC03:00
*** abregman has quit IRC03:00
*** itisha has quit IRC03:00
*** zhurong has quit IRC03:00
*** markvoelker has quit IRC03:00
*** amitgandhinz has quit IRC03:01
*** jcoufal has quit IRC03:03
*** pt_15 has quit IRC03:06
*** gouthamr has joined #openstack-infra03:08
*** davidlenwell has quit IRC03:12
*** zhurong has joined #openstack-infra03:13
*** thorst has joined #openstack-infra03:15
*** jcoufal has joined #openstack-infra03:17
*** rbuzatu_ has joined #openstack-infra03:18
*** jcoufal has quit IRC03:18
*** rbuzatu has quit IRC03:21
*** thorst has quit IRC03:21
*** davidlenwell has joined #openstack-infra03:23
*** tqtran has joined #openstack-infra03:33
*** EricGonczer_ has quit IRC03:34
*** yamamoto has joined #openstack-infra03:34
*** jcoufal has joined #openstack-infra03:37
*** kzaitsev_mb has joined #openstack-infra03:37
*** tqtran has quit IRC03:37
Shrewspabelanger: none of the network connections for that job are working. see the gear failures above that zk error03:37
Shrewspabelanger: bad node? dunno03:37
*** claudiub has joined #openstack-infra03:39
*** yamamoto has quit IRC03:41
*** kzaitsev_mb has quit IRC03:42
*** davidlenwell has quit IRC03:42
*** claudiub|2 has quit IRC03:43
openstackgerritsandro.gattuso proposed openstack-infra/jenkins-job-builder: Wrapper pre-scm-buildstep: added support for failOnError parameter  https://review.openstack.org/34921903:47
*** nwkarsten has joined #openstack-infra03:48
*** jcoufal has quit IRC03:50
*** davidlenwell has joined #openstack-infra03:52
*** zhurong has quit IRC03:54
*** PollyZ has joined #openstack-infra03:55
*** jcoufal has joined #openstack-infra03:56
*** markvoelker has joined #openstack-infra03:57
*** rfolco has joined #openstack-infra03:57
*** rfolco has quit IRC03:57
*** amitgandhinz has joined #openstack-infra03:57
*** rossella_s has quit IRC04:00
*** PollyZ has quit IRC04:00
*** rossella_s has joined #openstack-infra04:00
*** markvoelker has quit IRC04:01
*** amitgandhinz has quit IRC04:02
*** elo has joined #openstack-infra04:09
*** jcoufal has quit IRC04:19
*** thorst has joined #openstack-infra04:20
*** thorst has quit IRC04:26
*** karthikp_ has quit IRC04:34
*** jcoufal has joined #openstack-infra04:36
*** kzaitsev_mb has joined #openstack-infra04:38
*** kzaitsev_mb has quit IRC04:44
*** Jeffrey4l_ has quit IRC04:53
*** markvoelker has joined #openstack-infra04:57
*** amitgandhinz has joined #openstack-infra04:58
*** claudiub has quit IRC04:59
*** markvoelker has quit IRC05:01
*** amitgandhinz has quit IRC05:03
*** jcoufal has quit IRC05:04
*** jcoufal has joined #openstack-infra05:12
openstackgerritTakashi Kajinami proposed openstack-infra/elastic-recheck: Add query for storlets bug 1608171  https://review.openstack.org/34922605:15
openstackbug 1608171 in storlets "docker pull fails in gate testing" [Undecided,New] https://launchpad.net/bugs/160817105:15
openstackgerritTakashi Kajinami proposed openstack-infra/elastic-recheck: Add query for storlets bug 1608171  https://review.openstack.org/34922605:20
openstackbug 1608171 in storlets "docker pull fails in gate testing" [Undecided,New] https://launchpad.net/bugs/160817105:20
*** jcoufal has quit IRC05:21
*** thorst has joined #openstack-infra05:23
*** abregman has joined #openstack-infra05:27
*** psachin has joined #openstack-infra05:29
*** nmagnezi has joined #openstack-infra05:30
*** thorst has quit IRC05:31
*** jcoufal has joined #openstack-infra05:32
*** tqtran has joined #openstack-infra05:35
*** tqtran has quit IRC05:39
*** kzaitsev_mb has joined #openstack-infra05:39
*** kzaitsev_mb has quit IRC05:45
*** jcoufal has quit IRC05:50
*** jcoufal has joined #openstack-infra05:51
*** dimtruck is now known as zz_dimtruck05:56
*** rbuzatu_ has quit IRC05:56
*** markvoelker has joined #openstack-infra05:58
*** amitgandhinz has joined #openstack-infra05:59
*** markvoelker has quit IRC06:03
*** amitgandhinz has quit IRC06:03
*** oanson has joined #openstack-infra06:04
*** yamahata has quit IRC06:05
*** rbuzatu has joined #openstack-infra06:05
*** nwkarsten has quit IRC06:19
*** jcoufal has quit IRC06:21
*** thorst has joined #openstack-infra06:29
*** jcoufal has joined #openstack-infra06:31
*** thorst has quit IRC06:36
*** gouthamr has quit IRC06:36
*** achanda has joined #openstack-infra06:36
*** kzaitsev_mb has joined #openstack-infra06:41
*** kzaitsev_mb has quit IRC06:47
*** baoli has joined #openstack-infra06:49
*** baoli has quit IRC06:54
*** amitgandhinz has joined #openstack-infra07:00
*** rbuzatu has quit IRC07:00
*** amitgandhinz has quit IRC07:04
*** rbuzatu has joined #openstack-infra07:15
*** yamamoto has joined #openstack-infra07:15
*** admcleod has joined #openstack-infra07:17
*** admcleod_ has quit IRC07:18
*** sshnaidm has joined #openstack-infra07:20
*** yamamoto has quit IRC07:20
*** jcoufal has quit IRC07:26
*** jcoufal has joined #openstack-infra07:31
*** thorst has joined #openstack-infra07:33
*** kzaitsev_mb has joined #openstack-infra07:33
*** tkelsey has joined #openstack-infra07:33
*** tqtran has joined #openstack-infra07:36
*** tkelsey has quit IRC07:38
*** ljjjustin has quit IRC07:38
*** tqtran has quit IRC07:40
*** thorst has quit IRC07:40
*** ljjjustin has joined #openstack-infra07:43
*** kzaitsev_mb has quit IRC07:51
*** sshnaidm has quit IRC07:55
*** achanda has quit IRC07:56
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove broken coverage jobs  https://review.openstack.org/34924207:56
*** rossella_s has quit IRC08:00
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-infra08:00
*** rossella_s has joined #openstack-infra08:00
*** amitgandhinz has joined #openstack-infra08:00
*** kzaitsev_mb has joined #openstack-infra08:01
*** amitgandhinz has quit IRC08:05
*** rbuzatu has quit IRC08:06
*** kzaitsev_mb has quit IRC08:06
*** achanda has joined #openstack-infra08:10
*** jcoufal_ has joined #openstack-infra08:11
*** jcoufal has quit IRC08:11
*** jianghuaw has quit IRC08:14
*** jianghuaw has joined #openstack-infra08:15
*** rbuzatu has joined #openstack-infra08:18
*** jcoufal_ has quit IRC08:23
*** siva_krish has joined #openstack-infra08:30
*** achanda has quit IRC08:32
*** lennyb has quit IRC08:37
*** thorst has joined #openstack-infra08:39
*** thorst has quit IRC08:46
openstackgerritsandro.gattuso proposed openstack-infra/jenkins-job-builder: Wrapper pre-scm-buildstep: added support for failOnError parameter  https://review.openstack.org/34921908:46
*** rbuzatu has quit IRC08:49
*** r-mibu has quit IRC08:51
*** siva_krish1 has joined #openstack-infra08:52
*** siva_krish has quit IRC08:54
*** r-mibu has joined #openstack-infra08:56
*** nwkarsten has joined #openstack-infra08:59
*** amitgandhinz has joined #openstack-infra09:01
*** nwkarsten has quit IRC09:04
*** ihrachys has joined #openstack-infra09:04
*** chlong has joined #openstack-infra09:05
*** amitgandhinz has quit IRC09:06
*** anthonyper has quit IRC09:16
*** ihrachys has quit IRC09:17
*** anthonyper has joined #openstack-infra09:17
*** ihrachys has joined #openstack-infra09:18
*** achanda has joined #openstack-infra09:33
*** sshnaidm has joined #openstack-infra09:35
*** tqtran has joined #openstack-infra09:38
*** achanda has quit IRC09:39
*** rbuzatu has joined #openstack-infra09:41
*** tqtran has quit IRC09:42
*** ihrachys has quit IRC09:42
*** thorst has joined #openstack-infra09:45
*** ihrachys has joined #openstack-infra09:49
*** thorst has quit IRC09:51
*** amitgandhinz has joined #openstack-infra10:02
*** ihrachys has quit IRC10:06
*** ihrachys has joined #openstack-infra10:06
*** amitgandhinz has quit IRC10:07
*** yamamoto has joined #openstack-infra10:08
*** yamamoto has quit IRC10:08
*** yamamoto has joined #openstack-infra10:10
*** yamamoto has quit IRC10:15
*** ihrachys has quit IRC10:31
*** ihrachys has joined #openstack-infra10:33
*** achanda has joined #openstack-infra10:37
*** achanda has quit IRC10:42
*** thorst has joined #openstack-infra10:48
*** lennyb has joined #openstack-infra10:50
*** yamamoto has joined #openstack-infra10:55
*** yamamoto has quit IRC10:55
*** thorst has quit IRC10:56
*** yamamoto has joined #openstack-infra10:56
*** oanson has quit IRC10:59
*** nwkarsten has joined #openstack-infra11:01
*** zhurong has joined #openstack-infra11:01
*** amitgandhinz has joined #openstack-infra11:03
*** ihrachys_ has joined #openstack-infra11:04
*** nwkarsten has quit IRC11:06
*** ihrachys has quit IRC11:06
*** amitgandhinz has quit IRC11:07
*** zhurong has quit IRC11:12
*** zhurong has joined #openstack-infra11:13
*** ihrachys_ has quit IRC11:19
*** Cormite has joined #openstack-infra11:19
*** Cormite has quit IRC11:21
*** Cormite has joined #openstack-infra11:27
*** ihrachys has joined #openstack-infra11:28
*** sdake has joined #openstack-infra11:30
*** Cormite has quit IRC11:33
*** Cormite has joined #openstack-infra11:39
*** tqtran has joined #openstack-infra11:39
*** e0ne has joined #openstack-infra11:42
*** tqtran has quit IRC11:43
*** e0ne has quit IRC11:43
*** ihrachys has quit IRC11:51
*** thorst has joined #openstack-infra11:51
*** thorst has quit IRC11:52
*** ihrachys has joined #openstack-infra11:53
*** Cormite has quit IRC11:57
*** Cormite has joined #openstack-infra11:57
*** hwcomcn has joined #openstack-infra11:59
*** Cormite_ has joined #openstack-infra12:03
*** amitgandhinz has joined #openstack-infra12:03
*** hwcomcn has quit IRC12:04
*** hwcomcn has joined #openstack-infra12:05
*** tonytan_brb has quit IRC12:06
*** Cormite_ has quit IRC12:07
*** Cormite has quit IRC12:07
*** Cormite has joined #openstack-infra12:07
*** amitgandhinz has quit IRC12:08
*** ihrachys has quit IRC12:09
*** nwkarsten has joined #openstack-infra12:19
*** ihrachys has joined #openstack-infra12:21
*** nwkarsten has quit IRC12:24
*** zhurong has quit IRC12:31
*** ihrachys has quit IRC12:35
*** ihrachys has joined #openstack-infra12:39
*** achanda has joined #openstack-infra12:39
*** achanda has quit IRC12:46
openstackgerritSagi Shnaidman proposed openstack-infra/devstack-gate: Use ntp wait time as 10 min instead of 100  https://review.openstack.org/34926112:47
openstackgerritSagi Shnaidman proposed openstack-infra/devstack-gate: Use ntp wait time as 10 min instead of 100  https://review.openstack.org/34926112:49
sshnaidmis anybody from cores here?12:49
sdakesshnaidm might wait a couple more hours12:57
sdakeits 6am on the west coast of the us atm12:57
sdakeand also sunday :)12:57
sshnaidmsdake, maybe somebody from emea just in case :)12:57
sdakeya i think AJaeger is in emea12:57
sdakebut again, sunday :)12:57
*** thorst has joined #openstack-infra12:58
sdakei am not a core but have a fairly deep understanding of infra things - want to post your question - perhaps i can help12:58
sshnaidmsdake, actually I need a review+merge for small bugfix:  https://review.openstack.org/34926113:01
sshnaidmit blocks all tripleo jobs for now13:01
sdakethought so - yup can't help with that13:01
sshnaidmsdake, thanks anyway13:02
sdakei might recommend posting to openstack-infra and requesting an emergency merge of your patch since the tripleo jobs are blocking merging of work13:03
sdake(the mailing list)13:03
sshnaidmsdake, right, thanks13:04
*** amitgandhinz has joined #openstack-infra13:04
*** thorst has quit IRC13:06
*** tonytan4ever has joined #openstack-infra13:07
*** amitgandhinz has quit IRC13:09
*** tonytan4ever has quit IRC13:12
*** EricGonczer_ has joined #openstack-infra13:17
*** ihrachys has quit IRC13:18
*** dchen has quit IRC13:22
*** zhurong has joined #openstack-infra13:25
*** ihrachys has joined #openstack-infra13:27
*** tqtran has joined #openstack-infra13:41
jpmaxmanfungi: can you check your script is still clearing the spam. The foundation got a notice from Google. I should be able to pick back up on the wiki first thing in the morning.13:41
*** netsin has quit IRC13:43
fungijpmaxman: it's manual because i have to feed it the accounts to block and clean up after. i've been cleaning it up a few times a day13:44
fungithough i may have skipped yesterday13:44
jpmaxmanOk do we want to just block new user creation?13:44
fungithe lack of interest from anyone else in staying on top of and policing this reinforces my opinion we should get rid of the wiki. we only get a few spammers a day and we have at least a dozen volunteer wiki admins if not more13:45
*** tqtran has quit IRC13:45
fungibut i'm fine continuing to just clean them up myself for now while we figure out if people really want to help maintain it or just want to benefit from it13:46
fungiwe had 8 new spammer accounts, i'm mass deleting their work now13:48
fungijpmaxman: was the complaing about a page that had already been deleted, or about one that had just appeared in the past 24 hours?13:48
fungier, complaint13:48
fungithere we go, 70 pages cleaned up in the mass delete13:49
jpmaxmanJust forwarded to your email13:49
sdakesshnaidm fungi can likely help your situation with tripleo13:49
jpmaxmanThank you :)13:50
sshnaidmfungi, hi13:50
sdakemorning fungi :)13:50
fungii'm still of the opinion that if the main concern the foundation has is that spam appearing on the wiki devalues the www site's google-juice, then you'd be fine with us adding a robots.txt to tell search engines not to index the site as a compromise13:50
fungisdake: sshnaidm: i was just looking at it. did you read the manpage for it?13:50
sshnaidmfungi, yep13:50
sshnaidmfungi, it's 3 options there :)13:51
sdakefungi i dont know anything aboutthe problem - just pointing people in the right direction13:51
fungisshnaidm: on my system it says that's already the default. did it change between versions?13:51
sshnaidmfungi, what's the default?13:51
fungisshnaidm: _that's_ why i asked if you read the manpage13:51
sshnaidmfungi, and I answered yes :)13:51
sshnaidmfungi, what's the default on your system?13:52
fungi"-n number, --tries=number: Number  of  times  to  check ntpd.  This option takes an integer number as its argument.  The default number for this option is: 100"13:52
sshnaidmfungi, 1000 : http://linux.die.net/man/8/ntp-wait13:52
fungiyour copy of the manpage doesn't say that?13:52
fungii'll double-check across all our distros13:52
sshnaidmfungi, no, on centos it's 1000: CentOS Linux release 7.2.1511 (Core)13:52
fungiit's possible the one i checked alters the -n default or something13:52
fungii was looking at debian/ubuntu examples13:53
sshnaidmfungi, tripleo jobs are on centos13:53
fungii wasn't aware we had devstack-gate working on centos. fun stuff13:53
jpmaxmanfungi: I think the overarching solution is simply to fix the spam problem. But you are right we could do a robots file. I think generally everyone wants a functional wiki13:53
sdakefungi yup kolla uses centos jobs too13:53
sshnaidmfungi, it's for a few months, we used fedora before this13:54
*** bhavik has joined #openstack-infra13:54
sdakefungi fwiw i am superhappy centos has been in the gat eimages for over a year - really made our lives easier in kolla13:55
sdakealthough it probably creates inconsistencies like the above13:55
sshnaidmfungi, actually I didn't understand this commit to infra, why stopping ntp service was removed? If it runs (and this runs usually), it occupies the socket and no any ntp commands will succeed to run ntp, so it will never succeed to sync it13:55
fungijpmaxman: agreed, just wondering if that would be a better short-term compromise to satisfy google while we get the spamming reduced further. still, without people _actively_ policing for spam that slips through, if google's going to complain within 24 hours of spam appearing on the site we probably just can't let search engines index it any longer13:55
sshnaidmfungi, but maybe I miss something..13:56
sdakecould add a better captcha13:56
jpmaxmanI would just disable the new user creation until the upgrade is complete13:56
fungisdake: yeah, i was more just surprised we had devstack-gate working on centos. there was quite a while where devstack didn't really work well on it13:56
sdakei dont know if there are any free ones that can't be gamed13:56
*** pt_15 has joined #openstack-infra13:57
sdakefungi ya not ure about devtack itself - we dont use devstack13:57
jpmaxmansdake: that's what we are working on but requires a media wiki upgrade13:57
sdakebut i assume it works since nobody complains :)13:57
fungijpmaxman: even after the upgrade is complete, the spam volume won't be zero, so we'd need some way to prevent google from getting up in arms when spam pages appear on it before anyone has a chance to delete them13:57
*** baoli has joined #openstack-infra13:57
sdakejpmaxman roger just spitballing and bored :)13:57
*** yamamoto has quit IRC13:58
sdakei guess i'll go do something productive and try my hand at adding mirrors :)13:58
sdakebbl13:58
jpmaxmanfungi: the goal is zero :) at least from automated vectors13:59
*** itisha has joined #openstack-infra13:59
jpmaxmanBut yes the robots file is not a bad idea13:59
fungiyep, there are non-automated vectors13:59
jpmaxmanEspecially in the short term13:59
jpmaxmanIt would also devalue the target14:00
jpmaxmanLet me run it by jamesmcarthur14:00
fungiright, our spam problem with paste.openstack.org evaporated within days of making it no longer indexed by major search engines14:00
openstackgerritChristian Fetzer proposed openstack-infra/jenkins-job-builder: Update Gitlab to >=1.3.0  https://review.openstack.org/33311314:00
sshnaidmfungi, maybe the better solution is just reverting this patch? what do you think? https://github.com/openstack-infra/devstack-gate/commit/53170ea72a3e86a02a750d90e983be55400d61e214:01
fungijpmaxman: i'm trying to follow the wiki link google complained about for that pdf, but am getting a 40414:01
jpmaxmanThen it may be gone14:03
jpmaxmanThere reporting may be way delayed too14:03
fungijpmaxman: and given that we stopped allowing any image uploads weeks ago...14:03
fungijpmaxman: and given that we stopped allowing pdf uploads and then i deleted all the uploaded pdf spam months ago...14:03
fungii would venture to guess this is _very_delated14:03
fungier, delayed14:03
fungii'll try to see if i have a record of when i deleted that file14:04
*** ihrachys has quit IRC14:04
*** amitgandhinz has joined #openstack-infra14:05
*** thorst has joined #openstack-infra14:07
jpmaxmanOk cool14:07
fungiyeah, pabelanger and pleia2 disabled pdf uploads back in january, but left a lot of the uploaded spam behind until i deleted it all on june 814:09
fungijpmaxman: so that file's been gone for ~7 weeks14:09
*** amitgandhinz has quit IRC14:09
*** thorst has quit IRC14:12
*** ihrachys has joined #openstack-infra14:12
jpmaxmanOk good to know14:13
jpmaxmanSo even when it is 100% fixed...14:14
jpmaxmanRobots file is looking even better14:14
*** jcoufal has joined #openstack-infra14:15
*** ihrachys_ has joined #openstack-infra14:20
*** sdake has quit IRC14:23
*** baoli has quit IRC14:23
*** ihrachys has quit IRC14:23
*** sdake has joined #openstack-infra14:24
*** jcoufal has quit IRC14:27
*** ihrachys_ has quit IRC14:38
*** ihrachys has joined #openstack-infra14:41
*** nwkarsten has joined #openstack-infra14:42
pabelangerfungi: sshnaidm: tripleo is using devstack inplace of zuul-cloner.  Its been on my list since Austin to fix that.14:42
pabelangerfungi: sshnaidm: maybe I'll start on that this week14:42
pabelangerfungi: I also agree with you on the wiki14:43
*** bhavik has quit IRC14:43
*** achanda has joined #openstack-infra14:43
sshnaidmpabelanger, meanwhile we have a problem with ntp-wait on centos:  https://review.openstack.org/349261  could you please review the bugfix in your time?14:43
*** thorst has joined #openstack-infra14:44
clarkbthe assertion in that is not true btw. date is important for them. Both for generated log timestamps and for timeout accounting. Are you blocking nto or otherwise doing something that will prevent it from converging?14:45
pabelangerhttp://logs.openstack.org/77/299677/1/check/gate-tempest-dsvm-platform-centos7-nv/a0b6a43/console.html.gz#_2016-07-22_20_30_00_72880714:45
fungisshnaidm: just finished researching, it looks like the default for that option was dropped from 1000 to 100 in 2013 (commit 5d565b7) but the manpage wasn't updated for a long time after that14:45
pabelangerthat's why devstack-gate job didn't catch it14:45
pabelangerwe should likely fix that in centos-7 dibs14:45
pabelangeror bindepo14:45
sshnaidmfungi, https://paste.fedoraproject.org/398808/76432146/14:47
fungisshnaidm: might want to double-check that the source in use on centos doesn't have my $opts['tries'] defaulted to '100' under processOptions in scripts/ntp-wait/ntp-wait-opts14:47
sshnaidmfungi, $opt_n = 1000;                  # How many tries before we give up? (10 min+)14:47
fungisshnaidm: yep, looks like an older version of the script then14:47
sshnaidmfungi, seems like a typo "(10 min+)"14:48
*** achanda has quit IRC14:48
pabelangerclarkb: suggestions on hold to install ntp-wait?  Add yum install to devstack-gate?14:48
fungisshnaidm: yeah, i think the intent must have been 10 minutes going way back but it wasn't corrected until circa 201314:48
*** hwcomcn has quit IRC14:49
clarkbpabelanger: for f24? Ya I think just ad aninstall though ianw made a pull request to puppet-ntp as a first step I think14:50
sshnaidmfungi, can you paste your version of ntp-wait? I want to try it on centos14:50
pabelangerclarkb: let me find that14:50
*** thorst has quit IRC14:51
fungisshnaidm: i was browsing the commit history starting from the tip of master on https://github.com/ntp-project/ntp14:51
fungiunfortunately they don't use tags so it's going to take me a bit to match up a particular commit with the base version used on ubuntu 16.04 lts14:52
pabelangerclarkb: https://review.openstack.org/#/c/348601/14:52
pabelangerclarkb: let me check image builds14:52
pabelangeryup, okay, make sense why tripleo is affected now14:53
pabelanger Notice: /Stage[main]/Openstack_project::Template/Package[ntp-perl]/ensure: created14:53
pabelangersshnaidm: Have you figured out why ntp is failing to sync?14:55
pabelangerhttp://logs.openstack.org/56/333556/35/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/2261346/console.html#_2016-07-31_10_06_40_14737814:56
fungisshnaidm: comparing, ubuntu-xenial has a base ntp of 4.2.8, while fedora-24 and centos-7 are base from 4.2.614:56
sshnaidmpabelanger, no, not yet.. ntpq fails to connect to servers, it finishes with leap_alarm, although the time is correct14:57
pabelangersshnaidm: okay, going to hold a node and start debugging it14:57
fungisshnaidm: what servers is it configured to use? are there firewalls between the job nodes and the ntp servers?14:57
sshnaidmfungi, and do you have this script source in ubuntu machine?14:57
pabelangerfungi: should be our defaults, it is centos-7 dib now14:57
sshnaidmit uses usual 0/1/2 .centos.pool.ntp.org14:58
fungisshnaidm: it's a collection of files that make up ntp-wait, not just the script but also the option defaults file and probably more14:58
*** zhurong has quit IRC14:58
*** yamamoto has joined #openstack-infra14:59
sshnaidmfungi, hmm.. in centos I have a single perl script in /usr/sbin/ntp-wait14:59
*** yaume has joined #openstack-infra14:59
fungisshnaidm: yeah, digging deeper, the option defaults are still baked into the script, just assembled from multiple parts at build time15:00
openstackgerritChristian Fetzer proposed openstack-infra/jenkins-job-builder: gitlab trigger: Update Gitlab to >=1.3.0  https://review.openstack.org/33311315:00
fungisshnaidm: http://paste.openstack.org/show/54470615:00
sshnaidmfungi, thanks!15:00
fungithe processOptions subroutine defines my $opts['tries'] => '100' in that version15:01
fungiwhich matches the current upstream master branch15:01
pabelangeroh neat, ubuntu and centos nodes using different ntp servers.  We should fix that15:01
fungipabelanger: well, they're using whatever servers are the default for their platform15:02
pabelangerfungi: right, but we manage the file in puppet-ntp15:02
fungipabelanger: we _could_ run a tier 3 ntpd on each of our mirror servers and point the job nodes at those for better network happymaking15:02
pabelangerwe _could_ make them us the same server pool15:02
pabelangerfungi: Oh, that might be a idea15:03
fungipabelanger: *.pool.ntp.org go to the same "pool" of servers regardless15:03
fungithe platform-specific subdomain names are simply used for collecting usage statistics15:03
pabelangerokay, good15:04
pabelangerTIL15:04
*** yamamoto has quit IRC15:05
*** amitgandhinz has joined #openstack-infra15:06
fungisshnaidm: as far as why we switched to ntp-wait, as the commit message explains ntpdate is deprecated in favor of ntp-wait. however based on this research into defaults i don't object to making the script we're calling specify a number of tries to make it perform consistently across platforms and i agree setting it to the current upstream default value (100) makes sense there15:06
sshnaidmfungi, thanks15:07
*** tonytan4ever has joined #openstack-infra15:08
*** amitgandhinz has quit IRC15:10
*** EricGonczer_ has quit IRC15:11
*** tonytan4ever has quit IRC15:12
*** hongbin has joined #openstack-infra15:15
*** yaume has quit IRC15:17
*** sdake has quit IRC15:20
*** ihrachys has quit IRC15:20
fungisshnaidm: after some familiarizing with their release process, it appears that commit was merged and included in the 4.2.7p400 release15:21
sshnaidmfungi, on centos it's ntp-perl-4.2.6p5-22.el7.centos.2.noarch15:21
fungisshnaidm: yep, just pointing out that it explains why we see it on ubuntu-xenial nodes and why i saw it on my system (debian sid) with ntp 4.2.8 but not on our platforms using 4.2.615:22
*** kgiusti has left #openstack-infra15:22
sshnaidmfungi, yeah, right15:22
fungiit looks like they do the 4.2.<even> trees as stable release series and 4.2.<odd> as development series, which is why the "p" numbers on 4.2.6 and 4.2.8 are so low relative to 4.2.715:24
*** sdake has joined #openstack-infra15:25
*** siva_krish1 has quit IRC15:27
*** ihrachys has joined #openstack-infra15:30
pabelangerall these years using ntp, still don't understand how to troubleshoot it15:30
*** ihrachys has quit IRC15:31
*** netsin has joined #openstack-infra15:31
*** sshnaidm has quit IRC15:35
*** ihrachys has joined #openstack-infra15:40
*** bapalm has joined #openstack-infra15:42
*** tqtran has joined #openstack-infra15:42
*** achanda has joined #openstack-infra15:45
*** tqtran has quit IRC15:46
pabelangerWill have to look into it later15:47
pabelangercan't get ntpd to sync to time-b.nist.gov15:47
pabelangerbut ntpdate will15:47
*** bhavik has joined #openstack-infra15:48
*** thorst has joined #openstack-infra15:49
*** achanda has quit IRC15:49
*** ihrachys has quit IRC15:53
*** thorst has quit IRC15:56
*** ihrachys has joined #openstack-infra15:58
fungipabelanger: if ntpdate was using -u then it bound to an unprivileged port client-side15:58
*** furlongm has quit IRC15:59
fungipabelanger: ntpd needs packets allowed to 123/udp on the client side though15:59
*** furlongm has joined #openstack-infra16:00
*** rossella_s has quit IRC16:00
*** rossella_s has joined #openstack-infra16:00
pabelangerfungi: Right, however our default iptables rules don't allow that. Both inbound and outbound are lacking 123/udp16:00
pabelangerso, is that something the job should setup or should our manifests?16:01
fungipabelanger: but iptables is likely doing a decent job of "state" tracking on udp packets even if they're sourced from 123/udp. is it possible the tripleo cloud has some sort of packet filter upstream from iptables on our job nodes?16:02
pabelangerfungi: that is possible, I am not sure what the network looks like16:02
fungipabelanger: have you tried it from a node on another provider, not in the tripleo provider?16:03
pabelangerfungi: ya, that is what I am doing now16:03
fungiand it's broken everywhere?16:03
fungialso note that ntpq uses unprivileged ports too, so if ntpq is working to query timeservers but ntpd is still not syncing to them, then that could also point to packet filtering as an issue16:06
*** amitgandhinz has joined #openstack-infra16:06
pabelangerfungi: rax-iad works16:09
*** ihrachys_ has joined #openstack-infra16:09
pabelangerso, this is limited to tripleo-test-cloud-rh216:09
*** ihrachys has quit IRC16:09
pabelangerand I would agree a network issue16:10
fungiyep, chances are it's an overzealous firewall admin going "nobody should be running an ntp server on this network, let's block all outbound 123/udp packets" or something16:11
fungiall outbound packets sourced from 123/udp that is16:11
pabelangerfungi: likely possible16:11
*** amitgandhinz has quit IRC16:11
fungior it could be the firewall/nat is screwed up and not properly handling state for some udp responses16:12
openstackgerritSteven Dake proposed openstack-infra/system-config: Add Debian Percona mirror  https://review.openstack.org/34927816:12
*** psachin has quit IRC16:12
fungiregardless, need to get a network admin at that end to dig in filters/logs16:12
pabelangerfungi: agreed, thanks for the help16:12
*** sdake_ has joined #openstack-infra16:14
*** ihrachys_ has quit IRC16:17
fungihuh, so far we've got 22% voter turnout for the mascot poll with ~32 hours remaining16:17
fungithat's surprisingly high16:18
*** sdake has quit IRC16:18
*** nwkarsten has quit IRC16:19
sdake_fungi i w ouldl have voted16:23
sdake_but no idea what peopel really care to want ;)16:23
sdake_but your right 22% is really high for a mascot voter turnout16:24
*** ihrachys has joined #openstack-infra16:33
openstackgerritHenry Gessau proposed openstack-infra/project-config: Add neutron coverage job to check and gate queues  https://review.openstack.org/34397916:33
*** baoli has joined #openstack-infra16:35
openstackgerritMerged openstack-infra/puppet-userstory_dashboard: Initial boilerplate files  https://review.openstack.org/34391216:39
*** baoli has quit IRC16:39
*** sshnaidm has joined #openstack-infra16:40
*** ihrachys has quit IRC16:41
openstackgerritMerged openstack-infra/project-config: Add initial err2d2 project config  https://review.openstack.org/34899816:43
*** rbuzatu has quit IRC16:47
*** ihrachys has joined #openstack-infra16:48
*** rbuzatu has joined #openstack-infra16:49
*** ihrachys_ has joined #openstack-infra16:50
*** ihrachys_ has quit IRC16:53
*** karthikp_ has joined #openstack-infra16:53
*** nwkarsten has joined #openstack-infra16:54
*** thorst has joined #openstack-infra16:55
*** ihrachys has quit IRC16:55
*** gouthamr has joined #openstack-infra16:58
fungiharlowja: ^ i'll get group membership set up for that when the import completes (hopefully any minute now)16:58
*** sdake_ has quit IRC16:59
*** thorst has quit IRC17:01
*** openstackgerrit has quit IRC17:03
*** openstackgerrit has joined #openstack-infra17:03
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Switch twine to upload.pypi.org  https://review.openstack.org/34928217:03
fungidstufft: ^17:03
greghayneswow that name is amazing17:04
greghayneserr2d217:04
fungigreghaynes: yes. yes it is17:04
dstufftfungi: looks good to me17:04
fungidstufft: mainly making sure the /legacy endpoint is expected to work under the new domain17:05
fungidstufft: thanks!17:05
dstufftfungi: yea, it's the excat same code and everything, I just added a different domain17:05
fungiperfect17:05
dstufftI wish dude had agreed to our $500 offer 6 months ago before I told everyone to use the .io, but what can you do17:05
fungidomain squatters. meh17:06
*** nwkarsten has quit IRC17:06
dstufftyea17:07
dstufftoh well, pypi.org is a bit nicer than pypi.io so at least it ends happily17:07
fungiharlowja: you're now a core reviewer on the new repo in gerrit17:07
*** amitgandhinz has joined #openstack-infra17:07
* fungi returns to sunday housework17:07
*** tonytan4ever has joined #openstack-infra17:09
*** tonytan4ever has quit IRC17:09
*** hogepodge has quit IRC17:10
*** sdake has joined #openstack-infra17:10
*** amitgandhinz has quit IRC17:12
openstackgerritTakashi Kajinami proposed openstack-infra/elastic-recheck: Add query for storlets bug 1608171  https://review.openstack.org/34922617:13
openstackbug 1608171 in storlets "docker pull fails in gate testing" [Undecided,New] https://launchpad.net/bugs/160817117:13
*** tonytan4ever has joined #openstack-infra17:15
*** karthikp_ has quit IRC17:15
*** rbuzatu has quit IRC17:18
*** thorst has joined #openstack-infra17:20
*** thorst_ has joined #openstack-infra17:24
*** thorst_ has quit IRC17:26
*** rbuzatu has joined #openstack-infra17:26
*** thorst has quit IRC17:27
*** thorst has joined #openstack-infra17:27
*** nwkarsten has joined #openstack-infra17:31
*** thorst has quit IRC17:35
*** flepied has joined #openstack-infra17:41
mriedemmordred: is it possible to get mox3 docs hosted on docs.o.o?17:43
mriedemsince the original google docs appear to have been dropped17:43
*** hongbin has quit IRC17:44
*** achanda has joined #openstack-infra17:44
*** nwkarsten has quit IRC17:46
*** nwkarsten has joined #openstack-infra17:46
*** nwkarsten has quit IRC17:50
*** nmagnezi has quit IRC17:56
fungii take it mox3 hasn't died an honorable death yet?17:56
*** amitgandhinz has joined #openstack-infra18:08
*** amitgandhinz has quit IRC18:13
*** asettle has joined #openstack-infra18:21
*** asettle has quit IRC18:22
*** achanda has quit IRC18:25
*** thorst has joined #openstack-infra18:33
*** thorst has quit IRC18:36
*** thorst has joined #openstack-infra18:38
*** Volundr has joined #openstack-infra18:43
*** EricGonczer_ has joined #openstack-infra18:43
*** whoops has quit IRC18:43
AJaegermriedem: we only host docs for official Big Tent projects on docs.o.o18:45
*** kzaitsev_mb has joined #openstack-infra18:46
*** Volundr has quit IRC18:56
*** achanda has joined #openstack-infra18:56
*** e0ne has joined #openstack-infra19:00
*** fifieldt has quit IRC19:07
*** markvoelker has joined #openstack-infra19:08
*** amitgandhinz has joined #openstack-infra19:09
*** e0ne has quit IRC19:10
*** markvoelker has quit IRC19:12
*** amitgandhinz has quit IRC19:13
fungigood point, the source was only (somewhat recently) moved to gerrit so people could get some patches into it more easily19:14
*** rbuzatu has quit IRC19:14
*** e0ne has joined #openstack-infra19:15
fungii think it wasn't intended to stick around this long as it was just a quick and dirty mox fork19:15
*** e0ne has quit IRC19:17
*** fifieldt has joined #openstack-infra19:18
*** sdake has quit IRC19:19
*** kzaitsev_mb has quit IRC19:20
*** e0ne has joined #openstack-infra19:21
*** abregman has quit IRC19:22
*** e0ne has quit IRC19:22
*** bhavik has quit IRC19:23
*** kzaitsev_mb has joined #openstack-infra19:34
*** kzaitsev_mb has quit IRC19:42
*** kzaitsev_mb has joined #openstack-infra19:44
*** zz_dimtruck is now known as dimtruck19:46
*** gouthamr_ has joined #openstack-infra19:48
*** gouthamr has quit IRC19:51
openstackgerritMerged openstack-infra/devstack-gate: Use ntp wait time as 10 min instead of 100  https://review.openstack.org/34926119:55
*** sshnaidm is now known as sshnaidm|afk19:55
*** matrohon has joined #openstack-infra20:00
*** amitgandhinz has joined #openstack-infra20:10
*** thorst has quit IRC20:10
*** thorst has joined #openstack-infra20:11
*** amitgandhinz has quit IRC20:14
*** rbuzatu has joined #openstack-infra20:15
*** rbuzatu has quit IRC20:19
*** thorst has quit IRC20:19
*** bhunter71 has joined #openstack-infra20:22
*** hogepodge has joined #openstack-infra20:23
*** tonytan4ever has quit IRC20:31
*** e0ne has joined #openstack-infra20:36
*** e0ne has quit IRC20:37
*** tonytan4ever has joined #openstack-infra20:40
*** fifieldt has quit IRC20:42
*** e0ne has joined #openstack-infra20:42
*** PollyZ has joined #openstack-infra20:43
*** rbuzatu has joined #openstack-infra20:43
*** e0ne has quit IRC20:43
*** tqtran has joined #openstack-infra20:44
*** tqtran has quit IRC20:49
*** PollyZ has quit IRC20:52
*** sdake has joined #openstack-infra20:52
*** fifieldt has joined #openstack-infra20:53
*** rbuzatu has quit IRC21:06
*** rbuzatu has joined #openstack-infra21:07
*** markvoelker has joined #openstack-infra21:10
*** amitgandhinz has joined #openstack-infra21:10
*** sdake_ has joined #openstack-infra21:13
*** markvoelker has quit IRC21:14
*** amitgandhinz has quit IRC21:15
*** sdake has quit IRC21:16
*** elo has quit IRC21:17
*** thorst has joined #openstack-infra21:17
*** e0ne has joined #openstack-infra21:18
*** e0ne has quit IRC21:22
*** elo has joined #openstack-infra21:22
mriedemthere is a bunch of mox in a bunch of projects still21:22
*** thorst has quit IRC21:25
*** e0ne has joined #openstack-infra21:26
*** e0ne has quit IRC21:28
*** e0ne has joined #openstack-infra21:32
*** e0ne has quit IRC21:35
*** gouthamr_ is now known as gouthamr21:36
*** thorst has joined #openstack-infra21:37
*** e0ne has joined #openstack-infra21:40
*** e0ne has quit IRC21:41
*** rbuzatu has quit IRC21:41
*** matrohon has quit IRC21:41
*** kzaitsev_mb has quit IRC21:49
*** e0ne has joined #openstack-infra21:55
*** e0ne has quit IRC21:59
*** asettle has joined #openstack-infra22:01
*** asettle has quit IRC22:06
*** markvoelker has joined #openstack-infra22:10
*** amitgandhinz has joined #openstack-infra22:11
*** markvoelker has quit IRC22:15
*** amitgandhinz has quit IRC22:16
*** Cormite has quit IRC22:18
*** rbuzatu has joined #openstack-infra22:19
craigeo/22:23
*** rbuzatu has quit IRC22:23
*** camunoz has joined #openstack-infra22:31
*** yamamoto has joined #openstack-infra22:38
*** esberglu has joined #openstack-infra22:43
*** kzaitsev_mb has joined #openstack-infra22:45
*** esberglu has quit IRC22:46
fungimriedem: yeah, but i thought the plan was to replace use of mox in projects with mock rather than mox3 at this point22:49
mriedemfungi: it is,22:49
mriedemit just takes forever22:49
*** kzaitsev_mb has quit IRC22:49
fungii hear that22:49
fungijust, i'd personally push back on new patches introducing mox3 as a shortcut to py3k support22:50
fungisince it's one more thing that'd need to be undone22:50
fungibut i get that we still need mox3 maintained while we transition off whatever's already using it22:50
fungisetting up rtfd to publish the docs for it would probably be a reasonable approach22:51
*** sdake_ has quit IRC22:55
jheskethMorning23:07
*** markvoelker has joined #openstack-infra23:11
*** amitgandhinz has joined #openstack-infra23:12
*** kzaitsev_mb has joined #openstack-infra23:15
*** tonytan4ever has quit IRC23:16
*** markvoelker has quit IRC23:16
*** amitgandhinz has quit IRC23:17
*** itisha has quit IRC23:20
*** rbuzatu has joined #openstack-infra23:20
*** rbuzatu has quit IRC23:25
*** pt_15 has quit IRC23:26
*** kzaitsev_mb has quit IRC23:26
openstackgerritCraige McWhirter proposed openstack-infra/puppet-phabricator: Patches Required to Deliver Pholio  https://review.openstack.org/34248123:32
*** chlong has quit IRC23:34
ianwpabelanger / clarkb: dropped a comment in https://bugs.launchpad.net/tripleo/+bug/1608226 ... i have a bug open on ntp-wait trying to get some info on why it hangs; i noticed it works after a restart of ntpd daemon, not sure if tripleo tried that.  it might have to do with it's network detection stuff23:38
openstackLaunchpad bug 1608226 in tripleo "Ci: new ntp-wait command in devstack-gate hangs for 100 minutes which breaks jobs" [Critical,New] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)23:38
ianwsshnaidm: ^23:39
HenryGianw: Would you mind spending a couple of seconds looking at https://review.openstack.org/337698 ?23:40
ianwHenryG: seems fine ... no expert on it though :)23:42
HenryGianw: Much appreciated, it's just a dashboard.23:43
HenryGpleia2: if you are around, please take a look at https://review.openstack.org/33769823:43
*** thorst has quit IRC23:44
*** thorst has joined #openstack-infra23:45
ianwHenryG: iirc correctly she is traveling, let's just go with it23:47
*** thorst has quit IRC23:50
pabelangeropenstack: restart has no affect. I still believe there is an upstream network issue23:50
openstackgerritMerged openstack-infra/reviewday: Add neutron-lib project to neutron review dashboard  https://review.openstack.org/33769823:50
pabelangerianw: ^23:50
*** thorst has joined #openstack-infra23:50
*** thorst has quit IRC23:50
*** pahuang has joined #openstack-infra23:50
ianwpabelanger: could very well be the case :(  just something i saw23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!