Thursday, 2015-08-20

*** FallenPegasus has joined #openstack-infra00:00
*** unicell has quit IRC00:02
*** unicell has joined #openstack-infra00:02
*** bnemec has joined #openstack-infra00:03
*** sharikap_ has quit IRC00:03
clarkbfungi: should I write that change really quickly or are you doing it?00:04
clarkbI think I have just wrapped up paperwork00:04
*** geoffarn_ has quit IRC00:04
*** geoffarnold has joined #openstack-infra00:06
fungiclarkb: not urgent. i've not really had great luck testing proposed changes to modules outside of openstack_project using a dev env. still haven't figured out why but i'll give it another shot00:06
*** zz_dimtruck is now known as dimtruck00:06
clarkbfungi: you can use mine if you like just to get new view on it00:06
clarkbfungi: but what you do is put the etherpad module in /etc/puppet/environments/clarkb/modules/etherpad (path is something like that) then update system-config in /opt/puppet/environment/clarkb (again whatever that path is)00:07
fungithat's what i've done with mine in the past. will give it another shot00:08
openstackgerritSean M. Collins proposed openstack-infra/irc-meetings: FwaaS meeting: Add an APAC friendly time alternate
*** geoffarnold has quit IRC00:10
*** bnemec has quit IRC00:10
*** achanda has quit IRC00:11
*** flepied has joined #openstack-infra00:18
fungilooks like 214795 merged while i was at dinner, but puppet agent --test --noop isn't reflecting it yet00:19
fungiclarkb: ^ guesses?00:19
fungiare we failing to update the openstack_project module, or am i just testing incorrectly?00:20
*** armax has quit IRC00:20
*** ybathia has quit IRC00:20
openstackgerritSahdev Zala proposed openstack-infra/project-config: Add new repository for stand-alone TOSCA Parser
fungier, i guess it's the project_config module00:21
*** unicell has left #openstack-infra00:21
docaedoAnyone here know who would be the best person for me to chat at about the ask.openstack backend?00:21
fungilast update to /etc/puppet/modules/project_config on our puppetmaster seems to be a week old00:22
*** armax has joined #openstack-infra00:22
fungithat can't be right00:22
*** unicell has joined #openstack-infra00:22
fungidocaedo: what part of the backend?00:22
fungidocaedo: if memory serves, it's postgres and redis00:22
fungidocaedo: or do you mean the software which implements the service?00:23
docaedofungi: am thinking about it for app catalog - it basically already has much of what we want in the future, and I'm wondering if there's value to trying to re-purpose those bits rather than start over00:23
*** minwang2 has quit IRC00:23
fungidocaedo: no idea, the q&a forum software is called "askbot"00:24
*** armax has quit IRC00:24
docaedofungi: specifically stuff like voting and feedback - think of each question as an asset in the app catalog (so not perfect analog, but not far off)00:24
clarkbfungi noop wont pull project co fig updates00:24
docaedofungi: I saw that, it seems to be something you have to pay for, but maybe OpenStack gets to use it for free because OpenStack is awesome?00:24
clarkbfungi its th big gap woth noop and project config00:24
fungidocaedo: it's free software00:25
clarkbits open source you can host yourself00:25
*** eantyshev has quit IRC00:25
*** bnemec has joined #openstack-infra00:25
docaedoah thanks! ok I thought I'd seen something about buying/paying00:25
fungiclarkb: aha, okay i'll just give it a go for realz thn00:26
timrccrinkle, Doh, I introduced a bug :)00:26
docaedoyou folks have any off-the-cuff opinions of the idea? I'm trying hard not to re-invent the wheel for building up some app catalog stuff (and especially thinking about re-using things we already use elsewhere)00:26
openstackgerritTimothy R. Chavez proposed openstack-infra/puppet-cgit: Do not execute selinux commands if policy disabled
crinkletimrc: oh noes :(00:26
fungidocaedo: i really don't know how decomposable it is, but from what little i know of the source i expect it's fairly monolithic00:27
timrccrinkle, I s/enabled/enforcing/00:27
fungiclarkb: good call. actual non-noop run didn't revert our fix00:27
fungipuppet on zuul is back to enabled again00:28
*** asettle has quit IRC00:28
*** dannywil_ has quit IRC00:28
docaedofungi: thanks - I'll poke around a little bit, might end up just looking to use django to do something simple in the end00:28
*** salv-orl_ has quit IRC00:29
*** dims has joined #openstack-infra00:30
*** bnemec has quit IRC00:30
fungidocaedo: it might be a great example, but my gut says it won't be reusable without copying/forking00:31
clarkbits also a pita to deploy00:31
fungidocaedo: however mrmartin can give you a more informed evaluation when he's around (emea timezones)00:31
*** gyee has quit IRC00:33
docaedofungi: thanks00:33
docaedoclarkb: well .. that's not exciting to hear that it's a pita :) Expect me to chat at you about deploying stuff for app catalog before we head off in any specific direction00:34
clarkbI was the origibal attempt at deploying askbot way back when and I eventually came back and said no because it didnt work00:35
clarkbhad somethibg to do with internationalization support in django being busted00:35
*** pvaneck has quit IRC00:35
fungialso at the time we wanted it to support mysql (it basically still doesn't but we gave up on that point)00:37
*** hdd has quit IRC00:37
*** thorst has joined #openstack-infra00:38
*** spzala has quit IRC00:41
*** milligana1 has joined #openstack-infra00:41
*** pcrews has joined #openstack-infra00:41
*** milligana has quit IRC00:43
*** FallenPegasus has quit IRC00:43
*** bnemec has joined #openstack-infra00:44
*** mriedem has joined #openstack-infra00:45
fungiclarkb: new etherpad-dev attempt at 2001:4800:7819:104:be76:4eff:fe04:c137
*** sigmavirus24 is now known as sigmavirus24_awa00:46
fungii launched it with my dev env and the etherpad_lite module patched with your change plus a change to openstack_project to pass that parameter into the module00:46
*** wenlock has joined #openstack-infra00:46
fungibut dpkg -l doesn't show the package installed00:47
dstufftfungi: what's it use, postgresql?00:47
clarkbfungi: aptitude show ya that00:47
clarkbdstufft: yes and solr for search iirc00:47
*** tiswanso has joined #openstack-infra00:48
clarkbthe problem at the time was niether postgres nor mysql worked00:48
fungiclarkb: aha...00:48
*** achanda has joined #openstack-infra00:48
clarkbbecause django did some funny lazy loading of translations which was broken00:48
fungiError: Execution of '/usr/bin/git checkout --force system' returned 1: error: pathspec 'system' did not match any file(s) known to git.00:48
*** nadya has joined #openstack-infra00:48
clarkbfungi: my if is wrong then somehow00:48
clarkbwill look in a moment00:48
fungiclarkb: it may still not be finding my copy of the etherpad_lite module too00:49
*** tsekiyam_ has joined #openstack-infra00:49
fungii've got it cloned and patched at /etc/puppet/environments/fungi/modules/etherpad_lite on the puppetmaster00:50
clarkbfungi: under environments should be a file with a module path listing in it00:50
clarkbfungi: make sure that in that listing your path above comes before /etc/puppet/modules00:50
*** tiswanso has quit IRC00:50
fungiyep, /etc/puppet/environments/fungi/environment.conf says modulepath = /etc/puppet/environments/fungi/modules:/opt/system-config/fungi/modules:modules:$basemodulepath00:51
clarkbI think I need a $ on that var00:51
*** tiswanso has joined #openstack-infra00:51
*** xyang1 has quit IRC00:51
openstackgerritClark Boylan proposed openstack-infra/puppet-etherpad_lite: Allow system nodejs install
clarkbsee if thats better00:52
fungioh, indeed the conditional is missing a $00:52
*** tsekiyama has quit IRC00:53
*** nadya has quit IRC00:53
*** mtanino has quit IRC00:53
*** tsekiyam_ has quit IRC00:53
fungilaunching another now with that latest patchset00:54
*** jeadr has quit IRC00:55
*** jeadr has joined #openstack-infra00:56
fungiclarkb: works! 2001:4800:7817:103:be76:4eff:fe05:c92b
fungii still need to work out the apache config updates to work with 2.4, but i'll save that for tomorrow01:03
fungiand tomorrow01:03
fungiand tomorrow01:04
fungicreeps in this petty pace from day to day01:04
*** asettle has joined #openstack-infra01:05
*** alexsyip has quit IRC01:05
*** chen12 has joined #openstack-infra01:06
*** FallenPegasus has joined #openstack-infra01:06
*** baoli has joined #openstack-infra01:07
clarkbfungi: hrm I think we may also need npm01:08
*** glauco_ has joined #openstack-infra01:08
clarkbsince thats a separate oackage but part of the source build01:09
fungioh, true01:09
clarkbI do need to call it a day though feel free to update my change if you like01:09
*** thorst has quit IRC01:10
fungii will likely poke at it on the morrow, should we be blessed with minimal infrastructure breakage01:10
*** Shrews has quit IRC01:11
*** regXboi has quit IRC01:11
*** Shrews has joined #openstack-infra01:11
*** baoli has quit IRC01:12
*** yamamoto has joined #openstack-infra01:12
*** glauco_ has quit IRC01:13
fungiin the meantime, i will evening01:16
*** wenlock has quit IRC01:17
*** sdake_ has joined #openstack-infra01:21
ianwdstufft: so i think maybe the packages could help out more -> ... interested to see if it gets any response01:23 bug 1255206 in python-cffi "Consider adding installed-files.txt during build" [Unspecified,New] - Assigned to npmccallum01:23
*** sdake has quit IRC01:25
*** dims has quit IRC01:25
*** moravec has joined #openstack-infra01:26
*** hdd has joined #openstack-infra01:27
*** moravec has quit IRC01:30
*** sthillma has quit IRC01:33
*** Yanyanhu has joined #openstack-infra01:34
*** rick_chen has joined #openstack-infra01:37
*** Yanyanhu has quit IRC01:39
*** yamamoto has quit IRC01:40
*** Yanyan has joined #openstack-infra01:41
*** rick_chen has quit IRC01:41
*** jyuso1 has joined #openstack-infra01:41
*** woodster_ has quit IRC01:49
*** boris-42 has quit IRC01:50
*** dimtruck is now known as zz_dimtruck01:50
*** shashank_hegde has quit IRC01:52
*** ajmiller has joined #openstack-infra01:59
*** ajmiller_ has joined #openstack-infra02:02
*** ajmiller has quit IRC02:05
*** baoli has joined #openstack-infra02:08
*** bpokorny has quit IRC02:10
*** sridhar_ram1 has quit IRC02:10
*** jerryz has quit IRC02:10
*** baoli has quit IRC02:12
*** dims has joined #openstack-infra02:21
chen12do we have a infra core now ?  can anyone help me review/merge
chen12  ?02:22
*** unicell has quit IRC02:25
*** sthillma has joined #openstack-infra02:29
*** dims has quit IRC02:29
*** dims has joined #openstack-infra02:30
*** otter768 has quit IRC02:30
*** sthillma_ has joined #openstack-infra02:33
*** dims has quit IRC02:34
*** sthillma has quit IRC02:35
*** sthillma_ is now known as sthillma02:35
*** yamamoto has joined #openstack-infra02:40
*** mriedem has quit IRC02:44
*** salv-orlando has joined #openstack-infra02:44
*** markvoelker has quit IRC02:46
*** ivar-laz_ has joined #openstack-infra02:46
*** ivar-lazzaro has quit IRC02:49
*** ivar-laz_ has quit IRC02:50
*** salv-orlando has quit IRC02:51
*** yamahata has quit IRC02:53
*** salv-orlando has joined #openstack-infra02:55
*** salv-orlando has quit IRC03:02
*** otter768 has joined #openstack-infra03:02
*** gildub has quit IRC03:07
*** glauco has joined #openstack-infra03:09
*** shashank_hegde has joined #openstack-infra03:12
*** otter768 has quit IRC03:13
*** armax has joined #openstack-infra03:15
*** glauco has quit IRC03:15
*** baoli has joined #openstack-infra03:23
*** jerryz has joined #openstack-infra03:27
*** baoli has quit IRC03:28
*** Kennan2 is now known as Kennan03:36
*** sabeen1 has joined #openstack-infra03:46
*** markvoelker has joined #openstack-infra03:46
*** gildub has joined #openstack-infra03:46
*** aukhan has joined #openstack-infra03:49
*** markvoelker has quit IRC03:51
*** pal has joined #openstack-infra03:55
ruagairNot sure what TZ you're right now lifeless but if you're about I dropped a comment in this story for you:!/story/123444403:56
lifelessruagair: sure03:59
ruagairI was also wondering if it was still relevent.03:59
*** tlian2 has quit IRC03:59
lifelessI have no idea :)04:04
*** tiswanso has quit IRC04:05
*** achanda has quit IRC04:05
ruagairThe story was from 2013, last update for "gating" for example was Jan 14. Might be worth a re-read and see if it's still intimidating? Still lacks a simple example though, as you mention.04:08
lifelessruagair: I think you should read it and see if its intimidating04:08
lifelessruagair: :)04:09
ruagairI am mot of the way through.04:09
*** skylerberg has joined #openstack-infra04:10
lifelessruagair: I'm not super interested in the bug: it was a defect I observed and the project lead agreed on, so I filed the bug and moved on.04:13
lifelessruagair: if you think the bug04:13
lifelessruagair: is gone due to improvements, cool.04:13
lifelessruagair: if not, fixing it is great:)04:14
ruagairThanks for taking a look at it. I'll keep reading and submit patches if/where I think appropriate.04:15
*** minwang2 has joined #openstack-infra04:17
*** ayoung has quit IRC04:20
*** baoli has joined #openstack-infra04:24
*** pal has quit IRC04:27
*** minwang2 has quit IRC04:28
*** baoli has quit IRC04:29
*** unicell has joined #openstack-infra04:30
*** fawadkhaliq has joined #openstack-infra04:32
*** salv-orlando has joined #openstack-infra04:32
jamielennoxdoing tox -e py27 on keystone at the moment and watching pip quickly grow to using 100% of /tmp04:34
*** salv-orlando has quit IRC04:35
*** hdd has quit IRC04:36
openstackgerritPaul Van Eck proposed openstack-infra/puppet-refstack: Remove virtualenv and install RefStack on system
*** Sukhdev has joined #openstack-infra04:43
ianw/usr/bin/python /usr/bin/yum install -y fail2ban sysstat traceroute lsof apg strace telnet screen tcpdump ntp postfix vim-enhanced bind-utils jwhois mailx tmpwatch cyrus-sasl-lib cyrus-sasl-md5 cyrus-sasl-plain yum-cron rackspace-monitoring-agent04:45
ianw^ is this a few feature of RAX?  maybe i just never noticed it before04:45
*** darrenc is now known as darrenc_afk04:46
*** yuanying has joined #openstack-infra04:46
*** salv-orlando has joined #openstack-infra04:47
*** Sukhdev has quit IRC04:47
openstackgerritMerged openstack-infra/project-config: nova-powervm: Enable python3 job
*** skylerberg has quit IRC04:48
*** nadya has joined #openstack-infra04:50
*** shashank_hegde has quit IRC04:50
*** salv-orlando has quit IRC04:51
*** nadya has quit IRC04:54
*** erikwilson has joined #openstack-infra04:56
*** Sree has joined #openstack-infra04:58
*** Sukhdev has joined #openstack-infra04:58
*** erikwilson has quit IRC05:01
*** ajmiller_ has quit IRC05:02
*** zul has quit IRC05:04
*** FallenPegasus has quit IRC05:05
*** Sree has quit IRC05:06
*** darrenc_afk is now known as darrenc05:06
*** sdake has joined #openstack-infra05:07
*** achanda has joined #openstack-infra05:07
*** afazekas has joined #openstack-infra05:08
*** sabeen1 has quit IRC05:09
*** sdake_ has quit IRC05:11
*** glauco has joined #openstack-infra05:13
*** otter768 has joined #openstack-infra05:14
*** afazekas has quit IRC05:15
openstackgerritTimothy R. Chavez proposed openstack-infra/gearman-plugin: Send node label with data status packet
timrczaro, ^^ I updated to send back the node labels of the node returned by build.getBuiltOn()05:17
*** glauco has quit IRC05:18
timrcMy I now go another 10 years without looking at Java.05:18
*** kiran-r has joined #openstack-infra05:18
*** otter768 has quit IRC05:19
openstackgerritfumihiko kakuma proposed openstack-infra/devstack-gate: Allow for git base override
*** Sukhdev has quit IRC05:26
*** amotoki has quit IRC05:39
*** geoffarnold has joined #openstack-infra05:39
*** larainema has joined #openstack-infra05:40
openstackgerritSteve Kowalik proposed openstack-infra/project-config: Switch locale marker to locale_with_underscore
*** geoffarnold has quit IRC05:43
*** geoffarnold has joined #openstack-infra05:43
*** geoffarnold is now known as geoffarnoldX05:45
*** jeadr has quit IRC05:49
*** nadya has joined #openstack-infra05:51
*** jeadre has joined #openstack-infra05:52
*** vernhart is now known as vern05:52
*** hdd has joined #openstack-infra05:53
*** klagid has quit IRC05:54
*** nadya has quit IRC05:55
*** pal has joined #openstack-infra05:57
*** kiran-r has quit IRC05:59
*** mrmartin has joined #openstack-infra05:59
*** armax has quit IRC06:00
*** zeih has joined #openstack-infra06:01
*** unicell1 has joined #openstack-infra06:04
*** BharatK has joined #openstack-infra06:05
*** salv-orlando has joined #openstack-infra06:05
*** unicell has quit IRC06:05
*** zeih has quit IRC06:06
*** asettle has quit IRC06:09
*** amotoki has joined #openstack-infra06:09
*** hdd has quit IRC06:12
*** salv-orlando has quit IRC06:16
*** vlaza has joined #openstack-infra06:21
*** afazekas has joined #openstack-infra06:21
*** shashank_hegde has joined #openstack-infra06:21
*** pal has quit IRC06:23
*** pal has joined #openstack-infra06:27
*** Sree has joined #openstack-infra06:27
*** jerryz has quit IRC06:28
*** matbu has quit IRC06:30
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints
*** matbu has joined #openstack-infra06:32
*** salv-orlando has joined #openstack-infra06:32
*** Sree has quit IRC06:33
*** skylerberg has joined #openstack-infra06:37
*** afazekas has quit IRC06:37
*** cody-somerville has joined #openstack-infra06:38
BharatKianw, ping06:43
*** vlaza has quit IRC06:44
*** fawadkhaliq has quit IRC06:45
SpamapS" Located server and updated location.  Node has no power and needs motherboard replacement."06:45
SpamapSwell that's reassuring06:45
TheJuliaThat. is. awesome.06:46
*** vlaza has joined #openstack-infra06:46
SpamapSthats about the 4th box that has had such a catastrophic failure (out of 40)06:51
SpamapS3 years old.. doesn't seem like boxes should die so readily. :-P06:51
SpamapSbut.. he managed to resurrect the other two, so \o/06:51
*** scheuran has joined #openstack-infra06:52
*** AJaeger has quit IRC06:53
*** hyakuhei has joined #openstack-infra06:56
SpamapSgreghaynes: so, FYI, == dead06:56
SpamapSgreghaynes: the other two are back06:56
*** erikwilson has joined #openstack-infra06:56
SpamapSgreghaynes: I'm struggling to find a source of truth though. I've been editting machine-information-tab.txt but thats not what you used right?06:57
*** achanda has quit IRC07:00
*** dtantsur|afk is now known as dtantsur07:01
*** erikwilson has quit IRC07:01
*** peristeri has joined #openstack-infra07:03
*** mpopow has quit IRC07:05
*** marekd_404 is now known as marekd07:08
*** jtomasek has joined #openstack-infra07:09
*** fawadkhaliq has joined #openstack-infra07:09
*** jeadre has quit IRC07:13
*** jeadre has joined #openstack-infra07:14
openstackgerritMerged openstack/requirements: Bump cryptography version for Nova Bug 1481084
openstackbug 1481084 in OpenStack Compute (nova) "Keypair creation fails when ssh public key comment contains spaces" [Undecided,In progress] - Assigned to Davanum Srinivas (DIMS) (dims-v)07:14
openstackgerritMerged openstack/requirements: Add networking-ofagent to projects.txt
*** glauco_ has joined #openstack-infra07:15
*** otter768 has joined #openstack-infra07:15
openstackgerritMerged openstack-infra/puppet-cgit: Add cgit::ssh class to manage git over ssh
openstackgerrityolanda.robla proposed openstack-infra/puppet-jenkins: Add creation of user in jjb
*** claudiub has joined #openstack-infra07:19
*** otter768 has quit IRC07:19
*** yamamoto has quit IRC07:19
*** glauco_ has quit IRC07:20
BharatKclarkb, ping07:22
*** shardy has joined #openstack-infra07:23
openstackgerritMerged openstack-infra/project-config: Move experimental scenario gate jobs for Sahara to non-voting check
BharatKHi All,07:24
BharatKI am creating a job in which Neutron is enabled.07:25
*** hyakuhei has quit IRC07:25
BharatKThen, is it mandatory to have 'neutron' in the job name?07:25
BharatKFor more details:
openstackgerritMerged openstack-infra/puppet-unbound: Fix target path for regular git clone during tests
*** arxcruz has joined #openstack-infra07:32
*** pal has quit IRC07:32
*** sanjayu_ has joined #openstack-infra07:33
openstackgerritMerged openstack-infra/puppet-ssh: Fix target path for regular git clone during tests
*** hyakuhei has joined #openstack-infra07:34
openstackgerritvikram.choudhary proposed openstack-infra/project-config: Add #openstack-onos to gerritbot
openstackgerritMerged openstack-infra/puppet-redis: Fix target path for regular git clone during tests
openstackgerritMerged openstack-infra/puppet-ssl_cert_check: Fix target path for regular git clone during tests
openstackgerritMerged openstack-infra/puppet-sudoers: Fix target path for regular git clone during tests
*** hyakuhei has quit IRC07:36
*** sanjayu has quit IRC07:36
openstackgerritMerged openstack-infra/puppet-statusbot: Fix target path for regular git clone during tests
openstackgerritMerged openstack-infra/puppet-zanata: Fix target path for regular git clone during tests
*** sshnaidm has joined #openstack-infra07:38
*** fhubik has joined #openstack-infra07:40
*** salv-orlando has quit IRC07:40
*** yamamoto has joined #openstack-infra07:40
*** nadya has joined #openstack-infra07:40
*** jcoufal has joined #openstack-infra07:41
openstackgerritCraige McWhirter proposed openstack-infra/puppet-etherpad_lite: Allow system nodejs install
*** skylerberg has quit IRC07:41
*** sthillma has quit IRC07:42
openstackgerritMerged openstack-infra/puppet-tmpreaper: Fix target path for regular git clone during tests
openstackgerritMerged openstack-infra/puppet-user: Fix target path for regular git clone during tests
*** fhubik is now known as fhubik_brb07:44
*** skylerberg has joined #openstack-infra07:45
openstackgerritMerged openstack-infra/puppet-subunit2sql: Fix target path for regular git clone during tests
*** nadya has quit IRC07:45
openstackgerritMerged openstack-infra/puppet-yum: Fix target path for regular git clone during tests
*** markvoelker has joined #openstack-infra07:48
*** fedexo has quit IRC07:48
openstackgerritMerged openstack-infra/puppet-unattended_upgrades: Fix target path for regular git clone during tests
openstackgerritMerged openstack-infra/puppet-mailman: Fix target path for regular git clone during tests
*** camunoz has quit IRC07:51
openstackgerritMerged openstack-infra/puppet-kerberos: Fix target path for regular git clone during tests
openstackgerritMerged openstack-infra/puppet-jenkins: Fix target path for regular git clone during tests
*** markvoelker has quit IRC07:53
*** markus_z has joined #openstack-infra07:53
openstackgerritMerged openstack-infra/puppet-zuul: Fix target path for regular git clone during tests
openstackgerritMerged openstack-infra/puppet-openstackci: Fix target path for regular git clone during tests
*** skylerberg has quit IRC07:54
*** salv-orlando has joined #openstack-infra07:55
*** ihrachyshka has joined #openstack-infra07:58
*** fhubik_brb is now known as fhubik07:59
*** fhubik is now known as fhubik_brb08:00
*** yamahata has joined #openstack-infra08:00
*** fhubik_brb is now known as fhubik08:02
*** hyakuhei has joined #openstack-infra08:03
fbonibalizer, hi thanks for spreading that patch on all repos :)  where can I read that script if I need it for future patches ?08:05
*** derekh has joined #openstack-infra08:08
*** hyakuhei has quit IRC08:09
*** sridhar_ram has joined #openstack-infra08:11
*** dizquierdo has joined #openstack-infra08:14
*** sridhar_ram has quit IRC08:15
*** devvesa has joined #openstack-infra08:16
*** sflanigan has quit IRC08:17
*** zeih has joined #openstack-infra08:17
*** afazekas has joined #openstack-infra08:18
*** megm has joined #openstack-infra08:19
*** asettle has joined #openstack-infra08:19
fboit is like an ad-hoc script you just wrote for that specific case :)08:22
*** fawadkhaliq has quit IRC08:23
fboI should do the same for putting +1 on all reviews but I'm not sure that's really safe to automate the reviews :p08:24
*** asettle has quit IRC08:24
*** mrunge has joined #openstack-infra08:24
*** fawadkhaliq has joined #openstack-infra08:26
*** gildub has quit IRC08:26
openstackgerritMarton Kiss proposed openstack-infra/groups: Refactor bleed margins of bootstrap theme
*** jistr has joined #openstack-infra08:28
openstackgerritMotohiro/Yuanying Otsuka proposed openstack/requirements: Cap oslo.db to less than 2.4
*** fhubik is now known as fhubik_brb08:29
*** romcheg has joined #openstack-infra08:30
*** romcheg has left #openstack-infra08:31
openstackgerritMotohiro/Yuanying Otsuka proposed openstack/requirements: Cap oslo.db to less than 2.4
*** fhubik_brb is now known as fhubik08:33
openstackgerritNicko Glayre proposed openstack-infra/jenkins-job-builder: Stash publisher's credentials configuration
*** pal has joined #openstack-infra08:37
*** nadya has joined #openstack-infra08:40
*** shashank_hegde has quit IRC08:41
*** jeadre has quit IRC08:42
*** jeadre has joined #openstack-infra08:43
openstackgerritMerged openstack-infra/askbot-theme: Refactor css and font links to https
*** scheuran has quit IRC08:44
*** zeih has quit IRC08:48
*** dingyichen has quit IRC08:49
*** zeih has joined #openstack-infra08:50
*** rossella_s has joined #openstack-infra08:52
*** dtantsur is now known as dtantsur|brb08:55
*** spiffxp has quit IRC08:58
*** markus_z has quit IRC08:59
*** spiffxp has joined #openstack-infra09:00
*** spiffxp is now known as Guest7466809:00
*** yamamoto has quit IRC09:04
*** 7GHAAZ22K has joined #openstack-infra09:04
*** ociuhandu has quit IRC09:07
*** fawadkhaliq has quit IRC09:08
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [WIP] Remove heat pin
*** eantyshev has joined #openstack-infra09:10
*** lucasagomes has joined #openstack-infra09:12
openstackgerritsvasheka proposed openstack-infra/project-config: In order to copy screenshots after horizon integration tests, we need to make adjustment to horizon job.
openstackgerritsvasheka proposed openstack-infra/project-config: In order to copy screenshots after  horizon integration tests,we need  to make adjustment to horizon job.
openstackgerritEvgeny Antyshev proposed openstack-infra/devstack-gate: Support CloudLinux in devstack-gate
openstackgerritsvasheka proposed openstack-infra/project-config: In order to copy screenshots after  horizon integration tests, we need  to make adjustment to horizon job.
*** otter768 has joined #openstack-infra09:16
*** sdake_ has joined #openstack-infra09:18
*** markus_z has joined #openstack-infra09:18
*** jistr has quit IRC09:19
*** unicell1 has quit IRC09:20
*** otter768 has quit IRC09:20
*** jistr has joined #openstack-infra09:20
*** sdake has quit IRC09:21
*** unicell has joined #openstack-infra09:23
*** pelix has joined #openstack-infra09:25
*** fhubik is now known as fhubik_brb09:28
*** gaurangt has joined #openstack-infra09:28
*** nadya has quit IRC09:30
*** yamahata has quit IRC09:32
*** openkarma has joined #openstack-infra09:37
*** openkarma has quit IRC09:38
*** fhubik_brb is now known as fhubik09:38
*** nadya has joined #openstack-infra09:38
*** openkarma has joined #openstack-infra09:44
*** fhubik is now known as fhubik_brb09:44
*** markvoelker has joined #openstack-infra09:49
*** markvoelker has quit IRC09:54
*** dims has joined #openstack-infra09:56
*** fawadkhaliq has joined #openstack-infra09:58
*** fhubik_brb is now known as fhubik09:59
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack
*** Kennan2 has joined #openstack-infra10:03
*** matbu has quit IRC10:03
*** matbu has joined #openstack-infra10:04
*** Kennan has quit IRC10:04
*** Yanyan has quit IRC10:05
*** ociuhandu has joined #openstack-infra10:06
*** amotoki has quit IRC10:08
*** dtantsur|brb is now known as dtantsur10:09
*** fawadkhaliq has quit IRC10:13
*** bharath_ has joined #openstack-infra10:13
openstackgerritGary Duan proposed openstack/diskimage-builder: Contains the directory name of sys and proc when creating ramdisk for ironic-agent
*** markus_z has quit IRC10:15
*** sdake_ is now known as sdake10:15
openstackgerritNicko Glayre proposed openstack-infra/jenkins-job-builder: Stash publisher's credentials configuration
*** zeih has quit IRC10:23
*** 7GHAAZ22K has quit IRC10:25
*** glauco_ has joined #openstack-infra10:32
*** yolanda has quit IRC10:35
openstackgerritGary Duan proposed openstack/diskimage-builder: Contains the directory name of /sys and /proc when creating ramdisk for ironic python agent
*** glauco_ has quit IRC10:38
*** fawadkhaliq has joined #openstack-infra10:38
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack
*** yolanda has joined #openstack-infra10:45
*** shardy_ has joined #openstack-infra10:48
*** shardy has quit IRC10:48
*** yolanda has quit IRC10:50
*** zeih has joined #openstack-infra10:50
openstackgerritMerged openstack/requirements: Bump oslo.db to version 2.4
*** shardy_ has quit IRC10:53
*** yolanda has joined #openstack-infra10:53
*** shardy has joined #openstack-infra10:54
*** AJaeger has joined #openstack-infra10:54
*** unicell1 has joined #openstack-infra10:57
*** unicell has quit IRC10:58
openstackgerritNicko Glayre proposed openstack-infra/jenkins-job-builder: Stash publisher's credentials configuration
*** erikwilson has joined #openstack-infra10:58
*** mwagner_lap has quit IRC11:01
*** erikwilson has quit IRC11:03
*** unicell1 has quit IRC11:04
*** aukhan has quit IRC11:04
*** unicell has joined #openstack-infra11:04
*** shardy_ has joined #openstack-infra11:06
*** shardy has quit IRC11:08
*** shardy_ has quit IRC11:11
*** shardy has joined #openstack-infra11:12
*** unicell has quit IRC11:13
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack
*** unicell has joined #openstack-infra11:13
*** yamamoto_ has joined #openstack-infra11:14
*** dims has quit IRC11:15
*** dims has joined #openstack-infra11:16
*** otter768 has joined #openstack-infra11:17
*** dims has quit IRC11:20
*** otter768 has quit IRC11:22
*** gaurangt has left #openstack-infra11:24
*** baoli has joined #openstack-infra11:25
openstackgerritMerged openstack-infra/groups: Refactor bleed margins of bootstrap theme
*** pc_m has joined #openstack-infra11:28
*** baoli has quit IRC11:30
*** markus_z has joined #openstack-infra11:30
*** scheuran has joined #openstack-infra11:32
*** pal has quit IRC11:33
*** dims has joined #openstack-infra11:33
openstackgerritShivanand Tendulker proposed openstack/diskimage-builder: Fixes config drive creation failure in UEFI boot mode
*** dprince has joined #openstack-infra11:35
*** markvoelker has joined #openstack-infra11:35
*** lucasagomes is now known as lucas-hungry11:37
*** BharatK has quit IRC11:37
*** pal has joined #openstack-infra11:39
*** markvoelker has quit IRC11:40
*** ldnunes has joined #openstack-infra11:42
*** thorst has joined #openstack-infra11:43
*** yamamoto_ has quit IRC11:44
*** gordc has joined #openstack-infra11:45
*** salv-orlando has quit IRC11:45
*** samueldmq has joined #openstack-infra11:46
*** afazekas has quit IRC11:46
*** hyakuhei has joined #openstack-infra11:47
*** dansmith has quit IRC11:47
*** dizquierdo has quit IRC11:47
*** dansmith has joined #openstack-infra11:48
*** dansmith is now known as Guest9532811:48
*** woodster_ has joined #openstack-infra11:48
*** arxcruz has quit IRC11:56
*** bdemers has quit IRC11:59
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Change heat pin to a temprevert
*** hyakuhei has quit IRC12:01
*** hyakuhei has joined #openstack-infra12:01
*** arxcruz has joined #openstack-infra12:01
openstackgerritMerged openstack-infra/nodepool: Fix exception formatter in instance delete
*** derekh is now known as derekh_afk12:03
markus_zA 2nd +2 would be nice: Should be helpful for the upcoming bugfixing phase12:07
*** bswartz has quit IRC12:08
openstackgerritMerged openstack-infra/nodepool: Fix schema validator to allow specifying a gearman port
*** salv-orlando has joined #openstack-infra12:11
*** bharath_ has quit IRC12:13
*** gildub has joined #openstack-infra12:15
*** sdake has quit IRC12:17
*** shardy_ has joined #openstack-infra12:19
*** erlon has joined #openstack-infra12:19
*** glauco_ has joined #openstack-infra12:20
*** hyakuhei has quit IRC12:20
*** shardy has quit IRC12:20
*** asettle has joined #openstack-infra12:22
*** doug-fish has joined #openstack-infra12:23
*** dkranz has quit IRC12:23
*** pal has quit IRC12:23
*** asettle has quit IRC12:23
*** fawadkhaliq has quit IRC12:24
*** aysyd has joined #openstack-infra12:24
*** shardy_ has quit IRC12:24
openstackgerritsvasheka proposed openstack-infra/project-config: In order to copy screenshots after  horizon integration tests, we need  to make adjustment to horizon job.
*** shardy has joined #openstack-infra12:25
*** glauco_ has quit IRC12:27
openstackgerritsvasheka proposed openstack-infra/project-config: Add copy-screenshots publisher
*** hyakuhei has joined #openstack-infra12:29
*** ociuhandu_ has joined #openstack-infra12:32
*** ociuhandu has quit IRC12:33
*** ociuhandu_ is now known as ociuhandu12:33
*** unicell1 has joined #openstack-infra12:34
*** unicell has quit IRC12:34
*** glauco_ has joined #openstack-infra12:35
*** signed8bit has joined #openstack-infra12:36
*** cburroughs has joined #openstack-infra12:37
*** mwagner_lap has joined #openstack-infra12:37
*** flaviosr has joined #openstack-infra12:38
*** markvoelker has joined #openstack-infra12:39
*** thiagop has joined #openstack-infra12:41
openstackgerritsvasheka proposed openstack-infra/project-config: Add copy-screenshots publisher
*** hyakuhei has quit IRC12:42
*** mriedem has joined #openstack-infra12:42
*** hyakuhei has joined #openstack-infra12:42
*** tlian has joined #openstack-infra12:43
*** yamamoto has joined #openstack-infra12:44
openstackgerritsvasheka proposed openstack-infra/project-config: Add copy-screenshots publisher
*** chlong has joined #openstack-infra12:46
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Bump timeout for ironic-inspector job to usual 2 hours
*** dtantsur is now known as dtantsur|brb12:47
*** lucas-hungry is now known as lucasagomes12:48
*** dtantsur|brb is now known as dtantsur|mtg12:48
*** mriedem has quit IRC12:49
*** yamamoto has quit IRC12:49
*** annegentle has joined #openstack-infra12:50
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Make ironic-inspector-dsvm voting on ironic-inspector
*** mriedem has joined #openstack-infra12:51
*** cbader has quit IRC12:51
*** yamamoto has joined #openstack-infra12:51
*** yamamoto has quit IRC12:51
*** yamamoto has joined #openstack-infra12:52
*** yamamoto has quit IRC12:52
*** hyakuhei has quit IRC12:52
*** yamamoto has joined #openstack-infra12:52
*** jistr is now known as jistr|mtg12:53
*** hyakuhei has joined #openstack-infra12:55
*** signed8bit is now known as signed8bit_ZZZzz12:55
*** bswartz has joined #openstack-infra12:57
*** fhubik has quit IRC12:58
*** erikwilson has joined #openstack-infra12:59
*** pc_m has quit IRC12:59
*** pc_m has joined #openstack-infra12:59
*** chlong has quit IRC13:00
*** signed8bit_ZZZzz is now known as signed8bit13:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/requirements: block oslo.middleware 2.6.0
silehtdhellmann, ^13:02
openstackgerritMerged openstack-infra/reviewday: Make the review list sortable by review type
openstackgerritMerged openstack-infra/nodepool: Support SIGINT to gracefully stop nodepoold
*** amitgandhinz has joined #openstack-infra13:03
*** flaviosr has quit IRC13:03
*** fhubik has joined #openstack-infra13:04
*** erikwilson has quit IRC13:04
*** chlong has joined #openstack-infra13:04
openstackgerritNicko Glayre proposed openstack-infra/jenkins-job-builder: Customized pollscm trigger
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack
dhellmannsileht: +2a13:05
*** jyuso1 has quit IRC13:08
*** jswarren has quit IRC13:08
*** jyuso1 has joined #openstack-infra13:09
*** fhubik has quit IRC13:09
*** erikwilson has joined #openstack-infra13:11
mriedemi feel like the logstash job queue has been bonkers for about a week13:14
mriedemwe haven't been able to get logstash hits for any new gate bugs really13:14
openstackLaunchpad bug 1485969 in neutron "test_dualnet_multi_prefix_dhcpv6_stateless failed due to "RuntimeError: Set changed size during iteration" in quota code" [Undecided,In progress] - Assigned to Ihar Hrachyshka (ihar-hrachyshka)13:14
*** wenlock has joined #openstack-infra13:14
mriedemi do'nt know how bad that is right now13:14
*** dizquierdo has joined #openstack-infra13:15
*** rfolco has joined #openstack-infra13:15
clarkbmriedem there is a bug in os-loganalyze and we are indexing html not txt logs13:15
*** hyakuhei has quit IRC13:15
clarkbonce the fix for that merges we should get back to normal13:15
*** pc_m_ has joined #openstack-infra13:16
*** alivigni has joined #openstack-infra13:17
*** otter768 has joined #openstack-infra13:18
*** krtaylor has quit IRC13:18
*** pc_m has quit IRC13:20
*** bdemers has joined #openstack-infra13:21
*** jswarren has joined #openstack-infra13:21
*** otter768 has quit IRC13:23
*** jyuso1 has quit IRC13:23
*** ayoung has joined #openstack-infra13:24
*** fawadkhaliq has joined #openstack-infra13:24
*** xyang1 has joined #openstack-infra13:25
*** fawadkhaliq has quit IRC13:28
openstackgerritewitter proposed openstack-infra/git-review: Autotopic: read from configuration file .
*** jamielennox is now known as jamielennox|away13:30
*** zul has joined #openstack-infra13:30
*** krtaylor has joined #openstack-infra13:31
openstackgerritJeremy Stanley proposed openstack-infra/puppet-etherpad_lite: Allow system nodejs install
fungiclarkb: ^ that gets us much closer, now deployed at 2001:4800:7817:103:be76:4eff:fe05:98d4
fungistill need to massage the apache vhost config though13:33
*** bcourt has quit IRC13:33
clarkbfungi the symlink should require the nodejs package13:34
clarkbto avoid temporary dangling symlink13:34
fungican do that i suppose13:35
*** dims_ has joined #openstack-infra13:35
clarkbI wouldnt respin for that though, would wait for apache things13:36
*** prad_ has joined #openstack-infra13:36
fungialso the apache situation is weird. if i manually update puppet on the server after deploying, the config errors are absent :/13:36
fungisuggests a race in our puppetry13:36
clarkbmy guess is with mod enablement13:36
fungispecifically, it's complaining that RewriteEngine is unrecognized. i bet we're not enabling mod_rewrite early enough13:37
*** eharney has joined #openstack-infra13:37
openstackgerritGlauco Oliveira proposed openstack-infra/puppet-gerrit: Implementing a set of acceptance tests for puppet-gerrit.
*** dkranz has joined #openstack-infra13:37
fungihrm, also it's complaining the connection tuning config snippet isn't getting installed on the initial pass. we may need that to happen after apache is installed so the destination path will exist13:38
fungieither that or puppet the parent directories13:39
*** dims has quit IRC13:39
*** tiswanso has joined #openstack-infra13:40
openstackgerritMatthias Runge proposed openstack-infra/project-config: Switch Django-1.8 test to voting
*** geoffarnoldX is now known as geoffarnold13:42
*** amitgandhinz has quit IRC13:42
*** gildub has quit IRC13:44
*** dims_ has quit IRC13:44
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack
*** vadimk_ has joined #openstack-infra13:45
*** dims has joined #openstack-infra13:46
*** julim has joined #openstack-infra13:46
*** signed8bit is now known as signed8bit_ZZZzz13:46
*** prad_ is now known as pradk13:47
*** fawadkhaliq has joined #openstack-infra13:48
*** bcourt has joined #openstack-infra13:48
*** pal has joined #openstack-infra13:48
*** amitgandhinz has joined #openstack-infra13:48
*** signed8bit_ZZZzz is now known as signed8bit13:49
*** signed8bit is now known as signed8bit_ZZZzz13:50
*** xyang1 has quit IRC13:52
*** atuvenie has joined #openstack-infra13:54
*** pal has quit IRC13:56
*** regXboi has joined #openstack-infra13:56
*** pal has joined #openstack-infra13:57
*** larainema has quit IRC13:58
*** tvanderwiel has joined #openstack-infra13:58
*** tvanderwiel has quit IRC13:58
*** xyang1 has joined #openstack-infra13:59
*** skraynev has quit IRC13:59
*** skraynev has joined #openstack-infra14:00
*** Guest95328 is now known as dansmith14:00
svashekaguys does somebody knows a way to get notification on particullar job failure  throughout all patches?14:02
*** sigmavirus24_awa is now known as sigmavirus2414:03
*** warpc__ has joined #openstack-infra14:04
*** signed8bit_ZZZzz has quit IRC14:06
EmilienMsvasheka: logstash can help14:07
*** afazekas has joined #openstack-infra14:07
svashekaEmilienM, can you please be more specific?14:08
*** jistr|mtg is now known as jistr14:08
*** fhubik has joined #openstack-infra14:09
EmilienMsvasheka: a sec14:09
EmilienMsvasheka: this is an example with a QUERY that contains an error message14:10
*** dtantsur|mtg is now known as dtantsur14:10
*** bcourt has quit IRC14:10
*** geoffarnold has quit IRC14:10
EmilienMthere is a RSS link so you can follow new failures for all jobs14:11
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack
*** ajmiller has joined #openstack-infra14:13
*** signed8bit has joined #openstack-infra14:14
*** kgiusti has joined #openstack-infra14:14
*** kiran-r has joined #openstack-infra14:14
*** kiran-r has quit IRC14:15
*** doug-fish has quit IRC14:16
*** doug-fish has joined #openstack-infra14:16
*** dtantsur is now known as dtantsur|mtg14:17
svashekaEmilienM, thanks14:17
*** zul has quit IRC14:17
*** mtanino has joined #openstack-infra14:17
*** yamamoto has quit IRC14:17
EmilienMsvasheka: hope it helps!14:17
*** yamamoto has joined #openstack-infra14:19
*** yamamoto has quit IRC14:19
*** yamamoto has joined #openstack-infra14:19
*** lucasagomes is now known as lucas-afk14:21
*** cdent has joined #openstack-infra14:21
*** bcourt has joined #openstack-infra14:22
*** vlaza has left #openstack-infra14:26
*** pal_ has joined #openstack-infra14:27
*** pal has quit IRC14:27
*** glauco_ has quit IRC14:29
*** FallenPegasus has joined #openstack-infra14:33
*** fawadkhaliq has quit IRC14:33
*** doug-fish has quit IRC14:33
*** doug-fish has joined #openstack-infra14:33
*** mpopow has joined #openstack-infra14:34
*** tonytan4ever has joined #openstack-infra14:36
*** mpopow has quit IRC14:37
*** doug-fish has quit IRC14:38
*** cbader has joined #openstack-infra14:39
*** amitgandhinz has quit IRC14:39
*** amitgandhinz has joined #openstack-infra14:40
*** zeih has quit IRC14:40
*** geoffarnold has joined #openstack-infra14:40
*** samueldmq has quit IRC14:40
clarkbnow I know what its like when we mob a place during conferences14:41
clarkbmy breakfast currebtly interrupted by some large group of conference goers14:41
*** tsekiyama has joined #openstack-infra14:41
*** sabeen has joined #openstack-infra14:42
*** ddieterly has joined #openstack-infra14:42
fungitake no prisoners14:43
*** peristeri has quit IRC14:43
*** signed8bit has quit IRC14:43
*** zeih has joined #openstack-infra14:43
clarkbI wonder how hard it will be to do that in tokyo14:44
*** signed8bit has joined #openstack-infra14:44
*** glauco has joined #openstack-infra14:44
*** sabeen3 has joined #openstack-infra14:45
*** sabeen has quit IRC14:47
*** bpokorny has joined #openstack-infra14:47
*** zeih has quit IRC14:48
*** mpopow has joined #openstack-infra14:48
*** pal_ has quit IRC14:48
*** mpopow has quit IRC14:48
jeblairwe should all cross an intersection at the same time14:49
*** zz_dimtruck is now known as dimtruck14:49
*** derekh_afk is now known as derekh14:50
*** minwang2 has joined #openstack-infra14:53
openstackgerritJeremy Stanley proposed openstack-infra/puppet-etherpad_lite: Allow system nodejs install
openstackgerritJeremy Stanley proposed openstack-infra/puppet-etherpad_lite: Fix races in httpd install and config
*** shardy_ has joined #openstack-infra14:53
openstackgerritMehdi Abaakouk (sileht) proposed openstack/requirements: block oslo.middleware 2.6.0
fungistill testing that ^14:53
pabelangerfungi: clarkb: jeblair: I was hoping you'd be able to help me figure out the best way to get an experimental multinode job going.  My first thought, was to see about adding something into the openstack-dev/sandbox, a simple 1 subnode gate.14:54
clarkbI wonder if puppet sorted alphabetically in the past so when it was called "apache" it just worked but now that it is httpd we lose14:54
*** shardy has quit IRC14:54
jeblairclarkb: oh good notion14:54
clarkbpabelanger we have a few at this point if you want to look at prior art14:54
*** signed8bit has quit IRC14:55
clarkbpabelanger greo for multinode to find them but most of the magic is in devstack gate14:55
fungiclarkb: well, this could also be lingering/unnoticed since it was already "eventually consistent" (just needed more than one puppet run to get there)14:55
*** signed8bit has joined #openstack-infra14:55
*** ashleighfarnham has quit IRC14:56
clarkbI want to say we saw it with another module after the httpd switch though14:56
pabelangerclarkb: Ya, I was thinking of adding my code into devstack repo just to get access to the multi-node stuff.  The stuff I want to work on is the ansible launcher I have running locally.  Even, do some initial prep work for zuulv3 spec14:56
*** annegentle has quit IRC14:58
*** shardy_ has quit IRC14:58
*** dkranz has quit IRC14:58
*** annegentle has joined #openstack-infra14:58
*** arxcruz has quit IRC14:59
jgriffithI'm interested in adding a new gate item to Cinder, have the layout in project-config, but don't recall the steps to provide the actual tox instruction to run it.  Anybody have a minute to point me in the right direction?14:59
clarkbfungi it was openstackci and its beaker test14:59
*** shardy has joined #openstack-infra14:59
fungiclarkb: aha, seems likely in that case14:59
pabelangerclarkb: so, how do we -infra see people wanting to add multi-node support into a project working?  Would each project create an experimental job into their own namespace, or some sort of sandbox to simply see nodepool subnodes work14:59
jgriffithFWIW I'm moving the genconfig out of the pep8 heading in tox and into it's own test-case (non-voting)14:59
*** dangers_away is now known as dangers15:00
*** austin81 has joined #openstack-infra15:00
clarkbpabelanger I wouldnt use the sandbox repo since it isnt meant for real work, I would run the job against the appropriate projwct. also you shouldnt need multinode to test an ansible job runner fwiw15:01
clarkbjgriffith in project-config under jenkins/jobs you want to add the job.15:01
jgriffithclarkb: thanks!15:01
clarkbjgriffith there should already be a run tox template that you can pass a tox env name to to run that15:02
*** zul has joined #openstack-infra15:02
jgriffithclarkb: yup, found it, thank you15:02
pabelangerclarkb: I guess I could loop back ansible launcher, but that was the initial setup.15:02
clarkbpabelanger ya either ssh localhost or use ansibles local "connwction" which is really just a fork I think15:03
fungiclarkb: should i just drop the absent file resource at or is there a good way to make this so we can switch back and forth without manually deleting things?15:03
clarkbthat way you start simple and work out bugs before worrying about the more complex case15:03
pabelangerclarkb: Ya, I was mostly doing this in parallel. See what is needed to get multinode experimental going, since that will take the code some time to get merged15:04
*** fhubik has quit IRC15:04
clarkbfungi is the usr local path hardcoded? maybe we can rely on PATH to fibd it for usm15:04
pabelangerclarkb: could you see me experimental job for multi-nodes into system-config, or would that be out of the question?15:05
clarkbfungi then it can be in either location without pupoet caring15:05
clarkbpabelanger honestly I would want a single node job first15:05
fungiclarkb: it's not hard-coded, no. mostly just wondering if the nodejs source install will freak when it attempts to overwrite that symlink with an executable15:05
*** glauco has quit IRC15:05
*** fawadkhaliq has joined #openstack-infra15:06
clarkbfungi I think it will freak if we go source => package => source on the same host15:06
fungiwhat about just package => source? will it sanely replace that symlink?15:06
fungii suppose i can test that15:07
*** erikwilson has quit IRC15:07
openstackgerritAlexander Tivelkov proposed openstack/requirements: Bump yaql to version 1.0
*** erikwilson has joined #openstack-infra15:07
*** signed8bit has quit IRC15:08
*** kushal has joined #openstack-infra15:08
clarkbpabelanger: what we have seen with multinode jobs is that everyone wants them until they have them then they get neglected because its hard15:08
clarkbpabelanger: so IMO its good to have a solid single node test before bothering with the extra complexity15:08
clarkbespecially since in this case I don't think there is anything multinode would test that single node cant test15:09
odyssey4mefungi I see that the ubuntu-trusty image doesn't have growroot, so while disk 1 is 80gb, and the partition is 80gb, it's root file system is only 14gb15:09
clarkbodyssey4me: that should be fixed real soon now15:09
*** erikwilson has quit IRC15:09
fungiodyssey4me: i believe greghaynes was working on that15:09
*** pal has joined #openstack-infra15:09
clarkbyup greghaynes has a change to dib to fix that15:09
clarkbso once that is merged and released we will get new images with properly sized filesystems15:10
fungiwe just have to not rely on cloud-init or its initramfs magic to do that, since it drags in all sorts of distro packages of python modules15:10
*** dizquierdo has quit IRC15:10
clarkband the existing package to do it is broken15:10
clarkbso its all sorts of fun15:10
pabelangerclarkb: Right, that's why I was looking into some sort of experimental sandbox for multi-node. Some place off in the corner where people could really play with it to get a better understanding how it works.  Since, the process will be noisy to start15:10
odyssey4meah awesome - do you have the review for that handy? I'd like to track it15:11
*** ihrachyshka has quit IRC15:11
clarkbpabelanger: I guess I don't understand the motivation then. Are you wanting to test an asnible job runner? do that on a single node. If you want to explore the multinode setup play with the existing jobs15:11
fungianyway, slightly further now. no puppet errors with that patch series and seems to function 2001:4800:7815:102:be76:4eff:fe04:a65d if anyone wants to help test15:11
clarkbpabelanger: if you push changes to d-g you can very easily manipulate the multinode test envs15:11
*** AJaeger has quit IRC15:12
clarkbfungi: let me update my resolv.conf15:12
*** dprince has quit IRC15:12
clarkber /etc/hosts15:12
*** amitgandhinz has quit IRC15:12
fungilooks like the vhost config itself was already basically apache 2.4 ready15:13
pabelangerclarkb: Right, d-g is the only place right now. And going to look into it, just afraid of the potential noise my patchset will cause.  Either way, thanks I'll look into those 2 things15:13
*** f1ller is now known as filler15:14
clarkbpabelanger: the problem with using sandbox is people push all kinds of junk there and I don't think its appropriate to go run complex test scenarios based off of that15:14
*** dkranz has joined #openstack-infra15:14
clarkbpabelanger: its a gerrit sandbox not a jenkins sandbox. Maybe we need a jenkins sandbox too15:14
pabelangerclarkb: Ya, the only other place I've done work with multinode, is local setups.15:14
*** hodos has joined #openstack-infra15:14
openstackgerritDerek Higgins proposed openstack-infra/project-config: Pull instack in upstream tripleo
openstackgerritDerek Higgins proposed openstack-infra/project-config: Pull instack into upstream tripleo
openstackgerritJeremy Stanley proposed openstack-infra/puppet-etherpad_lite: Allow system nodejs install
openstackgerritJeremy Stanley proposed openstack-infra/puppet-etherpad_lite: Fix races in httpd install and config
fungiokay, that's got the /usr/local/bin/node symlink removal taken back out15:18
*** mpopow has joined #openstack-infra15:18
* timrc looks at gearman-plugin and frowns.15:19
*** otter768 has joined #openstack-infra15:19
*** eharney has quit IRC15:19
*** stevemar has joined #openstack-infra15:21
*** dannywilson has joined #openstack-infra15:21
*** BharatK has joined #openstack-infra15:21
*** jistr is now known as jistr|mtg15:22
openstackgerritMehdi Abaakouk (sileht) proposed openstack-infra/project-config: ceilometer: increase timeout of integration job
*** otter768 has quit IRC15:23
*** mpopow has quit IRC15:23
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack
*** FallenPegasus has quit IRC15:24
*** pal has quit IRC15:24
odyssey4meclarkb fungi I take it this is the review that's pending for growroot?
*** pal has joined #openstack-infra15:24
clarkbodyssey4me: that looks correct15:25
BharatKclarkb, Regarding the patch
fungialso i think there's some related cleanup needed (proposed?) in the simple-init element to stop installing the cloud-utils package15:25
BharatKclarkb, In our job definition we enabled Neutron. So is that mandatory to have 'neutron' in the job name?15:26
clarkbBharatK: no15:26
*** hdd has joined #openstack-infra15:26
BharatKclarkb, Thanks. please review this patch when you have time.15:26
clarkbat least I haven't cared about that, it is handy where we do both neutron and nova net but things are slowly moving away from nova net15:26
BharatKclarkb, Oh okay.15:27
*** samueldmq has joined #openstack-infra15:28
*** scheuran has quit IRC15:28
clarkbjeblair: fungi pleia2 is the fix for the current logstash index all the html situation15:29
openstackgerritDerek Higgins proposed openstack-infra/project-config: Tripleo CI reshuffle
clarkbreviews there would be helpful15:29
*** sshnaidm has quit IRC15:31
*** Swami has joined #openstack-infra15:31
openstackgerritMehdi Abaakouk (sileht) proposed openstack-infra/project-config: ceilometer: increase timeout of integration job
*** zul has quit IRC15:33
*** kushal has quit IRC15:33
*** kushal has joined #openstack-infra15:33
*** kushal has quit IRC15:33
*** kushal has joined #openstack-infra15:33
openstackgerritMerged openstack-infra/os-loganalyze: Only provide html if client supports it
*** pal has quit IRC15:35
*** r-daneel has joined #openstack-infra15:36
openstackgerrityolanda.robla proposed openstack-infra/puppet-jenkins: Set jenkins key with more generic name
*** geoffarnold has quit IRC15:41
*** armax has joined #openstack-infra15:44
openstackgerritAugustina Ragwitz proposed openstack-infra/nodepool: Overall documentation improvements focused on setup and testing
*** mriedem is now known as mriedem_away15:46
*** mwagner_lap has quit IRC15:50
therveclarkb, Logs problem seems fixed \o/15:50
*** angdraug has joined #openstack-infra15:51
clarkbtherve: yup looks good from here too15:51
clarkbneed to give the indexrs time to catch up so there is likely a delay until elasticsearch sees it15:52
clarkbbut we ar eon track to working again15:52
* therve nods15:52
*** salv-orlando has quit IRC15:52
fungiwelp, i accidentally tested deploying that puppet-etherpad_lite stack without system node and it also worked correctly, albeit took an extra 20+ minutes to install15:52
*** doug-fish has joined #openstack-infra15:52
fungirather, accidentally tested on trusty15:52
clarkbthats reassuring that it works )15:52
fungidoing again without system node on precise to make sure that's not going to get broken15:52
*** hyakuhei has joined #openstack-infra15:53
*** hogepodge has quit IRC15:53
fungiwhen it comes time to replace etherpad-dev, i assume we'll want to test a db import as well15:54
*** btully has joined #openstack-infra15:54
*** sergmelikyan has joined #openstack-infra15:54
fungioh, wait, it's using trove yeah?15:54
clarkbfungi: its running a trove db so we just point a tthe correct db15:54
*** ftersin_ has joined #openstack-infra15:54
*** ftersin_ has left #openstack-infra15:54
fungii'm sort of surprised pointing two etherpad-dev servers at one trove db isn't wreaking havoc here15:55
clarkbfungi: it should be fine as long as you use different pads15:55
*** kgiusti has quit IRC15:55
clarkbthats how you can load balance servers15:55
*** flepied has quit IRC15:55
*** devvesa has quit IRC15:56
jeblairthe pad dispatch is the tricky part, and of course, makes that very unlikely to be useful to us (since we have a habit of focusing on a small number of pads at once)15:56
*** armax has quit IRC15:56
*** notnownikki has quit IRC15:57
*** glauco has joined #openstack-infra15:57
*** eharney has joined #openstack-infra15:59
*** salv-orlando has joined #openstack-infra15:59
openstackgerritDerek Higgins proposed openstack-infra/project-config: Pull instack into upstream tripleo
*** btully has quit IRC16:00
*** ddieterly has quit IRC16:01
*** ihrachyshka has joined #openstack-infra16:02
*** unicell has joined #openstack-infra16:03
*** unicell1 has quit IRC16:05
*** hyakuhei has quit IRC16:05
*** skolekonov has joined #openstack-infra16:05
fungiokay, i've tested deploying the current state of that 215169 puppet-etherpad_lite stack (without system nodejs set) on precise and seems to be working so should be safe to approve 2001:4800:7817:101:be76:4eff:fe05:f13a
*** hyakuhei has joined #openstack-infra16:06
*** sdake has joined #openstack-infra16:06
*** esker has quit IRC16:07
*** yamahata has joined #openstack-infra16:09
claytonGetting "We're sorry, we hit a bug!" from mailman when attempting to subscribe to openstack-infra.  Is that a known issue?16:09
*** jistr|mtg is now known as jistr16:10
fungiclayton: via smtp to the request alias or http post?16:10
claytonhttp post16:10
fungifirst i've heard of that error regardless16:11
*** ashleighfarnham has joined #openstack-infra16:11
claytonI'll try via replying to the confirmation16:11
fungichecking the error log now for details16:11
fungiIOError: [Errno 28] No space left on device16:12
claytonheh, that'd do it16:12
fungilooks like /run/lock has filled up16:12
*** ihrachyshka has quit IRC16:13
*** klagid has joined #openstack-infra16:13
*** klagid has quit IRC16:14
*** hyakuhei has quit IRC16:15
*** minwang2 has quit IRC16:16
SpamapSmordred: FYI, gearman-interface is gone from Debian. :-P16:17
fungiokay, i just deleted all files in /run/lock/mailman greater than an hour old. clayton see if you still get an error16:17
*** hyakuhei has joined #openstack-infra16:17
claytonworked, thanks.16:17
*** krtaylor has quit IRC16:18
*** dkranz has quit IRC16:18
fungiit looks like this may be lingering fallout from the subscribe flood a couple days ago16:18
fungiahh, nope, the flood has resumed16:18
openstackgerritJames E. Blair proposed openstack-infra/project-config: Publish project team guide
*** flepied has joined #openstack-infra16:19
jeblairttx, annegentle: ^16:19
annegentlejeblair: sweet! Will look16:19
greghaynesSpamapS: hey, you highlighted me on some things while I was in transit last night16:20
greghaynesSpamapS: did they get sorted?16:20
openstackgerritTimothy R. Chavez proposed openstack-infra/gearman-plugin: Send node label with data status packet
*** kiran-r has joined #openstack-infra16:20
greghaynesSpamapS: The source of truth is the machine-information. For some of the info that isnt in there (like cpu / mem) and for double checking against the hardware we can talk to the ansible playbooks in the playbooks dir is used16:21
clarkbfungi: any thoughts on working around the flood? I am around to help if you need it16:21
funginigelb: you're probably asleep now, but it looks like our subscriber flood friends have returned. they're probably hitting you too16:21
*** hyakuhei has quit IRC16:22
*** rlandy has quit IRC16:22
*** hogepodge has joined #openstack-infra16:23
fungiclarkb: it caught me as i started eating lunch, but nigelb worked around it on his listserv with
jeblairclarkb, fungi: how can i catch up on the mm problem?16:23
clarkbjeblair: basically a botnet appears to be using public mailman servers to perform reflection attacks against an email address16:23
fungijeblair: someone using all the mailman servers they can find to flood some poor gmail account holder's inbox with subscription request confirmation messages via the http post subscribe interface16:23
clarkbjeblair: we can't effectively block the sources as they are well distributed so need to either turn off subscriptions globally or for the single user as above16:24
SpamapSgreghaynes: highlights were talking about the JIRA tickets.16:24
greghaynesSpamapS: ah, ok. \O/ for some fixed hardware16:24
SpamapSgreghaynes: basically, 2 of the boxes are fixed (box firmware updated). The other one has a bad motherboard.16:24
jeblairfungi, clarkb: got it.  i think we should probably run ban_user then, yeah?16:24
*** zul has joined #openstack-infra16:24
fungijeblair: run it on who?16:25
*** ihrachyshka has joined #openstack-infra16:25
jeblairfungi: on our lists?16:25
openstackgerritDouglas Mendizábal proposed openstack-infra/project-config: Add check-requirements to castellan
SpamapSgreghaynes: so I want to somehow mark the bad motherboard one in our source of truth as "don't pull this in anymore"16:25
fungijeblair: the e-mail addresses are randomized suffixes16:25
*** rossella_s has quit IRC16:25
clarkbright sorry its a single email addr with a bunch of +suffixes16:25
jeblairfungi: right, so nigelb's fix is to add a regex ban for all the lists, right?  so that the http post does not result in an email16:25
*** rossella_s has joined #openstack-infra16:26
fungii just ran this to clear the deferrals from our exim queue for that recipient pattern: sudo exim4 -bp|grep -B1 'kemo\.mart'|grep '@lists\.openstack\.org'|cut -c11-26|xargs sudo exim4 -Mrm16:26
SpamapSgreghaynes: really feels like we just need our own DB for machines.. even if we do end up duplicating their internal one..16:26
fungijeblair: oh, i see what you're saying, yes. we need to ban by regular expression match on the recipient address16:26
SpamapSDoes anybody have any experience with open source CMDB's?16:27
jeblairfungi: a) are we agreed that is a good course of action and we should take it; b) has that been done? c) shall i do it?16:27
jeblairclarkb: ^?16:27
*** mriedem_away is now known as mriedem16:27
clarkbjeblair: a yes b no c sure16:27
clarkbjeblair: I would like to be clue batted on what you did when its done too16:27
*** geoffarnold has joined #openstack-infra16:27
*** oomichi has joined #openstack-infra16:28
SpamapSgreghaynes: or.. maybe we could just check machine-information into a private git tree that we just have on our boxes?16:28
*** mwagner_lap has joined #openstack-infra16:28
greghaynesSpamapS: ok, so I lied about the source of truth16:28
greghaynesSpamapS: one sec16:29
greghaynesSpamapS: check out machine-information-tab.yaml on .316:29
*** dkranz has joined #openstack-infra16:30
*** sdake_ has joined #openstack-infra16:30
*** salv-orlando has quit IRC16:30
openstackgerritDmitry Tyzhnenko proposed openstack-infra/git-review: Add reviewers by group alias on upload
*** _kiran_ has joined #openstack-infra16:30
greghaynesSpamapS: thats what it double checks against16:30
*** kiran-r has quit IRC16:31
greghaynesSpamapS: then I had an inventory file which had all the hosts, and ran get_macs playbook in playbooks dir16:31
*** hyakuhei has joined #openstack-infra16:31
*** pradk has quit IRC16:31
openstackgerritGrant Murphy proposed openstack-infra/jeepyb: Make SMTP connection configurable
greghaynesits pretty un-ideal, so ++ on just makng an inventory db16:31
openstackgerritDouglas Mendizábal proposed openstack/requirements: Add Castellan to global requirements
fungijeblair: clarkb: it's the only solution i've seen anyone say they've used in this circumstance, other than manually hacking the mailman cgi to disable http post subscribes entirely16:31
greghaynesSpamapS: I was thinking wed just convert that inventory dir into an inventory db of some kind and go from there16:32
pleia2good morning16:32
jeblairclarkb, fungi: on it16:33
*** ams__ has joined #openstack-infra16:33
*** doug-fish has quit IRC16:33
*** doug-fish has joined #openstack-infra16:33
*** sdake has quit IRC16:33
fungisince the attacks are coming from a very wide variety (thousands) of ip addresses, both v4 and v6, and the subscription addresses vary on a suffix, i'm not sure what other avenues are open to us16:34
*** julim has quit IRC16:34
*** hdd has quit IRC16:34
*** ivar-lazzaro has joined #openstack-infra16:34
*** hyakuhei has quit IRC16:34
*** lucas-afk is now known as lucasagomes16:34
*** rlandy has joined #openstack-infra16:34
*** sdake_ is now known as sdake16:34
*** hyakuhei has joined #openstack-infra16:35
*** kushal has quit IRC16:36
*** dtantsur|mtg is now known as dtantsur|afk16:37
greghaynesSpamapS: So how about we kill the machine-information-*, and use the inventory dir as the source of truth? for those notes we have in the margin of machine-information-tab we can just use yaml comments16:37
*** fawadk has joined #openstack-infra16:37
greghaynesand then from there if we want to inventory db we can do that at some point16:37
*** fawadkhaliq has quit IRC16:37
*** kushal has joined #openstack-infra16:37
*** geoffarnold has quit IRC16:37
*** puranamr has joined #openstack-infra16:38
*** dprince has joined #openstack-infra16:39
SpamapSgreghaynes: I'm fine with that. There's more useful information there than anywhere else.16:41
*** nadya has quit IRC16:42
jeblairfungi: i think when the lockfile dir filled up, we ended up with some stuck lockfiles16:42
*** armax has joined #openstack-infra16:43
*** pvaneck has joined #openstack-infra16:44
mriedemsomething changed with displaying subunit logs for tox runs in the browser
mriedemis that intentional?16:45
*** shardy has quit IRC16:45
*** ivar-laz_ has joined #openstack-infra16:45
jeblairfungi: i cleaned them up16:45
fungijeblair: thanks16:45
jeblairfungi, clarkb: script finished; documenting now16:45
*** jistr has quit IRC16:46
*** pradk has joined #openstack-infra16:46
*** ivar-lazzaro has quit IRC16:46
openstackgerritMerged openstack/requirements: Add networking-ofagent to projects.txt
*** mrmartin has quit IRC16:48
*** unicell has quit IRC16:48
*** Kennan2 has quit IRC16:50
fungiokay, lunch wrapped up now. logs indicate this attack resumed yesterday at 11:54 utc16:51
fungiso unlike last time, it's been running for over 24 hours this time around16:53
*** minwang2 has joined #openstack-infra16:53
odyssey4mefungi clarkb so we discovered the issue with our builds failing in hpcloud, finally16:53
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add documentation on scripting mailman actions
*** flepied has quit IRC16:53
jeblairclarkb, fungi: ^ what i did16:53
*** atuvenie has quit IRC16:53
clarkbodyssey4me: what is the problem?16:53
*** btully has joined #openstack-infra16:54
odyssey4menothing to do with resource issues, everything to do with a missing package which we were assuming to be there:
odyssey4mecinder appears to require it now for liberty16:54
odyssey4mekilo does not16:54
jeblairnigelb: thanks for the ban script; i altered it to add lock calls, you may want to look at
clarkbjeblair: and that works for the various suffixes? How do the new ones get added?16:55
odyssey4mecinder-volume requires the  libxslt1.1 library16:55
jeblairclarkb: oh, sorry i ran it with nigelb's regex: "^kemo.mart.*"16:55
odyssey4mefor the lvm backend at least16:55
clarkbjeblair: oh I see the ban list takes a regex16:55
* jeblair updates change16:56
fungijeblair: clarkb: heh, i was just about to ask the same question16:56
fungiso anyway, with an added note that regular expressions work there, lgtm16:56
*** dizquierdo has joined #openstack-infra16:56
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add documentation on scripting mailman actions
*** armax has quit IRC16:57
*** spzala has joined #openstack-infra16:57
*** kgiusti has joined #openstack-infra16:57
SpamapSgreghaynes: so, what you're suggesting is that we edit the files in the inventory directory directly. Will your ansible stuff preserve edits?16:58
jeblairclarkb, fungi: also if you just run "withlist" it will print out a bunch of documentation on how to use it16:58
greghaynesSpamapS: It wont. but that can be fixed16:58
greghaynesSpamapS: but yes, I think we should do that16:58
SpamapSgreghaynes: also I just had a thought which is maybe we should make the erb+hiera the source of truth?16:58
greghaynesSpamapS: Also, that dir is a git repo - I just git commit whenever the inventory is at a state I think is useful16:59
*** derekh has quit IRC17:00
greghaynesSpamapS: hrm, unsure... im not too familiar with that17:00
SpamapSgreghaynes: well my thinking is that it allows us to maintain all but the passwords in a public DB17:01
greghaynesSpamapS: Yea, actually, definitely lets do that17:01
SpamapSgreghaynes: but at the same time.. I'm not sure the git review process is appropriate for maintaining a DB17:01
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Upgrade etherpad-dev to Ubuntu Trusty
*** armax has joined #openstack-infra17:02
SpamapSsince the DB needs to reflect reality as closely as possible to be useful.17:02
* SpamapS is just thinking out loud17:02
greghaynesSpamapS: I dont think we should be changing it much though?17:02
SpamapSgreghaynes: boxes will go down... and be replaced.17:02
*** afazekas has quit IRC17:02
SpamapSgreghaynes: and we won't be able to respond until we land the patch.17:03
SpamapSthat seems backwards.17:03
SpamapSin fact that makes me think the erb is backwards too.. and we should maintain it as a data source17:03
greghaynesSpamapS: I imagine itd be similar to the current infra workflow, you could do that, or you can do the ssh in, disable puppet, edit some things by hand17:03
openstackgerritTim Hinrichs proposed openstack-infra/project-config: Enable gating on tempest tests for Congress
greghaynesand land patch in parallel17:03
*** vahidh has joined #openstack-infra17:04
crinkleeverything we do goes through public review, this shouldn't be an exception17:04
*** cody-somerville has quit IRC17:04
*** tsekiyama has quit IRC17:04
SpamapSgreghaynes: true, I'm too inexperienced in how infra does things to speak to how wierd it would be.17:04
SpamapSor weird17:04
SpamapSOK, I'm convinced. :)17:04
greghaynesSpamapS: Yea, I don't think itd be especially wierd, infra is used to doing review as part of fixing things17:05
*** achanda has joined #openstack-infra17:05
SpamapSyeah, I actually love it. It just seems too good to be true. ;-)17:05
fungialso used to having some rather database-like things in our git repositories17:05
*** Kennan has joined #openstack-infra17:05
*** skylerberg has joined #openstack-infra17:06
*** jcoufal has quit IRC17:06
fungias long as they're editable text, wfm17:06
SpamapSeditable JSON + erb for passwords, with stable-sorted keys.17:06
SpamapSI did some tests and anything other than renaming a box produces useful diffs.17:07
SpamapSrenaming a box moves the whole record.17:07
*** kushal has quit IRC17:07
SpamapSbecause sorting. :-P17:07
*** markus_z has quit IRC17:08
*** mrmartin has joined #openstack-infra17:09
*** dahoo has joined #openstack-infra17:10
*** dahoo is now known as jerryz17:10
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Upgrade etherpad to Ubuntu Trusty
krotscheckIs there an openstack python api project template somewhere?17:11
*** dizquierdo has quit IRC17:12
*** dizquierdo has joined #openstack-infra17:12
fungikrotscheck: if you mean something more than openstack-dev/cookiecutter then not to my knowledge17:12
*** sergmelikyan has quit IRC17:13
*** dimtruck is now known as zz_dimtruck17:13
*** sergmelikyan has joined #openstack-infra17:13
fungikrotscheck: i don't know that there's much api server specific about it, but it's not specialized like the cookiecutter we have for oslo libs at least17:14
*** Kennan has quit IRC17:14
krotscheckfungi: No worries. I'm just curious whether there's a thing for python already. The JS world has a similar tool called yeoman that could perform this task, I just want to make sure that we don't duplicate work17:14
*** sergmelikyan has quit IRC17:15
krotschecki.e. tyring to figure out if I should do a cookiecutter thing or a yeoman thing for the JS CTI example.17:15
*** sergmelikyan has joined #openstack-infra17:15
*** ivar-la__ has joined #openstack-infra17:16
*** unicell has joined #openstack-infra17:16
clarkbjeblair: can you read my response to Clayton and make sure I am just not missing anything that was ocvered in person that I should be aware of?17:17
*** oomichi has quit IRC17:17
*** ivar-laz_ has quit IRC17:17
jeblairclarkb: ack17:18
sdakehey folks, I've noticed alot of merge conflicts on the kolla repo which I dont think are really merge conflicts17:19
sdakethe latest example is:
asselin_clarkb, can we get this merged?
sdakemy team is really starting to complain about it17:19
jeblairclarkb: have you sent it?17:19
*** zz_dimtruck is now known as dimtruck17:19
clarkbjeblair: yes17:20
clarkbjeblair: mailman may just be slow17:20
*** otter768 has joined #openstack-infra17:20
*** Kennan has joined #openstack-infra17:20
sdakeis jenkins doing something different with merging that results in merge conflicts when the existing files are not touched?17:20
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Bump oslo.db to 2.4.1 for backward compat fixes
clarkbasselin_: ya let me review it17:20
*** julim has joined #openstack-infra17:20
*** fdegir has quit IRC17:21
clarkbsdake: the bird comment sayin git can't be merged is gerrit saying that. Gerrit uses jgit to merge which is a bit more rudimentary than your C git client17:21
sdakeimo a merge conflict should not happen if the files in the patch only touch files not modified from last patchsets17:21
*** dolphm has left #openstack-infra17:21
clarkbsdake: then in the jobs we do our best mimic jgit behavior with C git17:21
jeblairclarkb: clayton is talking about their local testing (ie, he is a downstream nodepool user)17:21
clarkbjeblair: correct but he is saying lets make these change sto affect upstream tests17:21
clarkbjeblair: they want to take their downstream tests which already work and run them upstream17:22
clarkbjeblair: whihc they can do today17:22
jeblairclarkb: no, he wants to stop carrying patches17:22
jeblairto nodepool17:22
clarkbjeblair: also why can't they do it the same way we do it?17:22
sdakeclarkb ok i'll blame it on jgit then, thanks :)17:22
*** geoffarnold has joined #openstack-infra17:22
clarkbsdake: and in particular that is complaining about path conflicts, that change deletes some file sI bet another change merged that updated those files17:22
clarkbsdake: its jgits way of telling you that you should be careful and ACK it17:22
sdakeclarkb thanks - so likely to always happen with deletes - that is helpful17:23
*** doug-fish has quit IRC17:23
clarkbjeblair: ok "wanting to do the same thing as part of our multi-node integration test that we use as a gate for deployments" confused me17:23
clarkbjeblair: I will respond now that I read it better17:24
*** doug-fish has joined #openstack-infra17:24
jeblairclarkb: ah, yeah, i can see that.  we've been very successful at getting people to adopt our terminology, eh? :)17:24
*** Kennan has quit IRC17:24
*** otter768 has quit IRC17:24
jeblairclarkb: but yeah, i think he's just saying "for our downstream dev, we turn of port security, and we want to do the same thing for our downstream deployment testing"17:25
clarkbyup rerepsonded17:25
sdakeclarkb thanks for the help- got the folks calmed down a bit ;)17:26
jeblairclarkb: (i do think "hey, can you do the same thing we're doing upstream cause maybe we can join forces?" is a good question, though if the answer is "no because $goodreason", i think we probably still want to not get in the way of their being a nodepool user.17:26
*** signed8bit has joined #openstack-infra17:26
*** achanda has quit IRC17:27
*** oomichi has joined #openstack-infra17:28
clarkbjeblair: my concern with just making changes to nodepool is we alreay have a hard enough time testing them and making sure nodepool works. If we can accomplish the goal using softare that already exists and tested thats a big win17:29
*** mrmartin has quit IRC17:29
clarkbspeaking of time to go review that nodepool chnage for asselin_17:30
*** ihrachyshka has quit IRC17:31
clarkbasselin_: approved17:31
openstackgerritAlexander Tivelkov proposed openstack/requirements: Bump yaql to version 1.0
asselin_clarkb, thanks17:32
clarkbI had reviewed it previously just needed to catch up on it17:32
jeblairclarkb: yep; Clayton is expecting to write tests for this :)17:32
clarkband it makes the dsvm test pass again so yay17:32
asselin_clarkb, yeah! :)17:32
jeblairclarkb: i kind of like the 'extension point' approach actually17:32
jeblairshould be minimal code in nodepool itself17:33
clarkbjeblair: ya especially if its mor ethan just port security17:33
clarkbjeblair: though stevedore makes things slow whihc may impact the nodepool commands17:33
clarkbcan work through that17:33
*** amitgandhinz has joined #openstack-infra17:33
SpamapSgreghaynes: ok, so I'm wondering also if the 'gh' format needs to be evaluated against the ironic discovery project.17:34
clarkb(also people should totally test upstream)17:34
*** yamahata has quit IRC17:34
clarkb(we solve these problems for you :) )17:34
SpamapSgreghaynes: but that's something we can do later. :)17:34
*** smccully has joined #openstack-infra17:34
*** doug-fish has quit IRC17:35
*** doug-fish has joined #openstack-infra17:35
SpamapSgreghaynes: so, my current plan is to bring up a different box than the current bastion as baremetal00.. then if it looks good.. reclaim the bastion.17:36
*** ashleigh_ has joined #openstack-infra17:36
*** yamamoto has quit IRC17:36
SpamapSgreghaynes: I've backed up /home/shared except *.qcow2* and *.img17:36
SpamapSgreghaynes: anything else I should try to preserve from there?17:36
*** oomichi has quit IRC17:36
*** geoffarnold has quit IRC17:38
*** ashleighfarnham has quit IRC17:38
openstackgerritMerged openstack-infra/nodepool: Add support for project-name parameter
*** austin81 has quit IRC17:40
*** fdegir has joined #openstack-infra17:40
*** Kennan has joined #openstack-infra17:40
*** fdegir has quit IRC17:41
*** fdegir has joined #openstack-infra17:41
*** sergmelikyan has quit IRC17:41
*** salv-orlando has joined #openstack-infra17:42
*** nadya has joined #openstack-infra17:43
*** oomichi has joined #openstack-infra17:43
*** stevemar has quit IRC17:44
*** sergmelikyan has joined #openstack-infra17:44
mmmporki have a nodepool question, in the docs there's a statement that says all logging is to stdout by default17:44
mmmporki looked through the configs and stuff, and maybe i missed it, but is there anyway at the config level to specify an alternate logging output?17:45
mmmporkor do you just have to do it yourself when you run nodepoold17:45
clarkbmmmpork: you have to supply a python logging config file17:45
clarkbmmmpork: with that you can do all sorts of fun17:45
*** stevemar has joined #openstack-infra17:46
*** salv-orlando has quit IRC17:46
mmmporkah ok, where/how do you supply that info? again, sorry if this is obvious ;)17:46
*** krtaylor has joined #openstack-infra17:47
clarkbmmmpork: nodepoold -l17:47
*** nadya has quit IRC17:47
clarkbwhich takes a path to the file with the config17:47
mmmporkok cool. in the docs i'm editing, i wanted to add something to that statement about the logging to indicate how you should have it go anywhere else besides stdout ;)17:48
clarkbmmmpork: also greghaynes and I area at grendels hacking if yo uwant to sit and do this in person17:48
*** sridhar_ram has joined #openstack-infra17:48
mmmporki'm in seattle at openstack day!17:48
*** pradk has quit IRC17:48
*** bharath has joined #openstack-infra17:48
clarkbmmmpork: though we may relocate for noms soon17:48
clarkbah ok17:48
*** SumitNaiksatam has joined #openstack-infra17:48
mmmporki'm going to be at the lucky lab this evening though :)17:48
clarkbI will be at home by then ebabies17:48
mmmporkahh right :D17:49
mmmporkwell thanks for the invite :) definitely another time!17:49
*** prad_ has joined #openstack-infra17:49
mmmporkalso i've uploaded my wip review with the TODOs for the items i'm editing17:50
mmmpork"uploaded" posted.. whatever17:50
*** _kiran_ has quit IRC17:50
*** pelix has quit IRC17:50
fungisent, pushed, submitted... pick your verb17:51
fungiwe're easy here17:51
mmmporkha, well it's not officially submitted since it's wip, i just didn't want to lose my work in case my laptop craps on me17:51
mmmporker dies on me17:51
fungiwe all use gerrit as ephemeral storage for work in progress anyway. that's why we have a work in progress workflow vote17:52
mmmporkyeah i figured ;)17:52
pleia2yep, I do that all the time17:52
funginot only do i not keep half-finished local changes, i have a script i run regularly to delete all non-remote-tracking branches from my local repos17:53
mmmporkgit review garbage collecting :)17:53
*** ybathia has joined #openstack-infra17:53
fungihelps keep me in the habit of remembering to push my work to review.o.o, whatever state it's in17:53
fungiand to always retrieve my work from review.o.o when i resume, in case someone else has improved it for me in the interim17:54
mmmporkhaha.. you could tie it in to that service where if you don't do a thing it donates to a cause you don't want to donate to17:55
*** achanda has joined #openstack-infra17:55
clarkbmmmpork: how is openstack seattle? where are they hosting it?17:55
*** sinval has quit IRC17:55
mmmporkit's meh, mostly operators17:55
clarkbI have been to seattle once since  Imoved >_>17:55
*** sthillma has joined #openstack-infra17:56
*** tsekiyama has joined #openstack-infra17:56
mmmporki'm here for context and to meet morgan_2549 and see other openstack folks :)17:56
* morgan_2549 hides17:56
*** signed8bit is now known as signed8bit_ZZZzz17:56
* morgan_2549 crawls17:56
mmmporkclarkb i was in the same place... this is my first time back since i moved almost 4 years ago17:56
morgan_2549Back under a rock17:56
*** pc_m_ has quit IRC17:57
* mmmpork says in sauron voice " I SEE YOUUU "17:57
*** pc_m has joined #openstack-infra17:57
SpamapSmmmpork: you don't like operators? ;)17:57
mmmporki do :)17:57
*** sergmelikyan has quit IRC17:57
*** oomichi has quit IRC17:58
*** puranamr has quit IRC17:58
mmmporksorry, that might have come off odd!17:58
mmmporki just meant it's not much development level stuff, so for me it's meh :)17:58
*** pc_m has quit IRC17:58
fungithey're tasty with bbq sauce?17:58
*** puranamr has joined #openstack-infra17:59
clarkbfungi: not in the NW we don't do BBQ17:59
mmmporkwe do korean bbq17:59
mmmporkand hawaiian bbq17:59
clarkbup here they are tasty drenched in IPA17:59
fungiyou might make an exception for operators though17:59
*** pc_m has joined #openstack-infra17:59
openstackgerritSean M. Collins proposed openstack-infra/irc-meetings: FwaaS meeting: Add an APAC friendly time alternate
krotscheckclarkb: I beg to differ.17:59
clarkbmriedem: how are things doing e-r wise now? we should be fixed with the html thing18:00
*** gyee has joined #openstack-infra18:00
clarkbkrotscheck: I dunno I try BBQ here occasionally but always go back to just making it myself18:00
openstackgerritSean M. Collins proposed openstack-infra/irc-meetings: FwaaS meeting: Add an APAC friendly time alternate
mriedemclarkb: looks like indexing is getting caught up18:00
krotscheckclarkb: Most of what I see here is hawaiian inspired whole-animal roasts.18:00
mriedemi'll poke on some logstash queries in a bit18:00
*** gyee has quit IRC18:00
krotscheckAt least, that's the style of BBQ frequent here.18:00
timrcclarkb, I had some brisket at Tilt.  It was pretty good.18:00
timrcA lot better than I expected it to be.18:00
*** puranamr has quit IRC18:00
krotscheckThe "regional variant" as it were.18:00
clarkbtimrc: that was brave18:01
krotscheckPurists might scoff.18:01
krotscheckIn the meantime, I will eat.18:01
mmmporkthere's a really good place in SODO18:01
clarkbkrotscheck: kahlua pork is good18:01
mmmporka couple of really good places in SODO actually18:01
*** hyakuhei has quit IRC18:01
* mmmpork knows her pork ;D18:01
timrcclarkb, Well here in Austin... now that it's mostly Californians we have more terrible BBQ than good BBQ :)18:01
jesusaurusyeah, willie's taste of soul in sodo is amazing18:02
krotscheckOn a work related note, I need a +2 to get a matching set with ajaeger's :)
timrcclarkb, Franklin will probably be pretty crazy during the next Summit in Austin, but if we can, we should go.18:02
* krotscheck fully acknowledges that BBQ Trumps WOrk18:02
*** gyee has joined #openstack-infra18:03
krotschecktimrc: Stay a date late/show a day early18:03
timrckrotscheck, There will be a line regardless, only the POTUS had the power to cut in line... so you do need to block off at least a couple hours.  Sort of stupid to wait in line that long with no guarantee of food, until you actually get it :)18:04
openstackgerritStan Lagun proposed openstack/requirements: Bump yaql to version 1.0
*** prad_ is now known as pradk18:04
*** dizquierdo has quit IRC18:04
*** signed8bit_ZZZzz is now known as signed8bit18:06
*** tiswanso has quit IRC18:06
*** puranamr has joined #openstack-infra18:06
*** bdemers has quit IRC18:07
clarkbtimrc: I bet the waiting is less than doing it yourself18:08
openstackgerritMerged openstack-infra/system-config: Add documentation on scripting mailman actions
*** nadya has joined #openstack-infra18:08
timrcclarkb, True.18:08
clarkbtimrc: but I can do other things like brew beer or drink or play video games when I do it myself so thats not a clear win18:09
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/system-config: Add bifrost inventory management procedures
timrcclarkb, Indeed.  Do you cheat with a bbq guru? Makes it even easier to go off and do those things... my green egg does not stabilize well below 225... but not nearly as bad as a traditional smoker.18:10
timrcI'm thinking about getting one of those gurus to adjust air flow and control temperature in the dome.18:10
clarkbtimrc: I have a smokey mountain now, it sits at about 210 for 8 hours without messing wit hit18:10
timrcclarkb, Wow nice.18:10
*** pc_m has quit IRC18:10
clarkbgranted that was done on a warm day18:10
timrcclarkb, Does it have an oblong shape?18:10
clarkbmay be harder as the weather cools18:10
clarkbya its like a green egg18:10
*** yfried|afk has joined #openstack-infra18:11
timrcI sort of thing the circular design of a green egg is not efficient for brisket and ribs like the Primo.18:11
*** pc_m has joined #openstack-infra18:11
*** bapalm has quit IRC18:11
timrcspace-efficient that is.18:11
*** tiswanso has joined #openstack-infra18:11
*** bdemers has joined #openstack-infra18:11
clarkbits not, I can do about 4 briskets on mine if necessary but with the price of brisket that hasn't happened yet18:11
clarkbwe pay almost $6/lb up here its sad18:11
*** minwang2 has quit IRC18:12
timrcclarkb, Yikes.18:12
mmmporki've been wanting to try this -
openstackgerritDouglas Mendizábal proposed openstack-infra/project-config: Update python-barbicanclient acls
clarkbtimrc: granted thats localy grown usda choice blah blah so not like I was looking for cheapest cow18:12
mmmporka stove top smoker, seems good for small spaces as long as you can open a window18:12
*** arxcruz has joined #openstack-infra18:14
*** bapalm has joined #openstack-infra18:14
timrcclarkb, I think I pay about $5/lb.  I have neighbors that buy whole cows together and split 'em up.  Whenever that happens we usually have a party.  Lot's of people in the hood are BBQ enthusiasts.18:14
*** angdraug has quit IRC18:14
clarkbmmmpork: also if your landlord doesn't mind the house perpetually smelling of brisket18:14
mmmporkhey you know, some people like potpurri and those little plug ins that take the cartridges...18:15
mmmporki like my house to smell like brisket!18:15
*** chen12 has quit IRC18:16
*** chen12 has joined #openstack-infra18:16
*** mrunge has quit IRC18:16
*** mrunge has joined #openstack-infra18:17
*** armax has quit IRC18:18
timrcmmmpork, maybe it's time to /nick mmmbrisket?18:18
clarkbok back to work :) that should if all goe swell build a dib image and boot it against devstack18:19
clarkbwhich we can then use to test greghaynes gearman image builder uploaders with18:19
*** ayoung has quit IRC18:23
*** sthillma_ has joined #openstack-infra18:23
*** sabeen3 has left #openstack-infra18:24
*** sabeen1 has joined #openstack-infra18:24
*** achanda has quit IRC18:24
*** oomichi has joined #openstack-infra18:25
*** sthillma has quit IRC18:25
SpamapSgreghaynes: FYI, old bastion moved to
openstackgerritTim Hinrichs proposed openstack-infra/project-config: Enable gating on tempest tests for Congress
greghaynesSpamapS: ok18:25
openstackgerritgreghaynes proposed openstack-infra/nodepool: Add dib deletion test
greghaynesclarkb: ^18:26
*** sthillma has joined #openstack-infra18:26
*** pc_m has quit IRC18:27
*** fawadk has quit IRC18:27
*** signed8bit is now known as signed8bit_ZZZzz18:27
*** pc_m has joined #openstack-infra18:27
*** signed8bit_ZZZzz is now known as signed8bit18:28
*** sthillma_ has quit IRC18:28
annegentlecan anyone debug to see why two posts are showing up with September 2015 dates? I'm looking at it from a post side (for rackspace blog, the 2nd one) but wondered if anyone knows the engine well.18:28
*** geoffarnold has joined #openstack-infra18:28
*** tonytan4ever has quit IRC18:29
fungiannegentle: that usually happens when someone modifies a post and the url changes18:29
fungifor example, adjusting the title18:29
annegentlefungi: yeah, for the rackspace one it seems like it's a content problem, and I can fix that.18:29
fungiusually i can just delete the extra and reindex it18:30
*** tiswanso has quit IRC18:32
*** kiran-r has joined #openstack-infra18:33
*** sergmelikyan has joined #openstack-infra18:34
*** pc_m_ has joined #openstack-infra18:34
*** Sukhdev has joined #openstack-infra18:34
fungihaving trouble tracking down the cached copy of that aptira one18:35
fungiaha, found. for some reason it was titleless18:36
*** hyakuhei has joined #openstack-infra18:36
fungiaccording to my command history, i often have to remove posts from the aptira blog18:37
*** yamamoto has joined #openstack-infra18:37
* SpamapS just remembered he was going to try and boot a GPT-only image w/ ironic18:38
*** pc_m has quit IRC18:38
*** davideagnello has quit IRC18:38
*** austin81 has joined #openstack-infra18:38
*** davideagnello has joined #openstack-infra18:39
*** angdraug has joined #openstack-infra18:39
*** signed8bit is now known as signed8bit_ZZZzz18:39
*** hyakuhei has quit IRC18:39
*** signed8bit_ZZZzz is now known as signed8bit18:41
*** abdelwas_ has joined #openstack-infra18:41
*** yamamoto has quit IRC18:42
*** lucasagomes is now known as lucas-dinner18:43
fungiannegentle: look better now?18:44
*** dannywilson has quit IRC18:44
annegentleyeah fungi -- what did you do on your side? I fixed the one post I could fix.18:44
fungiannegentle: i deleted the cached copies for the articles which claimed to be from september and then reindexed it18:45
annegentlefungi: nice thanks18:45
fungithough i see that the aptira blog still has that post claiming to be from next month. it may pop back in again18:45
funginot sure who to contact for these things18:45
*** dannywilson has joined #openstack-infra18:46
*** davidlenwell has quit IRC18:50
*** davideag_ has joined #openstack-infra18:50
*** davidlenwell has joined #openstack-infra18:51
*** davideagnello has quit IRC18:52
*** kiran-r has quit IRC18:53
*** oomichi has quit IRC18:53
*** thiagop is now known as thiagop_afk18:54
*** afazekas has joined #openstack-infra18:55
pleia2woo, no more meetings/calls this week \o/18:57
pleia2(not an invitation)18:58
*** ociuhandu has quit IRC18:58
*** davidlenwell has quit IRC18:58
*** puranamr has quit IRC18:58
*** davidlenwell has joined #openstack-infra18:59
*** geoffarnold has quit IRC19:00
*** flepied has joined #openstack-infra19:00
regXboiis there a tempest knowledgeable entity around?19:01
fungiregXboi: more likely in #openstack-qa but what's the q?19:01
regXboifungi: I'll head over there - a commit has removed tempest.conf.sample and broken devstack19:02
*** afazekas has quit IRC19:03
fungiahh, yep. the devstack-knowledgeable folk also aggregate there, so better venue all around19:03
regXboifungi: ok - hopefully this gets sorted out before it starts impacting infra19:03
*** dannywilson has quit IRC19:04
fungiregXboi: well, if that change merged successfully then it's possible it won't impact our ci, since tempest changes are tested with devstack19:04
regXboifungi: yeah I hoping that is the case19:05
*** dannywilson has joined #openstack-infra19:05
* regXboi just updated his devstack repo and is trying over :)19:05
*** tiswanso has joined #openstack-infra19:07
*** achanda has joined #openstack-infra19:08
*** dkranz has quit IRC19:09
*** dannywilson has quit IRC19:10
*** dannywilson has joined #openstack-infra19:10
mordredSpamapS: gpt?19:13
*** sergmelikyan has quit IRC19:13
*** sergmelikyan has joined #openstack-infra19:15
*** btully has quit IRC19:16
openstackgerritK Jonathan Harker proposed openstack-infra/zuul: Add option to ignore ref-updated events emitted by branch deletions
*** pal has joined #openstack-infra19:19
*** oomichi has joined #openstack-infra19:21
*** pc_m_ has quit IRC19:21
*** sergmelikyan has quit IRC19:22
*** bdemers has quit IRC19:23
*** zul has quit IRC19:23
*** tiswanso has quit IRC19:23
*** sergmelikyan has joined #openstack-infra19:24
*** dims_ has joined #openstack-infra19:26
*** sergmelikyan has quit IRC19:27
*** ivar-lazzaro has joined #openstack-infra19:27
*** sergmelikyan has joined #openstack-infra19:27
*** hdd has joined #openstack-infra19:27
*** bdemers has joined #openstack-infra19:27
*** signed8bit is now known as signed8bit_ZZZzz19:27
*** woodster_ has quit IRC19:27
*** ttx has quit IRC19:27
*** GheRivero has quit IRC19:27
*** jamielennox|away has quit IRC19:27
*** GheRivero has joined #openstack-infra19:27
*** signed8bit_ZZZzz is now known as signed8bit19:28
*** dims has quit IRC19:28
*** DuncanT has quit IRC19:28
*** adam_g has quit IRC19:28
*** electrical has quit IRC19:28
*** oomichi has quit IRC19:28
*** davidlenwell has quit IRC19:28
*** ivar-la__ has quit IRC19:28
*** r-daneel has quit IRC19:28
*** otherwiseguy has quit IRC19:28
*** dguitarbite has quit IRC19:28
*** asahlin has quit IRC19:28
*** isviridov_away has quit IRC19:28
*** serverascode has quit IRC19:28
*** ryanpetrello has quit IRC19:28
*** tiswanso has joined #openstack-infra19:28
*** asahlin has joined #openstack-infra19:30
*** pal has quit IRC19:30
*** davidlenwell has joined #openstack-infra19:31
*** woodster_ has joined #openstack-infra19:31
*** btully has joined #openstack-infra19:31
*** DuncanT has joined #openstack-infra19:31
*** serverascode has joined #openstack-infra19:32
*** rm_work is now known as rm_work|away19:32
*** ayoung has joined #openstack-infra19:32
*** signed8bit is now known as signed8bit_ZZZzz19:32
*** ttx has joined #openstack-infra19:33
*** achanda has quit IRC19:34
*** isviridov_away has joined #openstack-infra19:34
*** electrical has joined #openstack-infra19:34
*** Ng has quit IRC19:34
*** flepied has quit IRC19:34
*** adam_g has joined #openstack-infra19:36
*** adam_g has quit IRC19:36
*** adam_g has joined #openstack-infra19:36
*** ryanpetrello has joined #openstack-infra19:36
*** Ng has joined #openstack-infra19:36
*** signed8bit_ZZZzz is now known as signed8bit19:36
*** alexsyip has joined #openstack-infra19:36
*** mmmpork has quit IRC19:36
SpamapSmordred: the special partition table that lets grub read > 1TB root filesystems.19:36
*** jtrovo has joined #openstack-infra19:37
jeblairoh look, i'm connected via my new dsl service!19:37
jeblairthe bad news is that 1 of the 2 lines is down19:38
pleia2woo, halfway there19:38
fungiso it's not ethernet, just eithernet19:38
jeblairthe good news is that the single line that is working appears to carry as much traffic as my current service19:38
*** puranamr has joined #openstack-infra19:38
*** ams__ has quit IRC19:39
*** ivar-lazzaro has quit IRC19:39
jeblairso i might actually end up with decent speeds, if the telco can find another working pair :)19:39
*** darrenc has quit IRC19:39
*** vern has quit IRC19:39
SpamapSAT&T has been dragging their feet bringing U-Verse to the neighborhood here19:40
SpamapSso TWC is the only game in town > 2Mbit19:40
SpamapSexcept 4G19:40
*** vern has joined #openstack-infra19:40
*** darrenc has joined #openstack-infra19:40
*** dguitarbite has joined #openstack-infra19:41
*** salv-orlando has joined #openstack-infra19:41
*** mrunge has quit IRC19:41
jeblairSpamapS: i use, which is a clec out of santa rosa using att's wires, but also is stringing their own fiber.  they're highly clueful (you can call up tech support and talk dsl tuning parameters with them.  apparently they have done some expanding into the la region.19:42
*** sergmelikyan has quit IRC19:42
jeblairthey have not installed any fiber around here yet, so i'm still on bonded dsl19:43
jeblairalso, they have bonded dsl :)19:43
*** r-daneel has joined #openstack-infra19:44
*** sergmelikyan has joined #openstack-infra19:44
*** j^2 has quit IRC19:45
*** mmmpork has joined #openstack-infra19:45
*** otherwiseguy has joined #openstack-infra19:45
SpamapSOur version of that is DSL Extreme19:45
*** j^2 has joined #openstack-infra19:46
SpamapSAnd they can get me 4Mbit, but not at any decent price.19:46
SpamapSTWC is actually really good.. and I don't know how I could live w/o 30Mbit anymore. ;)19:46
*** esker has joined #openstack-infra19:46
*** flepied has joined #openstack-infra19:47
*** pvaneck has quit IRC19:47
*** armax has joined #openstack-infra19:47
*** esker has quit IRC19:47
*** FallenPegasus has joined #openstack-infra19:47
*** jamielennox|away has joined #openstack-infra19:47
*** sergmelikyan has quit IRC19:47
*** esker has joined #openstack-infra19:47
*** jamielennox|away is now known as jamielennox19:47
fungithe only option out here is between a wired provider who can't tell their anterior from their posterior, and wireless19:48
openstackgerritAndreas Jaeger proposed openstack/requirements: Revert "Drop PuLP from g-r"
*** flepied1 has joined #openstack-infra19:49
*** glauco__ has joined #openstack-infra19:50
*** glauco has quit IRC19:50
openstackgerritTimothy R. Chavez proposed openstack-infra/gearman-plugin: Send node label with data status packet
*** ryanpetrello has quit IRC19:52
*** sergmelikyan has joined #openstack-infra19:53
*** flepied has quit IRC19:53
*** resker has joined #openstack-infra19:53
*** ajmiller has quit IRC19:53
*** glauco__ has quit IRC19:54
*** ryanpetrello has joined #openstack-infra19:55
*** glauco has joined #openstack-infra19:56
*** resker has quit IRC19:56
*** doug-fis_ has joined #openstack-infra19:56
*** resker has joined #openstack-infra19:57
*** esker has quit IRC19:57
*** sergmelikyan has quit IRC19:58
*** sergmelikyan has joined #openstack-infra19:59
*** doug-fish has quit IRC19:59
*** doug-fish has joined #openstack-infra20:00
*** puranamr has quit IRC20:00
*** doug-fis_ has quit IRC20:01
austin81Hi all, timothyb89 and I are trying to get some visualization software pushed upstream for devstack-tempest runs. We think this tool will have a wide variety of uses across OS and would love any and all feedback/criticism/hatemail. The project is still in its infancy, but we would like to know if we are on the right track with functionality/scope. Thanks! Links to follow20:02
austin81Git: POC devstack-gate patch:
austin81Server-side demo:
austin81^ link to an upstream view we are working on. The individual run views in the static site will be utilized in helping analyze aggregate test results from subunit2sql DB20:03
*** erikwilson has joined #openstack-infra20:03
fungiaustin81: timothyb89: neato. are you using the current public subunit2sql query account?20:04
*** annegentle has quit IRC20:04
*** resker has quit IRC20:04
austin81fungi: yep! creds hardcoded into the project and all20:04
*** annegentle has joined #openstack-infra20:04
timothyb89Also, the parent patch of that link:
*** glauco has quit IRC20:05
fungiaustin81: timothyb89: i'm trying to query a nova change of mine but not seeing any stats. how recent is the data there?20:07
*** sridhar_ram1 has joined #openstack-infra20:07
*** sridhar_ram has quit IRC20:08
austin81subunit2sql should be updated continuously, but only has merged changes. The plan is to add a view for gerrit api calls as well so un-merged changes can be queried as well20:08
fungioh, got it20:08
fungiyeah, i was querying an open change. i'll test with merged ones20:08
*** cdent has quit IRC20:09
*** sridhar_ram1 is now known as sridhar_ram20:09
*** sputnik13 has joined #openstack-infra20:09
clarkbI'm on a phone so maybe this is expected but when looking at resource usage it tells me nothing about what is happening at the time eg what tests20:09
clarkbI think without that it will be hard to fix performance problems20:10
fungiclarkb: on the timeline view?>20:10
fungii get details when i hover20:10
clarkbI see cpu net disk ram which is great but what is hapoebing20:10
clarkbah ok so likely a phone issue then20:10
timothyb89clarkb: that shows on mouse hover, though it should also work on mobile ... if not that should be fixed :)20:11
sdakewould someone who knows mind sharing with me how tripleo tests multinode deployment - i.e. IIUC tripleo has their own gating hardware inside RHT that is integrated with the infra gate20:11
fungithe info box fills up with name, class, module, status, tags and duration details20:11
fungisdake: they have a bastion model with a fixed number of bastions (and associated precreated networks) which act as jenkins slaves20:12
fungisdake: at least that was the model last i saw details. no idea how much of that may have changed since20:12
clarkbnote if tyou dont need baremetal that setup is a bit overkill20:13
*** puranamr has joined #openstack-infra20:13
sdakefungi typing define bastion into google doesn't seem to help :)20:13
clarkbfungi thats it excspt we boot the bastions dynamically via nova20:13
sdakeclarkb i'd be satisified with vms20:13
sdakebut we only get 1 vm20:13
sdakewith 8gb ram20:13
clarkbsdake you can gave 2...20:13
*** achanda has joined #openstack-infra20:13
timothyb89clarkb: not super obvious, but tapping onanywhere on the upper view will show the current timestamp, and tapping any test box will show details in the info box down below20:13
* clarkb should write an enail to the dev list "we have multinode testing kthxbai"20:13
sdakeclarkb that would be fantastic ;)20:14
sdakeclarkb I dont think anyone really knows that20:14
fungisdake: a bastion is a "stronghold" but in computer systems administration terms it's a (usually somewhat locked-down/secured/audited) system which you use as the only means of connecting to other systems20:14
clarkbsdake it runs on everg nova patch its out there20:14
clarkbnova neutron devstack etc20:14
sdakeclarkb i'll check out project-config for nova thanks20:14
sdakeis there an upper limit on vms?20:15
clarkbright now its 220:15
clarkbnone of the tests work reliably with that number so Inhavent worked to increase it20:15
fungisdake: our current multinode solution is not variable-node, it's a fixed node count per type20:15
sdakeany chance we can get an override?20:15
clarkbneed working cloyds at 2 first20:15
clarkbsdake if you can make nova and neutron work with two nodes first :)20:15
sdakeclarkb agree we can focus on two node deploy functioanl tests20:15
sdakei dont know if i can make nova and neutron gates work - that code is so way over my head ;)20:16
clarkbsdake you software depends on it20:16
sdakei spent 7 days learning how ips are assigned in nova - mindblowing20:16
clarkbso whether or not you can do it it is a prerequisite20:16
sdakenova wfm in 3 node setup along with neutron with kolla on bare metal20:16
sdakebut this is using ansible to deploy the thing :)20:17
clarkbthe deploymebt doesnt matter20:17
fungisdake: you'll appreciate the devstack-gate implementation. it uses ansible to run on the subnodes20:17
clarkbnetworking is broken with nova net and neutron in subtle ways that makes the fail rate higher on two nodes20:17
clarkbip assignment is part of the problem ;)20:18
clarkbthere appears to be a race between booting a node and telling dnsmasq what ip to give it20:18
clarkbthen your nova boot fails20:18
sdakeya that ip assignment code is squirly20:18
clarkbthats one of the issues at least20:18
sdakeit literally gets set in over 50 places20:18
*** sthillma has quit IRC20:18
*** achanda has quit IRC20:19
sdakeok so lets assume I get deployment working with 2 vms20:19
openstackgerritTimothy R. Chavez proposed openstack-infra/gearman-plugin: Send node label with data status packet
*** glauco has joined #openstack-infra20:19
sdakecould we get more vms after?20:19
clarkbsdake it us technically possible yes20:19
fungithe current model scales to an arbitrary number of nodes, but we have to set the node count for a given multinode label20:20
clarkbnodepool can do up to N node clusters where N is max VMs as set by min(provider quotas) also ^20:20
*** sergmelikyan has quit IRC20:21
*** ams__ has joined #openstack-infra20:21
*** glauco has quit IRC20:21
fungiso you would, for example, use a 5-node worker for a particular job, not define the number of subnodes within the job20:21
sdakewould N=5 be out of the question?20:21
clarkbsdake judgibg how 2 nodes is going, yes I just dont see anyone getting it reliable20:22
clarkbmaybe we try it for lols but there isnt enough effort behind this to get that big a cloud working any time soon20:22
sdakeclarkb keep in mind I want to test deployment not if the deployment works20:22
sdakethat testing if the deployment works is phase 3 ;)20:22
clarkbyou dont need 5 nodes for that20:22
sdake3 control 1 compute 1 network node20:23
sdakeand possibly a storage node as well20:23
clarkbwhy couldnt you all in one if ansible returning 0 is the goal?20:23
sdakebecause multinode deployment an all in one are subtly different - they use different inventory files20:23
clarkb(I love that ansible has sane return codes btw)20:24
sdakeyar ansible rocks20:24
sdakeonly 50 hours of experience and already productive with it20:24
fungi(also not implemented in ruby!)20:24
sdakezomg ruby DIAF20:24
* fungi feels like a language snob for saying that, but whatever20:24
clarkbsdake I guess determining if controller deploys and determining if compute deploy etc are one node things to me20:25
*** glauco has joined #openstack-infra20:25
sdakefungi its ok everyone that understands computer science things ruby is evil :)20:25
clarkband until you have tests of the deployment you dont need all 5 togetger20:25
sdakeagree our first step is an all in one gate20:25
*** rossella_s has quit IRC20:25
sdakejust thinking ahead20:25
*** rossella_s has joined #openstack-infra20:25
*** glauco has quit IRC20:26
sdakegetting an aio gate to run will be a big challenge20:26
greghaynesclarkb: for some reason our nodepool delete snap_image sets the snap_image.state = DELETE then a few lines below deletes the snap_image...20:26
clarkbalso I should note I am probably over skeptical because everyone said we needed multinode testing then we finally add it and now no one is actually inyerested in fixing bugs20:26
openstackgerritgreghaynes proposed openstack-infra/nodepool: Add dib deletion test
clarkbso very much want to encourage starting small and making incremental steps to where people are confortable rather than spending effort jumping way beyond that immediatwly20:26
sdakeclarkb most people that understand a project (like nova) and project-config to any degree are drinking from a firehose atm :)20:26
*** BharatK has quit IRC20:27
sdakeclarkb i totally agree with incremental20:27
clarkbsdake that doesnt invalidate my concerb20:27
fungi1. "we should test with multiple nodes!" 2. "look we have multiple nodes..." 3. "our software is so broken with multiple nodes :/"20:27
sdakeclarkb ya just an observation on why its not being done :)20:27
sdakefrom personal experience20:27
clarkbgreghaynes because sometimes openstack doesnt actually delete20:27
fungifirehose tastes goooood20:27
clarkbgreghaynes so if the first delete fails the periodic cleanup "cron" will try try again20:28
sdakeclarkb i do want to get to a basic dead chicken test with AIO gating as well20:28
*** warpc__ has quit IRC20:28
sdakeso its not just testing deployment, but that is where i'm going to start (small)20:28
*** skylerberg has left #openstack-infra20:29
sdakeultimately i want an AIO deploy that nova boots and tests vm is in active state, and verifies vm obtains dhcp20:29
greghaynesclarkb: 'doesnt actually delete' seems suspicious, I think its just happening not instantly20:29
sdakebut from there i want to go multinode20:30
sdakeso it sounds like we can go multinode - so thanks for the info :)20:30
clarkbI would do all in one tgen two node with controller + compute and go from thetr20:30
clarkbgrrghayjes nope sometimes nova returns 200 but doesnt do the action20:31
*** e0ne has joined #openstack-infra20:31
sdakesounds good clarkb20:31
greghaynesclarkb: that was an impressive name typo20:31
clarkbgreghaynes so you leak otherwise20:31
sdakeso 1 node, 2 nodes, then we can beg for more vms once our gate jobs are stable ;)20:31
greghaynesclarkb: oh, im talking about much more simple20:31
greghaynesclarkb: just the nodedb models20:31
sdakeatm our image building job isn't even stable20:31
* sdake sadfaces20:31
clarkbsdake ya :) and I bet you we learn a lot just starting there20:31
*** achanda has joined #openstack-infra20:32
sdakeclarkb samyaple wants to do docker in docker testing on 1 vm to look like multiple host oses, but I don't think it will techncally work correctly because of libvirt interactions with systemd20:33
sdakeplus the fact that /run is host bindmounted :(20:33
openstackgerritMichael Krotscheck proposed openstack/requirements: Updated oslo middleware to 2.6.1
krotscheckdum dee dum20:34
*** Sukhdev has quit IRC20:34
*** glauco has joined #openstack-infra20:35
dims_krotscheck: you may want to rebase that on top of
*** glauco has quit IRC20:35
mriedemclarkb: we seem to have lost logstash again20:37
openstackgerritMichael Krotscheck proposed openstack/requirements: Updated oslo middleware to 2.6.1
krotscheckdims_: Done20:37
*** signed8bit is now known as signed8bit_ZZZzz20:37
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for neutron bug 1485969
openstackbug 1485969 in neutron "test_dualnet_multi_prefix_dhcpv6_stateless failed due to "RuntimeError: Set changed size during iteration" in quota code" [Undecided,In progress] - Assigned to Ihar Hrachyshka (ihar-hrachyshka)20:38
*** zul has joined #openstack-infra20:39
*** sergmelikyan has joined #openstack-infra20:39
*** glauco has joined #openstack-infra20:40
*** kzaitsev_mb has joined #openstack-infra20:40
*** glauco has quit IRC20:41
*** signed8bit_ZZZzz is now known as signed8bit20:41
*** boris-42 has joined #openstack-infra20:41
clarkbmriedem can you expand on that?20:42
clarkbwe indexibg html? or?20:42
*** jtomasek has quit IRC20:42
mriedemi had a query that worked awhile back, then hit refresh and now getting an error on kibana20:42
SwansonIf zuul is no longer showing my queues what have I screwed up?  Jenkins is running.  Gearman is supposedly running.20:43
*** glauco_ has joined #openstack-infra20:44
*** FallenPegasus has quit IRC20:44
*** glauco_ has quit IRC20:45
vipulinfra runs a pypi mirror right?  Is there generally a delay in the sync to upstream pypi?20:46
*** glauco has joined #openstack-infra20:46
fungiSwanson: what do you mean "showing"? (status.json, logs...)20:47
fungivipul: under normal circumstances, 5 minutes20:47
*** glauco has quit IRC20:47
fungirather, up to 5 minutes20:47
*** geoffarnold has joined #openstack-infra20:47
*** puranamr has quit IRC20:47
vipulfungi: ok i'll try to recheck.. maybe just a timing thing20:48
fungibut sometimes there are issues with the mirroring software (bandersnatch), or with pypi's event serialization, or with the fastly cdn in front of (negatively-)caching things it shouldn't20:48
fungivipul: have an example? i can check20:48
vipulthis run should have used oslo.db 2.4.120:48
Swansonfungi: Oh, hey.  If I wait long enough I get a status.json: Proxy Error.  I should have three (sample) headers at the top.  check, silent and something else.  I get nothing.  Doesn't even show the last time it was updated anymore.20:49
Swansonfungi: Not sure what changed to break it.20:49
fungiSwanson: sounds like the zuul daemon isn't running20:49
fungior is hung somehow20:49
vipulwhich tox was actually able to donwload, since unit tests to this patch passed20:49
*** armax has quit IRC20:49
vipulfungi: but dsvm-gate still continues to fetch older version20:49
*** bswartz has quit IRC20:50
Swansonfungi: I agree.  server zuul status shows it is running.  /var/run/zuul shows no pid.20:50
*** nadya has quit IRC20:50
*** smoser has quit IRC20:50
fungivipul: the job is using our upper constraints file
*** glauco has joined #openstack-infra20:50
vipulwe should update that20:51
fungivipul: the point of that mechanism is to keep us from using new releases of libraries until we've run some integration tests to determine whether increasing the constraint pin will break20:51
*** glauco has quit IRC20:51
*** hodos has quit IRC20:51
clarkbmriedem: I will know more as soon as firefox determines it is no longer on vacation20:52
vipulOk makes sense.. there were a couple of bugs that broke Cue and i believe Magnum in 2.4.020:52
vipulwhich is why 2.4.1 came out quickly20:52
*** geoffarnold has quit IRC20:52
fungivipul: a change is proposed automatically to bump it each day, but a manual change to it can be proposed if needed20:52
clarkband it can only merge if it actually works20:53
vipulfungi: i shall submit a patch then20:53
clarkbso its also possible that there is a backup behind a broken dep and that would be a case where a manual patch may help20:53
fungivipul: today's change seems to want to increase cffi, nose-exclude and pysqlite, one of which is breaking the integration tests which ran against it
clarkbmriedem: I think its an issue of the search span20:54
clarkbmriedem: it comes back fine with a shorter search term, likely the older indexes are poluted with so much html crap that we are not very performant searching them20:55
*** regXboi has quit IRC20:55
fungivipul: looks like dims has already proposed
vipulfungi: was about to paste the same link20:55
vipulcan that be merged to unblock us?20:55
fungivipul: if you can find a second +2 for it20:56
clarkbfungi: updates to upper constraints rae single +2 you can approve20:56
clarkboh except global reqs is changed20:56
clarkbya you need second +2 for that20:56
clarkbgive me a moment20:56
vipulclarkb: you can do it!20:57
*** alivigni has quit IRC20:57
*** achanda has quit IRC20:57
*** achanda_ has joined #openstack-infra20:57
clarkbfungi: now we wait and see how long it takes us to make upper constraints work again20:58
*** e0ne has quit IRC20:58
clarkb(this ws my biggest concern with the system, what is time to fixing of broken)20:58
clarkbgreghaynes: that made a dib image \o/ but we didn't have a ready node off of it yet I bet the timeout is too short after the 9 minute build20:59
fungiclarkb: yeah, it's a pretty effective mechanism to avoid breaking us. however unless someone digs into the failures, we'll just forever be constraining to older than available versions of all our deps20:59
clarkbgreghaynes: reading logs now to see20:59
fungiand the incentive to look into it is much less since it's no longer preventing anyone from getting other work done instead20:59
clarkbfungi: yup and potentially vulnerable to security bugs and other bugs too20:59
openstackgerritgreghaynes proposed openstack-infra/nodepool: Add dib deletion test
vipulshouldn't the automated patch do one dependency at a time?20:59
*** glauco has joined #openstack-infra20:59
vipuli bet only one of those 3 propsed changes are actually breaking things21:00
fungivipul: possible enhancement, but for now it's semi-trivial to bisect the list21:00
*** dannywil_ has joined #openstack-infra21:00
*** geoffarnold has joined #openstack-infra21:00
clarkbthe problem with one per patch is what order do you use?21:01
clarkbit doesn't really fix the issue of blocking all the things21:01
mriedemclarkb: ah yeah, 24h back works for me in kibana21:01
fungii'll propose three changes now and see which ones go asplodey21:01
*** sthillma has joined #openstack-infra21:01
*** ivar-lazzaro has joined #openstack-infra21:02
openstackgerritJeremy Stanley proposed openstack/requirements: Test increasing cffi constraint
clarkbshould we take bets?21:03
*** dannywilson has quit IRC21:03
clarkbmy money is on ^21:03
fungiyeah, also why i pushed it first21:03
*** sthillma has quit IRC21:04
openstackgerritJeremy Stanley proposed openstack/requirements: Test increasing nose-exclude constraint
*** sthillma has joined #openstack-infra21:04
openstackgerritJeremy Stanley proposed openstack/requirements: Test increasing pysqlite constraint
*** FallenPegasus has joined #openstack-infra21:05
*** tiswanso has quit IRC21:05
*** aysyd has quit IRC21:06
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack
fungiit almost insta-failed, so we should have an answer pretty quickly21:07
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test dib image builds with devstack too.
clarkbgreghaynes: ^ almost there I think needed to make the /etc/nodepool dir in addition to installing sshd21:08
*** gondoi is now known as zz_gondoi21:10
*** yamahata has joined #openstack-infra21:10
*** regXboi has joined #openstack-infra21:11
greghaynesI like how this incorporates 3 different package specification systems21:12
openstackgerritSpencer Krum proposed openstack-infra/puppet-accessbot: Basic acceptance tests
greghaynesdevstack, dib's package-installs, and we could put a bindep file in there21:12
*** rm_work|away is now known as rm_work21:13
fungigreghaynes: once bindep is more ubiquitous, i want to work on switching devstack's package lists over to using it21:13
*** austin81 has left #openstack-infra21:13
*** ldnunes has quit IRC21:13
clarkbgreghaynes: why do something only one way when you can do it all the ways!21:14
greghaynesThatd be awesome21:14
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image delete using gearman
clarkbgreghaynes: if I can get that working I will update the job to run a script out of nodepool itself for the test then we can make it do more specific checks rather than grep something exists21:15
pabelangerclarkb: do you know of any jobs that are using ansible today to do loop back ssh?  First try into the gate rejected the connection because fatal: [localhost] => SSH Error: Permission denied (publickey).21:15
greghaynesnice, made a test for ^, verified it was broken in test, and now it passes21:15
*** hdd has quit IRC21:15
fungiclarkb: oho! i see the problem. cffi 1.2.0 apparently existed very briefly, then got replaced by 1.2.0-1 and 1.2.121:16
*** sergmelikyan has quit IRC21:16
*** dprince has quit IRC21:16
clarkbpabelanger: all devstack-gate runs use the local connection ansible setting21:16
clarkbfungi: nice21:16
pabelangerclarkb: thanks21:16
fungiclarkb: 1.2.0 was deleted or never sync'd21:16
fungii'll know from the bandersnatch logs in a bit21:16
clarkbpabelanger: for actual ssh to localhost thats how the puppet beakre jobs work (not ansible but same idea)21:16
*** jeadre has quit IRC21:16
*** thorst has quit IRC21:16
fungipabelanger: worst case you can ssh-keygen and then append the resulting public key to the authorized_keys file for the same user (presumably jenkins)21:17
*** derekh has joined #openstack-infra21:17
pabelangerfungi: Ha, I was just thinking that :)21:17
clarkbfungi: thats what the beaker jobs do but I would just start iwth ansibles local connection thing first21:17
fungioh, sure21:17
*** flepied1 has quit IRC21:18
fungiuse the mock "connection" first if you can, obviously21:18
*** zul has quit IRC21:18
*** erlon has quit IRC21:18
pabelangerYup, testing that now21:19
*** annegentle has quit IRC21:20
fungiclarkb: bingo! 2015-08-19 14:15:02,687 INFO: Removing deleted file /srv/static/mirror/web/packages/source/c/cffi/cffi-1.2.0.tar.gz21:20
*** annegentle has joined #openstack-infra21:20
clarkbfungi: that'll do it21:21
clarkbso I guess we just wait for tomorrow21:21
*** eharney has quit IRC21:21
*** cburroughs has quit IRC21:22
*** FallenPegasus has quit IRC21:22
openstackgerritMerged openstack-infra/elastic-recheck: Add query for neutron bug 1485969
openstackbug 1485969 in neutron "test_dualnet_multi_prefix_dhcpv6_stateless failed due to "RuntimeError: Set changed size during iteration" in quota code" [Undecided,In progress] - Assigned to Ihar Hrachyshka (ihar-hrachyshka)21:23
*** rfolco has quit IRC21:23
fungias suspected, the cffi bump failed out quickly across the board, the others are still running21:24
*** erikmwilson_ has joined #openstack-infra21:25
*** ayoung has quit IRC21:25
*** krtaylor has quit IRC21:26
*** armax has joined #openstack-infra21:26
*** amitgandhinz has quit IRC21:28
*** thiagop_afk has quit IRC21:28
*** stevemar has quit IRC21:28
*** erikwilson has quit IRC21:29
*** dguerri` is now known as dguerri21:30
*** hdd has joined #openstack-infra21:31
*** dguerri is now known as dguerri`21:31
*** dkranz has joined #openstack-infra21:32
pabelangerfungi: clarkb: thanks, worked as expected in the gate21:33
*** kgiusti has quit IRC21:33
pabelangerreally eagar to see what the zuulv3 playbooks will look like.21:34
*** lucas-dinner has quit IRC21:34
pabelangerwrote a quick zuul-cloner task to ensure my repo is cloned over ssh (localhost) properly, vs using copy task21:34
pabelangerworked as expected21:35
jeblairfungi, clarkb, SpamapS: woohoo!  connectivity re-established: 22/2.621:35
*** bdemers has quit IRC21:35
jeblairthe previous owners had a strange idea of how to deal with telco wiring...21:36
jeblairthey ran a nice new cat5 cable, cut it, and then spliced two pairs together.21:36
clarkbpabelanger: I expect they will look like zuul-cloner && run script with conditional logic inside21:36
clarkbpabelanger: similar to how we use it with d-g simply because do things like if foo then bar else baz or for X in Y is clunky and weird in ansible21:37
clarkbits doable but hard to read21:37
clarkbjeblair: uh21:37
pabelangerclarkb: Right. Thats what my first pass did. playbook for zuul cloner, then use shell task to run bash script per normal.21:38
clarkbpabelanger: yup then probably a playbook that does file copy in an ansibly way21:38
pabelangerGoing to play around with moving some of bash script into ansible, but I figure it is going to be a fine line of what goes where21:38
clarkber not playbook a task? whatever the individual bits are called21:38
*** sigmavirus24 is now known as sigmavirus24_awa21:38
jeblairclarkb: exactly.  in related news, i have box of jacks, 1000ft of cable, and a patch panel delivered from monoprice sitting in front of me.  :)21:38
clarkbpabelanger: ya we tried it with d-g and the problem you run into is its very hard to follow control flow at least for me21:38
pabelangerclarkb: Ya, for now I created zuul-playbooks in my repo, which setups the workspaces like jenkins does today.  Once we get zuulv3 going, I can bomb that directory.  My project specific code will live in playbooks like the spec suggests21:40
*** dannywil_ has quit IRC21:40
*** abdelwas_ has quit IRC21:40
clarkboh and hte other funky thing is logging21:41
clarkbbecause apparently thats a for pay add on21:41
clarkbso by pushing execution into shell you can get sane logging21:41
*** smoser has joined #openstack-infra21:41
*** doug-fish has quit IRC21:42
pabelangerYa, I am looking at that now.  Ugly blob of data in jenkins console. fun times21:42
*** doug-fish has joined #openstack-infra21:42
clarkbI think we will likely end up writing an ansible module/plugin/something to fix its logging whihc shouldn't be too bad since the python logging module is in stdlib21:42
clarkbit just doesn't exist today21:42
*** annegentle has quit IRC21:42
*** hdd has quit IRC21:45
*** doug-fish has quit IRC21:46
fungijeblair: congrats! i need to use the existing phone lines in our plenum as pull strings to run cat-5. that's when i run out of more pressing things to fix21:48
*** FallenPegasus has joined #openstack-infra21:48
*** bapalm has quit IRC21:49
jeblairand now i'm on my new block of 8 static ip addresses!21:50
*** ybathia has quit IRC21:51
fungienjoy your /2921:51
fungihow much ipv6 do they provide you?21:51
fungi /48? /56?21:51
nibalizerhow many internets?21:51
fungiall. all the internets21:52
*** bapalm has joined #openstack-infra21:52
nibalizerwell a /64 is an internet of internets right?21:52
nibalizeris the joke I was going for21:52
* nibalizer will head back to reviews21:53
clarkbjeblair: you can run a 6 node cloud for us21:54
fungian internet of internets, yes. and a /48 is 1.5 internets of internets21:54
fungier, internet^1.5 of internets21:54
jeblairfungi: i'm actually not sure; they've been a bit behind on ipv6, so i have an tunnel at home.  but this is new equipment, they might have something now.21:54
*** dannywilson has joined #openstack-infra21:54
*** sigmavirus24_awa is now known as sigmavirus2421:54
*** signed8bit has quit IRC21:55
clarkbjeblair: for when nodepool writes to /etc/nodepool it does that as the test user so we need to give it perms to do those writes?21:56
* clarkb greps21:56
fungiit's hard to not find modern network equipment, even consumer/cpe, without v6 support21:56
*** bapalm has quit IRC21:57
* fungi has confused himself with compound negatives now21:57
clarkbI still get a bunch of loss thorugh seattle on comcast ipv621:57
jeblairclarkb: yeah, so we made /etc/nodepool world writable21:57
*** sergmelikyan has joined #openstack-infra21:57
fungiwell, yes. the provider's implementation may be lacking, but missing support in the hardware/embedded os is usually not the reason21:58
clarkbyup see that now chmod 77721:58
fungiwe had a discussion around the 777 perms at the time, as i recall, and concluded that it was the simplest solution since we can't predict the account21:59
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test dib image builds with devstack too.
clarkbthis is so close21:59
fungiwhat's the run duration like?22:00
clarkbfungi: it still ~20 minutes for devstack then wait 15 minutes for things before cheking22:01
*** geoffarnold has quit IRC22:01
clarkbI think that may be just long enough but want to move the wait and check into nodepool itself so we don't have toupdate the job just for that22:01
clarkbone thing at a time22:01
fungii guess dib is also going to add some flakiness there with network interaction for package retrieval22:02
*** geoffarnold has joined #openstack-infra22:02
clarkbya but should be minimal the package list is small there22:02
*** bapalm has joined #openstack-infra22:03
fungiwe could add the set to the list of packages to cache on our workers and then you could copy that into dib's cache to prime it22:03
clarkbyup thta would be one option too22:03
*** sergmelikyan has quit IRC22:04
*** w_ has joined #openstack-infra22:05
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack
nigelbjeblair / fungi - thanks for the ping! Looks like my naios plugin worked! :)22:05
*** claudiub has quit IRC22:05
nigelbthough, it didn't give me any other side effects since the ban is still in place and seems to be holding up.22:05
*** bapalm has quit IRC22:08
openstackgerritlifeless proposed openstack/requirements: Revert "Drop PuLP from g-r"
*** olaph has quit IRC22:09
funginigelb: yep, this time it came to our attention because our server mounts /var/run/lock on a very tiny tmpfs and /var/run/lock/mailman filled it up with lockfiles from the subscribe requests22:09
fungiso people stopped being able to subscribe to mailing lists (which probably also limited the attack somewhat beyond that point)22:10
nigelbha! I really feel bad for the poor guy that owns that email.22:10
*** camunoz has joined #openstack-infra22:11
pleia2nigelb: nicely done22:11
*** rlucio has joined #openstack-infra22:11
*** w_ has quit IRC22:13
*** doug-fish has joined #openstack-infra22:14
*** bapalm has joined #openstack-infra22:14
*** w_ has joined #openstack-infra22:15
*** oomichi has joined #openstack-infra22:17
*** krtaylor has joined #openstack-infra22:18
*** doug-fish has quit IRC22:18
*** bapalm has quit IRC22:19
*** ayoung has joined #openstack-infra22:19
*** annegentle has joined #openstack-infra22:20
*** ybathia has joined #openstack-infra22:24
*** chlong has quit IRC22:25
*** zul has joined #openstack-infra22:26
*** oomichi has quit IRC22:26
fungidoes 202210 crash gertty for anyone besides me? (tested both latest release and master branch tip)22:27
fungiurwid.listbox.ListBoxError: Invalid offset_inset: -2, only 1 rows in target!22:27
fungiwondering if it's at all related to my terminal size22:28
fungigoing to try some other font sizes to confirm22:28
*** bapalm has joined #openstack-infra22:29
fungiooh, new pip/virtualenv today22:31
clarkbwhich are not contraints protected22:32
jesusaurusfungi: its not crashing gertty for me22:32
*** thorst has joined #openstack-infra22:32
funginew pip includes a fix for crashing on unwriteable wheel cache dir22:32
*** annegentle has quit IRC22:33
*** tlian has quit IRC22:33
fungialso a possible fix for the cffi issue on fedora22:33
*** annegentle has joined #openstack-infra22:33
fungi(where the .so was getting left behind when switching between distro packages and pip-installed packages)22:34
*** bapalm has quit IRC22:34
*** mriedem is now known as mriedem_away22:35
*** bapalm has joined #openstack-infra22:35
clarkbgood morning22:36
*** tlian has joined #openstack-infra22:36
*** annegentle has quit IRC22:38
*** xyang1 has quit IRC22:38
*** ams__ has quit IRC22:39
*** rfolco has joined #openstack-infra22:39
*** ashleigh_ has quit IRC22:40
*** glauco has quit IRC22:42
fungiinteresting, so i confirm i can crash gertty the same way on another machine with the same terminal geometry (80x24) but if in increase the terminal by a row (80x25) it's fine22:42
*** jtrovo has quit IRC22:43
*** bapalm has quit IRC22:43
*** bapalm has joined #openstack-infra22:43
fungithat change crashes it with an 80x23 terminal as well22:44
fungii have a feeling it's being triggered by that one especially large review comment22:45
*** wenlock has quit IRC22:45
fungiand scrolling down to it in an 80x24 or smaller terminal triggers the bug, but in an 80x25 or larger does not22:45
openstackgerritTyler Cipriani proposed openstack-infra/jenkins-job-builder: adding support for android emulator
*** EricGonczer_ has joined #openstack-infra22:48
*** bapalm has quit IRC22:48
*** dannywilson has quit IRC22:48
*** btully has quit IRC22:49
*** bapalm has joined #openstack-infra22:51
*** rkukura has quit IRC22:52
*** thorst has quit IRC22:55
*** EricGonczer_ has quit IRC22:55
jeblairfungi: yeah, i think there is a lingering bug (or bugs) related to that.  :/22:56
*** dannywilson has joined #openstack-infra22:57
fungii'm in the process of filling one in22:57
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack
fungisince it's a little deeper in urwid than i can grok for the moment22:57
openstackgerritMikhail S Medvedev proposed openstack-infra/puppet-project_config: Allow specifying repo ref as a class parameter
*** sabeen1 has quit IRC22:59
pleia2StevenK: ping me when you're about? want to get caught up on zanata status so I can follow up with Daisy and figure out what to focus on next week23:00
pleia2StevenK: I'm around all evening here, so whenever you're awake, no rush23:00
*** rm_work is now known as rm_work|away23:01
*** rkukura has joined #openstack-infra23:01
openstackgerritClark Boylan proposed openstack-infra/nodepool: Move nodepool test checks into nodepool
*** sridhar_ram has quit IRC23:02
*** sridhar_ram has joined #openstack-infra23:02
* SpamapS wrestles with hash and erb, battling hiera, and puppet .. a statement that in any other context would probably be cause for an intervention..23:02
sdakefungi around for a quick question - someone trying to write a commit and their launchpad id doesn't match their gerrit id23:02
*** sergmelikyan has joined #openstack-infra23:03
*** asettle has joined #openstack-infra23:03
*** ayoung has quit IRC23:03
sdakeshouldn't launchpad id match the gerrit review id?23:03
openstackgerritClark Boylan proposed openstack-infra/project-config: Run the post nodepool deploy checks from nodepool
clarkbpleia2: fungi ^ those two changes should be ready and give us even better nodepool testing23:04
derekhHi, I sent 2 mails to the dev list earlier and neither has appeared, I'm told there may have been mailman problems, should I resend the mails?23:04
clarkbsdake: you mean username?23:04
clarkbsdake: there is nothing that requires the usernames match23:04
sdakeclarkb yup23:04
sdakewhere does the username come from?23:04
clarkbsdake: you can set it in gerrit23:04
clarkbderekh: we have been used as a ddos vector via subscription reuests. I suppose its possible gmail really hates us now or something23:05
jlvillalIs there a status page on Zuul?  I see the status that gate jobs are taking about 8+ hours at the moment. Just curious if there was a page that says why. It seems slower than usual, but maybe that is my imagination.23:05
openstackgerritTyler Cipriani proposed openstack-infra/jenkins-job-builder: adding support for android emulator
clarkbderekh: do the emails show up in the archive on
*** achanda_ has quit IRC23:05
sdakeclarkb how do you chnge the username?23:05
clarkbjlvillal: you mean?23:05
clarkbsdake: you don't23:05
derekhclarkb: nope, their not there either23:05
EmilienMcan someone +A please ? thanks :)23:06
sdakeclarkb the fundamental issue is he does git review and it fails23:06
sdakeso I thought to fix he could get his username nad launchpad id in sync23:06
jlvillalclarkb: Not really, that just tells me it is taking a long time. I was hoping there was a reason for it. Unless the only reason is that there are a lot of jobs. I was thinking maybe there were some build servers out of action or something like that.23:06
jlvillalMaybe it is just too many jobs.23:06
*** dangers is now known as dangers_away23:07
clarkbsdake: that won't fix it, confirm the username at then do git config gitreview.username whatevertheusernameis then rerun git review -s23:07
clarkbjlvillal: usually the reason is tests failed a lot reseting things and losing progress + many jobs to run23:07
clarkbjlvillal: the graph at the bottom of the page that shows you an hourly job rate is often a good indicator to see if we are keeping up anywhere in the 600-1k range is normal23:07
*** FallenPegasus has quit IRC23:08
jlvillalclarkb: Thanks. So no infrastructure reasons around it, which is good :)23:08
clarkbjlvillal: not that I know of23:08
SpamapSgreghaynes: hah, they replaced the motherboard on the bad box so fast, I never had time to remove it from inventory. ;)23:09
sdakeclarkb he tried that, says "could not connect to gerrit"23:09
clarkbderekh: I am no mail guru (jeblair is the person to try) but I suppose its possible that people refuse to deliver to us? or that delivery failed and will need to be retried again23:09
sdakethen asks for a gerrit username, he types in "DuaneD"23:09
clarkbsdake: is that the username that shows on the page I linked?23:10
*** FallenPegasus has joined #openstack-infra23:10
clarkbsdake: and are ssh keys set p for that account?23:10
sdakessh keys are setup - he set them about 1 hr ago23:10
sdakelet me  have him check the link23:10
clarkbsdake: can you try ssh -p29418 gerrit ls-projects ?23:11
clarkbif that fails add some -vvv and see where it fails23:11
sdakesettings page for him says username "DuaneD"23:11
derekhclarkb: ok, thanks, I didn't get any failures emails (yet), I'll retry one of them now and see if its working now23:11
clarkbif that succeeds check `git remote -v` and make sure the uri for gerrit looks good, maybe even paste it in here23:11
sdakeclarkb that listed out a bunch of projects23:12
clarkbsdake: ok so that worked, next check the git remote v23:12
clarkber -v23:12
SpamapSSilly puppet question: If I use the hiera commandline tool and it produces the value I expect, is there something that might cause the same hiera query in site.pp to not find the key?23:12
derekhclarkb: my resend has appeared so I guess whatever the problems was has worked itself out23:13
clarkbSpamapS: not that I am aware of, the hiera config is all in that yaml file so should be the same for puppet or commandline hiera tool23:13
sdakefetch and pushes for the repos clarkb23:13
clarkbsdake: yes what do they say?23:13
clarkbspecifically for the remote named gerrit23:14
sdakeclarkb origin http:/ (fetch)23:14
sdakeorigin (push)23:14
pleia2clarkb: I think that patch depends on ? made a note accordingly23:14
fungisdake: latest (1.25.0) git-review or older?23:14
sdakeclarkb there is no gerrit remote23:14
pleia2(got confused when I searched my loco repos and couldn't find
clarkbpleia2: its all non voting so order isn't really required23:14
clarkbpleia2: either way should be fine23:15
clarkbsdake: ok so no preexisting remote is confusing git review23:15
pleia2clarkb: just made it a little tricky to review23:15
*** kutija has quit IRC23:15
clarkbpleia2: ah I see23:15
*** kzaitsev_mb has quit IRC23:15
*** regXboi has quit IRC23:15
fungisdake: some older git-review versions got confused by cla/contact info related errors in gerrit's response to the test push, and would mistakenly complain the credentials were wrong23:15
fungisdake: 1.25.0 should spit out the correct error in that case though23:16
*** achanda has joined #openstack-infra23:16
fungior rather, should properly pass through the error it's getting from gerrit23:16
SpamapSclarkb: must be something different, in --debug mode I see it only looking for the 'common' data source, even though in hiera.yaml I added a 'baremetal' datasource.23:16
sdakeclarkb any way to fix the remotes?23:17
fungisdake: he was saying the remotes are the problem23:17
sdakefungi trying to find the git-review version hi23:17
fungier, aren't23:17
clarkbsdake: see fungi's suggestion23:17
fungiaren't the problem23:17
sdakeclarkb will do23:17
SpamapSclarkb: says it uses /etc/puppetlabs/code/hiera.yaml23:17
fungisdake: git review --version23:17
clarkbSpamapS: uh ours is /etc/puppet/hiera.yaml iirc23:18
SpamapSclarkb: ahh, right23:18
*** sigmavirus24 is now known as sigmavirus24_awa23:18
SpamapSclarkb: but, the cli uses /etc/hiera.yaml23:18
clarkbSpamapS: hahahaha23:19
*** dannywilson has quit IRC23:19
SpamapSwhich is sort of like.. >:|23:19
clarkbright because hiera the tool isn't puppet specific23:19
clarkbI seem to recall hitting this before now and being grumpy23:19
SpamapSI'm more >:| because why, puppet, don't you just default to _the one the system provides_ :-P23:19
openstackgerritClark Boylan proposed openstack-infra/project-config: Run the post nodepool deploy checks from nodepool
clarkbpleia2: updated23:20
clarkbwe almost have full functional testing of two primary jobs of nodepool23:22
clarkbI might be a little excited23:22
sdakefungi he is now running git review 1.25.023:23
sdake"We don't know where your gerrit is.  Please manually create a remote23:24
*** kzaitsev_mb has joined #openstack-infra23:24
clarkbsdake: ok, that implies your .gitreview is broken23:24
fungisdake: that's after running `git review -s`23:24
sdakefungi yes23:24
clarkbI am going to guess there is some file somewhere saying using a different host/port/etc23:25
clarkbprobably in order to get through a proxy23:25
fungisdake: were there any errors prior to that message? can you put them on
clarkbproably rerun with git review -v -s23:25
clarkbto get the full trace if pasting stuff23:25
sdakefungi yup one moment23:25
pleia2clarkb: I'm excited too, looking good \o/23:26
*** dingyichen has joined #openstack-infra23:26
*** sridhar_ram has quit IRC23:26
*** r-daneel has quit IRC23:27
*** sridhar_ram has joined #openstack-infra23:28
*** dannywilson has joined #openstack-infra23:30
* fungi has to disappear again for a few minutes, maybe longer... bbiaw23:30
*** otter768 has joined #openstack-infra23:30
*** dimtruck is now known as zz_dimtruck23:33
*** ddecapit has joined #openstack-infra23:33
sdakefungi/clarkb here is the paste of git review of a fresh repo checkout
sdakelooks like its trying to use his credentials rather then the ones specified with that gitreview operation earlier23:34
*** manjeet_ has joined #openstack-infra23:34
manjeet_Hi everyone i have question does cidr value works for no_proxy parameter or it should be always list of ips?23:35
clarkbsdake its a git config op not git review23:35
clarkbdouble check ~/.gitconfig23:36
*** regXboi has joined #openstack-infra23:37
asselin_manjeet_, you need to use full ips23:37
asselin_no cidr23:37
sdakeclarkb looks like there is no git review crudini stuff23:37
sdakeratheri ni stuff23:37
*** ayoung has joined #openstack-infra23:37
sdakewhat should the format be?23:37
clarkbok so run the comand I posted before23:37
sdake   name = DuaneD?23:37
sdakeclarkb he ran it twice, no effect23:38
clarkboh sorry need a --global too23:38
clarkbbut yes as you pasted but use username not name23:39
openstackgerritTyler Cipriani proposed openstack-infra/jenkins-job-builder: adding support for android emulator
*** thcipriani is now known as thcipriani|afk23:40
sdakeok progress clarkb :)23:40
sdakesays icla requires contact information23:40
sdakeso I think we are in business :)23:40
sdakeclarkb super a+  for the extra hep :)23:41
*** sridhar_ram has quit IRC23:41
sdakefungi clarkb ++ :)23:41
*** sridhar_ram has joined #openstack-infra23:42
*** glauco_ has joined #openstack-infra23:42
*** ddieterly has joined #openstack-infra23:43
*** kzaitsev_mb has quit IRC23:43
*** geoffarnold has quit IRC23:43
*** angdraug has quit IRC23:45
*** salv-orlando has quit IRC23:46
*** ddecapit has quit IRC23:46
*** glauco_ has quit IRC23:47
*** Swami has quit IRC23:48
*** gildub has joined #openstack-infra23:55
SpamapSthe template makes a valid bifrost json23:56
SpamapSbut I seem to have mixed up hostnames<->ipmi passwords23:56
*** FallenPegasus has quit IRC23:56
*** dannywilson has quit IRC23:56
SpamapSseems like it might be better to use the ipmi address as the ipmi password key rather than the hostname which may change23:56
* SpamapS goes cross eyed and takes a break from staring at it23:56
mmmporkSpamapS: better be careful or your face might get stuck like that23:58
*** sergmelikyan has quit IRC23:59
*** SumitNaiksatam has quit IRC23:59
*** ybathia has quit IRC23:59

Generated by 2.14.0 by Marius Gedminas - find it at!