Tuesday, 2015-11-17

*** baoli has joined #openstack-infra00:00
jeblairi've only typed 'git review' once today, and of course it's at utc midnight.00:01
*** burgerk_ has quit IRC00:01
jeblairoh, that's not true; this is the second time00:01
zaroyolanda: ping00:01
mtreinishmordred, fungi, jeblair: ^^^ that's a simple 1 word patch if you get a sec00:02
openstackgerritApoorva Deshpande proposed openstack-infra/ciwatch: ciwatch cleanup  https://review.openstack.org/24603200:03
*** sigmavirus24 is now known as sigmavirus24_awa00:03
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate: Produce a script to reproduce the running build  https://review.openstack.org/24477200:04
*** gongysh has joined #openstack-infra00:04
anteayajeblair: is that a good day or a bad day?00:05
*** baoli has quit IRC00:05
*** xyang1 has quit IRC00:06
*** baoli has joined #openstack-infra00:06
*** sputnik13 has joined #openstack-infra00:08
*** gongysh has quit IRC00:08
jeblairanteaya: a long one?00:09
*** tqtran is now known as tqtran-afk00:10
*** sputnik1_ has quit IRC00:10
*** ashleighfarnham has quit IRC00:11
anteayajeblair: fair00:11
clarkbjeblair: not sure I have typed it at all00:11
clarkb(busy with jenkinses then busy testing logstash 2.0 against our ruleset)00:11
clarkbhopefully tomorrow I can push changes to upgrade logstash00:11
*** baoli has quit IRC00:12
mtreinishclarkb: ooh00:12
*** gongysh has joined #openstack-infra00:12
*** _bmjen is now known as bmjen00:13
*** sergmelikyan has joined #openstack-infra00:13
jeblairanyone know why puppet is disabled on graphite?00:13
clarkbmtreinish: will let us timeout multiline events so after upgrade need to update rules to do that and fix the issue iwth weird multiline events00:13
openstackgerritApoorva Deshpande proposed openstack-infra/ciwatch: Replacing legacy references of ci-watch to ciwatch  https://review.openstack.org/24603200:14
mtreinishclarkb: cool00:14
*** tchaypo has quit IRC00:14
*** tchaypo has joined #openstack-infra00:15
jeblairoh, right, the runaway pip thing00:15
*** tchaypo is now known as Guest9971000:15
clarkbmtreinish: at least for console logs we don't appear to need any config updates00:15
*** morgabra_ is now known as morgabra00:15
*** morgabra has quit IRC00:15
*** morgabra has joined #openstack-infra00:15
*** Guest99710 is now known as tchaypo00:15
clarkbmtreinish: need to work through the rest of the types of logs we have00:15
*** gongysh has quit IRC00:17
clarkband figure out how to install newer logstash since thats all different now00:17
mtreinishclarkb: cool, yeah the console logs are probably a pretty straightforward ruleset00:17
*** tchaypo has quit IRC00:17
*** tchaypo has joined #openstack-infra00:18
mtreinishiirc, the oslofmt one with the multiline stuff is a bit more involved00:18
clarkbya it is00:18
*** sergmelikyan has quit IRC00:18
*** tchaypo is now known as Guest4158300:18
*** Guest41583 is now known as tchaypo00:21
*** yamamoto has joined #openstack-infra00:22
*** dangers is now known as dangers_away00:22
*** yamamoto has quit IRC00:22
openstackgerritSteve Martinelli proposed openstack/requirements: bump upper-constraints for openstackclient to 1.9.0  https://review.openstack.org/24604900:22
*** annegentle has quit IRC00:22
*** annegentle has joined #openstack-infra00:24
*** ccrouch has joined #openstack-infra00:25
*** thorst_ has joined #openstack-infra00:29
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500900:30
*** yonglihe has quit IRC00:30
*** thorst_ has quit IRC00:30
clarkbjesusaurus: its likely going to take a bit of puppet untangling to use the package00:30
clarkbjesusaurus: but the good thing is there is an init script, there are logrotate rules, etc00:30
clarkbso yay packages00:31
jeblairinfra-root: i've started mass whisper resizing in screen on graphite.o.o00:31
*** thorst_ has joined #openstack-infra00:31
jeblairthis will probably take a really long time.  many days would not surprise me.00:31
*** gongysh has joined #openstack-infra00:33
*** hemna is now known as hemnafk00:34
*** denisra has quit IRC00:34
nibalizerok00:34
*** thorst_ has quit IRC00:35
*** denisra has joined #openstack-infra00:35
jeblairalso, i noticed that its actual data volume was not graphed in cacti, so i added it00:36
openstackgerritDanilo Ramalho proposed openstack-infra/puppet-openstack_health: Fix httpd apply Ubuntu Precise  https://review.openstack.org/24605300:37
jeblairthat's currently at 905G out of 2.0T; i expect some space savings because of this, but i can't say how much because i don't know how many whisper files are on the old retention policy00:37
*** dramalho has quit IRC00:38
*** gildub_ has quit IRC00:38
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500900:39
*** jyuso1 has joined #openstack-infra00:40
docaedoCould a PBR expert look at this error and see if it's a common thing? Like in this case this package is not in pypi, it's being installed locally with pip install . ... http://paste.openstack.org/show/47906500:42
clarkbarg puppet really needs a "only do this one ever to transition states" thing00:43
clarkbI want to remove user and group logstash then have package recreate them00:43
tchaypodocaedo: it looks like it’s expecting the local source to have a git repo00:43
clarkbbut I can only do that the one time before before package install00:43
*** otter768 has joined #openstack-infra00:44
tchaypodocaedo: as a quick workaround you should be able to just “git init .” in the dir and pbr will create a version something like 0.0-dev00:44
tchaypodocaedo: did you originally clone this from somewhere?00:44
docaedotchaypo: it does :) But we're not tagging00:44
nibalizerclarkb: marut wrote this https://forge.puppetlabs.com/puppetlabs/transition, but he classfiiified it as experimental00:44
tchaypodocaedo: you can also get around this by manually specifying a versoin00:44
lifelessdocaedo: I am confused; tchaypo said 'git repo' and you said 'not tagging'00:44
tchaypoexport PBR_VERSION=12.000:44
tchaypoI think00:44
clarkbnibalizer: I think we are going to get ansibled00:45
lifelessdocaedo: therse are separate things00:45
clarkbnibalizer: so process will be run ansible to cleanup then run puppet for new state00:45
tchaypooh look, lifeless is here, I’ll leave this to the real expert00:45
lifelesstchaypo: you're one too now :)00:45
docaedoso this is a clone of app-catalog repo (this is the manifest that does it - https://review.openstack.org/#/c/245315/1)00:45
docaedosetup.cfg does not specify a version, and I thought one other place PBR tries to divine version number from was repo tags (which was why I said we haven't tagged a version in that repo)00:46
lifelessdocaedo: pbr doesn't think its a clone00:46
lifelessdocaedo: either git isn't installed, or there is no .git directory.00:46
clarkbnibalizer: basically I have to remove all the pseudo packaging from puppet and let deb do it. But so that we don't end up super crufty want to undo what puppet does first00:46
clarkblifeless: well its a site-package so why would you need git?00:47
clarkbshould be in package metadata00:47
docaedolifeless: ok .. ah! that is because this is running from a virtual environment .. so the repo is cloned, then pip install . is run in the repo00:47
*** annegentle has quit IRC00:47
docaedolifeless: then apache is using the venv00:47
clarkbpbr should fail upfront if it can't make metadata during install right?00:47
lifelessclarkb: yes00:47
*** annegentle has joined #openstack-infra00:47
lifelessdocaedo: I missed what clarkb spotted; you've installed it ok but the pkg_resources metadata isn't accessible00:47
*** otter768 has quit IRC00:48
docaedolifeless: ok .. I am not sure how to fix that though - seems like something relating to PBR is failing when calling this from apache00:49
*** zns has quit IRC00:49
lifelessdocaedo: I think your python path is bogus00:49
lifelessdocaedo: a virtual environment is not just the site packages00:50
docaedolifeless: yes sorry, hold one sec I have not pushed up the fixed one00:50
docaedolifeless: this is the apache config with fixed path - http://paste.openstack.org/show/47907100:50
docaedolifeless: "fixed" is a maybe, I suspect if there's something wrong with that path you'll notice it immediately00:51
lifelessdocaedo: thats even more broken :)00:52
lifelessdocaedo: do this, make your virtualenv by hand00:52
lifelessdocaedo: then in it run python -c "import sys;print(sys.path)"00:52
lifelessdocaedo: what it outputs is the path you need00:52
docaedolifeless: ok excellent00:52
*** bardia_ has joined #openstack-infra00:53
openstackgerritMikhail S Medvedev proposed openstack-infra/puppet-ciwatch: WIP: Add initial implementation to deploy ciwatch  https://review.openstack.org/23860600:54
*** pvaneck has quit IRC00:57
clarkbactually maybe its easiest to just make a bunch of new hosts00:58
clarkbyay cloud00:59
*** Yanyanhu has joined #openstack-infra00:59
*** Swami has quit IRC01:01
*** jswarren has quit IRC01:01
*** baoli has joined #openstack-infra01:03
openstackgerritMerged openstack-infra/ciwatch: Replacing legacy references of ci-watch to ciwatch  https://review.openstack.org/24603201:05
*** davideagnello has quit IRC01:05
*** davideagnello has joined #openstack-infra01:06
openstackgerritPaul Belanger proposed openstack-infra/project-config: Allow a user to override the toxworkdir (tox.ini)  https://review.openstack.org/24606101:06
pabelangerianw: when you have a second. ^ interested in your thoughts01:07
*** jswarren has joined #openstack-infra01:07
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500901:07
pabelangerianw: running into issue where tox (bash) bombs because the path is too deep for the tox working directory.01:07
ianwhmm, that seems odd01:08
*** rui-zang has joined #openstack-infra01:08
openstackgerritChristopher Aedo proposed openstack-infra/puppet-apps_site: Add python WSGI server  https://review.openstack.org/24531501:09
jeblairpabelanger: that job name is 39 chars, not 12701:09
pabelangerjeblair: I think what is happening, is tox is building out the full path to .tox01:09
pabelangerand because the path is super long, it bombs01:09
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500901:10
clarkbwhy would you override the tox workdir?01:10
clarkbthat seems like a bad bad idea01:10
clarkbtox is an interface don't break it01:10
docaedolifeless: still having issues but no longer having issues with PBR at least.  Running python manage.py runserver in shell from venv works fine, but when running under apache I hit this (which seems like a path issue) http://paste.openstack.org/show/47907401:11
pabelangerclarkb: open to ideas how to fix tox01:11
docaedolifeless: this is the associated commit on the app-catalog side that I'm working from - https://review.openstack.org/#/c/227856/601:11
ianwpabelanger: so what's with the local() in the first arg of http://logs.openstack.org/79/245979/1/check/gate-ansible-dsvm-functional-centos7-nv/f24bec8/console.html#_2015-11-16_23_27_03_93501:11
jeblairpabelanger: i'd really like to know what's broken first :)01:11
ianwpabelanger: that seems to be the argument it can't exec, i wonder if something is getting passed through wrong01:12
*** salv-orlando has quit IRC01:12
ianwor, maybe that's just an artifact of the printing01:12
clarkbjeblair: ++01:13
clarkblinux by default seems to allow filenames to be 255 chars and paths to be 4096 chars01:13
clarkb(and thats chars not bytes but maybe I am misreading)01:13
clarkbwe are nowhere near either limit01:14
*** tlian has quit IRC01:15
lifelessclarkb: bytes, since linux doesn't do unicode01:15
openstackgerritMerged openstack-infra/zuul: Revert "Add Pillow to test-requirements.txt"  https://review.openstack.org/23926301:16
*** tchaypo has quit IRC01:16
clarkblifeless: oh I thought you oculd utf8 filenames01:16
clarkbbut maybes thats because bytes01:16
clarkband yolo01:16
*** tchaypo has joined #openstack-infra01:16
lifelessclarkb: yup, yolo01:16
lifelessclarkb: you can do any encoding that is null free01:17
clarkbgotcha01:17
lifelessclarkb: and then set an environment variable01:17
lifelessclarkb: and watch the world burn01:17
clarkbpabelanger: I think that error is more likely related to the subdir stuff01:17
lifelessclarkb: as all your python scripts etc fail to decode file paths into unicode01:17
clarkbbut I need to dig thorugh the logs more to understand what it is doing01:17
clarkbpabelanger: like maybe it can't write to that dir01:18
*** glauco has quit IRC01:18
lifelessclarkb: fun thing #34 about writing a VCS in python01:18
openstackgerritJames E. Blair proposed openstack-infra/project-config: Simplify ansible functional jobs  https://review.openstack.org/24606901:18
clarkbpabelanger: but for some reason doesn't fail until it tries to exec, or if it can't read same thing01:18
pabelangerclarkb: sure, I can test that quickly01:18
jeblairpabelanger: ^ also, why didn't you do that for the job defn? (cc clarkb)01:18
ianwpabelanger: ahh, i see01:20
clarkbpabelanger: also you are running those scripts on a node label never intended to run them01:20
clarkbso there may be other dep type issues01:20
ianwhaving #!/tmp/thisisreallyreallylongpath/undera/bunch/of/subdirectories/thatis/getting/reallyreally/long/and/i/wonderifsomething/fails/bin/python fails at the top of a .sh script01:20
pabelangerjeblair: I need to keep the directory name as ansible-role-nodepool.  When I start adding dependencies, ansible will start failing since the directory will parse as gate-ansible-dsvm-ansible-functional....01:20
ianwi guess bash has a limit on the interpreter length of #!01:20
pabelangerjeblair: currently working around it using ansible-playbook -erolename=blah, which will work. But as soon as next module comes, I need to work job01:21
pabelangerclarkb: understood, planning on adding support for centos701:22
jeblairpabelanger: ok, that might be worth a note, and is sort of surprising -- in general jenkins runs jobs in a working directory == the name of the job01:22
clarkbpabelanger: execve has an ENAMETOOLONG errno01:22
pabelangerclarkb: unless you don't want too?01:22
clarkbpabelanger: which is not what we are getting so I doubt that the length is the problem01:22
pabelangerjeblair: Ya, I added it to the original commit message. But, could also add it to job-template01:22
clarkbpabelanger: fungi is working on it as part of the bindep work01:22
jeblairpabelanger: ++01:22
pabelangerianw: Ya, that is what I found googling too01:22
*** paco20151113 has joined #openstack-infra01:23
pabelangerclarkb: okay, let me see if I can find fungi's work01:23
*** tlian has joined #openstack-infra01:24
openstackgerritChristopher Aedo proposed openstack-infra/puppet-apps_site: Add python WSGI server  https://review.openstack.org/24531501:25
ianwclarkb: see my comment ... it's the #! line in "pip" that's installed in the virtualenv01:26
*** gongysh has quit IRC01:26
docaedoGot a suggestion from lifeless on building the right path which made the PBR error go away (https://review.openstack.org/#/c/245315) but now I'm back to the apparent path issues with wsgi.py (http://paste.openstack.org/show/479074)01:27
docaedoany help is appreciated :)01:27
clarkbianw: but tox isn't shelling there is it?01:28
*** thorst_ has joined #openstack-infra01:28
* clarkb reads more execve manpage01:28
clarkbah execve supports the interpreter directly01:28
clarkbpabelanger: you don't need to bash there either fwiww01:29
clarkbsince rolename is a per repo thing you can just set it in your tox.ini01:29
clarkband I thought you were going to remove xargs?01:29
clarkb(xargs also not required to lint)01:29
pabelangerclarkb: sure, let me test01:29
clarkbianw: od that we would get erno 2 in that case01:30
*** thorst_ has quit IRC01:30
ianwclarkb: /bin/pip in your virtualenv doesn't want to run under /bin/python it wants to run under /path/to/virtualenv/bin/python ... when that's too long ...01:30
*** thorst_ has joined #openstack-infra01:30
pabelangerclarkb: without xargs, tox was rolling to the next command, regardless if the first command failed.  With xargs, I found a way to trap the error.  I need to play with find more to see if I could properly trap a failure in the first command01:31
clarkbianw: ya and from execve(2) A maximum line length of 127 characters is allowed for the first line in a #! executable shell script.01:31
clarkbpabelanger: ah ok01:32
clarkbI just want to get rid of the bashes if possible01:32
clarkb(and the | xargs needs a shell)01:32
pabelangerclarkb: Ya, same. Need to spend some time and figure out a better solution01:32
clarkbpabelanger: so rather than change the tox work dir I would change the base path (make your job name shorter, don't further nest tox, etc)01:33
clarkbbecause for me at least tox is an interface and part of that is source $PATH/.tox/env/bin/activate and go01:33
*** gongysh has joined #openstack-infra01:33
clarkbit would be confusing if tox had to rebuild its env every time I reboot01:34
ianwit's quite a trap, surprised we didn't hit it before01:34
Yanyanhuhi, could anybody help to review this patch https://review.openstack.org/244478  Many thanks!01:34
*** thorst_ has quit IRC01:35
pabelangerclarkb: okay, sounds fair01:36
pabelangerianw: I've seen it raise here before, just last week01:36
*** zhenguo has joined #openstack-infra01:36
mgagneI just hit the 127 characters limit last week :-/01:37
pabelangermgagne: Ah, ya... that is right01:37
*** markvoelker has joined #openstack-infra01:37
mgagneit's like a plague spreading itself01:38
*** dramalho has joined #openstack-infra01:39
clarkbI wonder why execve works that way when a file can be 255 bytes long01:40
clarkbat the very least use the filename limit?01:40
pabelangerI guess what I can do is use the patch jeblair did, since I only have 1 module right now. Then, sit down and come up with a better plan01:41
*** annegentle has quit IRC01:41
openstackgerritDoug Hellmann proposed openstack/requirements: ignore oslosphinx 3.4.0 and use 3.4.1  https://review.openstack.org/24607801:42
clarkbpabelanger: do you need the source or just the install?01:43
*** dramalho has quit IRC01:43
openstackgerritfumihiko kakuma proposed openstack-infra/devstack-gate: Add the log of package list for pip3  https://review.openstack.org/24601701:43
clarkbI gues its self hosting the tox so that answers it01:43
mgagnebecause no reason: http://www.in-ulm.de/~mascheck/various/shebang/linux-0.10-0.12-exec.c-diff.html01:43
mgagnehttp://www.in-ulm.de/~mascheck/various/shebang/#results01:44
pabelangerclarkb: right now, I am open to ideas. So, whatever tox does today, can change01:44
ianwclarkb: because /bin/bash should be enough for anyone?01:44
*** tiswanso has joined #openstack-infra01:44
*** tiswanso has quit IRC01:45
pabelangerswitching to zuul-git-prep will shave off 2 directory levels and 25+ chars01:45
*** otter768 has joined #openstack-infra01:45
*** tiswanso has joined #openstack-infra01:46
*** achanda has joined #openstack-infra01:46
clarkboh so it errno 2 because it truncates01:46
mgagneswitching to FreeBSD will give you 4k01:46
clarkbbwahahahahahaha01:46
clarkbthis code01:46
clarkbmgagne: which is in line with filesystem path limits01:46
clarkbmgagne: which is what I would expect the limit to actually be01:47
*** Sukhdev_ has quit IRC01:47
mgagneused to be 1022 as per diff above01:47
clarkbya01:47
mgagnebefore 199201:47
clarkbclearly we should test on that freebsd kernel + debian userspace distro01:49
clarkbI wonder if bhyve has userspace tooling on that01:49
openstackgerritPaul Belanger proposed openstack-infra/project-config: Switch ansible-functional job zuul-git-prep  https://review.openstack.org/24607901:50
pabelangerclarkb: ianw: restored jeblair suggestion01:50
pabelanger^01:50
ianwpabelanger: cool, i think at least bailing out in those scripts, and maybe just always choosing a shorter path01:52
clarkbI wonder how loudly one would get yelled at for trying to change that limit01:53
*** btully has quit IRC01:53
clarkbI am sure there are hysterical reasons for it being the way it is that aren't apparent to lowly non kernel devs01:53
mgagnecan't wait to see the justification for such change: "So you see, we are using tox from a Jenkins jobs and ..."01:54
clarkbmgagne: or just "I have a path that is 4095 bytes long because I can. That path is executable and needs to be treated by execve properly"01:54
jeblairi think the justification should be "any valid filesystem path should be able to be specified as the interpreter for a script"01:54
jeblairclarkb: ++01:54
*** gyee has quit IRC01:55
*** sdake has joined #openstack-infra01:55
pabelangerianw: Right01:57
clarkbso tox can work around this by using the python executable directly to call pip01:58
*** fitoduarte has quit IRC01:58
clarkbbut thats a very specific workaround and likely to break when you call your next command01:58
clarkblike testr or flake801:58
clarkbactually install command is overrideable01:59
*** mriedem_away is now known as mriedem01:59
clarkbpabelanger: so you could set install command to python $venv_path/bin/pip install stuff02:00
clarkbexecve shouldn't shebang python because it should be an elf02:00
pabelangerclarkb: do you have URL I could read up on?02:00
pabelangergoing to test it before the patch lands02:00
clarkbyou may hav eto prefix python with venv path too02:01
clarkbhttps://tox.readthedocs.org/en/latest/config.html#confval-install_command=ARGV02:01
*** yonglihe has joined #openstack-infra02:02
lifelessthat should be ARGH IMO02:02
*** bpokorny_ has joined #openstack-infra02:02
*** mwagner has joined #openstack-infra02:03
clarkbwe could LD_PRELOAD a thing that does its own parsing and opens the file then fexecves it02:04
clarkbthe quality of these workarounds is trending quickly to "get clarkb away from the keyboard"02:05
*** fawadkhaliq has joined #openstack-infra02:05
*** alivigni has joined #openstack-infra02:06
*** bpokorny has quit IRC02:06
openstackgerritMerged openstack/requirements: Bumps os-win version to 0.0.6  https://review.openstack.org/24309102:07
*** mriedem has quit IRC02:07
*** bpokorny_ has quit IRC02:07
*** shashank_hegde has quit IRC02:07
openstackgerritMerged openstack/requirements: Adds os-win in projects.txt  https://review.openstack.org/23345702:07
openstackgerritMerged openstack/requirements: Bump oslo.service to latest version  https://review.openstack.org/24410902:07
openstackgerritMerged openstack/requirements: Increase minimal Jinja2 version from 2.6 to 2.8  https://review.openstack.org/24055602:08
pabelanger02:09
pabelangeroops02:09
*** otter768 has quit IRC02:10
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500902:11
*** baoli has quit IRC02:11
*** akshai_ has quit IRC02:11
*** baoli has joined #openstack-infra02:11
pabelangerclarkb: Ya, I think I'm done shortly. Thanks again for looking, ianw you too02:11
*** sridhar_ram has quit IRC02:11
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova o.vo unit test bug 1516805  https://review.openstack.org/24608202:12
openstackbug 1516805 in OpenStack Compute (nova) liberty "nova unit tests failing with infinite recursion with oslo.versionedobjects 0.13.0" [Critical,In progress] https://launchpad.net/bugs/1516805 - Assigned to Dan Smith (danms)02:12
*** alivigni has quit IRC02:13
*** gongysh has quit IRC02:14
*** sdake has quit IRC02:16
*** sdake has joined #openstack-infra02:17
asselin__does infra have a large mail file for recheck user?02:17
asselin__-rw-rw---- 1 recheck mail 848313809 Nov 17 02:15 /var/mail/recheck02:17
asselin__ls02:17
*** zhurong has joined #openstack-infra02:18
*** rguillebert has quit IRC02:18
openstackgerritMerged openstack-infra/project-config: Switch ansible-functional job zuul-git-prep  https://review.openstack.org/24607902:19
jeblairasselin__: -rw-rw---- 1 recheck mail 3407675 Nov 16 03:01 /var/mail/recheck02:19
asselin__that's more reasonable02:19
asselin__I see now. cron jobs and   InsecurePlatformWarning02:24
asselin__ prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.o02:24
asselin__rg/en/latest/security.html#insecureplatformwarning.02:24
*** armax has joined #openstack-infra02:24
*** akshai has joined #openstack-infra02:25
*** mtanino has quit IRC02:29
jeblair<sigh>02:29
*** weshay has quit IRC02:29
mgagnesomeone should do something about it! ;)02:29
jeblairkeep sending mail until they capitulate02:29
asselin__it was a mailbox full of e-mails from cron jobs that had that message many many times. Anything really important has been effectively masked away.02:30
jeblairwe should probably have recheck mask all the requests exceptions (perhaps using requestsexceptions)02:32
*** sdake has quit IRC02:32
tonybjeblair: Do you have a moment or 5 to help me understand IRC meetings/logging (again)02:34
*** _amrith_ is now known as amrith02:35
jeblairtonyb: it's dinner time here, but we can try :)02:35
tonybjeblair: :)02:35
jeblairtonyb: if i have to leave, maybe someone else can help02:35
tonybjeblair: So I thought we could technically only run meentings in #openctack-meeting* because of the 'meetbots' lines in accessbot/channels.yaml02:36
tonybjeblair: but the diversity wg are running meetings in #openstack-diversity02:36
tonybwhich doesn't gel with my previous statement?02:36
jeblairtonyb: there is no _technical_ requirement that they only happen in #meetings, just a social requirement.  if we could technically enforce it, we would.02:36
jeblairtonyb: it would be great if they would stop doing that.02:37
jeblairtonyb: and schedule a meeting in an actual meeting channel02:37
tonybjeblair: Yeah Now they know they're breaking the social contract they're moving ....02:37
jeblairtonyb: the reason for the social requirement is to make it easy for anyone to participate in any meeting at any time without needing to be in all 400 channels at once :)02:37
tonybjeblair: Yeah.  That's basically what I told them .... when I asked them to move.02:38
hogepodgejeblair: it helps to have it documented. defcore just started doing the same thing. In part because of lack of time slots02:38
hogepodgejeblair: plus, apparently openstack-meeting-2 isn't a place to have a meeting?02:38
jeblairhogepodge: we can make more meeting channels if needed02:38
jeblairhogepodge: yep, not an official channel afaik02:38
tonybjeblair: the next question is releated, sdague woudl like to hold a meetign in #openstack-dev because it's very cross-project ....02:38
jeblairalt==2 :)02:38
hogepodgejeblair: that's just silly02:39
jeblairhogepodge: no argument02:39
jeblairhogepodge: we have an organically growing community.  sometimes that's not as elegant as we might like.02:39
jeblairtonyb: i think it should be in a meeting channel.02:39
*** unicell has quit IRC02:40
tonybjeblair: okay.02:40
tonybjeblair: Feel free to add a comment to: https://review.openstack.org/245745 ;P02:41
tonybjeblair: but I'll also do some digging.02:41
openstackgerritMerged openstack/requirements: Add virtualenv to global requirements  https://review.openstack.org/22723902:42
tonybjeblair: So what do the "meetbots:\n\topen_stack" lines do in accessbot/channels.yaml?02:44
*** tqtran-afk has quit IRC02:44
jeblairtonyb: they give meetbot the permissions it needs to set channel topics02:44
jeblairtonyb: (it can not do so otherwise)02:45
*** baoli has quit IRC02:45
jeblairi can not find the thread ttx is referring to02:45
tonybjeblair: okay.02:45
hogepodgejeblair: to be fair, registering a room with the infra team gives you logged meeting powers, so once it's there it's easy to use them02:45
jeblairtonyb: do you have any idea?02:45
*** baoli has joined #openstack-infra02:45
tonybjeblair: No I'm still grepping my mbox02:45
jeblairhogepodge: yes, see the start of this conversation :)02:46
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements  https://review.openstack.org/24611402:49
*** woodster_ has quit IRC02:49
openstackgerritVilobh Meshram proposed openstack/requirements: Add python consul client  https://review.openstack.org/24602102:50
*** btully has joined #openstack-infra02:50
*** lhcheng_ has joined #openstack-infra02:52
*** baoli has quit IRC02:52
anteayaI worked on a patch for a bit to take meeting permissions away from non meeting channels at a request from markmcclain because people would not realize they were in neutron and would just start a meeting02:54
anteayaat the time there wasn't much push to finish it and I didn't02:55
*** btully has quit IRC02:55
anteayawas probably about 2 years ago now02:55
*** rlandy has quit IRC02:55
anteayathere we are: https://review.openstack.org/#/c/82898/02:56
*** fedexo has joined #openstack-infra02:57
*** kushal has joined #openstack-infra02:57
anteayaclarkb wanted me to extend meetbot's config and that is where I think I never got my bearings to come back to it again02:57
openstackgerritMerged openstack-infra/irc-meetings: Correcting the Kuryr project meeting times  https://review.openstack.org/24586802:58
*** dramalho has joined #openstack-infra02:58
*** baoli has joined #openstack-infra02:58
*** sdake has joined #openstack-infra03:00
*** gildub_ has joined #openstack-infra03:00
*** bardia_ has quit IRC03:01
anteayayear and a half03:02
*** annegentle has joined #openstack-infra03:02
*** dramalho has quit IRC03:03
*** Sree has joined #openstack-infra03:05
*** bapalm has quit IRC03:06
*** Sree has quit IRC03:07
*** fedexo has quit IRC03:08
*** Sree has joined #openstack-infra03:08
*** cody-somerville has joined #openstack-infra03:10
*** cody-somerville has quit IRC03:10
*** cody-somerville has joined #openstack-infra03:10
*** Yanyanhu has quit IRC03:11
*** lhcheng_ has left #openstack-infra03:14
*** salv-orlando has joined #openstack-infra03:16
*** sdake has quit IRC03:16
tonybanteaya: :)03:17
*** jerryz has quit IRC03:17
*** timrc has quit IRC03:17
*** davideagnello has quit IRC03:18
*** yuanying has quit IRC03:18
*** devananda has quit IRC03:18
*** davideagnello has joined #openstack-infra03:21
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500903:21
*** shuquan has joined #openstack-infra03:24
*** timrc has joined #openstack-infra03:24
*** annegentle has quit IRC03:25
*** shuquan has quit IRC03:26
*** yamamoto has joined #openstack-infra03:28
*** eliqiao_ has joined #openstack-infra03:29
anteayaso if anyone is about to reactivate gerrit account id 11466: http://lists.openstack.org/pipermail/openstack-infra/2015-November/003448.html I am grateful03:29
*** bdemers has quit IRC03:30
anteayaand if you look at the thread view for this thread: http://lists.openstack.org/pipermail/openstack-infra/2015-November/003446.html why do only my posts show up in the archives?03:30
anteayaMonica cc'd infra03:30
*** bdemers has joined #openstack-infra03:30
* anteaya is clearly missing something03:30
*** devananda has joined #openstack-infra03:31
*** eliqiao has quit IRC03:31
*** jerryz has joined #openstack-infra03:32
anteayaand now sleep03:34
openstackgerritColleen Murphy proposed openstack-infra/system-config: Expose enable_unbound in openstack_project::server  https://review.openstack.org/24614403:36
*** salv-orlando has quit IRC03:41
*** ivar-laz_ has joined #openstack-infra03:46
*** shuquan has joined #openstack-infra03:48
*** ivar-lazzaro has quit IRC03:49
*** achanda has quit IRC03:50
*** tsg has joined #openstack-infra03:51
*** btully has joined #openstack-infra03:51
*** binbincong has joined #openstack-infra03:51
*** shuquan has quit IRC03:53
openstackgerritChangBo Guo(gcb) proposed openstack/requirements: Bump oslo.utils to 2.8.0  https://review.openstack.org/24614903:54
*** fedexo has joined #openstack-infra03:57
*** Yanyanhu has joined #openstack-infra04:01
*** ivar-laz_ has quit IRC04:05
openstackgerritMerged openstack-infra/project-config: Add reno jobs for sahara  https://review.openstack.org/24308504:05
*** jffische has quit IRC04:06
*** dims has quit IRC04:06
*** yuanying has joined #openstack-infra04:08
*** _ody has joined #openstack-infra04:10
*** Yanyanhu has quit IRC04:10
*** Yanyanhu has joined #openstack-infra04:11
*** MarkAtwood has joined #openstack-infra04:11
*** otter768 has joined #openstack-infra04:11
*** spzala has quit IRC04:14
*** barnaby has quit IRC04:14
*** otter768 has quit IRC04:16
*** jswarren has quit IRC04:17
*** Ramanjaneya has joined #openstack-infra04:17
*** jswarren has joined #openstack-infra04:17
*** akshai has quit IRC04:17
*** Yanyanhu has quit IRC04:18
*** akshai has joined #openstack-infra04:18
*** achanda has joined #openstack-infra04:21
*** bochi-michael has joined #openstack-infra04:21
*** sputnik13 has quit IRC04:25
*** tchaypo_znc has quit IRC04:25
*** barnaby has joined #openstack-infra04:27
*** mahatic has joined #openstack-infra04:37
*** Yanyanhu has joined #openstack-infra04:38
*** woodster_ has joined #openstack-infra04:40
*** sdake has joined #openstack-infra04:42
*** Yanyan has joined #openstack-infra04:43
*** _denisra has quit IRC04:44
*** Yanyanhu has quit IRC04:44
*** bdemers has quit IRC04:45
*** bdemers has joined #openstack-infra04:46
*** tiswanso has quit IRC04:48
openstackgerritYanyan Hu proposed openstack-infra/project-config: Enable pre_test_hook for Senlin functional test  https://review.openstack.org/24447804:48
*** salv-orlando has joined #openstack-infra04:53
*** schang_ has joined #openstack-infra04:53
*** electrical_ has joined #openstack-infra04:53
*** warpc_ has joined #openstack-infra04:54
openstackgerritMerged openstack-infra/project-config: Add check-requirements to astara projects  https://review.openstack.org/24596204:54
*** esheffield has joined #openstack-infra04:54
*** sdake has quit IRC04:55
*** Nakato_ has joined #openstack-infra04:55
*** matt___ has joined #openstack-infra04:55
*** HeOS__ has joined #openstack-infra04:56
*** swann has joined #openstack-infra04:56
tonybjeblair: FTR: I think this is the thread ttx was talking about: http://lists.openstack.org/pipermail/openstack-dev/2015-November/078374.html04:56
*** doffm has joined #openstack-infra04:56
openstackgerritMerged openstack-infra/project-config: Use same job for check and gate for opencafe  https://review.openstack.org/24375804:57
*** _d34dh0r53_ has joined #openstack-infra04:57
*** jyuso has joined #openstack-infra04:58
*** jhesketh_ has joined #openstack-infra04:58
*** cfarquhar_ has joined #openstack-infra04:58
*** Kiall_ has joined #openstack-infra04:58
*** ayoung_ has joined #openstack-infra04:58
*** binbincong_ has joined #openstack-infra04:58
*** gongysh has joined #openstack-infra04:58
*** sdake has joined #openstack-infra04:59
*** ruagair_ has joined #openstack-infra04:59
*** cburgess_ has joined #openstack-infra04:59
*** baoli has quit IRC05:00
*** zz_dimtruck has quit IRC05:00
*** isviridov_away has quit IRC05:00
*** gondoi has quit IRC05:00
*** rm_work has quit IRC05:00
*** sigmavirus24_awa has quit IRC05:00
*** jbryce has quit IRC05:00
*** SergeyLukjanov has quit IRC05:00
*** schang has quit IRC05:00
*** charz has quit IRC05:00
*** dtroyer_zz has quit IRC05:00
*** ryanpetrello has quit IRC05:00
*** dolphm has quit IRC05:00
*** serverascode has quit IRC05:00
*** flaper87 has quit IRC05:00
*** xnox has quit IRC05:00
*** dougshelley66 has quit IRC05:00
*** jyuso1 has quit IRC05:00
*** schang_ is now known as schang05:00
*** redrobot has quit IRC05:00
*** electrical has quit IRC05:00
*** vaidy_ril has quit IRC05:00
*** cloudnull has quit IRC05:00
*** rainya has quit IRC05:00
*** jklare has quit IRC05:00
*** HeOS_ has quit IRC05:00
*** swann_ has quit IRC05:00
*** cburgess has quit IRC05:00
*** binbincong has quit IRC05:00
*** jhesketh has quit IRC05:00
*** ayoung has quit IRC05:00
*** d34dh0r53 has quit IRC05:00
*** lewo has quit IRC05:00
*** Nakato has quit IRC05:00
*** esheffield_ has quit IRC05:00
*** jamielennox has quit IRC05:00
*** warpc has quit IRC05:00
*** flwang1 has quit IRC05:00
*** ruagair has quit IRC05:00
*** mgagne has quit IRC05:00
*** adam_g has quit IRC05:00
*** jroll has quit IRC05:00
*** sbadia has quit IRC05:00
*** cody-somerville- has quit IRC05:00
*** doffm_ has quit IRC05:00
*** jpeeler has quit IRC05:00
*** afazekas has quit IRC05:00
*** cfarquhar has quit IRC05:00
*** bkero has quit IRC05:00
*** notmyname has quit IRC05:00
*** Kiall has quit IRC05:00
*** stevemar_ has quit IRC05:00
*** mattoliverau has quit IRC05:00
*** jroll has joined #openstack-infra05:00
*** rainya has joined #openstack-infra05:00
*** jhesketh_ is now known as jhesketh05:00
*** adam_g` has joined #openstack-infra05:00
*** ruagair_ is now known as ruagair05:00
*** cody-somerville- has joined #openstack-infra05:00
*** rm_work has joined #openstack-infra05:00
*** jklare has joined #openstack-infra05:00
*** jhesketh has quit IRC05:00
*** mgagne has joined #openstack-infra05:00
*** SergeyLukjanov has joined #openstack-infra05:00
*** dolphm has joined #openstack-infra05:01
*** jhesketh has joined #openstack-infra05:01
*** ryanpetrello has joined #openstack-infra05:01
*** flaper87 has joined #openstack-infra05:01
*** jpeeler has joined #openstack-infra05:01
*** dtroyer has joined #openstack-infra05:01
*** jamielennox has joined #openstack-infra05:01
*** dougshelley66 has joined #openstack-infra05:01
*** gondoi has joined #openstack-infra05:01
*** redrobot has joined #openstack-infra05:01
*** warpc_ is now known as warpc05:01
*** sigmavirus24_awa has joined #openstack-infra05:01
*** zz_dimtruck has joined #openstack-infra05:01
*** jbryce has joined #openstack-infra05:01
*** zz_dimtruck is now known as dimtruck05:01
*** cloudnull has joined #openstack-infra05:01
*** redrobot is now known as Guest2617705:01
*** jroll has quit IRC05:02
*** jroll has joined #openstack-infra05:02
*** jroll is now known as Guest8904005:02
*** sigmavirus24_awa has quit IRC05:02
*** sigmavirus24_awa has joined #openstack-infra05:02
*** sigmavirus24_awa is now known as Guest8755305:02
*** xnox has joined #openstack-infra05:02
*** cloudnull is now known as Guest8618105:02
*** afazekas has joined #openstack-infra05:02
*** vaidy_ril has joined #openstack-infra05:02
*** lewo has joined #openstack-infra05:02
*** bkero has joined #openstack-infra05:02
*** notmyname has joined #openstack-infra05:03
*** flwang has joined #openstack-infra05:03
*** charz has joined #openstack-infra05:03
*** serverascode has joined #openstack-infra05:03
*** sbadia has joined #openstack-infra05:04
*** fitoduarte has joined #openstack-infra05:04
*** electrical_ is now known as electrical05:05
*** salv-orlando has quit IRC05:05
*** jamielennox is now known as jamielennox|away05:06
*** Guest86181 is now known as cloudkiller05:08
*** isviridov_away has joined #openstack-infra05:09
*** bdemers has quit IRC05:10
*** amotoki has joined #openstack-infra05:10
*** achanda_ has joined #openstack-infra05:16
*** jpmaxman has quit IRC05:17
*** sheeprine_ has joined #openstack-infra05:17
*** mrmartin has joined #openstack-infra05:17
*** teran has quit IRC05:17
*** zxiiro has quit IRC05:17
*** jed56 has quit IRC05:17
*** ashtokolov has quit IRC05:18
*** auggy has quit IRC05:18
*** Ng_ has joined #openstack-infra05:18
*** roaet- has joined #openstack-infra05:18
*** GheRivero has quit IRC05:18
*** dtardivel has quit IRC05:18
*** greghaynes has quit IRC05:19
*** bnemec has joined #openstack-infra05:19
*** doffm_ has joined #openstack-infra05:20
*** gongysh has quit IRC05:20
openstackgerritfumihiko kakuma proposed openstack-infra/project-config: Add job for networking-ofagent  https://review.openstack.org/24498605:20
*** SotK_ has joined #openstack-infra05:21
*** Vivek_ has joined #openstack-infra05:21
*** stack_ has joined #openstack-infra05:23
*** jvrbanac_ has joined #openstack-infra05:24
*** sirushti_ has joined #openstack-infra05:24
*** electrichead has joined #openstack-infra05:24
*** Guest26177 has quit IRC05:25
*** doffm has quit IRC05:25
*** achanda has quit IRC05:25
*** yonglihe has quit IRC05:25
*** rui-zang has quit IRC05:25
*** zaro has quit IRC05:25
*** spredzy has quit IRC05:25
*** beekneemech has quit IRC05:25
*** erikmwilson has quit IRC05:25
*** sheeprine has quit IRC05:25
*** SotK has quit IRC05:25
*** samueldmq has quit IRC05:25
*** DuncanT has quit IRC05:25
*** sballe has quit IRC05:25
*** zeljkof has quit IRC05:25
*** Ng has quit IRC05:25
*** Vivek has quit IRC05:25
*** jvrbanac has quit IRC05:25
*** sflanigan has quit IRC05:25
*** Mmike has quit IRC05:25
*** mgkwill has quit IRC05:25
*** mission712 has quit IRC05:25
*** markmcclain has quit IRC05:25
*** roaet_ has quit IRC05:25
*** sirushti has quit IRC05:25
*** jbernard has quit IRC05:25
*** onder has quit IRC05:25
*** sirushti_ is now known as sirushti05:25
*** spredzy_ has joined #openstack-infra05:25
*** erikmwilson has joined #openstack-infra05:25
*** Ng_ is now known as Ng05:26
*** DuncanT has joined #openstack-infra05:26
*** Mmike has joined #openstack-infra05:27
*** sdake has quit IRC05:27
*** samueldmq has joined #openstack-infra05:27
*** amotoki has quit IRC05:27
*** sflanigan has joined #openstack-infra05:28
*** sflanigan has joined #openstack-infra05:28
*** amotoki has joined #openstack-infra05:28
*** zaro has joined #openstack-infra05:29
*** jpmaxman has joined #openstack-infra05:29
*** auggy has joined #openstack-infra05:30
*** sballe has joined #openstack-infra05:30
*** zxiiro has joined #openstack-infra05:30
*** jbernard has joined #openstack-infra05:30
*** onder has joined #openstack-infra05:30
*** mgkwill has joined #openstack-infra05:31
*** markmcclain has joined #openstack-infra05:31
*** shashank_hegde has joined #openstack-infra05:31
openstackgerritEthan Lynn proposed openstack/requirements: Bump senlinclient to 0.1.5  https://review.openstack.org/24585905:31
*** zeljkof has joined #openstack-infra05:31
*** GheRivero has joined #openstack-infra05:32
*** gus has quit IRC05:33
*** sdake has joined #openstack-infra05:33
*** gus has joined #openstack-infra05:34
*** dtardivel has joined #openstack-infra05:35
*** greghaynes has joined #openstack-infra05:35
*** ashtokolov has joined #openstack-infra05:35
*** ccrouch has quit IRC05:36
*** mission712 has joined #openstack-infra05:38
*** yonglihe has joined #openstack-infra05:38
*** eliqiao has joined #openstack-infra05:38
*** teran has joined #openstack-infra05:38
*** akshai has quit IRC05:38
*** jed56 has joined #openstack-infra05:39
*** eliqiao_ has quit IRC05:41
*** adam_g` is now known as adam_g05:42
*** adam_g has quit IRC05:42
*** adam_g has joined #openstack-infra05:42
*** bpokorny has joined #openstack-infra05:43
*** shashank_hegde has quit IRC05:44
*** mrmartin has quit IRC05:44
*** bdemers has joined #openstack-infra05:47
*** matt___ is now known as mattoliverau05:59
*** ParsectiX has quit IRC06:01
*** unicell has joined #openstack-infra06:07
*** yfried__ has quit IRC06:07
*** bpokorny has quit IRC06:09
*** sirushti has quit IRC06:11
*** sirushti has joined #openstack-infra06:11
*** otter768 has joined #openstack-infra06:12
*** cody-somerville has quit IRC06:13
*** zeih has joined #openstack-infra06:16
*** otter768 has quit IRC06:16
*** zeih has quit IRC06:20
*** rcernin has joined #openstack-infra06:22
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Translate liberty for openstack-manuals  https://review.openstack.org/24620106:24
*** bochi-michael has quit IRC06:24
*** korzen has joined #openstack-infra06:25
*** cody-somerville has joined #openstack-infra06:29
*** bochi-michael has joined #openstack-infra06:30
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Add bifrost manifest  https://review.openstack.org/23175706:30
*** salv-orlando has joined #openstack-infra06:34
*** hdd has joined #openstack-infra06:34
*** salv-orlando has quit IRC06:37
*** abregman has joined #openstack-infra06:40
*** aeng has quit IRC06:42
*** adduarte has joined #openstack-infra06:43
*** eliqiao has quit IRC06:44
*** sridhar_ram has joined #openstack-infra06:44
*** fitoduarte has quit IRC06:44
*** eliqiao has joined #openstack-infra06:45
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/24550406:45
*** duartea has joined #openstack-infra06:45
*** cody-somerville has quit IRC06:46
*** adduarte has quit IRC06:49
*** sileht has joined #openstack-infra06:49
*** woodster_ has quit IRC06:49
*** camunoz has quit IRC06:52
*** angdraug has joined #openstack-infra06:53
*** jerryz has quit IRC06:55
*** sridhar_ram has quit IRC06:58
*** Yanyan has quit IRC07:00
*** gildub_ has quit IRC07:00
*** unicell1 has joined #openstack-infra07:01
*** MarkAtwood has quit IRC07:01
*** dhellmann has quit IRC07:01
*** dhellmann has joined #openstack-infra07:02
*** unicell has quit IRC07:02
*** fedexo has quit IRC07:02
*** harlowja_at_home has joined #openstack-infra07:03
*** yfried__ has joined #openstack-infra07:04
*** yonglihe has quit IRC07:04
*** unicell has joined #openstack-infra07:05
*** unicell1 has quit IRC07:05
*** tsg has quit IRC07:08
*** yfried__ has quit IRC07:08
*** yfried__ has joined #openstack-infra07:09
*** _denisra has joined #openstack-infra07:09
*** maishsk has quit IRC07:10
*** shashank_hegde has joined #openstack-infra07:10
openstackgerritAlexander Evseev proposed openstack-infra/zuul: Add style for skipped jobs  https://review.openstack.org/24622607:14
*** ParsectiX has joined #openstack-infra07:16
*** harlowja_at_home has quit IRC07:17
*** jyuso has quit IRC07:20
*** jyuso has joined #openstack-infra07:21
*** Yanyanhu has joined #openstack-infra07:25
*** btully has quit IRC07:30
*** sdake has quit IRC07:30
*** shashank_hegde has quit IRC07:31
*** achanda_ has quit IRC07:36
*** spredzy_ is now known as spredzy07:36
openstackgerritFredrik Medley proposed openstack-infra/zuul: Improve job dependencies using graph instead of tree  https://review.openstack.org/23112407:37
*** nadya_ has joined #openstack-infra07:40
*** sambetts has quit IRC07:40
openstackgerritFredrik Medley proposed openstack-infra/zuul: Improve job dependencies using graph instead of tree  https://review.openstack.org/23112407:45
*** sambetts has joined #openstack-infra07:45
*** Mmike has quit IRC07:46
*** Mmike has joined #openstack-infra07:46
openstackgerritKATO Tomoyuki proposed openstack-infra/jeepyb: Add docs contributor guide to the welcome message  https://review.openstack.org/24623607:46
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Add bifrost manifest  https://review.openstack.org/23175707:55
openstackgerritKATO Tomoyuki proposed openstack-infra/jeepyb: Add docs contributor guide to the welcome message  https://review.openstack.org/24623608:00
*** maishsk has joined #openstack-infra08:01
*** doronshai has joined #openstack-infra08:02
doronshaiabout feature branches again, I understand that this is a heavyweight operation, but i also see that it is supported by openstack according to documentation (just for specific cases...). when i write git review name_of_feature_branch i get this exception : The branch 'feature/new_branch' does not exist on the given remote 'origin'. If these changes are intended to start a new branch, re-run with the '-R' option enabled.08:04
anteayadoronshai: have you read this documentation? http://docs.openstack.org/infra/manual/drivers.html#feature-branches08:06
*** mrmartin has joined #openstack-infra08:08
*** shardy has joined #openstack-infra08:09
*** nmagnezi has joined #openstack-infra08:09
doronshaiI did, but when i psuh with -R then i got -  ! [remote rejected] HEAD -> refs/publish/feature/new_branch/dev (branch feature/new_branch/dev not found)08:11
*** zeih has joined #openstack-infra08:13
*** otter768 has joined #openstack-infra08:13
anteayaand does your repo have pushMerge enabled on it? http://docs.openstack.org/infra/manual/drivers.html#merge-commits08:13
*** matrohon has joined #openstack-infra08:15
*** scheuran has joined #openstack-infra08:15
doronshaianteaya: yes, i have it08:17
*** otter768 has quit IRC08:18
anteayagreat then I don't know why you can't create a feature branch for your repo08:18
doronshaiand according to the eror that i see it is still trying to add the word dev to the frature name, including it is located under refs/publish08:18
*** mgrosz has joined #openstack-infra08:18
mgroszHello,08:18
mgroszI have lately added the new Vitrage RCA project for OpenStack.08:18
mgroszI have followed the instructions for adding a setting a new project, but for some reason, when I enters OpenStack launchpad - https://launchpad.net/openstack08:18
mgroszI don’t see the Vitrage project in the lists (for example, I don’t see any of our blueprints when I enter the launchpad blueprints: https://blueprints.launchpad.net/openstack)08:18
mgroszWhat do I miss? Where did I need to add Vitrage so that it would appear?08:18
mgroszThanks,08:18
mgroszMaty08:18
anteayadoronshai: what is the repo name?08:19
doronshaiit is local repo, not openstack repo08:19
anteayamgrosz: have you the url of the patch that created a repo08:19
openstackgerritMerged openstack-infra/devstack-gate: Produce a script to reproduce the running build  https://review.openstack.org/24477208:19
mgroszanteaya: sorry, what URL?08:19
anteayadoronshai: I don't understand, are you trying to submit a feature branch to gerrit?08:20
anteayamgrosz: you say a new project was created, do you have the url of the project-config patch that created the repo?08:20
doronshaianteaya: yes but I am wokring on a privat gerrit server in our lab, not part of openstack. it is just that we want to work in the same way using the 'git review' and I see errors that are not documented08:21
mgroszanteaya: no08:22
anteayadoronshai: oh okay, so you are certain that the gerrit permissions for that repo on your private gerrit have pushMerge for that repo?08:22
anteayadoronshai: the most common issue with actions that are blocked is that gerrit permissions are not set up properly08:23
doronshaianteaya: checking08:23
anteayamgrosz: have you spend any time with this document? http://docs.openstack.org/infra/manual/creators.html#set-up-launchpad08:25
mgroszanteaya: yes. This is the page I followed when I created the Vitrage project08:26
*** yfried has joined #openstack-infra08:27
*** yfried__ has quit IRC08:27
*** ildikov has quit IRC08:28
mgroszanteaya: It either someone needs to configure OpenStack  main page in launchpad to add Vitrage to it, or it is done automatically using some configuration files which I am not familiar with08:28
anteayaI don't know much about launchpad08:29
*** mpavone has joined #openstack-infra08:30
anteayajeblair: is the admin for the openstack-admins team: https://launchpad.net/~openstack-admins so perhaps when he is next online he can offer some thoughts on how a project gets listed on the openstack launchpad page08:30
anteayathere are no configuration files for launchpad08:30
anteayajust launchpad settings08:31
doronshaianteaya: yes i have the permissons: [access "refs/for/refs/*"]     pushMerge = group gerrit_main_developers08:31
shardyMorning all08:31
shardyanteaya: Hey, is there any chance you can check out https://review.openstack.org/#/c/245693/ we discussed yesterday?08:32
anteayadoronshai: then I don't have any idea why you are having issues, we have reached the end of my ability to help you08:32
shardyIt's got one +2 already08:32
anteayashardy: yes, it is from me08:32
anteayaand on that note good night08:32
anteayaI have to go back to bed now08:32
doronshaianteaya: Thanks08:32
shardyanteaya: Oh, I'm sorry, I mismatched irc nics, thanks!08:33
anteayashardy: welcome08:33
anteayadoronshai: sorry I couldn't help you08:33
*** mgrosz has quit IRC08:34
*** bkero has quit IRC08:34
*** bkero has joined #openstack-infra08:34
*** egonzalez has joined #openstack-infra08:35
*** dingyichen has quit IRC08:37
*** sshnaidm has joined #openstack-infra08:39
*** ifarkas has joined #openstack-infra08:41
*** jtomasek has quit IRC08:41
*** jlanoux has joined #openstack-infra08:41
*** mpavone has quit IRC08:43
*** korzen has quit IRC08:43
*** salv-orlando has joined #openstack-infra08:45
*** egonzalez has quit IRC08:46
*** egonzalez90 has joined #openstack-infra08:47
openstackgerritMerged openstack-infra/project-config: Lodgeit: Downgrade gate and check jobs to experimental  https://review.openstack.org/24577108:48
*** stack_ has quit IRC08:50
*** jordanP has joined #openstack-infra08:51
*** mpavone has joined #openstack-infra08:53
*** mpavone has quit IRC08:53
*** k4n0 has joined #openstack-infra08:54
*** ihrachys has joined #openstack-infra08:56
*** yfried has quit IRC08:56
*** yfried__ has joined #openstack-infra08:56
*** sheeprine_ is now known as sheeprine08:58
*** sheeprine has joined #openstack-infra08:58
*** salv-orlando has quit IRC08:59
*** markus_z has quit IRC09:00
*** markus_z has joined #openstack-infra09:03
*** btully has joined #openstack-infra09:06
*** ildikov has joined #openstack-infra09:06
openstackgerritAlexander Evseev proposed openstack-infra/zuul: Allow using numeric change number in addition to ID in Depends-On tag  https://review.openstack.org/21555309:07
*** rossella_s has quit IRC09:07
*** rossella_s has joined #openstack-infra09:08
*** maishsk has quit IRC09:08
*** maximov has joined #openstack-infra09:10
*** dizquierdo has joined #openstack-infra09:12
*** yamamoto has quit IRC09:12
*** hashar has joined #openstack-infra09:15
*** salv-orlando has joined #openstack-infra09:15
*** salv-orlando has quit IRC09:15
*** salv-orlando has joined #openstack-infra09:15
*** salv-orlando has quit IRC09:20
*** salv-orlando has joined #openstack-infra09:20
*** ParsectiX has quit IRC09:22
*** ekarlso has quit IRC09:22
*** ihrachys has quit IRC09:24
*** ihrachys has joined #openstack-infra09:26
openstackgerritMerged openstack-infra/project-config: Update channel setup for openstack-docs  https://review.openstack.org/24584609:26
*** nadya_ has quit IRC09:28
*** markmcd has quit IRC09:28
*** Liuqing has joined #openstack-infra09:28
*** openstackgerrit has quit IRC09:31
*** ihrachys has quit IRC09:31
*** openstackgerrit has joined #openstack-infra09:32
*** electrofelix has joined #openstack-infra09:32
*** markmcd has joined #openstack-infra09:32
openstackgerritMehdi Abaakouk (sileht) proposed openstack/requirements: Bump ceilometerclient to 2.0.0  https://review.openstack.org/24627709:33
*** ihrachys has joined #openstack-infra09:35
openstackgerritMehdi Abaakouk (sileht) proposed openstack/requirements: Add gnocchiclient to requirements  https://review.openstack.org/24628009:37
openstackgerritEinst Crazy proposed openstack-infra/zuul: Close config_file after config read out  https://review.openstack.org/24628109:37
*** ekarlso has joined #openstack-infra09:37
*** achanda has joined #openstack-infra09:38
*** ekarlso has quit IRC09:38
*** ekarlso has joined #openstack-infra09:38
*** nikil89_ has joined #openstack-infra09:43
*** claudiub has joined #openstack-infra09:44
*** ParsectiX has joined #openstack-infra09:44
*** nikil89_ is now known as naggappan09:47
*** luqas has joined #openstack-infra09:48
*** e0ne has joined #openstack-infra09:48
*** mgrosz has joined #openstack-infra09:48
mgroszHello, can someone please review https://review.openstack.org/#/c/245671/ and give it the second +2? Thnkas.09:49
*** ParsectiX has quit IRC09:49
*** esker has joined #openstack-infra09:49
*** yamamoto has joined #openstack-infra09:52
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Publish also from branches  https://review.openstack.org/24628409:52
*** ParsectiX has joined #openstack-infra09:52
*** ParsectiX has quit IRC09:54
*** Yanyanhu has quit IRC09:54
*** esker has quit IRC09:54
*** ParsectiX has joined #openstack-infra09:54
*** dizquierdo has quit IRC09:54
*** esker has joined #openstack-infra09:55
*** ihrachys has quit IRC09:55
*** esker has quit IRC09:55
*** Liuqing has quit IRC09:56
*** ekarlso has quit IRC09:57
*** Liuqing has joined #openstack-infra09:57
*** luqas has quit IRC09:57
*** zhurong has quit IRC09:58
*** dizquierdo has joined #openstack-infra09:58
*** achanda has quit IRC10:00
*** rguillebert has joined #openstack-infra10:00
*** Sree_ has joined #openstack-infra10:01
*** Sree_ is now known as Guest5027310:02
openstackgerritMerged openstack-infra/lodgeit: Security fix for possible private paste bruteforcing  https://review.openstack.org/21822810:04
*** markvoelker has quit IRC10:05
*** Sree has quit IRC10:05
*** zns has joined #openstack-infra10:06
*** Liuqing has quit IRC10:06
*** e0ne has quit IRC10:07
openstackgerritAkihiro Motoki proposed openstack/requirements: Bump oslo.config >=2.7.0  https://review.openstack.org/24629410:08
*** ociuhandu has quit IRC10:09
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Fix up the tests and add tox configuration to run them  https://review.openstack.org/23463710:10
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Replace XXX with TODO  https://review.openstack.org/24278010:10
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Add tox configuration to enable PEP-8 checks, and fix various failures  https://review.openstack.org/24186810:10
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Ignore the virtualenv folder and Eclipse's settings files.  https://review.openstack.org/24156910:10
openstackgerritLucas Alvares Gomes proposed openstack/diskimage-builder: Add login-troubleshooting element  https://review.openstack.org/24508210:12
*** achanda has joined #openstack-infra10:12
*** paco20151113 has quit IRC10:12
*** ildikov has quit IRC10:12
*** daemontool has joined #openstack-infra10:12
*** ihrachys has joined #openstack-infra10:13
*** eliqiao has quit IRC10:13
*** otter768 has joined #openstack-infra10:14
*** daemontool has quit IRC10:14
openstackgerritMerged openstack-infra/project-config: check-requirements for swauth  https://review.openstack.org/24595210:14
openstackgerritMerged openstack-infra/project-config: Add pypi publishing job for networking-powervm  https://review.openstack.org/23346610:14
*** daemontool has joined #openstack-infra10:15
*** eliqiao has joined #openstack-infra10:16
*** achanda has quit IRC10:16
openstackgerritMerged openstack-infra/project-config: Create vitrage-dashboard.config project file  https://review.openstack.org/24567110:16
*** Guest50273 has quit IRC10:17
*** luqas has joined #openstack-infra10:17
*** Sree has joined #openstack-infra10:17
*** egonzalez90 has quit IRC10:18
*** otter768 has quit IRC10:18
*** rpodolyaka1 has joined #openstack-infra10:18
*** egonzalez has joined #openstack-infra10:20
openstackgerritMerged openstack-infra/ansible-puppet: Default show_diff to false just for completeness  https://review.openstack.org/24044510:21
*** luqas has quit IRC10:23
openstackgerritMerged openstack-infra/project-config: Added new projects for the OSA role break out  https://review.openstack.org/24395210:24
*** ihrachys has quit IRC10:27
*** luqas has joined #openstack-infra10:29
*** openstackgerrit has quit IRC10:31
*** ildikov has joined #openstack-infra10:31
*** thorst has joined #openstack-infra10:32
*** openstackgerrit has joined #openstack-infra10:32
*** ldnunes has joined #openstack-infra10:32
openstackgerritMerged openstack-infra/project-config: Add neutron-classifier as a project to infra  https://review.openstack.org/24414710:34
*** mgrosz has quit IRC10:35
*** thorst has quit IRC10:35
*** ekarlso has joined #openstack-infra10:36
*** ociuhandu has joined #openstack-infra10:37
*** Sree has quit IRC10:38
*** achanda has joined #openstack-infra10:38
*** zhenguo has quit IRC10:38
*** Sree has joined #openstack-infra10:39
*** ekarlso has quit IRC10:39
*** btully has quit IRC10:40
*** ihrachys has joined #openstack-infra10:40
openstackgerritMerged openstack-infra/storyboard-webclient: Fix dashboard subscriptions list  https://review.openstack.org/24581210:41
*** zns has quit IRC10:43
*** Sree has quit IRC10:43
*** dramalho has joined #openstack-infra10:43
*** elemoine has joined #openstack-infra10:45
*** jtomasek has joined #openstack-infra10:46
*** dramalho has quit IRC10:47
*** luqas has quit IRC10:48
*** daniloramalho has joined #openstack-infra10:48
silehtHi, someone can take a look to https://review.openstack.org/#/c/241205/ it unblocks the gnocchi gate 1.0 branch.10:48
*** yamamoto has quit IRC10:49
*** rpodolyaka1 has quit IRC10:50
*** mgrosz has joined #openstack-infra10:50
*** mgrosz has quit IRC10:51
daniloramalhoHello crinkle Can take a look at https://review.openstack.org/#/c/246053, please10:53
daniloramalhocrinkle: ^^10:54
*** ihrachys has quit IRC10:54
*** yamamoto has joined #openstack-infra10:56
*** ihrachys has joined #openstack-infra10:57
*** e0ne has joined #openstack-infra10:57
*** dizquierdo has quit IRC10:59
*** doronshai has quit IRC11:01
*** zns has joined #openstack-infra11:01
*** aysyd has joined #openstack-infra11:02
*** markvoelker has joined #openstack-infra11:06
openstackgerritSergey Nikitin proposed openstack/requirements: Updated oslo.db to 3.2.0  https://review.openstack.org/24632511:06
*** dims has joined #openstack-infra11:08
*** rfolco has joined #openstack-infra11:08
openstackgerritJesse Pretorius proposed openstack-infra/project-config: Add release note publishing for OpenStack-Ansible  https://review.openstack.org/24575211:09
openstackgerritAlexey Shtokolov proposed openstack-infra/project-config: Added and enabled gate for fuel-docs and fuel-ostf  https://review.openstack.org/24590211:09
odyssey4meyolanda https://review.openstack.org/245752 is just a rebase11:10
*** eliqiao has quit IRC11:10
*** daniloramalho has quit IRC11:10
yolandaok it lost the +2 so will need an extra reviewer11:10
*** daemontool has quit IRC11:11
*** markvoelker has quit IRC11:11
*** daemontool has joined #openstack-infra11:11
*** eliqiao has joined #openstack-infra11:12
odyssey4meyup, thanks - hopefully Andreas will pick it up11:12
*** zns has quit IRC11:13
shardyIf anyone can take a look at https://review.openstack.org/#/c/245693/ that would be great11:14
shardycurrently all TripleO stable CI is blocked on it11:14
openstackgerritIgor Malinovskiy proposed openstack-infra/project-config: Use Manila specific job templates for building images  https://review.openstack.org/23306511:14
*** salv-orl_ has joined #openstack-infra11:15
*** gildub_ has joined #openstack-infra11:16
*** salv-orlando has quit IRC11:17
*** dizquierdo has joined #openstack-infra11:22
*** daemontool has quit IRC11:23
*** gildub_ has quit IRC11:23
*** daemontool has joined #openstack-infra11:24
openstackgerritAlexey Shtokolov proposed openstack-infra/project-config: Added and enabled gates for ruby fuel repos  https://review.openstack.org/24633911:24
*** mahatic_ has joined #openstack-infra11:25
*** daemontool has quit IRC11:25
*** xnox has left #openstack-infra11:26
*** daemontool has joined #openstack-infra11:26
*** mrmartin has quit IRC11:26
*** dzamboni has joined #openstack-infra11:26
*** flaper87 has quit IRC11:27
*** flaper87 has joined #openstack-infra11:27
*** pc_m has joined #openstack-infra11:27
*** mahatic has quit IRC11:28
openstackgerritAlexey Shtokolov proposed openstack-infra/project-config: Added and enabled gates for ruby fuel repos  https://review.openstack.org/24633911:29
*** salv-orl_ has quit IRC11:31
*** salv-orlando has joined #openstack-infra11:32
*** ihrachys has quit IRC11:37
*** jhesketh has quit IRC11:37
*** jhesketh has joined #openstack-infra11:40
*** ihrachys has joined #openstack-infra11:43
*** achanda has quit IRC11:43
*** zns has joined #openstack-infra11:44
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Test a update in trunk repository version  https://review.openstack.org/22978911:45
*** maiteb has joined #openstack-infra11:49
*** amotoki has quit IRC11:49
*** ZZelle has quit IRC11:50
*** ZZelle has joined #openstack-infra11:51
*** markus_z has quit IRC11:51
*** ihrachys has quit IRC11:51
*** ihrachys has joined #openstack-infra11:52
*** ihrachys has quit IRC11:52
*** markus_z has joined #openstack-infra11:53
*** mgrosz has joined #openstack-infra11:53
*** jlanoux has quit IRC11:53
*** rpodolyaka1 has joined #openstack-infra11:57
*** glauco has joined #openstack-infra11:58
*** mrmartin has joined #openstack-infra11:58
*** Liuqing has joined #openstack-infra11:58
*** rpodolyaka1 has quit IRC11:59
mgroszQuestion: why a new group in gerrit, vitrage-dashboard, is still disabled for me to add memebers? Change that I did and was merged, https://review.openstack.org/#/c/245671/, was support to create this group.12:00
*** nadya_ has joined #openstack-infra12:02
*** Sree_ has joined #openstack-infra12:03
*** Sree_ is now known as Guest2404012:03
*** zns has quit IRC12:04
*** ParsectiX has quit IRC12:06
*** achanda has joined #openstack-infra12:06
*** stevemar_ has joined #openstack-infra12:06
*** ParsectiX has joined #openstack-infra12:06
*** ParsectiX has quit IRC12:08
*** rpodolyaka1 has joined #openstack-infra12:09
*** achanda has quit IRC12:09
*** w_ has joined #openstack-infra12:11
*** links has joined #openstack-infra12:12
*** zns has joined #openstack-infra12:12
*** links has quit IRC12:12
*** dramalho has joined #openstack-infra12:14
*** otter768 has joined #openstack-infra12:15
*** jyuso has quit IRC12:15
*** olaph has quit IRC12:15
openstackgerritMerged openstack-infra/project-config: Add releasenotes jobs to murano  https://review.openstack.org/24433412:15
*** dramalho has quit IRC12:19
*** otter768 has quit IRC12:19
openstackgerritAlexey Shtokolov proposed openstack-infra/project-config: Added and enabled gates for ruby fuel repos  https://review.openstack.org/24633912:21
*** elemoine_ has joined #openstack-infra12:24
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Test a update in trunk repository version  https://review.openstack.org/22978912:25
*** fawadkhaliq has quit IRC12:26
*** fawadkhaliq has joined #openstack-infra12:27
*** elemoine has quit IRC12:30
*** fawadkhaliq has quit IRC12:31
*** Guest89040 is now known as jroll12:36
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/24550412:36
*** markvoelker has joined #openstack-infra12:37
*** dizquierdo has quit IRC12:37
*** annegentle has joined #openstack-infra12:39
*** ihrachys has joined #openstack-infra12:40
*** markvoelker has quit IRC12:42
*** jtomasek has quit IRC12:43
*** annegentle has quit IRC12:44
*** smarcet has joined #openstack-infra12:45
*** ihrachys has quit IRC12:46
*** weshay_xchat has joined #openstack-infra12:46
*** mrmartin has quit IRC12:46
*** mrmartin has joined #openstack-infra12:46
*** trown|outttypeww is now known as trown12:46
*** mrmartin has quit IRC12:47
*** mrmartin has joined #openstack-infra12:47
openstackgerritVladimir Kozhukalov proposed openstack-infra/project-config: Enable voting for fuel-ostf gate jobs.  https://review.openstack.org/24636412:47
*** annegentle has joined #openstack-infra12:47
smarcetmordred: morning, how i should procede with https://review.openstack.org/#/c/245394/?12:47
smarcetwas failing bc a problem on a job12:48
*** mrmartin has quit IRC12:48
smarcetthink that now its fixed... should resubmit a new patch ?12:48
*** ParsectiX has joined #openstack-infra12:48
*** akurenyshev1 has quit IRC12:49
openstackgerritMerged openstack-infra/project-config: Make TripleO jobs run not only on master and remove noop-jobs  https://review.openstack.org/24569312:49
*** pc_m_ has joined #openstack-infra12:51
*** pc_m_ has quit IRC12:51
openstackgerritMerged openstack-infra/project-config: Add release note publishing for OpenStack-Ansible  https://review.openstack.org/24575212:52
*** ParsectiX has quit IRC12:52
*** baoli has joined #openstack-infra12:52
*** pc_m is now known as pc_m_AWAY12:53
*** maishsk has joined #openstack-infra12:54
*** korzen has joined #openstack-infra12:55
*** thorst has joined #openstack-infra12:55
*** nadya_ has quit IRC12:56
*** achanda has joined #openstack-infra12:56
*** ihrachys has joined #openstack-infra12:57
*** luqas has joined #openstack-infra12:57
*** ihrachys has quit IRC12:58
*** dprince has joined #openstack-infra12:59
*** amuller has joined #openstack-infra13:00
*** jffische has joined #openstack-infra13:00
*** yanyanhu has joined #openstack-infra13:01
*** ayoung_ has quit IRC13:01
*** doug-fish has joined #openstack-infra13:02
*** ParsectiX has joined #openstack-infra13:05
*** achanda has quit IRC13:05
*** ParsectiX has quit IRC13:07
*** rossella_s has quit IRC13:07
*** rossella_s has joined #openstack-infra13:07
*** luqas has quit IRC13:08
*** bdemers has quit IRC13:09
*** Ala has joined #openstack-infra13:10
*** ParsectiX has joined #openstack-infra13:12
*** rhallisey has joined #openstack-infra13:13
*** nadya_ has joined #openstack-infra13:15
*** pradk has joined #openstack-infra13:15
*** pradk has quit IRC13:15
*** weshay_xchat is now known as weshay13:16
*** gordc has joined #openstack-infra13:16
*** jlanoux has joined #openstack-infra13:17
*** signed8bit has joined #openstack-infra13:17
openstackgerritMerged openstack-infra/system-config: Only install modules from source  https://review.openstack.org/24268313:17
*** bexelbie_ has joined #openstack-infra13:17
*** pc_m_AWAY is now known as pc_mn13:17
*** ff has joined #openstack-infra13:17
*** ff has quit IRC13:18
*** jlanoux_ has joined #openstack-infra13:19
*** pc_mn has quit IRC13:20
openstackgerritMerged openstack-infra/system-config: Remove 'removed' modules, they have been removed  https://review.openstack.org/24268413:20
*** jlanoux has quit IRC13:21
*** peristeri has joined #openstack-infra13:21
samueldmqmay I use "SUSE linux" to refer to both openSUSE and SLE (SUSE Linux Enterpise) ?13:21
*** ala_ has joined #openstack-infra13:21
samueldmqin keystone dev environment docs http://docs.openstack.org/developer/keystone/devref/development.environment.html13:22
*** luqas__ has joined #openstack-infra13:22
samueldmqwe have : "This document assumes you are using Ubuntu, Fedora or openSUSE (SLE)"13:22
*** Ala has quit IRC13:22
samueldmqbut openSUSE and SLE aren't the same thing (that way I undertand that SLE was an abbreviation to openSUSE)13:23
samueldmqdoes this make sense ?13:23
*** kushal has quit IRC13:25
*** cloudkiller is now known as cloudnull13:26
*** zns has quit IRC13:26
*** bexelbie_ has quit IRC13:27
*** markvoelker has joined #openstack-infra13:27
dimssdague : hmm, 246013 is still not merged, should it be promoted?13:28
*** mgrosz has quit IRC13:28
dimssdague : https://review.openstack.org/#/c/246013/13:28
*** luqas__ has quit IRC13:29
*** barnaby has quit IRC13:29
*** luqas has joined #openstack-infra13:29
sdaguetypically we only do that for things that impact multiple projects13:29
sdagueit would be good to stop approving nova patches13:29
*** amrith is now known as _amrith_13:29
dimssdague : right, the gate is 8 hours deep13:30
*** dramalho has joined #openstack-infra13:30
*** zns has joined #openstack-infra13:32
dimssdague : haha, i was going to do just that :)13:32
sdaguedims: yeh, because nova patches got approved while this was broken13:32
dimssdague : touching up the commit messages :)13:32
*** Guest24040 has quit IRC13:32
*** burgerk has joined #openstack-infra13:32
*** bochi-michael has quit IRC13:32
*** Sree has joined #openstack-infra13:32
*** luqas has quit IRC13:33
*** elemoine_ has quit IRC13:33
*** amotoki has joined #openstack-infra13:34
*** elemoine has joined #openstack-infra13:34
*** luqas__ has joined #openstack-infra13:34
*** regXboi has joined #openstack-infra13:34
*** dramalho has quit IRC13:34
*** rpodolyaka1 has quit IRC13:35
*** bhunter71 has joined #openstack-infra13:36
*** pc_m has joined #openstack-infra13:36
*** pc_m has quit IRC13:36
*** Sree has quit IRC13:37
*** pc_m has joined #openstack-infra13:38
*** luqas__ has quit IRC13:38
*** luqas has joined #openstack-infra13:40
*** kgiusti has joined #openstack-infra13:40
*** zeih has quit IRC13:41
*** zeih_ has joined #openstack-infra13:41
*** tsg has joined #openstack-infra13:41
*** cdent has joined #openstack-infra13:41
*** cdent has left #openstack-infra13:41
*** jamespage has quit IRC13:42
*** dramalho has joined #openstack-infra13:42
openstackgerritChangBo Guo(gcb) proposed openstack/requirements: Bump oslo.utils to 2.8.0  https://review.openstack.org/24614913:42
*** pradk has joined #openstack-infra13:43
*** oomichi has quit IRC13:43
*** gnuoy has quit IRC13:43
openstackgerritMehdi Abaakouk (sileht) proposed openstack/requirements: Add gnocchiclient to requirements  https://review.openstack.org/24628013:44
*** luqas has quit IRC13:44
*** spzala has joined #openstack-infra13:44
*** zhurong has joined #openstack-infra13:45
*** nmagnezi_ has joined #openstack-infra13:46
*** nmagnezi has quit IRC13:46
*** hichihara has joined #openstack-infra13:48
*** luqas has joined #openstack-infra13:48
*** yfried__ has quit IRC13:49
bhunter71a question;  there's a subunit2sql 'server' in the CI infrastructure.. is this required or optional [in a downstream CI] ?   My nodepool image-build for devstack-trusty has recently started failing to prepare_tempest_testrepository -> write_subunit.  much thanks!13:50
*** kushal has joined #openstack-infra13:50
*** pc_m has quit IRC13:50
igorbelikovFolks, we have a couple more changes to enable gate jobs for Fuel. Can you please take a look at https://review.openstack.org/#/c/245902/ - this enables voting gates for fuel-docs and fuel-ostf13:51
*** eharney has quit IRC13:52
igorbelikovplus https://review.openstack.org/#/c/244217/ and https://review.openstack.org/#/c/246339/ - to add and enable rake-dsvm jobs for fuel-astute and fuel-nailgun-agent13:52
*** luqas has quit IRC13:53
*** pc_m has joined #openstack-infra13:55
*** pc_m has quit IRC13:55
*** rpodolyaka1 has joined #openstack-infra13:56
*** signed8bit is now known as signed8bit_ZZZzz13:56
*** claudiub has quit IRC13:56
*** luqas has joined #openstack-infra13:56
*** claudiub has joined #openstack-infra13:57
*** markus_z is now known as markus_z_meeting13:58
*** pc_m has joined #openstack-infra14:00
*** jlanoux_ has quit IRC14:00
*** signed8bit_ZZZzz is now known as signed8bit14:00
*** ekarlso has joined #openstack-infra14:01
*** jlanoux has joined #openstack-infra14:01
*** yanyanhu has quit IRC14:02
*** gnuoy has joined #openstack-infra14:03
openstackgerritgordon chung proposed openstack-infra/project-config: fix aodh gate  https://review.openstack.org/24639914:03
*** jamespage has joined #openstack-infra14:03
*** cdent has joined #openstack-infra14:04
openstackgerritgordon chung proposed openstack-infra/project-config: fix aodh gate  https://review.openstack.org/24639914:04
*** claudiub has quit IRC14:04
*** luqas has quit IRC14:05
*** olaph has joined #openstack-infra14:05
*** luqas has joined #openstack-infra14:05
*** claudiub has joined #openstack-infra14:05
*** w_ has quit IRC14:06
*** zns has quit IRC14:07
*** luqas has quit IRC14:09
openstackgerritDavid TARDIVEL proposed openstack-infra/system-config: Enable logging in #openstack-watcher  https://review.openstack.org/24640514:11
*** tdurakov has joined #openstack-infra14:12
*** thiagop has joined #openstack-infra14:12
*** rlandy has joined #openstack-infra14:12
*** bcourt has joined #openstack-infra14:13
*** pc_m_ has joined #openstack-infra14:14
*** burgerk has quit IRC14:15
*** pc_m_ has quit IRC14:15
openstackgerritSamuel de Medeiros Queiroz proposed openstack-infra/infra-manual: Improve docs on setting up development environment  https://review.openstack.org/22864714:15
*** otter768 has joined #openstack-infra14:15
samueldmqlifeless: ^14:15
*** julim has joined #openstack-infra14:16
*** zns has joined #openstack-infra14:17
*** dkranz has joined #openstack-infra14:17
*** cdent has left #openstack-infra14:17
*** bhunter71 has quit IRC14:17
*** monester has joined #openstack-infra14:19
*** signed8bit is now known as signed8bit_ZZZzz14:19
*** tsg has quit IRC14:19
*** tiswanso has joined #openstack-infra14:19
*** otter768 has quit IRC14:20
*** Ramanjaneya has quit IRC14:20
*** signed8bit_ZZZzz is now known as signed8bit14:21
*** vlaza has joined #openstack-infra14:24
*** watanabe_isao has joined #openstack-infra14:26
pabelangertimrc: do you have some time today for grafyaml reviews?  I'd like to see about cutting a release later this week14:26
*** alivigni has joined #openstack-infra14:29
*** mriedem has joined #openstack-infra14:32
*** ayoung_ has joined #openstack-infra14:33
*** sergmelikyan has joined #openstack-infra14:33
*** sergmelikyan has quit IRC14:34
*** sergmelikyan has joined #openstack-infra14:34
*** sergmelikyan has quit IRC14:34
*** akshai has joined #openstack-infra14:35
*** ttx has quit IRC14:36
*** nikhil_k is now known as nikhil14:39
*** ekarlso has quit IRC14:40
*** ttx has joined #openstack-infra14:40
*** amitgandhinz has joined #openstack-infra14:41
*** sergmelikyan has joined #openstack-infra14:41
*** doug-fish has quit IRC14:42
*** bdemers has joined #openstack-infra14:42
*** dizquierdo has joined #openstack-infra14:42
*** ParsectiX has quit IRC14:43
*** jtomasek has joined #openstack-infra14:43
*** moravec has joined #openstack-infra14:43
*** eharney has joined #openstack-infra14:43
*** gnuoy has quit IRC14:44
mordredsmarcet: you can just leave a comment of "recheck" (which I have now done)14:44
*** jamespage has quit IRC14:45
openstackgerrittatyana-leontovich proposed openstack-infra/project-config: Added and enabled gate for fuel-docs and fuel-ostf  https://review.openstack.org/24590214:45
*** salv-orl_ has joined #openstack-infra14:45
mordredsamueldmq: I think I would not lump the two together unless you're going to do the same with fedora/rhel - and then you have an issue with debian/ubuntu14:46
*** burgerk has joined #openstack-infra14:47
mordredsamueldmq: I'd just leave it as "assumes you are running ubuntu/fedora/openSUSE" - and same for the references below in the document14:47
*** kozhukalov_ has joined #openstack-infra14:48
*** fawadkhaliq has joined #openstack-infra14:48
*** salv-orlando has quit IRC14:48
mordredsamueldmq: also, if you're cleaning up that document - PyPI has a captial I not a lowercase - and "pip install -e ." should replace "python setup.py develop"14:49
*** jlanoux has quit IRC14:50
*** jlanoux has joined #openstack-infra14:52
pabelangerLooks like graphite is down again14:52
pabelangerpretty sure they did a new release a few weeks ago, should see if that fixes stability14:52
*** hamzy has quit IRC14:53
anteayawell jeblair did say last night that his whisper run was expected to take a long time, measured in days I do believe14:53
*** maiteb has quit IRC14:53
anteayagraphite is up for me, what do you see that makes you say you feel it is down?14:53
*** doug-fish has joined #openstack-infra14:54
openstackgerritAlexander Evseev proposed openstack-infra/zuul: Add possibility to use SSH instead of HTTP to get ref list  https://review.openstack.org/24643314:54
pabelangeranteaya: http://grafana.openstack.org/dashboard/db/zuul-status14:55
pabelangergrafana pulls data straight in from graphite14:55
*** sergmelikyan has quit IRC14:55
pabelangerbut, if whisper is down, that is the reason14:55
*** mriedem has quit IRC14:55
anteayawhisper isn't down, whisper is running14:55
anteayaand from what jeblair said takes a long time to complete14:56
maishskGood afternoon all. Can someone assist me in trying to debug a openstack-planet issue?14:56
anteayamaishsk: best to just ask your question14:57
anteayaI'm in a meeting and others are here at times14:57
anteayasomeone will respond if they can help14:57
pabelangeranteaya: fair enough. However something is stopping data from being served from graphite14:57
*** yonglihe has joined #openstack-infra14:57
*** doug-fish has quit IRC14:57
maishskthere were a number of posts added to the feed - and I am not certain where they are coming from14:57
*** achanda has joined #openstack-infra14:58
anteayapabelanger: okay I would agree with that statement14:58
anteayapabelanger: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2015-11-17.log.html#t2015-11-17T00:31:0314:58
*** dramalho has quit IRC14:59
*** dkranz has quit IRC14:59
*** doug-fish has joined #openstack-infra14:59
samueldmqmordred: yes I am cleaning up that documenation, I will apply your suggestions on https://review.openstack.org/#/c/24640014:59
igorbelikovanteaya: Hi, please take a look at https://review.openstack.org/#/c/244217/ and https://review.openstack.org/#/c/246339/ if you'll have the time. These are updated patches for centos7/ruby 2.0 jobs for Fuel that were discussed yesterday14:59
mordredsamueldmq: thanks!14:59
anteayamaishsk: are they related to openstack or clearly not related?14:59
samueldmqmordred: thanks for your comments !14:59
pabelangeranteaya: thanks14:59
anteayapabelanger: welcome14:59
maishskclearly not14:59
*** tiswanso has quit IRC14:59
*** doug-fish has quit IRC14:59
mordredsamueldmq: ZOMG! you removed referneces to install_venv.py - you win the gold star!14:59
*** doug-fish has joined #openstack-infra15:00
anteayamaishsk: have you a link or two?15:00
samueldmqmordred: haha, there was a review up for that already (https://review.openstack.org/#/c/223020/)15:00
maishskanteaya: http://planet.openstack.org/ - top three posts15:01
maishskhttps://www.citrix.com/blogs/2015/11/17/enhanced-interactive-sessions-for-citrix-service-providers/15:01
maishskhttps://www.citrix.com/blogs/2015/11/17/esri-arcgis-pro-is-citrix-ready-with-hdx-3d-pro/15:01
samueldmqmordred: but I decided to put that together, as I ma making several improvements in that docs (hopefully)15:01
maishskhttps://www.citrix.com/blogs/2015/11/17/finish-2015-strong-as-a-citrix-specialist/15:01
*** doug-fish has quit IRC15:01
anteayaigorbelikov: my priority until end of day tomorrow is the gerrit upgrade, so I am unlikely to get to that until that is complete15:01
*** tiswanso has joined #openstack-infra15:01
anteayamaishsk: well looks like they are coming from citrix15:01
igorbelikovanteaya: got it, thanks anyway15:01
pabelangerjeblair: would be interesting to see if we could use / add influxdb into our stats collection.  Either replace graphite or just as a backup.  I had some good success with it locally, but my collections were pretty limited15:01
anteayaigorbelikov: thank you for understanding15:01
maishskI assume from this feed http://blogs.citrix.com/author/matel/feed/15:02
maishskbut that feed no longer has the posts15:02
pabelangerjeblair: IIRC, grafana has a grop in replacement for some graphite pieces15:02
*** hichihara has quit IRC15:02
anteayamaishsk: those are links to the citrix blog, not the openstack-planet feed15:02
*** pc_m has quit IRC15:02
*** mriedem has joined #openstack-infra15:03
*** naggappan has quit IRC15:04
*** zns has quit IRC15:05
maishskanteaya: http://planet.openstack.org/atom.xml15:05
*** spredzy is now known as spredzy|afk15:06
anteayamaishsk: all of those links are coming from the one post in the planet in a post about summit offereings: http://planet.openstack.org/15:07
igorbelikovwe really want to see the remaining gates for fuel enabled and voting, so any feedback from the infra team will be much appreciated for these reviews https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+owner:%22Alexey+Shtokolov+%253Cashtokolov%2540mirantis.com%253E%22,n,z15:07
maishskanteaya: You lost me..15:07
anteayaMate Lakat authored a single article entitled New! Interactive Sessions for Citrix Service Providers @Summit!15:08
anteayathe article contains several paragraphs, each of which have links to a citrix blog15:09
*** rhallisey has quit IRC15:09
anteayathe links to the citrix blog seem to be the same links you showed to me15:09
anteayathis is one article about summit sessions15:09
*** rhallisey has joined #openstack-infra15:09
*** rhallisey has quit IRC15:09
*** rhallisey has joined #openstack-infra15:10
maishskSo why is the planet creating an entry for of the sub articles?15:10
anteayamust be a formatting issue15:10
*** amotoki_ has joined #openstack-infra15:10
anteayathat happens sometimes15:10
anteayamaishsk: there is the code for the planet if you want to look into it: http://git.openstack.org/cgit/openstack/openstack-planet/tree/15:10
*** annegentle has quit IRC15:11
*** amotoki has quit IRC15:11
*** tongli has joined #openstack-infra15:11
*** annegentle has joined #openstack-infra15:11
*** Liuqing has quit IRC15:11
*** pcm_ has joined #openstack-infra15:11
maishskanteaya: if I knew what to do with that - then great - but it does not help me very much.15:12
*** amotoki_ is now known as amotoki15:13
maishskand honestly - I have no idea how that post got in there - becuase the original feed - https://www.citrix.com/blogs/author/matel/feed/ - does not have that post15:13
*** bdemers has quit IRC15:14
*** bcourt has quit IRC15:14
*** Guest87553 is now known as sigmavirus2415:15
*** yfried__ has joined #openstack-infra15:15
*** MarkAtwood has joined #openstack-infra15:15
*** _amrith_ is now known as amrith15:16
anteayaare you objecting to the existance of the post?15:16
*** zhurong has quit IRC15:16
*** dkehnpad has joined #openstack-infra15:17
anteayaI don't know as we have a structure set up if someone wishes to file a complaint about content15:17
anteayaon the planet15:17
*** btully has joined #openstack-infra15:17
*** nmagnezi_ has quit IRC15:18
maishskNot objecting - just want to keep things tidy.15:18
anteayaso the format is what you want addressed?15:18
*** samuelBartel has joined #openstack-infra15:18
*** bdemers has joined #openstack-infra15:19
*** jaypipes has quit IRC15:19
maishskWell essentially it is a bug. so best to submit a bug?15:20
*** claudiub has quit IRC15:20
anteayaif you like15:20
anteayahonestly I would suggest you contact the author of the post and ask them to look at the output on planet.o.o15:20
maishskand regarding removal of content / feeds from the planet15:21
*** doug-fish has joined #openstack-infra15:21
maishskI will start a thread on the ML15:21
anteayaand ask them what framework and syntax they are using for their articles as it formats strangle on the planet and see what they say15:21
anteayamaishsk: if you like15:21
maishskThanks15:21
anteayabut before you point to this as an example, I do encourage you to contact the author15:21
anteayathey probably don't know how the planet has scraped their article for formatting15:22
anteayaand I honestly don't see an issue with content here, as a data point15:22
*** rbrndt has joined #openstack-infra15:22
*** mtanino has joined #openstack-infra15:23
maishskanteaya: how can I find the email address of the user ?15:23
anteayaI start by taking the name and offering it to google15:24
anteayaadding citrix to it wouldn't hurt15:24
*** elemoine has quit IRC15:27
*** tonytan4ever has joined #openstack-infra15:28
openstackgerritAkihiro Motoki proposed openstack/requirements: Bump oslo.config >=2.7.0  https://review.openstack.org/24629415:29
*** doug-fish has quit IRC15:29
*** elemoine has joined #openstack-infra15:30
*** ccrouch has joined #openstack-infra15:30
openstackgerritTimofey Durakov proposed openstack-infra/devstack-gate: min_compute_nodes set before NOTESTS check  https://review.openstack.org/24645215:30
*** doug-fish has joined #openstack-infra15:30
*** tsg has joined #openstack-infra15:30
*** pc_m has joined #openstack-infra15:31
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/24550415:31
*** doug-fis_ has joined #openstack-infra15:31
*** doug-fi__ has joined #openstack-infra15:33
*** harlowja_at_home has joined #openstack-infra15:33
*** doug-fi__ has quit IRC15:33
*** nadya_ has quit IRC15:33
*** k4n0 has quit IRC15:34
*** doug-fi__ has joined #openstack-infra15:34
*** dkliban has joined #openstack-infra15:34
*** doug-fish has quit IRC15:34
tdurakovanteaya, clarkb, sdague, hi, could you review this https://review.openstack.org/246452 I suppose there is a bug in devstack-gatse15:34
*** daemontool has quit IRC15:34
*** doug-fis_ has quit IRC15:36
*** vlaza has quit IRC15:36
*** dramalho has joined #openstack-infra15:36
*** dkliban has left #openstack-infra15:36
openstackgerritTimofey Durakov proposed openstack-infra/devstack-gate: min_compute_nodes set before NOTESTS check  https://review.openstack.org/24645215:37
*** markus_z_meeting is now known as markus_z15:37
*** maiteb has joined #openstack-infra15:37
*** zeih_ has quit IRC15:39
*** bpokorny has joined #openstack-infra15:40
*** dkehnpad has quit IRC15:40
*** bpokorny has quit IRC15:40
openstackgerritSean M. Collins proposed openstack-infra/project-config: Create a multinode grenade job for testing Neutron  https://review.openstack.org/24586215:40
*** bpokorny has joined #openstack-infra15:41
*** samuelBartel has quit IRC15:41
anteayasc68cal_: tdurakov the two of you should meet15:42
anteayaand perhaps review each other's patches15:43
anteayaas you are both working on multinode grenade builds for your projects15:43
sdaguetdurakov: is the concern there that the live migration tests get turned off if that isn't set?15:44
sdaguewe can spin that around, the live migration post hook could also set that directly15:44
*** amotoki_ has joined #openstack-infra15:44
anteayasorry, multinode builds not both grenade builds15:45
*** bhunter71 has joined #openstack-infra15:45
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Set puppet versions in tripleo.sh not toci_instack.sh  https://review.openstack.org/24645715:46
sdaguetdurakov: I'm +2 on that if we just add another comment about why the order is important into the code, otherwise it's easy to get lost later15:46
*** gnuoy has joined #openstack-infra15:46
*** yamamoto has quit IRC15:46
tdurakovsdague, here is the point DEVSTACK_GATE_TEMPEST is responsible for tempest config, right?15:46
openstackgerritMerged openstack-infra/project-config: Add publishing jobs to ceilometer-powervm  https://review.openstack.org/24525215:47
*** jamespage has joined #openstack-infra15:47
sdaguetdurakov: yes15:47
*** amotoki has quit IRC15:47
sdaguelike I said, I'm fine with this if we add another comment into the code15:47
sdaguesee the review15:47
tdurakovsetting min_compute_nodes is a part of tempest config, that could be skipped if DEVSTACK_GATE_TEMPEST_NOTESTS == 115:47
*** proffalken has joined #openstack-infra15:48
tdurakovsdague, ok, will add comment15:48
*** bnemec has quit IRC15:48
openstackgerritgordon chung proposed openstack-infra/project-config: add release notes jobs for ceilometer  https://review.openstack.org/24645815:49
*** armax has quit IRC15:49
*** Piet has quit IRC15:50
*** leifmadsen_ is now known as leifmadsen15:52
openstackgerritTimofey Durakov proposed openstack-infra/devstack-gate: min_compute_nodes set before NOTESTS check  https://review.openstack.org/24645215:53
tdurakovsdague, added inline comments15:53
*** dkehnpad has joined #openstack-infra15:54
jeblairinfra-root: it looks like no one has looked into the graphite failure yet; i will do so now.15:54
mordredjeblair: ++15:56
*** tdurakov has quit IRC15:56
*** daemontool has joined #openstack-infra15:57
*** dizquierdo has quit IRC15:57
anteayajeblair: I had thought pabelanger earlier comment about graphite was an indication of whisper running not an indication of a failure so that is my fault15:57
anteayabut graphite.o.o did render for me and I was able to produce graphs, so I don't know where I should have been looking15:58
jeblairanteaya: whisper is a database file format, not a running daemon.  the running components of the system are graphite, carbon-cache, and statsd15:58
anteayawhere could I have seen if they were running or not?15:58
anteayaI took the fact I was able to create a graph that things were running, obviously I was wrong15:58
anteayadon't mean to take you from fixing the issue15:59
*** daemontool has quit IRC15:59
anteayabut I am interested in learning after it is back up15:59
jeblairanteaya: logging into the system, i believe15:59
*** jaypipes has joined #openstack-infra15:59
*** sabeen1 has joined #openstack-infra15:59
anteayaNameError: name 'patterns' is not defined15:59
*** daemontool has joined #openstack-infra15:59
anteayaah yes, my attempt to login did through an error16:00
anteayathanks16:00
anteayas/through/throw16:00
jeblairNov 17 10:47:37 graphite kernel: [761134.817513] Out of memory: Kill process 32249 (carbon-cache.py) score 756 or sacrifice child16:00
*** zns has joined #openstack-infra16:00
anteayapabelanger: you were right, graphite is experiencing problems, I'm sorry16:00
jeblairso the usual carbon-cache oom, probably with memory-pressure assistance from the whisper resize and triggered by the puppet run16:01
*** dramalho has quit IRC16:02
openstackgerritSean Dague proposed openstack-infra/project-config: propose new tempest layer4 job  https://review.openstack.org/24646716:02
timrcpabelanger: Yeah, I should.  I intend to do a lot of reviewing this week as I'll be out all next week fly fishing the heck out of the great smoky mountains16:02
*** ddieterly has joined #openstack-infra16:02
*** nmagnezi has joined #openstack-infra16:03
jeblairi think when people notice errors with our systems that someone should at least say "infra-root" so that people will know about it and be able to fix it16:03
*** cody-somerville has joined #openstack-infra16:03
*** sabeen3 has joined #openstack-infra16:03
anteayajeblair: I can do that16:03
*** bnemec has joined #openstack-infra16:03
mordredjeblair: ++16:03
*** tdurakov has joined #openstack-infra16:03
*** sabeen1 has quit IRC16:04
*** rcernin has quit IRC16:04
igorbelikovjeblair: maybe add it to channel description?16:04
jeblairigorbelikov: i'm not ready to go that far yet.  we don't need to be pinged for everything -- i'd just like people who know enough about our systems to know when something is a system problem that *needs* root access to be sure to let those with that access know about it.16:05
jeblairigorbelikov: many things that break don't need root access to fix.16:05
*** aviau has quit IRC16:05
igorbelikovjeblair: seems reasonable, ok16:05
*** pc_m is now known as pc_m_AWAY16:06
*** fedexo has joined #openstack-infra16:06
*** mriedem has quit IRC16:06
jeblairinfra-root: i'm going to temp disable puppet on graphite and restart carbon-cache a few times to try some tuning parameters16:06
*** tdurakov has quit IRC16:06
*** aviau has joined #openstack-infra16:06
*** bcourt has joined #openstack-infra16:07
*** ildikov has quit IRC16:07
*** proffalken has left #openstack-infra16:08
mordredjeblair: kk16:09
*** AJaeger has joined #openstack-infra16:10
*** mriedem has joined #openstack-infra16:11
sc68cal_anteaya: thanks. I'll take a look at tdurakov's patches in the future16:12
anteayasc68cal_: thank you, I think the two of you can learn from each other in this, also it never hurts to find someone who can review your patches16:13
jeblairit looks like the bulk of our statsd traffic is actually nodepool reporting the detailed counts of nodes with specific labels assigned to specific jenkins masters16:14
AJaegerGood afternoon! I've got two patches for liberty translations of openstack-manuals in project-config that I'd like to see reviewed today if possible, please - https://review.openstack.org/#/c/246201/ and https://review.openstack.org/#/c/246284/16:14
jeblairconsidering we don't actually use that data, perhaps we should stop sending it16:14
mordredjeblair: hrm. that doesn't seem like information we use a lot16:14
mordredyeah16:14
mordredjeblair: I support that16:14
jeblairafter i finish playing with the tuning params, i'll propose a patch to cut that out16:14
mordredjeblair: out of curiosity - can you give me an example of that?16:14
mordredjeblair: like "bare-centos6.jenkins06 == 20" ?16:15
*** SotK_ is now known as SotK16:15
jeblairE..]i.@.=.7.h....=.p.~...I..nodepool.target.jenkins07.devstack-trusty-2-node.rax-ord.used:1|g16:15
jeblairmordred: yeah ^16:15
jeblair(tcpdump)16:15
mordredwow. yeah. that doesn't seem _immediately_ useful16:16
jeblairi think we can probably drop the node label and provider from that and just do jenkins07.used16:16
*** dangers_away is now known as dangers16:16
*** otter768 has joined #openstack-infra16:16
jeblair(we still don't immediately use that metric, but we might)16:16
jeblair(if we made a graph based on that, we'd be able to see jenkins imbalances due to things like the thread issues fairly easily, so i'm inclined to try to keep that)16:17
*** mwagner has quit IRC16:18
igorbelikovAJaeger: hi, can you take a look at updated centos7/ruby 2.0 jobs please? https://review.openstack.org/#/c/244217/ and https://review.openstack.org/#/c/246339/16:19
*** bpokorny_ has joined #openstack-infra16:19
*** bpokorny has quit IRC16:19
mordredjeblair: yah. and we should make a graph of that16:19
*** amotoki_ has quit IRC16:19
AJaegerlooking...16:19
*** otter768 has quit IRC16:21
*** _d34dh0r53_ is now known as d34dh0r5316:22
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196416:23
*** sshnaidm has quit IRC16:23
*** harlowja_at_home has quit IRC16:23
*** rpodolyaka1 has quit IRC16:24
AJaegerpabelanger: could you review https://review.openstack.org/#/c/244217 as well, please?16:25
anteayamordred: have you seen zaro's comment on your gerrit db rollback script? https://review.openstack.org/#/c/245598/16:25
*** salv-orl_ has quit IRC16:26
*** hemnafk is now known as hemna16:26
AJaegerthanks, anteaya for the reviews!16:26
anteayaAJaeger: welcome16:26
mordredanteaya: nope. thanks. looking now!16:27
*** julim_ has joined #openstack-infra16:27
igorbelikovAJaeger: thanks for the reviews! And we're sure about making it voting:)16:27
mordredanteaya: blast16:28
*** armax has joined #openstack-infra16:28
anteayamordred: yeah, well at least he included good artifacts16:28
AJaegerigorbelikov: fine with me, just wanted you to be aware of the fun ;)16:28
*** ccrouch has quit IRC16:29
*** ccrouch has joined #openstack-infra16:29
*** ayoung_ is now known as ayoung16:29
mordredzaro, jeblair: so - I'm starting to worry, from that traceback and from some of the database migrations I was looking at and did not do anything with ...16:30
mordredthat a rollback from 2.11 to 2.8 without dataloss may not be possible16:30
*** rpodolyaka1 has joined #openstack-infra16:30
krotscheckgreghaynes: So, fungi asked me two weeks ago to hold off on my pypi mirror rename patches, because he wanted to land your wheel patches first. I'd like to get moving on my work, so that it doesn't bitrot out - do you have an ETA for when those wheel mirrors will be done?16:30
*** julim has quit IRC16:30
mordredbecause I _THINK_ 2.11 moves some data into git and out of the db16:30
mordredwhich means a rollback would have to include a revese-engineering of that16:30
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196416:30
anteayamordred: without dataloss of new data, I do think is what zaro found16:30
mordredyah16:30
anteayamordred: original data seems to be intact16:31
mordredold data remains16:31
mordredyup16:31
*** dramalho has joined #openstack-infra16:31
anteayaso that is something16:31
openstackgerritsebastian marcet proposed openstack-infra/puppet-openstackid: Added Bower support  https://review.openstack.org/24539416:31
*** Piet has joined #openstack-infra16:31
anteayamordred: I had thought moving data into git was considered use of notedb, which I do believe is not a part of 2.1116:32
anteayamordred: I believe notedb is the reason for the version 3 bump and am foggy on if it plays a role in 2.1216:32
bhunter71off-topic comment;  I'm pretty sure my downstream CI clone is using subunit2sql to pull some schema from graphite.openstack.org.   thus I'm blaming some nodepool/devstack image-build failures I'm seeing on whatever-you-said-about-graphite.16:32
bhunter71sorry, logstash, never mind that.16:33
openstackgerritAlexey Shtokolov proposed openstack-infra/project-config: Add rake-dsvm gate job-template  https://review.openstack.org/24421716:33
*** dkranz has joined #openstack-infra16:34
anteayamordred: 2.11 does include schema changes that require a secondary index: https://gerrit-documentation.storage.googleapis.com/ReleaseNotes/ReleaseNotes-2.11.html#_important_notes16:34
jeblairbhunter71, asselin__, mtreinish: should we make a flag for downstream ci users to turn off subunit2sql population in image builds?16:34
anteayamordred: do you know if we already have a secondary index?16:35
openstackgerritAlexey Shtokolov proposed openstack-infra/project-config: Add rake-dsvm gate job-template  https://review.openstack.org/24421716:35
*** gokrokve has joined #openstack-infra16:35
jeblairanteaya: yeah, that's lucene16:35
anteayajeblair: okay thanks thought so, grateful for confirmation though16:35
jeblairanteaya: (which is the 'reindex' step we do in renames)16:35
mtreinishjeblair: sure, I mean unless they actually want to try preseeding tempest with the test results from the infra db16:36
anteayaah there we go, thanks16:36
mtreinishwhich some people may want?16:36
jeblairmtreinish: it's sort of looking like maybe they already do?  :)16:36
mtreinishheh, yeah almost everyone is doing it, they just don't necessarily realize it16:37
jeblairmaybe it's harmless?  or maybe it's wasteful?  i dunno.  just hadn't thought about it until now.16:37
*** armax has quit IRC16:37
sc68cal_AJaeger: oh, dumb question, about the neutron-classifier repo. How do we add members to the neutron-classifier-core group?16:38
mtreinishjeblair: well I will say the preseeding has little actual effect for a number of reasons16:38
mtreinishand I doubt it really puts extra load on the server or anything16:38
jeblairok16:39
mtreinishthere is a bit of jitter when I push a release and we run a long migration16:39
mtreinishso we often get people complaining when they're using a newer version and the migration hasn't finished16:39
openstackgerritMerged openstack-infra/project-config: Translate liberty for openstack-manuals  https://review.openstack.org/24620116:39
*** cloudtrainme has joined #openstack-infra16:40
AJaegersc68cal_: http://docs.openstack.org/infra/manual/creators.html#verify-the-gerrit-review-permissions - ask here to get added initially to the repo once it's in and then you can add others16:40
*** armax has joined #openstack-infra16:40
sc68cal_AJaeger: derp. sorry, should have RTFM16:40
*** e0ne has quit IRC16:41
anteayamordred: okay so what happens if before the rollback we take a db dump16:41
openstackgerritAlexey Shtokolov proposed openstack-infra/project-config: Added and enabled gates for ruby fuel repos  https://review.openstack.org/24633916:41
anteayamordred: then do the rollback, then look in the dump and isolate entries with timestamps after the upgrade16:41
anteayamordred: can we do anything to that data to put that into the rolled back schema?16:42
mordredanteaya: biggest issue is that we'd still need to restore the data from those entries from the data that's in git16:42
anteayamordred: what do you mean the data that's in git?16:42
anteayamordred: I am not seeing in the release notes that data is stored in git16:42
anteayamordred: so how do we test your theory that that is what 2.11 is doing?16:43
*** doug-fi__ is now known as doug-fish16:43
*** dkranz has quit IRC16:43
anteayathe 2.11 release notes say a schema change16:44
*** shashank_hegde has joined #openstack-infra16:44
greghayneskrotscheck: they have just been waiting on review, no idea how long that will take16:46
greghayneskrotscheck: re: wheel mirrors16:46
mordredhttp://git.openstack.org/cgit/openstack-infra/gerrit/tree/gerrit-server/src/main/java/com/google/gerrit/server/schema/Schema_106.java?h=openstack/2.11.416:46
mordredanteaya, zaro, jeblair: ^^16:46
mordredthat is the thing I'm worried about16:46
krotscheckgreghaynes: Thanks for the update. I'll ping fungi when he shows up.16:46
anteayathanks, /me looks16:47
mordredit's creating a git reflog for each thing16:47
*** yamamoto has joined #openstack-infra16:47
mordredwhich makes me think that new refs go into it in 2.1116:47
AJaegerkrotscheck: fungi is on vacation, will take a few days until he shows up16:47
mordredwhich would potentially explain zaro's error16:47
*** nmagnezi has quit IRC16:47
anteayaAJaeger: krotscheck 23rd I think he said16:47
*** maishsk has quit IRC16:48
*** erikwilson has joined #openstack-infra16:49
anteayamordred: hmmmmm16:49
*** sergmelikyan has joined #openstack-infra16:50
*** hashar has quit IRC16:50
*** tiswanso has quit IRC16:50
*** sergmelikyan has quit IRC16:51
*** ala_ has quit IRC16:51
anteayawell if that is what gerrit is doing with data are they creating a way for themselves to be able to rollback?16:51
anteayaor are they saying since the information will be stored in git rollbacks aren't necessary?16:52
*** yamamoto has quit IRC16:52
*** unicell has quit IRC16:52
*** elemoine has quit IRC16:53
*** e0ne has joined #openstack-infra16:53
mordredI do not think they intend 2.11 to 2.8 to be a thing that people do16:53
anteayaleaving a weird space in the transition where some data is in a database and some in git16:54
*** abregman is now known as abregman|brb16:54
anteayamordred: yes the do say that in the release notes, they suggest you do 2.x -> 2.10 and then 2.10 to 2.1116:54
*** tsg has quit IRC16:54
anteayas/the/they16:54
anteayado we want to do that?16:54
*** tsg has joined #openstack-infra16:55
anteayathough my read of that is to get version 11 of the lucene index in place prior to the 2.11 upgrade so reindexing doesn't take as long16:55
anteayaas 2.10 comes with version 1116:55
*** gyee has joined #openstack-infra16:55
anteayaof the lucene index16:55
mordredyah. I think it's just a risk we have to be aware of16:56
mordredif the same thing happens as last time16:56
*** bdemers has quit IRC16:56
anteayaright16:56
mordredwhere we run 2.11 for several days and then discover a big problem we can't solve16:56
krotscheckAJaeger: Danke16:56
*** elemoine has joined #openstack-infra16:56
mordredwe may be in trouble16:56
anteayaokay well I'm fine with acknowledging it as a known rish16:56
anteayarisk16:56
anteayawill wait to hear from others16:56
anteayazaro: any idea what version of lucene we are using with 2.8?16:56
*** dramalho has quit IRC16:57
*** maiteb has quit IRC16:57
*** maiteb has joined #openstack-infra16:58
*** Sukhdev has joined #openstack-infra16:58
*** dramalho has joined #openstack-infra16:58
*** mfalatic has joined #openstack-infra16:59
*** mriedem is now known as mriedem_meeting16:59
*** angdraug has quit IRC16:59
*** Sukhdev has quit IRC17:00
*** Sukhdev has joined #openstack-infra17:01
*** watanabe_isao has quit IRC17:01
*** korzen_ has joined #openstack-infra17:01
*** sridhar_ram has joined #openstack-infra17:02
AJaegermestery, armax, sdague : I'd like your input on  https://review.openstack.org/243610, please. This is an unusual setup the networking-bgvpn team is doing and I'd like some more discussion on it.17:02
* mestery looks17:02
armaxAJaeger: looks17:02
*** korzen has quit IRC17:02
AJaegerthanks, mestery and armax.17:02
* AJaeger is back later...17:03
*** tiswanso has joined #openstack-infra17:03
*** mwagner has joined #openstack-infra17:03
sdagueyeh, honestly, release independent drivers for a branched release model just doesn't work17:04
*** Swami has joined #openstack-infra17:04
*** daemontool has quit IRC17:04
anteayayeah this looks like it is just the beginning of a world of pain17:04
*** ayoung has quit IRC17:04
*** daemontool has joined #openstack-infra17:04
anteayaAJaeger: nice catch17:05
pleia2good morning17:05
pleia2conferences all done for the year \o/17:05
anteayamorning pleia217:05
anteayayay!17:05
anteayanice to have you back17:05
jeblairpleia2: yay!  glad you're back!17:06
pleia2jeblair: me too :)17:06
*** tsg has quit IRC17:06
*** jlanoux has quit IRC17:07
*** rossella_s has quit IRC17:07
pleia2fungi asked me to chair the meeting this week, so getting caught up and will poke at meeting agenda (plus, if anyone has anything to add, now's the time :))17:07
*** mahatic_ has quit IRC17:07
*** rossella_s has joined #openstack-infra17:08
armaxAJaeger: done17:08
anteayapleia2: under upcoming project renames, I looked and git has http://git.openstack.org/cgit/openstack-attic/akanda/17:10
anteayaso did that already happen or is it unecessary?17:10
*** tsg has joined #openstack-infra17:11
pleia2anteaya: looking17:11
*** bdemers has joined #openstack-infra17:12
anteayapleia2: here is the patch: https://review.openstack.org/#/c/241328/917:12
anteayapleia2: it looks right to me, still17:12
pleia2anteaya: I think you're right17:12
asselin__bhunter71, I believe it is optional, but it should work for downstream....17:13
anteayapleia2: oh no I found it: line 77 on the etherpad: https://etherpad.openstack.org/p/project-renames-November-6-201517:13
*** e0ne has quit IRC17:13
anteayapleia2: I must have made a mistake on the input to the scripts17:13
anteayapleia2: step 5, 6, and 8, my fault17:14
anteayapleia2: so it is in the gerrit db17:14
openstackgerritSean Dague proposed openstack-infra/puppet-elastic_recheck: put a 1hr timeout on flock blocking  https://review.openstack.org/24650817:14
* clarkb realizes that if anyone wants to learn the fun details of how logstash works my current test setup is a good way to do so17:14
anteayaclarkb: cool17:14
pleia2anteaya: but the repo exists, did the mistake get fixed during the rename?17:14
clarkbanyone interested in helping test logstash 2.0.0 with our rules against the various file types?17:15
anteayapleia2: I think someone would have to check the gerrit db to confirm17:15
clarkbI can walk you through setting up a local testing setup and maybe we get some better docs out of it17:15
anteayapleia2: but the errors in steps 5, 6 and 8 where gerrit db updates17:15
pleia2anteaya: oh, I see, maybe the comment is what we're looking for "(NEEDS GERRIT CHANGE, MANUAL CLEANUP)"17:15
pleia2so it's not a regular rename, it's fixing up some stuff17:15
*** unicell has joined #openstack-infra17:15
pleia2I didn't really understand context with that comment, makes sense now17:15
anteayaright, the rename happened and there was a mistake in the gerrit db commands I offered in the etherpad17:16
anteayapleia2: k, probably not the priority but yeah now I understand too17:16
*** korzen has joined #openstack-infra17:16
*** shashank_hegde has quit IRC17:16
anteayaI will link the etherpad that introduced the error, so folks know where to look17:16
*** korzen_ has quit IRC17:17
pleia2anteaya: good idea, thanks17:17
*** abregman|brb is now known as abregman17:19
clarkbthough I suppose I should focus on gerrit upgrade from now until that is done17:19
*** ashleighfarnham has joined #openstack-infra17:19
openstackgerritJim Rollenhagen proposed openstack-infra/project-config: Drop Python 2.6 tests for python-ironicclient  https://review.openstack.org/24651417:19
anteayapleia2: it was a mistake in my file to feed in the new project names17:19
clarkbanteaya: pleia2 I think its basically a project rename to the proper name17:19
anteayaclarkb: I am interested but I am slow and don't want to take your time if you have someone faster interested17:20
clarkbanteaya: well probably wont spend more time on it until after gerrit upgrade anyways so speed not super big deal17:20
anteayaclarkb: no it is a db fix, since the errors came from the db update commands I ran through fungi's scripts17:20
*** ayoung has joined #openstack-infra17:20
anteayaclarkb: yup, okay sounds good17:20
clarkbanteaya: yes but its the same steps to rename a project17:20
pleia2it's just -attic anyway, I'm not concerned17:21
clarkbmove the git repo, update the db to proper name17:21
*** pradk has quit IRC17:21
anteayaclarkb: but the git repo is named correctly17:21
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500917:21
clarkbanteaya: I don't think it is because you can clone the wrong name17:21
anteayawe don't need another patch since the patch was accurate17:21
anteayaclarkb: really?17:21
anteayaokay17:21
clarkbyes, so what happened was we made a new repo with the wrong name17:21
*** e0ne has joined #openstack-infra17:21
clarkbI would have ot double check but I think if we just update the things the new repo becomes correct repo and everything just works17:22
anteayahttp://git.openstack.org/cgit/openstack-attic/akanda/17:22
anteayathat is the correct name17:22
clarkbyup17:22
clarkband its a completely new repo17:22
clarkbI think we can just mv wrong name repo over that one on disk, update db, and replication will update things on the remotes properly17:22
anteayaoh your are right17:22
clarkb(that needs more testing but I think it will just work)17:22
anteayaokay, hopefully that will work17:22
clarkb(we may need to mark openstack-attic/akanada "private" though17:23
*** ifarkas has quit IRC17:23
zaromorning17:23
anteayamorning zaro17:24
anteayazaro: we have a number of things to discuss, do let us know when you are ready17:24
anteayaclarkb: how do we do that?17:24
* zaro looks at scrollback17:25
*** tdurakov has joined #openstack-infra17:25
*** unicell has quit IRC17:25
clarkbanteaya: there are acl updates one can do to make it so no one can see the project17:25
clarkbanteaya: we can also just delete it17:25
anteayazaro: well for starters do you know what version of the lucene index we run with 2.8?17:25
*** matrohon has quit IRC17:25
zaroanteaya: you mean version of lucene?17:25
anteayaclarkb: yeah if it is wrong and we can do that I am in favour of just deleting it17:25
*** nadya has joined #openstack-infra17:25
anteayazaro: okay version of lucene17:25
anteayaclarkb: no sense having it floating around if we don't need the history for anything17:26
clarkbya17:26
zaroit looks like it's Lucene 4.4 for gerrit 2.8: https://git.openstack.org/cgit/openstack-infra/gerrit/tree/lib/lucene/BUCK?h=openstack/2.8.417:27
anteayapleia2: that was the only thing I spotted for the meeting since gerrit upgrade is already on the agenda17:27
anteayazaro: okay the 2.11 release notes talk about version 11 for indexing17:27
zaroand lucene 4.10 for Gerrit 2.11: https://git.openstack.org/cgit/openstack-infra/gerrit/tree/lib/lucene/BUCK?h=openstack/2.11.417:27
*** elemoine has quit IRC17:28
anteayazaro: do you know what the release notes are talking about? they suggest 2.x -> 2.10 upgrade first to get version 11 for indexing before upgrading from 2.10 to 2.1117:28
anteayahttps://gerrit-documentation.storage.googleapis.com/ReleaseNotes/ReleaseNotes-2.11.html#_important_notes17:29
pleia2anteaya: great, thanks for taking a look17:30
zarothat's only required if you want to do 'online indexing'.  we will be doing offline indexing so we don't need to do that.17:30
anteayazaro: okay thanks17:30
openstackgerritMerged openstack-infra/project-config: Added and enabled gate for fuel-docs and fuel-ostf  https://review.openstack.org/24590217:30
anteayamordred and I were discussing the outcome of your db migration and rollback test run17:30
zarogerrit 2.11 lets you do reindex without stopping the server.17:30
zarothat's what 'online' means17:31
anteayazaro: mordred feels that 2.11 creates reflogs which has him suspicious that 2.11 stores data in git17:31
*** salv-orl_ has joined #openstack-infra17:32
anteayazaro: leading him to conclude that is the explaination for your rollback data loss for new entries17:32
anteayazaro: he pointed to this as the part of 2.11 creating reflogs http://git.openstack.org/cgit/openstack-infra/gerrit/tree/gerrit-server/src/main/java/com/google/gerrit/server/schema/Schema_106.java?h=openstack/2.11.417:32
zarothe code seems like that's what it's doing although i'm not sure that explains the error.  i tested that late last night and didn't have time to further investigate.  planning to do more today.17:32
anteayazaro: okay17:33
anteayaso the decision I believe is, do we keep trying to debug or do we accept that if we have to rollback after use the new entries will not be accessible17:33
*** dramalho has quit IRC17:33
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add zuul-swift-upload-console-log for ansible-functional job  https://review.openstack.org/24651917:33
anteayazaro: would you agree?17:33
*** scheuran has quit IRC17:34
*** egonzalez has quit IRC17:34
tdurakovanteaya, sdague, clarkb, i've updated comment on my patch in devstack-gate, could you merge it, please?17:35
zarowell keep in mind that gerrit does not support rollback and nobody i've talked to has ever, EVER done a rollback.17:35
sc68cal_tdurakov: link?17:35
tdurakovhttps://review.openstack.org/#/c/246452/17:36
tdurakovsc68cal_, ^17:36
zaroso i think we would be accepting the same risk as everyone else that uses gerrit.17:36
*** rcernin has joined #openstack-infra17:36
anteayazaro: okay, thanks17:36
clarkbjesusaurus: bug in the curator cron, it should be looking in /usr/local/bin not /usr/bin. I would just set the path to include both that way no matter how you install it the cron should just work17:36
anteayazaro: so apart from looking more deeply into the db results, what else is high priority to be addressed today for the upgrade?17:37
openstackgerritgreghaynes proposed openstack-infra/nodepool: Add dib deletion test  https://review.openstack.org/21527517:37
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image delete using gearman  https://review.openstack.org/19811417:37
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman  https://review.openstack.org/19772217:37
openstackgerritgreghaynes proposed openstack-infra/nodepool: Builders can be run on their own  https://review.openstack.org/23225117:37
openstackgerritgreghaynes proposed openstack-infra/nodepool: Decouple builders from nodepool instance  https://review.openstack.org/23213517:37
openstackgerritgreghaynes proposed openstack-infra/nodepool: Builders distinguish between failure and exception  https://review.openstack.org/24213117:37
openstackgerritgreghaynes proposed openstack-infra/nodepool: Make secure.conf optional and backwards-compat  https://review.openstack.org/23280017:37
openstackgerritgreghaynes proposed openstack-infra/nodepool: Move nodepool config loading into module  https://review.openstack.org/23159217:37
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image builds using gearman  https://review.openstack.org/19517517:37
openstackgerritgreghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders  https://review.openstack.org/22239817:37
clarkbjesusaurus: but manually running it based on path is happyness so should be fine once thats done17:37
greghaynesI don't want to suggest stopping all nodepool changes, but ^ is a merge conflict magnet, so reviews would be *awesome*17:38
jesusaurusclarkb: whoops17:39
*** mriedem_meeting is now known as mriedem17:39
*** sergmelikyan has joined #openstack-infra17:39
asselin__jeblair, I have a few patches that affect/can benefit downstream ci users. Should be easy to review: 217914 242800 24597317:39
*** trown is now known as trown|outttypeww17:41
*** trown|outttypeww is now known as trown|lunch17:41
openstackgerritgreghaynes proposed openstack-infra/system-config: Add wheel_mirror_slaves that use pypi-mirror  https://review.openstack.org/16524017:43
onovyhi, can someone look to https://review.openstack.org/#/c/244597/ pls? thanks17:43
clarkbzaro: anteaya I don't follow the reflog thing, is there something I can read with the concerns written down?17:44
openstackgerritK Jonathan Harker proposed openstack-infra/puppet-logstash: Look for curator in both /usr/bin and /usr/local/bin  https://review.openstack.org/24652517:44
anteayazaro: can I strikethrough 'toggle ci button does not work' on https://etherpad.openstack.org/p/test-gerrit-2.11'17:44
pabelangerAJaeger: looking at the ruby job, isn't it basically a duplicate of: gate-{name}-puppet-unit-{puppet_version}-dsvm-{ostype}17:44
zaroi'm a bit confused on this change for gerrit-upgrade, would like more reviews here: https://review.openstack.org/#/c/24387917:44
*** Piet has quit IRC17:44
jesusaurusclarkb: https://review.openstack.org/246525 ?17:44
anteayaclarkb: the only thing so far is the backscroll, I can summarize them somewhere for mordred to review, how about one of the etherpads?17:44
zaroanteaya: strike at will17:45
igorbelikovpabelanger: yeah, it basically is, but the proposed ruby jobs are not related to puppet in any way, so it seemed wrong to use puppet templates17:45
anteayaclarkb: or mordred's db rollback patch, that would be better maybe17:45
anteayazaro: thanks17:45
anteayaclarkb: I will add a comment to https://review.openstack.org/#/c/245598/17:46
mordredclarkb: tl;dr - there is data that is stored in git in 2.11 that is in the db before 2.11 - which means there is not a great way to support changes made in 2.11 on a 2.8 install17:46
zaroanteaya: summarize in testing etherpad?17:46
pabelangerigorbelikov: what is wrong about using them?17:46
clarkbzaro: that apache change is not correct17:46
*** e0ne has quit IRC17:46
clarkbzaro: there are a bunch of rewrite conditions with no rewrite rules17:46
*** yfried__ is now known as yfried|afk17:46
zaroohh good, give me something i can try out on review-dev17:47
*** korzen has quit IRC17:47
clarkbzaro: well I don't understand why we need those changes ta all17:47
openstackgerritTimofey Durakov proposed openstack-infra/devstack-gate: min_compute_nodes set before NOTESTS check  https://review.openstack.org/24645217:47
clarkbthe allow encoded slashes nodecode is the fix for cgit17:47
clarkbso you don't want ot undo that iirc17:47
*** zxiiro has quit IRC17:47
*** salv-orl_ has quit IRC17:47
*** ZZelle_ has joined #openstack-infra17:48
*** salv-orlando has joined #openstack-infra17:48
AJaegerpabelanger: ahh... Can we consolidate these in a good way?17:48
*** jed56 has quit IRC17:48
*** GheRivero has quit IRC17:49
igorbelikovpabelanger: nothing wrong technically:) it just seemed unnecessary (and confusing) to do the puppet installation steps and have jobs with 'puppet' in name for to test the projects that are not related to puppet17:49
*** e0ne has joined #openstack-infra17:49
*** greghaynes has quit IRC17:49
*** auggy has quit IRC17:49
*** yonglihe has quit IRC17:50
asselin__jeblair, also, if you can review this: 237796. I plan to use that to disable urllib3 warnings I hit yesterday via "PYTHONWARNINGS="ignore:Unverified HTTPS request" ./do-insecure-request.py"17:50
AJaegerigorbelikov, pabelanger : so, what about renaming the puppet jobs so that both puppet and fuel can use them?17:50
zaroclarkb: really, all i know is that if rewrite rule 'RewriteRule ^/(.*)$ http://localhost:8081/$1 [NE,P]' is put back then double slashes appear again.17:50
*** teran has quit IRC17:50
*** dramalho has joined #openstack-infra17:50
clarkbzaro: ok so we need to fix that rule then17:50
clarkbzaro: but that is an important rule17:50
pabelangerAJaeger: igorbelikov: Well, from what I see, aside from it named puppet, the jobs do the same thing.  I suggest making the job more generic to both teams can use it17:50
pabelangerEmilienM: ^17:50
*** ashtokolov has quit IRC17:50
openstackgerritMerged openstack-infra/project-config: Add rake-dsvm gate job-template  https://review.openstack.org/24421717:50
clarkbsince it makes /p/ work17:50
pabelangerAJaeger: Ya, my thoughts17:50
*** monester has quit IRC17:50
anteayaclarkb: zaro just summarized in this patch as a comment: https://review.openstack.org/#/c/245598/17:51
pabelangerAJaeger: igorbelikov: I'd suggest using the puppet job for now, then rename it to something more generic17:51
jrollanyone free for a super-easy review? trying to get this 2.6 drop done today-ish :) https://review.openstack.org/#/c/246514/17:51
EmilienMpabelanger: can I have a context?17:51
jrolljust drops py26 jobs for iroincclient17:51
AJaegerpabelanger: igorbelikov's change just merged but we can still rename.17:51
*** jpmaxman has quit IRC17:51
AJaegerigorbelikov: do you want to do the consolidation? That would be really appreciated!17:52
openstackgerritMerged openstack-infra/project-config: Added and enabled gates for ruby fuel repos  https://review.openstack.org/24633917:52
pabelangerEmilienM: https://review.openstack.org/#/c/244217 appears to dupe some of your puppet gate jobs. Considering rename renaming yours and compressing them so both fuel and puppet teams can use it17:53
zaroclarkb: do you know anything about the error from one of the non-voting tests?17:53
sdagueanteaya: up for another job change - https://review.openstack.org/#/c/246467/ ?17:53
igorbelikovpabelanger AJaeger: I'm totally for it, but can I do it as a separate step? It would be cool to have working gates now, since the changes are being merged.17:53
clarkbzaro: against whta change?17:53
zaroclarkb: https://review.openstack.org/24387917:53
AJaegerigorbelikov: the changes are in, so you have something working, don't you? So, we have to do it separately ;)17:53
*** pc_m_AWAY is now known as pc_c17:53
*** pc_c is now known as pc_m17:53
zaroclarkb: the one yolanda pointed out.17:54
EmilienMpabelanger: nice catch, thanks for the pointer17:54
igorbelikovAJaeger: yep:) Ok, I'll work on renaming/consolidation stuff17:54
EmilienMpabelanger: I'm totally open to adjust our job names17:54
clarkbzaro: it looks like apache failing to work which is consistent with what I expect ot happen there17:54
zarosdague: would you be interested in testing group query on review-dev.o.o?17:54
clarkbzaro: we need to fix the rewrite rule not remove it17:54
pabelangerigorbelikov: feel free to add me to the review17:54
AJaegerthanks, igorbelikov - please tell pabelanger and EmilienM about your change so that they can review as well...17:54
sdaguezaro: yes, but right now, I need lunch17:55
*** rpodolyaka1 has quit IRC17:55
zarosdague: today?17:55
anteayasdague: done17:55
zaroclarkb: ok. please make a suggestion because i'm not good at that.17:55
*** yonglihe has joined #openstack-infra17:56
clarkbzaro: I am still trying to figure out how it would be breaking17:56
*** rguillebert has quit IRC17:56
*** mfalatic_ has joined #openstack-infra17:57
*** dtardivel has quit IRC17:57
jeblairmordred: i've found that statsd will send values for all the counters and timers that it knows about in every flush interval; that means we send _thousands_ of metrics every flush interval, most of them 0, because of our sparse counters and timers on job names17:57
*** markvoelker_ has joined #openstack-infra17:57
jeblairthis is probably significantly contributing to our graphite/carbon-cache load17:57
mordredjeblair: awesome17:57
jeblairthere are options to tell statsd not to do that17:57
*** serg_melikyan has joined #openstack-infra17:57
*** burgerk_ has joined #openstack-infra17:57
*** rbrndt_ has joined #openstack-infra17:57
mordredjeblair: is there a downside to not sending all the zeros?17:57
clarkbzaro: so that rule specifically says take everything after the / and append it to /17:58
*** akshai_ has joined #openstack-infra17:58
mordredI mena, carbon seens to know how to omit missing stuff anyway17:58
jeblairmordred: i think we will just get nulls in graphite for those things... i think that will make graphs show up with holes, but that seems correct to me17:58
clarkbzaro: which means if there is a second / in there its already there17:58
*** hdd_ has joined #openstack-infra17:58
jeblairmordred: (and we already have those holes if statsd is restarted and 'forgets' about a timer/counter)17:58
*** yfried|afk is now known as yfried__17:58
*** jklare has quit IRC17:58
mordredjeblair: ++17:59
*** ivar-lazzaro has joined #openstack-infra17:59
mordredjeblair: I vote for telling statsd to not send meaningless things17:59
clarkbzaro: we could match multiple /s and only keep one17:59
jeblairmordred: also, there is a 'draw null as zero' graphite option, which can make that prettier if we don't want holes17:59
*** hdd has quit IRC17:59
clarkbbut thats a hack around not understanding what is broken17:59
*** mfalatic has quit IRC17:59
*** bnemec has quit IRC17:59
*** rbrndt has quit IRC17:59
*** ZZelle has quit IRC17:59
mordredjeblair: hrm.18:00
mordredjeblair: so - I'm torn on something18:00
*** sergmelikyan has quit IRC18:00
*** aviau has quit IRC18:00
*** markvoelker has quit IRC18:00
*** _denisra has quit IRC18:00
*** sbadia has quit IRC18:00
*** binbincong_ has quit IRC18:00
*** Kiall_ has quit IRC18:00
*** timrc has quit IRC18:00
*** yonglihe has quit IRC18:00
openstackgerritMerged openstack-infra/project-config: propose new tempest layer4 job  https://review.openstack.org/24646718:00
mordredif we do that - then we have a cloud like bluebox that may not be active for $time18:00
clarkbzaro: so I think the problme is in gerrit18:00
*** bnemec has joined #openstack-infra18:00
*** burgerk has quit IRC18:00
*** akshai has quit IRC18:00
clarkbzaro: we likely can fix this with apache but that will juts be a hack to work around the actual bug18:00
mordredjeblair: then we will have no way of knowing (I guess either way) if bb is not reporting or just idle18:00
jeblairmordred: oh, the draw nulls thing is a run-time graphing api option -- like setting the title, etc.  so we can do whatever we want there on a per-graph basis.18:00
clarkbI do not think the bug is in our rewrite rules18:00
mordredAH - cool18:01
*** jordanP has quit IRC18:01
*** Kiall has joined #openstack-infra18:01
*** aviau has joined #openstack-infra18:01
clarkbmordred: jeblair more eyes on https://review.openstack.org/#/c/243879/4/templates/gerrit.vhost.erb would be helpful18:01
*** ivar-lazzaro has quit IRC18:03
*** serg_melikyan has quit IRC18:03
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Don't run gate-horizon-dsvm-integration on stable branches  https://review.openstack.org/24653318:04
jeblairer, i don't think loadmodule belongs in a vhost def file18:04
mriedemdavid-lyle: doug-fish: ^18:04
openstackgerritK Jonathan Harker proposed openstack-infra/nodepool: Write per-label nodepool demand info to statsd  https://review.openstack.org/24603718:05
clarkbjeblair: yes I htink the whole change is -218:05
*** unicell has joined #openstack-infra18:05
clarkbjeblair: mordred more need eyes on how to appraoch the problem18:05
clarkbthe persistent appended /18:05
*** timrc has joined #openstack-infra18:05
*** ihrachys has joined #openstack-infra18:05
*** jklare has joined #openstack-infra18:06
*** sergmelikyan has joined #openstack-infra18:06
samueldmqanyone with ban powers on openstack-meeting to ban VictimOfCulture ?18:06
*** armax has quit IRC18:06
*** ZZelle has joined #openstack-infra18:07
jeblairclarkb, zaro: yeah, there's a bunch of rewriterule stuff that's probably important that's not used in that change18:07
*** Sukhdev has quit IRC18:07
clarkbjeblair: /p/ in particular18:07
jeblairclarkb: okay, so what's the problem we're trying to solve?18:07
mordredsamueldmq: I'm there and op'd, but so far it's a one-off message so I'm going to not bad the id just yet18:08
clarkbjeblair: review-dev appends a / to your url when you login. So you go from https://review-dev.openstack.org/ to https://review-dev.openstack.org//18:08
clarkbjeblair: this then breaks any query links for things like our changeid commentlinks18:08
*** sbadia has joined #openstack-infra18:08
clarkbjeblair: from what I can tell our rewrite rule is not adding that / anywhere because it explicitly matches after the /18:08
*** yfried__ is now known as yfried|afk18:08
clarkbso gerrit is adding it and the fix should be in gerrit18:08
clarkbanything we do in apache is a workaround18:09
*** austin81 has joined #openstack-infra18:09
samueldmqmordred: okay, it's talking about paris attacks, etc18:09
jeblairrewriterule ^(.*)// $1/18:09
*** yfried|afk is now known as yfried__18:09
samueldmqmordred: but seems fair to consider it as just an off-message for now18:09
samueldmqmordred: thanks18:09
*** kozhukalov_ has quit IRC18:09
mordredsamueldmq: ping me if it happens again18:09
samueldmqmordred: sure, thanks18:09
zaroclarkb: your probably right but i was not able to repro without that rule in place so i thought that was the problem.18:10
*** Sukhdev has joined #openstack-infra18:10
clarkbsamueldmq: its usually best to ignore on irc if you can18:10
clarkbshaking the hornets nest causes more problems18:11
*** Sukhdev has quit IRC18:11
*** ihrachys has quit IRC18:11
clarkbthe NE is noescape and the P is proxy which is equivalent to the proxypass rule I think18:12
jeblairclarkb, zaro: how do i get the // ?18:12
samueldmqclarkb: yep, but it's a pitty we still find such disrespectful people talking that way about serious things18:12
clarkbjeblair: login to review-dev18:12
jeblairclarkb: not seeing it18:12
tdurakovclarkb, could you review once again https://review.openstack.org/#/c/246452/18:12
clarkbjeblair: zaro may have that patch applied?18:12
*** binbincong_ has joined #openstack-infra18:12
*** _denisra has joined #openstack-infra18:12
zarojeblair: yep, i manually applied those changes18:13
jeblairclarkb, zaro: okay, i can't provide other suggestions then.  :)  above i suggested a potential rewrite rule we could insert before the main one to work around the problem: "rewriterule ^(.*)// $1/".18:13
zarojeblair: should i restore it?18:14
*** MarkAtwood has quit IRC18:14
jeblairclarkb, zaro: we might be able to better determine the source of the problem if we can observe it in action.  so restoring it might be a good idea.18:14
clarkbyes I think we should restore18:14
*** ihrachys has joined #openstack-infra18:14
clarkbthen at least I can trace through what happens on my browser18:14
*** Sukhdev has joined #openstack-infra18:15
* zaro doing now18:15
*** zns has quit IRC18:15
jeblairi'd recommend restoring it, investigating the behavior to see where it appears, and then if it doesn't look like something we can easily fix with a config setting, trying that rewrite rule to work around it.18:15
*** nadya has quit IRC18:15
*** mahatic has joined #openstack-infra18:15
*** teran has joined #openstack-infra18:16
*** tdurakov has quit IRC18:16
*** dizquierdo has joined #openstack-infra18:17
*** otter768 has joined #openstack-infra18:17
*** tdurakov has joined #openstack-infra18:18
clarkbzaro: let us know when we should look at it more18:18
smarcetmordred: clarkb: still having problems with https://review.openstack.org/#/c/245394/18:18
smarcetError: Failed to parse template haproxy/haproxy_listen_block.erb:18:18
openstackgerritDimitry Ushakov proposed openstack-infra/project-config: Enable devstack plugin for solum  https://review.openstack.org/24653718:19
smarcetnot sure why18:19
*** tonytan4ever has quit IRC18:19
*** Sukhdev has quit IRC18:20
mordredHunner: did you land that change to puppet-haproxy?18:20
*** achanda has quit IRC18:21
mordredsmarcet: there is a bug that only shows up when tests are run on hpcloud - Hunner wrote a workaround for it upstream, we need to land a patch18:21
mordredsmarcet: to consume it18:21
mordredone sec18:21
smarcetok thx for the info18:21
*** otter768 has quit IRC18:22
zaroclarkb, jeblair : ok sorry took a while. windstorm here and i just lost power18:25
zaroto repro logout then login on review-dev18:25
*** ihrachys has quit IRC18:25
openstackgerritMikhail S Medvedev proposed openstack-infra/puppet-ciwatch: Add initial implementation to deploy ciwatch  https://review.openstack.org/23860618:25
openstackgerritMonty Taylor proposed openstack-infra/system-config: Pin puppetlabs-haproxy to commit containing 1.8 fix  https://review.openstack.org/24654018:25
mordredclarkb, jeblair: ^^ that should fix the puppet apply test on centos6 on hpcloud issues18:25
*** fawadkhaliq has quit IRC18:26
*** armax has joined #openstack-infra18:26
mordredbut I think the actual fix is to get off of centos618:26
zaroi'll probably run out of juice in an hour18:26
clarkbjeblair: zaro confirmed that when I login gerrit sets the location header to https://review-dev.openstack.org//18:26
clarkbjeblair: zaro that header is not something that our apache vhost touches at all18:27
jeblairclarkb: it's possible the proxyreverse setting has an interaction with that18:27
jeblairer proxypassreverse18:27
anteayaclarkb: for me too18:27
clarkbjeblair: oh18:27
anteayazaro: can you move anywhere with power, or is it too dangerous?18:27
zaromaybe to the library18:28
* clarkb reads proxypassrevers docs18:28
openstackgerritgordon chung proposed openstack/requirements: raise minimum for pysnmp  https://review.openstack.org/24654318:28
anteayazaro: can you do so soon, we need you longer than an hour18:28
anteayazaro: but be safe18:28
*** baoli has quit IRC18:29
openstackgerritMichael Krotscheck proposed openstack-infra/infra-manual: Moved Python project guide to Project Team Guide  https://review.openstack.org/24485118:29
anteayazaro: can you get to the library before the infra meeting?18:29
clarkb(fwiw I am similarly in the middle of stormy weather so if I disapear thats why)18:29
anteayazaro: 30 minutes18:29
anteayaclarkb: ack and thanks for letting us know18:29
*** sridhar_ram has quit IRC18:29
*** ihrachys has joined #openstack-infra18:30
mordredclarkb: you used to live in the south pacific - and you're describing a weather event in the PNW as a "storm"?18:30
*** abregman is now known as abregman|mtg18:31
clarkbmordred: its a different kind of storm18:31
clarkbdefinitely far less rain involved18:31
mordredclarkb: is the threat of power loss from bearded hipsters panicing and cutting down telephone poles for firewood?18:32
docaedomordred: are you saying PNW storms can't be legit? c'mon man, it like, sprinkles rain for HOURS sometimes!18:32
greghaynes_clarkb: its storming here?18:32
*** bpokorny_ has quit IRC18:32
calebbit's a little windy outside, but not that windy >.>18:32
Hunnermordred: https://github.com/puppetlabs/puppetlabs-haproxy/pull/205 was merged to master; can you pull a hash?18:32
zaroanteaya: ohh that's a good idea. probably should head out now.18:32
clarkbgreghaynes_: calebb its not as bad as last night but still going18:32
Hunnersmarcet: ^18:32
*** ayoung has quit IRC18:32
mordredHunner: thanks! just found that, and yes: https://review.openstack.org/24654018:32
*** baoli has joined #openstack-infra18:32
greghaynes_Yea, this is why I am not out fishing today :(18:32
clarkbgreghaynes_: you should've yolo'd18:33
clarkbzaro: I think you can try removing the proxypassreverse setting18:33
* mordred thinks yolo should be clarkb's casual nick friday nick18:33
clarkbzaro: I believe gerrit will rely on its canonical url to do the correct thing18:33
clarkbzaro: and your change did remove it so maybe thats sufficient18:33
clarkbjeblair: ^18:33
*** hdd_ has quit IRC18:34
*** Sukhdev has joined #openstack-infra18:34
zaroso here's what i see and might be the issue but i don't know what's causing it: http://paste.openstack.org/show/479151/18:34
*** sabeen3 has quit IRC18:35
zarotake a look at the token param.  it's there when making request on review.o.o but not from review-dev.o.o18:35
*** Sukhdev has quit IRC18:35
jeblairmordred: the carbon-cache size is decreasing after i restarted statsd with that option!18:35
clarkbmordred: we don't get typhoons here but we do get things like hail and freezing rain and enough wind to knock over trees18:35
*** MarkAtwood has joined #openstack-infra18:35
*** mahatic has quit IRC18:35
zaroalright heading out, fingures crossed18:35
anteayazaro: be safe!18:35
*** Sukhdev has joined #openstack-infra18:36
*** Sukhdev has quit IRC18:36
mordredjeblair: woot!18:36
*** sergmelikyan has quit IRC18:36
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500918:36
mordredoooh18:36
*** pradk has joined #openstack-infra18:36
*** dims has quit IRC18:37
*** daemontool_ has quit IRC18:37
anteayayes the open id GET is different on review from review-dev18:37
mordredSpamapS: that's a sexy patch18:38
openstackgerritgreghaynes proposed openstack-infra/system-config: Add wheel_mirror_slaves that use pypi-mirror  https://review.openstack.org/16524018:38
*** dramalho has quit IRC18:38
SpamapSmordred: isn't it?18:39
SpamapSmordred: _THREE_ databases in one18:39
SpamapSmordred: is it politically incorrect to say I want to stab postgresql?18:39
*** gokrokve has quit IRC18:40
SpamapSmordred: kicking off a test run on a VM soon.. I'm predicting 2 days to run that migration on the current subunit2sql database.18:40
*** dims has joined #openstack-infra18:40
*** teran has quit IRC18:40
*** tonytan4ever has joined #openstack-infra18:41
mordredSpamapS: in this channel, you can just say "I want to stab postgresql"18:41
mordredSpamapS: there are enough people who have your back :)18:41
*** trown|lunch is now known as trown18:41
* SpamapS wonders if there are any Sharks to counter these postgresql hating Jets18:42
*** mriedem has quit IRC18:42
*** shashank_hegde has joined #openstack-infra18:42
jeblairwait, why is postgres in there _at all_?18:42
*** ihrachys has quit IRC18:42
*** e0ne has quit IRC18:43
*** ihrachys has joined #openstack-infra18:43
*** abregman|mtg has quit IRC18:43
*** jaypipes has quit IRC18:43
*** unicell1 has joined #openstack-infra18:44
*** dizquierdo has quit IRC18:44
*** daemontool has quit IRC18:44
*** sputnik13 has joined #openstack-infra18:44
*** tqtran-afk has joined #openstack-infra18:44
*** mriedem has joined #openstack-infra18:44
lifelessSpamapS: mordred: perhaps we could be accepting of other db's rather than hating them? :)18:45
*** ayoung has joined #openstack-infra18:45
*** eil397 has joined #openstack-infra18:46
openstackgerritAndreas Jaeger proposed openstack-infra/infra-specs: Consolidation of docs jobs  https://review.openstack.org/24655018:46
*** unicell has quit IRC18:46
jeblairi think it would be a lot better for us to spend our energy optimizing the one database that we use rather than supporting all of them poorly.18:47
bhunter71Trove loves them all, but we test mysql significantly better than the rest.18:47
lifelessjeblair: sure; we can do that without 'hating' a given DB engine18:47
jeblairSpamapS: is doing amazing things by optimizing all of them18:47
*** maiteb has quit IRC18:48
*** ashtokolov has joined #openstack-infra18:48
*** boris-42 has quit IRC18:48
jeblairlifeless: oh you strawmanned me.  nicely done.  i responded to 'accepting' and you went with 'hating'.18:49
* jeblair goes back to work18:49
*** ociuhandu has quit IRC18:49
lifelessjeblair: I was replying to the comments earlier about hating18:50
lifelessjeblair: sorry 'stabbing'18:50
lifelessjeblair: I hadn't even seen your comment about 'why is postgresql in there at all'18:51
lifelessjeblair: which is why my comment was addressed to SpamapS and mordred18:51
* zaro recharges18:51
anteayazaro: yay you made it!18:51
lifelessjeblair: I'm sorry you feel strawmanned - crossed conversational wires18:51
anteayazaro: library still has power I take it?18:52
*** bpokorny has joined #openstack-infra18:52
SpamapSjeblair: I tend to agree with you, and have recommended that we deprecate pgsql18:52
jeblairlifeless: no prob :)18:52
SpamapSjeblair: there's good reasons to have sqlite support apparently, but pgsql is in there "just because"18:52
SpamapSmtreinish: ^ right? ;-)18:52
zaroanteaya: yup, looks like just a small outtage since library is pretty nearby18:52
mtreinishSpamapS: yeah, pretty much18:53
*** electrofelix has quit IRC18:53
SpamapSlifeless: ^ thats why we shouldn't be accepting. ;) because we're busy.18:53
anteayazaro: yay, let us know when they get ready to get you to leave for the day, so we are in a good place for tomorrow's upgrade18:53
*** armax has quit IRC18:53
*** ivar-lazzaro has joined #openstack-infra18:53
SpamapSlifeless: and it's not a thing, so I can stab it without remorse. ;)18:53
*** tsg has quit IRC18:53
lifelessSpamapS: I'm totally fine with not supporting it; its just the adversarial way you're putting it that is offputting18:53
*** armax has joined #openstack-infra18:55
*** GheRivero has joined #openstack-infra18:55
SpamapSlifeless: I'm being adversarial because I'm frustrated, and I'm sorry if that upsets you, truly. The frustration comes from the fact that this keeps happening (seemingly free alt db support costing days of developer time.18:57
*** luqas has joined #openstack-infra18:57
*** ivar-lazzaro has quit IRC18:57
*** gokrokve has joined #openstack-infra18:57
sc68cal_AJaeger: sorry to bother you, but who has gerrit ACLs to add users to new groups, based on that link to the infra manual you gave me - do you?18:57
*** bardia has joined #openstack-infra18:57
clarkbI am going to try a couple things on review-dev really quick before meeting18:58
zaroclarkb: i've commented out 'ProxyPassReverse / http://localhost:8081/' but that did not fix it.18:58
*** amuller is now known as amuller_afk18:58
clarkbexcept I can't ssh in18:58
jeblairclarkb: wfm18:58
clarkbzaro: in that case I am pretty sure apache isn't at fault18:58
anteayasc68cal_: no, gerrit admins which are infra root18:58
clarkbI will have to go get my old ssh key18:58
jeblairah heh18:58
anteayasc68cal_: what is the url for the patch that creates the gerrit group?18:58
clarkbzaro: did you restart apache?18:58
zaroyes18:59
sc68cal_anteaya: https://review.openstack.org/24414718:59
lifelessSpamapS: so - thanks; the bit that upsets me isn't the frustration, its the 'stabbing of a thing'. if you said 'man I truely hate having to support db's when noone is running them' -> I wouldn't be upset at all. Perhaps that wouldn't express your frustration enough18:59
clarkbzaro: let me see what it looks like in my browser18:59
openstackgerritDimitry Ushakov proposed openstack-infra/project-config: Enable devstack plugin for solum  https://review.openstack.org/24653718:59
sc68cal_anteaya: sorry, was hoping to give you a break today :)18:59
*** cloudtrainme has quit IRC18:59
*** tiswanso has quit IRC18:59
*** bpokorny has quit IRC18:59
clarkbya the location header is still double /'d18:59
*** MarkAtwood has quit IRC18:59
anteayasc68cal_: thanks I appreciate the intent :)19:00
clarkbso I don't know that apache is at fault here19:00
*** sc68cal_ is now known as sc68cal19:00
anteayacan some infra-root add sc68cal_ to https://review.openstack.org/#/admin/groups/1184,members please? https://review.openstack.org/#/c/244147/19:00
pleia2meeting time19:00
SpamapSlifeless: I expressed the idiom that came to mind: I want to stab that thing. Will filter raw emotions for greater harmony in the future.19:00
*** tiswanso has joined #openstack-infra19:00
lifelessSpamapS: thank you - really - thank you!19:01
*** bpokorny has joined #openstack-infra19:01
anteayasc68cal: check back after our infra meeting19:01
*** bdemers has quit IRC19:01
jesusaurusclarkb: can you give https://review.openstack.org/241058 another review? it has a +2 from jhesketh now19:01
sc68calanteaya: ack. thanks :)19:01
clarkbjesusaurus: after meeting yes19:02
*** gokrokve has quit IRC19:02
*** bdemers has joined #openstack-infra19:03
*** cloudtrainme has joined #openstack-infra19:03
*** dramalho has joined #openstack-infra19:05
*** ociuhandu has joined #openstack-infra19:05
*** maiteb has joined #openstack-infra19:06
*** ihrachys has quit IRC19:07
*** dkranz has joined #openstack-infra19:09
anteayaclarkb: I added that patch as a link to https://etherpad.openstack.org/p/test-gerrit-2.1119:10
anteayathe git review patch19:10
clarkbanteaya: its just a test patch its not meant to merge or anything19:10
anteayaright, it just shows that you tested git review19:11
anteayathat is the etherpad tracking the things we have tested19:11
*** zxiiro has joined #openstack-infra19:11
*** shardy has quit IRC19:13
*** ccrouch has quit IRC19:13
*** ccrouch has joined #openstack-infra19:14
*** teran has joined #openstack-infra19:14
*** spzala has quit IRC19:14
*** ccrouch has joined #openstack-infra19:14
*** gokrokve has joined #openstack-infra19:15
*** kozhukalov_ has joined #openstack-infra19:16
*** rguillebert has joined #openstack-infra19:16
*** ihrachys has joined #openstack-infra19:16
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Set puppet versions in tripleo.sh not toci_instack.sh  https://review.openstack.org/24645719:17
*** dtardivel has joined #openstack-infra19:17
*** cloudtrainme has quit IRC19:19
openstackgerritDimitry Ushakov proposed openstack-infra/project-config: Enable devstack plugin for solum  https://review.openstack.org/24653719:19
*** tdurakov has quit IRC19:19
*** bpokorny has quit IRC19:19
*** bpokorny has joined #openstack-infra19:19
*** gildub_ has joined #openstack-infra19:20
*** gokrokve has quit IRC19:20
*** ildikov has joined #openstack-infra19:20
*** bpokorny has quit IRC19:22
*** markus_z has quit IRC19:22
*** bpokorny has joined #openstack-infra19:22
cody-somervillenibalizer: Did you take down your polygerrit instance? The URL in your e-mail 404s for me.19:22
*** cloudtrainme has joined #openstack-infra19:22
nibalizerya i think so19:22
nibalizeri mean to bring it back up on some host that isn't a playtoy19:22
*** signed8__ has joined #openstack-infra19:23
*** ekarlso has joined #openstack-infra19:24
*** signed8bit has quit IRC19:25
*** Piet has joined #openstack-infra19:26
*** hdd has joined #openstack-infra19:26
*** ivar-lazzaro has joined #openstack-infra19:26
*** jaypipes has joined #openstack-infra19:27
*** monester has joined #openstack-infra19:27
*** e0ne has joined #openstack-infra19:27
*** bpokorny has quit IRC19:28
*** luqas has quit IRC19:29
*** bpokorny has joined #openstack-infra19:29
*** luqas has joined #openstack-infra19:29
openstackgerritLianhao Lu proposed openstack/requirements: Bump the lower boundary of pysnmp to 4.2.3  https://review.openstack.org/24656419:30
*** electrichead is now known as redrobot19:31
*** redrobot is now known as Guest9740419:31
openstackgerritEgle proposed openstack-infra/irc-meetings: Correct Diversity WG calendar entry The Diversity Working Group holds meetings weekly, at alternating times. The entry for the calendar was never accurate. This patch fixes the wrong times. It also now includes accurate IRC channel.  https://review.openstack.org/24499919:32
*** Guest97404 is now known as redrobot19:32
*** nadya has joined #openstack-infra19:33
sdaguecody-somerville: it's really raw19:33
*** luqas has quit IRC19:34
*** sabeen has joined #openstack-infra19:34
*** pc_m has quit IRC19:34
*** devkulkarni has joined #openstack-infra19:35
*** greghaynes has joined #openstack-infra19:36
*** nadya has quit IRC19:36
*** ihrachys has quit IRC19:36
devkulkarnihello cores, whenever one of you get a chance, could you take a look at this: https://review.openstack.org/#/c/246537/3 .. thank you19:36
*** yonglihe has joined #openstack-infra19:36
*** jed56 has joined #openstack-infra19:38
*** ddieterly has quit IRC19:38
*** ddieterly has joined #openstack-infra19:39
waynrzaro clarkb are there any upcoming JJB releases planned?19:39
*** jlebon has left #openstack-infra19:40
*** jpmaxman has joined #openstack-infra19:41
*** auggy has joined #openstack-infra19:41
*** elemoine has joined #openstack-infra19:42
*** sridhar_ram has joined #openstack-infra19:43
*** ihrachys has joined #openstack-infra19:43
sdagueclarkb: where do things stand with the pip wheel mirrors?19:43
clarkbsdague: greghaynes just pushed a patch to add the slaves that I think passes CI now19:44
*** jamielennox|away is now known as jamielennox19:45
sdagueclarkb: hmmm - https://review.openstack.org/#/c/165240/ still is -119:46
*** elemoine has quit IRC19:46
*** angdraug has joined #openstack-infra19:48
clarkbI guess its not passing yet then19:48
*** salv-orlando has quit IRC19:48
*** kushal has quit IRC19:49
zarowaynr: not that i'm aware of19:49
*** e0ne has quit IRC19:50
*** ihrachys has quit IRC19:51
*** jamielennox is now known as jamielennox|away19:52
waynrcould we get one soon?19:52
*** baoli has quit IRC19:53
waynrif there's anything I can do to help out with it let me know19:54
*** erikwilson has quit IRC19:54
waynri'd be satisfied with a patch-level release so I can try using jenkins-job-builder pypi package19:54
clarkbwaynr: if you just need to pip install you can do so via the git repo19:55
*** doug-fis_ has joined #openstack-infra19:57
*** armax has quit IRC19:57
*** pc_m has joined #openstack-infra19:58
*** sabeen1 has joined #openstack-infra19:58
*** cloudtrainme has quit IRC19:58
openstackgerritDoug Hellmann proposed openstack-infra/project-config: add python3 jobs to reno  https://review.openstack.org/24657919:58
*** sabeen has quit IRC19:59
*** eliqiao has quit IRC19:59
openstackgerritMerged openstack-infra/tripleo-ci: Turn introspection back on  https://review.openstack.org/22593420:00
ruagairI have a "stable" phabricator instance up yolanda20:00
*** doug-fish has quit IRC20:00
mmedvedecould any of infra cores who is familiar with zuul swift consider approving https://review.openstack.org/#/c/229582/?20:01
ruagairWhich I can give you auth too.20:01
*** doug-fis_ has quit IRC20:01
*** eliqiao has joined #openstack-infra20:01
ruagairIt's just not using SSO and granting auth is manual.20:01
*** doug-fish has joined #openstack-infra20:01
yolandaruagair, sounds good20:01
ruagairHappy to git it though.20:01
yolandathanks20:01
clarkbmmedvede: ruagair so tl;dr is I am testing our current logstsah config that we use against logstash 1.3.3 with logstash 2.0.0 so that we can upgrade it20:01
ruagairOkay, I'l lsort some creds for you and punt you the details shortly.20:01
zarowaynr: can we revisit jjb release sometime next week?20:01
clarkbmmedvede: ruagair to do this I set up a log worker client, geard, log worker, and logstash which effectively tests the entire pipeline20:01
anteayacan some infra-root add sc68cal to https://review.openstack.org/#/admin/groups/1184,members please? https://review.openstack.org/#/c/244147/20:02
clarkbmmedvede: ruagair and I was thinking other people may be interested in putting that together and helping to test20:02
clarkbmmedvede: ruagair so if there is a good time for all 3 of us we can just work through it via IRC otherwise I can do it 1:1 (its not too complicated so shouldn't take long an hour is probably plenty20:02
*** Shrews has left #openstack-infra20:02
anteayaclarkb: how many vms to get it set up?20:03
ruagairI'm still interested clarkb20:03
*** tsg has joined #openstack-infra20:03
clarkbtoday and tomorrow are pretty busy with gerrit upgrade20:03
*** Shrews has joined #openstack-infra20:03
*** dramalho has quit IRC20:03
clarkbanteaya: I just do it locally no VMs20:03
*** hodos has joined #openstack-infra20:03
anteayaoh okay even easier20:03
*** yfried__ is now known as yfried|afk20:03
*** Sukhdev has joined #openstack-infra20:03
*** sridhar_ram has quit IRC20:03
*** baoli has joined #openstack-infra20:03
anteayayeah so as I said before after gerrit upgrade, I'm interested but don't want to slow folks down20:04
clarkbbut thursday friday this side of dateline should work for me, ruagair mmedvede I don't know what timezones you all sit in20:04
ruagairThis time works for me clarkb. Just set a day.20:04
clarkbanteaya: oh right you said you were intested too20:04
* ruagair is in AEDT.20:04
anteayaclarkb: np20:04
mmedvedeclarkb: I am interested in understanding logstash better, and if I can help test upgrade at the same time, sweet20:04
Zararuagair: pleia2 just mentioned you'd had some progress re: task-tracking spec; I looked back through th emeeting notes but couldn't find anything.20:04
waynrzaro: sure, next week is fine20:04
Zararuagair: did I miss it? (sorry if so!)20:04
anteayazaro: so we are looking for you and mordred do have a chat about the rollback process to make a decision on the upgrade20:04
clarkbwell everyone was awake and alive this time today how about 1900 UTC thursday?20:04
*** dramalho has joined #openstack-infra20:04
ruagairNi, I didn't have any progress on a spec Zara. I think someone else said I did but there was none.20:05
*** devkulkarni has left #openstack-infra20:05
anteayazaro: do you have what you need to get information for that discussion when mordred shows up again?20:05
ruagairSounds like a plan clarkb20:05
anteayaclarkb: sure20:05
waynrclarkb: i am currently using a git submodule to pin to a specific version of the JJB repo, if you have advice about how to do something similar without resorting to submodules or something that cleanly integrates with setuptools i'd appreciate it20:05
clarkbwaynr: just use pip20:06
pleia2Zara: sorry, I meant progress in geenral on work, just talking about working through auth stuff20:06
clarkbwaynr: pip can install arbitrary refs iirc20:06
waynrclarkb: could you provide an example or documentation?20:06
*** bdemers has quit IRC20:06
pleia2nothing ticked off on the spec, but work is being done20:06
Zarapleia2, ruagair: ahh, okay, sorry for the confusion. :)20:06
ruagair:-)20:07
*** cloudtrainme has joined #openstack-infra20:07
* mordred is here20:07
clarkbI am going to restart gerrit on review-dev (I want to change the canonicalurl)20:07
mordredsorry for missing the  meeting20:07
ruagairWe gave you all the tasks.20:07
Clintmordred: you have until 0000Z20:07
pleia2zaro: still around?20:07
*** claudiub has joined #openstack-infra20:07
rcarrillocruzbleh20:07
rcarrillocruzcouldn't do the meeting today either20:07
rcarrillocruzjust got my kid asleep now20:08
Zarayolanda: if you have specific things in mind, re: storyboard's incompleteness, would you be able to make stories (or point us to them if there are already stories)? it sounds like useful input.20:08
rcarrillocruzClint: interesting, i like the task tracking of pri efforts in yaml20:08
clarkbwaynr: https://pip.readthedocs.org/en/stable/reference/pip_install/#git20:08
pleia2mordred: we decided to make a go/no go decision about the gerrit upgrade following the trouble with the rollback plan, so we were looking for you and zaro to chat with us so we can decide by EoD UTC today20:08
mmedvedeclarkb: 19 UTC this thursday is no go for me, but I can always just check irc logs20:08
clarkbwaynr: note the @ref thing20:08
Clintrcarrillocruz: review welcome20:09
rcarrillocruzyup20:09
*** jamielennox|away is now known as jamielennox20:09
clarkbmmedvede: ok we can catch up after if logs don't get you started20:09
anteayamordred: folks need an understanding of the depth of the work needed to create a full rollback plan20:09
waynrclarkb: thanks, i'll try it out20:09
mmedvedeclarkb: sounds good20:09
pleia2mordred: you can look at meeting logs, but we need to figure out if we're taking too big of a risk, and if we postpone the upgrade who/how will solve this20:09
anteayamordred: as some feel uncomfortable without a full rollback plan20:09
Zarayolanda: I'm heading off for the evening but I should be online tomorrow morning to read any replies. :)20:09
mordredso - the risk is that if we run for 2 weeks and then need to roll back, we currently have no way for new refs uploaded to be recognized by the downgraded system20:09
anteayaand while the code exists that looks like it is creating reflogs noone knows what that means20:10
*** yfried|afk is now known as yfried__20:10
anteayamordred: right that was conveyed20:10
*** tdurakov has joined #openstack-infra20:10
*** bdemers has joined #openstack-infra20:11
*** fedexo has quit IRC20:11
anteayabut noone knows what the current data is doing so how long it would take to create a full rollback plan is unknown20:11
*** regXboi has quit IRC20:11
anteayaand some want a full rollback plan20:11
anteayacurrent data == data in the care of 2.1120:11
*** doug-fish has quit IRC20:12
clarkbremoving the trailing / from the canonical web url does not fix it either20:12
*** doug-fish has joined #openstack-infra20:12
anteayaclarkb: :(20:13
*** pc_m has quit IRC20:13
clarkbgonna try jeblairs workaround idea next20:13
*** ldnunes has quit IRC20:16
*** eil397 has quit IRC20:16
zaromordred: just found out that the change is accessible via rest api.20:17
*** AJaeger has quit IRC20:18
mordredzaro: aroo? that's very weird20:18
*** otter768 has joined #openstack-infra20:18
mordredzaro: maybe there was an indexing that needed to be re-run after the downgrade?20:18
anteayathe 2.11 release notes do go on at length about indexing changes20:19
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: POC: Testing client specific options from OCC  https://review.openstack.org/24658820:19
zaroi did a re-index after downgrade. or at least that's what i remember.  whatever i wrote in my test scenario.20:20
zaroyep, step #14 says reindex20:20
zaroso yeah, i can get full details of the change.20:21
*** tqtran-afk is now known as tqtran20:21
anteayazaro: what change are you referencing?20:22
*** otter768 has quit IRC20:23
*** amuller_afk is now known as amuller20:23
clarkbjeblair: doesn't look like that rewrite works, I think because we actually need to get the browser to use / instead of //20:24
*** cloudtrainme has quit IRC20:24
clarkbanother redirect may work20:24
jeblairclarkb: maybe make it a redirect or something?  yeah20:24
clarkbredirect // to /20:24
jeblair[R]20:24
zaroanteaya: the new changes (post rollback) that i was not able to access in my testing.20:25
mordredanteaya, zaro: I think perhaps after the TC meeting we should chat, so that jeblair and I can fully pay attention20:25
zaroi can't access from UI but can thru rest api20:25
anteayazaro: wow20:25
anteayamordred: yup, been waiting20:26
anteayazaro: so can you update your comment on mordred's patch so we can all understand the status clearly20:26
*** cloudtrainme has joined #openstack-infra20:26
mordredanteaya: from the rest API - you can access the change, yeah?20:26
mordredgah20:26
anteayazaro: you did such a great job with your comment from last night20:26
zarotrying to run check change command but it doesn't seem to work: https://gerrit-documentation.storage.googleapis.com/Documentation/2.11/rest-api-changes.html#check-change20:26
mordredzaro: ^^20:26
mordredcan you access the revisions on the change from the rest api?20:27
*** doug-fish has quit IRC20:27
*** doug-fish has joined #openstack-infra20:28
pabelangerianw: do you mind? https://review.openstack.org/#/c/246519/20:28
*** amrith is now known as _amrith_20:28
anteayazaro: can you GET the change? https://gerrit-documentation.storage.googleapis.com/Documentation/2.11/rest-api-changes.html#get-change20:28
*** kozhukalov_ has quit IRC20:29
clarkbok redirecting seems to work20:29
clarkband somehow its affecting location header20:29
anteayaclarkb: yay redirecting20:29
ianwpabelanger: LGTM, that would help debug i imagine :)20:29
anteayaclarkb: how is it affecting the header?20:29
clarkbif other people want ot test that really quickly that would be great20:29
clarkbanteaya: its putting a single / in the header20:29
* anteaya tests20:29
clarkbI was expecting two //s then a redirect20:29
pabelangerclarkb: based on your suggestions, I managed to drop bash for tox -eansible-functional: https://github.com/openstack/ansible-role-nodepool/blob/master/tox.ini#L2120:29
*** dkranz has quit IRC20:29
clarkbbut whatever redirecting is happehing must be happening earlier and affecting location20:29
pabelangerclarkb: going to revisit ansible-lint soon20:29
*** cloudtrainme has quit IRC20:30
openstackgerritEverett Toews proposed openstack-infra/project-config: Publish the Python OpenStack SDK docs  https://review.openstack.org/24659120:30
pabelangerianw: Ya, I thought the tox builder added it for some reason20:30
clarkbpabelanger: lint will likely be more of a pain20:30
* clarkb tests with chromium too20:30
anteayaclarkb: ff 42, signed out, signed back in got //20:31
clarkbhrm nope still broken there so must've got my browser in a happy state somehow20:31
clarkbanteaya: ya20:31
anteaya:(20:31
anteayawell confirmed the same experience anyway20:31
*** kozhukalov_ has joined #openstack-infra20:31
openstackgerritMerged openstack-infra/project-config: Add zuul-swift-upload-console-log for ansible-functional job  https://review.openstack.org/24651920:32
*** MarkAtwood has joined #openstack-infra20:32
zaroanteaya, mordred yes GET change and change/detail is what i used20:32
mordredwow20:33
*** rfolco has quit IRC20:33
*** ayoung has quit IRC20:33
*** cloudtrainme has joined #openstack-infra20:33
zaroi can access using changeId but i can seem to find any SHAs in the change detail is that somewhere else?20:33
anteayazaro: so to confirm you are saying after migration and rollback you can GET changes via the api?20:34
*** nmagnezi has joined #openstack-infra20:34
anteayathe new changes that is20:34
zaroanteaya: yes.20:34
anteayayay20:34
zaromy test server is still in rollback state20:34
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for neutron-debug probe-create bug 1477534  https://review.openstack.org/24659220:35
openstackbug 1477534 in neutron "neutron tempest check failed due to neutron-debug "RTNETLINK answers: File exists" error" [Medium,Confirmed] https://launchpad.net/bugs/147753420:35
anteayaokay can you then add the change you GET'd into the rolled back db?20:35
clarkbtime to tcpdump the gerrit side to see if it is setting location20:35
openstackgerritMerged openstack-infra/project-config: Enable devstack plugin for solum  https://review.openstack.org/24653720:35
*** Swami has quit IRC20:35
zaroclarkb: still double slash for me20:36
zaroclarkb: did you take a look at my observation? http://paste.openstack.org/show/479151/20:36
*** baoli has quit IRC20:36
zarolook at 'gerrit.token'20:36
*** greghaynes has quit IRC20:38
*** greghaynes_ is now known as greghaynes20:38
*** elemoine has joined #openstack-infra20:38
clarkbzaro: I am not sure thats related20:38
clarkbi tshould be using the location header to determine where to go which is //20:38
clarkband my redirect isn't fixing that for some reason20:39
zaroclarkb: gerrit code to manipulate url depends on that token20:40
zaroor at least that's what i noticed during my investigation of this issue.20:40
clarkbright but if it doesn't exist in newer gerrit its not part of the problem20:40
zaroi believe it does it's there if the rewrite rule is removed.20:41
*** doug-fish has quit IRC20:41
* pleia2 seeks lunch20:42
*** doug-fish has joined #openstack-infra20:42
anteayapleia2: may you find20:42
clarkbzaro: the rewrite rule shouldn't affect parameters20:42
openstackgerritAdam Gandelman proposed openstack-infra/project-config: Update astara image build  https://review.openstack.org/24659420:42
clarkbbut we can double chekc that. I have confirmed that gerrit itself sends the double // location header20:43
clarkbvia tcpdump so apache is not adding that20:43
clarkb(this is enough for me to at least say it is a gerrit bug)20:43
tdurakovclarkb, do you have 2 minutes?20:44
*** e0ne has joined #openstack-infra20:44
clarkbtdurakov: sure (I need a break from gerrit things)20:45
tdurakovi've updated comments as Sean Collins asked https://review.openstack.org/#/c/246452/20:45
tdurakovcould you review?20:45
tdurakovclarkb, ^20:46
*** doug-fish has quit IRC20:46
clarkbtdurakov: is this urgent? that shouldn't break any existing jobs right?20:46
tdurakovclarkb, it should not break any20:47
*** e0ne has quit IRC20:47
tdurakovit's kind of blocker for one that I'm working on,20:48
clarkbtdurakov: migration tests? I don't think you need that ocnfig to get those tests running20:48
greghaynescrinkle: ohai, we can chat here, actually :)20:49
tdurakovwell, it's requred20:49
crinklegreghaynes: awesome20:49
greghaynescrinkle: so, I am unsure on https://review.openstack.org/#/c/165240/17/modules/openstack_project/manifests/wheel_mirror_slave.pp if we want to juse be using the jenkins_ssh_key for all the hosts or what20:49
tdurakovclarkb, https://github.com/openstack/tempest/blob/master/tempest/api/compute/admin/test_live_migration.py#L38-L4020:50
greghaynescrinkle: because theres obviously the bit about using a seconf wheel_mirror ssh key, but I dont entirely remember if that is something there for a reason or just part of the refactoring puppet code20:50
*** tonytan4ever has quit IRC20:50
tdurakovi could duplicate this logic in my hook, but trying to make it right instead:)20:50
*** Sukhdev has quit IRC20:51
*** salv-orlando has joined #openstack-infra20:51
clarkbtdurakov: you should be using the migration switch not the number of nodes switch so no its not required20:51
*** salv-orlando has quit IRC20:51
crinklegreghaynes: i'm not sure i understand, can you rephrase your question?20:51
clarkbtdurakov: tempest has a "migration enabled" flag20:52
crinklegreghaynes: this is a separate issue from the failing tests right?20:52
clarkbtdurakov: that is what should be used20:52
greghaynescrinkle: Sure, so there are two sets of keys in that code AFAICT, a wheel mirror key and a jenkins ssh key20:52
*** salv-orlando has joined #openstack-infra20:52
tdurakovyep, and now it's not enough to run tests20:52
clarkbtdurakov: why?20:52
tdurakovcheck link above20:52
crinklegreghaynes: oh, so it's not actually appropriate to have it default to using openstack_project::jenkins_ssh_key ?20:52
greghaynescrinkle: kind of, the test is failing because of the stuff that is adding a wheel mirror key, but that is making me try and question why that second key exists at all20:52
*** dprince has quit IRC20:52
tdurakovit will skip test20:52
clarkbtdurakov: because you are checking the wrong gflag20:52
clarkbdo not check that flag20:53
clarkbbecause you don't care how many nodes there are if migration is enabled then it is enabled20:53
crinklegreghaynes: the test is failing because you haven't declared the .ssh directory and puppet isn't smart enough to do it for you20:53
tdurakovwell, it's already in tempest20:53
clarkbI dunno too many things to think about IMO that check is invalid20:53
*** kozhukalov_ has quit IRC20:53
openstackgerritMerged openstack-infra/puppet-haveged: Add acceptance tests for puppet-haveged  https://review.openstack.org/24479620:53
crinklegreghaynes: oh i see20:54
greghaynescrinkle: Yea, in the resource which is adding the wheel mirror key. I guess one big question I am trying to ask is - where are the resources to add the jenkins ssh key20:54
greghaynesAFAICT they are just nonexistent here20:55
tdurakovclarkb, so, what should i do? remove extra check from tempest? not sure this will be approved20:55
crinklegreghaynes: ha20:55
crinklegreghaynes: you're right20:55
*** Swami has joined #openstack-infra20:55
clarkbtdurakov: I think we should at least have the conversation, it is weird that migration being explicitly enabled would be overridden by a ost count check when in theory you can have working migration tests without that20:55
clarkb(though thats not the case today)20:55
crinklegreghaynes: does jenkins need to be able to log into these?20:55
greghaynescrinkle: ok. So maybe what I actually want is to remove the wheel_mirror ssh key things and ensure the jenkins ssh key instead?20:55
greghaynescrinkle: Yes - the mirrors are created from a CI job which I assume == login as jenkins20:56
crinklegreghaynes: sounds good to me, but it will still fail because of the missing .ssh directory20:56
greghaynescrinkle: Then that job needs to be able to rsync to the persistent hosts which hold the mirrors, which is why there is a second key (I just figured that out)20:57
crinkleoh20:57
greghaynesclarkb: ^ can you sanity check my rambling20:57
crinklelol20:57
tdurakovclarkb, btw, this patch was introduced to devstack-gatse to support this tempest checks: https://github.com/openstack-infra/devstack-gate/commit/3c6b1bdfe3e02d444dca2b387d6a8f76c0745e2020:57
tdurakovso i'm just trying to align all things20:58
clarkbzaro: looks like openid is more broken20:59
clarkbzaro: that token is indeed used to get back from where you started and if it isn't ther you go to PageLinks.MINE20:59
*** erikwilson has joined #openstack-infra20:59
*** AJaeger has joined #openstack-infra20:59
clarkbzaro: if you try logging in from a change page you don't end up on the change page you end up on My Changes20:59
clarkbso I think the token isn't being set at all and it results in ^20:59
anteayajeblair: not sure if you saw this from last night: https://review.openstack.org/#/c/82898/21:00
clarkbtdurakov: yes we need the host count for a specific test (not migration testing)21:00
*** dims_ has joined #openstack-infra21:00
anteayaI posted it after your conversation about meeting channels21:00
clarkbtdurakov: the test that >1 nova compute node was used if >1 nova compute nodes exist21:00
greghaynescrinkle: there is also http://git.openstack.org/cgit/openstack-infra/puppet-jenkins/tree/manifests/jenkinsuser.pp21:00
greghaynescrinkle: I wonder if I should be using that21:00
clarkbzaro: I think https://gerrit.googlesource.com/gerrit/+/stable-2.11/gerrit-openid/src/main/java/com/google/gerrit/httpd/auth/openid/OpenIdServiceImpl.java#478 is the bug21:01
clarkbzaro: it should be doing a url path append not a string append21:01
crinklegreghaynes: maybe!21:01
clarkbzaro: I still don't know why it isn't setting the token21:02
openstackgerritMerged openstack-infra/puppet-lodgeit: Add acceptance tests for puppet-lodgeit.  https://review.openstack.org/22527921:02
tdurakovclarkb, ok, how command reordering could affect any?21:02
*** dims has quit IRC21:02
jeblairanteaya: oh neat...  i do like clarkb's suggestion on that though :)21:03
*** dzamboni has quit IRC21:03
tdurakovas i commented there is a bug in d-g now, cause tempest could be not configured properly21:03
clarkbtdurakov: it doesn't I am just juggling about 5 way more important things right now21:04
clarkbtdurakov: so I was trying to understand if this is actually required21:04
*** dkehnpad has quit IRC21:04
tdurakovif someone add DEVSTACK_GATE_TEMPEST_NOTESTS=1 to job template, this conf will not happen21:04
*** thiagop has quit IRC21:04
*** bhunter71 has quit IRC21:04
anteayajeblair: yup, just wanted to show you it existed, in case you care21:05
clarkbtdurakov: sounds like it is required (but maybe it shouldn't be)21:05
openstackgerritMerged openstack-infra/elastic-recheck: Add query for neutron-debug probe-create bug 1477534  https://review.openstack.org/24659221:05
openstackbug 1477534 in neutron "neutron tempest check failed due to neutron-debug "RTNETLINK answers: File exists" error" [Medium,Confirmed] https://launchpad.net/bugs/1477534 - Assigned to Sean M. Collins (scollins)21:05
anteayafolks didn't much at the time21:05
mordredjeblair, zaro: ok - so - gerrit rollbacks21:05
*** doug-fish has joined #openstack-infra21:06
crinklegreghaynes: maybe it should be using http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/slave.pp - it sets up jenkins::slave which sets up jenkins::jenkinsuser21:06
tdurakovclarkb, it's just side effect, imho, not desired side-effect21:07
mordredjeblair: I thought I had a thought about what was going on here, but now zaro can see new revision in old gerrit via api - just not through web ui21:07
*** rossella_s has quit IRC21:07
clarkbzaro: https://gerrit.googlesource.com/gerrit/+/stable-2.11/gerrit-openid/src/main/java/com/google/gerrit/httpd/auth/openid/OpenIdServiceImpl.java#474 is going to end with a / and 478 is going to start with a / so I think we get two /s21:07
clarkbzaro: what happened to fixing this in gerrit?21:07
anteayamordred: I'm not yet sure what can be done with the GET'd change though21:07
*** rossella_s has joined #openstack-infra21:08
anteayamordred: do we try to apply it to the db, do we offer it as a new patch?21:08
mordredwell, it makes me think there is a data transition missing21:08
*** AJaeger has quit IRC21:08
* mordred looking21:08
* anteaya nods21:08
*** salv-orlando has quit IRC21:08
*** tiswanso has quit IRC21:09
anteayazaro: has added his observations as a comment to https://review.openstack.org/#/c/245598/21:09
*** bdemers has quit IRC21:10
*** salv-orlando has joined #openstack-infra21:10
tonybjeblair: If I follow http://docs.openstack.org/infra/system-config/irc.html and create #openstack-cross-project with the intent that it is a mixed discussion/meeting channel is that okay?21:12
*** tiswanso has joined #openstack-infra21:12
*** bdemers has joined #openstack-infra21:12
jeblairtonyb: see discussion in #openstack-dev21:12
clarkband I definitely don't see where gerrit adds that token anymore21:13
clarkbits attempts to use it if its there but never sets it21:13
stevemar_silly question, as ptl, should i be able to add folks to keystone-stable-maint? https://review.openstack.org/#/admin/groups/538,members21:13
jeblairtonyb: i think we're making a new meeting channel for cp topics21:13
clarkbat least not within the openid class itself21:13
jeblairtonyb: i think sdague plans on doing that21:13
clarkbstevemar_: openstack stable maint iirc21:13
stevemar_the "Add" box is greyed out :\21:13
clarkbstevemar_: so not necessarily the ptl or project cores21:13
* tonyb will read the scoolback and volenteer21:13
stevemar_clarkb: ah, so ping one of them21:14
jeblairclarkb: why does 478 necessarily start with a /?21:14
openstackgerritDanilo Ramalho proposed openstack-infra/puppet-openstack_health: Fix httpd apply Ubuntu Precise  https://review.openstack.org/24605321:14
clarkbjeblair: because of like 47421:14
clarkbjeblair: it uses the correct url parsing there which should end with a /21:15
clarkbjeblair: but then a few lines later does not use correct url parsing and just appends21:15
clarkb(it doesdecode it at least, but to join two halfs of a url requires a bit more)21:15
*** hodos has quit IRC21:15
*** dramalho has quit IRC21:16
*** maiteb has quit IRC21:16
*** Nakato_ is now known as Nakato21:16
jeblairclarkb: maybe i'm just not caught up, but i don't know why 474 should necessarily end with a / and while 478 would necessarily start with one.21:17
clarkbjeblair: https://gerrit.googlesource.com/gerrit/+/stable-2.11/gerrit-httpd/src/main/java/com/google/gerrit/httpd/CanonicalWebUrl.java#4321:17
clarkbthats 474 starting with one21:17
clarkber ending with on21:17
jeblairlast change to these lines: https://gerrit-review.googlesource.com/#/c/57800/21:17
*** amitgandhinz has quit IRC21:18
clarkbjeblair: https://gerrit.googlesource.com/gerrit/+/stable-2.11/gerrit-openid/src/main/java/com/google/gerrit/httpd/auth/openid/OpenIdServiceImpl.java#470 is where we set token for 47821:18
jeblairwhoat21:19
jeblairhttps://gerrit-review.googlesource.com/#/c/57800/8/gerrit-openid/src/main/java/com/google/gerrit/httpd/auth/openid/OpenIdServiceImpl.java21:19
clarkbjeblair: https://gerrit.googlesource.com/gerrit/+/stable-2.11/gerrit-common/src/main/java/com/google/gerrit/common/PageLinks.java#38 defines it21:19
jeblairlook at that diff -- does that look wrong to you?  the lines don't line up21:19
clarkbjeblair: so I am reasonably sure just based on reading the code that that is what is happening (I have not run it through debugger21:19
jeblairthe empty line on the right should be at the start of the block, not the end, right?21:19
clarkblet me look at diff21:19
anteayazaro: how long can you stay at the library?21:20
jeblair(sorry it's off-topic, but i just had a really hard time reading that and wondered if that's a change to gerrit ui? and when?)21:20
*** sergmelikyan has joined #openstack-infra21:20
zaroanteaya: as long as there is power and i'm not too hungry to pass out21:20
clarkbjeblair: agreed21:20
openstackgerritApoorva Deshpande proposed openstack-infra/ciwatch: Update contact us information for ciwatch  https://review.openstack.org/24660221:21
anteayazaro: okay just want to ensure we are wrapped up before you disappear21:21
zarojust added additional info to the rollback script change21:21
*** kgiusti has quit IRC21:21
*** yfried__ is now known as yfried|afk21:21
anteayazaro: thanks, did you need to take a break for food? would like to time that around a chat with mordred and jeblair if possible21:21
clarkbanyways we are taking a canonical url which ends in / (because that class makes it do so) and appending PageLinks.MINE which == '/' to it21:21
clarkbrather than doing a url.join() type thing21:21
nibalizeri'm gonna go do some errands, i'll try to poke back in here inbetween to get the go-nogo status21:21
clarkbseparately broken gerrit is not properly setting the gerrit return token thingy which it should be using to send you back to where you started21:22
zaromordred: more info in the change.21:22
clarkbzaro: did the upstream fix for this stall? its clearly broken21:22
zarolooks like the commit info is the thing that we can no longer retrieve.21:23
*** rpodolyaka1 has joined #openstack-infra21:23
jeblairclarkb: is there an upstream fix?21:23
clarkbjeblair: zaro had pushed one at one point21:23
zaroclarkb: i don't think my change was correct.21:23
jeblairzaro: link?21:24
clarkbzaro: ah ok. I think the correct fix here is to join rdr and token21:24
clarkbnot to append them something like a python os.path.join21:24
*** rguillebert has quit IRC21:25
jeblairclarkb: i haven't followed everything but i agree your suspected cause is plausible and if so, that's the right solution21:25
clarkbjeblair: tl;dr is CanonicalWebURL appends / if it isn't already there, then we append PageLinks.MINE which is '/' in the openid code21:26
zarojeblair, clarkb :https://gerrit-review.googlesource.com/#/c/72130/21:26
*** dkranz has joined #openstack-infra21:27
jeblairzaro: i agree that's not the right solution, but if that worked for you, it supports clarkb's theory21:28
*** Rockyg has joined #openstack-infra21:28
anteayazaro: I get a 500 on that link21:28
* anteaya tries another browser21:28
zaroclarkb: i think putting back append with if not '/' is a workable solution.21:28
clarkbzaro: basically oyu need to check rdr[-1] and token[0] and make sure only one is /21:29
jeblairokay, somewhere around here is a terminal running an editor with a commit message i was writing 3 hours ago...21:29
zaroyea, too many things integrated together was difficult to know what the right solution is thre.21:30
zaroclarkb: also i have no idea why gerrit token is null only for our gerrit.21:32
*** maishsk has joined #openstack-infra21:32
*** jffische has quit IRC21:32
*** krtaylor has quit IRC21:32
clarkbzaro: does it work with other gerrits?21:32
*** rpodolyaka1 has quit IRC21:32
clarkb(I don't know how many people are using openid)21:32
zaroit works for libreoffice21:33
zaroit works on my local machine when i setup openid21:33
*** weshay has quit IRC21:34
clarkblibreoffice is running 2.10.721:34
clarkb(so different versions)21:34
clarkband they allow any openid looks like21:34
clarkbmaybe its related to our single sign on config?21:34
zaroi believe DavidO tried to repro with 2.10 and was not able to repro21:34
zarothe problem was in 2.10 as well21:34
zarowe had this problem when we upgraded to 2.10 last time21:35
*** dtardivel has quit IRC21:35
clarkboh right21:36
clarkbanyways I would look at single sign on as being related since that is one way we are clearly different21:36
openstackgerritJames E. Blair proposed openstack-infra/puppet-graphite: Set statsd to delete idle counters/timers  https://review.openstack.org/24661021:36
*** tonytan4ever has joined #openstack-infra21:37
zarofor some reason i don't think i was able to setup the SSO thing on my local env.  so maybe your right.21:37
*** maishsk_ has joined #openstack-infra21:37
zarois there a way to set that up on dev env? otherwise i cannot debug.21:37
jeblairzaro: should be no different from any other openid dev setup21:38
jeblair(which is to say, you may need to make a modification to your local hosts file)21:38
zaroi clearly must be doing something wrong because when i set it up gerrit fails to start21:38
jeblairzaro: what's the error?21:38
zarohang, no messages21:38
jeblairzaro: make sure you have the url specified; compare to the config on review-dev.21:39
openstackgerritVilobh Meshram proposed openstack/requirements: Add python consul client  https://review.openstack.org/24602121:40
*** maishsk has quit IRC21:40
*** maishsk_ is now known as maishsk21:40
*** aysyd has quit IRC21:40
zarojeblair: gerrit url? i believe i do have that setup. i was able to setup the basic openid thing.21:40
jeblairzaro: no, the openid url21:41
jeblair        openIdSsoUrl = https://login.launchpad.net/+openid21:42
jeblairzaro: ^21:42
jeblairin [auth]21:42
*** kozhukalov_ has joined #openstack-infra21:42
bardiaasselin_: where does the gerrit ssh key written to after puppet setup?21:43
*** rpodolyaka1 has joined #openstack-infra21:44
zarojeblair: yes, i did add that to [auth] section. i basically took a copy of review-dev.o.o gerrit.config and modified it to work with my local site.21:44
jeblairzaro: that's my only suggestion short of running it in a debugger to see why it's hung21:44
bardiaasselin_: in another question should i use the Zuul plugin or Gerrit plugin way in jenkins?21:45
*** krtaylor has joined #openstack-infra21:45
clarkbI need to pop out for a few but when I come back will look into why I am not getting redirected like I expect (as a workaround)21:47
jeblairinfra-root: based on my testing, https://review.openstack.org/246610 will make a _huge_ difference in carbon-cache memory usage on graphite.  i think it likely to alleviate the oom errors, so i think we should land it asap.21:47
clarkbmaybe I will look at that really quickly first21:47
clarkb(no more OOMing sounds good)21:47
clarkbjeblair: is that different than deleteidlestats?21:49
*** alivigni has quit IRC21:49
jeblairclarkb: yes, i tried deleteidlestats, but i think some of our guages go too long between updates for that to work... i'd like to use it, but i think we won't necessarily send a guage update for, say, every zuul pipeline every 10 seconds.21:50
mordredjeblair: convinced21:50
jeblairclarkb: if you look at the sparklines on zuul status, you can see some holes there...21:50
clarkbjeblair: it looks like deleteidlestats is just a superset21:50
*** tongli has quit IRC21:50
clarkbjeblair: so instead of setting each config value you set the one and its done?21:50
mordredjeblair, zaro: ok. so I'm walking through comparitive code, and I can see no database-level relevant changes in 2.11 vs. 2.8 or 2.1021:50
clarkbhttps://github.com/etsy/statsd/blob/master/exampleConfig.js#L55-L6121:50
jeblairclarkb: yeah, deleteidle sets that for all 4 things, i'm only setting it for 2.21:51
clarkboh you don't want to delete gauges21:51
mordredthe only think I can think of is that something has changed WRT to how commit info is stored on the filesystem21:51
jeblairclarkb: right21:51
clarkbgotcha21:51
*** mtanino has quit IRC21:51
openstackgerritEverett Toews proposed openstack-infra/project-config: Publish the Python OpenStack SDK docs  https://review.openstack.org/24659121:51
*** dims_ has quit IRC21:51
*** hdd has quit IRC21:52
*** rpodolyaka1 has quit IRC21:52
jeblairmordred, zaro: i really don't understand why it's apparent in the rest api but not the ui; i'm told the ui _uses_ the rest api.21:52
openstackgerritMikhail S Medvedev proposed openstack-infra/system-config: Remove logstash/elasticsearch classes, use puppet-openstackci  https://review.openstack.org/24001121:52
greghaynescrinkle: *shrug* seems useful21:53
mordredjeblair: it's broken in the rest api too21:54
mordredjeblair: it's broken once you actually request the commits21:54
*** rguillebert has joined #openstack-infra21:54
mordredjeblair: check the latest comment on https://review.openstack.org/#/c/245598/ from zaro21:54
mordredjeblair: it's the get commit endpoint that's the problem21:54
jeblairoh21:55
mordredwhich would jive with 'something about commits and reflog being different'21:55
mordredI'm currently trying to figure out what is going on with this reflog thing21:55
zaroyeah, i believe that's what ui barfs on21:55
mordredit is - that section of the code is walking the revision tree to get specific commit details21:55
mordredand if it hits an IOError throws that exception21:55
*** sdake has joined #openstack-infra21:56
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Send fewer statsd guages  https://review.openstack.org/24661921:57
*** dims has joined #openstack-infra21:57
mordredok. the 'reflog' is a red herring21:57
mordredthe reflog migration is adding a reflog to refs/meta/config21:57
*** tiswanso has quit IRC21:58
asselin__bardia, http://git.openstack.org/cgit/openstack-infra/puppet-zuul/tree/manifests/init.pp#n21121:58
pleia2bah, herring21:58
Clintdelicious21:59
bardiaasselin_: ok so zuul is easier to setup then21:59
asselin__bardia, neither, you don't need to install any additional plugins. these are the ones you need which should be installed for you: http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/manifests/jenkins_master.pp#n4021:59
*** sdake_ has joined #openstack-infra21:59
asselin__bardia, so just 'scp' as the doc explains22:00
mordredjeblair: so, summary from me at this point - I have NO IDEA what is different - it does not seem to be schema structure or content related, unless there is something I just fundamentall do not grok22:00
bardiaasselin_: I'm trying to follow this http://docs.openstack.org/infra/system-config/third_party.html#the-zuul-gerrit-trigger-way22:00
*** sdake has quit IRC22:00
openstackgerritApoorva Deshpande proposed openstack-infra/ciwatch: Update contact us information for ciwatch  https://review.openstack.org/24660222:00
jeblairmordred: can you point me at the loc where you think it's blowing up?22:01
bardiaasselin_: so zuul is already setup. I should be able to test against openstack-dev/ci-sandbox22:01
asselin__bardia, ok, all of those changes would go to your project-config settings22:01
bardiaasselin_: okie dok22:01
mordredjeblair: yes.22:01
asselin__bardia, yes e.g. http://git.openstack.org/cgit/openstack-infra/project-config-example/tree/zuul/layout.yaml22:01
*** elemoine has quit IRC22:02
*** sdake_ has quit IRC22:02
mordredjeblair: in openstack/2.8.4 gerrit-server/src/main/java/com/google/gerrit/server/patch/PatchSetInfoFactory.java22:02
mordredjeblair: line 10022:02
asselin__bardia, and http://git.openstack.org/cgit/openstack-infra/project-config-example/tree/jenkins/jobs/projects.yaml22:02
*** tmorin has joined #openstack-infra22:02
*** tmorin has left #openstack-infra22:02
mordredthe try/catch structure is slightly different in 2.11 but the essential parts of the code at least in there do the same thing22:03
bardiaasselin_: cool yeah I'm about test against the sandbox22:03
*** erikwilson has quit IRC22:04
asselin__bardia, cool22:04
*** angdraug has quit IRC22:04
*** dkranz has quit IRC22:04
*** baoli has joined #openstack-infra22:06
*** rpodolyaka1 has joined #openstack-infra22:06
*** doffm_ is now known as doffm22:06
*** amitgandhinz has joined #openstack-infra22:06
jeblairhttp://git.openstack.org/cgit/openstack-infra/gerrit/tree/gerrit-server/src/main/java/com/google/gerrit/server/patch/PatchSetInfoFactory.java?h=openstack/2.8.4#n10022:06
mordredjeblair: yes22:07
jeblairmordred, zaro: what do the rows in the patch_sets table look like for the new revisions?22:08
jeblairare they maybe missing the 'revision' value or something?22:08
*** mtanino has joined #openstack-infra22:08
*** eliqiao has quit IRC22:09
mordredjeblair: I'm looking for that right now22:09
* zaro looking22:09
*** eliqiao has joined #openstack-infra22:10
mordredjeblair: old and recent data in patch_sets looks identical22:10
*** baoli has quit IRC22:11
*** weshay_xchat has joined #openstack-infra22:12
mordred| revision                                 | uploader_account_id | created_on          | change_id | patch_set_id | draft |22:13
mordred| e219ecc7bba3c21513fc4b16a2cb2f01d4f09a89 |                3164 | 2015-11-10 22:42:05 |      5383 |            1 | N     |22:13
*** luqas__ has joined #openstack-infra22:13
mordredthat's what it looks like for a recent change in review-dev22:13
mordredjeblair, zaro: is it possible that new jgit is creating git repos in a form that old jgit cannot read?22:14
*** EricGonczer_ has joined #openstack-infra22:14
clarkbmordred: that would be scary as git has been very very stable22:14
openstackgerritTony Breeds proposed openstack-infra/project-config: Add #openstack-cross-project to eavesdrop  https://review.openstack.org/24662822:14
openstackgerritTony Breeds proposed openstack-infra/system-config: Add #openstack-cross-project to eavesdrop  https://review.openstack.org/24662922:14
*** cbader has quit IRC22:15
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: add meeting for service catalog tng effort  https://review.openstack.org/24574522:15
*** rpodolyaka1 has quit IRC22:15
tonybjeblair, ttx: ^^22:15
jeblairtonyb: the name sdague suggested was #openstack-meeting-cp i think22:15
mordredclarkb: yah22:15
mordredclarkb: it's the only thing I can think of ...22:16
mordredzaro: do you have the downgraded gerrit still?22:16
zaromordred: jgit version has changed.22:16
jeblairmordred, zaro: can cgit read them, like 'git show e219ecc7bba3c21513fc4b16a2cb2f01d4f09a89'22:16
anteayatonyb: the project-config change has to come first, accessbot needs to know about the channel before eavesdrop can log22:16
jeblairmordred, zaro: there's a jgit command line, right?22:16
zaromordred: yes i do22:16
clarkbjeblair: yes its convoluted but yes22:16
mordredzaro: cool. that's the one that dies on 1a0b5671198813c3df558cc044ab3c437265ea8e ?22:17
*** dramalho has joined #openstack-infra22:17
tonybanteaya: Huh, I guess I mis-remebered that.  Thanks.22:17
mordredzaro: can you cd to review_site/git/openstack/python-jenkins and do "git log 1a0b5671198813c3df558cc044ab3c437265ea8e" ?22:17
*** kozhukalov_ has quit IRC22:17
mordredzaro: (is it on a server I can ssh to or is it private to you?)22:17
zaromordred: it's an HP VM.  how would i give you access?22:18
zaroi've been using the ubuntu account to login.22:18
mordredzaro: you could drop my public key into the .ssh/authorized_keys file of the ubuntu account22:18
*** thinrichs has joined #openstack-infra22:18
*** nmagnezi has quit IRC22:19
openstackgerritJames E. Blair proposed openstack-infra/zuul: Simplify wait_time stats  https://review.openstack.org/24663022:19
*** bhunter71 has joined #openstack-infra22:19
*** thorst has quit IRC22:19
mordredzaro: http://paste.openstack.org/show/47918622:19
zaromordred: ok give me a min.22:19
mordredzaro: thnaks!22:19
tonybjeblair: Hmm okay. I'll register that22:19
*** otter768 has joined #openstack-infra22:19
*** Sukhdev has joined #openstack-infra22:19
*** thorst has joined #openstack-infra22:19
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500922:19
*** julim_ has quit IRC22:20
jeblairwow "/etc/init.d/carbon-cache restart" works now :)22:20
anteayacongratulations22:20
mordredwoot!22:21
*** rcernin has quit IRC22:21
*** dramalho has quit IRC22:21
jeblairtimrc: https://review.openstack.org/24663022:22
zaromordred: msg you the server info.22:23
*** erikwilson has joined #openstack-infra22:23
*** ayoung has joined #openstack-infra22:23
*** thorst has quit IRC22:23
*** otter768 has quit IRC22:24
*** apoorvad has joined #openstack-infra22:24
openstackgerritTony Breeds proposed openstack-infra/system-config: Add #openstack-meeting-cp to eavesdrop  https://review.openstack.org/24662922:25
openstackgerritTony Breeds proposed openstack-infra/project-config: Add #openstack-meeting-cp to eavesdrop  https://review.openstack.org/24662822:25
thinrichsCould I get some eyes on this review?22:25
thinrichshttps://review.openstack.org/#/c/241969/622:25
*** luqas__ has quit IRC22:25
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: add meeting for service catalog tng effort  https://review.openstack.org/24574522:25
thinrichsWe're trying to enable the devstack plugin so we can continue gating after Mitaka1.22:25
*** luqas has joined #openstack-infra22:26
openstackgerritApoorva Deshpande proposed openstack-infra/ciwatch: Update contact us information for ciwatch  https://review.openstack.org/24660222:26
mordredfatal: bad object 1a0b5671198813c3df558cc044ab3c437265ea8e22:26
*** EricGonczer_ has quit IRC22:27
jeblairmordred: that's with cgit?22:27
mordredyup22:27
jeblairmordred: so the reason we can't downgrade is that new jgit is writing git repos that neither old jgit, nor cgit can read?22:27
mordredmaybe?22:27
mordredthis: | 1a0b5671198813c3df558cc044ab3c437265ea8e |                6987 | 2015-11-17 07:53:13 |    236753 |            1 | N     |22:27
mordredis definitely in the db there22:27
*** EricGonczer_ has joined #openstack-infra22:28
jeblairmordred: what does refs/changes/87/6987/1 point to?22:28
jeblairoops not the change id22:29
jeblairmordred: refs changes/53/236753/1 i guess :)22:29
jeblairmordred: refs/changes/53/236753/1 even22:29
mordred236753 is not in refs/changes at all22:29
tonybanteaya: Thanks for the review22:29
*** lykinsbd has quit IRC22:30
anteayatonyb: sure, thanks for doing the work22:30
mordred236753 is in project-team-guide22:30
*** luqas has quit IRC22:30
mordredand git log 1a0b5671198813c3df558cc044ab3c437265ea8e  also fails in project-team-guide22:30
jeblairoh i thought that was supposed to be one of the new changes zaro uploaded after the upgrade?22:30
zarolemme double check that22:31
mordredrefs/changes/53/236753/122:31
mordredpoints to22:31
mordred644f9dda6453f0ceb8d7d2fa8e1901eaadd267ca22:31
mordredwhich git log does resolve22:31
jeblairmordred: https://review.openstack.org/#/c/236753/22:32
jeblairso that's an old change22:32
zaroyes, verified it's one of the new changes.22:32
mordredtaht revision is not in the db22:32
openstackgerritApoorva Deshpande proposed openstack-infra/ciwatch: Update contact us information for ciwatch  https://review.openstack.org/24660222:32
mordredso - righ tnow there is a mismatch between the db content and the filesytem22:32
jeblairit sounds like we're looking at zaro's forked db but with the _current_ git repos22:32
mordredselect * from patch_sets where revision='644f9dda6453f0ceb8d7d2fa8e1901eaadd267ca';22:32
mordredreturns nothing22:33
*** amitgandhinz has quit IRC22:33
jeblairdid we not have a synchronized snapshot of the db and git repos?22:33
jeblair(or it's possible that instead of the _current_ git repo, maybe we're looking at a git repo that's, say 1 hour later than the db snapshot?)22:34
*** jed56 has quit IRC22:34
zaroyeah, i have it.  db and git files synced. that's what i used to test22:34
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500922:34
*** tdurakov has quit IRC22:35
zaroi'm not sure about that, got the files from fungi22:35
zaroit's only date stamped i guess, review_openstack_org_20151019.tar.gz22:35
openstackgerritPaul Belanger proposed openstack-infra/project-config: Create ansible-role-jobs for JJB and zuul  https://review.openstack.org/24663322:36
*** tdurakov has joined #openstack-infra22:36
zaromordred: ^ you see those files?22:36
jeblairzaro: that's within a day of when this change was uploaded.22:36
jeblairi think that supports the theory of the db and git repos being out of sync22:36
zarothat's oct isn't it?22:36
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: remove oslo-incubator jobs  https://review.openstack.org/24546222:36
mordredyah. but unless that was a backup taken when gerrit was shut down - there is no way it's a fully consistent snapshot22:37
jeblairzaro: yes, that file is named "october 19" this change was uploaded "october 18"22:37
pabelangerianw: ^ that will help up with ansible clean up22:37
jeblairmordred: agreed22:37
mordredHOWEVER - that should not matter if we're looking specifically at changes that were uploaded fresh in the new install22:38
mordredit means there would be changes that are out of sync - but we can ignore those for the purposes of this22:38
zarothat is odd, i uploaded that last night. i couldn't have been that sleepy.22:38
mordredzaro: which is a change that you uploaded a patch to?22:38
jeblairmordred: yep, as long as we don't upload a new change with the same change number to the same project as one that has an out-of-sync change22:38
jeblairmordred: eg, as long as we don't create 236753 on project-team-guide, we should be fine22:39
clarkbI am ok to continue doing things to review-dev ya?22:39
jeblairclarkb: think so22:39
mordredclarkb: yah22:39
clarkbok just doubble checking22:39
*** gordc has quit IRC22:40
anteayaso the current theory is that the db and git files are out of sync because when zaro's test db dump was created changes happened during the time of the dump?22:40
*** camunoz has joined #openstack-infra22:40
anteayado I have that correct?22:40
*** austin81 has left #openstack-infra22:40
openstackgerritgreghaynes proposed openstack-infra/system-config: Add wheel_mirror_slaves that use pypi-mirror  https://review.openstack.org/16524022:40
jeblairanteaya: yes, and the errors we are seeing are a result of those differences.  that would not happen during the actual upgrade.22:41
* anteaya nods22:42
greghaynescrinkle: Next round ^22:42
ianwpabelanger: the pep8 is a new one there?  or did i misread?22:42
anteayawonderful22:42
jeblairanteaya: to correctly simulate the upgrade/rollback, we would need to stop gerrit while doing a db and filesystem dump to ensure they are in sync.  instead, we propose to ignore errors related to those changes and focus only on changes we know are new when examining the rollback procedure.22:42
anteayajeblair: makes sense22:42
openstackgerritLucas Alvares Gomes proposed openstack/diskimage-builder: Extend root device hints for different types of WWN  https://review.openstack.org/24583922:42
*** Sukhdev has quit IRC22:43
openstackgerritLucas Alvares Gomes proposed openstack/diskimage-builder: Add dynamic-login element  https://review.openstack.org/24508222:43
jeblairanteaya, clarkb: http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=2944&rra_id=1&view_type=&graph_start=1447713841&graph_end=1447800241 is a result of the (still running) whisper resize22:44
*** apoorvad has quit IRC22:44
*** burgerk has joined #openstack-infra22:45
*** thinrichs has quit IRC22:45
*** dingyichen has joined #openstack-infra22:45
*** thinrichs has joined #openstack-infra22:45
jeblairanteaya, clarkb: http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=443&rra_id=1&view_type=&graph_start=1447713921&graph_end=1447800321 is a result of the statsd config change22:45
zarojeblair, mordred : ok looks like we've gotten to the root of this issue. i'll switch my attention back to gerrit url '//' problem which should not prevent us from upgrading.22:45
clarkbjeblair: that is a pretty consistent slope22:45
*** burgerk_ has quit IRC22:46
mordredzaro: ++22:46
jeblairanteaya, clarkb: note that unlike the last time memory use was at this level, carbon-cache is actually running :)22:46
greghaynesnew DIB release incoming22:46
greghaynesshouldnt cause any issues, just PSA22:46
mordredgreghaynes: woot22:47
*** annegentle has quit IRC22:47
mordredgreghaynes: also, that change about compat=22:47
mordredgreghaynes: makes me sad22:47
greghaynesmordred: me too!22:47
*** annegentle has joined #openstack-infra22:47
anteayawow22:47
*** claudiub has quit IRC22:47
anteayathe statsd config change had quite the effect22:47
greghaynesmordred: Not sure what we want to do about that... I might have to rally a vote from the cores or something22:48
openstackgerritStephen Lowrie proposed openstack/os-testr: Change to always parsing classes from test_id  https://review.openstack.org/24663622:48
zarojeblair, mordred : ohh and if one of you gents could update the rollback change with your assesment that would be great.22:48
mordredgreghaynes: yah. lazy consensus there is not working22:48
jeblairzaro, mordred: so with the new understanding of the erroneous changes, have we verified that new changes do roll back as expected?22:48
*** peristeri has quit IRC22:48
mordredjeblair: no22:49
anteayawhisper resize is quite effective too22:49
zarois that verifiyable22:49
zaro?22:49
anteayazaro: well can you recall any change you created anew in review-dev before you rolled back?22:49
anteayado you recall the commit message name?22:49
zaroi push 2 (what i remembered was new) commits, 236753, and 23675422:50
clarkbRewriteRule ^//(.*) https://review-dev.openstack.org/$1 [R,L] is the rule I have addedbut that doesn't seem to work22:50
mordredyah. those are corrupt on the filesyste22:50
zarobut i could be wrong in that i might have based it on another change or something. but pretty sure they were new indepenent changes.22:51
clarkbits after the rewrite on command and after the host redirect22:51
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: add meeting for service catalog tng effort  https://review.openstack.org/24574522:51
clarkb(note I went with prefix // because it actually seems to be the larger problem22:52
mordredso - the filesystem and database do not sync up between 236754 and 23675322:52
clarkbwhen we go to //#/query?status=open is when we break22:52
mordredhowever, I do not know that those are still not related to sync issues22:52
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: libvirt-python and pyudev do not work on OSX  https://review.openstack.org/24466922:53
anteayazaro: how long did it take you to start with a test gerrit use your db script get set up to add some changes prior to the rollback?22:53
*** mriedem has quit IRC22:53
anteayaI'm wondering if we should try again and see what results we get22:53
zaroa while22:53
anteayawe have about an hour left before we have to make a decision22:54
zaroreindex takes about 1 hr22:54
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: libvirt-python and pyudev do not work on OSX  https://review.openstack.org/24466922:54
*** MarkAtwood has quit IRC22:54
anteayaI'm on the fence22:54
anteayagiven current information I could go either way22:55
zaromordred: i'm wondering whether i missed a step in the testing?22:55
anteayaanyone currently present at no?22:55
*** EricGonczer_ has quit IRC22:55
zaromordred: maybe should have reindexed after pushing those new changes22:55
*** bdemers has quit IRC22:55
*** mwagner has quit IRC22:55
mordredzaro: possibly? I mean, I don't really know what's going on - 236754 is definitely the most recent change22:56
mordredbut it's not in sync with the filesystem22:56
mordredI do not know that that means there is a rollback problem22:56
jeblairzaro, mordred: were 236754 and 236753 pushed to the same projects as they actually are in git?22:56
pabelangerianw: I added pep8 and docs, since all (except ansible-role-nodepool) have them.22:56
mordredjeblair: lemme check22:56
pabelangerI have a patch up in ansible-role-nodepool to add upport22:56
zarojeblair: i believe both were to same projects.22:56
jeblairzaro: what project did you create 236753 in?22:56
zaropython-jenkins22:57
*** ccrouch has quit IRC22:57
mordredthat is not where it is on the filesystem22:57
jeblairmordred: did you check there?22:57
mordredyup22:57
*** ccrouch has joined #openstack-infra22:57
pabelangerianw: comment left22:57
mordredit's in project-team-guide22:57
jeblairmordred: we expect it to be in ptg because that's where it is in production22:57
zaroopenstack/python-jenkins?22:57
jeblairmordred: but i would _also_ expect it to be in python-jenkins22:57
mordrednope22:58
jeblairmordred: because that's where zaro's test put it22:58
mordredwell, on the filesystem it's only in project-test-guide22:58
mordredin the db it's listed as being in openstack/python-jenkins22:58
*** burgerk has quit IRC22:58
openstackgerritYuriy Taraday proposed openstack-infra/project-config: Allow core reviewers to push merge commits to fuel-octane  https://review.openstack.org/24664022:59
anteayaso we don't know if this mis-match occured during the upgrade or during the rollback, would that be accurate to say?22:59
jeblairthen i have little confidence that we know whether the rollback would work or not.  it might be that our test is invalidated by the sync issue, or there may be a serious problem, but we have no changes we rolled back that are unaffected by the sync issue.22:59
*** ccrouch has quit IRC22:59
*** ccrouch has joined #openstack-infra23:00
openstackgerritgreghaynes proposed openstack/diskimage-builder: Remove cloud-initramfs-growroot package  https://review.openstack.org/21543923:00
zarocan't be during upgrade because the change was accessible and working23:00
anteayazaro: okay23:00
*** dims has quit IRC23:00
anteayaso affected by the rollback23:00
jeblairanteaya: what?23:00
openstackgerritDan Moravec proposed openstack-infra/subunit2sql: Add dates to x-axis for subunit2sql graphs  https://review.openstack.org/24664123:00
anteayajeblair: zaro answered my question above23:01
*** dims has joined #openstack-infra23:01
anteayaso we don't know if this mis-match occured during the upgrade or during the rollback, would that be accurate to say?23:01
*** jhesketh has quit IRC23:01
jeblairthe _mis-match_ is because we are re-using a change id that exists in the filesystem but not the db.23:01
*** tsg has quit IRC23:02
anteayaoh, sorry so even the changes he created fresh are affected by the async23:02
jeblairyep23:02
mmedvedecan we please get a couple of reviewers added to puppet-ciwatch-core group? https://review.openstack.org/#/admin/groups/1138,members23:02
anteayaso how do we test without be affected by the async?23:03
bardiaasselin_: so I have posted a review to ci-sandbox and added my thirdparty ci as a reviewer but I don't see the noop build running in my local jenkins setup. Can you think of anywhere I might have made a mistake?23:03
jeblairso rollback testing against those chages is invalid23:03
mordredand we do not have a copy of the 2.11 install before the rollback, right?23:03
anteayajeblair: yes, I see now23:03
asselin__bardia, are you using 'master' node or a slave?23:03
*** Rockyg has quit IRC23:03
jeblairanteaya: we could keep adding new changes until we create one that does not overlap with the out-of-sync local git repos23:03
jeblairanteaya: which i think is what mordred is getting at with his question23:04
bardiaasselin_: i have a jenkins master and private devstack that runs the slaves23:04
anteayayes, but we need to start the environment over again23:04
zaromordred: no, unfortunately not atm23:04
anteayayeah which makes sense to me23:04
*** dims_ has joined #openstack-infra23:04
jeblairanteaya: or we start over with synced git repo and fs snapshots23:04
anteayazaro: well it appears that starting the testing over is the only way we will be able to tell if this works or not23:04
*** jhesketh has joined #openstack-infra23:04
anteayajeblair: oh can we do that?23:05
jeblairanteaya: expect 15 minutes of gerrit downtime to do so, but yes.  :)23:05
asselin__bardia, force the job to run on a slave. Seems working on master really is broken.23:05
anteayaI think we have to do it23:05
asselin__bardia, https://github.com/openstack-infra/project-config-example/blob/master/jenkins/jobs/projects.yaml#L4 change that tothe slave label23:05
*** apoorvad has joined #openstack-infra23:05
mordredyah. I'd say use the out of sync/git23:05
* anteaya votes to do the test23:05
mordredcreate changes until we're past the overlap23:06
anteayamordred: how big is the overlap?23:06
mordredthen verify that we get new changes that are consistent on the FS and the disk23:06
bardiaasselin_: thanks. Shouldn't forcing the noop on the slave post a comment on the gerrit review?23:07
*** dims has quit IRC23:07
asselin__bardia, it should. there seems be an issue with running jobs on master. i saw this before but never tracked it down.23:07
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500923:07
anteayazaro: have you eaten?23:08
openstackgerritMerged openstack/requirements: Cap requests at <2.8.0 since it packages urllib3 1.12  https://review.openstack.org/23225023:08
anteayazaro: I picture you stuck at the library, and if we are going to do this you need food23:08
zaropower bar23:08
anteayaokay as long as you are good23:08
anteayado you know if your power is back at home?23:09
zarono idea23:09
openstackgerritApoorva Deshpande proposed openstack-infra/ciwatch: Update contact us information for ciwatch  https://review.openstack.org/24660223:09
anteayazaro: how long until the library closes?23:09
clarkbseattle light may have an outage map23:09
clarkbPGE definitely does23:09
clarkbhttp://www.seattle.gov/light/sysstat/23:10
zaroin 5 hrs23:10
*** sergmelikyan has quit IRC23:10
anteayahttp://www.seattle.gov/light/sysstat/map.asp23:10
anteayazaro: oh good23:10
clarkbanteaya: do we still need to reenable that 11466 account?23:11
*** gokrokve has joined #openstack-infra23:11
* clarkb takes another break from apache because my brain is melting23:11
anteayaclarkb: yes please23:11
*** rlucio has joined #openstack-infra23:11
anteayaclarkb: I don't think anyone else has gotten to it23:11
zarobig cluster of red in shoreline i guess means still no power.  and my house is right in the middle23:11
clarkbdone23:11
anteayaclarkb: thanks23:12
*** sergmelikyan has joined #openstack-infra23:12
anteayafeel like adding sc68cal to https://review.openstack.org/#/admin/groups/1184,members while you are at it?23:12
clarkbsure23:12
anteayahe authored the creation patch, I can dig it up if you like23:12
anteayazaro: okay23:12
clarkbsc68cal isn't a valid gerrit username23:13
clarkbsc68cal: ^ any idea what your gerrit username/email/name is?23:13
* clarkb imagines there is a middle initial or something tripping me up23:13
mgagnehmm, is there a way within JJB itself to define "global" variables somewhere so they can be reused in job definitions? I wish to have a common set of jobs I can easily rsync and a place where I can put env specific variables in.23:13
zaroi feel lik we've decided to postpone gerrit upgrade for more testing23:13
*** tonytan4ever has quit IRC23:14
anteayaclarkb: Sean Collins23:14
zaroshould we decide today on a new time/date or leave it as postponed for 'another time' TBD23:14
zaro?23:14
clarkbzaro: yes plan was to decide at 000UTC23:14
clarkb~45 minutes23:14
*** dingyichen has quit IRC23:14
anteayaclarkb: M. https://review.openstack.org/#/q/owner:sean%2540coreitpro.com+status:open,n,z23:14
*** thinrichs has quit IRC23:15
*** gokrokve has quit IRC23:15
clarkbanteaya: that user is added23:15
zarowell, that testing isn't gonna happen in 45 mins.  so we can probably decide now.23:15
jeblairclarkb, zaro: i think for rescheduling we should punt to the next infra team meeting to do the usual scheduling dance23:15
anteayaclarkb: thank you, sorry about that23:15
*** dingyichen has joined #openstack-infra23:15
clarkbanteaya: np23:15
zarosounds good.  is nibalizer still gonna send out the announcement?23:16
anteayazaro: do you feel up to starting a new test environment now?23:16
zaroanteaya: no23:16
anteayaokay thanks23:16
clarkbzaro: gotcha23:16
jeblairi think nibalizer should send an announcement that says "gerrit upgrade postponed, new scheduled date to be announced"23:17
anteayazaro: let us know when you do so we can have someone watch the db so we can ensure we are passed the async numbers23:17
anteayajeblair: agreed23:17
anteayaclarkb: that can move up logstash things if you like23:17
anteayafor me anyway23:18
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements  https://review.openstack.org/24611423:18
zaromordred, jeblair : is there a way to figure when the numbers are beyond in correct range?23:18
*** dramalho has joined #openstack-infra23:18
clarkboh right we could do it tomorrow23:18
zaro*figure/figure out23:18
clarkbmmedvede: ruagair would tomorrow at 1900UTC work?23:18
*** gokrokve has joined #openstack-infra23:19
mmedvedeclarkb: wfm23:19
*** sigmavirus24 is now known as sigmavirus24_awa23:20
clarkbzaro: jeblair mordred I am not sure who has a valid gerrit CLA anymore but I am pretty sure I dont23:22
clarkbotherwise I would work on patching the openid thing23:22
*** dramalho has quit IRC23:22
mordredzaro: root@xbigmysql:/mnt/gerrit/gerrit_testsite-28_clean/git# find . | grep 23679423:22
mordredzaro: returns a hit23:22
mordredzaro: as does 23689423:23
mordredzaro: 237894 doesn't have anything23:23
*** hichihara has joined #openstack-infra23:23
jeblairclarkb: i have started work on that but i don't know the current status; at any rate, i don't believe i do.23:23
*** cloudtrainme has quit IRC23:24
mordredzaro: so I'd get your first environment set up23:24
mordredzaro: then do "alter table change_id auto_increment=237894;"23:25
mordredzaro: that will set the auto-increment value on the change_id past where you've got overlap23:25
*** aeng has joined #openstack-infra23:25
mordredso changes aft erthat should be large enough numbers to be safe23:25
zaroahh cool. that makes it much easier and more efficient. thanks23:26
mordredafter you make a change, then you can select * from patch_set where change_id = "id-of-change-you-uploaded"23:26
*** wuhg has joined #openstack-infra23:26
mordredthen git log in the git dir of the project you pushed to of the git ref to make sure it's there23:26
mordredthen do a find in the git dir like above to find the ref in refs of that project23:27
mordredand cat that file to make sure it has the ref you expect23:27
*** ddieterly has quit IRC23:27
mordredif you're happy with all of that, then we can do the downgrade and make sure that the downgrade works with that change23:27
*** bhunter71 has quit IRC23:28
*** salv-orl_ has joined #openstack-infra23:28
zarook.  will add these steps to the testing.23:28
*** tdurakov has quit IRC23:28
clarkbI am going to work on logging the mod rewrite rules to try and understand why my redirect isn't working23:28
jeblairjhesketh, mordred, clarkb: so i'm really torn on https://review.openstack.org/209906  -- the change looks fine, but i don't want zuul to use mock.23:28
openstackgerritfumihiko kakuma proposed openstack-infra/project-config: Add job for networking-ofagent  https://review.openstack.org/24498623:29
anteayamordred: zaro do you think it is worth taking a copy of the upgrade before the rollback next time?23:29
jheskethjeblair: why's that?23:29
jhesketh(excuse my ignorance)23:30
openstackgerritMerged openstack-infra/project-config: Allow core reviewers to push merge commits to fuel-octane  https://review.openstack.org/24664023:30
zaroanteaya: yeah, probably a good idea. was just avoiding it because it takes a lot of time.23:30
*** doug-fish has quit IRC23:30
jeblairjhesketh: it generally leads to "assert true" for tests23:30
*** salv-orlando has quit IRC23:30
*** sergmelikyan has quit IRC23:30
*** mwagner has joined #openstack-infra23:31
anteayazaro: understood23:31
jeblairjhesketh: there are some things that it is good for that are really hard to do otherwise23:31
jeblairjhesketh: which is why we added it to shade23:31
jeblairjhesketh: and then it was used everywhere23:32
jeblairit gets out of hand fast23:32
openstackgerritApoorva Deshpande proposed openstack-infra/ciwatch: Update contact us information for ciwatch  https://review.openstack.org/24660223:33
crinklegreghaynes: it looks like openstack_project::slave declares openstack_project::server which conflicts with your declaration in site.pp23:34
crinklegreghaynes: would be better to have someone with more background suggest best practice here23:34
greghaynes:(23:34
greghaynesI was trying to cargo release_slave23:34
clarkboh we likely didn't move it because of how image build swork23:36
jheskethjeblair: I'm not really sure I see it as a problem, but I'm also not very familiar with the alternatives or intricacies etc23:36
*** sabeen1 has quit IRC23:36
clarkbI think you can rely on the ::server in ::slave23:36
jeblairjhesketh: the way i would like to solve this problem is get rid of zuul.lib.gerrit and rely on gerritlib for this (that was the intent, that's why it's called zuul.lib.gerrit)23:36
crinkleif we cargo release_slave we need to pass through $sysadmins into openstack_project::wheel_mirror_slave23:36
crinklei think23:36
crinklealso openstack_project::slave doesn't set any iptables rules, is that a concern?23:37
mgagneI think I found an answer to my question regarding "variables" within JJB: So far, I only need it for gerrit-git-prep macro which will run on nodepool nodes. I added a script to nodepool-base element used by Nodepool which will create a file with site specific vars in it.23:37
mgagne I then source that file from within the JJB macro and use it with gerrit-git-prep.23:37
clarkbcrinkle: iptables is default locked down, only ssh allowed so should be fine23:37
crinkleclarkb: okay23:37
jeblairjhesketh: so it's frustrating to see a lot of work going into dead-end code23:37
crinkleclarkb: but [] being the list of sysadmins is not okay, right?23:37
clarkbcrinkle: ya we should have a sysadmins list23:38
jheskethjeblair: ah, I didn't even know that was the plan23:38
bardiaasselin_: general question: Can I submit my cinder driver for review while i'm still figuring out the connection issue to my third party CI from gerrit?23:39
jeblairjhesketh: but even so, about the only place i can justify the use of mock at the lowest levels of interaction with another system.  in this case, we're actually just wanting to test some json parsing.  there should be no need to mock anything for that.23:39
mgagnebardia: IMO, better ask #openstack-cinder since they are the ones requiring 3rd party CI23:40
asselin__bardia, that's a cinder channel question #openstack-cinder, and yes23:40
bardiathanks will do that23:40
*** smarcet has quit IRC23:40
*** signed8__ has quit IRC23:42
*** dimtruck is now known as zz_dimtruck23:43
jeblairclarkb, mordred: what's the haproxy centos6 status?23:44
clarkbwe need to install fix via sha123:45
clarkbnot sure if that change has been pushed yet23:45
mordredclarkb: https://review.openstack.org/#/c/246540/23:47
openstackgerritMerged openstack-infra/zuul: Support pagination in simplequery for Gerrit >=2.9  https://review.openstack.org/20990623:47
mordredwoot. my "wayward children" search in gertty is only one page23:48
mordred(that's changes that have one +2, no -1s and have not been touched in over a week)23:48
jeblairmordred, clarkb: possibly silly q, but why are we rolling forward instead of backward on that?23:48
openstackgerritMerged openstack-infra/ciwatch: Update contact us information for ciwatch  https://review.openstack.org/24660223:48
clarkbjeblair: I don't know, I havne't been involved in the debugging, just remember what mordred and Hunner said this morning23:49
jeblairmordred: how tall is your terminal?  :)23:49
mordredjeblair: we could do that as well - we'd lke to be on the 1.3 series though, so this would minimize the delta next time we sync with that series23:49
mordredjeblair: :)23:49
nibalizerjeblair: we did roll back the haproxy bump...23:49
*** salv-orl_ has quit IRC23:49
clarkbbased on rewrite rules it looks like apache is treating // as /23:50
mordrednibalizer: do we didn't23:50
clarkband even chromium debugger says /23:50
mordrednibalizer: no patches have been landed to solve this23:50
nibalizerwhat? but we made that revert patch23:50
nibalizeroh... we just didnt land it23:50
jeblairnibalizer: i had a patch just hit it.23:50
nibalizerwell it has my +2 so any core can land it23:50
*** zer0c00l has joined #openstack-infra23:50
*** salv-orlando has joined #openstack-infra23:50
jeblairah that's this one https://review.openstack.org/24583623:50
mordrednibalizer: https://review.openstack.org/#/c/246619/ is there and https://review.openstack.org/#/c/245836/ is too23:50
*** gokrokve has quit IRC23:51
nibalizerwhere did we get to on go/no-go for gerrit?23:51
mordrednibalizer: still working on it23:51
jeblairmordred, nibalizer: er, i think we got to "no-go"23:52
mordrednibalizer: zaro is re-running tests now that we've characterized a flaw in the test setup23:52
mordredjeblair: oh we did?23:52
mordredk23:52
clarkbI think zaro said he wouldn't be able to retest today23:52
clarkbbecause ENOPOWER23:52
mordredah. ok23:52
zer0c00lI am running linux kernel 4.1.x on as a VM in this gate, There is nothing on the console other than the TFTP loading deploy_kernel23:52
mordredI missed that23:52
*** smarcet has joined #openstack-infra23:52
zer0c00lhttp://logs.openstack.org/05/191505/9/check/gate-tempest-dsvm-ironic-pxe_ipa-src/2bc210a/logs/ironic-bm-logs/23:52
zer0c00l"curl http://logs.openstack.org/05/191505/9/check/gate-tempest-dsvm-ironic-pxe_ipa-src/2bc210a/logs/ironic-bm-logs/baremetalbrbm_0_console.txt.gz"23:52
zer0c00lI am able to locally build the same image and test it fine23:53
nibalizerok. thanks23:53
zer0c00lIs there someone who can look at these servers and see the status of these vms?23:53
jeblairnibalizer: rescheduled date tbd23:53
clarkbzer0c00l: I would talk to ironic devs23:53
*** smarcet has quit IRC23:54
clarkbthere is quite a bit of cray cray going on to make fake baremetal nodes and I doubt anyone here understands it23:54
*** dangers is now known as dangers_away23:54
mordredzer0c00l: there are no persistent servers to look at from our side23:54
openstackgerritColleen Murphy proposed openstack-infra/system-config: Add wheel_mirror_slaves that use pypi-mirror  https://review.openstack.org/16524023:54
anteayaclarkb: yay on /23:54
zer0c00li see23:54
zer0c00lmordred: what is the OS running on them?23:55
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Change uuid columns to bigint  https://review.openstack.org/23500923:55
mordredzer0c00l: for that job, the vm running the test is running trusty23:55
clarkbzer0c00l: its an ubuntu trusty host with package list at http://logs.openstack.org/05/191505/9/check/gate-tempest-dsvm-ironic-pxe_ipa-src/2bc210a/logs/dpkg-l.txt.gz23:55
mordredzer0c00l: clarkb's answer is better than mine :)23:55
zer0c00lmordred, clarkb thanks23:56
pleia2nibalizer: going to send out the no-go email?23:56
anteayamordred: yeah zaro was at the library due to a power outage at home and had been running on a power bar as food23:57
*** Sukhdev has joined #openstack-infra23:58
anteayamordred: when asked if he felt like working on setting up a new test env now he said no23:58
pleia2anteaya: oh, the things we do :)23:58
anteayapleia2: I know it23:58
*** ZZelle_ has quit IRC23:58
anteayafor my my main priority for tomorrow has changed to logstash things a new fridge23:59
pleia2haha23:59
anteayawhich is a better combination than gerrit upgrade and new fridge23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!