Saturday, 2014-06-28

*** msabramo has quit IRC00:01
*** nati_ueno has quit IRC00:02
*** dangers is now known as dangers_away00:04
*** nati_ueno has joined #openstack-infra00:06
*** nati_ueno has quit IRC00:07
*** zehicle_at_dell has quit IRC00:08
*** jergerber has quit IRC00:13
*** msabramo has joined #openstack-infra00:13
jeblairfungi: i added https://review.openstack.org/#/c/102033/ to the list of changes to merge -- update zuul pipelines to new syntax00:14
anteayajeblair: I have a question on https://review.openstack.org/#/c/103273/00:15
jeblair(since we'll be restarting zuul anyway, we may as well)00:15
anteayajenkins is unhappy still with 10203300:16
jeblairanteaya: the only reason to list a job in that section is to set some non-standard configuration option for the job00:16
jeblairanteaya: since there wouldn't be anything left, it should be removed00:16
*** markmcclain has joined #openstack-infra00:16
anteayaoh okay00:16
*** CaptTofu_ has quit IRC00:17
*** CaptTofu_ has joined #openstack-infra00:18
*** markmcclain1 has joined #openstack-infra00:20
*** markmcclain has quit IRC00:21
*** CaptTofu_ has quit IRC00:23
*** gangil has quit IRC00:25
*** timrc is now known as timrc-afk00:27
*** ArxCruz has quit IRC00:31
*** michchap has joined #openstack-infra00:35
*** sweston_ has quit IRC00:37
*** dkehn_ is now known as dkehnx00:38
*** jogo is now known as jogo_away00:40
*** pballand has quit IRC00:45
lifelessare specs published anywhere? e.g. as sphinx?00:49
jeblairlifeless: not yet; eventually to specs.o.o, but no one is driving that atm00:50
*** sarob has joined #openstack-infra00:52
*** stevebaker has joined #openstack-infra00:53
*** wendar has joined #openstack-infra00:53
*** jbryce has joined #openstack-infra00:53
*** russellb has joined #openstack-infra00:53
*** comstud has joined #openstack-infra00:53
*** Adri2000 has joined #openstack-infra00:53
*** marcoemorais has joined #openstack-infra00:53
*** sweston has joined #openstack-infra00:53
*** alaski has joined #openstack-infra00:53
*** vishy has joined #openstack-infra00:53
*** mrda-weekend has joined #openstack-infra00:53
*** zz_gondoi has joined #openstack-infra00:53
*** mgagne has joined #openstack-infra00:53
*** antonym has joined #openstack-infra00:53
*** zz_gondoi is now known as gondoi00:53
*** Adri2000 is now known as Guest4982400:53
lifelessjeblair: thanks00:53
*** roaet_ has joined #openstack-infra00:54
*** jraim_ has joined #openstack-infra00:54
lifelessjeblair: could it go on docs.o.o/developer perhaps, where we have lots of projects already publishing ?00:54
*** simonmcc has joined #openstack-infra00:54
*** dolphm has joined #openstack-infra00:54
*** kgriffs|afk has joined #openstack-infra00:54
*** kgriffs|afk is now known as kgriffs00:54
*** morgabra has joined #openstack-infra00:55
*** sarob has quit IRC00:57
*** HACKING-TWITTER has joined #openstack-infra00:58
markmcclain1anyone around to talk about reqs update failure?01:00
markmcclain1(trying to figure out why the job is failing for a lib we published to pypi)01:01
clarkblink?01:01
bknudsonclarkb: https://review.openstack.org/#/c/103256/01:01
bknudsonclarkb: or did you mean the package ? https://pypi.python.org/pypi/oslo.config/1.4.0.0a101:02
bknudsonthis one's different than the other oslo.configs, oslo.config-1.4.0.0a1-py2.py3-none-any.whl01:03
bknudsonwhereas the others are oslo.config-1.3.0.tar.gz01:03
*** sweston_mobile has joined #openstack-infra01:04
bknudsonalthough it installs fine for me with pip01:04
markmcclain1bknudson: we've started publishing wheels01:04
clarkbI think because pip wont install alphas by default01:04
clarkbmordred ^01:05
clarkboh and there is only a wheel01:05
clarkband that test may check that not wheels work01:05
clarkbmordred ^ this might be another kink in the wheels for alphas plan01:06
*** arnaud has joined #openstack-infra01:06
*** wenlock_ has joined #openstack-infra01:07
*** dstanek is now known as dstanek_zzz01:07
bknudson./pip install --no-use-wheel "oslo.config>=1.4.0.0.a1" ?01:07
*** arnaud has quit IRC01:07
clarkbsomething like that but am on phone so hard to read logs01:08
*** uvirtbot has joined #openstack-infra01:08
bknudsonhttp://logs.openstack.org/56/103256/1/check/check-requirements-integration-dsvm/99ab032/console.html#_2014-06-27_22_59_26_34301:08
bknudson/tmp/tmpp7azgM/venv/bin/pip install -U  ... --no-use-wheel -r /tmp/tmpeArHVW01:09
*** arnaud__ has quit IRC01:10
clarkbyup no use wheel01:10
mattoliverauclarkb pfft, it is with that attitude :p (says Matt out eating breakfast and mocking on his phone) :p01:10
clarkb:P01:10
jeblairlifeless: nope, annegentle wants to keep future-docs away from current-docs01:11
*** wenlock has quit IRC01:11
*** marcoemorais has quit IRC01:11
lifelessjeblair: hmm, interesting. To me they are current-docs. Ah well.01:13
*** markmcclain1 has quit IRC01:15
*** sweston_mobile has quit IRC01:16
*** dimtruck is now known as zz_dimtruck01:18
mordredclarkb: you have to reference an alpha version for pip to install it01:24
mordredclarkb: wait - what's the problem?01:24
* mordred looks ...01:25
mordredAH01:25
mordredI understand01:25
*** CaptTofu_ has joined #openstack-infra01:25
mordredI think that may be a holdout from a thing we don't need to check01:26
mordredclarkb: it's a mirror issue in pypi-mirror01:30
mordredbknudson: it'll take me a little while to figure out a remediation. sorry01:30
bknudsonmordred: no problem01:30
*** dstanek_zzz is now known as dstanek01:30
*** wenlock_ has quit IRC01:37
*** sweston_mobile has joined #openstack-infra01:39
*** markwash has quit IRC01:42
*** sarob has joined #openstack-infra01:52
*** sarob has quit IRC01:57
*** sweston_mobile has quit IRC01:58
*** sweston_mobile has joined #openstack-infra02:03
*** sweston_mobile has quit IRC02:06
*** sarob has joined #openstack-infra02:20
*** sabeen has quit IRC02:22
*** sweston_mobile has joined #openstack-infra02:23
*** sarob has quit IRC02:25
*** kgriffs is now known as kgriffs|afk02:28
*** yamahata has joined #openstack-infra02:29
*** sweston_mobile has quit IRC02:30
*** msabramo has quit IRC02:33
*** devkulkarni has joined #openstack-infra02:38
*** arnaud has joined #openstack-infra02:39
*** arnaud__ has joined #openstack-infra02:40
*** HACKING-TWITTER has quit IRC02:41
*** penguinRaider has joined #openstack-infra02:43
*** devkulkarni has quit IRC02:45
*** HACKING-TWITTER has joined #openstack-infra02:46
*** HACKING-TWITTER has joined #openstack-infra02:49
*** HACKING-TWITTER has joined #openstack-infra02:52
*** HACKING-TWITTER has quit IRC02:52
*** sweston_mobile has joined #openstack-infra02:53
*** HACKING-TWITTER has joined #openstack-infra02:56
*** HACKING-TWITTER has quit IRC02:56
*** HACKING-TWITTER has joined #openstack-infra02:59
*** HACKING-TWITTER has quit IRC02:59
*** sweston_mobile has quit IRC03:00
*** CaptTofu_ has quit IRC03:11
*** CaptTofu_ has joined #openstack-infra03:11
*** HACKING-TWITTER has joined #openstack-infra03:14
*** CaptTofu_ has quit IRC03:16
*** liusheng has joined #openstack-infra03:17
liushengHi folks, we have met this bug again when updating contacts :https://bugs.launchpad.net/openstack-org/+bug/1317957 can anyone please help me?03:21
uvirtbotLaunchpad bug 1317957 in openstack-org "Server error when updating contacts" [Critical,Fix released]03:21
reedliusheng: unlikely it's a bug. Read the comments to the bug and try the solutions there first03:28
liushengreed: thanks a lot, I am reading the comments and will try :)03:29
*** HACKING-TWITTER has quit IRC03:33
*** HACKING-TWITTER has joined #openstack-infra03:36
*** HACKING-TWITTER has quit IRC03:36
*** HACKING-TWITTER has joined #openstack-infra03:38
*** zhiyan_ has quit IRC03:41
*** HACKING-TWITTER has quit IRC03:46
*** mestery has quit IRC03:46
*** zz_dimtruck is now known as dimtruck03:49
*** atiwari has quit IRC03:50
*** harlowja_at_home has joined #openstack-infra03:53
*** lttrl has quit IRC03:58
*** liusheng has left #openstack-infra04:00
*** liusheng has joined #openstack-infra04:00
*** zhiyan_ has joined #openstack-infra04:08
*** adrian_otto has joined #openstack-infra04:09
mordreddstufft: does pip 1.5 grok wheels by default?04:09
dstufftyes04:09
mordredawesome04:10
mordredclarkb, bknudson: https://review.openstack.org/10328904:12
*** CaptTofu_ has joined #openstack-infra04:18
*** sarob has joined #openstack-infra04:18
*** harlowja_at_home has quit IRC04:19
*** CaptTofu_ has quit IRC04:22
*** sarob has quit IRC04:23
*** harlowja is now known as harlowja_away04:26
*** dimtruck is now known as zz_dimtruck04:28
*** sarob has joined #openstack-infra04:28
*** ominakov has quit IRC04:34
*** praneshp has joined #openstack-infra04:37
*** praneshp_ has joined #openstack-infra04:40
*** praneshp has quit IRC04:43
*** adrian_otto has quit IRC04:43
*** praneshp_ is now known as praneshp04:43
*** arnaud__ has quit IRC04:44
*** arnaud has quit IRC04:44
*** msabramo has joined #openstack-infra04:46
*** sarob has quit IRC04:48
*** sarob has joined #openstack-infra04:48
*** sarob has quit IRC04:52
*** zz_dimtruck is now known as dimtruck04:59
*** craigbr has quit IRC05:01
*** changbl has joined #openstack-infra05:03
*** SumitNaiksatam has quit IRC05:04
*** pcrews has quit IRC05:05
*** dimtruck is now known as zz_dimtruck05:05
*** jdahlin has quit IRC05:07
*** rcarrill` has quit IRC05:20
*** arnaud has joined #openstack-infra05:20
*** rcarrillocruz has joined #openstack-infra05:25
*** sweston_ has joined #openstack-infra05:25
*** arnaud__ has joined #openstack-infra05:34
*** sweston_ has quit IRC05:36
*** sweston_ has joined #openstack-infra05:37
*** _nadya_ has joined #openstack-infra05:37
*** _nadya_ has quit IRC05:42
*** praneshp has quit IRC05:43
*** praneshp has joined #openstack-infra05:44
mordredclarkb, bknudson: ok. that's not going to work05:47
mordredbecause, it turns out, we need both things for things that have both things05:47
mordredand for things that only have wheels, we need that05:48
*** arnaud__ has quit IRC05:48
*** arnaud has quit IRC05:48
*** dstanek is now known as dstanek_zzz05:49
*** arnaud has joined #openstack-infra05:49
*** arnaud__ has joined #openstack-infra05:49
*** otherwiseguy has joined #openstack-infra05:52
*** _nadya_ has joined #openstack-infra05:56
*** _nadya_ has quit IRC06:01
*** CaptTofu_ has joined #openstack-infra06:06
*** CaptTofu_ has quit IRC06:11
*** sweston_ has quit IRC06:15
*** dstanek_zzz is now known as dstanek06:15
*** sweston_ has joined #openstack-infra06:16
*** enikanorov has quit IRC06:18
*** _nadya_ has joined #openstack-infra06:25
*** dstanek is now known as dstanek_zzz06:25
*** rwsu has quit IRC06:25
*** sweston_ has quit IRC06:29
*** sweston_ has joined #openstack-infra06:29
*** _nadya_ has quit IRC06:33
*** e0ne has joined #openstack-infra06:33
*** praneshp has quit IRC06:37
*** e0ne has quit IRC06:43
*** msabramo has quit IRC06:45
*** sarob has joined #openstack-infra06:49
*** sarob has quit IRC06:53
mordredOK. I dug in to this on the plane, and I think it's actually easier to just migrate to bandersnatch. seriously.  I've got a set of patches incoming as soon as I'm back on wifi06:59
*** sweston_ has quit IRC07:00
*** sweston_ has joined #openstack-infra07:01
*** e0ne has joined #openstack-infra07:01
*** pcrews has joined #openstack-infra07:01
*** e0ne has quit IRC07:15
*** sandywalsh_ has quit IRC07:20
*** sandywalsh has joined #openstack-infra07:22
*** dstanek_zzz is now known as dstanek07:26
dstufftmordred: turns out pip wasn't made to mirror things ;)07:26
mordreddstufft: well, that :)07:29
mordreddstufft: also, external links are dead07:29
mordredwoot07:30
dstufft:D07:34
*** chandan_kumar has joined #openstack-infra07:35
*** dstanek is now known as dstanek_zzz07:36
*** e0ne has joined #openstack-infra07:37
*** praneshp has joined #openstack-infra07:42
*** yolanda has quit IRC07:44
*** yolanda has joined #openstack-infra07:45
*** arnaud has quit IRC07:47
*** arnaud__ has quit IRC07:47
*** sweston_ has quit IRC07:49
*** pcrews has quit IRC07:52
*** yolanda has quit IRC07:52
*** otherwiseguy has quit IRC07:54
*** CaptTofu_ has joined #openstack-infra07:54
*** CaptTofu_ has quit IRC07:59
*** yolanda has joined #openstack-infra08:06
*** andreykurilin has joined #openstack-infra08:19
*** gema has quit IRC08:23
*** gema has joined #openstack-infra08:25
*** rcarrill` has joined #openstack-infra08:31
*** rcarrillocruz has quit IRC08:32
*** ildikov has quit IRC08:38
*** andreykurilin has quit IRC08:39
*** andreykurilin has joined #openstack-infra08:52
*** praneshp has quit IRC09:01
*** rcarrillocruz has joined #openstack-infra09:04
*** rcarrill` has quit IRC09:06
*** crc32 has quit IRC09:31
*** _nadya_ has joined #openstack-infra09:35
*** _nadya_ has quit IRC09:40
*** CaptTofu_ has joined #openstack-infra09:43
*** CaptTofu_ has quit IRC09:48
*** e0ne has quit IRC09:48
*** e0ne has joined #openstack-infra10:16
*** _ruhe_ has joined #openstack-infra10:37
*** e0ne has quit IRC10:44
*** sandywalsh_ has joined #openstack-infra10:56
*** sandywalsh has quit IRC10:58
*** CaptTofu_ has joined #openstack-infra11:01
*** chandan_kumar has quit IRC11:04
*** Longgeek has joined #openstack-infra11:06
*** rcarrillocruz has quit IRC11:07
*** andreykurilin has quit IRC11:10
*** rcarrillocruz has joined #openstack-infra11:12
*** jcoufal has joined #openstack-infra11:28
*** rcarrill` has joined #openstack-infra11:44
*** rcarrillocruz has quit IRC11:45
*** xianghuihui has joined #openstack-infra11:49
*** jcoufal has quit IRC11:54
*** sandywalsh_ has quit IRC11:56
*** sandywalsh has joined #openstack-infra11:58
fungijeblair: heads up (once you're awake) i rebased https://review.openstack.org/102033 because it was merge conflicting against your https://review.openstack.org/102618 change from a couple days ago. the inter-patch diff from the rebase looks sane though, so +2 from me11:59
fungialso, openstackgerrit seems to have abandoned us again. restarting12:00
*** openstackgerrit has joined #openstack-infra12:02
*** rcarrillocruz has joined #openstack-infra12:06
*** rcarrill` has quit IRC12:08
sdaguefungi: any chance you want to send this back through - https://review.openstack.org/#/c/100728/ it was +A, but hit another rebase issue12:25
sdagueand it's tough to keep that rebase clean12:25
*** andreykurilin has joined #openstack-infra12:27
sdaguethanks12:29
*** dstanek_zzz is now known as dstanek12:37
*** devkulkarni has joined #openstack-infra12:44
*** dstanek is now known as dstanek_zzz12:46
*** mriedem has joined #openstack-infra12:48
*** _ruhe_ has quit IRC12:55
*** timrc-afk is now known as timrc12:59
*** dstanek_zzz is now known as dstanek13:07
openstackgerritA change was merged to openstack/requirements: Move pep8 to just 1.5.7  https://review.openstack.org/10300413:08
openstackgerritOpenStack Proposal Bot proposed a change to openstack-dev/hacking: Updated from global requirements  https://review.openstack.org/10331513:09
*** rcarrill` has joined #openstack-infra13:15
*** dstanek is now known as dstanek_zzz13:17
*** rcarrillocruz has quit IRC13:17
openstackgerritKiall Mac Innes proposed a change to openstack/requirements: Add Designate to projects.txt  https://review.openstack.org/10331613:18
openstackgerritKiall Mac Innes proposed a change to openstack/requirements: Add Designate to projects.txt  https://review.openstack.org/10331613:19
*** rcarrill` has quit IRC13:21
*** _ruhe_ has joined #openstack-infra13:24
*** rcarrillocruz has joined #openstack-infra13:26
*** CaptTofu_ has quit IRC13:28
*** CaptTofu_ has joined #openstack-infra13:28
*** e0ne has joined #openstack-infra13:30
*** andreykurilin has quit IRC13:30
openstackgerritA change was merged to openstack-infra/devstack-gate: double up [ for safety  https://review.openstack.org/10072813:32
*** CaptTofu_ has quit IRC13:33
*** julim has quit IRC13:35
*** pcrews has joined #openstack-infra13:40
*** sandywalsh has quit IRC13:40
*** e0ne has quit IRC13:40
*** sandywalsh has joined #openstack-infra13:42
*** chandan_kumar has joined #openstack-infra13:43
*** e0ne has joined #openstack-infra13:49
*** e0ne has quit IRC13:51
*** e0ne has joined #openstack-infra13:52
*** otherwiseguy has joined #openstack-infra13:54
_ruhe_jeblair: fungi: i apologize for not creating patches to move some of murano projects to stackforge-attic. i intended to do so, but got carried away by a nasty pep8 problem we've got in master13:55
*** CaptTofu_ has joined #openstack-infra13:56
*** _ruhe_ has quit IRC14:01
*** mriedem has quit IRC14:04
openstackgerritfrazy proposed a change to openstack-infra/gerritbot: Update pbr version for requirements  https://review.openstack.org/10331814:05
*** xianghuihui has quit IRC14:06
*** xianghuihui has joined #openstack-infra14:07
*** devkulkarni has quit IRC14:07
*** dstanek_zzz is now known as dstanek14:08
openstackgerritfrazy proposed a change to openstack-infra/gerritbot: Update pbr version for requirements  https://review.openstack.org/10331814:08
*** xianghuihui has quit IRC14:12
*** xianghuihui has joined #openstack-infra14:12
Kialljeblair: BTW - While you're logged into GitHub for the project moves.. Can we fix the description on the Designate repos? s/Moniker/Designate/14:12
fungiKiall: manage-projects is supposed to set that based on the description field in the review.projects.yaml file14:15
KiallOh.. maybe we don't have a description field in there.. It used to be by hand14:15
KiallYep .. No description.14:15
KiallI'll submit a review after the move - avoid conflicts etc :)14:15
fungiKiall: good plan14:16
*** dstanek is now known as dstanek_zzz14:19
* Kiall really needs to stop trying to generate JSON with Bash -_-14:20
*** chandan_kumar has quit IRC14:23
fungisrsly. three or four lines of python and you have a json filter you can call from bash14:23
jeblairfungi: morning14:26
jeblairfungi: i'm going to put zuul in graceful shutdown14:26
fungijeblair: great!14:27
*** penguinRaider has quit IRC14:27
openstackgerritstephen proposed a change to openstack-infra/gerritlib: Update pbr version  https://review.openstack.org/10332014:28
*** devkulkarni has joined #openstack-infra14:30
*** chandan_kumar has joined #openstack-infra14:35
*** timrc is now known as timrc-afk14:36
jeblair#status alert Gerrit will be offline from 1500-1515 UTC for project renames14:36
openstackstatusjeblair: sending alert14:36
-openstackstatus- NOTICE: Gerrit will be offline from 1500-1515 UTC for project renames14:38
*** ChanServ changes topic to "Gerrit will be offline from 1500-1515 UTC for project renames"14:38
*** adrian_otto has joined #openstack-infra14:40
openstackstatusjeblair: finished sending alert14:40
openstackgerritstephen proposed a change to openstack-infra/zuul: Update requirements modules version  https://review.openstack.org/10332114:40
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Update gerrit project rename instructions  https://review.openstack.org/10332214:41
jeblairfungi: ^ i'm working on disabling the puppet run crontab on puppetmaster14:42
openstackgerritEoghan Glynn proposed a change to openstack/requirements: Adding influxdb to the global requirements.  https://review.openstack.org/10332314:42
jeblairfungi: (we really need a flag file for that or something)14:42
jeblairfungi: okay, that's done, so we're complete through step 314:42
fungijeblair: agreed, would be a lot simpler14:42
*** jamespage_ has joined #openstack-infra14:43
Longgeekfungi: The two patch did not trigger jenkins. look https://review.openstack.org/#/c/103320/  https://review.openstack.org/#/c/103321/14:45
*** CaptTofu_ has quit IRC14:45
*** CaptTofu_ has joined #openstack-infra14:45
fungiLonggeek: zuul is in a graceful shutdown in preparation for some maintenance we're doing in 15 minutes14:45
fungiLonggeek: see http://status.openstack.org/zuul/ (and the channel topic)14:46
Longgeekfungi:so,gerritlib project ?14:47
fungiLonggeek: what?14:48
Longgeekfungi: ok, I understand14:48
*** zz_dimtruck is now known as dimtruck14:48
fungiLonggeek: zuul won't start any new jobs until after we're done with our maintenance work and start it back up14:48
Longgeekfungi: ok14:49
*** ildikov has joined #openstack-infra14:49
fungiright now it has 25 events queued, which probably includes your change uploads and subsequent comments14:49
*** jamespage_ has quit IRC14:49
*** jamespage__ has joined #openstack-infra14:49
*** CaptTofu_ has quit IRC14:50
*** msabramo has joined #openstack-infra14:51
Longgeekyes.14:52
fungias soon as https://jenkins04.openstack.org/job/gate-tempest-dsvm-neutron/10077/console finishes we should be ready to move forward with the maintenance (eta 10 minutes)14:53
*** superdan is now known as dansmith14:57
fungilooks like it finished early14:57
jeblairneat14:58
fungii'm ready to proceed with step #4 from http://ci.openstack.org/gerrit.html#renaming-a-project in one minute14:58
fungiand then i can do the db and fs updates on review.o.o14:59
jeblairfungi: okay, you want to take review.o.o tasks, and i'll take gitfarm tasks?14:59
fungijeblair: sounds perfect15:00
fungistarting now15:00
fungigerrit is stopped. proceeding with steps 5 and 615:00
jeblairgitfarm (step8) done; i'll do some github stuff now15:03
fungiokay, gerrit db and fs changes done15:06
fungii guess we're safe to start gerrit again?15:06
jeblairfungi: i think so15:06
fungistarting now15:07
fungiit's up15:07
*** amitpp has joined #openstack-infra15:07
fungitime to start zuul too?15:07
*** eglynn has joined #openstack-infra15:07
jeblairfungi: yup, will do15:07
fungiand does 102033 need to be manually applied?15:08
fungiotherwise i assume we're not going to be able to gate in the project changes15:08
jeblairfungi: no, zuul is backwards compat15:08
fungioh! right-o15:08
jeblairfungi: we don't actually even have to merge that today if we don't feel like it :)15:08
funginoted15:09
fungilooks like zuul's up and adding changes now15:09
jeblairyup15:09
fungiready for me to start approving changes?15:09
jeblairfungi: yep.  i'll keep chugging through github15:10
*** dimtruck is now known as zz_dimtruck15:10
*** dstanek_zzz is now known as dstanek15:10
fungi8 changes getting gated now15:11
jeblairfungi: want to do the group renames?15:12
fungiyep, doing them now15:12
jeblairdone with github tasks15:13
fungigroups are renamed15:13
fungilooks like our config changes are gettign workers assigned now15:14
jeblairfungi: i think mordred used ansible last time for step 14.15:14
jeblairi think the docs for that might be in his proposed ansible change...15:15
fungiat this point it's really just proposal and pypi slaves we care about for this though, right?15:15
jeblairfungi: yeah15:15
jeblairi'll take care of those15:15
fungioh, maybe the mirror slaves also have workspaces for these... checking15:16
jeblairfungi: the only project this applies to is designate, right?15:16
fungiyep15:16
fungier15:16
jeblairso *designate* should get all 315:16
fungiyeah, technically this also applies to murano too, but we won't be running any jobs for it any longer so who cares15:17
jeblairoh, i missed the other designate repos on github15:17
fungiahh, right. i based my list at the top of the etherpad on your e-mail plus the follow-up reply about the additional designate repos15:18
*** andreykurilin has joined #openstack-infra15:18
fungii dodn't check that you included them in the github list though15:18
fungier, didn't15:18
jeblairgithub done (again)15:18
*** xianghuihui has quit IRC15:19
openstackgerritLonggeek proposed a change to openstack-infra/jeepyb: Update global requirements  https://review.openstack.org/10333815:19
jeblairpypi and proposal workspaces cleaned15:19
fungiand just checked, the mirror slaves don't have remotes for those repos15:19
jeblairso waiting on changes to merge now15:20
*** e0ne has quit IRC15:20
*** dstanek is now known as dstanek_zzz15:21
* fungi nods15:21
*** e0ne has joined #openstack-infra15:21
*** dansmith is now known as superdan15:22
openstackgerritA change was merged to openstack-infra/config: Move Designate from stackforge to openstack  https://review.openstack.org/10232815:23
fungiall the changes' jobs have workers now, so eta is 5 minutes15:23
openstackgerritA change was merged to openstack-infra/config: Rename bash8 to bashate  https://review.openstack.org/10325915:24
openstackgerritA change was merged to openstack-infra/config: Move murano-repository to stackforge-attic  https://review.openstack.org/10326015:24
openstackgerritA change was merged to openstack-infra/config: Move murano-metadataclient to stackforge-attic  https://review.openstack.org/10326115:24
openstackgerritA change was merged to openstack-infra/config: Move murano-common to stackforge-attic  https://review.openstack.org/10326215:24
openstackgerritA change was merged to openstack-infra/config: Move murano-conductor to stackforge-attic  https://review.openstack.org/10326315:24
openstackgerritA change was merged to openstack-infra/config: Move murano-tests to stackforge-attic  https://review.openstack.org/10326415:27
openstackgerritA change was merged to openstack-infra/config: Make gate-devstack-bashate non-voting  https://review.openstack.org/10327215:27
fungiand they're all merged now15:27
openstackgerritstephen proposed a change to openstack-infra/zuul: Update requirements modules version  https://review.openstack.org/10332115:27
fungiso i guess we're just ready to get puppet going again?>15:27
jeblairfungi: yup, i'll kick one off15:27
fungithanks15:28
KiallShould the open reviews for designate be showing under the new name yet?15:28
fungiKiall: not yet15:28
fungiKiall: oh, er maybe yes15:28
KiallAha - I thought that was done while gerrit was down :/15:28
jeblairfungi: i'm holding15:28
fungiKiall: example?15:28
Kiallhttps://review.openstack.org/#/q/status:open+(project:openstack/designate+OR+project:openstack/python-designateclient+OR+project:openstack/designate-specs),n,z15:29
Kiallthere should be a bunch there15:29
jeblairfungi: did you do the reindex?15:29
fungid'oh! i did not reindex15:29
Kialland the "My reviews" page doesn't show my designate reviews15:29
Kiall:)15:29
fungidid we have details on the reindex command somewhere? i can dig them back out of my notes if not15:30
jeblairfungi: http://ci.openstack.org/gerrit.html#renaming-a-project :)15:30
jeblairfungi: step 715:30
fungicripes. i totally missed that15:30
fungican't be done with gerrit online either, huh?15:30
KiallLooks like gerrit needs to be stopped again for it?15:30
jeblairi believe that's our current understanding15:30
jeblairfungi: we could probably just stop/reindex/start gerrit without doing anything else15:31
fungii think it went quickish last time... do we want to risk15:31
fungiyeah that15:31
jeblairzuul won't notice for the next 23 mins15:31
fungii think so15:31
fungidoing now15:31
jeblairok15:31
*** jamespage_ has joined #openstack-infra15:31
Longgeekfungi: The two patch did not trigger jenkins. look https://review.openstack.org/#/c/102796/  https://review.openstack.org/#/c/102794/15:32
*** devkulkarni has quit IRC15:33
*** jamespage__ has quit IRC15:33
*** sacharya has joined #openstack-infra15:35
*** jamespage_ has quit IRC15:36
*** CaptTofu_ has joined #openstack-infra15:38
*** devkulkarni has joined #openstack-infra15:38
fungidone, gerrit's startign again now15:38
fungitook ~7 minutes to reindex15:39
fungiKiall: looking better to you now?15:39
*** xianghui has joined #openstack-infra15:39
KiallYes15:39
KiallSeems to be back15:39
fungiagreed--your query looks like it's returning changes now15:40
jeblairfungi: i'll proceed with puppet now?15:40
fungijeblair: should be safe to puppet stuff now15:40
jeblairrunning15:40
fungiKiall: thanks for catching that15:40
Kiallno problem :)15:41
jeblairgit01-03 are done15:44
jeblairhttp://puppetboard.openstack.org/nodes?status=changed15:44
*** openstackgerrit has quit IRC15:46
jeblaironto review.o.o now15:46
*** msabramo has quit IRC15:46
fungii'm getting prepped to kick off teh nodepool image updates once it has new copies of the slave scripts on hand15:47
*** openstackgerrit has joined #openstack-infra15:47
*** jamespage_ has joined #openstack-infra15:49
fungier, i guess those actually get cloned straight out of the config repo so should be safe to start now?15:49
jeblairfungi: oh, yeah.15:50
KiallI've getting .gitreview changes to the designate repos ready - OK to submit + merge? or shall I hold off?15:50
jeblairKiall: go for it15:50
KiallK15:50
jeblair#status ok15:51
openstackstatusjeblair: sending ok15:51
fungithough if the acls on review.o.o haven't been updated by puppet yet, you may have a problem approving them15:51
KiallSure, That'll sort itself though :)15:51
KiallJust wnated to be sure I wouldn't break anything ;)15:51
jeblairpuppet on review.o.o is done15:51
Kiallwanted*15:51
fungiyeah, it'll probably be working by the time you get that far15:51
*** ChanServ changes topic to "Discussion of OpenStack Developer Infrastructure | docs http://ci.openstack.org | bugs https://launchpad.net/openstack-ci/ | https://git.openstack.org/cgit/openstack-infra/config/tree/"15:52
fungioh, or now ;)15:52
jeblairfungi: there are errors in syslog from manage_projects15:53
openstackstatusjeblair: finished sending ok15:53
jeblairfungi: i think i may have missed a step in setting up stackforge-attic15:53
jeblairon github15:53
fungiokay, i've got bare-precise nodes in a building state in all providers/regions/azs and will keep an eye on them and restart any which fail, then i'll approve 103273 once they complete15:53
fungijeblair: missing gerrit team access?15:54
jeblairyeah15:54
KiallAlso just realized Zuul isn't reconfigured yet ;)15:54
* Kiall waits to recheck15:54
*** e0ne has quit IRC15:54
*** zz_dimtruck is now known as dimtruck15:55
jeblairok, github is fixed, i'll re-run mp for those repos15:57
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Tag Complete directive has proper focus behavior  https://review.openstack.org/10318315:58
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Added focus directive  https://review.openstack.org/10334515:58
jeblairdone15:59
jeblairfungi: i'll trigger replication15:59
jeblair1897 replication tasks queued16:00
fungiso aside from that and the image updates/bashate job voting change (and the zuul config cleanup if we want) i guess we're done?16:00
*** chandan_kumar has quit IRC16:00
jeblairfungi: i think so; i'm leaning toward deferring the zuul config change since i think i may go out and have a weekend :)16:01
fungijeblair: i think that's a swell idea16:01
jeblair2014-06-28 15:59:50,723 DEBUG zuul.IndependentPipelineManager: Event <TriggerEvent comment-added openstack/designate-specs master 103343,1> for change <Change 0x7f512835dad0 103343,1> matched <EventFilter types: comment-added c16:02
jeblairomments: (?i)^(Patch Set [0-9]+:)?( [\w\\+-]*)*(\n\n)?\s*recheck(( (?:bug|lp)[\s#:]*(\d+))|( no bug))\s*$> in pipeline <IndependentPipelineManager check>16:02
jeblairfungi: i think that's a pretty cool debug message though ^ :)16:02
fungi_yes_16:02
*** craigbr has joined #openstack-infra16:02
fungithat's going to help a *ton*16:02
jeblairfungi: all of the cgit replication is done; only githubs are pending16:04
jeblairKiall: did zuul reload?16:05
KiallYes, changes on there way in16:05
jeblairKiall: cool16:05
Kiall(for the designate repos anyway... I assume it doesn't matter for the attic stuff - they should be read only)16:06
jeblairfungi: so yeah, i think we're done now; we can check back later today or tomorrow and see if that image build is done16:06
fungijeblair: yep. i plan to check back in on it periodically while i continue the endless unpacking16:07
*** adrian_otto has quit IRC16:07
jeblairoh, the long running slaves have new ssh host keys and so haven't been getting puppet updates16:08
jeblairfixing16:08
fungigah, right16:09
mordredmornign all16:11
*** dstanek_zzz is now known as dstanek16:12
mordredwhyfore the long running slaves with the new host keys?16:12
jeblairmordred: i, uh, strategically deleted them recently16:12
*** harlowja_at_home has joined #openstack-infra16:13
*** sweston_ has joined #openstack-infra16:13
fungithey were in need of a refresh16:14
fungisilver lining16:14
jeblairand you know, i figured when i was deleting all of the nodepool slaves would be exactly the right time to delete the long running slaves and ensure that refresh16:16
jeblairsee? strategic.16:16
mordredjeblair: neat!16:17
*** rcarrill` has joined #openstack-infra16:17
mordredjeblair: this is why you have all the powers16:18
anteayaso if a guy named tim crawford creates a paper.li called the OpenStack Daily, do we care? http://paper.li/tcrawford/139991103616:18
*** rcarrillocruz has quit IRC16:18
*** dizquierdo has joined #openstack-infra16:19
anteayahttps://twitter.com/tcrawford16:19
fungianteaya: i don't *personally* care, but reed and lsell may be interested. perhaps he can be encouraged to contribute to openstack's official superuser magazine instead16:20
openstackgerritLonggeek proposed a change to openstack-infra/nodepool: Update pbr version  https://review.openstack.org/10334716:20
*** dstanek is now known as dstanek_zzz16:22
anteayagood idea16:22
anteayaI'll send an email to reed and lsell16:22
fungie.g. http://superuser.openstack.org/16:23
*** rcarrillocruz has joined #openstack-infra16:24
*** rcarrill` has quit IRC16:26
SergeyLukjanovfungi, mordred, ack that we have Mirantis OpenStack16:26
anteayaemail sent16:27
anteayafungi: yeah I took a look at the first issue of superuser16:27
anteayait has a really slick look16:27
anteayaSergeyLukjanov: I think reed's orginial question was on the licencing around Mirantis OpenStack16:30
mordredI think we should not care16:30
mordredabout OpenStack daily16:32
anteayaokay16:33
anteayawell I'm with fungi, I don't care16:33
anteayaI don't like dude scraped my feed for content without asking but meh16:33
anteayabut lsell and reed might, so now they know16:33
anteayaif they read their email16:33
*** lttrl has joined #openstack-infra16:39
openstackgerritKiall Mac Innes proposed a change to openstack-infra/config: Add designate doc publish jobs to Zuul layout  https://review.openstack.org/10334916:41
Kiallfungi / jeblair .. Missed something in the Designate rename ;) ^16:41
*** sandywalsh has quit IRC16:41
*** sandywalsh has joined #openstack-infra16:42
anteayaKiall: I think it is just openstack-publish-jobs16:43
anteayanot -server and -client16:43
*** msabramo has joined #openstack-infra16:44
Kiallanteaya: Nope - server and client is right, copied from the other projects :)16:44
anteayahuh, but I see it elsewhere in the file16:44
anteayawhich I find odd16:44
KiallReally? http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml16:45
Kiallopenstack-publish-jobs shows nothing for me16:45
*** CaptTofu_ has quit IRC16:46
anteayahttp://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/openstack-publish-jobs.yaml16:46
*** craigbr has quit IRC16:46
KiallAh.. The JJB side is already done16:46
Kiallthat's the zuul layout file16:46
*** CaptTofu_ has joined #openstack-infra16:46
*** sweston_ has quit IRC16:46
*** harlowja_at_home has quit IRC16:47
Kiallthanks jeblair :)16:48
Kiallany others takers? Going Once.. Going Twice... ;)16:48
anteayayeah I am trying to see the jjb file that has the template for openstack-{server|client}-publish-jobs16:49
anteayaso far, I don't see it16:49
*** CaptTofu_ has quit IRC16:51
KiallIt's not a JJB template, it's a Zuul layout template - It's defined here: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n31316:51
anteayaoh okay, thanks Kiall16:51
anteayaand {name}-docs comes from openstack-publish-jobs16:53
anteayacool16:53
KiallYea :)16:55
*** rcarrill` has joined #openstack-infra16:55
*** rcarrillocruz has quit IRC16:56
*** sweston_ has joined #openstack-infra17:01
*** msabramo has quit IRC17:02
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Start building a bandersnatch mirror  https://review.openstack.org/10335317:03
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Make select-mirror use the bandersnatch mirror  https://review.openstack.org/10335417:03
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Delete select-mirror and all the args  https://review.openstack.org/10335517:03
mordredjeblair: ^^17:03
*** msabramo has joined #openstack-infra17:04
jeblairmordred: wooo!17:06
mordredjeblair: running a test mirror right now - discovered one of the paths is wrong17:09
mordredjeblair: but the simple version is pretty simple17:09
mordredjeblair: which, of course, has got me thinking about the complex version - which is per-region mirrors17:09
mordredjeblair: which obviously comes back to AFS17:10
*** dstanek_zzz is now known as dstanek17:12
*** adam_g has quit IRC17:13
*** adam_g has joined #openstack-infra17:14
*** adam_g has quit IRC17:14
*** adam_g has joined #openstack-infra17:14
*** sweston_ has quit IRC17:18
dstufftmordred: why AFS and not just an indenendent bandersnatch mirror in each region17:20
mordreddstufft: atomic volume publication for one - also saves on having to rsync to an expanding fan of mirrors17:21
mordreddstufft: we need the mirror job itself to run triggered by zuul - so we run the actually mirroring on one node and then rsync it to the node where it's served out currently17:22
*** dstanek is now known as dstanek_zzz17:22
mordreddstufft: if we add nodes per region, we'll have a add an rsync to the copy template each time we add a server17:22
mordredobviously could be done and not a problem and doesn't _require_ AFS17:23
mordredbut the usecase fits in with why we want AFS available in the first place17:23
mordredand we should be able to use the exact same automation to deal with per-region apt, gem, node and maven mirrors too17:24
mordredin theory17:24
*** amitpp has quit IRC17:24
dstufftmordred: wait what17:24
mordreddstufft: the copying/publication17:25
mordrednot the bandersnatch part17:25
dstufftmordred: why is your bandersnatch mirror being triggered by zuul and not just running in a corn every 5 minutes17:25
dstufftoh17:25
mordreddstufft: because we want to be able to trigger when we publish a new package to pypi17:25
mordredto ensure taht package winds up locally asap17:25
dstuffta 5 minute delay isn't fast enough?17:25
mordreddstufft: isa  5 minute cron reasonable?17:25
dstufftsure17:25
dstufftbandersnatch is efficient17:25
mordredah. ok. fair enough then - might be worth revisiting that then17:26
dstufftit hits a changelog API on PyPI that asks if any changes have been made since a particular revision17:26
clarkbdstufft thats basically what I said17:26
dstufftif nothing has changed, that's a single HTTP request17:26
clarkbbut apparently eventually consistent is no good17:26
mordredclarkb: I think it's fine17:26
clarkboh good17:27
mordredwe're not talking ACTUALLY eventually consistent17:27
*** sweston_ has joined #openstack-infra17:27
dstufftmordred: to be honest, you could probably od less than 5 min if you really wanted, we (python-infra) run a bandersnatch mirror that does every minute17:27
mordredwe're talking about a skew of a minute or two - which is better than the mirror build skew now17:27
mordreddstufft: awesome. great to know. that actually would simplify several things17:28
mordredclarkb: I was also thinking we may want to still do a per-node-type build-wheels-from-requirements.txt once we're on bandersnatch17:28
clarkbyes we should17:28
mordredbut we're not really using out local built wheels anyway17:29
mordredright now17:29
clarkbsee my response to adrian about the mirrors17:29
mordredso I think we can do it as a followon17:29
clarkbI use them17:29
mordredclarkb: context?17:29
clarkbin my pip.conf I tell pip to use our wheels first17:29
mordredclarkb: oh. great. yeah - I just meant we don't have that in our config yet17:29
mordredfor the gate17:29
clarkbya17:29
mordredwhat response to adrian?17:30
clarkbyou havent seen that? one sec17:30
*** sweston_ has quit IRC17:31
clarkbhttp://lists.openstack.org/pipermail/openstack-dev/2014-June/038609.html17:32
clarkbmordred ^17:32
dstufftmordred: you probably want monitoring on your last updated file though btw17:32
dstufftmordred: as in sometimes pypi loses a purge request to Fastly and bandersnatch is smart and realizes it has done so and won't mark the mirror run as successful because it's not getting the revision it expects17:33
*** arnaud__ has joined #openstack-infra17:33
dstufftbut bandersnatch is also greedy, it'll mirror as much as it can even in an unsuccessful run17:33
mordreddstufft: I'm not sure I understand the monitoring on the last updated file part17:34
dstufftmordred: to look for a stale mirror17:35
mordredwould it not just get fixed next cron?17:35
mordredand what's the remediation?17:35
* mordred learns things...17:35
dstufftmordred: if PyPI loses a purge for say /simple/requests/, then it'll serve the old cached version for that until it naturally falls off the cache (1 day) unless PyPI triggers a new purge because the author did something17:36
dstufftmordred: bandernsatch is smart enough to be able to realize that PyPI is serving a stale version, and won't mark the run as successful because /simple/requests/ is old17:36
dstuffton every cron job, it'll attempt to get that (plus anything else it can), and it'll get as much as it can, but utlimately fail until /simple/requests/ is purged17:37
dstufftmarking a run as successful is when the last modified timestamp gets updated17:37
dstufftthe remediation is just purge the stuck URL, which you can either yell at me to do, or anyone can purge with curl17:38
dstufftcurl -X PURGE https://pypi.python.org/simple/requests/ in the example17:38
dstufftmordred: make sense?17:38
mordredok - I need to ask a few stupid questions...17:38
mordredwhen you say "loses a purge" - do you mean "old versions are still present"17:39
dstuffthttp://www.pypi-mirrors.org/ this is what we have the official mirror17:39
mordredor you mean there is a new version on pypi and it hasn't made it to fastly?17:39
dstufftmordred: I mean, (again using the requests example) kenneth reitz uploads a new version of requests, and Fastly has the pre-upload page cached, when kenneth does the upload PyPI attempts to tell fastly to purge the old cached results from the cache17:40
dstufftso the second one17:40
dstufftFastly is really just varnish17:40
mordredok17:40
*** amitpp has joined #openstack-infra17:40
dstufftwe use purging to (mostly) get near instant reflection of changed data on PyPI even with a long (1 day) cache17:40
*** sweston_ has joined #openstack-infra17:41
dstufftbut purging was hacked into PyPI and it sometimes fails and we don't have retries setup yet17:41
mordredso in a perfect world, we'd notice that something failed and just issue a purge17:41
dstufftmordred: ya17:41
dstufftthe last modified file is just a date17:41
dstufftwhen everything is correct it should reflect the last time the cronjob ran17:41
mordreddstufft: any reason to not have bandersnatch trigger a purge when it notices stale?17:41
dstufftmordred: probably just that when that was implemented I didn't realize that purging didn't require authentication so it didn't occur to me to tell the author that17:42
mordredkk. so a patch to do that if I got around to it wouldnt' be like a terrible idea or anything17:42
dstufftthe only downside would be it might kill our cache if it's buggy and tries to purge over and over or something17:43
dstufftbut that's about it17:43
mordrednod17:43
mordredwell, I think we can start with "notice there is a stale thing"17:43
mordreddstufft: next q - if I put the web dir of bandersnatch as the doc-root of a vhost, let's call it mirror.openstack.org17:44
mordredshould I be pointing pip at http://mirror.openstack.org/simple ?17:44
dstufftya17:44
mordredk17:44
dstuffthopefully https:// though ;)17:44
mordredthat's on the TDL ... we're http at the moment17:44
mordredclarkb: ^^ we need to fix that17:44
clarkbbuy a cert :P17:45
mordredclarkb: yah.17:45
clarkbits a not hard problem17:45
jeblairmordred: if you want to use mirror.o.o, it should be in a subdir17:45
dstufftmordred: fwiw the code that powers http://www.pypi-mirrors.org/ is open source, might be a nice little dashboard to look at the region mirrors and check their updated things17:45
jeblairmordred: (ubuntu mirror, fedora mirror, ...)17:45
*** chandan_kumar has joined #openstack-infra17:45
mordredjeblair: was just an example - wanted to grok the dirs17:45
jeblairmordred: ack17:45
mordredjeblair: I think we'll want to transition from http://pypi.openstack.org/openstack to https://pypi.openstack.org/simple17:46
mordredsince we dont' need the "we might have multiple pockets of mirrors" anymore17:46
jeblairmordred: ++17:47
dstufftoh man I didn't notice that bandersnatch is using my xmlrpc2 lib now17:48
*** e0ne has joined #openstack-infra17:49
*** e0ne has quit IRC17:49
*** praneshp has joined #openstack-infra17:52
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Start building a bandersnatch mirror  https://review.openstack.org/10335317:54
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Make select-mirror use the bandersnatch mirror  https://review.openstack.org/10335417:54
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Delete select-mirror and all the args  https://review.openstack.org/10335517:54
mordredok. this should be better17:54
mordred^^17:54
mordredI'm going to follow it with a change to just do cron17:54
*** sarob has joined #openstack-infra18:01
*** sarob has quit IRC18:01
*** sarob has joined #openstack-infra18:02
*** sarob has quit IRC18:06
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Run bandersnatch mirror on the mirror host  https://review.openstack.org/10336018:08
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Remove the mirror slaves  https://review.openstack.org/10336118:08
mordredok. there's the full set18:08
*** harlowja_at_home has joined #openstack-infra18:09
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Remove the mirror slaves  https://review.openstack.org/10336118:12
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Run bandersnatch mirror on the mirror host  https://review.openstack.org/10336018:12
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Start building a bandersnatch mirror  https://review.openstack.org/10335318:12
mordredoops. puppet lint18:12
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Make select-mirror use the bandersnatch mirror  https://review.openstack.org/10335418:12
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Delete select-mirror and all the args  https://review.openstack.org/10335518:12
*** msabramo has quit IRC18:12
*** praneshp_ has joined #openstack-infra18:13
*** dstanek_zzz is now known as dstanek18:13
*** praneshp has quit IRC18:14
*** praneshp_ is now known as praneshp18:14
*** devkulkarni has quit IRC18:15
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Remove the mirror slaves  https://review.openstack.org/10336118:22
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Run bandersnatch mirror on the mirror host  https://review.openstack.org/10336018:22
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Make select-mirror use the bandersnatch mirror  https://review.openstack.org/10335418:22
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Delete select-mirror and all the args  https://review.openstack.org/10335518:22
*** dstanek is now known as dstanek_zzz18:23
*** superdan is now known as dansmith18:23
openstackgerritMonty Taylor proposed a change to openstack-infra/devstack-gate: Stop doing tricky things with mirrors  https://review.openstack.org/10336318:25
*** CaptTofu_ has joined #openstack-infra18:27
*** alexpilotti has joined #openstack-infra18:27
*** penguinRaider has joined #openstack-infra18:29
*** e0ne has joined #openstack-infra18:31
*** CaptTofu_ has quit IRC18:32
*** lttrl has quit IRC18:34
*** lttrl has joined #openstack-infra18:34
*** CaptTofu_ has joined #openstack-infra18:38
*** msabramo has joined #openstack-infra18:41
*** arnaud__ has quit IRC18:42
*** arnaud__ has joined #openstack-infra18:43
*** arnaud__ has quit IRC18:45
*** mriedem has joined #openstack-infra18:47
*** dizquierdo has quit IRC18:47
*** devkulkarni has joined #openstack-infra18:49
mordredclarkb: this game is killing me18:50
*** ildikov_ has joined #openstack-infra18:50
clarkbmordred chile is failing18:51
mordredclarkb: I mean, good on them for pushing brazil so hard during the game ... but this is not a good moment for the18:51
mordredthem18:51
*** ildikov has quit IRC18:53
clarkbok this is good18:53
mordredclarkb: ok.18:53
mordredclarkb: I mean18:54
mordredclarkb: what the hell is this game?18:54
fungihad to retry rax-dfw (the first attempt there is currently stuck building with the template instance in an error state), but all bare-precise images are fresh now since the bashate rename18:54
mordredneymar!18:54
clarkbthis is it18:55
clarkband over18:55
mordredWOAH18:55
mordreddude18:55
mordredway to turn the first knockout match into CRAZY18:56
*** CaptTofu_ has quit IRC18:56
*** CaptTofu_ has joined #openstack-infra18:56
fungigrr... "Download error on https://pypi.python.org/simple/: [Errno 110] Connection timed out -- Some packages may not be found!"18:58
dstufftConnection timed out18:59
dstufftwat18:59
dstufftI don't se that one very often18:59
*** dimtruck is now known as zz_dimtruck19:00
mordredfungi: /me workie on mirrors ...19:00
mordredfungi: :)19:00
mordredfungi: you wanna review bandersnatch patches?19:00
fungimordred: i saw--good stuff!19:00
fungimaybe when i get another unpacking break19:00
mordredfungi, clarkb: btw - I'm going to land and babysit the ansible patches19:00
fungiexcellent19:00
*** CaptTofu_ has quit IRC19:01
*** zz_dimtruck is now known as dimtruck19:01
fungidstufft: clearly your employer has trouble reaching pypi sometimes... http://logs.openstack.org/73/103273/1/gate/gate-config-pep8/8bc03a8/console.html "Building remotely on bare-precise-rax-dfw..."19:01
mordredfungi: and - I _don't_ have them in the tree, but from the scrollback - I _do_ have ansible code locally for doing project renames - I shoudl add them19:01
fungimordred: i would much appreciate that19:01
fungianything to help prevent me from skipping another lucene reindex :/19:02
*** sarob has joined #openstack-infra19:02
*** sarob has quit IRC19:02
dstufftfungi: idk what to do about that19:03
mordredfungi: yah. that's one of my ultimate goals with the ansible stuff - have playbooks for the things like this that arent' puppet state19:03
fungidstufft: we do. moar mirroring closer to our workers19:03
dstufftfungi: well yea, but still we shouldn't have problems hitting pypi enough that it's an "thing"19:03
fungidstufft: i seriously doubt it's pypi per se. more likely network gasping in dfw19:04
*** craigbr has joined #openstack-infra19:04
dstufftfungi: that also sounds like something that shouldn't be a thing19:05
mordredfungi, clarkb: I'm thinking about making a patch to nodepool as a first step towards getting to a per-region mirror model...19:05
mordredwhere we take all the info we know about a region - like region name, for instance, and stuff it into nova metadata for every node we launch19:05
mordred(nodepool region name)19:05
mordredwhich should make it really easy to havea  node know which mirror it should point to19:06
mordredOR19:06
fungimordred: yeah, metadata or we also talked about just dropping a breadcrumb in /etc during image build (though that becomes harder with glance images not being special per-region any longer)19:06
mordredskipping that - we could just have nodepool drop a shell script file as part of post-boot19:06
mordredyeah19:06
openstackgerritlifeless proposed a change to openstack-dev/pbr: Allow examining parsing exceptions.  https://review.openstack.org/8085619:06
openstackgerritlifeless proposed a change to openstack-dev/pbr: Teach pbr about post versioned dev versions.  https://review.openstack.org/8044919:06
mordredfungi: well, we still ssh to nodes to test that they're real19:06
openstackgerritlifeless proposed a change to openstack-dev/pbr: WIP: Break out a common version object from VersionInfo  https://review.openstack.org/9410819:07
fungimordred: we do, but we may no longer have root access at that point19:07
mordredfungi: so copying in a 4 line file at boot shouldn't be awful or wasteful19:07
mordredfungi: good point19:07
fungimordred: so we'd probably need to tune them prior to snapshotting anyway19:07
mordredwell - this is where putting it in the metadata might be nice19:07
fungimordred: or use something more dynamic (like have scripts base decisions on the hostname)19:07
fungimore dynamic than files in teh snapshot images i mean, but yeah nova metadata would work for that in theory19:08
mordredI'll test nova metadata + cloud-init19:08
mordredshoudl be an actual match for that usecase19:08
mordredand simple enough that it's not likely to massively derp19:08
*** craigbr has quit IRC19:09
mordredSpamapS: do you know if cloudinit knows how to read openstack metadata extensions?19:09
lifelessmordred: what extensions ?19:10
*** dimtruck is now known as zz_dimtruck19:10
mordredlifeless: http://169.254.169.254/openstack/2013-10-17/meta_data.json19:11
lifelessmordred: yes (under latest)19:11
mordredk19:11
mordredoh - wait19:12
lifeless./tests/unittests/test_datasource/test_configdrive.py:  'openstack/latest/user_data': USER_DATA}19:12
mordredrackspace doesn't do metadata service19:12
lifelessthey do config drive right? close enough.19:12
mordredit is - except it's a bunch of extra work on our part19:12
lifelessas shown by the path of that test :)19:12
lifelessmordred: how is it more work?19:12
mordredwe have to make the image mount the config drive19:13
lifelessdoesn't cloud-init do that ?19:13
mordreddoes it?19:13
mordredjust automatically by itself? if so, that's neat19:13
lifelesspretty sure19:13
mordredI'll test all of that. cool19:13
lifelessthats its job19:13
mordredwell, my experience with cloud-init is usually massively underwhelming19:14
mordredso if it dose that, I'll be quite happy19:14
*** dstanek_zzz is now known as dstanek19:14
*** sweston_ has quit IRC19:14
mordredbut I will not believe it until I've verified it19:14
mordredlifeless: do you happen to know off the top of your head if trusty images have the latest cloud init?19:14
lifelessI think they do - I recall seeing the bug with cloud-init hanging on machines with serial ports get closed19:15
adam_gcloud-init may also go reading and writing to serial ports19:15
lifelessbut adam_g may know more ;)19:15
adam_gmordred, yeah trusty has the latest, or near latest, and has config drive support enabled by default19:18
*** harlowja_at_home has quit IRC19:18
*** sacharya has quit IRC19:19
mordredadam_g: awesome. I will experiment with this19:20
mordredI mean, I need to get just the one mirror done first19:21
mordred:)19:21
mordredbut clearly having per-region mirrors is a thing19:21
morganfainbergsdague, jogo_away, did you know you can't # noqa E711 errors?19:22
morganfainbergsdague, i found a legitimate case for using XX == None19:22
openstackgerritA change was merged to openstack-infra/config: Revert "Make gate-devstack-bashate non-voting"  https://review.openstack.org/10327319:22
fungiwould be nice if we could also use ubuntu precise and centos 6 in rackspace though19:22
fungi(from a cloud-init sending us to the right mirrors context)19:22
dstufftcentos7 tho19:22
morganfainbergsdague, revolves around SQLAlchemy queries19:23
morganfainbergi guess i can use filter_by instead. bleh.19:23
fungidstufft: where? and also can you make it retroactively exist 1.5 years ago so we don't have to test our stable releases on 6? ;)19:23
dstufftoh right19:23
dstufftopenstack actually cares if shit runs on other OSs19:24
*** dstanek is now known as dstanek_zzz19:24
mordredfungi: well... if we move to using our own base images for everything19:24
*** weshay has quit IRC19:24
fungidstufft: to hear the distro packagers talk, you'd think we don't give tuppence about support for them19:24
mordredfungi: then updating cloud-init on precise should be doable19:24
fungiwell, not all the distro packagers, but there are definitely still rumblings that we don't have nearly long enough stable branch support19:25
*** e0ne has quit IRC19:25
fungimordred: very true. we could easily shim in non-distro-provided cloud-init if needed19:25
mordredfungi: you know - we support things as long as people show up to suppor things19:25
dstufftfungi: lol19:26
dstufftfungi: I figure if some distro wants to support something for a billion years, it's not my job to do that if that's what their value add is :D19:26
fungimordred: we do indeed. but it's easier to show up and complain that we don't support something than to show up and support it yourself ;)19:26
fungidstufft: well, the situation for the distros can be improved when the collaborate on common versions and pitch in collectively on backports to those (cf linux kernel stable trains)19:28
pleia2mordred: I forgot to tell you, got to hang out with Georg Greve in Croatia, he says hi :)19:28
*** msabramo has quit IRC19:32
mordredpleia2: nice!19:34
*** devkulkarni has quit IRC19:40
*** devkulkarni has joined #openstack-infra19:46
*** penguinRaider has quit IRC19:50
*** Longgeek has quit IRC19:51
*** msabramo has joined #openstack-infra19:51
*** Guest49824 is now known as Adri200019:55
*** Adri2000 has joined #openstack-infra19:55
*** e0ne has joined #openstack-infra19:56
*** e0ne_ has joined #openstack-infra19:58
*** e0ne has quit IRC19:58
*** e0ne_ has quit IRC19:59
*** e0ne has joined #openstack-infra20:00
*** e0ne has quit IRC20:02
*** zz_dimtruck is now known as dimtruck20:03
*** zzelle has joined #openstack-infra20:07
*** sweston_ has joined #openstack-infra20:07
*** msabramo has quit IRC20:09
*** dimtruck is now known as zz_dimtruck20:13
*** dstanek_zzz is now known as dstanek20:15
*** devkulkarni has quit IRC20:17
*** dstanek is now known as dstanek_zzz20:25
*** yamahata has quit IRC20:27
*** penguinRaider has joined #openstack-infra20:29
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Write the puppet command as a module  https://review.openstack.org/10337020:32
mordredclarkb: the above ^^ is to deal with your comment about puppet and return codes20:32
*** msabramo has joined #openstack-infra20:37
mordrednibalizer: any chance you know if --detailed-exitcodes has a return code for "catalog failed to compile" ?20:41
*** sweston is now known as sweston_cloud20:42
mordrednibalizer: ooh. that seems to return 1 as opposed to 4 or 6 - we might be able to do your suggestion on the irc thing20:43
clarkbcool20:48
clarkbalso may need to catch 1 in the dib stuff20:48
mordredyup20:50
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Write the puppet command as a module  https://review.openstack.org/10337020:51
mordredclarkb: it helps when I git add the key file20:51
*** sweston_ has quit IRC20:54
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Write the puppet command as a module  https://review.openstack.org/10337020:55
*** msabramo has quit IRC20:55
*** msabramo has joined #openstack-infra21:00
*** e0ne has joined #openstack-infra21:00
*** e0ne has quit IRC21:02
*** andreykurilin has quit IRC21:03
*** craigbr has joined #openstack-infra21:03
*** e0ne has joined #openstack-infra21:06
*** craigbr has quit IRC21:07
*** e0ne has quit IRC21:09
*** andreykurilin has joined #openstack-infra21:12
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Write the puppet command as a module  https://review.openstack.org/10337021:13
mordredok. that should be clearner21:13
*** dstanek_zzz is now known as dstanek21:15
*** msabramo has quit IRC21:17
*** dstanek is now known as dstanek_zzz21:25
*** sweston has joined #openstack-infra21:28
mordredsigh21:29
mordredmirror27.slave.openstack.org has puppet3 on it21:29
openstackgerritVitaliy Lotorev proposed a change to openstack-infra/jenkins-job-builder: add logfilesize plugin support (doc,tests)  https://review.openstack.org/10337221:29
*** zz_dimtruck is now known as dimtruck21:39
*** salv-orlando has quit IRC21:41
*** sweston has quit IRC21:44
*** rcarrillocruz has joined #openstack-infra21:54
*** rcarrill` has quit IRC21:55
*** chandan_kumar has quit IRC21:58
adam_gmordred, oh heads up, if you want to use that config drive cloud-init stuff with DIB images, you need to enable it via DIB_CLOUD_INIT_DATASOURCES22:00
*** sacharya has joined #openstack-infra22:02
mordredadam_g: thanks!22:13
*** dstanek_zzz is now known as dstanek22:16
*** dstanek is now known as dstanek_zzz22:26
*** otherwiseguy has quit IRC22:35
*** dkehn has joined #openstack-infra22:44
*** dkehn__ has quit IRC22:46
*** dkehnx has quit IRC22:46
*** rcarrill` has joined #openstack-infra22:46
*** dkehn_ has joined #openstack-infra22:47
*** rcarrillocruz has quit IRC22:47
*** dkehn__ has joined #openstack-infra22:47
*** dkehn has quit IRC22:48
*** dstanek_zzz is now known as dstanek22:51
*** sweston has joined #openstack-infra22:52
*** dimtruck is now known as zz_dimtruck22:53
*** craigbr has joined #openstack-infra22:58
*** dstanek is now known as dstanek_zzz23:01
*** rcarrillocruz has joined #openstack-infra23:02
*** andreykurilin has quit IRC23:04
*** rcarrill` has quit IRC23:05
*** amitpp has quit IRC23:07
*** craigbr has quit IRC23:17
nibalizermordred: woot!23:21
*** masayukig has quit IRC23:21
*** jhesketh has quit IRC23:29
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Notify in IRC when puppet run fails  https://review.openstack.org/9651923:30
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Use ansible instead of direct ssh calls  https://review.openstack.org/8782123:30
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add playbook for cleaning workspaces  https://review.openstack.org/9664623:30
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add mirror management playbooks  https://review.openstack.org/10006623:31
nibalizerarst23:33
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Use ansible instead of direct ssh calls  https://review.openstack.org/8782123:34
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add playbook for cleaning workspaces  https://review.openstack.org/9664623:34
*** sweston has quit IRC23:35
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Notify in IRC when puppet run fails  https://review.openstack.org/9651923:37
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Remove salt  https://review.openstack.org/9636123:38
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Remove old salt references from the puppet  https://review.openstack.org/9636223:38
mordrednibalizer: okie. I think I've got all fo the patches reworked and sensible23:39
mordrednibalizer, clarkb: I squashed four of them after I went through and did a bunch of empirical testing23:39
mordredbecause, you know, sanity23:39
mordrednibalizer: I think I've got your stuff addressed here: https://review.openstack.org/9651923:40
mordredclarkb, fungi: ok. I lied. I23:41
mordredI'm READY to land and babysit the ansible change now - but I did a bunch of testing on my laptop and made a few changes23:42
mordredso it's probably enough that you guys should re-review it23:42
*** HACKING-TWITTER has joined #openstack-infra23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!