Tuesday, 2014-12-23

Katherinehow will the two be viewed as dependent?00:00
jeblairKatherine: you have described a case of conflicting reviews, that's not related to dependencies00:00
dstufftoh right00:00
Katherinewhat we've seen in our env is two changes like this getting merged in quick succession00:00
*** beekneemech has joined #openstack-infra00:00
dstufftsalt only runs so often00:00
*** bnemec has quit IRC00:00
jeblairKatherine: based a git commit's parent00:00
dstufftasselin: try now, salt just ran at 0000:00
Katherineok.00:00
asselinok00:00
Katherineso the problem i described above would not be caught by zuul00:01
Katherinethis is the problem we're trying to solve in our env00:01
asselindstufft, jeblair fungi ok works for me00:02
*** thedodd has quit IRC00:02
asselindstufft, thanks!00:02
dstufftasselin: sorry about that, that's what I get for copy/pasting without testing00:02
fungimtreinish: any guesses what's going on here? http://logs.openstack.org/04/143504/1/check/check-grenade-dsvm-ironic-sideways/c673096/logs/grenade.sh.txt.gz#_2014-12-22_23_50_35_09900:02
jeblairKatherine: zuul should not allow any change that fails tests to land; so if you have testing in place, then a patch which removes something needed by tests should not land00:02
jeblairKatherine: however, if you have developers removing tests, then that's not something zuul can help with :)00:03
Katherinegot the git commit parent dependencies.  thanks for that explanation00:03
fungimtreinish: that's the "new" failure i'm seeing on the ironic sideways job now that we're past the other pip 6.0 errors00:03
Katherinelet me see if i can be more clear.  these changes were approved in quick succession of one another.  each passed the gate individually00:04
jeblairKatherine: we also have a new feature in zuul that we're using that might be relevant00:04
Katherinedoes o~s run into that scenario?00:04
Katherinewhat's that?00:04
dstufftfungi: could be related to the fact that pip caches by default to ~/.cache/pip on Linux00:04
dstufftthough that error doens't look like pip00:04
jeblairKatherine: the 'merge-check' pipeline that we defined will check all outstanding changes for merge conflict each time a change merges00:04
dstufftpip doens't use mkdir00:04
Katherinejeblair: got it00:05
fungidstufft: good eye! same error at http://logs.openstack.org/04/143504/1/check/check-tempest-dsvm-ironic-pxe_ssh/beacd18/logs/devstacklog.txt.gz#_2014-12-22_23_49_11_665 too00:05
Katherinei'll look into that00:05
mtreinishfungi: hmm, dunno. I'm not too familiar with dib or the ironic devstack paths00:05
Katherinejeblair: what's the new feature?  i'm curious00:05
*** achanda has joined #openstack-infra00:05
mtreinishdstufft: oh, yeah that's a good call00:06
fungimtreinish: dstufft: looks like maybe on the ironic jobs we're creating /opt/stack/new/.cache and then pip is barfing all over because it can't write there00:06
jeblairKatherine: if i'm following you, i think it will be difficult to solve that problem with technology -- it sounds like there are developers that don't agree on the direction00:06
mtreinishfungi: does dib use pip internally?00:06
jeblairKatherine: but there is one more bit of tech that might help...00:06
Katherinehmm...  good point00:06
Katherinegreat.  tell me00:06
dstufftfungi: you can turn off pip's caching00:06
mtreinishfungi: or I guess just creating .cache would do it :)00:06
dstufftyou might want to for devstack I guess?00:07
jeblairKatherine: the new change screen in gerrit will tell you if a patch conflicts with any other patches in gerrit, so you might find cases where developers are attempting to change the same code sooner00:07
fungimtreinish: dstufft: might be the other way around. pip already created .cache and there's an mkdir in the deploy script which is missing -p00:07
dstufftyea I think the order fungi said is correct00:07
Katherinejeblair:  i love the sounds of that!  that sounds like something we could really use00:07
*** baoli has joined #openstack-infra00:07
*** baoli has quit IRC00:08
dstufftpip should just silently not cache if it can't write/read to the cache dir00:08
*** baoli has joined #openstack-infra00:08
fungiso perhaps a bug in ramdisk-image-create00:08
fungilooks like we can possibly work around this in lib/baremetal and lib/ironic bu clearing that path first00:09
jeblairKatherine: https://gerrit-review.googlesource.com/Documentation/user-review-ui.html#conflicts-with00:09
*** beekneemech is now known as bnemec00:10
*** reazem has quit IRC00:10
*** achanda has quit IRC00:10
adam_gmkdir: cannot create directory '/opt/stack/new/.cache': Permission denied00:10
dstufftfungi: for complete-ness sake, you can both disable pip's caching and you can point it to a diff dir00:11
adam_g$HOME/.cachce is where DIB caches build things like base cloud image, etc00:11
dstufft$HOME/.cache is a standard cache dir on Linux yea, pip uses it now too by default00:12
Katherinejeblair: thanks for the pointer00:12
jeblairKatherine: so i'd say the ideal workflow for that kind of situation would be: developers use that feature (or otherwise discover) they are working on the same code; they agree on a way forward; they rebase their changes on each other as appropriate so they merge in the correct series.00:12
*** signed8bit is now known as signed8bit_ZZZzz00:12
fungiadam_g: based on the error messages there, it looks less like it's failing to create /opt/stack/new/.cache because it exists, but rather because it's owned by some other account (possibly root from pip being run under sudo)00:13
adam_gfungi, yeah00:14
adam_gwe can just point DIB to $DATA_DIR/dib-cache or something?00:14
jogoare things working again?00:14
fungiadam_g: oh, maybe00:14
jogothings == pip 6.0 issues fixed00:14
dstufftif you're running pip with sudo, you might want sudo -H pip00:14
fungijogo: no, blocked on ironic and pip fighting over the same cachedir now00:14
dstufftso that pip uses /root/.cache00:14
fungidstufft: that's a stellar suggestion. seeing if i can find all the possible places that's happening00:15
*** zz_zz_zz_zz_zz_s is now known as zz_zz_zz_zz_zz_z00:15
jogofungi: thanks00:15
*** Masahiro has joined #openstack-infra00:20
adam_gfungi, https://review.openstack.org/14357300:20
*** dims has joined #openstack-infra00:22
*** dims has quit IRC00:23
fungiadam_g: dstufft: updated https://review.openstack.org/143504 to see if that helps. otherwise we can try squashing 143573 into the initial patchset there00:23
adam_gfungi, nice00:24
*** Masahiro has quit IRC00:24
*** SumitNaiksatam has quit IRC00:27
dstufftfungi: using sudo -H with pip is a good idea anyways because we're going to increasingly be using ~/<stuff> automatically00:28
*** dims has joined #openstack-infra00:28
*** salv-orlando has quit IRC00:32
*** ryanpetrello has joined #openstack-infra00:35
*** dims has quit IRC00:36
*** ryanpetrello has quit IRC00:42
*** hemna is now known as hemnafk00:46
*** hichtakk has quit IRC00:47
*** hichtakk has joined #openstack-infra00:48
*** grue_pm has quit IRC00:51
*** grue_pm has joined #openstack-infra00:52
*** unicell has joined #openstack-infra00:57
*** hichtakk has quit IRC00:58
*** hichtakk has joined #openstack-infra00:58
*** dmsimard is now known as dmsimard_away00:59
fungimtreinish: dstufft: adam_g: looks like the new https://review.openstack.org/143504 is working for juno, so i'll make similar edits to fix it on master as well01:01
*** harlowja has joined #openstack-infra01:01
*** liusheng has quit IRC01:01
fungidtroyer: ^01:02
*** dannywilson has quit IRC01:03
adam_gw00t01:03
*** sigmavirus24_awa is now known as sigmavirus2401:05
fungilooks like stack.sh didn't need editing on master, just functions-common01:06
fungidtroyer: https://review.openstack.org/143501 is updated now01:07
fungiand the juno change looks like it's about to pop into the gate pipeline if we're really lucky01:08
*** sigmavirus24 is now known as sigmavirus24_awa01:08
anteayazaro: nice christmas present01:08
anteaya:D01:09
dtroyerfungi: I just +2 it for now…am going to dinner soon so if it looks good, go ahead and approve01:09
fungidtroyer: okay01:09
fungithanks!01:09
dstufftfungi: awesome, does that mean that as of right now the pip release wasn't very bad? :D01:10
fungidstufft: yep!01:11
*** fandi_ has quit IRC01:11
dstufftawesome01:12
dstufftit wouldn't be a pip release without a little breakage01:12
*** gyee has quit IRC01:12
fungidstufft: i was worried it would tail into a multi-day scramble01:12
fungikudos!01:12
fungiand thanks for all the help01:12
dstufftno problem :) glad it went relatively smoothly01:13
zaroanteaya: thanks! hoping to get a similar response from my wife :)01:13
zaroalthough i feel odds are not as good.01:13
fungizaro: it's awesome that your wife is such a huge fan of storyboard01:14
fungii can't convince my wife to care about any of this stuff01:14
*** camunoz has quit IRC01:15
fungiokay, the juno fix has now made it into the gate. i'll recheck the master fix once that merges01:16
dstufftmy wife and daughter are putting up the christmas tree, it has disco balls and a strobe light01:16
dstufftit's like christmas at a rave01:16
fungidstufft: i'm envious01:16
fungibackpacks and pacifiers all 'round01:16
*** ddieterly has quit IRC01:16
dstufftI should get some of them to complete the look!01:16
fungidstufft: i hope you have enough blacklights01:17
*** grue_pm has quit IRC01:17
*** ddieterly has joined #openstack-infra01:17
dstufftit's a pink tree with a zebra skirt, basically our tree looks like snooki puked on it01:17
*** reed has quit IRC01:17
*** grue_pm has joined #openstack-infra01:17
*** hichtakk has quit IRC01:18
*** hichtakk has joined #openstack-infra01:18
*** adalbas has quit IRC01:19
*** andreykurilin_ has joined #openstack-infra01:19
fungiwe have the biggest black prelit tree i could find, painstakingly re-bulbed with all purple lights01:19
dstufftnow they are asking me if I know where the smoke machine is01:20
dstufftfungi: a black tree would be great01:20
*** ddieterly has quit IRC01:21
jogosigmavirus24_awa: just tried your patch, very neat01:23
*** sdake has quit IRC01:24
*** dims has joined #openstack-infra01:28
*** cdent has quit IRC01:30
*** andreykurilin_ has quit IRC01:32
*** salv-orlando has joined #openstack-infra01:32
*** dims has quit IRC01:34
anteayadstufft: where you you get a zebra skirt01:39
anteayaI'm feeling like spruce is all out of place01:39
dstufftanteaya: It's actually a blanket for a bed I think, but we use it as a skirt01:40
anteayaah okay01:40
*** grue_pm has quit IRC01:40
anteayawhen I am inclined to tree I just go spruce or balsam01:40
*** grue_pm has joined #openstack-infra01:40
anteayahead outside, knock something down, done01:41
dstufftI haven't had a real tree in like 10 years01:41
anteayawow01:41
anteayathe smell is what I like01:41
anteayacleaning up the needles is tons of fun too01:41
anteayanot sure how I would deal with a pink tree and a smoke machine01:41
dstufftthis house isn't big enough for a big tree01:42
*** marcusvrn has quit IRC01:42
*** grue_pm has left #openstack-infra01:43
dstufftmy child hood house was though01:43
dstufftwe cut it down and the whole 9 yards01:43
*** grue_pm has joined #openstack-infra01:43
anteayathe tree I hope01:44
*** otter768 has quit IRC01:44
anteayayeah we would make a day of it01:44
anteayain high school my brother and I would spend the day getting the old snowmachines working01:45
anteayadrive around in circles in the fields for a few hours01:45
anteayathen cut a tree, drag it behind the snowmachine round about dark01:45
*** melwitt has quit IRC01:45
dstufftI used to have a big sheet of plywood that I had a model railroad tracks nailed down on, and it was sprayed with fake snow and such for the base01:45
dstufftdunno if my parents still have it01:46
anteayaput the machines away, eat dinner with our grandparents and head home01:46
anteayadstufft: sounds awesome01:46
*** marcusvrn has joined #openstack-infra01:47
dstufftI remember being blown out of my mind when we went to a tree farm that has the machine that drills a hole in the base of the tree01:47
dstufftthose hole in the tree things are so much better than the screws for standing up a tree01:47
anteayaI don't know what you are talking about01:47
anteayawe just nailed a circle of plywood to the base and stood the whole business up in a plastic 5 gallon pail and added rocks01:48
anteayaI have never seen a machine that drills a hole in the base of the tree01:48
dstufftanteaya: it's a hole, drilled in the bottom of the tree, the tree farm levels the tree out and drills a hole in it, then you get a stand like this -> https://cdn.shopify.com/s/files/1/0194/1253/products/standstrait_1024x1024.jpg?v=1353464744 which has a big spike in it01:49
dstufftyou just stick the tree on the spike and it's leveled and all that for you01:49
anteayacool01:50
*** grue_pm has left #openstack-infra01:50
anteayaand makes sense01:50
*** grue_pm has joined #openstack-infra01:50
anteayaso did you pick your own tree at the tree farm?01:50
dstufftya01:50
dstufftwent and cut them01:50
anteayanice01:51
anteayaspruce?01:51
dstufftthen just took em to the people there and they put the hole in it and sent it through the baler to wrap string around it to bind it tight so that it was easier to move01:51
anteayanice01:51
dstufftyea I believe they were spruce01:52
*** bdpayne has quit IRC01:52
anteayaspruce has pointy needles and when you pick one you can roll it around between your fingers01:52
anteayabalsam has flat needles, you can't roll them, and the are not pointy01:52
anteayawrapping your hand around a balsam branch doesn't hurt01:52
dstufftyea it was spruce then01:53
anteayacool01:53
anteayaI like them both01:53
anteayabut I slightly favour spruce01:53
jogoafter https://review.openstack.org/#/c/143504/ land are things working again?01:54
dstufftjogo: I think there's a similar patch for master01:54
dstufftthat can't land until that lands01:54
*** harlowja has quit IRC01:54
dstuffthttps://review.openstack.org/#/c/143501/01:54
jogoahh thanks01:55
anteaya"that can't land until that lands" I want that on a shirt01:55
jogoanteaya: hehe01:56
*** grue_pm has quit IRC01:57
*** grue_pm has joined #openstack-infra01:58
*** markmcclain has quit IRC01:59
anteayayeah, I too want to hear how excited zaro's wife is about the storyboard plugin02:01
krotscheckUrm what?02:01
* krotscheck is missing context.02:01
anteayaha ha ha02:02
anteayabackscroll02:02
anteayait is better than if i try to explain02:02
anteayahave the -dev ml handy while you read02:02
krotscheckanteaya: I… uh… know what? That didn’t help much02:02
*** markmcclain has joined #openstack-infra02:03
*** koolhead17 has joined #openstack-infra02:04
*** stevemar has joined #openstack-infra02:04
anteayazaro posted to the ml about the gerrit plugin for storyboard02:07
anteayaI said nice christmas present02:07
anteayahe said he was hoping for the same response from his wife02:07
anteayaand fungi was surprised zaro's wife is such a big fan of storyboard02:07
*** Masahiro has joined #openstack-infra02:09
*** ZZelle has quit IRC02:11
anteayait loses something in the telling02:11
fungijogo: it's rechecked now and should hopefully pop into the gate as soon as the grenade jobs for it pass02:11
fungijogo: https://review.openstack.org/14350102:11
* fungi disappears again02:11
*** Masahiro has quit IRC02:13
*** ddieterly has joined #openstack-infra02:14
*** camunoz has joined #openstack-infra02:17
*** ddieterly has quit IRC02:19
*** signed8bit_ZZZzz is now known as signed8bit02:20
*** ddieterly has joined #openstack-infra02:26
*** baoli has quit IRC02:27
*** baoli has joined #openstack-infra02:29
*** baoli has quit IRC02:30
*** baoli has joined #openstack-infra02:30
*** ddieterly has quit IRC02:30
*** jerryz has joined #openstack-infra02:33
*** yamahata has joined #openstack-infra02:34
*** yamahata has quit IRC02:34
*** dims has joined #openstack-infra02:34
*** yamahata has joined #openstack-infra02:34
*** yaguang has joined #openstack-infra02:35
*** dims has quit IRC02:39
*** zz_dimtruck is now known as dimtruck02:42
*** Ryan_Lane has quit IRC02:47
*** hdd has quit IRC02:48
*** SumitNaiksatam has joined #openstack-infra02:51
*** jyuso has quit IRC02:54
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Add plugins_info to module registry object.  https://review.openstack.org/13292702:55
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Update 'timeout' wrapper module  https://review.openstack.org/12946702:55
*** teran has quit IRC02:55
*** salv-orlando has quit IRC02:58
*** marcusvrn has quit IRC03:00
*** marcusvrn has joined #openstack-infra03:03
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Add plugins_info to module registry object.  https://review.openstack.org/13292703:04
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Update 'timeout' wrapper module  https://review.openstack.org/12946703:04
*** wuhg has joined #openstack-infra03:11
*** boris-42 has quit IRC03:13
*** mfer has joined #openstack-infra03:15
*** mfer has quit IRC03:20
*** markmcclain has quit IRC03:20
*** Ryan_Lane has joined #openstack-infra03:22
*** ayoung has quit IRC03:23
*** jyuso has joined #openstack-infra03:23
*** ddieterly has joined #openstack-infra03:26
*** spzala has quit IRC03:30
*** ddieterly has quit IRC03:31
*** hichtakk has quit IRC03:33
*** hichtakk has joined #openstack-infra03:33
*** otter768 has joined #openstack-infra03:45
*** Ryan_Lane has quit IRC03:48
*** asettle has quit IRC03:50
*** otter768 has quit IRC03:50
*** marcusvrn has quit IRC03:51
*** marcusvrn has joined #openstack-infra03:55
*** teran has joined #openstack-infra03:56
fungidevstack should be unbroken again. i've rechecked the setuptools 8 stack for pbr now to see if they'll finally merge03:57
*** Masahiro has joined #openstack-infra03:57
*** dannywilson has joined #openstack-infra03:59
*** signed8bit has quit IRC04:00
*** teran has quit IRC04:01
*** Masahiro has quit IRC04:01
*** salv-orlando has joined #openstack-infra04:02
*** asettle has joined #openstack-infra04:03
*** dannywilson has quit IRC04:04
*** dimtruck is now known as zz_dimtruck04:10
*** baoli has quit IRC04:12
jogofungi: nice, time to do some rechecks then04:20
*** otter768 has joined #openstack-infra04:24
*** patrickeast has quit IRC04:25
*** ddieterly has joined #openstack-infra04:26
*** hdd has joined #openstack-infra04:27
*** armax has quit IRC04:27
*** ddieterly has quit IRC04:30
*** mbacchi has quit IRC04:35
*** stevemar has quit IRC04:40
*** stevemar has joined #openstack-infra04:41
*** mtanino has quit IRC04:41
dougwigfor job in ALL_JOBS_IN_GERRIT():  "recheck"04:46
dougwig:)04:46
*** hichtakk has quit IRC04:51
jogodougwig:  I think its for job in https://review.openstack.org/#/q/is:open+label:Workflow%253E%253D1+label:verified%253C%253D0%252Cjenkins+age:2hour,n,z04:51
*** teran has joined #openstack-infra04:57
*** yamahata has quit IRC04:58
*** hichtakk has joined #openstack-infra05:00
*** devanand1 is now known as devananda05:00
*** teran has quit IRC05:02
*** hichtakk has quit IRC05:03
*** garyh has quit IRC05:09
*** gpocentek has quit IRC05:10
*** mfink- has quit IRC05:15
*** mfink_ has joined #openstack-infra05:16
*** ddieterly has joined #openstack-infra05:17
*** erlon_ has quit IRC05:19
*** ddieterly has quit IRC05:22
*** salv-orlando has quit IRC05:32
*** pcrews has quit IRC05:42
*** adriant has quit IRC05:44
*** yfried has quit IRC05:44
*** Masahiro has joined #openstack-infra05:46
*** achanda has joined #openstack-infra05:50
*** Masahiro has quit IRC05:51
*** wuhg has quit IRC05:53
*** sputnik13 has joined #openstack-infra05:59
*** achanda has quit IRC06:02
*** marcusvrn has quit IRC06:03
*** achanda has joined #openstack-infra06:07
*** marcusvrn has joined #openstack-infra06:08
*** hichtakk has joined #openstack-infra06:15
*** garyk has joined #openstack-infra06:16
*** stevemar has quit IRC06:20
*** achanda has quit IRC06:26
*** hdd has quit IRC06:36
*** hdd has joined #openstack-infra06:36
*** yfried has joined #openstack-infra06:39
*** koolhead17 has quit IRC06:43
*** denis_makogon has quit IRC06:50
*** denis_makogon has joined #openstack-infra06:50
*** vponomaryov has quit IRC06:51
*** vponomaryov has joined #openstack-infra06:51
*** camunoz has quit IRC06:56
openstackgerritAlice Ferrazzi proposed openstack-infra/lodgeit: Install pillow instead of PIL  https://review.openstack.org/12889506:57
*** hdd has quit IRC06:58
*** otter768 has quit IRC06:58
*** Masahiro has joined #openstack-infra07:01
*** HeOS has quit IRC07:04
*** k4n0 has joined #openstack-infra07:07
*** salv-orlando has joined #openstack-infra07:17
*** jamielennox is now known as jamielennox|away07:24
*** mfink_ has quit IRC07:25
*** teran has joined #openstack-infra07:25
*** mfink_ has joined #openstack-infra07:30
*** yamahata has joined #openstack-infra07:37
*** pblaho_ has joined #openstack-infra07:39
*** hichtakk has quit IRC07:41
*** teran_ has joined #openstack-infra07:42
*** teran has quit IRC07:43
*** subscope has joined #openstack-infra07:48
*** salv-orlando has quit IRC07:50
openstackgerritMerged openstack-dev/pbr: Port in git sha changes from 0.10 line  https://review.openstack.org/14293107:50
*** salv-orlando has joined #openstack-infra07:50
*** yamahata has quit IRC07:55
*** teran has joined #openstack-infra07:57
*** pblaho_ has quit IRC07:57
*** yfried is now known as yfried|afk08:00
*** teran_ has quit IRC08:00
*** isaacb has joined #openstack-infra08:01
*** EmilienM|afk is now known as EmilienM08:02
*** hichtakk has joined #openstack-infra08:02
*** garyk has quit IRC08:03
*** jgallard_ has joined #openstack-infra08:05
openstackgerritMerged openstack-dev/pbr: Properly check for git before getting git dir  https://review.openstack.org/14284108:07
openstackgerritMerged openstack-dev/pbr: Move write_pbr_json to avoid issues with nose  https://review.openstack.org/14314608:07
*** yfried|afk is now known as yfried08:08
*** e0ne has joined #openstack-infra08:10
*** Masahiro has quit IRC08:12
*** ttx has quit IRC08:13
*** ttx has joined #openstack-infra08:14
*** ttx has quit IRC08:14
*** ttx has joined #openstack-infra08:14
*** e0ne has quit IRC08:14
*** Longgeek has joined #openstack-infra08:22
*** hichtakk has quit IRC08:23
*** amuller has joined #openstack-infra08:29
*** teran has quit IRC08:30
*** HeOS has joined #openstack-infra08:33
openstackgerritSumit Naiksatam proposed openstack-infra/project-config: Update GBP projects for tarballs, pypi & gerritbot  https://review.openstack.org/14352608:34
*** denis_makogon has quit IRC08:34
*** denis_makogon has joined #openstack-infra08:35
*** Hal_ has joined #openstack-infra08:40
*** yfried is now known as yfried|afk08:40
*** yfried|afk is now known as yfried08:42
*** hichtakk has joined #openstack-infra08:46
*** Ala has joined #openstack-infra08:50
*** jpich has joined #openstack-infra08:51
*** skolekonov has joined #openstack-infra08:53
*** e0ne has joined #openstack-infra08:54
*** e0ne has quit IRC08:55
*** otter768 has joined #openstack-infra08:59
*** yfried is now known as yfried|afk08:59
*** yfried|afk is now known as yfried08:59
anteayaomrim: I am still here for a few minutes if you want to keep working on your tox problem09:01
anteayaif I don't hear a response in 2 minutes I am off to bed09:02
omrimanteaya: I jeust clone a devstack09:02
omrimanteaya: And then I run the tox09:03
anteayaokay great09:03
omrimanteaya: How can I see the tox.ini of the gerrit?09:03
*** otter768 has quit IRC09:03
anteayawell it is the tox.ini that that job uses09:03
anteayawhich is the tox.ini file of the system-config repo09:04
anteayawhich should be the same tox file you are invoking when you run tox within the system-config repo after you have made changes to the third_party.rst file09:04
anteayaomrim: so when you say you clone the devstack and run tox09:05
omrimNow..during the meeting09:05
anteayayou are running tox within the system-config root are you not?09:06
anteayathis is the tox file for system-config09:06
anteayahttp://git.openstack.org/cgit/openstack-infra/system-config/tree/tox.ini09:06
anteayaomrim: sorry are you saying you have another meeting?09:06
omrimanteaya: No I meant during our meeting..:)09:07
anteayaah09:07
anteayawhat directory are you in when you run tox locally?09:08
omrimanteaya: Oh...anteaya I think you figure it out09:09
anteayaI did09:09
anteayaso can you get the expected results from you local tox now?09:09
omrimanteaya: Now I run it with the tox.ini that you sent me ant it failed09:09
anteayawell you should be in the system-config repo and run tox09:10
omrimanteaya: Why there is a different between tox.ini of the devstack to the infra?09:10
anteayaand when you are in the correct repo, tox will find the tox.ini file in that repo09:10
anteayatox will find the tox.ini file of whereever it is and run that09:10
anteayaand system-config is not part of devstack09:11
anteayaso when you tell me you run tox in devstack I am very confused09:11
omrimanteaya: Thanks a lot! have a good night :)09:11
anteayasince to get your tox results for the third_party.rst file you have to be in the system-config repo when you run tox09:11
anteayaomrim: I won't turn down the opportunity to go to bed, I hope you have solved your problem09:12
anteayagood night09:12
anteayaomrim: you are doing good work on your patch, keep it up09:12
* anteaya goes to bed09:12
omrimanteaya: Yes it's make sense my mistake09:12
omrimanteaya: Thanks a lot you are doing a great job too..09:13
*** mfink_ has quit IRC09:13
*** Masahiro has joined #openstack-infra09:13
*** hichtakk has quit IRC09:17
*** garyk has joined #openstack-infra09:17
*** Masahiro has quit IRC09:17
heyonglianteaya, are you still there?09:19
*** yfried is now known as yfried|afk09:20
*** yfried|afk is now known as yfried09:23
*** salv-orlando has quit IRC09:24
heyonglianteaya, don't worry, see you next year.09:24
*** ihrachyshka has joined #openstack-infra09:31
openstackgerritMerged openstack-infra/storyboard: Plugins may now register cron workers.  https://review.openstack.org/12960909:35
*** ildikov has joined #openstack-infra09:36
*** ociuhandu has joined #openstack-infra09:43
openstackgerritomri marcovitch proposed openstack-infra/system-config: Add Third Party FAQ paragraph  https://review.openstack.org/14181709:45
*** dizquierdo has joined #openstack-infra09:54
*** ZZelle has joined #openstack-infra09:56
*** praveenkumar has quit IRC09:56
*** andreykurilin_ has joined #openstack-infra09:57
*** teran has joined #openstack-infra09:58
*** nuritv has joined #openstack-infra10:01
*** salv-orlando has joined #openstack-infra10:01
*** praveenkumar has joined #openstack-infra10:06
*** e0ne has joined #openstack-infra10:08
*** vigneshvar has joined #openstack-infra10:10
*** _nadya_ has joined #openstack-infra10:11
*** abhijeetm has joined #openstack-infra10:12
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: Explain changes and patch sets  https://review.openstack.org/14364410:13
*** yfried is now known as yfried|afk10:14
*** Masahiro has joined #openstack-infra10:14
*** Masahiro has quit IRC10:18
*** EmilienM is now known as EmilienM|afk10:22
*** yfried|afk is now known as yfried10:22
*** sputnik13 has quit IRC10:24
*** yolanda has quit IRC10:29
*** garyk has quit IRC10:33
*** andreykurilin_ has quit IRC10:35
*** yolanda has joined #openstack-infra10:41
*** garyk has joined #openstack-infra10:41
*** yaguang has quit IRC10:41
openstackgerritYair Fried proposed openstack-infra/project-config: Remove large-ops-{stable_branch} gates from tempest  https://review.openstack.org/14364810:44
*** garyk has quit IRC10:52
*** unicell has quit IRC10:56
*** e0ne is now known as e0ne_10:59
*** otter768 has joined #openstack-infra11:00
*** habib has joined #openstack-infra11:04
*** otter768 has quit IRC11:04
*** EmilienM|afk is now known as EmilienM11:07
*** salv-orlando has quit IRC11:08
*** e0ne_ has quit IRC11:09
*** e0ne has joined #openstack-infra11:21
*** _nadya_ has quit IRC11:21
*** jgallard_ has quit IRC11:22
*** habib has quit IRC11:27
*** enikanorov_ has quit IRC11:30
*** rfolco has joined #openstack-infra11:33
*** rfolco has quit IRC11:38
*** e0ne is now known as e0ne_11:45
*** e0ne_ is now known as e0ne11:46
*** dims has joined #openstack-infra11:56
*** andreaf has quit IRC12:00
*** andreaf has joined #openstack-infra12:00
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Bring stackforge/puppet modules to StoryBoard  https://review.openstack.org/14365512:02
*** Masahiro has joined #openstack-infra12:02
*** teran has quit IRC12:05
*** teran has joined #openstack-infra12:07
*** Masahiro has quit IRC12:07
*** garyk has joined #openstack-infra12:07
*** ff has joined #openstack-infra12:07
*** salv-orlando has joined #openstack-infra12:08
*** salv-orlando has quit IRC12:11
*** salv-orlando has joined #openstack-infra12:12
*** e0ne_ has joined #openstack-infra12:15
*** subscope has quit IRC12:20
*** vigneshvar has quit IRC12:24
*** jyuso has quit IRC12:24
*** mwagner_lap has quit IRC12:24
*** annegentle has quit IRC12:24
*** shayneburgess has quit IRC12:24
*** rkukura has quit IRC12:24
*** dims has quit IRC12:24
*** jpich has quit IRC12:24
*** yfried has quit IRC12:24
*** asettle has quit IRC12:24
*** pabelanger has quit IRC12:24
*** krtaylor has quit IRC12:24
*** vhoward has quit IRC12:24
*** sc68cal has quit IRC12:24
*** tchaypo has quit IRC12:24
*** zhiyan has quit IRC12:24
*** gus has quit IRC12:24
*** cloudnull has quit IRC12:24
*** StevenK has quit IRC12:24
*** sweston has quit IRC12:24
*** vishy has quit IRC12:24
*** dougwig has quit IRC12:24
*** zz_zz_zz_zz_zz_z has quit IRC12:24
*** masayukig has quit IRC12:24
*** zigo has quit IRC12:24
*** jamielennox|away has quit IRC12:24
*** erw_ has quit IRC12:24
*** briancline has quit IRC12:24
*** hogepodge has quit IRC12:24
*** freyes has quit IRC12:24
*** mattoliverau has quit IRC12:24
*** Guest7756 has quit IRC12:24
*** erikmwilson has quit IRC12:24
*** Adri2000 has quit IRC12:24
*** Hunner has quit IRC12:24
*** yolanda has quit IRC12:24
*** notmyname has quit IRC12:24
*** xianghui has quit IRC12:24
*** dansmith has quit IRC12:24
*** tteggel_ has quit IRC12:24
*** alazarev has quit IRC12:24
*** hyakuhei_ has quit IRC12:24
*** gothicmindfood has quit IRC12:24
*** dkehn has quit IRC12:24
*** juice has quit IRC12:24
*** LinuxJedi has quit IRC12:24
*** ianw has quit IRC12:24
*** jesusaurus has quit IRC12:24
*** dkliban_afk has quit IRC12:24
*** e0ne has quit IRC12:24
*** denis_makogon has quit IRC12:24
*** Longgeek has quit IRC12:24
*** Daviey has quit IRC12:24
*** mfink has quit IRC12:24
*** dtantsur has quit IRC12:24
*** maurosr has quit IRC12:24
*** jraim has quit IRC12:24
*** kevinbenton_ has quit IRC12:24
*** BobBall_Xmas has quit IRC12:24
*** rcarrillocruz has quit IRC12:24
*** funzo_ has quit IRC12:24
*** hamzy_vacation has quit IRC12:24
*** primeministerp has quit IRC12:24
*** doude_ has quit IRC12:24
*** dhp has quit IRC12:24
*** dstufft has quit IRC12:24
*** gingerjiang has quit IRC12:24
*** dteselkin has quit IRC12:24
*** NikitaKonovalov has quit IRC12:24
*** ruhe has quit IRC12:24
*** zul has quit IRC12:24
*** andreaf_ has quit IRC12:24
*** HeOS_ has quit IRC12:24
*** davidlenwell has quit IRC12:24
*** Apsu has quit IRC12:24
*** antonym has quit IRC12:24
*** eikke has quit IRC12:24
*** SpamapS has quit IRC12:24
*** EntropyWorks has quit IRC12:24
*** amuller has quit IRC12:24
*** jerryz has quit IRC12:24
*** Mmike has quit IRC12:24
*** redrobot_away has quit IRC12:24
*** sressot has quit IRC12:24
*** mugsie has quit IRC12:24
*** gnuoy has quit IRC12:24
*** JoshNang has quit IRC12:24
*** vladan has quit IRC12:24
*** jokke_ has quit IRC12:24
*** alaski has quit IRC12:24
*** jhesketh has quit IRC12:24
*** paul-- has quit IRC12:24
*** vigneshvar has joined #openstack-infra12:25
*** jyuso has joined #openstack-infra12:25
*** annegentle has joined #openstack-infra12:25
*** mwagner_lap has joined #openstack-infra12:25
*** shayneburgess has joined #openstack-infra12:25
*** rkukura has joined #openstack-infra12:25
*** dims has joined #openstack-infra12:26
*** jpich has joined #openstack-infra12:26
*** yfried has joined #openstack-infra12:26
*** asettle has joined #openstack-infra12:26
*** pabelanger has joined #openstack-infra12:26
*** krtaylor has joined #openstack-infra12:26
*** vhoward has joined #openstack-infra12:26
*** sc68cal has joined #openstack-infra12:26
*** tchaypo has joined #openstack-infra12:26
*** zhiyan has joined #openstack-infra12:26
*** gus has joined #openstack-infra12:26
*** cloudnull has joined #openstack-infra12:26
*** StevenK has joined #openstack-infra12:26
*** vishy has joined #openstack-infra12:26
*** sweston has joined #openstack-infra12:26
*** dougwig has joined #openstack-infra12:26
*** zz_zz_zz_zz_zz_z has joined #openstack-infra12:26
*** masayukig has joined #openstack-infra12:26
*** zigo has joined #openstack-infra12:26
*** jamielennox|away has joined #openstack-infra12:26
*** erw_ has joined #openstack-infra12:26
*** freyes has joined #openstack-infra12:26
*** hogepodge has joined #openstack-infra12:26
*** briancline has joined #openstack-infra12:26
*** mattoliverau has joined #openstack-infra12:26
*** Guest7756 has joined #openstack-infra12:26
*** erikmwilson has joined #openstack-infra12:26
*** Adri2000 has joined #openstack-infra12:26
*** Hunner has joined #openstack-infra12:26
*** yolanda has joined #openstack-infra12:26
*** notmyname has joined #openstack-infra12:26
*** xianghui has joined #openstack-infra12:26
*** dansmith has joined #openstack-infra12:26
*** tteggel_ has joined #openstack-infra12:26
*** alazarev has joined #openstack-infra12:26
*** hyakuhei_ has joined #openstack-infra12:26
*** gothicmindfood has joined #openstack-infra12:26
*** dkehn has joined #openstack-infra12:26
*** juice has joined #openstack-infra12:26
*** LinuxJedi has joined #openstack-infra12:26
*** ianw has joined #openstack-infra12:26
*** jesusaurus has joined #openstack-infra12:26
*** dkliban_afk has joined #openstack-infra12:26
*** denis_makogon has joined #openstack-infra12:27
*** Longgeek has joined #openstack-infra12:27
*** eikke has joined #openstack-infra12:27
*** Daviey has joined #openstack-infra12:27
*** mfink has joined #openstack-infra12:27
*** dtantsur has joined #openstack-infra12:27
*** maurosr has joined #openstack-infra12:27
*** jraim has joined #openstack-infra12:27
*** kevinbenton_ has joined #openstack-infra12:27
*** BobBall_Xmas has joined #openstack-infra12:27
*** rcarrillocruz has joined #openstack-infra12:27
*** funzo_ has joined #openstack-infra12:27
*** hamzy_vacation has joined #openstack-infra12:27
*** primeministerp has joined #openstack-infra12:27
*** doude_ has joined #openstack-infra12:27
*** dhp has joined #openstack-infra12:27
*** dstufft has joined #openstack-infra12:27
*** gingerjiang has joined #openstack-infra12:27
*** dteselkin has joined #openstack-infra12:27
*** NikitaKonovalov has joined #openstack-infra12:27
*** ruhe has joined #openstack-infra12:27
*** zul has joined #openstack-infra12:27
*** Apsu has joined #openstack-infra12:27
*** andreaf_ has joined #openstack-infra12:27
*** HeOS_ has joined #openstack-infra12:27
*** EntropyWorks has joined #openstack-infra12:27
*** davidlenwell has joined #openstack-infra12:27
*** antonym has joined #openstack-infra12:27
*** SpamapS has joined #openstack-infra12:27
*** jhesketh has joined #openstack-infra12:27
*** paul-- has joined #openstack-infra12:27
*** mwagner_lap has quit IRC12:28
*** dims has quit IRC12:28
*** ddieterly has joined #openstack-infra12:28
*** amuller has joined #openstack-infra12:28
*** jerryz has joined #openstack-infra12:28
*** Mmike has joined #openstack-infra12:28
*** redrobot_away has joined #openstack-infra12:28
*** sressot has joined #openstack-infra12:28
*** mugsie has joined #openstack-infra12:28
*** gnuoy has joined #openstack-infra12:28
*** JoshNang has joined #openstack-infra12:28
*** vladan has joined #openstack-infra12:28
*** jokke_ has joined #openstack-infra12:28
*** alaski has joined #openstack-infra12:28
*** alexpilotti has joined #openstack-infra12:32
*** andreaf has quit IRC12:33
*** koolhead17 has joined #openstack-infra12:34
*** andreaf has joined #openstack-infra12:34
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Bring stackforge/puppet modules to StoryBoard  https://review.openstack.org/14365512:39
*** yfried is now known as yfried|afk12:39
*** _nadya_ has joined #openstack-infra12:40
*** baoli has joined #openstack-infra12:41
*** baoli has quit IRC12:42
*** baoli has joined #openstack-infra12:43
*** koolhead17 has quit IRC12:45
*** dims has joined #openstack-infra12:51
*** jerryz is now known as jerryz_12:53
*** jerryz_ is now known as jerryz12:53
*** yfried|afk is now known as yfried12:54
*** amuller has quit IRC13:00
*** otter768 has joined #openstack-infra13:00
*** Masahiro has joined #openstack-infra13:03
*** unicell has joined #openstack-infra13:04
*** dkliban_afk is now known as dkliban13:05
*** yfried is now known as yfried|afk13:05
*** otter768 has quit IRC13:05
*** fandi has joined #openstack-infra13:06
*** isaacb has quit IRC13:06
*** Masahiro has quit IRC13:07
*** ff has quit IRC13:09
*** mbacchi has joined #openstack-infra13:14
openstackgerritMerged openstack-infra/subunit2sql: Add a db api method to extract run_times for a single test  https://review.openstack.org/14230913:14
*** derekh has joined #openstack-infra13:15
*** mwagner_lap has joined #openstack-infra13:16
*** bswartz has quit IRC13:20
*** jgallard_ has joined #openstack-infra13:21
*** mika has quit IRC13:24
*** yfried|afk is now known as yfried13:24
*** vigneshvar has quit IRC13:24
*** alexpilotti has quit IRC13:25
*** spzala has joined #openstack-infra13:26
*** isaacb has joined #openstack-infra13:26
*** e0ne has joined #openstack-infra13:28
*** e0ne_ has quit IRC13:30
*** bhunter71 has quit IRC13:32
*** mase_x200 has joined #openstack-infra13:33
*** kgiusti has joined #openstack-infra13:33
*** pblaho_ has joined #openstack-infra13:35
*** mfink has quit IRC13:35
*** dprince has joined #openstack-infra13:36
*** garyk has quit IRC13:36
*** ryanpetrello has joined #openstack-infra13:37
*** garyk has joined #openstack-infra13:37
*** andreykurilin_ has joined #openstack-infra13:38
openstackgerritDenis M. proposed openstack/requirements: Add aioeventlet dependency  https://review.openstack.org/13875013:38
*** andreykurilin_ has quit IRC13:39
*** ayoung has joined #openstack-infra13:41
*** wuhg has joined #openstack-infra13:50
*** mase_x200 has quit IRC13:55
openstackgerritThierry Carrez proposed openstack-infra/release-tools: Use PEP440 normalized versions  https://review.openstack.org/14303913:57
derekhAre CI jobs having trouble with pip 6.0.X ? Having trouble in tripleo jobs and wondering if its happening in other places http://logs.openstack.org/17/98817/11/check-tripleo/check-tripleo-ironic-overcloud-f20-nonha/ae39aa3/console.html#_2014-12-23_08_13_33_10013:57
*** bswartz has joined #openstack-infra13:59
*** mfink has joined #openstack-infra13:59
ashpderekh: we had similar troubles at work yesterday with pbr14:00
ashpI wasn't involved in it but I saw lots of pip 6.x talk14:00
derekhashp: ok, thanks14:01
ashpi think the solution was to wait for upstream, aka you, to fix it :D14:01
ashpderekh: https://www.youtube.com/watch?v=JYc05gZFly014:02
derekhashp: lol, will see if I can figure out whats going on14:02
*** Ala has quit IRC14:02
*** mfer has joined #openstack-infra14:04
ashpgood luck! I think we ended up pinning on 5.x for now as it was a pain14:04
*** Ala has joined #openstack-infra14:04
*** mfer has quit IRC14:05
*** yfried is now known as yfried|afk14:05
*** abhijeetm has left #openstack-infra14:06
*** mfer has joined #openstack-infra14:06
*** mfer has quit IRC14:08
dstufftderekh: in pip 6 / setuptools 8 the meaning of specifiers changed in some ways14:10
*** mfer has joined #openstack-infra14:10
fungiderekh: ashp: that error indicates that ceilometer needs to approve their requirements sync change14:10
dstufftone of that ways is instead of a confusing and mostly incomprehensible meaning of what , means, it changes it so that , means AND14:10
fungiderekh: ashp: that sqlalchemy version specifier is not pep 440 compliant, and all the equivalents in the openstack/requirements repo have been fixed for weeks14:11
derekhdstufft: fungi: ok, I'll got poke ceilometer14:11
*** redixin has joined #openstack-infra14:13
dstufftfungi: techincally the specifier is compliant, it's just nonsense because it's impossible to have a version which satisfies all the constraints </pedant>14:14
ashpoh our issue might have been different then fungi, i just heard pip 6 and issues and assumed it was the same14:14
fungiashp: yeah, at this point i think we have all the setuptools 8/pip 6/virtualenv 12 issues we were seeing solved14:16
fungiafter a slew of changes to devstack and pbr in particular14:17
*** cdent has joined #openstack-infra14:17
*** cnesa has joined #openstack-infra14:25
*** yfried|afk is now known as yfried14:26
*** amuller has joined #openstack-infra14:28
*** ddieterly has quit IRC14:30
*** ddieterly has joined #openstack-infra14:31
*** baoli has quit IRC14:33
*** imcsk8 has quit IRC14:34
*** imcsk8 has joined #openstack-infra14:34
*** ddieterly has quit IRC14:35
*** yfried is now known as yfried|afk14:36
*** darvon has quit IRC14:37
*** ryanpetrello has quit IRC14:37
*** darvon has joined #openstack-infra14:37
*** baoli has joined #openstack-infra14:38
*** ryanpetrello has joined #openstack-infra14:40
*** dkranz has joined #openstack-infra14:40
*** yfried|afk is now known as yfried14:40
*** _nadya_ has quit IRC14:42
openstackgerritAleksey proposed openstack-infra/storyboard: Team and project groups delete methods  https://review.openstack.org/14367514:42
*** mfink_ has joined #openstack-infra14:44
openstackgerritAleksey proposed openstack-infra/storyboard: Team and project groups delete methods  https://review.openstack.org/14367514:44
*** radez_g0n3 is now known as radez14:44
EmilienMfungi: are you familiar with storyboard?14:46
EmilienMfungi:  If I want to add stackforge/puppet projects in StoryBoard, I just have to update project-config - gerrit/projects.yml with use-storyboard: true for the projects?14:46
EmilienMI tried something: https://review.openstack.org/14365514:47
EmilienMI know you guys are using it, but not much doc on it yet14:47
*** enikanorov has joined #openstack-infra14:50
*** yfried is now known as yfried|afk14:51
*** Masahiro has joined #openstack-infra14:52
*** mfer has quit IRC14:56
*** Masahiro has quit IRC14:56
*** yfried|afk is now known as yfried14:58
dteselkinHi! Have you faced an issue when console logs from Jenkins jobs partially copied to node with logs?14:59
dteselkinThat occurs not for every job, though14:59
*** otter768 has joined #openstack-infra15:01
fungiEmilienM: right now we've only put infra projects on storyboard, mostly as an incentive to our developers to report on storyboard's shortcomings/needed features and as an incentive to work on fixing them. it's still missing features you probably expect in a general issue tracker15:03
*** dmsimard_away is now known as dmsimard15:04
EmilienMfungi: I was about setting up a Trello board for our project15:04
EmilienMand sbadia suggested storyboard15:04
*** ryanpetrello has quit IRC15:05
fungiEmilienM: searching is limited, there's no e-mail functionality, no integration with our code review system yet, et cetera15:05
EmilienMoh15:05
*** amitgandhinz has joined #openstack-infra15:06
*** teran has quit IRC15:06
*** otter768 has quit IRC15:06
EmilienMfungi: so you mean it's too early stage for our needs, right now?15:06
fungiEmilienM: also no client library for the api yet15:07
EmilienMfungi: fair enough15:07
*** teran has joined #openstack-infra15:07
fungiEmilienM: yeah, it's still in the early stages. we're actively discouraging random projects from using it yet unless their going to be working on tackling the work needed to implement the missing parts15:08
fungis/their/they're/15:08
EmilienMfungi: I would appreciate if you could put your words in the review15:08
EmilienMbecause people from Puppet community is not reading this channel, but they will see the review15:08
EmilienMfungi: thanks a lot for your inputs, I was doing wrong here15:09
fungiEmilienM: sure. luckily gertty works from the car. gerrit's web interface is a bit laggy over wireless modem15:09
fungii'll see what i can do to summarize in a review comment15:09
EmilienMfungi: I use gerrty every day15:09
EmilienMgertty*15:09
fungibest...thing...evar15:09
EmilienMahah15:09
EmilienMvery useful when I do Montreal <-> Paris15:10
*** ddieterly has joined #openstack-infra15:10
*** sigmavirus24_awa is now known as sigmavirus2415:16
sigmavirus24jogo glad you like it15:19
*** _nadya_ has joined #openstack-infra15:21
*** jerryz has quit IRC15:24
openstackgerritSylvain Bauza proposed openstack-infra/elastic-recheck: Add query for Tempest bug 1405204  https://review.openstack.org/14368115:25
uvirtbotLaunchpad bug 1405204 in tempest "SSH times out when trying to validate Tempest authentication" [Undecided,New] https://launchpad.net/bugs/140520415:25
*** k4n0 has quit IRC15:25
openstackgerritYair Fried proposed openstack-infra/project-config: Remove large-ops-{stable_branch} from tempest gate  https://review.openstack.org/14364815:25
*** hdd has joined #openstack-infra15:26
*** _nadya_ has quit IRC15:26
*** tonytan4ever has joined #openstack-infra15:26
*** mjturek has joined #openstack-infra15:27
*** lttrl has quit IRC15:28
jaypipesjeblair: so... I was able to figure out a solution for the 401 Unauthorized problem in gertty. :)15:29
*** dims has quit IRC15:30
*** ihrachyshka has quit IRC15:31
openstackgerritMerged openstack-dev/pbr: Merge tag '0.10.3' into master  https://review.openstack.org/14332515:31
jaypipesjeblair: instead of re-using a requests.Session object in between calls to sync.get|post|put, I modified the code to create a new session for each call. Seems much more stable now (been running uninterrupted for >2 hours now) but a little slower of course. Would you be opposed to me adding a conf option to toggle the "new session for each HTTP call" behaviour?15:31
jaypipesjeblair: oh, and in case you're wondering, I did try setting session.keep_alive = False, but it had no effect.15:31
*** isaacb has quit IRC15:32
*** ryanpetrello has joined #openstack-infra15:33
*** baoli has quit IRC15:33
*** FlorianSW has joined #openstack-infra15:35
*** achanda has joined #openstack-infra15:36
jeblairjaypipes: hrm; i still haven't had time to get fully up to speed on this, but istr i wrote it like that originally and then someone had a good reason for making the change to reuse it15:39
*** jerryz has joined #openstack-infra15:39
anteayafungi: this might be the same chap who had difficulty with the multiple gerrit accounts, in any case he would like to run glusterfs on our nodes: https://review.openstack.org/#/c/143309/15:40
anteayafungi: do we know if it is possible to do so?15:40
*** ddieterl_ has joined #openstack-infra15:41
anteayaI'll also ask in cinder to find out if they are aware of this proposed addition15:41
*** ddieterly has quit IRC15:41
jeblairjaypipes: i don't see "No JSON object could be decoded" in my .gertty.log (running for 11 days)15:44
jaypipesjeblair: yeah, I don't know if it's something to do with the particular projects I'm subscribed to, or something particular to my setup :(15:45
mtreinishanteaya: none of the support for doing that has landed anywhere yet: https://review.openstack.org/133102 and https://review.openstack.org/#/c/143308/115:45
mtreinishanteaya: so it's probably a bit premature to discuss adding a job for it.15:46
jaypipesjeblair: but I assure you, it happens on the hour when using the stock gertty :)15:46
anteayamtreinish: do we have any expectation the support will land?15:46
*** pblaho_ has quit IRC15:46
*** ryanpetrello has quit IRC15:47
dstufftfungi: is the pip 6 + setuptools 8 stack holding up now? Nothing new that needs addressed?15:47
mtreinishanteaya: no I'm not sure, sdague had strongish objections to the devstack patch before. Definitely not until after the holidays at least15:47
anteayaand dtroyer is also not in favour15:47
anteayaas there is a qa spec up outlining a plug in approach15:48
fungidstufft: i think just someone needs to review/approve https://review.openstack.org/14232015:48
clarkbfungi I will do that shortly15:49
fungiclarkb: thanks15:49
dstufftah cool15:50
dstufftI don't have +2 power on that so ;D15:50
jeblairanteaya, mtreinish: however, configuring the job to run experimentally on the devstack and devstack-gate repos may be worth doing so that the changes to devstack and devstack-gate can be tested.  if you want to do that i would suggest...15:51
jeblairanteaya, mtreinish: not adding it to the integrated-gate template, but rather just to those specific projects; and additing it with a note of who is working on it, and a deadline for when it should either be finished or removed.15:52
jeblair(i will put that in the project-config review)15:52
openstackgerritMerged openstack-dev/pbr: Merge tag '0.10.4' into master  https://review.openstack.org/14332615:53
openstackgerritMerged openstack-dev/pbr: Merge tag '0.10.5' into master  https://review.openstack.org/14332715:53
openstackgerritMerged openstack-dev/pbr: Merge tag '0.10.6' into master  https://review.openstack.org/14332815:53
dstufftdem merges15:53
anteayajeblair: ah wonderful thank you, I had just finished commenting15:53
*** reed has joined #openstack-infra15:54
anteayajeblair: so you are advising I lift my -215:54
jeblairanteaya: yes, and i am surprised you would -2 that in the first place.  that's rather strong.15:54
anteayaokay15:55
anteayathat was the sense I got from mtreinish comments and the comments on the other patches15:55
jeblairanteaya: i did not get the sense that "people are opposed to this and it must never merge"15:56
anteayaoh, that was what I read from dtroyers comments15:56
anteayaperhaps I read his comments incorrectly15:56
jeblairanteaya: dtroyer said he wanted it to use plugins15:57
*** zz_dimtruck is now known as dimtruck15:57
* dtroyer wakes up15:57
anteayayes15:57
anteayadtroyer: I'm using your name in vain do stop me15:57
jeblairanteaya: that is not the same as dtroyer does not think glusterfs should ever be tested15:57
anteayatrue15:58
dtroyeryes, we want the gluster review to be the first to use the extended plugin where the devstack code is not in the devstack repo…sdague is still working on that...15:58
dtroyerI'm neutral on testing it, I don't want it in the devstack repo15:58
dtroyerceph either fwiw, I'll propose we change it to the same thing when this is working15:58
*** pcrews has joined #openstack-infra15:59
anteayaso does the approach for whether it is in devstack or accessed via a plugin change this patch? https://review.openstack.org/#/c/143309/15:59
jeblairanteaya: at any rate, there's a chicken and egg situation with some of these jobs, where it can be quite difficult to ensure that the associated changes are working correctly.  in these cases it's often helpful to configure the jobs to run before those changes land so that the changes are self-testing15:59
anteayaoh I didn't know that15:59
anteayaas I have been operating on the belief that the changes should be expected to work by the time the job lands15:59
anteayaso that is a new piece of information for me16:00
anteayathank you16:00
clarkbfungi: did we revert the devstack setuptools pin on icehouse and juno too? Probably less urgent do to those16:00
jeblairanteaya: the experimental pipeline is specifically to help get new jobs into shape16:00
anteayajeblair: so for an experimental job it is fine if the first piece is the job in the experimental pipeline and nothing else exists?16:01
jeblairanteaya: regarding 143309, my proposal is that if the change were going into devstack, 309 should only enable it for the devstack (and perhaps devstack-gate repo), so it would at least need to change for that.  if it's not going into devstack, then presumably it would need to be enabled for the cinder repo instead.  so yes, it may still be too early to merge 309 in any form16:02
anteayaokay thanks for clearing that up, and I appreciate you taking the time to teach me16:02
anteayasaves me continuing to make mistakes16:02
jeblairanteaya: and yes, it is okay for it to be the first piece.  however, it should be balanced with whether it's desirable to run that job (if people -2 devstack patches with "we will never test this!" then probably not worth it), and also making sure that we don't end up with a bunch of orphaned jobs no one cares about (thus my suggestion about adding comments in the files with names/deadlines)16:03
*** markmcclain has joined #openstack-infra16:04
openstackgerritMerged openstack-infra/system-config: Revert "Pin version of setuptools"  https://review.openstack.org/14232016:05
anteayaright the piece about orphaned jobs is important (andreas the house cleaner would be unhappy) also I noticed you had an item up about the procedural -2 on the meeting last week16:05
anteayaI am hoping we can get to it this week16:05
anteayaI have been using -2 as a process for ensuring things don't get merged before other pieces are in place, either code or agreements16:06
anteayaand I look forward to learning how to use that better and more in alignment with expectations16:06
anteayaas it appears I am not there yet16:06
jeblairjaypipes: i believe you :)  i'm still kind of stumped16:06
jeblairanteaya: you have to be careful with that; if you are on vacation, other people can't remove your -216:07
jaypipesjeblair: :) hehe, yeah, I am too. I've been looking into oepnstackclient's use of requests, along with keystoneclient.Session usage of requests to try and see if there's something I'm missing... no luck yet :)16:07
jeblairjaypipes: i see a handful of these: ProtocolError: ('Connection aborted.', BadStatusLine("''",))16:08
jeblairjaypipes: in my log, and some dns errors from yesterday during the rax ddos, but nothing in the form you quoted16:08
jaypipesjeblair: those are from requests logging, IIRC. I saw those too, but didn't think much of them.16:08
jaypipesjeblair: and they didn't happen on the hour mark, like this Unauthorized thing does.16:09
jeblairjaypipes: so you figure, based on your additional local code/testing, that when you get the 401, your session object is hosed and must be replaced?  or does it ever recover on its own?16:09
anteayajeblair: right16:09
jeblairjaypipes: when you say 'the hour mark', you mean elapsed time, right?  not wall-clock time?16:09
jaypipesjeblair: yes, the session object is hosed. I tried to reset the session object by doing self.session = requests.Session() but that didn't work. and yes, elapsed time from starting gertty.16:10
jeblairjaypipes: didn't you just propose resetting the session for each call as a solution?  are you saying that that works as long as you do it _before_ the 401, but after the 401, even that is not helpful?16:11
*** e0ne is now known as e0ne_16:11
*** e0ne_ is now known as e0ne16:12
*** Ala has quit IRC16:12
jaypipesjeblair: sorry, I was unclear... I was referring to a previous attempt at a solution that, upon getting a 401 Unauthorized, I would "reset" the session object and retry the same HTTP call. But that did not work. However, a solution that simply creates a brand new session object for each HTTP call does work... very odd.16:13
jeblairjaypipes: yeah, it's hard for me to see how those would produce different behavior16:14
jaypipesjeblair: I know, right? :)16:14
* dtroyer speculates wildly16:15
dtroyeris that auth cookie based?16:15
dtroyeris the session reset not clearing cookies maybe?16:15
jaypipesdtroyer: https://github.com/stackforge/gertty/blob/master/gertty/sync.py#L909-L914 <-- I put a block around that code there and if I got r.status_code == 401, I re-created the self.session object and retried the session.request() call.16:17
jeblairjaypipes: what version of requests do you have?16:18
sigmavirus24dtroyer: define session reset?16:18
jaypipessigmavirus24: self.session = requests.Session() <-- session reset :)16:19
dtroyersigmavirus24: I was reusing jaypipes word…I think the link he posted is what he meant…16:19
sigmavirus24ah16:19
openstackgerritRamy Asselin proposed openstack-infra/infra-specs: Add optimization opportunities  https://review.openstack.org/14368916:19
sigmavirus24I was going to say, we don't have a Session reset method =P16:19
jaypipessigmavirus24: do you have any idea why after an hour a requests.Session() would return a 401 Unauthorized from Gerrit? If I create a new requests.Session for each HTTP call to gerrit (in gertty), I don't get the 401 Unauthorized. But if I re-used the same session, exactly one hour after makign the first HTTP call with the requests.Session, I will get a 401 from Gerrit. really werid.16:21
jeblairthis should be http digest auth16:22
sigmavirus24jaypipes: if it is digest auth, I suspect you need to reinitialize the auth handler16:23
sigmavirus24The current HTTPDigestAuth handler does not check time and if it's already been used to authenticate continues to use what it has16:23
jeblairso maybe the server has expired the nonce, or otherwise that got out of sync?16:23
sigmavirus24yeah16:23
sigmavirus24that's my best guess16:24
jeblairjaypipes: can you check the requests version you are using?16:24
jeblair(i'm also trying to figure out why i am not seeing this behavior but jaypipes is)16:24
jaypipesjeblair: ah, sure, one sec, sorry missed your query above.16:24
sigmavirus24oh so, we recently improved some behaviour in the Digest Auth handler (in 2.5.0 maybe?)16:24
jeblairsigmavirus24: i'm on 2.4.016:24
sigmavirus24One of 2.4.3 or 2.5.016:24
anteayapleia2: what repo do we have with a 'feature/gearman' branch? I've tried gear and gearman-plugin repos and so far no luck16:25
jaypipesjeblair: 2.5.016:26
sigmavirus24So this is the specific improvement I'm thinking of: https://github.com/kennethreitz/requests/pull/225316:26
sigmavirus24But it only matters when the flow is 401 -> 302 -> 40116:26
anteayaclarkb: what repo has a 'logstash' branch?16:27
sigmavirus24Oh I bet I know what's going on jeblair/jaypipes16:27
openstackgerritJeremy Stanley proposed openstack-dev/pbr: Use unsafe OpenPGP keys for testing  https://review.openstack.org/14288416:28
sigmavirus24jaypipes: can you patch L185 in requests/auth.py and remove the addition taking place on the call to setattr?16:28
jaypipessigmavirus24: I can try that, sure...16:28
sigmavirus24I bet it's not even trying to re-auth and it's skipping the 401 at that point16:28
jaypipessigmavirus24: gimme about one hour and 2 minutes to test :)16:28
jeblairsigmavirus24: do you mean remove the whole line?16:28
sigmavirus24jeblair: no just switch it to setattr(self, 'num_401_calls', 1)16:29
* sigmavirus24 is going to through toegether a PR because I'm pretty sure this is blatantly wrong and my fault. If it works for jaypipes I'll push out 2.5.1 this afternoon16:29
sigmavirus24s/ugh/w/16:29
clarkbanteaya: is there context for that?16:31
jaypipessigmavirus24: so, that line is line 157 in my /usr/local/lib/python2.7/dist-packages/requests/auth.py ...16:31
jaypipessigmavirus24: should I change that one?16:31
*** dims has joined #openstack-infra16:31
jaypipessigmavirus24: sorry, no, line 171 looks like this:16:31
sigmavirus24jaypipes: sorry, you're changing setattr(self, 'num_401_calls', num_401_calls + 1) to setattr(self, 'num_401_calls', 1)16:31
jaypipessigmavirus24:             setattr(self, 'num_401_calls', num_401_calls + 1)16:31
sigmavirus24L19116:31
anteayaclarkb: trying to verify https://review.openstack.org/#/c/143197/16:31
sigmavirus24sorry I read the wrong line number jaypipes16:32
sigmavirus24jaypipes: https://github.com/kennethreitz/requests/pull/2253/files#diff-9f3a95293a5d26032b1c588167760362R19116:32
anteayaclarkb: I'm sure they exist, I would just like to learn where they are coming from16:32
sigmavirus24revert the change on that line16:32
jaypipessigmavirus24: got it. thx.16:32
sigmavirus24jaypipes: you're welcome16:32
clarkbanteaya: I think feature/gearman is zuul. from when zuul grew gearman support. not sure of logstash branch16:32
*** jgallard_ has quit IRC16:33
*** Hal_ has quit IRC16:33
fungiinfra publications repo branches?16:33
anteayaclarkb: I only see the master branch in zuul: http://git.openstack.org/cgit/openstack-infra/zuul/16:33
jaypipessigmavirus24: ok, gertty started. will let you know if all is right in the world after an hour :)16:33
anteayafungi: well there are several publication branches I have verified16:34
anteayaand a 'logstash' branch and a 'feature/gearman' branch I am working on verifying16:34
jeblairsigmavirus24, jaypipes: i know we're past this, but i did confirm that gerrit expires digest tokens after 1 hour.  it's also hardcoded, so i can't easily make it shorter for testing purposes :(.16:34
jaypipesjeblair: oh, that's excellent snooping. good to know! :)16:35
sigmavirus24jeblair: no worries16:35
anteayaI just learned 'debian/sid' branch comes from zuul/packaging16:35
jaypipesjeblair: glad to know I'm not going totally crazy :)16:35
sigmavirus24jeblair: also, I think the HTTPDigestAuth class would otherwise renegotiate a nonce if it weren't buggy16:35
*** dims has quit IRC16:35
sigmavirus24Of course when we tested that behaviour all seemed right with the world but we didn't know about this use case16:36
*** yfried has quit IRC16:37
*** sputnik13 has joined #openstack-infra16:40
jeblairkrotscheck: filed https://storyboard.openstack.org/#!/story/2000092 (posted a comment and had to reload to see it)16:40
*** Masahiro has joined #openstack-infra16:41
*** carl_baldwin has joined #openstack-infra16:41
*** dims has joined #openstack-infra16:41
*** rkukura_ has joined #openstack-infra16:42
sigmavirus24jeblair: jaypipes https://github.com/kennethreitz/requests/pull/238916:43
sigmavirus24Ping me there if this solves your problem16:43
jaypipesk, will do.16:44
*** habib has joined #openstack-infra16:44
*** rkukura has quit IRC16:44
*** rkukura_ is now known as rkukura16:44
*** sabeen has joined #openstack-infra16:45
*** Masahiro has quit IRC16:45
*** _nadya_ has joined #openstack-infra16:46
*** hdd has quit IRC16:46
*** markmcclain has quit IRC16:48
sigmavirus24Also feel free to ping me here or elsewhere about requests related stuff as you need. Just don't bring up the v word because Kenneth won't ever let us change that16:49
*** boris-42 has joined #openstack-infra16:50
*** skolekonov has quit IRC16:50
*** garyk has quit IRC16:51
*** cnesa has quit IRC16:52
*** ChuckC has joined #openstack-infra16:54
*** mriedem has joined #openstack-infra16:57
krotscheckjeblair: Ack16:57
* krotscheck wants to be done with the stupid email thing so he can get back to writing javascript :/16:57
*** sarob has joined #openstack-infra16:58
*** andreaf has quit IRC17:00
*** andreaf has joined #openstack-infra17:00
zaromorning17:00
openstackgerritMerged openstack-infra/project-config: ec2-driver: Added gate checks  https://review.openstack.org/14290817:01
anteayamorning zaro17:02
*** HeOS has quit IRC17:02
anteayaasselin: are you about?17:02
*** otter768 has joined #openstack-infra17:02
anteayaasselin: just wanted to express my concerns about a workflow that hinges on a script which others may or may not be inclined to run17:03
*** cnesa has joined #openstack-infra17:03
anteayaasselin: I just want to ensure we are clear that the spliting out of modules offers the script running on cron as an option not a requirement17:03
anteayacontext: https://review.openstack.org/#/c/143689/1/specs/puppet-modules.rst17:04
*** sarob has quit IRC17:07
*** otter768 has quit IRC17:07
*** sabeen has quit IRC17:07
pleia2anteaya: replied to your comments re: branches17:08
*** sarob has joined #openstack-infra17:08
anteayajeblair clarkb or fungi I'm waiting to hear from a nodepool admin on this patch which enables injection of urls in the xenserver nodepool scripts: https://review.openstack.org/#/c/136700/17:08
anteayapleia2: thanks17:08
*** sarob_ has joined #openstack-infra17:09
clarkbanteaya: we aren't consuming those scripts directly (at least not yet) so should be fine to update that if it comes from the xenserver folks or has been reviewed by them17:09
anteayapleia2: ah sorry, so you didn't add those branches17:09
*** Katherine has quit IRC17:09
anteayaclarkb: great, thanks and jeblair has +2'd17:10
pleia2anteaya: no, they're just reorganized, that's why they show up in the diff17:10
*** e0ne is now known as e0ne_17:10
anteayapleia2: your goal was just to add the publication branches?17:10
pleia2anteaya: only 4 branches were added (they're in the publications list)17:10
anteayaah okay my mistake thanks17:11
anteayaI'll follow in with a patch offering some cleanup17:11
pleia2anteaya: yes, if you look at the first patchset that's all I did, then ajaeger asked me to organize them17:11
anteayasorry I didnt' look17:11
pleia2no worries, thanks for the review :)17:11
*** sarob has quit IRC17:12
*** yfried has joined #openstack-infra17:13
*** dimtruck is now known as zz_dimtruck17:15
*** sarob_ has quit IRC17:16
anteayaasselin: also are you and jesusaurus in co-ordination with his lodgeit module split out and your large patch? https://review.openstack.org/#/c/142917/17:16
*** sweston_ has joined #openstack-infra17:16
*** baoli has joined #openstack-infra17:17
openstackgerritMerged openstack-infra/project-config: XenServer: Enable injection of XVA and ISO urls  https://review.openstack.org/13670017:17
*** sweston is now known as spw17:17
*** sweston_ has quit IRC17:17
*** sweston has joined #openstack-infra17:18
anteayathis patch adds a nodepool script for mtreinish's subunit2sql work, would appreciate some nodepool admin eyes: https://review.openstack.org/#/c/136234/917:19
*** e0ne_ has quit IRC17:20
*** esker has joined #openstack-infra17:20
clarkbmtreinish: anteaya: do we want to call that script from the devstack preparation scripst so that the testreposiroty DBs end up on our devstack test nodes?17:21
openstackgerritMerged openstack-infra/project-config: Add more publications branches to gerritbot  https://review.openstack.org/14319717:22
anteayaclarkb: a good question17:22
openstackgerritThierry Carrez proposed openstack-infra/infra-specs: StoryBoard: story types specification  https://review.openstack.org/12926717:22
*** yfried has quit IRC17:23
*** jpich has quit IRC17:23
mtreinishclarkb: https://review.openstack.org/#/c/142940/17:23
mtreinishI can squash them together I guess17:24
clarkbmtreinish: maybe? I do have a commetn for the second ne though17:24
anteayaoh sorry I had thought you had seen that clarkb17:24
clarkbmtreinish: so that will need to be addressed.17:25
clarkbactually we may accomodate that so nevermind17:25
*** dannywilson has joined #openstack-infra17:25
mtreinishclarkb: ?17:26
clarkbmtreinish: trying to figure out if that should be added to the dib stuff too17:26
mtreinishah, ok17:27
clarkbya I think it should be17:27
*** habib has quit IRC17:27
clarkbI thought maybe that we were running the cache script out of scripts/ for that but we do use dib elements for all of it17:27
mtreinishthe other thing I've thought of is I'll have to update d-g to not use .testrepository/0 anymore as part of the artifact collection17:27
openstackgerritKhai Do proposed stackforge/python-jenkins: Fix cancel_queue() method  https://review.openstack.org/13896417:28
clarkbmtreinish: oh ya, we can just change that to do a sort and grab highest17:28
clarkbor similar17:28
*** sressot has quit IRC17:29
*** thedodd has joined #openstack-infra17:29
mtreinishclarkb: yeah I was probably just gonna switch it to do testr last --subunit > testrepository.subunit I think that should work fine17:29
*** teran has quit IRC17:30
clarkbmtreinish: I commneted on the second change. I think we can leave it unsquahsed and I will review the script itself now17:30
*** teran has joined #openstack-infra17:30
clarkbmtreinish: how is subunit2sql installed on the image build nodes? it is imported by your script but I don't expect it to be available?17:30
mtreinishok, thanks. I'll work on respinning the 2nd one now17:30
*** sressot has joined #openstack-infra17:31
mtreinishoh, that's a good point, I guess i'ts not being installed anywhere17:31
*** e0ne has joined #openstack-infra17:31
openstackgerritAnita Kuno proposed openstack-infra/project-config: Cleanup gerritbot branches reporting to -infra  https://review.openstack.org/14369917:31
anteayapleia2: ^17:32
clarkbmtreinish: commented17:33
*** mwagner_lap has quit IRC17:33
clarkbjeblair: did you happen to restart geard on zuul to deal with the extra logging?17:33
clarkbjeblair: if not I can likely do that today17:33
*** sdake has joined #openstack-infra17:34
*** sdake has quit IRC17:34
*** sdake has joined #openstack-infra17:34
*** sdake_ has joined #openstack-infra17:34
*** sdake_ has quit IRC17:34
*** sdake_ has joined #openstack-infra17:34
*** openstackgerrit has quit IRC17:34
*** openstackgerrit has joined #openstack-infra17:35
jeblairclarkb: i have not.  i'm digging into geard ssl.  it looks like SSL_WANT_READ is actually just masking EAGAIN17:35
pleia2anteaya: thanks, looks like feature/gearman used to be a zuul branch17:35
jeblairclarkb: it's pretty easy for me to restart it, why don't i?17:35
jaypipesjeblair, sigmavirus24: \o/ it's been >1 hour and no errors in my log. looks like that one liner change worked.17:36
*** sdake is now known as steak17:36
jeblairjaypipes: woo!17:36
jaypipesjeblair: I'll submit a patch that bumps requests requirement to 2.5.1.17:36
jaypipesjeblair: once sigmavirus24 releases it :)17:36
jeblairjaypipes: hopefully that patch is self-testing ;)17:36
sigmavirus24heh17:37
jaypipesjeblair: indeed.17:37
*** koolhead17 has joined #openstack-infra17:37
jeblairactually, heh, it has absolutely no tests, so even that isn't self-testing.  :)17:38
*** adalbas has joined #openstack-infra17:38
*** jerryz has quit IRC17:38
*** fandi has quit IRC17:39
*** cnesa has quit IRC17:39
*** cnesa has joined #openstack-infra17:40
*** hichtakk has joined #openstack-infra17:41
clarkbjeblair go for it17:41
*** amuller has quit IRC17:41
anteayapleia2: ah17:42
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Use prepare_tempest_testrepository as part of devstack node script  https://review.openstack.org/14294017:43
mtreinishclarkb: ^^^ I'm not sure that's right17:43
anteayapleia2: how do you see a branch that used to exist?17:43
*** derekh has quit IRC17:43
pleia2anteaya: some google searching and some assumptions17:44
pleia2led me to find some patches in zuul against that branch in gerrit17:44
*** SumitNaiksatam has quit IRC17:45
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: Explain changes and patch sets  https://review.openstack.org/14364417:47
anteayapleia2: not that important, just a passing curiosity17:47
*** stevemar has joined #openstack-infra17:47
jeblairrestarting geard17:49
*** fandi has joined #openstack-infra17:49
*** ildikov_ has joined #openstack-infra17:51
*** s0nea has quit IRC17:52
*** wuhg has quit IRC17:53
*** s0nea has joined #openstack-infra17:54
*** ildikov has quit IRC17:54
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Add support to the subunit workers to reuse zuul uuids  https://review.openstack.org/13975017:55
*** e0ne has quit IRC17:55
*** Ryan_Lane has joined #openstack-infra17:55
openstackgerritIan Cordasco proposed stackforge/gertty: Do not use requests 2.5.0  https://review.openstack.org/14370317:56
sigmavirus24jeblair: jaypipes ^ 2.5.1 is out17:56
jaypipessigmavirus24: rock on. ty sir!17:57
*** zz_dimtruck is now known as dimtruck17:57
sigmavirus24yw17:57
anteayazaro: can you look at https://review.openstack.org/#/c/143699/1 please? our current gerrit branch is openstack/2.8.4 is it not?17:58
anteayazaro: I assume we are working on the latest of our branches, yes?17:58
openstackgerritMerged stackforge/gertty: Do not use requests 2.5.0  https://review.openstack.org/14370317:59
*** armax has joined #openstack-infra18:02
*** lttrl has joined #openstack-infra18:05
anteayalooks like there might be a meeting topic issue in -meeting, will know for sure after keystone finishes18:05
*** bdpayne has joined #openstack-infra18:07
openstackgerritMerged openstack-infra/project-config: Remove icehouse compat checks from glance/keystoneclient  https://review.openstack.org/14356618:08
*** SumitNaiksatam has joined #openstack-infra18:09
*** teran has quit IRC18:09
*** _nadya_ has quit IRC18:11
vponomaryovHave anyone faced same sudden error using py26 job? - https://jenkins06.openstack.org/job/gate-manila-python26/444/console18:13
*** vigneshvar has joined #openstack-infra18:14
openstackgerritKhai Do proposed stackforge/python-jenkins: Fix cancel_queue() method  https://review.openstack.org/13896418:14
*** garyk has joined #openstack-infra18:15
clarkbvponomaryov: that failed bceause zero tests were run. The test listing discovered zero tests so ran no tests18:15
vponomaryovclarkb: test run was before and it was the only one. Now there are two of them and second fails18:15
*** patrickeast has joined #openstack-infra18:17
asselinanteaya, I'm around to coordinate with jesusaurus18:18
asselinanteaya, jesusaurus if ledgeit module is ready to go, then push it through. I'll rebase from there.18:19
zaroanteaya: taking a look18:20
clarkbjeblair: I think gertty may have trouble with those tag merge commits. Haven't been able to debug beyond that though18:21
anteayaasselin: great thanks, just want to ensure there is a clear way forward18:23
anteayazaro: thank you18:23
*** achanda has quit IRC18:25
*** achanda has joined #openstack-infra18:25
jeblairclarkb: yeah, gertty does not handle multiple parents at all yet18:26
jeblairclarkb: implementation status is basically "TODO: handle multiple parents" :)18:26
jeblair(it's not even in the db schema)18:26
*** achanda has quit IRC18:26
*** achanda has joined #openstack-infra18:26
*** Masahiro has joined #openstack-infra18:29
*** carwatt has joined #openstack-infra18:32
clarkbfungi: are you still around today? 141666 and 142323 should be abandoned? and pbr master is basically happy now?18:32
jesusaurusasselin: yes, i think the lodgeit module is ready18:32
jesusaurusclarkb: jeblair: either of you feel like reviewing https://review.openstack.org/#/c/142917/?18:33
bnemecvponomaryov: I saw that on an oslo.messaging patch too.  It looks like something is getting confused by the tox -epy26 -- pbr freeze call.18:34
jesusaurusasselin: why do you think the current split-out process is too involved?18:34
*** Masahiro has quit IRC18:34
asselinjesusaurus, because there are a few changes spread out in multiple files18:34
*** amuller has joined #openstack-infra18:34
*** harlowja has joined #openstack-infra18:35
bnemecAs in, it runs all the tests, then it runs the pbr freeze, which doesn't run any tests, and then it checks whether tests were run, and correctly finds that the last tox run had 0 tests.18:35
clarkbbnemec: oh you may be right I think that is a bug in the script `tox -epy26 -- pbr freeze` says run the pbr freeze tests18:35
clarkbwhich doesn't make sense18:35
*** e0ne has joined #openstack-infra18:35
bnemecclarkb: Yeah, something seems wrong there.18:36
*** andreaf has quit IRC18:36
clarkbbnemec: ya it should be doing `.tox/py26/bin/pbr freeze` not `tox -epy26 -- pbr freeze`18:37
*** andreaf has joined #openstack-infra18:37
clarkbI am not finding freezecmd in our scripts though18:38
openstackgerritKhai Do proposed stackforge/python-jenkins: Fix cancel_queue() method  https://review.openstack.org/13896418:38
clarkboh my git was out of date18:38
jesusaurusasselin: i like keeping the changes together to make it easier to follow the logical story backwards through the commit history, but will defer to the cores' opinions18:39
fungisorry we stopped and got out for lunch, back now18:39
fungiclarkb: yeah, i'll abandon them now that the other stuff merged18:40
*** ihrachyshka has joined #openstack-infra18:40
clarkbbnemec: I am whipping up the fix18:40
clarkbbnemec: thank you for pointing that out18:40
openstackgerritJames E. Blair proposed openstack-infra/gear: Add SSL functional test  https://review.openstack.org/14323518:40
openstackgerritJames E. Blair proposed openstack-infra/gear: Add simple functional test  https://review.openstack.org/14321718:40
openstackgerritJames E. Blair proposed openstack-infra/gear: Fix SSL non-blocking IO support  https://review.openstack.org/14371618:40
carl_baldwinGreetings, I have a quick question.  Is there something going on with Jenkins creating false merge conflicts?18:41
anteayacarl_baldwin: what prompts you to ask?18:41
carl_baldwinI saw some strange merge conflicts yesterday and I wondered.  Today I saw this one:  https://review.openstack.org/#/c/134339/18:41
bnemecclarkb: Thanks.  vponomaryov gets credit though - I was still waiting to see if it would happen again on the recheck. :-)18:41
carl_baldwinanteaya: ^18:41
anteayacarl_baldwin: looking18:42
carl_baldwinHere is one that failed after the gate and I don’t see how the conflict could have happened:  https://review.openstack.org/#/c/143179/18:42
*** spzala has quit IRC18:42
jeblairclarkb: i think i have addressed the ssl issues in https://review.openstack.org/14371618:42
jeblairclarkb: going to run some longer tests now18:43
asselinjesusaurus, updating the spec. you can post your comments there.18:43
carl_baldwinanteaya: Here is a third one that didn’t seem like it should have conflicted:  https://review.openstack.org/#/c/118491/18:43
asselinjesusaurus, https://review.openstack.org/#/c/143689/18:43
openstackgerritClark Boylan proposed openstack-infra/project-config: We want to run freese in venv not with tox target  https://review.openstack.org/14371718:44
clarkbbnemec: vponomaryov ^ that is the fix once that is in I will rebuild images for all the things18:44
anteayacarl_baldwin: you ask a good question, I am uncertain how there can be a merge conflict with a patch that introduces a new directory and file18:44
clarkbjeblair: fungi anteaya ^18:44
clarkbmordred: ^18:44
openstackgerritRamy Asselin proposed openstack-infra/infra-specs: Add module-split workflow optimizations  https://review.openstack.org/14368918:45
carl_baldwinanteaya: So, with these three patches that don’t appear to conflict with anything in master, I’m now wondering if something is broken.18:45
*** dizquierdo has quit IRC18:45
bnemecclarkb: Nice, thanks18:45
clarkbcarl_baldwin: gerrit specifically calls out the conflict in a comment on 14317918:46
clarkbcarl_baldwin: same thing with 11849118:46
carl_baldwinclarkb: Nothing has changed around that comment in over a month.18:47
carl_baldwinclarkb: b8930e8f        (Gary Kotton    2014-11-10 08:19:06 -080018:47
jeblaircarl_baldwin: 134338 could be fallout from some geard issues we were having last week, you can 'recheck' to be sure.18:47
carl_baldwinI’m not a git newby.  This shouldn’t conflict.18:47
*** FallenPegasus has joined #openstack-infra18:48
carl_baldwinjeblair: I will recheck them.18:48
clarkbjeblair: no rechecking won't help18:48
clarkbcarl_baldwin: ^18:48
clarkbgerrit is saying there is a path conflict18:48
jeblaircarl_baldwin: jgit is not as good as cgit in resolving merges, in those cases they just need to be rebased18:48
clarkbit is not zuul/jenkins reporting the merge conflict. and since it is gerrit you get a specific message about it18:48
fungiwas it part of a long patch series? is this the jgit octomerge bug?18:48
jeblairclarkb: i was specifically referring to a change that has not merged18:48
clarkbfungi: I think its actually neutron's symlink mess18:48
fungioh18:49
jeblairclarkb: s/merged/attempted to merge18:49
clarkbjeblair: oh missed the number18:49
jeblairclarkb: and the change i was referring to has no comments from gerrit18:49
*** steak has quit IRC18:49
clarkbfungi: since apparently the "fix" for that was to complain about pbr then copy pasta code18:50
clarkbfungi: the copy pasta movement likely explains the path conflicts18:50
carl_baldwinjeblair: I understand the differences between jgit and cgit.  But, these examples show a conflict where there is no code changing anywhere close.18:51
fungicarl_baldwin: for the one where gerrit complained about the merge, if it was part of a patch series of more than a few patches, gerrit attempts to merge them serially but has to do so with merge commits since their original parents aren't the branch tip, and after a few of those in a row it gets crabby and decides it can't calculate the merge and complains that there's a conflict even though there18:52
fungiisn't18:52
*** markmcclain has joined #openstack-infra18:52
carl_baldwinfungi: Which one are you talking about exactly?18:53
clarkbfungi: though looking at the file lists tests/contrib and tests/functional/contrib are not in them so maybe not the file movement18:53
*** HeOS has joined #openstack-infra18:53
fungicarl_baldwin: whichever one was gerrit refusing to merge the approved change after it passed tests18:54
fungii'm pulling up your examples now to get specifics18:54
clarkbhttps://review.openstack.org/#/c/143179/ for example18:54
clarkband https://review.openstack.org/#/c/118491/18:54
clarkbboth have the message about path conflicts from gerrits diffy cuckoo bird18:55
fungi143179 doesn't look like the patch series jgit bug at least18:55
jheskethMorning18:56
anteayamorning jhesketh18:56
anteayajhesketh: I see a meeting in your future :D18:56
jheskethHeh :-)18:56
*** mjturek has quit IRC18:56
fungimanually rebasing 143179 seems to work currently18:57
fungithough i wonder if the changing state of master means that there were conflicts since reverted18:58
carl_baldwinhttps://review.openstack.org/#/c/143179/ is such a simple change.  There is no patch series and there isn’t any patch in the current master that touches any line close to the change and isn’t already reachable from the commit.18:59
carl_baldwinfungi: I’ve manually rebased them all successfully.  However, I used cgit.  Are you manually rebasing with cgit?18:59
*** ddieterl_ has quit IRC19:00
fungicarl_baldwin: yeah, i tested with cgit and that definitely worked19:00
fungialso there have been no merges to neutron master which would explain that conflict from an hour ago being invalidated19:00
pleia2meeting time :)19:00
carl_baldwinfungi: A revert of a conflict would show up in git annotate.  I don’t see any such revert.19:00
*** koolhead17 has quit IRC19:01
fungimost recent merges to master were 75 minutes ago and 8 hours ago19:01
jeblairfungi, carl_baldwin: the conflict from an hour ago is still probably the geard thing.19:01
*** markmcclain has quit IRC19:01
jeblairthe conflict from gerrit was probably a jgit-cgit incompatibility19:01
carl_baldwinjeblair: geard is where my skill set stops.  :)19:01
vponomaryovclarkb: thanks!19:02
*** otter768 has joined #openstack-infra19:03
carl_baldwinjeblair: I don’t see how jgit could have messed up https://review.openstack.org/#/c/143179.  I’m trying to show above how this patch has no merge complexity  that possibly could have tripped up jgit.19:03
*** hdd has joined #openstack-infra19:04
*** ryanpetrello has joined #openstack-infra19:06
carl_baldwinjeblair:  But, jgit does seem to be unable to handle it.  I cannot see why.  I created https://review.openstack.org/#/c/143721/ so that I could hit the rebase button in the UI.  It failed.19:07
*** otter768 has quit IRC19:08
*** vhoward has left #openstack-infra19:08
jeblaircarl_baldwin: aiui, the octomerge jgit issue that fungi was referring to does not involve complexity as much as git features it just doesn't implement19:08
carl_baldwinjeblair: This shouldn’t be an octomerge.19:09
openstackgerritMerged openstack-infra/project-config: We want to run freese in venv not with tox target  https://review.openstack.org/14371719:09
carl_baldwinThere is no patch series.19:09
clarkbcarl_baldwin: 881344280ce47a1af41d8b74d8fd779959510068 maybe the conflict19:10
carl_baldwinclarkb: I checked that one.  It is already a decendent of this patch.19:11
*** subscope has joined #openstack-infra19:11
carl_baldwinclarkb: Shown by this command:  “git merge-base 4e79a4d3cda7905d77a56d6bc97f59790d113d1f 881344280ce47a1af41d8b74d8fd779959510068”19:12
*** carwatt has quit IRC19:12
clarkbya its in the log of the change19:13
carl_baldwinclarkb: That too.19:13
*** garyk has quit IRC19:14
clarkbcarl_baldwin: you know I wonder if we are focusing on the diff too much. I wonder if it is due to the function contrib test move stuff19:14
clarkbis that change on one side and master on the other19:15
*** prad has joined #openstack-infra19:15
clarkbgerrit shows you diff against HEAD^ not diff against target branch19:15
carl_baldwinclarkb: ^ I understand what you’re trying to tell me about git diff.19:17
*** ryanpetrello has quit IRC19:17
*** dimtruck is now known as zz_dimtruck19:17
carl_baldwinThe command I ran was merge-base and that was a simple way to show that the patch is reachable in the commit graph.19:18
clarkbcarl_baldwin: not that patch19:20
clarkbcarl_baldwin: I think you are right that its not at fault19:20
*** FallenPegasus has quit IRC19:20
clarkbcarl_baldwin: instead I think that the movement of neutron/tests/**/contrib is likely at fault19:20
carl_baldwinclarkb:  This must be some drawback with jgit that I don’t understand and haven’t seen before.  None of these patches touch files in that area.  Even a very naive path merge should not have any problem ignoring it.  Do we know any jgit maintainers who might want to take a look at this case?19:24
*** weshay has joined #openstack-infra19:24
carl_baldwinclarkb: Meanwhile, I’ll rebase using cgit and resubmit the patches to the gate.19:25
clarkbcarl_baldwin: I think jgit is intentionally more conservative than cgit? iirc one of the major ocmplaints with git is it is often thought to be too helpful with conflict resolution19:25
clarkbcarl_baldwin: but I don't know any jgit maintainers19:26
clarkbso can't have them comment on that19:26
carl_baldwinclarkb: fair enough19:26
carl_baldwinclarkb: Could you guys provide me the version of jgit in use on our gerrit?19:29
*** ddieterly has joined #openstack-infra19:30
*** ddieterly has quit IRC19:32
*** kgiusti has left #openstack-infra19:32
*** ddieterly has joined #openstack-infra19:32
carl_baldwinclarkb: I see our gerrit version is 2.8.4-15-g6dc8444 but I’m not sure if that is sufficient to nail down the version of jgit it uses.19:33
clarkbcarl_baldwin: in theory it is http://git.openstack.org/cgit/openstack-infra/gerrit/tree/?h=openstack/2.8.4 but I have no idea how to figure out from buck what the version is19:34
clarkbzaro: ^19:34
*** mfer has joined #openstack-infra19:34
carl_baldwinclarkb: Thanks.19:35
*** ddieterly has quit IRC19:37
openstackgerritMatthew Treinish proposed openstack-infra/devstack-gate: Handle more than one stream stored testrepository  https://review.openstack.org/14372719:38
*** spzala has joined #openstack-infra19:42
*** kgiusti has joined #openstack-infra19:45
*** teran has joined #openstack-infra19:45
*** zz_zz_zz_zz_zz_z is now known as sabari19:49
*** otter768 has joined #openstack-infra19:54
*** rlandy has joined #openstack-infra19:55
*** ildikov_ has quit IRC19:55
*** KurtMartin is now known as kmartin19:55
zarocarl_baldwin, clarkb : git grep jgit in 'BUCK' files show ver is 3.5.1.201410131835-r19:55
carl_baldwinzaro: thanks.19:56
zarocarl_baldwin: ohh sorry, that was on master.  please try to git grep on the 2.8.4 branch to get the version.19:57
carl_baldwinzaro: I will.19:57
*** baoli has quit IRC19:58
fungisince there's no tc meeting to gawk at, i'm going to afk and take over driving for the afternoon. i'll check back in at some point this evening20:02
clarkbok I am going to start spinning up new nodepool nodes now20:02
clarkbfungi: have fun20:02
anteayafungi: happy trails20:02
fungithanks. pavement as far as the eye can see20:02
clarkbfungi: you don't have windy mountain roads?20:02
clarkbthose are fun20:02
fungithose come in a couple hours20:02
*** mika has joined #openstack-infra20:03
*** fifieldt has quit IRC20:03
pleia2need to scoot off for a bit to handle some family things, bbiab20:04
*** bswartz has quit IRC20:05
dteselkinHi, could anyone help me a bit with scp plugin for Jenkins?20:06
*** yfried has joined #openstack-infra20:06
clarkbdteselkin: sure what is the question?20:07
dteselkinclarkb, I'm trying to figure out how it copies console.log to the static node20:08
dteselkinI have a problem with the logs on that node20:08
dteselkinSome of them are truncated20:08
dteselkinI know that you use a custom version of plugin20:08
dteselkinSo, first of all, where can I get it to try?20:09
clarkbdteselkin: its not custom as much as it is unreleased.20:09
dteselkinWell, but it works :)20:09
clarkbdteselkin: https://github.com/jenkinsci/scp-plugin is the code20:09
dteselkinThanks, I'll try20:09
clarkbdteselkin: and http://tarballs.openstack.org/ci/scp.jpi should be our most recent build of it20:10
dteselkinCool, thanks!20:10
dteselkinAm I right that this plugin takes console log using some kind of API ?20:10
clarkbdteselkin: it runs within jenkins so it just gets it internally20:11
dteselkinHmm, that's strange20:11
*** teran_ has joined #openstack-infra20:11
clarkbthere is a file like java object that the plugin reads from and writes out via scp20:11
dteselkinI mean, I looked at the console log file on jenkins noe20:11
dteselkin*node20:11
dteselkinIt have a bit different format20:12
clarkbthe format should be the same. it reads the same underlying html file20:12
clarkbso it gets properly escaped and all that20:12
dteselkinThere is some kind of prefix before each line, and that prefix looks like base64 string20:13
dteselkinSo jenkins should store console log as html file?20:13
clarkbno jenkins actually stores the log in base64 iirc20:13
clarkbbut the data served via http to your web browser is the same data read by the plugin internally20:14
*** teran has quit IRC20:14
dteselkinos_loganalyzer does that?20:14
clarkbthe plugin doesn't read it from disk. It reads it from the specail java file object thing that applies all of the appopriate filters to the stream20:14
clarkbdteselkin: no20:14
dteselkinAh, ok. So scp plugin uses some Jenkins internals and read it as html file, then copies to the destination server?20:15
clarkbyes20:15
dteselkinOk, so probably the problem is in the plugin in my case20:16
dteselkinOne more question20:16
dteselkinHow can I enable debug logging for the plugin?20:16
*** fifieldt has joined #openstack-infra20:16
clarkbdteselkin: I think you can do that via jenkins log config management in the gui20:17
dteselkinAnd is it possible to add more debugging outputs manually to the plugin?20:17
clarkbdteselkin: there is also a way to set it up in a config file on disk but I forget how that works20:17
clarkbdteselkin: you can edit the plugin and rebuild it with more logging info20:17
dteselkinOk, I'll dig into this20:17
dteselkinOne stupid question - how to rebuild it?20:18
dteselkinSorry, I'm not familiar with Java :(20:18
*** amuller has quit IRC20:18
*** Masahiro has joined #openstack-infra20:18
*** ociuhandu has quit IRC20:19
clarkbdteselkin: `mvn package` will run maven to build it20:19
dteselkinclarkb, ok, I'll try. Thank you!20:22
*** Masahiro has quit IRC20:22
*** teran_ has quit IRC20:24
*** bswartz has joined #openstack-infra20:26
*** dizquierdo has joined #openstack-infra20:26
*** dprince has quit IRC20:29
*** teran has joined #openstack-infra20:30
*** sabari is now known as zz_sabari20:31
*** ddieterly has joined #openstack-infra20:31
* anteaya goes for a walk20:34
*** teran has quit IRC20:35
*** ddieterly has quit IRC20:36
*** otter768 has quit IRC20:37
*** yamahata has joined #openstack-infra20:38
*** sdake_ has quit IRC20:38
*** kgiusti has left #openstack-infra20:42
*** esker has quit IRC20:42
*** dizquierdo has quit IRC20:43
*** harlowja has quit IRC20:44
*** yamahata has quit IRC20:45
*** teran has joined #openstack-infra20:47
*** markmcclain has joined #openstack-infra20:47
*** harlowja has joined #openstack-infra20:48
*** ihrachyshka has quit IRC20:49
*** yamahata has joined #openstack-infra20:52
*** mfer has quit IRC20:52
*** achanda has quit IRC20:54
*** achanda has joined #openstack-infra20:54
*** carl_baldwin has quit IRC20:55
*** steak has joined #openstack-infra20:57
*** ihrachyshka has joined #openstack-infra20:58
*** achanda has quit IRC20:59
*** markmcclain1 has joined #openstack-infra21:00
*** teran has quit IRC21:00
*** ryanpetrello has joined #openstack-infra21:00
*** markmcclain has quit IRC21:00
*** markmcclain1 has quit IRC21:02
*** markmcclain has joined #openstack-infra21:02
*** markmcclain has quit IRC21:03
*** EmilienM is now known as EmilienM|afk21:04
clarkbimage builds are still going. centos6 should be all done and trusty is one its way21:04
clarkbprecise and variants will be next. Iam avoiding devstack-* since they don't use those scripts so don't need the updates21:05
*** mfer has joined #openstack-infra21:05
*** rlandy has quit IRC21:06
*** ddieterly has joined #openstack-infra21:07
*** teran_ has joined #openstack-infra21:07
*** steak has quit IRC21:08
*** zz_dimtruck is now known as dimtruck21:09
*** e0ne has quit IRC21:10
mtreinishclarkb: on 136234 to install the deps do I just need to do something like: https://review.openstack.org/#/c/142940/2/nodepool/elements/cache-devstack/extra-data.d/51-cache-testrepository-db21:10
mtreinishor is there something else I need to do?21:10
*** subscope has quit IRC21:12
clarkbmtreinish: I think thats basically it. We install zuul onto the nodes in a venv though. Maybe we should do what zuul does?21:12
clarkbmtreinish: except that appears broken :(21:13
clarkbjeblair: http://paste.openstack.org/show/154229/21:13
clarkbjeblair: is that similar to what you ran into in the past?21:13
mtreinishok sure, that should be simple enough21:14
mtreinishoh, heh21:14
clarkbjeblair: note that doesn't appear to happen on hpcloud image builds21:14
clarkbjust rax so far21:14
mtreinishwasn't there a new virtualenv release recently?21:14
clarkbmtreinish: yup21:14
clarkbI think we should use the same version on both though?21:14
clarkblikely something to look into as the cause21:15
clarkbI am also rebuilding just to see if it is transient21:15
*** ociuhandu has joined #openstack-infra21:15
*** e0ne has joined #openstack-infra21:18
*** dimtruck is now known as zz_dimtruck21:19
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Add nodepool script to preseed testrepository from subunit2sql  https://review.openstack.org/13623421:23
*** zz_sabari is now known as sabari21:23
mtreinishclarkb: ^^^ I think that should setup the venvs correctly21:23
*** thedodd has quit IRC21:23
clarkbI lied hpcloud is affected too21:23
clarkbmtreinish: thanks21:23
clarkbI need to go do a last round of grocery shopping before cooking stuff for thursday21:24
clarkbwill try to get back and debug the venv issues during image builds. In theory this should be easy to replicate21:24
clarkbinstall latest venv, make venv, look for explosion21:24
*** mfer has quit IRC21:25
mattoliveraumorning all21:26
*** baoli has joined #openstack-infra21:26
*** zz_dimtruck is now known as dimtruck21:26
*** eharney has quit IRC21:28
*** ryanpetrello has quit IRC21:30
*** ryanpetrello has joined #openstack-infra21:32
*** eharney has joined #openstack-infra21:33
jeblairclarkb: i don't think i've seen this before21:36
jeblairclarkb: virtualenv 1.11.6 (which i happened to have on a test vm) works, 12.0.2 does not21:37
jeblairclarkb: 11.11.6 is from may 16, 12.0 is from yesterday.21:38
ekarlso-hmmm, whne enable_service cue-api in devstack why does it install cinder instead ? :/21:39
jeblairdstufft: virtualenv 12.0.2 produces http://paste.openstack.org/show/154229/ on ubuntu 12.04 wheras virtualenv 1.11.6 does not21:40
dstufftjeblair: hrm21:41
dstufftthat's strange21:41
dstufftI think travis uses ubuntu 12.0421:42
dstufftthough it doesn't uses ubuntu's python21:42
jeblairoh, theres some missing output from that, let me get more verbose21:42
jeblairdstufft, clarkb: http://paste.openstack.org/show/154240/21:42
jeblairIOError: invalid Python installation: unable to open /usr/zuul-env/local/include/python2.7/pyconfig.h (No such file or directory)21:43
dstufftjeblair: I'm only half here (cooking atm), do you have python-dev installed?21:43
jeblairyep21:44
jeblairii  python-dev                       2.7.3-0ubuntu2.2                  header files and a static library for Python (default)21:44
jeblairthough python-minimal supplies pyconfig.h, but that's installed too21:44
jeblairpython2.7-minimal: /usr/include/python2.7/pyconfig.h21:44
openstackgerritElizabeth K. Joseph proposed openstack-infra/infra-manual: Remove third party page from the manual  https://review.openstack.org/14373721:45
*** EmilienM|afk is now known as EmilienM21:48
jeblairclarkb, dstufft: it _looks_ like we have built rhat related images (centos6,centos7,f20) within the past few hours, so this _may_ be a debian-only problem.  i'll try to confirm21:49
*** dims has quit IRC21:51
anteayamorning mattoliverau21:52
*** spzala has quit IRC21:53
*** dimtruck is now known as zz_dimtruck21:55
*** prad has quit IRC21:55
*** ChanServ changes topic to "Discussion of OpenStack Developer Infrastructure | Current Python distutils issues: https://etherpad.openstack.org/p/pydistutils-issues"21:56
*** dims has joined #openstack-infra21:56
jeblairclarkb, fungi, anteaya, dstufft: https://etherpad.openstack.org/p/pydistutils-issues21:56
jeblairso we can keep up to date as we become highly async21:57
clarkb++21:57
dstufft local/include/whatever looks suspect21:58
*** e0ne has quit IRC21:58
dstufftDebian patches their python to move pip install stuff to /usr/local21:58
dstufftI wonder if that is breaking things21:58
*** mbacchi has quit IRC21:59
anteayajeblair: thanks22:00
dstufftluckily22:01
*** dannywil_ has joined #openstack-infra22:01
dstufftvirtualenv doesn't change much (mostly because I think we're all afraid to change it much)22:01
dstuffthttps://github.com/pypa/virtualenv/compare/1.11.6...12.0.222:01
*** harlowja_ has joined #openstack-infra22:01
dstufftshouldn't be too hard to narrow it down22:01
dstufftwill do it once I eat22:01
*** harlowja has quit IRC22:02
*** jamielennox|away is now known as jamielennox22:03
*** ddieterl_ has joined #openstack-infra22:04
*** dannywilson has quit IRC22:04
dstufftI wonder if I can just convince python-dev to backport venv to 2.7 too and then virtualenv can just become a shim :D22:04
*** mfink has quit IRC22:05
*** dannywil_ has quit IRC22:05
anteayahere is a commit that deletes a sys.path: https://github.com/pypa/virtualenv/commit/dde220efe38b99020cd61e3c3a88c5d44922c54422:07
*** Masahiro has joined #openstack-infra22:07
*** ddieterly has quit IRC22:07
anteayaand another that addresses sys.path: https://github.com/pypa/virtualenv/commit/25cea9d5a416b17efa9098c0564a2077c99741c722:08
*** dannywilson has joined #openstack-infra22:08
anteayaand a third: https://github.com/pypa/virtualenv/commit/920d7c71d800ba4c0da8fcac605cdf0adfe46f3a22:09
*** dannywilson has quit IRC22:09
* dstufft spins up a precise image22:09
*** dannywilson has joined #openstack-infra22:09
*** patrickeast_ has joined #openstack-infra22:10
clarkbtrusty is where it failed on us. though in theory precise should fail similarly22:11
jeblairanteaya, dstufft: reverting https://github.com/pypa/virtualenv/commit/dde220efe38b99020cd61e3c3a88c5d44922c544 appears to fix it for me22:11
jeblairclarkb: yeah, i'm testing on precise22:11
jeblair(it's what i had laying around)22:11
*** patrickeast has quit IRC22:11
*** patrickeast_ is now known as patrickeast22:11
dstufftI hate python22:11
*** dims has quit IRC22:11
dstufftthat commit was there to fix a bleed through of the stdlib22:11
*** Masahiro has quit IRC22:11
dstufftbecause virtualenv's -p thing does something reaaaaly hacky22:12
dstuffthttps://github.com/pypa/virtualenv/issues/67322:13
*** teran has joined #openstack-infra22:13
anteayamy shot in the dark was a lucky one22:13
dstufftI bet it needs to be smarter about what it deletes22:14
jeblairoh, so we should test any fixes on trusty and make sure it can still use an alternate interpreter22:15
* anteaya steps away to chop some vegetables22:15
pleia2anteaya: happy chopping22:15
*** teran_ has quit IRC22:15
dstufftmaybe a better answer is to be even more hacky and just copy virtualenv.py into a temporary directory before we execute it22:16
*** mfer has joined #openstack-infra22:16
*** esmute has quit IRC22:17
*** zaro has quit IRC22:18
*** gothicmindfood has quit IRC22:18
*** jesusaurus has quit IRC22:18
*** ryanpetrello has quit IRC22:22
*** signed8bit has joined #openstack-infra22:24
dstufftjeblair: https://bpaste.net/show/b2f9c2d8e1cd does that fix it?22:27
jeblairdstufft: i'll start testing it22:28
dstuffthttps://github.com/pypa/virtualenv/pull/687 pull request for completeness sake22:29
*** harlowja_ has quit IRC22:31
*** harlowja has joined #openstack-infra22:31
krotscheckjeblair: I’m currently drafting the promotion email for yolanda - Given how many western countries are currently on vacation, I’d like to keep the review period open until the 9th rather than just a week. Thoughts?22:32
jeblairkrotscheck: seems reasonable22:33
*** mfer has quit IRC22:34
jeblairdstufft: btw i found that current HEAD (not including your change) works if you do "-p python3" and also if you omit "-p python2". it seems to only be the case where you are specifying the default interpreter that it fails22:36
jeblair(on precise)22:36
*** ihrachyshka has quit IRC22:36
*** otter768 has joined #openstack-infra22:38
dstufftjeblair: yea, it's a an error that comes from like, 12 different layers of hacks in virtualenv22:42
*** hdd has quit IRC22:43
jeblairdstufft: the 6 tests described at the bottom of https://etherpad.openstack.org/p/pydistutils-issues all work with your patch22:43
*** otter768 has quit IRC22:44
jeblairdstufft: i'm running those again, but with virtualenv running under python322:46
*** esmute has joined #openstack-infra22:46
*** gothicmindfood has joined #openstack-infra22:47
*** Longgeek has quit IRC22:49
*** jesusaurus has joined #openstack-infra22:49
*** zaro has joined #openstack-infra22:55
jeblairdstufft: okay, so all of the python2/3 cross testing i can think to do on precise and trusty works with your patch (see etherpad for full list)22:57
*** teran_ has joined #openstack-infra22:58
*** FlorianSW has quit IRC22:58
*** unicell has quit IRC22:59
*** zz_dimtruck is now known as dimtruck23:00
*** dannywilson has quit IRC23:01
*** otter768 has joined #openstack-infra23:01
*** teran has quit IRC23:01
*** dannywilson has joined #openstack-infra23:04
*** esker has joined #openstack-infra23:05
*** esker has quit IRC23:05
*** esker has joined #openstack-infra23:06
*** marun has quit IRC23:08
*** tonytan4ever has quit IRC23:08
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard: [WIP] Normalized event data  https://review.openstack.org/14374423:08
*** salv-orlando has quit IRC23:10
*** vigneshvar has quit IRC23:10
*** dims has joined #openstack-infra23:12
*** hichtakk has quit IRC23:12
*** harlowja has quit IRC23:12
*** hichtakk has joined #openstack-infra23:12
*** radez is now known as radez_g0n323:13
*** dims has quit IRC23:16
*** dmsimard is now known as dmsimard_away23:20
*** harlowja has joined #openstack-infra23:20
*** yamahata has quit IRC23:22
*** jamielennox is now known as jamielennox|away23:24
clarkbjeblair so I guess we wait for new virtualenv before worrying about those images?23:28
dstufftI'll be releasing a new virtualenv in a bit23:31
*** esker has quit IRC23:37
*** amitgandhinz has quit IRC23:37
*** esker has joined #openstack-infra23:38
clarkbdstufft so the original fix detailed in 673 was insufficient?23:38
*** dkliban is now known as dkliban_afk23:38
*** naohirot has joined #openstack-infra23:38
dstufftclarkb: honestly I understand like 50% of what virtualenv is doing23:39
clarkbok I understand less so if its not worth grokking thats fine by me :)23:39
dstufftI just noticed that it was failing trying to import ``site`` when we subshell out to python /path/to/site-packages/virtualenv.py23:39
dstufftso I randomly tried -S and it fixed it23:39
dstufftwhy importing site failing? I have no idea23:40
*** [HeOS] has joined #openstack-infra23:42
*** HeOS has quit IRC23:43
naohirotgood morning23:43
naohirotthis is my first time to join this channel23:45
*** ddieterly has joined #openstack-infra23:45
naohirotgate-tempest-dsvm-neutron-src-python-heatclient becomes error at the gate23:46
*** cnesa has quit IRC23:46
*** miqui_ has quit IRC23:46
*** dimtruck is now known as zz_dimtruck23:46
clarkbnaohirot can you link to logs for failing runs?23:46
naohirotIs this channel appropriate place to discuss such that gate problem?23:46
naohirotclarkb: Hi23:46
*** ddieterl_ has quit IRC23:46
clarkbpossibly. having logs would definitely help23:47
*** hichtakk has quit IRC23:47
naohirotclarkb: this is OK log http://logs.openstack.org/59/143059/1/check/gate-tempest-dsvm-neutron-src-python-heatclient/ff49780/23:47
naohirotclarkb: this is NG log http://logs.openstack.org/59/143059/4/check/gate-tempest-dsvm-neutron-src-python-heatclient/5817272/23:47
naohirotclarkb: the program is same23:48
naohirotclarkb: the gerrit review is here https://review.openstack.org/#/c/143059/23:50
clarkbthose look like timeouts when testing heat. is it possible that the change is at fault?23:50
clarkbI think those may be valid failures23:50
naohirotclarkb: sorry what do you mean by "at fault"?23:52
naohirotclarkb: No, definitely No23:52
clarkbnaohirot: I mean that test fails in code related to heatclient23:53
clarkbnaohirot: so it seems likely that the change to heatclient is causing those tests to fail but let me see the change23:53
naohirotclarkb: because the patch set 1 was OK, the patch set 4 was NG, and 1 and 4 are exactly the same code23:54
clarkbhttp://logs.openstack.org/59/143059/4/check/gate-tempest-dsvm-neutron-src-python-heatclient/5817272/logs/screen-h-eng.txt.gz appears to be the error23:54
clarkbso it is indirectly related to heatclient. Now why are we using a version of pbr that doesn't work fo rthis23:55
*** achanda has joined #openstack-infra23:55
*** sabari is now known as zz_sabari23:56
*** Masahiro has joined #openstack-infra23:56
naohirotclarkb: Yes the url you just put here is the log of the patch set 4.23:56
clarkblooks like we install pbr from ubuntu23:56
clarkbsdague: ^ if you are not on vacation yet can we please please please not install packages like that from the distros?23:57
naohirotclarkb: can you compare the code between patch set 1 and 4 at https://review.openstack.org/#/c/143059/, you will set the same.23:57
*** dannywilson has quit IRC23:57
*** ociuhandu has quit IRC23:58
naohirotclarkb: regarding "pbr",23:58
clarkbnaohirot: yes its not the codes fault it appears to be devstack doing something funny23:58
naohirotclarkb: I didn't do anything.23:58
clarkbnaohirot: I know23:59
naohirotclarkb: Okay, so should I submit a bug report ?23:59
*** achanda has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!