Monday, 2017-12-18

*** ^andrea^ has quit IRC00:26
*** psachin has joined #openstack-swift00:54
*** StevenK has quit IRC01:08
*** StevenK has joined #openstack-swift01:12
*** hoonetorg has quit IRC01:41
*** cshastri has joined #openstack-swift01:42
*** tovin07_ has joined #openstack-swift01:45
-openstackstatus- NOTICE: The freenode network is currently the target of automated spam attacks, we have enabled temporary restrictions on targetted OpenStack channels which requires users to be logged on to NickServ. If you see spam in your channel, please report it in #openstack-infra. Thanks.01:48
*** hoonetorg has joined #openstack-swift01:49
kota_good morning01:56
* kota_ got flu shot in this morning01:57
*** m_kazuhiro has joined #openstack-swift02:01
m_kazuhirogood morning02:06
openstackgerritCheng Li proposed openstack/swift master: change account_autocreate to default to true  https://review.openstack.org/38594602:34
mattoliveraukota_, m_kazuhiro o/02:41
m_kazuhiromattoliverau: o/02:41
*** ChanServ sets mode: +r 02:55
*** gkadam has joined #openstack-swift03:37
*** gkadam has quit IRC04:54
kota_test call05:24
*** SkyRocknRoll has joined #openstack-swift06:17
*** SkyRocknRoll has quit IRC06:28
*** kei_yama has quit IRC06:30
openstackgerritAndreas Jaeger proposed openstack/swift master: DNM: Testing Zuul v3 native tox jobs  https://review.openstack.org/52858206:38
*** tovin07_ has quit IRC06:44
*** hoonetorg has quit IRC06:45
*** rcernin has quit IRC06:46
openstackgerritAndreas Jaeger proposed openstack/swift master: DNM: Testing Zuul v3 native tox jobs  https://review.openstack.org/52858206:52
*** hoonetorg has joined #openstack-swift07:01
*** tovin07_ has joined #openstack-swift07:02
openstackgerritAndreas Jaeger proposed openstack/swift master: DNM: Testing Zuul v3 native tox jobs  https://review.openstack.org/52858207:05
*** geaaru has quit IRC07:19
*** m_kazuhiro has quit IRC07:47
*** MeltedLux_ has quit IRC07:52
openstackgerritAndreas Jaeger proposed openstack/swift master: DNM: Testing Zuul v3 native tox jobs  https://review.openstack.org/52858207:52
*** bkopilov has quit IRC07:55
mattoliverauacoles: ahem, seems the ashes are decided ;) better luck next year08:00
*** rcernin has joined #openstack-swift08:06
*** silor has joined #openstack-swift08:15
*** AJaeger has joined #openstack-swift08:27
openstackgerritAndreas Jaeger proposed openstack/swift master: Native Zuul v3 tox jobs  https://review.openstack.org/52858208:28
AJaegerswift team, I converted the legacy tox jobs to Zuul v3 and moved them in-tree. Please review the above and ask any questions you have.08:28
*** gkadam has joined #openstack-swift08:28
AJaegernotmyname: This still uses the XFS set up you did earlier. It's now much easier to do and fully under your control ;)08:29
AJaegernotmyname: do we still need the py27/py35 jobs *without* XFS setup? Or should we remove them from project-config?08:32
*** cbartz has joined #openstack-swift08:53
acolesmattoliverau: :'(09:24
acolesgood morning09:24
*** jarbod_ has quit IRC09:57
*** tovin07_ has quit IRC10:18
*** d0ugal_ has quit IRC10:36
*** cshastri has quit IRC10:46
*** silor has quit IRC10:48
*** rcernin has quit IRC10:58
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Fix broker merge_shard_ranges  https://review.openstack.org/52842211:02
*** d0ugal has joined #openstack-swift11:16
openstackgerritMerged openstack/swift master: Move symlink versioning functional test  https://review.openstack.org/52825312:27
*** mvk has quit IRC12:31
*** psachin has quit IRC12:56
*** ChanServ sets mode: -r 14:09
*** saint_ has joined #openstack-swift14:23
*** d0ugal has quit IRC14:56
*** d0ugal has joined #openstack-swift15:08
*** d0ugal has quit IRC15:11
*** mingyu_ has joined #openstack-swift15:11
*** d0ugal has joined #openstack-swift15:12
*** thiago1 has quit IRC15:16
*** hseipp has joined #openstack-swift15:46
*** hseipp has quit IRC16:13
*** saint_ has quit IRC16:30
*** catintheroof has joined #openstack-swift16:38
notmynamegood morning16:43
notmynameAJaeger: ah, interesting. and thanks16:43
notmyname(the zuul jobs)16:44
notmynameAJaeger: for real testing, XFS should be required. however, the non-xfs jobs were left in because I wasn't able to get that requirement in devstack (well, was told it wouldn't happen if I tried)16:45
notmynameso the existing jobs needed to still work16:45
*** catintheroof has quit IRC16:45
clarkbnotmyname: devstack has created an xfs filesystem for swift as long as I can remember16:46
notmynameclarkb: nah, it's xfs as the TMPDIR location16:46
notmynamenot the data location16:46
notmyname(or more generally, a TMPDIR location that supports more than 4k of xattrs)16:46
*** armaan has joined #openstack-swift16:47
notmynameand I got pushback from tempest, actually, not "devstack". ie something along the lines of "adding a specific filesystem requirement in this way is something that is unreasonable to add as a requirement to tests that tempest runs"16:48
clarkbI see so something different than the xfs that is there16:48
notmynamebut TBH, it doesn't matter too much for me. I went with the direction that would (1) let me get what I needed done and (2) caused fewest needless arguments with others16:48
notmynameFWIW, the commit message for the related patch in swift (the one that caused the test changes) has some more details https://review.openstack.org/#/c/336323/16:51
patchbotpatch 336323 - swift - Add checksum to object extended attributes (MERGED)16:51
*** creiht has joined #openstack-swift17:03
*** gyee has joined #openstack-swift17:04
creihtGreetings swiftlings!17:04
notmynamehello creiht17:04
notmynamewhat's up?17:04
creihtWe noticed some small issues with the additions of the symlinks functests17:05
creihtNot all of them have the logic to be skipped if not enabled17:05
*** SkyRocknRoll has joined #openstack-swift17:06
notmynameah, sounds like a good catch17:07
creihtand raising skipTest in the setupmodule can be a little problematic when running nosetests17:08
creihtwhat is the preferred paste server for you guys?17:08
notmynamethere's not one. the openstack pastebin (paste.openstack.org) if you don't have one you prefer17:09
notmynameI'm bringing up my dev vm17:09
creihtHere's the tests we had to manually skip: http://paste.openstack.org/show/629229/17:11
creihtAnd here's a traceback we were getting when running nosetest: http://paste.openstack.org/show/629230/17:12
notmynamehmm... functests passed on my saio vm17:15
*** mvk has joined #openstack-swift17:16
notmynamebut I got the same SkipTest error when runnign it directly with nosetests17:17
notmynamecreiht: it's a bad import17:19
creihtahh17:20
notmynameunittest vs unittest217:22
notmynamenose recognizes unittest.Skiptest17:22
notmynametestr recognizes unittest2.SkipTest17:22
notmyname(because of course)17:23
notmynameso running ./.functests works (uses testr)17:23
notmynamerunning nose directly doesn't17:23
notmynamelooks like there'sa couple of other places like that too17:23
*** catintheroof has joined #openstack-swift17:23
notmynameI'll have a patch in a moment17:23
creihtNo worries, we got things working here17:24
*** armaan has quit IRC17:24
creihtjust wanted to let you guys now17:24
creihtknow17:24
*** armaan has joined #openstack-swift17:24
*** cshastri has joined #openstack-swift17:25
notmynamemeaning you already have a patch you could share?17:28
*** catintheroof has quit IRC17:30
creihtno, we just told our tests to skip those tests :)17:30
creihtand we just found the nosetest thing accidentally when trying to figure out what was wrong17:31
*** cshastri has quit IRC17:32
*** cbartz has quit IRC17:33
openstackgerritJohn Dickinson proposed openstack/swift master: fix SkipTest imports in functests so they can be run directly by nose  https://review.openstack.org/52876917:33
claygrledisez: thanks for the detailed report on lp bug #173880417:34
openstackLaunchpad bug 1738804 in OpenStack Object Storage (swift) "Socket leak on proxy->obj when HTTPRequestedRangeNotSatisfiable with erasure code" [Undecided,New] https://launchpad.net/bugs/173880417:34
rledisezclayg: np, i just pasted a dirty fix, but i don't know where to look for writing a real fix17:36
*** mvk has quit IRC17:37
*** HCLTech-SSW has joined #openstack-swift17:38
*** gkadam has quit IRC17:38
HCLTech-SSWHi Clay17:38
* creiht waves at everyone, and hopes everyone has a Merry Christmas17:40
*** creiht has quit IRC17:40
*** MeltedLux has joined #openstack-swift17:48
*** HCLTech-SSW has quit IRC17:49
*** JimCheung has joined #openstack-swift17:53
*** geaaru has joined #openstack-swift18:03
*** mvk has joined #openstack-swift18:25
*** catintheroof has joined #openstack-swift18:36
*** catintheroof has quit IRC18:36
*** catintheroof has joined #openstack-swift18:36
*** catintheroof has quit IRC18:36
AJaegernotmyname: I'm talking about py27 and py35 tox jobs - do we need them both with XFS as TMPDIR and without?18:37
claygi don't think anyone really wants the "without XFS TMPDIR" jobs - but at somepoint we also decided trying to mock out the xattr support when the default tmpdir filesystem doesn't support it wasn't working anymore18:43
claygI think at the time notmyname asked if we can just "fix" the "normal" python unittest environments to have a xattr supporting TMPDIR but the easiest path forward at the time was to create a second job?18:44
notmynameAJaeger: yeah, that's what I was trying to get at. we only *need* the with XFS jobs in order to qualify swift for delivery. but keeping the non-xfs ones around make it easier on other projects18:44
timburke...something something PTI something...18:46
notmynameAJaeger: so the simple answer is "yes, we need them both"18:46
notmyname(although technically we don't have any py3 jobs, at least that do anything...)18:46
timburkenotmyname: hey! there are *some* modules that get py3 coverage now! https://github.com/openstack/swift/blob/master/tox.ini#L31-L35 :P18:47
notmynameI have *some* parts of a million dollars in my bank account right now!18:48
timburkeand if i ever beat the ring builder tests into submission so we could land https://review.openstack.org/#/c/401397/ you could actually do your ring manipulations in py3!18:49
patchbotpatch 401397 - swift - py3: port common/ring/ and common/utils.py18:49
*** mingyu_ has quit IRC18:55
*** mingyu has joined #openstack-swift18:56
claygtorgomatic: do you have the cors patch handy?18:56
*** catintheroof has joined #openstack-swift18:56
timburkeclayg: https://review.openstack.org/#/c/528106/18:57
patchbotpatch 528106 - swift - Move CORS to middleware.18:57
claygtimburke: thanks!  starred now!18:58
*** itlinux has joined #openstack-swift18:58
claygtorgomatic: ok, now I remember where we were at... 1) there's no functional tests for container CORS that I could find 2) the auto-insert placement isn't deterministic if you're not using either tempauth or keystoneauth19:00
*** mingyu has quit IRC19:00
*** mingyu has joined #openstack-swift19:06
*** mingyu has quit IRC19:07
*** mingyu has joined #openstack-swift19:07
*** mingyu has quit IRC19:12
openstackgerritTim Burke proposed openstack/swift master: Stop logging tracebacks when the replicator runs out of handoffs  https://review.openstack.org/52879219:12
AJaegernotmyname: The PTI does not imply that you need to run py27 two times - once with XFS, once without.19:14
AJaegernotmyname, timburke : Same for py35. Let's define one variant and run that one19:14
notmynameAJaeger: I'm totally fine with only having the definitions that require xfs. I was led to believe that adding an XFS TMPDIR as a hard requirement to anything that is running swift tests was not something that could be done. also, changing the definition for "py27" tests would add that for every project regardless of if they run swift tests, because the job definition is (was?) global19:16
notmynameAJaeger: for swift, we require the XFS change. I am 100% happy with the current situation with two job definitions. I do *not* want to try to convince every openstack project to change test environment definitions (one, it's not needed for them and two, it's hard to convince that many people of anything)19:18
notmynameif zuul 3 has changed something, that's great (eg per-project definitions of py* jobs)19:20
AJaegernotmyname: then we can merge my change - and we then remove the openstack-tox-py27 /py35 jobs from your project.19:21
AJaegernotmyname: yes, zuul v3 has this changed, have a look at my proposed change https://review.openstack.org/52858219:22
patchbotpatch 528582 - swift - Native Zuul v3 tox jobs19:22
notmynameAJaeger: ok, thanks. I'll look at it. my only concern, from the words you just said, are any perceived differences with swift not doing the "right" thing wrt testing. you know, the whole "swift is different" meme that won't die19:25
AJaegernotmyname: https://governance.openstack.org/tc/reference/pti/python.html#specific-commands has19:28
AJaeger"Some basic prerequisites for test running (system packages, database configuration, custom filesystem types) are acceptable" - so, this is fine.19:28
notmynameright, but the xfs change requires a global different definition of `tox -epy27`19:29
AJaegerLooking at my change, the only thing special is the passing of TMPDIR in so that it points to a custom filesystem type19:29
notmynameor did that change with zuulv3?19:29
AJaegernotmyname: we inherit from the global one and the only change I do is adding TMPDIR. The rest is the same...19:29
AJaegerfungi: any comments on https://review.openstack.org/528582 and whether we need openstack-tox-py27 and swift-tox-py27? I argue we don't and this fullfills the PTI.19:30
patchbotpatch 528582 - swift - Native Zuul v3 tox jobs19:30
notmynamemy understanding is that every python project must run tests when they are invoked exactly with `tox -epy27`19:31
AJaegernotmyname: see my quoted test from PTI - you can ask for some set up.19:33
fungiAJaeger: i explicitly amended the pti after discussing the xfs case with notmyname: https://review.openstack.org/39750219:34
patchbotpatch 397502 - governance - Acknowledge nominal prerequisites for tests (MERGED)19:34
notmynameAJaeger: just looked at your patch. looks fairly simple (I like that!). I don't quite understand all of it yet (mostly how it fits together). but thanks19:34
fungia little over a year ago now19:34
fungithat additional sentence was basically initiated by this use case19:35
notmynameyeah, so with that governance change and the in-project definition, it seems like we can both fulfill the PTI and simplify the jobs by removing the non-xfs-tmpdir jobs19:35
notmynameyay!19:36
torgomaticclayg: I have no answer for the functests, but I made the middleware work before auth so now placement doesn't care about your auth system19:37
AJaegerfungi, thanks19:43
AJaegernotmyname: if you don't understand it: Note that it's self testing, you see the jobs running fine on it ;) If you have questions about it, just ask and I'll try to explain and give pointer19:44
notmynameAJaeger: thanks. yeah, I'll look over the yaml schema. it's just me wrapping my head around how the parts fit together19:46
AJaegernotmyname: I'll stay a bit in the channel in case of questions - but since I'm Europe based, I won't answer forever but can then read scrollback...19:48
notmynameAJaeger: no worries. TBH it's close to lunch time for me, and I've got a bunch of other stuff going on too. I'm not doing it right now, so don't wait around for me. if I have questions, I'll handle them async in gerrit19:48
claygtorgomatic: perfecto!19:49
AJaegernotmyname: enjoy lunch...19:50
claygtimburke: i hate it when 'this needs a number %d' % '0' blows up with a TypeError :'(19:52
timburkeclayg: whomp whomp. i'll respin it, and actually add a test to cover the branch19:53
claygtest_update (test.unit.obj.test_replicator.TestObjectReplicator) hits it19:53
claygi think it just has everything mocked as unmounted so ... eventually it runs out!19:54
timburkeoh, gdi -- i haven't cleaned up my vsaio to default to an xfs tmp!19:54
claygtimburke: sorry about that - pull the latest goodies!19:55
clayg... and vagrant provision19:55
timburkethose skips should have given me a clue...19:55
*** SkyRocknRoll has quit IRC20:07
openstackgerritTim Burke proposed openstack/swift master: Stop logging tracebacks when the replicator runs out of handoffs  https://review.openstack.org/52879220:08
*** armaan has quit IRC20:21
*** armaan has joined #openstack-swift20:22
*** d0ugal has quit IRC20:36
*** d0ugal has joined #openstack-swift20:37
*** ChanServ has quit IRC20:52
*** linkmark has joined #openstack-swift20:59
*** ChanServ has joined #openstack-swift21:01
*** barjavel.freenode.net sets mode: +o ChanServ21:01
timburketdasilva: what was the status of the experimental centos7 jobs? i was worried about the failures on https://review.openstack.org/#/c/528582/ -- but checking against another recent patch suggests they're broken anyway?21:01
patchbotpatch 528582 - swift - Native Zuul v3 tox jobs21:01
tdasilvatimburke: yeah, I think they worked at some point, but I'm not 100% what's broken21:02
tdasilvatimburke: gime a few and i'm going to try to dig a little bit21:02
timburkesomething about the repos -- no erasurecode available if i remember right21:03
*** ChanServ sets mode: +v tdasilva21:03
AJaegertimburke: they are broken since bindep.txt has liberasurecode-devel which does not exist on CentOS7 - only on Fedora and openSUSE.21:03
AJaegerSo, I suggest to test on either of those instead - or drop it completely21:04
timburkewhat's weird is that it *had* worked on centos, once -- https://review.openstack.org/#/c/438758/21:04
patchbotpatch 438758 - swift - fix bindep file to enable func test in centos (MERGED)21:04
timburke(that or we lied about what platform it was in the job name)21:05
tdasilvaright, i thought at some point the rdo repo was being installed on the centos nodes21:05
tdasilvacentos-release-openstack-*21:05
tdasilvaAJaeger: ^^^21:08
AJaegertdasilva: not anymore, we removed that one some time ago...21:08
timburkeeither way, it seems like moving the job definitions in-repo must be a step in the right direction -- then we can iterate on trying to fix up centos (or fedora, or suse, or *whatever*) without a bunch of churn in -infra repos that shouldn't really care21:08
*** mingyu has joined #openstack-swift21:08
AJaegertdasilva: there was an email on the mailing list about that21:08
tdasilvaAJaeger: i trust you :) i probably missed the email21:09
AJaegerhttp://lists.openstack.org/pipermail/openstack-dev/2017-November/124613.html21:10
tdasilvatimburke: yeah, i'm fine with removing it for now and maybe we can later add it ourselves. I think one of the goals was to test swift EC with the libec that is packaged in a rhel based platform21:11
AJaegertdasilva: shouldn't be a problem to update the job to add rdo repos in this case again , best ask ianw on #openstack-infra21:11
AJaegerthe jobs are experimental, I suggest to migrate my change over as is - and then you can decide in followup what to do...21:12
timburketdasilva: i wasn't really suggesting we remove them -- just looking for how best to interpret the results :-)21:13
*** mingyu has quit IRC21:13
tdasilvaAJaeger: .zuul.yaml is the swift-tox-func job missing the TMPDIR tox_environment setting?21:13
tdasilvaAJaeger: ah, nevermind: parent: swift-tox-base21:14
AJaegertdasilva: yes, that's the trick ;)21:17
*** catintheroof has quit IRC21:20
*** hseipp has joined #openstack-swift21:24
*** JimCheung has quit IRC21:24
*** saint_ has joined #openstack-swift21:25
*** JimCheung has joined #openstack-swift21:25
*** JimCheung has quit IRC21:29
*** JimCheung has joined #openstack-swift21:29
*** openstackgerrit has quit IRC21:33
*** JimCheung has quit IRC21:36
*** JimCheung has joined #openstack-swift21:37
*** JimCheung has quit IRC21:49
*** hseipp has quit IRC21:52
mattoliveraumorning22:05
*** JimCheung has joined #openstack-swift22:16
torgomaticmorning22:18
*** JimCheung has quit IRC22:28
*** JimCheung has joined #openstack-swift22:30
*** JimCheung has quit IRC22:37
*** rcernin has joined #openstack-swift22:37
*** JimCheung has joined #openstack-swift22:39
*** saint_ has quit IRC22:40
*** JimCheung has quit IRC22:43
*** JimCheung has joined #openstack-swift22:45
*** JimCheung has quit IRC22:52
*** catinthe_ has joined #openstack-swift23:08
*** catinthe_ has quit IRC23:13
notmynamebit rot visualized https://www.youtube.com/watch?v=m4dZ4x_f4CM23:22
*** zacksh has quit IRC23:23
*** zacksh has joined #openstack-swift23:23
*** tonyb has quit IRC23:26
timburkemattoliverau (or anyone else with opinions): any thoughts on logging at warning vs error for p 528792?23:32
patchbothttps://review.openstack.org/#/c/528792/ - swift - Stop logging tracebacks when the replicator runs o...23:32
*** tonyb has joined #openstack-swift23:36
*** openstackgerrit has joined #openstack-swift23:50
openstackgerritTim Burke proposed openstack/swift master: Stop logging tracebacks when the replicator runs out of handoffs  https://review.openstack.org/52879223:50
*** d0ugal has quit IRC23:51
*** mingyu has joined #openstack-swift23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!