Thursday, 2014-05-29

notmynameGET /time   ===>> 5:07 Brain Full00:07
peluse_clayg:  I think we can find solutions for any scenario, just didn't seem like it was worth the effort out of the gate to cover those00:09
openstackgerritpaul luse proposed a change to openstack/swift: Make quarantine and tmp dirs in DiskFile Storage Policy Aware  https://review.openstack.org/9631300:15
notmynamepeluse_: ah ok. so tmp..tmp-N and quarantined/objects..quarantined/objects-N00:20
*** ozialien has quit IRC00:20
*** matsuhashi has joined #openstack-swift00:22
*** bkopilov has joined #openstack-swift00:23
claygoh no no no no00:23
claygwell... hrmm....00:23
claygso for container PUT w/o specifying the sp we were sending down the PUT to the containers bare, which when you're doing a rolling restart of your container servers to update swift.conf your nodes might have different ideas of what's the default :\00:29
claygI'm gunna have the proxy select the default and push down the spi with the request - always00:30
notmynamegood thing you have that reconciler00:31
notmyname;-)00:31
openstackgerritA change was merged to openstack/swift: Fixes probe tests with non-zero default storage policy  https://review.openstack.org/8749200:34
yuancreiht: clayg: swift-get-nodes accept the first parameter as the ring, so if the ring is specified, we could get the datadir from the ring name. we also plan to make swift-get-nodes to accept one policy name parameter, like 'swift-get-nodes -P nada a/c/o'. If you specified both the ring and the policy name and they're missmatched, it will print some alert message00:39
claygyuan: that all sounds *awesome* - good to have you in chan00:39
yuanclag, thanks, let me work harder to address this today. It's 8:40am here now.00:41
notmynameyuan: any questions or concerns on how the merge to master is happening?00:41
peluse_hey, yuan, cool!00:41
peluse_clayg:  was your 'oh no no no no' thinking aloud wrt the prev discussion or related to the tmp/quarantine patch I just submitted?00:43
*** ozialien has joined #openstack-swift00:43
*** foexle has quit IRC00:43
claygthe sp-headers thing00:45
claygi haven't looked at the tmp/q thing yet - i'm sure it's fine00:45
peluse_clayg:  OK, just checking... off tun run some errands/buy some beer.  Back in a bit :)00:45
* notmyname will likewise be in and out for the rest of the evening00:46
*** thehybridtech has joined #openstack-swift00:48
yuannotmyname: no questions here but feel really excited about it!00:48
*** fifieldt has joined #openstack-swift01:00
*** dmorita has joined #openstack-swift01:02
*** shakamunyi has quit IRC01:16
*** ozialien has quit IRC01:26
zaitcev"Downloading refs/changes/49/96049/1 from gerrit"01:26
*** Edward-Zhang has quit IRC01:26
zaitcevthere's still time to issue cd(1) without arguments and drink myself senseless01:27
*** baojg has joined #openstack-swift01:35
clayglol @ awkward unix reference to "go home"01:37
*** gyee has quit IRC01:41
zaitcevActually I meant it literally.01:43
clayglol - do you HAVE to be in ~ to drink?01:43
*** nosnos has joined #openstack-swift01:45
clayg... maybe safer01:50
*** haomaiwang has joined #openstack-swift01:51
*** mwstorer has quit IRC01:52
*** gyee has joined #openstack-swift01:54
*** tusharsg has quit IRC02:00
*** tusharsg has joined #openstack-swift02:06
*** Edward-Zhang has joined #openstack-swift02:16
*** zhiyan_ is now known as zhiyan02:34
*** matsuhashi has quit IRC03:00
*** judd7_ has quit IRC03:02
*** matsuhashi has joined #openstack-swift03:04
openstackgerritClay Gerrard proposed a change to openstack/swift: Allow to deprecate policy  https://review.openstack.org/8682703:28
openstackgerritClay Gerrard proposed a change to openstack/swift: make policies sortable  https://review.openstack.org/9634103:28
openstackgerritClay Gerrard proposed a change to openstack/swift: always send spi with container PUT  https://review.openstack.org/9634203:28
*** bkopilov has quit IRC03:28
*** nosnos has quit IRC03:33
*** matsuhashi has quit IRC03:34
*** matsuhashi has joined #openstack-swift03:35
*** matsuhashi has quit IRC03:39
*** bkopilov has joined #openstack-swift03:41
*** zhiyan is now known as zhiyan_03:47
*** shakamunyi has joined #openstack-swift03:48
*** matsuhashi has joined #openstack-swift03:56
*** Edward-Zhang has quit IRC04:03
*** shakamunyi has quit IRC04:05
*** baojg has quit IRC04:07
*** baojg has joined #openstack-swift04:07
claygyuan: you still online?04:09
*** ppai has joined #openstack-swift04:10
*** zhiyan_ is now known as zhiyan04:10
claygyuan: i took a stab at some cleanups for deprecating polices - another fix to container PUT fell out -> https://review.openstack.org/#/c/96342/104:11
*** psharma has joined #openstack-swift04:18
*** Edward-Zhang has joined #openstack-swift04:33
clayghttps://www.youtube.com/watch?v=o0YWRXJsMyM04:39
*** bkopilov has quit IRC04:40
*** bkopilov has joined #openstack-swift04:41
*** nosnos has joined #openstack-swift04:45
*** zhiyan is now known as zhiyan_04:52
madhuriclayg: need some help05:00
openstackgerritClay Gerrard proposed a change to openstack/swift: Add functional tests for Storage Policy  https://review.openstack.org/9604205:00
openstackgerritClay Gerrard proposed a change to openstack/swift: Update swift-container-info to be storage policy aware  https://review.openstack.org/9604305:00
openstackgerritClay Gerrard proposed a change to openstack/swift: Merge container storage_policy_index  https://review.openstack.org/9604005:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to Accounts  https://review.openstack.org/9604105:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to list_endpoints  https://review.openstack.org/9604605:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to Container Sync  https://review.openstack.org/9604705:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Enqueue misplaced objects during container replication  https://review.openstack.org/9604405:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add LRUCache to common.utils  https://review.openstack.org/9604505:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to ssync  https://review.openstack.org/9603405:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Put X-Timestamp in object 404 responses  https://review.openstack.org/9603505:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to the Auditor  https://review.openstack.org/9603205:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add storage policy support for the Replicator  https://review.openstack.org/9603305:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add container-reconciler daemon  https://review.openstack.org/9603805:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add reconciler probetest outline  https://review.openstack.org/9603905:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Extend interface on InternalClient  https://review.openstack.org/9603605:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Extend direct_client  https://review.openstack.org/9603705:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy Support  https://review.openstack.org/9602705:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy Documentation  https://review.openstack.org/9602605:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy support to Containers  https://review.openstack.org/9602905:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Update FakeRing and FakeLogger  https://review.openstack.org/9602805:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy support to Object Updates  https://review.openstack.org/9603105:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy support to Object Server  https://review.openstack.org/9603005:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy support to the Account Reaper  https://review.openstack.org/9604905:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to Recon Middleware  https://review.openstack.org/9604805:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Update container storage_policy_index when auditing  https://review.openstack.org/9635205:01
openstackgerritClay Gerrard proposed a change to openstack/swift: Fixes probe tests with non-zero default storage policy  https://review.openstack.org/9635305:01
claygmadhuri: nope05:02
*** shakamunyi has joined #openstack-swift05:02
madhuriclayg: ??05:03
claygmadhuri: oh heh, i thought you were asking a question05:04
claygmadhuri: what's up05:04
clayg?05:04
*** bkopilov has quit IRC05:04
*** bkopilov has joined #openstack-swift05:05
yuanclayg: thanks a lot, very cool05:05
claygyuan: !  yeah np, thanks for everything05:08
claygyuan: how you feeling on the bin scripts?05:09
*** Edward-Zhang has quit IRC05:09
*** Edward-Zhang has joined #openstack-swift05:10
yuanclayg: the tests are bit tough than the scripts05:10
clayglol - yeah that sounds about right :\05:11
*** shakamunyi has quit IRC05:14
clayghrmm.... gerrits handling of rebases is very interesting05:22
*** haomaiwang has quit IRC05:24
*** haomaiwa_ has joined #openstack-swift05:25
*** zhiyan_ is now known as zhiyan05:29
openstackgerritA change was merged to openstack/swift: Make FakeRing use more real code  https://review.openstack.org/9093305:29
claygmadhuri: did you need something?05:36
claygmadhuri: i'm about to head out05:36
claygyuan: you good?05:36
*** thehybridtech has quit IRC05:37
claygwell g'night05:37
yuanclayg: have a good sleep05:38
*** shakamunyi has joined #openstack-swift05:40
*** haomaiwa_ has quit IRC05:42
*** haomaiwang has joined #openstack-swift05:43
*** haomaiw__ has joined #openstack-swift05:47
*** nshaikh has joined #openstack-swift05:48
*** haomaiwang has quit IRC05:50
*** shakamunyi has quit IRC05:50
hugokuohow are you today06:10
*** tusharsg has quit IRC06:15
*** zaitcev has quit IRC06:20
*** tusharsg has joined #openstack-swift06:21
*** shakamunyi has joined #openstack-swift06:47
*** shakamunyi has quit IRC06:59
*** Edward-Zhang has quit IRC07:01
*** haomaiw__ has quit IRC07:05
*** haomaiwang has joined #openstack-swift07:06
*** haomaiw__ has joined #openstack-swift07:09
*** gyee has quit IRC07:10
*** haomaiwang has quit IRC07:12
*** shakamunyi has joined #openstack-swift07:25
*** Edward-Zhang has joined #openstack-swift07:26
*** shakamunyi has quit IRC07:36
*** Edward-Zhang_ has joined #openstack-swift07:38
*** Edward-Zhang has quit IRC07:38
*** Edward-Zhang_ is now known as Edward-Zhang07:38
*** ppai has quit IRC07:39
*** ppai has joined #openstack-swift07:56
*** baojg has quit IRC07:58
*** matsuhashi has quit IRC07:58
*** matsuhashi has joined #openstack-swift07:59
*** mkollaro has joined #openstack-swift08:00
*** matsuhas_ has joined #openstack-swift08:02
*** shakamunyi has joined #openstack-swift08:03
*** matsuhashi has quit IRC08:04
*** shakamunyi has quit IRC08:14
*** ppai has quit IRC08:20
*** Midnightmyth has joined #openstack-swift08:28
*** baojg has joined #openstack-swift08:28
*** ppai has joined #openstack-swift08:33
*** shakamunyi has joined #openstack-swift08:40
*** shakamunyi has quit IRC08:52
*** matsuhas_ has quit IRC08:53
*** matsuhashi has joined #openstack-swift08:58
*** foexle has joined #openstack-swift09:09
*** shakamunyi has joined #openstack-swift09:19
*** foexle has quit IRC09:21
*** ppai has quit IRC09:23
openstackgerritChristian Berendt proposed a change to openstack/swift: replaced e.message with str(e)  https://review.openstack.org/9357009:25
*** zhiyan is now known as zhiyan_09:30
*** ppai has joined #openstack-swift09:31
openstackgerritChristian Berendt proposed a change to openstack/swift: change assertEquals to assertEqual  https://review.openstack.org/9358109:31
*** shakamunyi has quit IRC09:31
*** matsuhashi has quit IRC09:33
*** matsuhashi has joined #openstack-swift09:33
openstackgerritJoel Wright proposed a change to openstack/python-swiftclient: Add importable SwiftService incorporating shell.py logic  https://review.openstack.org/8545309:33
*** matsuhashi has quit IRC09:35
*** matsuhashi has joined #openstack-swift09:36
*** mlipchuk has joined #openstack-swift09:37
*** ccorrigan has joined #openstack-swift09:37
openstackgerritChristian Berendt proposed a change to openstack/swift: change assertEquals to assertEqual  https://review.openstack.org/9358109:39
openstackgerritJoel Wright proposed a change to openstack/python-swiftclient: Add importable SwiftService incorporating shell.py logic  https://review.openstack.org/8545309:46
*** ppai has quit IRC09:49
*** shakamunyi has joined #openstack-swift09:58
*** nosnos has quit IRC10:02
*** nosnos has joined #openstack-swift10:05
*** shakamunyi has quit IRC10:05
*** shakamunyi has joined #openstack-swift10:05
*** ppai has joined #openstack-swift10:06
*** Edward-Zhang has quit IRC10:07
*** omame has quit IRC10:10
*** shakamunyi has quit IRC10:10
*** shakamunyi has joined #openstack-swift10:10
*** dmorita has quit IRC10:12
*** foexle has joined #openstack-swift10:16
*** ahale has joined #openstack-swift10:16
*** omame has joined #openstack-swift10:17
*** shakamunyi has quit IRC10:20
*** foexle has quit IRC10:30
*** ppai has quit IRC10:35
*** matsuhashi has quit IRC10:41
*** nosnos has quit IRC10:41
*** nosnos has joined #openstack-swift10:45
*** jamie_h has joined #openstack-swift10:46
*** nosnos has quit IRC10:46
*** shakamunyi has joined #openstack-swift10:47
*** nosnos has joined #openstack-swift10:47
*** nosnos has quit IRC10:48
*** shakamunyi has quit IRC11:00
*** Midnightmyth has quit IRC11:02
*** MooingLemur has quit IRC11:16
*** MooingLemur has joined #openstack-swift11:18
*** shakamunyi has joined #openstack-swift11:27
*** Midnightmyth has joined #openstack-swift11:34
*** shakamunyi has quit IRC11:41
*** ppai has joined #openstack-swift11:43
*** mlipchuk has quit IRC11:43
*** foexle has joined #openstack-swift11:44
*** haomaiw__ has quit IRC12:04
*** haomaiwang has joined #openstack-swift12:04
*** Midnightmyth has quit IRC12:06
*** shakamunyi has joined #openstack-swift12:07
*** shakamunyi has quit IRC12:20
*** haomai___ has joined #openstack-swift12:22
*** haomaiwang has quit IRC12:24
*** baojg has quit IRC12:27
*** baojg has joined #openstack-swift12:28
*** baojg has quit IRC12:32
openstackgerritJoel Wright proposed a change to openstack/python-swiftclient: Add importable SwiftService incorporating shell.py logic  https://review.openstack.org/8545312:53
*** miqui has joined #openstack-swift12:58
gholtIt's kind of amazing, that Jenkins. Fails all the time for no reason with no explanation and then just passed 4 unit tests somehow that should have had zero chance of passing (extra kwarg in __init__).13:05
gholtSystems you trust to gate your code...13:07
*** zhiyan_ is now known as zhiyan13:11
*** ppai has quit IRC13:12
*** shakamunyi has joined #openstack-swift13:16
*** shakayumi has joined #openstack-swift13:18
*** shakamunyi has quit IRC13:21
*** elambert has quit IRC13:27
gholtWith the timing, I guess the hackathon is going to end up being the code-roast-a-thon, eh? :)13:27
*** shakayumi has quit IRC13:34
*** jamie_h has quit IRC13:38
*** kenhui has joined #openstack-swift13:40
*** Midnightmyth has joined #openstack-swift13:41
*** shakayumi has joined #openstack-swift13:48
acolesgholt: you mean the test_container failures? looks like they pass for 96029 but then fail for 96030 onwards which is where the arg is removed from the proxy init.13:49
gholtYeah, I'm just realizing the new commit "set" isn't. :/13:50
gholtThe doc/saio/bin/remakerings is in one new patchset but not in the final either. And probably other stuff.13:51
gholtWell, the file is there, but not the new additions I mean.13:51
acolesgholt: took me a while to figure what was going on ;)13:51
gholtclayg: Sorry, I'm sure this is a pain in the ass, but yeah, something wonky is going on. ;)13:52
acolesgholt: hm, remakerings looks ok to me. i did fresh git review -d 96049 today13:54
gholtI'll try again, I had done a delete of the old branch and redid the review -d, but... I also did a git -m on another patch set in the chain, so maybe that effed everything up. Gotta love the whole Gerrit rewriting git history crap.13:55
acolesgholt: and once i figured it, jenkins is correct on the tests. phew, the world can rest easy ;)13:55
gholtAnd you're right, a redelete and fresh review -d got remakerings back in line. Grrr. :)13:56
acolesgholt: likewise, deleted existing branch, then review -d13:56
*** haomai___ has quit IRC13:56
gholtSo, if you ever do a git -m ... be sure to redo any dependent branches you might have.13:57
*** haomaiwang has joined #openstack-swift13:57
*** nshaikh has quit IRC13:57
gholt-m is pretty useful, so I guess it's worth the small pain13:57
gholtSo I guess just the proxy.server.Application missing kwarg is the only real issue so far.13:59
gholtclayg: ^13:59
*** bkopilov has quit IRC14:00
*** haomai___ has joined #openstack-swift14:06
*** haomai___ has quit IRC14:07
*** haoma____ has joined #openstack-swift14:07
*** haomaiwang has quit IRC14:09
*** bkopilov has joined #openstack-swift14:13
*** psharma has quit IRC14:14
*** diegows has joined #openstack-swift14:22
*** byeager has joined #openstack-swift14:26
openstackgerritpaul luse proposed a change to openstack/swift: Add Storage Policy support to Containers  https://review.openstack.org/9602914:28
openstackgerritpaul luse proposed a change to openstack/swift: Add Storage Policy support to Containers  https://review.openstack.org/9602914:37
*** jamie_h has joined #openstack-swift14:38
*** zhiyan is now known as zhiyan_14:52
*** baojg has joined #openstack-swift14:53
openstackgerritYuan Zhou proposed a change to openstack/swift: Update swift-object-info/swift-get-nodes to be storage policy aware  https://review.openstack.org/8273415:14
*** kashyapk has joined #openstack-swift15:14
openstackgerritChristian Berendt proposed a change to openstack/swift: change assertEquals to assertEqual  https://review.openstack.org/9358115:18
*** mwstorer has joined #openstack-swift15:23
*** jergerber has joined #openstack-swift15:23
*** elambert has joined #openstack-swift15:25
*** kenhui has quit IRC15:25
*** tdasilva has joined #openstack-swift15:26
openstackgerritpaul luse proposed a change to openstack/swift: Add Storage Policy Documentation  https://review.openstack.org/9602615:28
*** kashyapk has quit IRC15:29
*** gholt has quit IRC15:31
*** gholt has joined #openstack-swift15:32
*** ChanServ sets mode: +v gholt15:32
openstackgerritpaul luse proposed a change to openstack/swift: Add Storage Policy Documentation  https://review.openstack.org/9602615:33
creihtclayg: I just did a fresh checkout with git review -d 9604915:33
creihtunit tests are giving me 4 failures all with this error:15:33
creihthttp://paste.ronin.io/1c4f45d715:33
gholtcreiht: Yeah, read the scrollback and comments on the patchsets. ;P15:34
gholtAlthough, peluse_ probably clobbered my patchset comments, thanks paul. :)15:35
creihtoh15:35
creihtheh15:35
peluse_gholt:  do my best15:35
peluse_gholt:  so I'm not clear on how the split into the new patch set is causing that error.. I would think the dependencies would work themselves out such that this shouldn't happen?15:36
gholtMaybe clayg will know what to do.15:37
peluse_gholt:  I"m sure he will...  I do know that it's not a bug though :)15:38
gholtIt could be he has a split on his end somehow, but who knows, heheh.15:38
*** baojg has quit IRC15:46
*** zhiyan_ is now known as zhiyan15:47
*** zaitcev has joined #openstack-swift15:52
*** ChanServ sets mode: +v zaitcev15:52
*** zhiyan is now known as zhiyan_15:57
*** shakayumi is now known as shakamunyi15:59
*** byeager has quit IRC16:01
*** byeager has joined #openstack-swift16:02
*** mkollaro has quit IRC16:03
notmynamegood morning16:04
peluse_good morning!16:05
brianclineholler16:11
*** mkollaro has joined #openstack-swift16:11
*** zhiyan_ is now known as zhiyan16:12
claygcreiht: gholt: ok unittest thing was just a rebase snafu - i have it fixed16:17
gholtCool16:18
peluse_sweet!16:19
*** nshaikh has joined #openstack-swift16:19
clayganyway, it was a process break down - i wont make that same exact mistake again16:19
claygcan you just like... remove the object_ring kwarg from the ContainerController test's __init__ and carry on?  Or do you want me to refresh the patches?16:20
claygI really don't care - it's your inboxes - it'll come up tonight with whatever other review comments regardless16:21
*** zhiyan is now known as zhiyan_16:21
gholtShould be fine tbh, already been ignoring them.16:22
peluse_claygg:  I tried that, see patch history16:22
claygsee... what patch... history...16:22
peluse_clayg: ahh, never mind.  will just confuse things that you already have understood :)16:23
claygwell... did you push up a change to gerrit?16:24
openstackgerritpaul luse proposed a change to openstack/swift: Make quarantine and tmp dirs in DiskFile Storage Policy Aware  https://review.openstack.org/9631316:24
notmynameanyone from clouda.ca in here?16:24
peluse_clayg:  I did but I reverted it once I realized that it was a dependency and/or rebase thing.  https://review.openstack.org/#/c/96029/16:24
clayg"out dated"16:24
claygwtf?16:24
notmynamebecause today they just announced a public storage cloud powered by swift https://www.clouda.ca/technology/bulk-storage/ (which is awesome!)16:24
peluse_clayg:  I also pushed some doc updates based on early morning comments as well...16:25
gholtclayg: Hahah, peluse_ was trying to help, honest!16:25
claygpeluse_: ok... so there's fixes in gerrit that I need to get back into my changes on my local changes which has already been rebased16:26
*** bgmccollum has joined #openstack-swift16:26
claygyou guys know how people say "never rebase if you're collaborting on branches" - and gerrit says "you must always rebase" - that's fun16:26
gholtHeheh16:26
openstackgerritpaul luse proposed a change to openstack/swift: Make quarantine and tmp dirs in DiskFile Storage Policy Aware  https://review.openstack.org/9631316:27
peluse_^ man, I need a comment grammar/spellchecker16:27
claygok, i need to run will to school... i'll try and clean this up after that16:27
peluse_clayg:  so I'm thinking I'll just leave things alone there unless asked in the future :)16:28
peluse_notmyname:  cool, thanks for passing that on.  I like the website16:30
notmynamepeluse_: check out their home page. they burn hats16:30
peluse_notmyname:  Love this one:  https://www.clouda.ca/technology/bulk-storage/  "Reliable as F***"16:32
notmyname:-)16:32
notmynamepeluse_: in the office here: "reliable as a fort?"16:35
zaitcevor fish16:35
brianclinefsck?16:35
peluse_heh16:37
peluse_I have a t-shirt that I think came from an australia conf that says "what the f**k is openstack" and the two ** are little cloud icons.  Maybe that's it :)16:38
notmynameheh16:38
notmynamepeluse_: that was originally from the piston dopenstack think16:38
notmynamebut ya, the aussies were passing out a bunch of them16:40
*** Thurloat has joined #openstack-swift16:40
*** swat30 has joined #openstack-swift16:41
swat30Thurloat: yo16:41
ThurloatHey notmyname! swat30 and thurloat here from Cloud-A16:41
notmynameThurloat: swat30: hi!16:41
swat30notmyname: howdy!16:41
notmynamecool to see your announcement this morning. we were just chatting about it in here16:41
Thurloatall bad things, I presume.16:42
brianclinewatched a linuxconf video discussing zuul the other night. kinda cleared up the specifics of its purpose16:42
notmynameThurloat: swat30: this is the IRC channel where swift contributors (ie devs and ops running prod clusters) do most of our collaboration16:43
notmynameThurloat: swat30: all of the voiced people (with a "+" by their nick) are core reviewers16:44
pandemicsyn...its where we gather to be with others who's spirit has also been crushed by running Swift in prod ;)16:44
tdasilvabriancline: do you have a link of that video?16:44
pandemicsyn..kidding......mostly16:44
notmynamelol16:44
*** nshaikh has quit IRC16:45
swat30haha16:45
notmynamebriancline: zuul is a pretty interesting system, I think. I think it has the potential to be one of the things in opnestack that has lasting significance16:45
swat30I have to say that getting it setup wasn't too bad16:45
notmynamegreat to hear!16:45
*** NM has joined #openstack-swift16:45
notmynameswat30: and I'm told you're using keystone for auth?16:45
swat30notmyname: you got it16:46
notmynameare you using other openstack projects? (eg are you using nova for the VMs?)16:46
swat30notmyname: pretty much using it exclusively for all of our stuff. Nova, Cinder, Glance, Neutron, and now Swift16:46
swat30and keystone of course16:47
notmynameah ok16:47
*** byeager has quit IRC16:47
notmynamelooks like my 9:30 meeting is starting now. I'll be back later16:48
swat30notmyname: cool! great meeting you16:48
notmynameswat30: Thurloat: please stay, ask questions, answer questions. jump it. great to have you here!16:48
swat30we'll hang around16:48
brianclinetdasilva: it was this one: https://www.youtube.com/watch?v=_xkcAnWnlrY16:48
Thurloatthanks for the welcome notmyname :)16:48
tdasilvabriancline: thanks!16:48
brianclinetdasilva: however, it appears there's a newer one now: https://www.youtube.com/watch?v=xTPILCPRGeg16:48
tdasilvabriancline: ok, thx, will check it out...16:49
brianclineI think I need a business excuse to attend an AU linuxconf16:50
brianclinenotmyname: yeah, I agree. I was pretty fascinated once I heard more about which pieces it was doing behind the scenes16:50
brianclineprior to that the boundaries between it, nodepool, et al. were unclear16:50
*** haoma____ has quit IRC16:58
ThurloatIs the swift horizon dashbaord a swift thing, or a horizon thing?17:09
*** kashyapk has joined #openstack-swift17:09
swat30Thurloat: pretty sure anything horizon is done separately in the horizon project17:09
swat30separate team etc.17:10
*** zhiyan_ is now known as zhiyan17:12
*** kashyapk has quit IRC17:15
claygpeluse_: no worries, i'm sure I can get it squared - but yeah comments on the changes are the best way for me to manage things moving forward17:17
*** lpabon has joined #openstack-swift17:19
claygpeluse_: do you think it matters that the docs reference a bunch of list endpoints stuff that doesn't work until later in the patch chain when the list endpoints gets updated to work with policies17:20
claygcreiht: gholt: ^ maybe doesn't matter to you guys since you're mostly reviewing the end-of-the-line17:21
*** zhiyan is now known as zhiyan_17:22
gholtI don't think it matters, except I wonder how Jenkins will handle merges to master later.17:22
gholtAnd sorry for all the splng grmr stuff. I probably started everyone off on the wrong foot. ;)17:23
*** jergerber has quit IRC17:23
gholtMan, assertEquals really offends that guy; to the tune of way over 4,000 lines. I'm pretty if Python dropped assertEquals we could just add quick support for it calling assertEqual for us.17:26
*** pconstantine has left #openstack-swift17:27
*** pconstantine_ has joined #openstack-swift17:27
gholtCases like that call for a BDFL that says, "Please direct all that energy to something more useful."17:28
peluse_clayg:  yeah, I don't think it matters, everyone knows its a patch chain17:28
*** bena has joined #openstack-swift17:28
peluse_just curious, whats wrong with assertEuals anyway?17:29
gholtThey deprecated the plural form.17:29
claygwho "deprecated" it?  i don't think it raises a warning?17:30
peluse_gholt:  the spelling/grammar stuff is all my fault.  I feel bad it amde it this far with that many stupid things left, honestly it was reviwed like 12 times before you saw it.  Imagine how bad my first cut was :)17:30
gholtHeheheh! That's going to be true for any of us.17:30
claygdoes anyone know how to get ahold of Thiago da Silva?17:31
peluse_I keep trying to blame my keyboard but every time I buy a new one it just doesn't gett any better, can't figure it out17:31
peluse_clayg:  what would you like done to him?17:31
clayghe made a comment regarding policy "types" - and I agree that support was sorta half-baked, but it made a *little* since in the replicators so they could skip policy datadirs that weren't of type replication17:31
gholtAll I have is the email from Gerrit that says he works at RedHat.17:32
openstackgerritDonagh McCabe proposed a change to openstack/swift: Allow swift-recon to easily integate with Nagios  https://review.openstack.org/9652917:32
clayganyway, i don't really know how to address his comments - I guess he wants more doc - but it's really on there as a stub, since there's only one supported type and it's the default if not specified - it doesn't really need to be documented17:32
peluse_clayg:  yeah, I commented on the comment because he also made it on the feature/ec version.  We could add a list of currently supported types in that section and that would probably make it clear enough17:33
peluse_clayg:  I have his email, will send it yo you17:34
benaHI! just a comment. I am performing a test. I would like use s3curl.pl to connect to openstack swift. I found an example but I have doubt related to swift account:user (example: ./s3curl.pl --id '<account>:<user>' --key <password> --get -- -k -v -s http://<my IP>:8080). Have you any idea about what account,user I should use?17:34
claygpeluse_: you marked some of acoles comments "done" in patchset 2, i think i got all of your changes merged into my working set - so I guess those should all be addressed.17:36
peluse_clayg:  yup.  also, check private conversation for that email adddress17:37
*** gyee has joined #openstack-swift17:37
gholtbena: Have you ever used Swift with Swift tools before? If so, you should have an account and user from that.17:39
* peluse_ stepping out for a few hrs....17:41
bena+gholt I only download and install devstack with swift but I did not use Swift with swift tools.17:42
bena+gholt also I added swift317:42
claygpeluse_: ok so I think Thiago's point is that if you're doing swift-on-file it's silly to have the policy type described as "replication" in the /info call?17:42
claygnotmyname: i'm just removing the Copyright line from the source files that attribute it to OpenStack Foundation17:45
*** byeager has joined #openstack-swift17:46
*** byeager has quit IRC17:46
*** byeager has joined #openstack-swift17:50
*** ozialien has joined #openstack-swift17:51
*** byeager has quit IRC17:51
*** byeager has joined #openstack-swift17:52
*** wasmum has joined #openstack-swift17:53
*** byeager has quit IRC17:53
wasmumany swiftstack owners/operators have time for a quickie swift_undelete?17:54
*** byeager has joined #openstack-swift17:54
ctenniswhat's up wasmum?17:55
clayggholt: heh, it's going to have to be iter(self.by_index.values())17:56
*** openstackgerrit has quit IRC17:57
claygpeluse_: so do you have a better name for Policy_0 - i'm fixing acoles bug17:58
wasmumctennis: thanks17:58
wasmumctennis: is the swift_undelete porject still active?   Doing a python setup.py install results in the package being installed as /usr/local/lib/python2.7/dist-packages/swift_undelete-_VERSION_-py2.7.egg17:59
wasmumctennis:  i add just 'undelete' delete in the pipeline, tried 'swift_undelete" as well17:59
wasmumctennis: not much docs on usage, so just trying to get this in and tested17:59
ctennisyeah, it's still active, lemme look18:00
wasmumctennis: thank you, sir.18:00
ctenniswasmum: It's part of our commercial package, I think it was open sourced but without much detail and probably wasn't tested standalone.18:01
wasmumctennis: thank you, Sir.  I'll see if I can do something with it.  do you all want a pull request if we can get it working in a standalone env?18:02
alpha_oriwasmum: Yeah, in its current state it's probably only of casual interest as long as its restrictions / performance characteristics fit your use case.18:02
ctenniswasmum: absolutely18:03
alpha_oriwasmum: yeah, definitely.18:03
alpha_oriwasmum: We intend to do some more focused development on it this summer.18:03
acolesclayg: i wonder if you want to just make Policy_0 reserved?18:03
wasmumalpha_ori: great!  ctennis: I'll see what I can come up with thanks to both of you!18:04
ctenniswasmum: you bet18:04
*** bena has quit IRC18:04
*** zhiyan_ is now known as zhiyan18:13
claygacoles: yeah that's a bug that I guess could happen - so we'll prevent it.  I really want to have a better name for the existing policy exposed in /info when you upgrade your cluster w/o updating swift.conf18:14
gholtI guess bena left. tbh, I probably wouldnt' be much help to him anyway :/18:16
*** ozialien has quit IRC18:18
Dieterbeseeing a weird issue. I'm using https://github.com/ncw/swift which returns a list of all objects in a container, for a given object it claims the size is 0, though when i run "swift stat...." the file is 470MB, which i can confirm by downloading the file18:21
Dieterbewhen i sniff the traffic between the library and swift, i see it queries /v1/AUTH_vimeo/uploads?format=json&limit=1000018:21
Dieterbebut interestingly, the file doesn't even seem to appear anywhere in the network traffic.18:21
Dieterbedoes any of this make sense somehow? perhaps because of segments?18:21
*** zhiyan is now known as zhiyan_18:23
*** byeager has quit IRC18:31
notmyname /back18:31
*** byeager has joined #openstack-swift18:31
notmynameclayg: you're looking for tdasilva18:34
*** byeager has quit IRC18:36
Thurloatwb notmyname18:36
Thurloatthanks for the shoutout on the twitter earlier.18:37
claygnotmyname: I'm probably looking for peluse_ - I want to figure out if we just drop types - or if we're going to have to bite the bullet and make it extensible now.18:37
claygnotmyname: peluse_: maybe if we just we just pull it out of /info we can punt on it for now?18:38
notmynameThurloat: I'm your local swift social media maven18:38
ThurloatI'll solicit you for an RT in a couple weeks when we roll out more of the swift features, haha18:38
claygbut if someone were to configure a storage policy with object server's using swift-on-file DiskFile it would be silly for the policy with the name GlusterFS to say it's type is 'replication' - and since those nodes won't even been running the object-replicator there's no need for the type field to be there to "skip" those directories18:39
wasmumctennis: for what it's worth, this is the issue i get statically specifying a version in setup.py and then adding it to the pipeline:18:39
wasmumLookupError: Entry point 'main' not found in egg 'swift_undelete' (dir: /usr/local/lib/python2.7/dist-packages/swift_undelete-1.1-py2.7.egg; protocols: paste.filter_factory, paste.filter_app_factory; entry_points: )18:39
wasmumctenni: I'm not even sure if it likes my stanza in the pipeline.  well, off to the races i guess.18:40
notmynameclayg: what are we pulling out of info? I think I missed the context. I think you're talking abut storage policy types maybe?18:40
claygoh shit, gholts last comments were on the update fake's chagne - he must be on the container change now :\18:41
claygnotmyname: yeah from tdasilva from redhat asking about why types are there if there's only one type?18:41
claygpeluse_: did you push some changes onto 96029 as well?  I have no idea how I'm going to track down if i'm stomping on anything you did from underneath me man :\18:42
gholtclayg: Actually, I haven't done much reviewing in the past couple hours.18:43
notmynameclayg: peluse_: ah. yeah I had a similar question, but I can see why it would be more important to tdasilva :-)18:43
claygok, well the stupid kwarg thing on the one change that i had to add in when i moved a test to an earlier commit but didn't pull out again in the later commit made last nights rebases pretty messy - and I think i'm all caught up on this mornings comments/changes (mostly docs, yay!) - do you guys want a clean push or just wait till tonight?18:46
claygpeluse_: and nm, regarding the changes on 96029 - i see what you were trying to do - it's fine.18:47
claygpeluse_: did you push anything else - or just that and docs?18:47
*** byeager has joined #openstack-swift18:49
tdasilvaclayg: yes, I agree that in the case of swiftonfile it seems a little strange to define the type as 'replication'18:55
gholtFrom this office, I think it's fine if you want to push right now. I think everyone is off doing other things atm.18:55
tdasilvaclayg: this would also be the case for swift-ceph-backend and other backends that don't rely on swift replication18:57
dmsimardHi, does anyone know if it's possible to have the ceilometer swift middleware talk to the ceilometer-api instead of the bus/database backend ?18:59
notmynamedmsimard: the ceilometer middleware is managed by the ceilometer team, so you should ask there19:00
dmsimardnotmyname: I'm trying my luck here, haven't had much luck in #openstack-ceilometer :)19:00
claygtdasilva: yeah ok, point taken, when peluse_ comes back we'll figure out what we'll do there for now - thanks for the reviews - keep going!19:01
tdasilvaclayg: great work by you guys! will try to do some more reviews later today...19:03
*** pberis1 has joined #openstack-swift19:03
wasmumctennis:   got it19:03
wasmumctennis:  this will work on a syncstack aio19:04
wasmumctennis: i just had my middleware filter dorked19:04
wasmumctennis: it should look like: [filter:swift_undelete] paste.filter_factory = swift_undelete:filter_factory19:05
wasmumwith the swift_undelete loaded in the pipeline before the proxy server19:05
wasmumin the setup.py, you can optionall set a version19:05
peluse_clayg:  I'm back19:05
peluse_clayg:  wrt types maybe only add it to /info if its not replication?19:06
*** openstackgerrit has joined #openstack-swift19:06
*** pberis has quit IRC19:07
peluse_clayg: wrt other changes I pushed, I believe just the doc19:07
ctenniscool wasmum19:07
peluse_clayg:  others I limited to just comments so you don't get all sorts of crap to sort out19:08
peluse_clayg: wrt Policy_0 I don't have a better name but do agree for now a minimum would be not to allow that as a user selected name19:08
peluse_tdasilva:  BTW, yes, thanks for the reviews - thanks to everyone for that matter -- easy for me to say since clayg is cleaning up after all of the comments :)19:09
*** openstackgerrit has quit IRC19:13
*** zhiyan_ is now known as zhiyan19:14
*** kashyapk has joined #openstack-swift19:15
*** kashyapk has quit IRC19:22
claygpeluse_: maybe LEGACY, DEFAULT sounds better but seems confusing if someone defines a policy-1, makes that the default, and doesn't give a name/section for storage-policy:019:22
claygpeluse_: adding the PolicyError for when name == default and index != 0 was trivial19:23
*** zhiyan is now known as zhiyan_19:24
claygpeluse_: re: type - i'm more keen on just ripping it out for now, and i'm not sure I see the value of having it in /info at all - we expect the interface to be the same from the clients persepctive19:27
peluse_clayg:  yeah, I've done down the legacy and default ideas before and legacy sounds so, I dunno wrong, and default I agree is confusing with our other defn so that's how I ended up at Policy_019:27
peluse_clayg:  I think when we add EC though we will want something descriptive in /info to indicate that its EC19:27
notmynamepeluse_: maybe. maybe not19:28
claygmaybe we name it LEGACY or something and if it's hte only policy defined don't show anything in /info?19:28
peluse_clayg:  yeah, I'm down with that19:28
notmynamewhat about a non-required field that is something like "notes" where the deployer can say whatever they want up to 500 chars or something?19:28
claygpeluse_: well you have the *name* field which can be anything - if you don't want to call it "achive-large-data" you could always stick the "erasure-encoded" in the name?19:28
claygnotmyname: yeah, i guess - but then you have product managers telling swift deployers to update their marking docs in the swift.conf!19:29
peluse_or "description"...19:29
notmynameya, description is good19:29
claygmeh19:30
notmynameclayg: is that a big concern?19:30
claygnotmyname: yeah?  swift.conf is not the right place for that kind of crap - it's like really important not to f' it up19:30
claygI'm going to do a push - everyone go clean out your inboxes and ignore the scrollback19:31
* peluse_ is holding on...19:31
clayghrmm...19:32
peluse_only 27 or 28 emails :)19:33
claygdunno why the channel didn't gripe at us19:33
*** openstackgerrit has joined #openstack-swift19:34
notmynameopenstackgerrit: oh hai19:35
peluse_sympathy maybe?19:35
*** foexle has quit IRC19:37
claygok, i'm going to pull down the policy_string on q/tmp change and see about adding that19:41
claygi really don't know about the description feild19:41
notmynameclayg: don't worry. swifterdarrell just explained how wrong I am :-)19:42
claygfor 1) the swift client support for formatting tall that nested json junk is kinda weak19:42
claygI think the name has to be there because it's part of the api - and probably the default - same reason19:42
peluse_clayg:  we can always punt for now and just rip type from /info and deal with when it will actually be needed, when we add EC19:42
claygeverything else you put somewhere and reference by name19:42
claygpeluse_: even then I don't know if the "type" enum needs to be in /info - and more to the point I'm not sure how far we can get away with it as an enum19:43
*** kutija has joined #openstack-swift19:43
claygi think there's an idea that proxy code will just grow "if policy.type == 'ec': a bunch of code elif type == 'replication': a bunch of code19:44
notmynameso pull it out for now and add it back when needed19:44
claygbut I think it's really going to just have to get something_the_proxy_needs = policy.get_something()19:44
notmynameand then we can determine (orthogonally) if there is a need for an annotation on /info19:44
claygnotmyname: so leave it in there half-baked and pull it out of /info - or just rip out types until we know what f we're doing?19:45
notmynameclayg: the 2nd19:45
claygyay!  right answer ;)19:46
claygpeluse_: sorry19:46
notmynamelol19:46
claygi'll work on it on the train - heading into the office - looking forward to more comments on those reviews guys - i feel like you're just about to dip into the good stuff :D19:46
peluse_hey, I'd rather get this on to master now and worry about EC as a separate discussion19:46
claygpeluse_: i could also maybe use some help with the doc updates for depercation support - which I just rolled into the laste change19:47
peluse_clayg:  can do, just let me know which patches are safe to push on w/o screwing your system up19:47
peluse_clayg:  I have time right now if that works19:48
claygpeluse_: probably just a diff would be best?19:48
*** Thurloat has quit IRC19:49
claygyou could also do a PR against github.com/clayg/sp-base (i don't think i ever turned on collaborator for you, but I should...)19:49
creihtis it safe to check the code out now?19:49
glangenever19:49
claygcreiht: yeah thanks - sorry for this morning - i should have peeked at gerrit last night before i went to bed19:50
claygi was up watching into darkness (which is free on netflix btw, and not terrible)19:50
peluse_clayg:  not totally following you, maybe I took too many allergy pills this morning...19:50
claygpeluse_: dont' push over any of the changes purposed to master PLEASE19:50
claygpeluse_: any other way you can think of to get me code is fine19:50
peluse_clayg:  gotcha19:50
claygemail a diff, paste something, push somewhere else19:50
peluse_print out some stuff, fax it.. whatever it takes :)19:51
claygi know at the conference i was all about more collaboration on changes, but this patch chain stuff is already complicated enough thanks to gerrit19:51
claygnotmyname: oh... one more PTL hammer19:52
peluse_clayg: I hear ya19:52
notmynamewhere?19:52
claygnotmyname: do you want POLICY_HEADER and BACKEND_POLICY_HEADER - or do you want to just use string literals 'X-Storage-Policy' and 'X-Backend-Storage-Policy-Index' everywhere?19:52
notmynamethe global constants is fine. seems better long-term probably19:53
notmynameclayg: oh are you changing the name too? :-)19:53
gholtX_BACKEND_STORAGE_POLICY_INDEX should work19:54
clayggholt: yup19:54
claygnotmyname: the thing about the constants - although it's nice for flake8 - it's not like you can just change the constant and it doesn't matter - in an upgrade it's a terrible mess... like they can't really change19:55
notmynameclayg: I don't feel strongly about it either way. I figured it would be easier to have them because it's already there19:55
gholtSo its use should just be to make typing easier and typos harder or at least detectable.19:55
claygplus in some places the code needs to say env['HTTP_X_BACKEND_STORAGE_POLICY_INDEX'] - shoudl i have a constant for that too?19:55
notmynamebut what gholt said :-)19:56
clayggholt: ok, so what's easier to type than X-Backend-Storage-Policy-Index19:56
peluse_yeah, I made them constants because very early on we kept changing the name and I was tired of search and replace everywhere, plus I was making typos left and right :)19:56
gholtBACKEND_SPI :)19:56
claygright now it's POLICY_INDEX which is ok, but notmyname says he doesn't know it's a header19:56
gholtThat'll make everyone equally unhappy.19:56
peluse_hey notmyname, that's a header :)19:56
notmynamepeluse_: thanks!19:56
peluse_hehe19:57
claygyeah i don't love the acronyms, or silly short spellings like HDR19:57
gholtOh, gotcha, it is already a constant, I forgot already.19:57
claygnotmyname: so anyway, PTL hammer19:57
gholtHeheh19:57
peluse_clayg:  yeah, I'm guilty of silly short abbreviations from past jobs - long history of doing that so will take me a while to break it19:57
gholtI do comment how we need more of that BDFL attitude around here.19:57
clayggholt: go for it - no one would dare chanllenge the gholt19:58
peluse_I know how much you love idx means "index" too19:58
claygyah now that i have __init__ i'm all about the int(policy)19:58
clayger... __int__19:58
claygwow muscule memory19:58
gholtclayg: Hah, I'd have to be PTL to be BDFL, and we know that's not my path, heheh.19:59
creihtlol19:59
clayggholt: i'm just saying in this cause you can throw the hammer just as easy19:59
gholtOh, gotcha. Thanks :)19:59
notmynameclayg: you're the one actually typing in the code. :-)20:00
claygin this *case* - and lots of other cases too20:00
claygheh, i got used to POLICY and POLICY_INDEX - at least they're words20:00
claygat first I was much more in the camp of just type the strings20:00
peluse_it used to be POLICY_IDX :)20:00
claygoh god20:00
claygis it tx_id or tnx_id or txn_id?20:01
gholtone's for your driver's license here20:01
clayglol20:01
claygfuck it; they stay as is for now20:01
notmynameif you need a decision, then: use the constants20:01
claygi'm going to go fart with removing types20:02
gholtHeheheh20:02
claygnotmyname: ok, good, we *have* constants (but not for env['HTTP_X_BACKEND_STORAGE_POLICY_INDEX']) - and they're named POLICY and POLICY_INDEX - and that's confusing because they don't look like they're headers, but we don't have other constants for headers, so everyone can get used to it - DONE20:03
peluse_clayg:  how many cups of coffee have you this today so far?20:04
notmynamepeluse_: I'm guessing none ;-)20:04
gholtMore muscle memory on the prior post, clayg?20:04
clayg3, but i just poor my mug20:04
notmynameya, I'd prefer that it would have _HEADER on there, but it doesn't seem like many others are concerned by that, so it's not a big deal to me20:05
clayggholt: no i don't think so...20:05
*** wasmum has quit IRC20:05
gholtOkay, sorry, I'm just 5y old and found it tremendously funny. You know me.20:05
claygi glad folks are having a good time - me too!20:06
peluse_heh, OK, I'm gonna go add some dececation info to the docs - err I mean deprecation info.  clayg, I'll post a diff somewhere for you in a bit20:06
claygnotmyname: ok, i'll tack a _HEADER on them20:06
claygi'm offline for a bit20:06
*** byeager has quit IRC20:11
*** byeager has joined #openstack-swift20:11
peluse_clayg:  I'll also do the doc update for the pending tmp and quarantined dir updates20:13
*** zhiyan_ is now known as zhiyan20:15
*** byeager has quit IRC20:16
*** kashyapk has joined #openstack-swift20:19
-openstackstatus- NOTICE: Gerrit is going offline to correct an issue with a recent project rename. ETA 20:45 UTC.20:21
*** ChanServ changes topic to "Gerrit is going offline to correct an issue with a recent project rename. ETA 20:45 UTC."20:22
*** jergerber has joined #openstack-swift20:22
*** kashyapk has quit IRC20:23
*** openstackgerrit has quit IRC20:25
*** zhiyan is now known as zhiyan_20:26
peluse_sheesh20:31
notmynamepeluse_: you didn't want to review any code, did you?20:32
peluse_nah, there's nothing up there :)20:34
*** swat30 has quit IRC20:37
*** ChanServ changes topic to "Storage Policies have been proposed to master. Soft freeze in effect until these patches land | First SP patch: https://review.openstack.org/#/c/96026/ | Last SP patch: https://review.openstack.org/#/c/96049/"20:40
-openstackstatus- NOTICE: Gerrit is back online20:40
*** byeager has joined #openstack-swift20:42
zaitcevportante: sorry it took me 3 years, but xattr is a problem no more https://bugzilla.redhat.com/show_bug.cgi?id=110292620:44
portantegreat, thanks20:46
portantewill the Fedora community actually accept that, though?20:47
*** byeager_ has joined #openstack-swift20:49
zaitcevIt certainly is a downstream patch to be carried forever, which we do not like in general.20:49
zaitcevHowever, I think I considered various approaches. We could go ahead and package python-xattr. Russell had a review languishing somewhere.20:50
*** byeager has quit IRC20:50
portanteWhich is more likely to be accepted by Fedora?20:51
*** shakamunyi has quit IRC20:51
*** shakamunyi has joined #openstack-swift20:52
*** ozialien has joined #openstack-swift20:54
zaitcevportante: I sent e-mail to rbryant seeking his opinion.20:58
*** byeager_ has quit IRC20:59
portantegreat20:59
zaitcevyou're on cc20:59
*** byeager has joined #openstack-swift20:59
zaitcevI need to work on being more laconic.21:00
portantethanks21:00
zaitcevoh nice, I already have xattr tag https://slasti.zaitcev.us/zaitcev/xattr/21:02
peluse_clayg:  just emailed you some doc updates - let me know if you don't get them21:03
zaitcevNOW21:03
*** fifieldt has quit IRC21:03
zaitcevWith that 3-year-old monkey of xattr off my back, I may turn to Storage Policies and tear them like cat a coach.21:03
zaitcevUnless Peter finds some other horror in Red Hat Distribution of OpenStack (RDO[tm]).21:04
peluse_well that sounds enthusiastic (I think)...21:04
dfgclayg: you there?21:07
*** lpabon has quit IRC21:10
*** shakamunyi has quit IRC21:14
claygdfg: ohai21:17
claygpeluse_: thanks21:17
*** zhiyan_ is now known as zhiyan21:18
claygpeluse_: fwiw the types extraction went over pretty well21:18
dfgclayg: just added a comment on one of them.21:18
peluse_clayg:  sweet21:19
claygthe renaming of the POLICY constants is going to be more work (the sed introduce a bunch of flake8's) - so i'd just like everyone to be sure about POLICY_HEADER and POLICY_INDEX_HEADER21:19
dfgclayg: going to my swift reviews page and seeing a gazillion patches all added by you in the same minute is giong to become a recurring nightmare for me :)21:19
creihtheh21:20
*** fifieldt has joined #openstack-swift21:20
creihtclayg, notmyname: It might be useful to have a wiki page with a link to all of the policy reviews in order21:20
creihtto make it easier to keep track of21:20
claygdfg: yes, i'm sorry for that - perhaps I can never ever ever do this again?21:20
notmynamecreiht: (like gholt) I've got a star on the first and the last one21:20
dfg:) no- its just because of gerrit21:21
claygcreiht: too bad stupid gerrit can't just cough up somethign like that for us21:21
*** NM has quit IRC21:21
creihtclayg: yeah21:21
creihtnotmyname: hrm21:21
* creiht goes to look21:21
claygso this page is not *terrible* but it's not in order either - https://review.openstack.org/#/q/status:open+project:openstack/swift+branch:master+topic:bp/storage-policies,n,z21:22
notmynamecreiht: I cna get it. will only take a few minutes21:22
creihtclayg: I think that is decent enough21:23
claygdfg: when you have a comment can you go ahead and stick on -1 on it21:24
claygdfg: a) it' helps me keep my moral beat down b) i can find it21:24
dfghaha21:24
dfga) is enough :)21:24
glangewow21:24
dfgcrap- now I don't know where i added it...21:25
claygtorololoololololo21:25
claygglange: when are you going to start reviewing it?21:25
dfghttps://review.openstack.org/#/c/96027/321:25
peluse_dfg, I saw it... was hunting through my archives to remember the justification - that lazy loading of the ring dates back to early last summer21:25
glangeI read the docs :)21:25
claygglange: no grammer fix comments!?21:26
dfghe had some but they were all wrong21:26
glangemy grammer is not 100%, I thought maybe you should have a tech writer go over it :)21:26
glangegrammar! <-- it has an "a"21:27
*** zhiyan is now known as zhiyan_21:27
glangeit had a very conversational style :)21:27
notmynameclayg: http://b.z19r.com/post/did-you-just-tell-me-to-go-fuck-myself ?21:28
dfgpeluse_: clayg seems like it would be better to load it on proxy init. there aren't going to be too many of these things are there? and it would be slow to pull it in on a per request basis. also the 500 needs to get fixed.21:30
peluse_dfg... hmm I found the patch where I used to instantiate all the rings at init... looking for the input from torgomatic where we changed it21:30
peluse_it had to do with how the proxy test code ended up....21:31
claygdfg: yeah that's weird, what happens on master if you don't have an object.ring.gz21:31
dfgclayg: ya I just tried it out. maybe i'm full of it...21:32
dfgclayg: oh- the same thing. proxy starts and 500s when you get an obj21:33
claygdfg: no no no, we can make all the things better21:33
dfgwell- maybe you can :p21:33
*** openstackgerrit has joined #openstack-swift21:34
claygidk, werid, so does master do the same thing with container/account rings?  or only objects?21:34
peluse_same thing if the ring is missing you mean?21:34
claygyeah21:34
claygi guess with the automatic reloading of the ring data maybe it's... idk - very strange21:35
*** NM has joined #openstack-swift21:36
dfgpeluse_: ya-21:36
*** byeager has quit IRC21:37
claygpeluse_: dfg: i'm cool with a for policy in POLICIES: policy.load_ring(swift_dir) in proxy's __init__21:37
peluse_so I can't find details on why we changed to lazy loading, just found the change.  I'm certain it was because of unit test's ability to pass in a ring collection.  So many things have changed in that area since that decision was made maybe its something to think about now, clayg?21:37
dfgclayg: ya- if there's no container.ring proxy won't start21:38
peluse_clayg:  that's basically how it was21:38
*** byeager has joined #openstack-swift21:38
peluse_here's the original and the next patch is when we changed it https://review.openstack.org/#/c/39839/26/swift/proxy/server.py21:39
dfgwell. it seems better to me. but on the other hand I'm only on like the 4 patch of like 50 so what do I know. i guess just wait for what others say etc.21:40
peluse_its very possible that the reason for the lazy loading no longer exists.  the policy module itself looks very different today than it did back then21:40
peluse_clayg:  want me to mess with it?21:41
creihtIf there isn't a good reason for the lazy loading, I would prefer to load on start21:41
peluse_OK, I'll snadbox it for a few and see where it goes...21:41
dfgclayg: peluse_ : i21:42
dfg'm an idiot. master does blow up if there's no obj server (i didn't actually switch to master before) sorry21:42
dfgfuck21:42
dfgmaster does blow up if there's no object.ring.gz21:43
peluse_peluse:  sorry, could have mentioned that.  That's the main reason why we didn't do anything about the fact that things blow up if a policy ring is not there21:43
dfgso anyway- i like the "for policy in POLICIES: policy.load_ring(swift_dir) in proxy's __init__" idea.21:44
claygcool - i've already got it hacked up - i'll see what needs to happen to get some tests around it - you'll see in tonights changes21:44
claygdfg: thanks!21:44
clayganyone going to bite on the POLICY_HEADER and POLICY_INDEX_HEADER name changes?  because of the flake8 word I only want to change 'em once21:45
notmynamecreiht: https://wiki.openstack.org/wiki/Swift/PriorityReviews21:46
creihtnotmyname: awesome, thx21:47
*** openstackgerrit has quit IRC21:47
peluse_clayg:  rock on21:47
*** ujjain has quit IRC21:50
*** Thurloat has joined #openstack-swift21:52
*** jamie_h has quit IRC21:53
creihtwhere is storage policy type documented?21:54
peluse_clayg:  FYI I had already hacked in the 2 lines you mention and it exposes a few errors in test code that defines policies but not corresponding rings (because they weren't loaded on init before).  I'll leave it alone unless you want me to tackle the 3 errors I see anyway21:54
claygcreiht: trying to get rid of that - did you find a refrence to it in the latest change - or maybe you had it in an old config?21:55
*** ujjain has joined #openstack-swift21:55
peluse_clayg:  its still in the docs until you take the stuff I sent you (type that is)21:55
claygpeluse_: i'll find 'em no worries21:55
*** tusharsg has quit IRC21:55
peluse_cool, let me know if you want help21:55
claygpeluse_: i pulled it out21:55
claygpeluse_: or rather i guess i *tried* to pull it out21:55
peluse_:)21:55
claygoh, unless maybe that wasn't in the last push?21:56
claygyeah i guess I did that on the train21:56
creihtclayg: ahh cool21:56
claygcreiht: types are going away ;)21:56
claygcreiht: it was pre-mature21:56
creihtclayg: https://review.openstack.org/#/c/96027/3/etc/swift.conf-sample21:56
peluse_you pulled it out pre-maturely, is that what you're saying?21:56
peluse_and on a train no less :)21:57
claygpeluse_: no... i mis-spoke is all, the changes in gerrit still have types - but tomorrow they won't21:57
creihtk21:57
creihtI'll ignore it then21:57
claygreviews indicated that they either need to not be there or they need to be a bunch different21:57
claygwe choose they don't need to be there (or notmyname did anyway and I was happy with that)21:57
creihtyeah that makes sense to me21:58
peluse_creiht:  FYI we'll need something to address what they were there for when we add EC though... that's why it was there (but really as a stub for now) thus no real need at the moment21:58
claygpeluse_: i think even that is TBD, well need *something* - it may not look anything like a static list of strings that was VALID_TYPES before, and it may not be exposed in /info directly - but since we'll need to argue about it - they're gone for now!22:00
*** jergerber has quit IRC22:02
*** byeager has quit IRC22:06
peluse_nope, I'm with ya, that why I said "something" and not "types"....22:09
*** swat30 has joined #openstack-swift22:09
*** byeager has joined #openstack-swift22:09
*** shakamunyi has joined #openstack-swift22:11
mattoliverauMorning22:11
bgmccollumi guess i missed this, but why was `swift-object-expirer` separately packaged in Ubuntu? Is the idea that it could be run external to an object server, so it needed to be packaged separately?22:16
notmynamebgmccollum: it's a separate daemon. I can't tell you why it's separately packaged, but it is independent of the object server22:17
bgmccollumright...but it used to be installed with just object-server...22:17
bgmccollum*shrug*22:17
*** zhiyan_ is now known as zhiyan22:18
notmynamebgmccollum: you should take that up with your cannonical rep ;-)22:18
bgmccollumits easy enough to just add to the list of packages to install...i guess i just missed the heads up wherever that would have been.22:19
notmynamebgmccollum: normally you should tell people to run the expirer process on an admin server in the cluster. and you can add more if you have a lot of expiring obejcts. but it's not 1:1 with the object servers22:19
bgmccollumnotmyname: which probably explains the separate package. thx.22:20
creihtshould we make the policy names non-case sensitive?22:20
claygcreiht: yeah, the names are used in header keys sometimes (e.g. account response)22:21
claygcreiht: can you ding something somewhere?22:21
claygcreiht: good one22:21
creihtclayg: will do22:21
*** shakayumi has joined #openstack-swift22:21
*** shakamunyi has quit IRC22:22
*** kashyapk has joined #openstack-swift22:23
*** zhiyan is now known as zhiyan_22:27
*** kashyapk has quit IRC22:28
creihtso if a storage policy is marked as deprecated, users can read objects, but they can't put any more objects with that policy?22:35
*** Midnightmyth has quit IRC22:36
claygcreiht: the reconciler.conf stuff should be there later with the reconciler change - i wasn't really sure how to handle docs for that - the list endpoint stuff is in the docs even though that doesn't show up till later - does it matter if i move it or not?22:41
creihtclayg: doesn't matter to me as long as it is in the pipe22:43
claygyeah it is22:44
creihtcool22:44
peluse_creiht:  a container can contiue to be used you just can't create new continaers22:44
creihtpeluse_: ahh ok22:44
mattoliveraucreiht: the way i read the code was when a policy is deprecated, new containers couldn't be created with it, but the existing one remained, so those uses could still add to the etc. However the deprecated policy wont show up in /info.22:45
mattoliverauor simply what peluse_ said :P22:45
creihthehe22:45
creihtyeah I realized I was misreading it22:45
creihtand probably a good time for me to call it a night :)22:45
peluse_yup, I just added all that to the docs too.  Well, I sent to clayg and he'll add it to the chain at the next opportunity22:45
mattoliveraulol, some of us are only just waking up :P22:45
creihthehe22:46
* creiht hands off the baton :)22:46
peluse_yup to time to call it a night but to what mattoliverau said :)22:46
peluse_sheesh, I think you know what I mean.  I can't seem to get the words out correctly22:46
creihthehe22:47
mattoliverauLol, well you both better sleep then :) For us aussies, Friday morning has started, and the weekend isnt too far away!22:47
peluse_nice!22:52
mattoliverauSpeaking of which, I think its coffee time so I actaully wake up. brb22:52
*** byeager has quit IRC22:55
*** Edward-Zhang has joined #openstack-swift22:57
*** NM has quit IRC23:03
*** GoJkOrS has quit IRC23:14
*** sungju has joined #openstack-swift23:19
*** zhiyan_ is now known as zhiyan23:19
*** mkollaro has quit IRC23:28
*** zhiyan is now known as zhiyan_23:28
*** shri has joined #openstack-swift23:40
*** tdasilva has left #openstack-swift23:42
*** elambert has quit IRC23:47

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!