Wednesday, 2017-09-20

openstackgerritMerged openstack/swift feature/deep: sharding: test container listing merging old db and pivot db  https://review.openstack.org/50394400:00
*** catintheroof has quit IRC00:49
*** catintheroof has joined #openstack-swift00:49
*** catintheroof has quit IRC00:50
*** bigdogstl has joined #openstack-swift00:50
*** mat128 has joined #openstack-swift00:51
*** bigdogstl has quit IRC00:52
*** bigdogstl has joined #openstack-swift00:53
*** bigdogstl has quit IRC01:01
openstackgerritMerged openstack/swift master: Add assertion about last-modified to object post test  https://review.openstack.org/50289301:03
*** abhitechie has joined #openstack-swift01:03
openstackgerritMerged openstack/swift feature/deep: Remove some instance vars from _one_shard_cycle  https://review.openstack.org/50532901:06
openstackgerritMerged openstack/swift feature/deep: sharding: unit test for base.py get_shard_ranges  https://review.openstack.org/50394501:06
*** bigdogstl has joined #openstack-swift01:12
openstackgerritClay Gerrard proposed openstack/swift master: Follow-up test fixup  https://review.openstack.org/50545401:13
openstackgerritMerged openstack/swift feature/deep: Move some sharder static methods to ContainerBroker  https://review.openstack.org/50530201:15
openstackgerritMerged openstack/swift feature/deep: Add note to doc re internal client conf file  https://review.openstack.org/50533701:15
openstackgerritMerged openstack/swift master: Move listing formatting out to proxy middleware  https://review.openstack.org/44939401:15
*** gyee has quit IRC01:15
*** bigdogstl has quit IRC01:17
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements  https://review.openstack.org/8925001:18
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873601:19
*** cshastri has joined #openstack-swift01:20
*** bigdogstl has joined #openstack-swift01:30
*** bigdogstl has quit IRC01:35
*** tovin07_ has joined #openstack-swift01:40
*** abhitechie has quit IRC01:44
*** mingyu_ has joined #openstack-swift01:51
*** mingyu has quit IRC01:53
*** itlinux has joined #openstack-swift01:54
*** pdardeau has quit IRC01:54
*** itlinux has quit IRC02:08
*** bigdogstl has joined #openstack-swift02:09
*** Sukhdev has quit IRC02:24
*** bigdogstl has quit IRC02:27
*** _ix has joined #openstack-swift02:34
*** bigdogstl has joined #openstack-swift02:36
*** bigdogstl has quit IRC02:36
*** bigdogstl has joined #openstack-swift02:47
*** bigdogstl has quit IRC02:51
openstackgerritMerged openstack/swift master: proxy: Use the right ranges when going to multiple object servers  https://review.openstack.org/50460402:52
*** bigdogstl has joined #openstack-swift02:59
*** bigdogstl has quit IRC03:04
*** bigdogstl has joined #openstack-swift03:39
*** _ix has quit IRC03:40
*** klrmn1 has quit IRC03:43
*** bigdogstl has quit IRC03:43
*** kei_yama has quit IRC03:46
*** bigdogstl has joined #openstack-swift03:47
*** bigdogstl has quit IRC03:55
*** SkyRocknRoll has quit IRC04:00
*** bigdogstl has joined #openstack-swift04:01
*** kei_yama has joined #openstack-swift04:01
mattoliverauI just realised, this week probably should be a 0700 week.. however, I forgot. Anyone against skipping this week? I'll chair and do a PTG recap at the next one. I kinda promised the family to take them to a festival at the marina this arvo after work :(04:29
mattoliverauunless someone else who was at the PTG wants to run it today in my absence.04:29
*** links has joined #openstack-swift04:39
*** links has quit IRC04:41
*** mingyu_ has quit IRC04:44
openstackgerritMerged openstack/swift feature/deep: Get rid of include_end_marker  https://review.openstack.org/50448804:46
*** bigdogstl has quit IRC04:51
*** SkyRocknRoll has joined #openstack-swift04:51
*** bigdogstl has joined #openstack-swift04:57
*** links has joined #openstack-swift04:58
*** SkyRocknRoll has quit IRC04:59
*** bigdogstl has quit IRC04:59
*** links has quit IRC05:00
*** SkyRocknRoll has joined #openstack-swift05:12
*** kei_yama has quit IRC05:13
*** links has joined #openstack-swift05:16
*** links has quit IRC05:17
*** links has joined #openstack-swift05:35
*** links has quit IRC05:35
*** psachin has joined #openstack-swift05:38
*** mat128 has quit IRC05:42
mahaticmattoliverau: have fun. wfm, we could do the next one. Looks like kota_ is not around as well05:48
mattoliveraumahatic: yeah, looks like from twitter he's had a bit of a holiday post PTG05:49
mattoliveraumahatic: thanks05:49
mattoliveraumahatic: also morning and we missed you at the PTG :)05:49
mahaticmattoliverau: Morning. I missed being there as well! My twitter feed was full of PTG updates, which didn't help at all :)05:50
*** ChubYann has quit IRC06:00
*** cschwede has joined #openstack-swift06:17
*** ChanServ sets mode: +v cschwede06:17
*** silor has joined #openstack-swift06:39
*** rcernin has joined #openstack-swift06:43
*** skudlik has joined #openstack-swift06:49
*** m_kazuhiro has joined #openstack-swift06:56
*** pcaruana has joined #openstack-swift07:02
*** openstackgerrit has quit IRC07:02
*** tesseract has joined #openstack-swift07:05
*** bigdogstl has joined #openstack-swift07:11
*** bigdogstl has quit IRC07:17
*** m_kazuhiro has quit IRC07:19
*** geaaru has joined #openstack-swift07:43
*** mingyu has joined #openstack-swift07:45
*** mingyu has quit IRC07:49
*** cbartz has joined #openstack-swift08:11
acolesgood morning08:14
acolesoh, I forgot about the 0700 today. but maybe that was a good thing :)08:14
acolestdasilva: thanks for merging 449394. that was my task for today!08:16
*** joeljwright has joined #openstack-swift08:21
*** ChanServ sets mode: +v joeljwright08:21
*** oshritf_ has joined #openstack-swift08:26
*** mvk has quit IRC08:30
*** openstackgerrit has joined #openstack-swift08:33
openstackgerritAlistair Coles proposed openstack/swift feature/deep: remove node-id, node_idx and part instance vars in _one_shard_cycle  https://review.openstack.org/50532108:33
acolesthank you gerritbot!08:33
*** mvk has joined #openstack-swift09:00
openstackgerritChristian Schwede proposed openstack/swift master: Add test to ensure cache cleared after container PUT  https://review.openstack.org/50555709:07
*** bigdogstl has joined #openstack-swift09:14
*** bigdogstl has quit IRC09:18
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Always use node_idx 0 as scanner  https://review.openstack.org/50393809:20
openstackgerritAlistair Coles proposed openstack/swift feature/deep: WIP: historic scanner election code  https://review.openstack.org/50556309:20
*** bigdogstl has joined #openstack-swift09:26
*** oshritf_ has quit IRC09:28
*** bigdogstl has quit IRC09:30
openstackgerritMatthew Oliver proposed openstack/swift feature/deep: sharding - Make swift-container-info shard aware  https://review.openstack.org/50558010:06
mattoliverauacoles: hopefully ^^ that will make looking at your container states easier in your cluster :)10:08
acolesmattoliverau: whoa! how did you know that right now i am typing 'sqlite> select * from shard_ranges;'10:08
acolesgenius!10:08
mattoliverau:)10:08
acolesmattoliverau: I feel like you were looking over my shoulder!10:09
mattoliveraumaybe I am ;) Really there is a trojan in the shard code that allows me to watch what you type :P10:09
acolesmattoliverau: seeing probe test intermittently fail with a missing object from listing (the final obj in first shard) but all shard ranges look consistent.10:10
*** tovin07_ has quit IRC10:10
mattoliverau^^ that patch also fixes a cleave bug I introduced in the rename.10:11
mattoliverauhmm10:11
mattoliveraumaybe timburke's end_marker + /x0 isn't working?10:11
mattoliverauI can do some debugging here, pycharm lets  me debug the sharder.. have you got a sharder run configuration working?10:12
* mattoliverau has a SAIO on his worklaptop then can load up a sharder, container server or whatever in pycharms, so can debug bits 10:13
acolesmattoliverau: so are you renaming last_range to last_pivot because it is referring to the actual point?10:14
mattoliverauyu[10:14
mattoliverauyup10:14
acolesok makes sense10:14
mattoliverauits the last point it pivited the data on10:14
mattoliverauwe could use a different name if you can think of one10:15
acolesmay be my bad, I may have over-cooked the rename when I was fixing up10:15
mattoliverauacoles: nah it was probably me :)10:15
mattoliverauI was over zealous10:15
mattoliverauwe could call it last_split or something10:16
mattoliverauif that makes more sense10:16
* mattoliverau needs to step away for a bit10:16
acolesNP for now10:17
acolespivot or w/e10:17
*** oshritf_ has joined #openstack-swift10:18
mattoliverauacoles: oh and the default/sample internal client config doesn't work with sharding. It needs the autocreate accounts turned on10:19
acolesmattoliverau: yeah spotted that. in fact we have updated the docs to say that, landed overnight10:19
acolesand I put a note on the etherpad10:20
*** oshritf_ has quit IRC10:20
mattoliverauAhh great!10:20
acolesmattoliverau: it's late for you?10:20
mattoliverauIt's 8:3010:24
mattoliverauSo not too bad10:24
*** bigdogstl has joined #openstack-swift10:27
*** bigdogstl has quit IRC10:31
*** oshritf_ has joined #openstack-swift10:56
*** cshastri has quit IRC10:58
*** oshritf_ has quit IRC11:00
acolesmattoliverau: ugh, I had some stale proxy/container server processes on my SAIO, can't reproduce the probe test failure now11:04
openstackgerritAlistair Coles proposed openstack/swift feature/deep: remove node-id, node_idx and part instance vars in _one_shard_cycle  https://review.openstack.org/50532111:10
*** janonymous has quit IRC11:16
openstackgerritAlistair Coles proposed openstack/swift feature/deep: sharding: trivial renaming  https://review.openstack.org/50559911:18
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Drop unused _get_local_devices  https://review.openstack.org/50539911:24
tdasilvagood morning11:38
acolestdasilva: wow is it already your morning11:39
tdasilvatime is flying by :)11:39
acoles"time flies like an arrow but fruit flies like a banana"11:40
tdasilvalol11:41
*** SkyRocknRoll has quit IRC12:06
*** MVenesio has joined #openstack-swift12:06
*** _ix has joined #openstack-swift12:08
*** MVenesio has quit IRC12:22
*** SkyRocknRoll has joined #openstack-swift12:23
openstackgerritMerged openstack/swift feature/deep: Always use node_idx 0 as scanner  https://review.openstack.org/50393812:44
*** catintheroof has joined #openstack-swift13:02
*** _ix has quit IRC13:04
*** vint_bra has joined #openstack-swift13:29
*** chlong has joined #openstack-swift13:40
*** SkyRocknRoll_ has joined #openstack-swift13:41
openstackgerritAlistair Coles proposed openstack/swift feature/deep: sharding - Make swift-container-info shard aware  https://review.openstack.org/50558013:43
*** skudlik has quit IRC13:43
acolesmattoliverau: if you agree with my changes then go ahead and +A ^^ - great idea to have this!13:45
*** mat128 has joined #openstack-swift13:53
*** zhurong has joined #openstack-swift13:55
*** gkadam has joined #openstack-swift14:04
*** vint_bra has quit IRC14:09
*** _ix has joined #openstack-swift14:35
openstackgerritMerged openstack/swift feature/deep: Drop unused _get_local_devices  https://review.openstack.org/50539914:36
*** gkadam is now known as gkadam-afk14:37
*** mingyu has joined #openstack-swift14:38
*** klrmn has joined #openstack-swift14:42
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements  https://review.openstack.org/8925014:43
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873614:44
*** zhurong has quit IRC15:05
*** links has joined #openstack-swift15:21
*** links has quit IRC15:24
mwheckmannmattoliverau: thanks for the heads up on the threads in 2.15. I'll give that a try and get back.15:26
*** bigdogstl has joined #openstack-swift15:32
*** bigdogstl has quit IRC15:36
*** gyee has joined #openstack-swift15:45
*** Sukhdev_ has joined #openstack-swift15:58
*** cbartz has quit IRC15:59
*** Jeffrey4l_ has joined #openstack-swift16:01
*** Jeffrey4l has quit IRC16:06
*** Jeffrey4l has joined #openstack-swift16:07
*** Jeffrey4l_ has quit IRC16:08
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873616:09
*** klrmn has quit IRC16:17
*** rcernin has quit IRC16:17
*** SkyRocknRoll has quit IRC16:25
*** hoonetorg has quit IRC16:25
*** chsc has joined #openstack-swift16:32
*** chsc has joined #openstack-swift16:32
timburkegood morning16:35
timburkewith the listing work landed, looks like i've got a merge from master to do today :-)16:37
timburkethanks tdasilva!16:37
tdasilva:)16:37
tdasilvaand i'm fixing symlinks, so thanks for that too :)16:38
timburkei'm great at prompting work for myself and other people! :-/16:38
tdasilvatimburke: i'm also hoping to review p 44152016:38
patchbothttps://review.openstack.org/#/c/441520/ - swift - Use swift3's check_signature function16:38
timburkeyay! land all the things!16:39
timburkealso, thanks torgomatic and clayg for landing p 504604! i'll have backports up shortly16:39
patchbothttps://review.openstack.org/#/c/504604/ - swift - proxy: Use the right ranges when going to multiple... (MERGED)16:39
*** mvk has quit IRC16:51
*** Sukhdev_ has quit IRC16:52
*** psachin has quit IRC16:53
timburkeacoles: what's up with intermittent failures on the probe test? was that on feature/deep or some patchset?16:55
acolestimburke: it was false alarm. I was working on a patchset but my SAIO had some stale processes hanging around, once I cleaned them up all was good16:55
timburkeah, yeah, i've hit that sort of thing occasionally too. some proxy that doesn't get cleaned up starts sending back 401s... haven't seen partial listings, though16:57
*** vint_bra has joined #openstack-swift17:04
*** gkadam-afk is now known as gkadam-away17:05
*** klrmn has joined #openstack-swift17:07
openstackgerritMerged openstack/swift master: Make gate keeper to save relative location header path  https://review.openstack.org/50450717:10
*** hugokuo has quit IRC17:11
*** hugokuo has joined #openstack-swift17:14
notmynamegood morning17:15
*** ianychoi_ has joined #openstack-swift17:18
openstackgerritMerged openstack/swift master: Add test to ensure cache cleared after container PUT  https://review.openstack.org/50555717:19
*** ianychoi has quit IRC17:22
*** mvk has joined #openstack-swift17:31
*** bigdogstl has joined #openstack-swift17:33
*** bigdogstl has quit IRC17:38
*** cschwede has quit IRC17:56
openstackgerritAlistair Coles proposed openstack/swift feature/deep: sharding: WIP make find_pivot_ranges a broker method  https://review.openstack.org/50576317:59
*** tesseract has quit IRC17:59
acolesmattoliverau: ^^ I have some questions in this patch (inline) - be great to discuss during some timezone overlap (cc timburke)18:02
*** MVenesio has joined #openstack-swift18:14
*** geaaru has quit IRC18:14
*** Sukhdev_ has joined #openstack-swift18:20
*** lucasxu has joined #openstack-swift18:21
*** Sukhdev_ has quit IRC18:33
*** ChubYann has joined #openstack-swift18:44
*** bigdogstl has joined #openstack-swift18:44
*** bigdogstl has quit IRC18:51
*** silor has quit IRC18:55
timburkeoh man, reverse sharded listings are gonna make my head hurt...18:56
timburkemaybe i should just focus on that merge from master for now... but i wanna get a couple more patches on feature/deep first18:57
tdasilvais there a meeting today?19:04
notmynameyes19:05
notmynamehaven't looked at it yet though ;-)19:06
tdasilvanotmyname: np, what was that website for scheduling meetings again??19:06
notmynamedoodle19:06
tdasilvayes! thanks!19:06
notmynametdasilva: are you going to set something up with zaitcev about put/post?19:11
tdasilvanotmyname: yeah, my plan was to announce the doodle link in the meeting and then go from there in terms of scheduling19:12
notmynamenice. thank you. sounds like a good plan19:12
* notmyname needs to get lunch so I don't get cranky during the busy afternoon ;-)19:12
openstackgerritTim Burke proposed openstack/swift feature/deep: Add test for reversed listings  https://review.openstack.org/50578419:27
*** SkyRocknRoll_ has quit IRC19:31
*** rmcall has joined #openstack-swift19:33
openstackgerritThiago da Silva proposed openstack/swift master: Symlink implementation.  https://review.openstack.org/23216219:45
*** bigdogstl has joined #openstack-swift19:58
*** bigdogstl has quit IRC20:02
*** catintheroof has quit IRC20:32
*** MVenesio has quit IRC20:35
timburkeclayg: bug 1718525 seems screwy -- the trouble is that the object (once PUT) doesn't show up in container listings, but it came up because the update arrived just after the container GET20:40
openstackbug 1718525 in OpenStack Object Storage (swift) "test_list_container_contents_with_prefix failed with: ['tempest-TestObject-1992896707'] != []" [Undecided,Incomplete] https://launchpad.net/bugs/171852520:40
claygoh, did I read that wrong?  I thought it was a listing after DELETE expecting the list to be empty?20:40
*** joeljwright has quit IRC20:40
timburkenah, it's failing here: https://github.com/openstack/tempest/blob/master/tempest/api/object_storage/test_container_services.py#L27120:41
timburkestill -- container listings are eventually consistent. but on the other hand, i've got no explanation for the observed order of events unless the tempest client is somehow async20:42
timburkeit's not that the update got punted to the object-updater... there's no "Container update timeout" in the object log20:43
*** jistr has quit IRC20:52
*** m_kazuhiro has joined #openstack-swift20:57
*** mat128 has quit IRC20:58
notmynameswift team meeting in 2 minutes in #openstack-meeting20:58
*** pcaruana has quit IRC20:59
*** joeljwright has joined #openstack-swift21:03
*** ChanServ sets mode: +v joeljwright21:03
*** rmcall has quit IRC21:04
*** rmcall has joined #openstack-swift21:04
*** _ix has quit IRC21:15
*** rmcall has quit IRC21:16
*** chsc has quit IRC21:17
*** rmcall has joined #openstack-swift21:17
*** chsc has joined #openstack-swift21:19
acolesmattoliverau: if I get up early tomorrow (your today) can I maybe touch base with you about the questions I have in https://review.openstack.org/#/c/505763/ ?21:23
patchbotpatch 505763 - swift (feature/deep) - sharding: WIP make find_pivot_ranges a broker method21:23
mattoliverauSure21:25
acolesthat way you may have chance to look at it first, and I can sleep first ;)21:25
acolesmattoliverau: ^^21:25
acolesmattoliverau: thanks21:25
mattoliverauLol, I'll definitely look today21:25
mattoliverauWe can talk after you've had a coffee in the morning :)21:25
*** chlong has quit IRC21:26
*** lucasxu has quit IRC21:29
*** kong_ has joined #openstack-swift21:33
*** kong_ is now known as kong21:33
*** Sukhdev has joined #openstack-swift21:34
*** m_kazuhiro has quit IRC22:01
*** chsc has quit IRC22:04
openstackgerritMerged openstack/swift feature/deep: remove node-id, node_idx and part instance vars in _one_shard_cycle  https://review.openstack.org/50532122:08
claygwhy is calendar not the default!?22:11
*** chsc has joined #openstack-swift22:11
claygnm, i don't know how that view works either22:12
claygi think i did it right22:12
*** catintheroof has joined #openstack-swift22:15
*** ypbg has quit IRC22:17
openstackgerritMerged openstack/swift feature/deep: sharding: trivial renaming  https://review.openstack.org/50559922:21
openstackgerritMerged openstack/swift master: Log deprecation warning for allow_versions  https://review.openstack.org/46808422:23
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements  https://review.openstack.org/8925022:30
*** joeljwright has quit IRC22:31
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873622:31
thurloathey folks, i have a new swift object storage server and the rsync logs occasionally spit out some errors that I'm unfamiliar with. Perhaps yall can be of some assistance? https://hastebin.com/eforajoyam.log22:52
*** ianychoi_ is now known as ianychoi22:52
thurloatI've just added the new node and it's drives into the zone22:53
*** jistr has joined #openstack-swift22:53
openstackgerritTim Burke proposed openstack/swift feature/deep: Merge branch 'master' into merge-from-master  https://review.openstack.org/50584422:57
*** jistr has quit IRC23:02
*** jistr has joined #openstack-swift23:04
*** catintheroof has quit IRC23:19
*** kei_yama has joined #openstack-swift23:34
*** vint_bra has quit IRC23:35
*** bigdogstl has joined #openstack-swift23:49
*** chsc has quit IRC23:52
*** itlinux has joined #openstack-swift23:53
*** bigdogstl has quit IRC23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!