Friday, 2017-12-15

*** ejat has quit IRC00:07
*** ejat has joined #openstack-swift00:08
*** ejat has quit IRC00:08
*** ejat has joined #openstack-swift00:08
*** joeljwright has quit IRC00:10
openstackgerritClay Gerrard proposed openstack/swift master: Remove symlink from xml listing response  https://review.openstack.org/52813400:18
kota_timburk: i think the version is from the object listing request so if you send a request via v2 (idk, what's v2 api), the response xml should include the v2 path00:25
kota_Oh, perhaps, the path format could break something?00:31
claygtimburke: thanks for the pointer on the coverage change... I was digging around the .html looking at missing and branch/partial coverage confused00:33
kota_Probably I'm missing something on the matter...00:34
kota_Oic, it looks like xml doesn't want track newer scheme changes?00:37
* kota_ will look at the discussion at office later00:38
*** tovin07_ has joined #openstack-swift00:40
openstackgerritSamuel Merritt proposed openstack/swift master: Move CORS to middleware.  https://review.openstack.org/52810600:42
*** psachin has joined #openstack-swift00:54
*** mingyu has joined #openstack-swift00:56
*** mingyu has quit IRC01:00
*** m_kazuhiro has joined #openstack-swift01:30
m_kazuhirogood morning01:30
m_kazuhirosymlink is merged!!01:30
m_kazuhiroI'm very happy. Thank you everyone!!01:32
timburkegood work m_kazuhiro, kota_!01:35
timburkeand tdasilva, and.... :-)01:35
openstackgerritSamuel Merritt proposed openstack/swift master: Move CORS to middleware.  https://review.openstack.org/52810601:35
*** linkmark has quit IRC01:40
kota_good morning and I'm at my office now, grubbing a new cap of coffee :-)01:41
kota_timburke: still here? I'm not yet get the problem when the symlink_path is in xml format. what's broken with that?01:41
timburkei'm just a little worried that there may be a client that parses xml responses in a brittle way, expecting a particular schema that we never properly defined01:43
kota_something like we are doing in swift3 testing?01:43
*** Sukhdev has quit IRC01:44
timburkesuch a client presumably wouldn't create symlinks -- it's old/abandoned and not adding support for new features -- but if it had to coexist with another client that *did* want to write symlinks, it may find that it can't do container listings anymore01:44
timburkei guess an alternative would be to make the symlink elements conditional on some new query param, similar to what i did for SLO heart-beating?01:47
*** two_tired has joined #openstack-swift01:48
kota_ah, like `heart-beat=on`, `allow-symlink=true` for format: application/xml case could work.01:49
kota_make sense.01:49
*** psachin has quit IRC02:16
openstackgerritMerged openstack/swift master: Add base64decode function to common/utils  https://review.openstack.org/51280402:33
openstackgerritMerged openstack/swift master: rename utils function less like stdlib  https://review.openstack.org/52808102:33
openstackgerritMerged openstack/swift master: Symlink doc clean up  https://review.openstack.org/52747502:33
openstackgerritMerged openstack/swift master: Assert X-Newest and X-Backend headers are propagated to symlink target  https://review.openstack.org/52747702:33
kota_OMG the docs clean up already landed.02:33
kota_that means, patch 528134 should fix the docs as well.02:34
patchbothttps://review.openstack.org/#/c/528134/ - swift - Remove symlink from xml listing response02:34
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Remove symlink from xml listing response  https://review.openstack.org/52813402:40
*** JimCheung has quit IRC02:43
kota_clayg: I fixed the docs as well ^^^^02:45
*** JimCheung has joined #openstack-swift02:47
*** psachin has joined #openstack-swift02:50
*** JimCheung has quit IRC02:52
*** jappleii__ has joined #openstack-swift03:17
*** JimCheung has joined #openstack-swift03:18
*** jappleii__ has quit IRC03:19
*** jappleii__ has joined #openstack-swift03:19
*** threestrands_ has quit IRC03:20
*** cshastri has joined #openstack-swift03:22
*** JimCheung has quit IRC03:23
*** cshastri has quit IRC03:27
*** kei_yama has quit IRC03:31
*** mingyu has joined #openstack-swift03:36
*** JimCheung has joined #openstack-swift03:38
*** JimCheung has quit IRC03:42
*** gyee has quit IRC03:43
mahaticnotmyname: clayg: acoles: kota_: likewise. It's been a pleasure working with you all!03:45
*** jappleii__ has quit IRC03:56
*** kei_yama has joined #openstack-swift04:02
openstackgerritClay Gerrard proposed openstack/swift master: Save ring builder if dispersion changes  https://review.openstack.org/47901204:17
openstackgerritClay Gerrard proposed openstack/swift master: Represent dispersion worse than one replicanth  https://review.openstack.org/52815504:17
claygcschwede: timburke: as availability allows - can you take another look at sam's ring builder cli fixup in patch 47901204:24
patchbothttps://review.openstack.org/#/c/479012/ - swift - Save ring builder if dispersion changes04:24
claygthe follow up change is useful to me because I have some EC rings that need multiple rebalances to get out of a bad state and we need to be able to detect the dispersion improving each iteration.04:25
*** SkyRocknRoll has joined #openstack-swift04:27
*** m_kazuhiro has quit IRC04:32
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Add more assertions for Symlink + Copy unit tests  https://review.openstack.org/52759504:56
kota_just rebased04:57
*** mingyu has quit IRC05:37
*** two_tired has quit IRC05:56
*** links has joined #openstack-swift06:18
*** SkyRocknRoll has quit IRC06:39
*** rcernin has quit IRC06:47
*** SkyRocknRoll has joined #openstack-swift06:52
kota_today, I am going to leave my office to owe m_kazuhiro a beer for great symlink work.07:06
kota_see you.07:07
*** brimestone has joined #openstack-swift07:08
*** kmARC has left #openstack-swift07:11
*** SkyRocknRoll has quit IRC07:15
*** hseipp has joined #openstack-swift07:38
*** cbartz has joined #openstack-swift07:50
*** brimestone has quit IRC07:52
*** armaan has joined #openstack-swift07:54
*** armaan has quit IRC08:23
*** armaan_ has joined #openstack-swift08:23
*** armaan_ has quit IRC08:24
*** armaan has joined #openstack-swift08:24
*** armaan has quit IRC09:04
*** armaan has joined #openstack-swift09:05
*** armaan has quit IRC09:28
*** armaan has joined #openstack-swift09:28
acolesgood morning09:30
acolesmahatic: o/ good luck with whatever comes next09:30
acolesm_kazuhiro: congratulations on symlinks work09:31
acoleskota_: you too ^^ , great work everyone09:32
acolesmattoliverau: did you see my note yesterday here?09:33
acolesoh, it's already the weekend in oz! I'll try to catch you next week, will need to set an alarm09:34
mattoliverauumm, yes.. but I can't remember.. let me scroll back :)09:34
mattoliverauacoles: Oh yes.. I have that problem with the old shrink code09:35
acolesmattoliverau: aha!09:35
mattoliverauI remember bringing it up at a sharding update at a summit or midcycle.09:36
acolesmattoliverau: I'm going to try removing that PUT and...see what happens! in meantime if you remember any context please let me know09:36
mattoliverauwe needed some way to mark a shard, that it's still sharding (cleaving)09:36
mattoliverauwe want to make sure there is somewhere for the redirected traffic to go (taking load of the big container)09:38
acolesright, so need to get a container created asap09:38
mattoliverauif the container auto creates on a PUT (so we don't put during the sharding stage) we get the same problem.09:38
acolesyup09:38
mattoliverauI was dropping a sharding metadata that was removed when sharding was complete (or remove it on the handoff container so when it replicates it's dropped from the shards)09:39
mattoliverau(ie as a part of moving the data. if that makes sense)09:39
acolesyes makes sense, some kind of sentinel to prevent shrinking until shard container is past its genesis09:41
acolesthank mattoliverau have a good weekend, enjoy watching England get crushed :/09:44
mattoliverauacoles: yeah, I knew you were travelling so didn't want to kick you while your jetlagged ;)09:45
mattoliverauAussie Aussie Aussie, oi oi oi!09:46
acolesmattoliverau: let's talk rugby instead https://www.ruck.co.uk/wp-content/uploads/2017/11/ENGLAND-1.jpg ;-)09:49
mattoliverauahh touche :)09:51
*** armaan_ has joined #openstack-swift09:52
*** armaan has quit IRC09:52
*** mvk has quit IRC09:59
mattoliverauk, my Suse team meeting is over, now I can go back to starting my weekend. Night all o/10:04
mattoliverauacoles: have a great day and weekend10:04
acolesmattoliverau: and you, thanks for responding10:04
*** tovin07_ has quit IRC10:05
*** armaan_ has quit IRC10:06
*** armaan has joined #openstack-swift10:07
*** geaaru has joined #openstack-swift10:18
*** mvk has joined #openstack-swift10:28
*** kei_yama has quit IRC10:53
*** hseipp has quit IRC11:03
*** hseipp has joined #openstack-swift11:06
*** Tengu has left #openstack-swift11:11
*** SkyRocknRoll has joined #openstack-swift11:51
openstackgerritMerged openstack/swift master: add symlink to container sync default and sample config  https://review.openstack.org/52807211:56
openstackgerritMerged openstack/swift master: Add more assertions for Symlink + Copy unit tests  https://review.openstack.org/52759511:56
*** catintheroof has joined #openstack-swift12:31
openstackgerritMerged openstack/swift master: add symlink to probetest for reconciler  https://review.openstack.org/52807312:45
openstackgerritAlistair Coles proposed openstack/swift master: Move symlink versioning functional test  https://review.openstack.org/52825312:47
*** abhitechie has joined #openstack-swift12:54
*** cshastri has joined #openstack-swift13:03
*** abhitechie has quit IRC13:13
*** cshastri has quit IRC13:20
*** flwang has quit IRC13:22
*** flwang has joined #openstack-swift13:23
*** psachin has quit IRC14:07
*** cshastri has joined #openstack-swift14:22
*** links has quit IRC14:31
*** sc has joined #openstack-swift14:34
schow can I get a report of how objects are stored? I mean on which node?14:35
*** shaner has quit IRC14:41
*** openstackgerrit has quit IRC14:48
*** cshastri has quit IRC14:48
*** rcernin has joined #openstack-swift14:57
*** chsc has joined #openstack-swift15:01
*** chsc has joined #openstack-swift15:01
*** armaan has quit IRC15:05
acolessc: the swift-get-nodes cli tool will tell you the expected location of an object15:11
*** shaner has joined #openstack-swift15:12
*** silor has joined #openstack-swift15:27
*** armaan has joined #openstack-swift15:30
*** rcernin has quit IRC15:41
*** abhitechie has joined #openstack-swift15:42
scthanks acoles I found in the meanwhile15:48
scusing the output of swift-get-nodes I got to the point15:48
scit's not as easy as customers think, I was asked to get evidence of the replication happening. I just trusted swift for years without even asking myself questions like this15:49
acolessc: another useful tool, once you have located object files, is swift-object-info15:51
*** openstackgerrit has joined #openstack-swift15:53
openstackgerritMerged openstack/swift master: Remove symlink from xml listing response  https://review.openstack.org/52813415:53
*** SkyRocknRoll has joined #openstack-swift16:01
*** mvk has quit IRC16:05
openstackgerritMerged openstack/swift feature/deep: Add object count and bytes to ShardRange repr  https://review.openstack.org/52656116:11
*** SkyRocknRoll has quit IRC16:14
*** SkyRocknRoll has joined #openstack-swift16:26
*** abhitechie has quit IRC16:27
*** itlinux has joined #openstack-swift16:34
*** cbartz has left #openstack-swift16:35
*** sc has left #openstack-swift16:40
*** d0ugal has quit IRC16:45
*** joeljwright has joined #openstack-swift17:00
*** ChanServ sets mode: +v joeljwright17:00
*** hseipp has quit IRC17:01
*** d0ugal has joined #openstack-swift17:04
*** joeljwright has quit IRC17:08
*** geaaru has quit IRC17:11
*** brimestone has joined #openstack-swift17:11
*** mvk has joined #openstack-swift17:25
*** joeljwright has joined #openstack-swift17:27
*** ChanServ sets mode: +v joeljwright17:27
*** silor has quit IRC17:28
notmynamegood morning17:44
amrithnotmyname, good afternoon17:44
brimestoneHello notmyname!17:44
*** JimCheung has joined #openstack-swift17:49
notmyname16 patches landed since yesterday17:54
claygwtg yesterday17:54
*** joeljwright has quit IRC17:56
*** catintheroof has quit IRC18:07
*** catinthe_ has joined #openstack-swift18:07
*** armaan has quit IRC18:38
acolestimburke: hi, re discussion here, I'm currently looking at adding a shard range update to root in _find_ranges as part of eliminating racing between sharding and shrinking18:50
timburkei should go read my scrollback :-)18:52
acolesin short...need (a) root to be aware of shards and their object count before any update arrives from the fresh but as yet empty shard container18:52
acolestimburke: wait, here was meant to be followed by https://review.openstack.org/51097818:52
patchbotpatch 510978 - swift (feature/deep) - Root driven shrinking (MERGED)18:52
acolessorry!18:52
acoles... and need (b) fresh-but-empty shard container updates to then be ignored at the root until objects get cleaved into them18:53
acolestimburke:  summary from earlier conversation with mattoliverau (here, yes in irc!) was him reminding me that we do need the fresh but empty shard container in order to start receiving new object updates on them18:54
acolesanyway, I hope I am almost there, and in true swift fashion it comes down to appropriate use of timestamps18:54
notmynameoh, I guess I havent' actually registered for the ptg yet18:55
acolesnotmyname: :O nor have I, and I was feeling so organised :/18:55
notmyname...and no visa for US citizens to go to ireland for a conference18:59
*** szaher has quit IRC19:02
*** gyee has joined #openstack-swift19:08
*** szaher has joined #openstack-swift19:18
notmynameBA flight to london is $544. first class ticket on that flight is $2347619:18
claygnotmyname: seems reasonable19:20
*** catinthe_ has quit IRC19:21
*** SkyRocknRoll has quit IRC19:35
*** brimestone has quit IRC19:47
acolesnotmyname: so which class did you choose?19:53
notmynamethe problem with the first class fare is that I'd still be on the flight with the common fare. seems like too much to me. can't risk brushing against the cattle class. probably will need to look into a private plane instead19:57
notmyname;-)19:57
acoleslol. you're worth it19:57
notmynamein actuality, I was only checking times. and I'm very happy to use the corp travel person so I don't have to worry about little things like prices. I just trust/hope they choose a reasonable one :-)19:58
notmynamesince I hear the event hotel is booked the night before the ptg, I may not come a day early. seems flight schedules would likely work well to leave SFO saturday and get to dublin on sunday afternoon or dinner time20:00
notmynamebut I was considering spending a day in london or something20:00
claygi'm so confused about allowed_versioned_writes - set it to false and I swear after restart my proxy still shows versioned_writes in /info - it's insane?20:09
acolesclayg: is it in your pipeline or being autoinserted?20:16
acolesI think if it is auto inserted it doesn't pick up the conf section but uses defaults20:17
acoleshmmm, maybe not, can't reproduce that20:18
acolesdoh, it is false by default, ignore me20:22
claygit's in there pipeline = catch_errors healthcheck proxy_logging memcache container_sync bulk tempurl tempauth staticweb slo dlo versioned_writes symlink keymaster encryption proxy_logging proxy20:25
clayg:'(20:25
acolesclayg: I just set mine false (it is in pipeline) and do not see it /info20:25
claygyeah.... something super stupid is going on my environment - thanks for confirming it's just me20:26
acolesorphan process?20:26
*** armaan has joined #openstack-swift20:27
claygyup :'(20:31
*** openstackgerrit has quit IRC20:48
*** itlinux has quit IRC20:59
*** armaan has quit IRC21:14
*** armaan has joined #openstack-swift21:15
*** rcernin has joined #openstack-swift21:36
*** itlinux has joined #openstack-swift21:40
*** openstackgerrit has joined #openstack-swift21:55
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Fix broker merge_shard_ranges  https://review.openstack.org/52842221:55
acoles!21:55
*** geaaru has joined #openstack-swift22:00
*** itlinux has quit IRC22:01
*** armaan has quit IRC22:28
*** catintheroof has joined #openstack-swift22:29
openstackgerritClay Gerrard proposed openstack/swift master: functest for symlink + versioned writes  https://review.openstack.org/52758322:49
*** chsc has quit IRC22:58
openstackgerritClay Gerrard proposed openstack/swift master: Save ring builder if dispersion changes  https://review.openstack.org/47901223:04
openstackgerritClay Gerrard proposed openstack/swift master: Represent dispersion worse than one replicanth  https://review.openstack.org/52815523:33

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!