Monday, 2016-04-04

*** haomaiwang has quit IRC00:01
*** haomaiwa_ has joined #openstack-swift00:01
*** asettle has quit IRC00:03
*** asettle has joined #openstack-swift00:06
*** jmb_ has quit IRC00:11
*** jmb_ has joined #openstack-swift00:15
*** asettle has quit IRC00:18
*** asettle has joined #openstack-swift00:19
*** asettle has quit IRC00:23
*** asettle has joined #openstack-swift00:24
*** darrenc is now known as darrenc_afk00:26
*** klrmn1 has quit IRC00:27
*** asettle has quit IRC00:27
*** asettle has joined #openstack-swift00:28
*** klrmn has joined #openstack-swift00:28
*** darrenc_afk is now known as darrenc00:53
*** haomaiwa_ has quit IRC01:01
*** haomaiwang has joined #openstack-swift01:01
*** nadeem has joined #openstack-swift01:02
*** jmb_ has quit IRC01:12
*** jmb_ has joined #openstack-swift01:13
kota_good morning01:29
*** jmb_ has quit IRC01:36
*** jmb_ has joined #openstack-swift01:38
*** asettle has quit IRC01:41
*** asettle has joined #openstack-swift01:41
*** asettle has quit IRC01:45
*** asettle has joined #openstack-swift01:45
*** jmb_ has quit IRC01:48
*** bapalm has joined #openstack-swift01:51
*** jmb_ has joined #openstack-swift01:53
*** nadeem has quit IRC01:55
*** haomaiwang has quit IRC02:01
*** haomaiwang has joined #openstack-swift02:01
*** asettle has quit IRC02:02
*** asettle has joined #openstack-swift02:02
*** jmb_ has quit IRC02:18
*** jmb_ has joined #openstack-swift02:23
*** mingdang1 has joined #openstack-swift02:26
*** jmb_ has quit IRC02:38
*** jmb_ has joined #openstack-swift02:43
*** links has joined #openstack-swift02:46
*** mingdang1 has quit IRC02:50
*** haomaiwang has quit IRC03:01
*** haomaiwang has joined #openstack-swift03:01
*** jmb_ has quit IRC03:18
*** jmb_ has joined #openstack-swift03:20
*** silor has joined #openstack-swift03:26
*** jamielennox is now known as jamielennox|away03:27
*** jamielennox|away is now known as jamielennox03:37
janonymouskota_ : gud morning !03:45
*** jmb___ has joined #openstack-swift03:47
*** jmb_ has quit IRC03:47
*** asettle has quit IRC03:54
*** asettle has joined #openstack-swift03:54
*** haomaiwang has quit IRC04:01
*** haomaiwang has joined #openstack-swift04:01
*** asettle has quit IRC04:02
*** asettle has joined #openstack-swift04:02
kota_janonymous: morning!04:06
*** jmb_ has joined #openstack-swift04:13
*** jmb___ has quit IRC04:13
*** trifon has joined #openstack-swift04:22
*** SkyRocknRoll has quit IRC04:25
*** nadeem has joined #openstack-swift04:33
*** SkyRocknRoll has joined #openstack-swift04:43
*** jmb_ has quit IRC04:48
*** jmb_ has joined #openstack-swift04:50
*** haomaiwang has quit IRC05:01
*** jmb_ has quit IRC05:01
*** jmb_ has joined #openstack-swift05:01
*** haomaiwang has joined #openstack-swift05:01
*** asettle has quit IRC05:12
*** asettle has joined #openstack-swift05:13
*** nakagawamsa has joined #openstack-swift05:32
*** ppai has joined #openstack-swift05:33
*** nakagawamsa has quit IRC05:36
*** ChubYann has quit IRC05:50
*** mingdang1 has joined #openstack-swift05:51
*** asettle has quit IRC05:55
*** mingdang1 has quit IRC05:55
*** asettle has joined #openstack-swift05:57
*** asettle has quit IRC05:57
*** haomaiwang has quit IRC06:01
*** haomaiwa_ has joined #openstack-swift06:01
*** nakagawamsa has joined #openstack-swift06:03
*** nakagawamsa has quit IRC06:07
*** asettle has joined #openstack-swift06:10
*** asettle has quit IRC06:14
*** mingdang1 has joined #openstack-swift06:16
*** asettle has joined #openstack-swift06:16
*** jmb_ has quit IRC06:19
*** jmb_ has joined #openstack-swift06:21
*** daemontool has joined #openstack-swift06:24
*** jmb_ has quit IRC06:29
*** jmb___ has joined #openstack-swift06:29
*** ankur has joined #openstack-swift06:30
*** jmb___ has quit IRC06:37
*** jmb_ has joined #openstack-swift06:38
*** mingdang1 has quit IRC06:43
*** klrmn has quit IRC06:59
*** haomaiwa_ has quit IRC07:01
*** haomaiwang has joined #openstack-swift07:01
*** asettle has quit IRC07:08
*** rledisez has joined #openstack-swift07:11
*** jmb___ has joined #openstack-swift07:14
*** jmb_ has quit IRC07:14
-openstackstatus- NOTICE: Gerrit is going to be restarted due to bad performance07:15
*** trifon has quit IRC07:15
*** trifon has joined #openstack-swift07:22
*** jmccarthy has joined #openstack-swift07:26
*** sanchitmalhotra has quit IRC07:27
*** mmcardle has joined #openstack-swift07:29
*** acoles_ is now known as acoles07:32
*** jmccarthy has quit IRC07:35
*** jmb___ has quit IRC07:35
*** jmb_ has joined #openstack-swift07:37
*** charz has quit IRC07:37
*** ejat has quit IRC07:37
*** ejat has joined #openstack-swift07:38
*** M4urice has quit IRC07:39
*** Raymii has quit IRC07:39
*** Jeffrey4l__ has quit IRC07:40
*** jmccarthy has joined #openstack-swift07:40
*** Raymii has joined #openstack-swift07:41
*** Jeffrey4l__ has joined #openstack-swift07:43
*** rcernin has joined #openstack-swift07:43
*** charz has joined #openstack-swift07:43
*** alpha_ori has quit IRC07:44
*** alpha_ori has joined #openstack-swift07:47
*** haomaiwang has quit IRC08:01
*** jamielennox is now known as jamielennox|away08:01
*** haomaiwang has joined #openstack-swift08:01
*** daemontool_ has joined #openstack-swift08:13
*** jmb_ has quit IRC08:14
*** jmb_ has joined #openstack-swift08:15
*** jethrosun has quit IRC08:17
*** daemontool has quit IRC08:17
*** jethrosun has joined #openstack-swift08:17
*** joeljwright has joined #openstack-swift08:18
*** ChanServ sets mode: +v joeljwright08:18
*** nadeem has quit IRC08:18
*** jistr has joined #openstack-swift08:19
*** sanchitmalhotra has joined #openstack-swift08:27
*** nadeem has joined #openstack-swift08:28
*** nadeem has quit IRC08:28
*** nadeem has joined #openstack-swift08:29
*** M4urice has joined #openstack-swift08:31
*** nadeem has quit IRC08:34
*** nadeem has joined #openstack-swift08:36
*** jethrosu_ has joined #openstack-swift08:37
*** jethrosun has quit IRC08:37
*** jmb_ has quit IRC08:38
*** jmb_ has joined #openstack-swift08:39
*** nadeem has quit IRC08:40
*** jmb___ has joined #openstack-swift08:50
*** jmb_ has quit IRC08:50
*** silor has quit IRC08:58
*** jmb___ has quit IRC08:59
*** jmb_ has joined #openstack-swift09:00
*** haomaiwang has quit IRC09:01
*** haomaiwang has joined #openstack-swift09:01
*** geaaru has joined #openstack-swift09:02
*** jethrosu_ has quit IRC09:03
*** jethrosun has joined #openstack-swift09:03
*** stantonnet has quit IRC09:03
*** stantonnet has joined #openstack-swift09:05
*** trifon has quit IRC09:07
*** jmb_ has quit IRC09:09
*** jmb_ has joined #openstack-swift09:11
*** wer has quit IRC09:12
*** wer has joined #openstack-swift09:13
*** jordanP has joined #openstack-swift09:20
*** kei_yama has quit IRC09:25
*** number80 has quit IRC09:44
*** jmb_ has quit IRC09:49
*** jmb_ has joined #openstack-swift09:51
*** links has quit IRC09:53
*** links has joined #openstack-swift09:53
*** haomaiwang has quit IRC10:01
*** haomaiwang has joined #openstack-swift10:01
*** Trixboxer has quit IRC10:02
*** NM has joined #openstack-swift10:13
*** silor has joined #openstack-swift10:14
*** silor1 has joined #openstack-swift10:19
*** silor has quit IRC10:21
*** silor1 is now known as silor10:21
*** sheel has joined #openstack-swift10:27
*** hosanai has quit IRC10:43
*** mingdang1 has joined #openstack-swift10:45
*** openstackgerrit has quit IRC10:48
*** openstackgerrit has joined #openstack-swift10:48
*** jmb___ has joined #openstack-swift10:50
*** jmb_ has quit IRC10:50
*** thurloat has quit IRC10:58
*** swat30 has quit IRC10:58
*** sanchitmalhotra has quit IRC10:59
*** sanchitmalhotra has joined #openstack-swift10:59
*** haomaiwang has quit IRC11:01
*** haomaiwang has joined #openstack-swift11:01
*** jmb___ has quit IRC11:03
*** jmb_ has joined #openstack-swift11:05
*** NM has quit IRC11:24
*** NM has joined #openstack-swift11:31
*** ppai has quit IRC11:34
*** SkyRocknRoll has quit IRC11:43
*** haomaiw__ has joined #openstack-swift11:48
*** ppai has joined #openstack-swift11:48
*** haomaiwang has quit IRC11:50
*** NM has quit IRC11:53
openstackgerritKota Tsuyuzaki proposed openstack/swift: Follow up on patch 295875  https://review.openstack.org/30107011:55
*** marcusvrn_ has joined #openstack-swift11:56
*** mvk_ has joined #openstack-swift11:57
*** jmb___ has joined #openstack-swift11:59
*** jmb_ has quit IRC11:59
*** jordanP has quit IRC12:00
*** mvk has quit IRC12:00
*** haomaiw__ has quit IRC12:01
*** ppai has quit IRC12:01
*** haomaiwang has joined #openstack-swift12:01
*** mvk_ has quit IRC12:03
*** mmcardle has quit IRC12:04
*** ppai has joined #openstack-swift12:13
*** jmb_ has joined #openstack-swift12:16
*** jmb___ has quit IRC12:16
*** sanchitmalhotra has quit IRC12:20
*** sanchitmalhotra has joined #openstack-swift12:20
*** mmcardle has joined #openstack-swift12:23
*** mvk_ has joined #openstack-swift12:39
*** sheel has quit IRC12:47
*** felixcantournet has joined #openstack-swift12:48
*** zul has quit IRC12:48
*** zul has joined #openstack-swift12:50
*** NM has joined #openstack-swift12:54
*** haomaiwang has quit IRC13:01
*** haomaiwang has joined #openstack-swift13:01
*** ppai has quit IRC13:16
*** jmb_ has quit IRC13:16
*** jmb_ has joined #openstack-swift13:18
*** ankur has quit IRC13:21
*** links has quit IRC13:21
*** mingdang1 has quit IRC13:24
*** felixcantournet has quit IRC13:28
*** esker has quit IRC13:30
*** jmb__ has joined #openstack-swift13:32
*** jmb_ has quit IRC13:33
*** jmb__ has quit IRC13:36
*** sgundur has joined #openstack-swift13:56
*** haomaiwang has quit IRC14:01
*** haomaiwang has joined #openstack-swift14:01
*** zaitcev has joined #openstack-swift14:02
*** ChanServ sets mode: +v zaitcev14:02
*** _JZ_ has joined #openstack-swift14:08
*** jmb_ has joined #openstack-swift14:09
*** jmb_ has quit IRC14:11
*** jmb_ has joined #openstack-swift14:11
*** pauloewerton has joined #openstack-swift14:21
*** sbezverk has joined #openstack-swift14:21
*** esker has joined #openstack-swift14:22
sbezverkGood morning, swift packaging does not provide rootwrap scripts by default right?14:23
*** esker has quit IRC14:23
*** esker has joined #openstack-swift14:24
*** arch-nemesis has joined #openstack-swift14:29
*** arch-nemesis has joined #openstack-swift14:29
*** Jeffrey4l__ has quit IRC14:33
*** klrmn has joined #openstack-swift14:38
openstackgerritThiago da Silva proposed openstack/swift: Support for http footers - Replication and EC  https://review.openstack.org/23739314:51
openstackgerritJethro Sun proposed openstack/swift: Fix the errors in swift/common/ring/builder.py and swift/cli/ringbuilder.py  https://review.openstack.org/30071014:54
*** bkeller` has joined #openstack-swift14:56
*** haomaiwang has quit IRC15:01
*** haomaiwang has joined #openstack-swift15:01
pdardeaugood morning15:02
*** garthb has joined #openstack-swift15:09
claygmorning!15:10
ntatagood morning!15:14
*** swat30 has joined #openstack-swift15:16
*** thurloat has joined #openstack-swift15:17
*** jistr has quit IRC15:41
*** david-lyle_ has quit IRC15:48
*** david-lyle has joined #openstack-swift15:48
acolesgood morning15:52
acolestdasilva: thanks for your work on crypto footers patch!15:53
acolestdasilva: jrichli : i have been working some more on that today based on tdasilva's latest push15:53
tdasilvaacoles: oh cool, thanks for the heads up. I will look forward to that15:54
jrichliacoles tdasilva: thanks to you both :-)  I just got back to work after doing some family stuff, and I am moving offices this morning. but i will checkout your changes soon!15:56
*** haomaiwang has quit IRC16:01
acolesjrichli: good luck with the move16:01
*** haomaiwa_ has joined #openstack-swift16:01
*** rledisez has quit IRC16:07
jrichliacoles: thanks!  about the new trello cards on failing tests: I guess these tests are now failing after the merge to our branch?  do you know if they are new tests?  which patch were you testing against when you found these?16:13
*** klrmn has quit IRC16:14
*** jethrosun has quit IRC16:22
*** lyrrad has joined #openstack-swift16:23
*** mingdang1 has joined #openstack-swift16:25
*** mingdang1 has quit IRC16:29
*** barra204 has quit IRC16:32
*** barra204 has joined #openstack-swift16:32
sbezverkhello, I was wondering if swift has rootwrap functionallity integrated into the packaging?16:33
*** barra204 has quit IRC16:36
*** esker has quit IRC16:39
acolesjrichli: i was testing the merge from master patch, and I believe the new failures were due to assertions that have been added on master to verify etag values are correct in respone headers16:39
*** nadeem has joined #openstack-swift16:42
notmynamehello, world16:45
*** rcernin has quit IRC16:48
*** bkeller` has quit IRC16:52
*** lcurtis has joined #openstack-swift16:56
*** jethrosun has joined #openstack-swift16:56
*** haomaiwa_ has quit IRC17:01
*** haomaiwang has joined #openstack-swift17:01
claygballs -> why did patch 300319 get abandoned?  that's webscale.17:03
patchbotclayg: https://review.openstack.org/#/c/300319/ - swift - Add API compatibility middleware for S4 (ABANDONED)17:03
*** jethrosun has quit IRC17:04
*** jethrosun has joined #openstack-swift17:04
*** dmorita has joined #openstack-swift17:05
*** jmb_ has quit IRC17:06
*** tqtran has joined #openstack-swift17:06
*** joeljwright has quit IRC17:08
*** jethrosun has quit IRC17:09
*** klrmn has joined #openstack-swift17:14
claygnotmyname: do you still have the link for the austin schedule?17:15
notmynamefor the design sessions?17:15
claygnotmyname: there's a section on the pad for "conflicts" - maybe we can link there?17:15
claygnotmyname: yeah I'm looking at my email for my schedule talk and thinking it probably conflicts with the design sessions...17:15
claygnotmyname: oh nice you added a session for searchlight!17:16
notmynameclayg: found it in the meeting notes http://lists.openstack.org/pipermail/openstack-dev/2016-March/090606.html17:17
*** rickyrem has joined #openstack-swift17:19
claygnotmyname: brilliant!17:20
mmotianijoeljwright: Hi, did you get the chance to reivew the patch? https://review.openstack.org/#/c/288566/17:22
patchbotmmotiani: patch 288566 - python-swiftclient - WIP: This patch adds a new doc structure for swift...17:22
*** sheel has joined #openstack-swift17:25
*** ChubYann has joined #openstack-swift17:25
notmynamewhew. a few judicious email filters and a *lot* of down arrow pushing, and all 522 emails are marked as read.17:35
claygnotmyname: do you use gmail keyboard shortcuts - really helps me clear out the junk17:40
notmynameno, I don't use gmail ;-)17:40
claygwhoa17:40
notmynamehttp://d.not.mn/swift_mailbox_rules.png is my current set of rules17:41
zaitcevsemantic17:42
*** mvk_ has quit IRC17:42
notmynameand that filters the openstack ML mailbox (which is sorted server-side via dovecot/sieve)17:42
notmynameif anyone else is using their own mailserver, here's the openstack ML section of my sieve rules https://gist.github.com/notmyname/79658e45757056b0755e62710933352717:45
claygnotmyname: no one is running their own mailserver - dork17:46
clayg;)17:46
*** bkeller` has joined #openstack-swift17:46
*** rickyrem has quit IRC17:49
notmynameFYI cross-project session proposals for the summit are at https://etherpad.openstack.org/p/newton-cross-project-sessions17:50
claygwhoa - they have +3's!?17:50
notmynameones that look interesting to swift are 27, 26, 25, 24, 22, 20, 917:52
notmynameprobably a couple of others, too17:52
claygnotmyname: 10. co-installability is hard - let's not do that anymore17:54
notmynamere the summit/conference split: "we have general agreement on the approach" <- I haven't heard anyone speak positively about it17:56
*** geaaru has quit IRC17:56
claygnotmyname: +2 22. How to Keystone17:58
notmynameyeah18:00
notmynameand also the how to policy.json one18:00
*** haomaiwang has quit IRC18:01
*** haomaiwang has joined #openstack-swift18:01
clarkbnotmyname: there was a lot of positive response to the mailing list thread (but there was also a lot of disagreement)18:04
notmynameyeah. I guess I mean literally heard. there were some (of the more active ML participants) who did respond favorably to the idea18:05
notmynameoh, nice. https://review.openstack.org/#/c/299686/ is going through the gate18:06
patchbotnotmyname: patch 299686 - swift - Fix upgrade bug in versioned_writes18:06
notmynametimburke: cschwede: acoles: any updates on getting rolling upgrade testing going?18:06
acolesnotmyname: not from me i'm afraid except merging 29968618:08
notmynamepatch 29968618:08
patchbotnotmyname: https://review.openstack.org/#/c/299686/ - swift - Fix upgrade bug in versioned_writes18:08
notmynameack18:08
claygacoles: A.B.M. ; A - Always ; B - Be ; M - Merging ; Always Be Merging.18:09
openstackgerritAlistair Coles proposed openstack/swift: Support for http footers - Replication and EC  https://review.openstack.org/23739318:09
notmynameclayg: coffee is for mergers?18:09
claygnotmyname: lol18:09
acolesi'm lost18:10
notmynameacoles: old american movie reference18:10
notmynameboiler room?18:10
claygacoles: yeah sorry18:10
acolesoic18:10
claygnotmyname: i think it was a play?  http://www.imdb.com/title/tt0104348/18:10
notmynameall about high pressure sales. phrase is "ABC always be closing" and "coffee is for closers"18:10
notmynameclayg: oh interesting.18:11
notmynameI've never actually seen it18:11
claygnotmyname:  you can just watch the baldwin doing his thing on youtube - that's the main thing folks make reference to18:11
notmynameyeah, I've done that (of course) ;-)18:12
acolesclayg: notmyname thank you for clarifying, google had led me to "Always Be My Baby". i stopped there :)18:13
notmynameacoles: https://www.youtube.com/watch?v=Q4PE2hSqVnk18:14
claygnotmyname: this one is better -> https://youtu.be/H68eCEWKb7M?t=61  (NSFW)18:17
acolestdasilva: jrichli I just pushed latest on 237393. I *think* its getting a little simpler. I left the BaseObjController knowing about final_phase - tried to see how it could be encapsulated into the MIMEPutter by making the putters track which phase they were dealing with but it seemed like a lot of churn and probably harder to follow the code so i gave up18:17
notmynameclayg: yeah18:17
*** number80 has joined #openstack-swift18:17
*** daemontool_ has quit IRC18:20
*** mmcardle has quit IRC18:20
tdasilvaacoles: looking...18:20
acolesnotmyname: much like a typical daily standup round here :)18:28
notmynamelol18:28
notmynamealways be merging. first prize: new computer. second prize: free download of swift.18:29
tdasilvaacoles: looks like you removed all crypto reference! is determine_crypto_md and trailing_metadata_crypto all encapsulated in the middleware now?18:30
tdasilvaacoles: just wondering why _get_footers wasn't being used before...18:33
*** diogogmt has joined #openstack-swift18:34
acolestdasilva: yes, so i couldn't really figure what those trailing_metadata methods were doing. the way i see it the proxy just calls back the middleware and it gets to update the dict with any footers it has. then for EC we just make sure the Etag that is sent is the fragment etag.18:34
acolestdasilva: oh i just saw you pushed another patch, sorry! did it just remove get_put_responses2?18:34
tdasilvaacoles: yeah18:34
acolestdasilva: ok, i did that too ;)18:35
tdasilvacool! sorry for forgetting that18:35
notmynameclayg: when you get a chance, can you look at the new patch set on https://review.openstack.org/#/c/238799/ ? There's been one since your last review18:35
patchbotnotmyname: patch 238799 - swift - Change schedule priority of daemon/server in config18:35
notmynameclayg: (this is my manual attempt at a script that does this for you) ;-)18:35
acolestdasilva: i figured you were doing exactly what i do when replacing/moving a method :)18:35
* notmyname is walking down the https://wiki.openstack.org/wiki/Swift/PriorityReviews page18:35
tdasilvaacoles: yeah...run tests first, make sure i didn't break anything ;)18:36
tdasilvanotmyname: kota_ left some comments for me on patch 260179, i will get to them today/tomorrow18:36
patchbottdasilva: https://review.openstack.org/#/c/260179/ - swift - decouple versioned writes from COPY18:36
acolesi saw kota_: left a review on patch 260179 - thanks kota_ !18:36
patchbotacoles: https://review.openstack.org/#/c/260179/ - swift - decouple versioned writes from COPY18:36
tdasilvalol18:36
notmynamegreat18:37
acolestdasilva: jrichli i left some comments on patchset 22 of patch 237393, a lot of which i addressed in patchset 24 but there's some queries i am not sure about - like where the connection closing moved to?18:39
patchbotacoles: https://review.openstack.org/#/c/237393/ - swift (feature/crypto) - Support for http footers - Replication and EC18:39
tdasilvaacoles: do you still think _transfer_data can be merged in one?18:40
ahaleclayg: im interested what the operational stuff around rsync is that you mentioned that fallocate percent stuff18:41
claygnotmyname: ahale's point wasn't about "how much space" to reserve - it was "why do I want to reserve more on my 4TB drives than on my 8TB drives?  Even if it's 1% - why do I need twice as much on the larger drives?  a few hundered MB will get you 10K's of tombstones.  The use-case of reserve as a percentage is under question - either folks are only trying to keep back a little and % doesn't make sense - or folks are trying t18:42
claygahale: well since everyone not RAX is still doing rsync replication - i'm just implementing basically some automation around the "fire drill" stuff that we do when clusters get full - all the handoffs first and disable rsync on the full the nodes stuff18:42
ahaleclayg: you ran out of irc at "or folks are trying t"18:43
ahaleah ok18:43
claygahale: except instead of "disable rsync on the full nodes" - i'm using rsync module's per disk to a) get better i/o isolation (no "all 25 connections on the same disk") and also to shut down individual disk as they get full18:43
ahaleyeah my main point was more what yours was initially i think? that as long as you have one box that isn't full then rsync will fill them unless you hack it18:43
claygahale: obviously the expectation is most drives will get near full very close to the same time - but depending on your ingest and how fast replication is pushing - the hope is we'll get the fullest drives drives soonest18:44
ahaleahh ok - does that mean tombstones have to be from deletes on that host then? not replicated in ?18:44
notmynameclayg: yeah, that makes sense. but I also don't want to get into a "your use case isn't valid" situation where we have someone proposing a patch because he's building that automation into his deployment scripts. ostensibly there's some value there. so doign a 1% reserve doesn't seem to harm anything but it does allow for andymccr to get is itch scratched18:45
acolestdasilva: maybe but not sure and tbh my brain is fried :) maybe you will see it or i will look again tomorrow. there is a trade off between 'perfect' refactoring and making the patch 'reviewable'18:45
claygahale: yeah so we already have a little daemon/agent guy that watches disks for fullness - with rsync module per disk - he can just drop a little [object_dXX] max connections = -1 and everyone trying to write data to him gets rejected quick and moves on to trying to find a part-replica that *can* move18:45
ahalelike when we ran rsync, we hacked it to leave 5G on every disk i think, and had the same set in swift as a fixed fallocate_reserve - so a full disk would never sneakily fill18:45
ahaleah ok i guess that works18:45
acolestdasilva: there is some re-naming that could still be useful - where we have inconsistent use of conns and putters, but again i was wary of adding line diff count and putting off reviewers ;)18:45
tdasilvaacoles: I agree...at one point I was even thinking if it would make sense to break this patch down is small pieces18:46
claygnotmyname: maybe?  it's one more knob to document and maintain?  why should we assume andy is on the right track?  And if he *is* onto something - why wouldn't we want to know about it?  (Honestly asking, not sure I disagree - I'm cool with LET THEM HAVE CAKE!)18:46
claygahale: did you guys compile a custom rsync - or just like a ld_preload shim?18:47
ahaleyeah i mean im not opposed at all, just offering ideas why it might immediately not solve the problem people think it might - its not something that impacts us18:47
tdasilvaacoles: nice cleanup of _get_put_responses18:47
ahaleyeah a custom rsync gholt patched18:47
ahalelemme see if i can find it18:47
acolestdasilva: yep, there's probably some of it that is just straight simplifying whats on master18:47
notmynameclayg: ahale yeah, you're right. it's a really good question (what, exactly, is this solving that isn't possible without this patch)18:47
ahalecan you see https://github.com/rackerlabs/cloudfiles-rsync/blob/master/debian/patches/limit-fs-fullness.diff clayg18:48
claygnotmyname: I mean like you said "ostensibly" it solves the ability to give one number to a config and have it mean two numbers depending on the disks - but ... like do you have a situation where that number is so big that it's useful for it to be different?18:49
claygnotmyname: ahale is saying 5G is the number - which is what 0.1% on 4-8TB disks - i was honestly thinking 500M would be enough tombstones for anyone.  But maybe we're missing the point.18:50
ahaleyeah 500M 1G 5G whatevs18:51
claygahale: i can!  nice!18:51
ahaleim just saying limiting your rsync to the same as your swift processes makes sense - and the way we did that would have made rsync builds as new zones with bigger disks land18:52
ahalei dunno, it probably doesnt matter that much really - anyone with disks filling up that much probably has enough other problems to worry about than rsync slowly filling up in the background18:53
*** acoles is now known as acoles_18:54
*** jethrosun has joined #openstack-swift18:55
claygahale: well, yeah clusters getting full is a fire no matter what - but it's annoying enough apparently that Swift not be fighting you while you're trying to fix it that at least you and us have tried to address the rsync issue -18:55
claygthat feeling you're about to ruin your day when you press enter on `sudo pip install --upgrade pip`18:57
*** bkeller` has quit IRC18:59
*** haomaiwang has quit IRC19:01
*** haomaiwang has joined #openstack-swift19:01
*** bkeller` has joined #openstack-swift19:01
*** silor has quit IRC19:11
openstackgerritMichael Barton proposed openstack/swift: go: conf.d support + some refactoring  https://review.openstack.org/30129919:16
claygredbo: ^ whoa!19:26
*** sheel has quit IRC19:27
claygredbo: i'll star it - dust off https://github.com/swiftstack/vagrant-swift-all-in-one/tree/hummingbird and see if I can get unittests passing!?19:27
*** joeljwright has joined #openstack-swift19:48
*** ChanServ sets mode: +v joeljwright19:48
*** shakamunyi has joined #openstack-swift19:51
*** shakamunyi has quit IRC19:57
*** mmcardle has joined #openstack-swift19:57
*** dmorita has quit IRC19:58
*** dmorita has joined #openstack-swift19:59
*** tqtran is now known as tqtran-afk20:00
*** bkeller` has quit IRC20:00
*** haomaiwang has quit IRC20:01
*** haomaiwang has joined #openstack-swift20:01
*** MooingLemur has quit IRC20:01
notmynamecan anyone else actually log in and make schedule selections on https://www.openstack.org/summit/austin-2016/summit-schedule/ ?20:04
clarkbnotmyname: I can20:05
*** bkeller` has joined #openstack-swift20:05
clarkbit uses your openstack foundation profile login20:05
notmynameclarkb: you can save sessions? I can log in to the openstack site overall, but the schedule page still shows "log in" and selecting a session doesn't give me any sort of "save this for later" or other way to mark it20:06
notmynamebasically, I need to build up my calendar for the week20:06
clarkbya I get a little + my calendar thing in each of the items which I can click on and they show up under "switch to my schedule"20:06
notmynameI've tried in chrome and safari. are you, by any chance, using firefox?20:07
clarkbI am using firefox20:07
notmynameapparently, so are the site devs ;-)20:07
notmynameoh, wait! maybe I just hadn't clicked enough20:10
notmynameI found a "(+) My calendar" link. doesn't seem to do anything. or where can I find my schedule?20:11
clarkbthe + changes to a green check mark if it works, you can find the my schedule link at the top of any days main listing20:11
notmynameoh. no, I don't get that20:12
clarkbthe my schedule link is to the right of the Calendar search filters toggle20:12
notmynameclearly I can't computer. not working in any of the 4 browsers I've tried (including firefox)20:18
tdasilvahas anybody played with javaswift? http://javaswift.org/20:23
notmynameno, but that's great!20:24
openstackgerritThiago da Silva proposed openstack/swift: added javaswift to associated projects  https://review.openstack.org/30133320:27
notmynametdasilva: thanks :-)20:28
tdasilvanotmyname: no problem. I just got asked about it, but had never heard of it before :/20:29
*** MooingLemur has joined #openstack-swift20:33
*** tqtran-afk is now known as tqtran20:36
*** shakamunyi has joined #openstack-swift20:53
*** mvk_ has joined #openstack-swift20:57
*** shakamunyi has quit IRC20:58
*** haomaiwang has quit IRC21:01
tdasilvanotmyname: i'm also seeing issues with clicking the + button to add to "my calendar" but when I click "Event Details" button I can see that it did get added to my schedule21:01
*** dmorita has quit IRC21:02
*** haomaiwa_ has joined #openstack-swift21:02
zaitcevI just write the date and time on a piece of paper...21:03
*** asettle has joined #openstack-swift21:04
tdasilvazaitcev: :) that works too21:04
zaitcevtho I don't produce fire by rubbing 2 pieces of wood21:05
*** dmorita has joined #openstack-swift21:09
*** daemontool has joined #openstack-swift21:13
*** pauloewerton has quit IRC21:20
*** haomaiwa_ has quit IRC21:21
*** haomaiwa_ has joined #openstack-swift21:23
*** bkeller` has quit IRC21:35
*** NM has quit IRC21:36
*** bkeller` has joined #openstack-swift21:42
*** daemontool has quit IRC21:45
openstackgerritMerged openstack/swift: Fix upgrade bug in versioned_writes  https://review.openstack.org/29968621:46
timburkeyay!21:46
notmynameyay21:48
notmynamejoeljwright: timburke: FYI https://bugs.launchpad.net/glance-store/+bug/1556059. any thoughts? https://bugs.launchpad.net/glance-store/+bug/155605921:54
openstackLaunchpad bug 1556059 in glance_store mitaka "stable mitaka gate broken after swiftclient release" [Critical,Fix committed] - Assigned to Tom Cocozzello (tjcocozz)21:54
notmynameoops. double paste21:54
timburkenotmyname: sounds like not really our fault? "Due to how glance_store unit tests are implemented (stubbing private functions from swiftclient)..."21:55
joeljwrightI just copied the same21:56
timburkei could probably come up with a patch to do it better21:56
notmynamehttps://review.openstack.org/#/c/291682/21:56
patchbotnotmyname: patch 291682 - glance_store (stable/mitaka) - Mock swiftclient's functions in tests (MERGED)21:56
joeljwrightto make the same comment21:56
timburkehey, yeah... https://review.openstack.org/#/c/291495/ seems familiar... i think i saw that fly by in scrollback a while ago, was going to leave a couple comments, but then noticed it was already merged21:58
patchbottimburke: patch 291495 - glance_store - Mock swiftclient's functions in tests (MERGED)21:58
timburkethings like "We never call swiftclient.client.get_object directly, right, only ever through swiftclient.client.Connection.get_object? Would it be better to just update fake_get_object to reflect that?"21:59
timburkeand "As long as we're already using requests_mock, why not just set the content-length header there?"21:59
*** haomaiwa_ has quit IRC22:01
*** david-lyle_ has joined #openstack-swift22:02
*** david-lyle has quit IRC22:03
*** david-lyle_ is now known as david-lyle22:03
*** ujjain has quit IRC22:06
*** haomaiw__ has joined #openstack-swift22:07
*** bkeller` has quit IRC22:07
*** ujjain has joined #openstack-swift22:10
*** ujjain has quit IRC22:10
*** ujjain has joined #openstack-swift22:10
*** mwheckmann has joined #openstack-swift22:14
*** lyrrad has quit IRC22:18
*** klrmn has quit IRC22:18
timburkenotmyname: submitted https://review.openstack.org/#/c/301373/22:19
patchbottimburke: patch 301373 - glance_store - Fix swiftclient mocks22:19
*** asettle has quit IRC22:24
*** mmcardle has quit IRC22:25
joeljwrighttimburke: so no private stubbing required? nice.22:27
*** nadeem has quit IRC22:28
*** klrmn has joined #openstack-swift22:33
*** mwheckmann has quit IRC22:34
*** asettle has joined #openstack-swift22:36
timburkejoeljwright: really, i suppose i ought to have it mock out Connection. there are still a lot of mocks for things like swiftclient.client.head_object (which they don't directly use)22:38
joeljwrightyeah, that would make sense22:38
*** lyrrad has joined #openstack-swift22:39
joeljwrightbut in the grand scheme, just not mocking out things we're free to change is a good start22:42
*** asettle has quit IRC22:43
*** david-lyle has quit IRC22:44
*** david-lyle has joined #openstack-swift22:47
*** diogogmt has quit IRC22:56
*** diogogmt has joined #openstack-swift22:59
*** km has joined #openstack-swift23:00
*** haomaiw__ has quit IRC23:01
*** haomaiwang has joined #openstack-swift23:03
*** shakamunyi has joined #openstack-swift23:03
*** mingdang1 has joined #openstack-swift23:07
*** lcurtis has quit IRC23:12
*** joeljwright has quit IRC23:12
*** asettle has joined #openstack-swift23:14
*** shakamunyi has quit IRC23:16
*** natarej has joined #openstack-swift23:18
*** chlong has joined #openstack-swift23:18
*** asettle has quit IRC23:19
*** mingdang1 has quit IRC23:23
*** shakamunyi has joined #openstack-swift23:27
*** haomaiwang has quit IRC23:27
*** haomaiwang has joined #openstack-swift23:28
*** kei_yama has joined #openstack-swift23:31
*** shakamunyi has quit IRC23:31
*** shakamunyi has joined #openstack-swift23:43
*** hosanai has joined #openstack-swift23:47
*** ChanServ sets mode: +v hosanai23:47
*** shakamunyi has quit IRC23:47
*** kei_yama has quit IRC23:51
*** kei_yama has joined #openstack-swift23:52
*** asettle has joined #openstack-swift23:54
*** dmorita has quit IRC23:55
*** dmorita has joined #openstack-swift23:56
*** haomaiwang has quit IRC23:57
*** haomaiwang has joined #openstack-swift23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!